[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:11:43.938812  3922 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.212.190:36867
I20260709 12:11:43.940495  3922 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:11:43.941606  3922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:11:43.957540  3928 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:11:43.957551  3929 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:11:43.958528  3931 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:11:43.958787  3922 server_base.cc:1061] running on GCE node
I20260709 12:11:45.082505  3922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:11:45.082768  3922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:11:45.082929  3922 hybrid_clock.cc:648] HybridClock initialized: now 1783599105082911 us; error 0 us; skew 500 ppm
I20260709 12:11:45.083738  3922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:11:45.090245  3922 webserver.cc:533] Webserver started at http://127.3.212.190:43553/ using document root <none> and password file <none>
I20260709 12:11:45.091248  3922 fs_manager.cc:362] Metadata directory not provided
I20260709 12:11:45.091471  3922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:11:45.091931  3922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:11:45.097963  3922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599103767690-3922-0/minicluster-data/master-0-root/instance:
uuid: "da5ee2a8fc594530bda9d3cb0baf3b20"
format_stamp: "Formatted at 2026-07-09 12:11:45 on dist-test-slave-442x"
I20260709 12:11:45.106374  3922 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.003s	sys 0.004s
I20260709 12:11:45.112008  3937 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:11:45.113488  3922 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 12:11:45.113901  3922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599103767690-3922-0/minicluster-data/master-0-root
uuid: "da5ee2a8fc594530bda9d3cb0baf3b20"
format_stamp: "Formatted at 2026-07-09 12:11:45 on dist-test-slave-442x"
I20260709 12:11:45.114226  3922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599103767690-3922-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599103767690-3922-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599103767690-3922-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:11:45.161459  3922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:11:45.163074  3922 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:11:45.163539  3922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:11:45.236133  3922 rpc_server.cc:307] RPC server started. Bound to: 127.3.212.190:36867
I20260709 12:11:45.236214  3988 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.212.190:36867 every 8 connection(s)
I20260709 12:11:45.244158  3989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:45.267045  3989 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da5ee2a8fc594530bda9d3cb0baf3b20: Bootstrap starting.
I20260709 12:11:45.273307  3989 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P da5ee2a8fc594530bda9d3cb0baf3b20: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:45.275375  3989 log.cc:826] T 00000000000000000000000000000000 P da5ee2a8fc594530bda9d3cb0baf3b20: Log is configured to *not* fsync() on all Append() calls
I20260709 12:11:45.281019  3989 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da5ee2a8fc594530bda9d3cb0baf3b20: No bootstrap required, opened a new log
I20260709 12:11:45.302893  3989 raft_consensus.cc:359] T 00000000000000000000000000000000 P da5ee2a8fc594530bda9d3cb0baf3b20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da5ee2a8fc594530bda9d3cb0baf3b20" member_type: VOTER }
I20260709 12:11:45.303459  3989 raft_consensus.cc:385] T 00000000000000000000000000000000 P da5ee2a8fc594530bda9d3cb0baf3b20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:45.303702  3989 raft_consensus.cc:740] T 00000000000000000000000000000000 P da5ee2a8fc594530bda9d3cb0baf3b20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da5ee2a8fc594530bda9d3cb0baf3b20, State: Initialized, Role: FOLLOWER
I20260709 12:11:45.304672  3989 consensus_queue.cc:260] T 00000000000000000000000000000000 P da5ee2a8fc594530bda9d3cb0baf3b20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da5ee2a8fc594530bda9d3cb0baf3b20" member_type: VOTER }
I20260709 12:11:45.305182  3989 raft_consensus.cc:399] T 00000000000000000000000000000000 P da5ee2a8fc594530bda9d3cb0baf3b20 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:11:45.305487  3989 raft_consensus.cc:493] T 00000000000000000000000000000000 P da5ee2a8fc594530bda9d3cb0baf3b20 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:11:45.305797  3989 raft_consensus.cc:3060] T 00000000000000000000000000000000 P da5ee2a8fc594530bda9d3cb0baf3b20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:45.310316  3989 raft_consensus.cc:515] T 00000000000000000000000000000000 P da5ee2a8fc594530bda9d3cb0baf3b20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da5ee2a8fc594530bda9d3cb0baf3b20" member_type: VOTER }
I20260709 12:11:45.311085  3989 leader_election.cc:304] T 00000000000000000000000000000000 P da5ee2a8fc594530bda9d3cb0baf3b20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: da5ee2a8fc594530bda9d3cb0baf3b20; no voters: 
I20260709 12:11:45.312810  3989 leader_election.cc:290] T 00000000000000000000000000000000 P da5ee2a8fc594530bda9d3cb0baf3b20 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:11:45.313234  3992 raft_consensus.cc:2804] T 00000000000000000000000000000000 P da5ee2a8fc594530bda9d3cb0baf3b20 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:11:45.315636  3992 raft_consensus.cc:697] T 00000000000000000000000000000000 P da5ee2a8fc594530bda9d3cb0baf3b20 [term 1 LEADER]: Becoming Leader. State: Replica: da5ee2a8fc594530bda9d3cb0baf3b20, State: Running, Role: LEADER
I20260709 12:11:45.316452  3992 consensus_queue.cc:237] T 00000000000000000000000000000000 P da5ee2a8fc594530bda9d3cb0baf3b20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da5ee2a8fc594530bda9d3cb0baf3b20" member_type: VOTER }
I20260709 12:11:45.317008  3989 sys_catalog.cc:565] T 00000000000000000000000000000000 P da5ee2a8fc594530bda9d3cb0baf3b20 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:11:45.327039  3993 sys_catalog.cc:455] T 00000000000000000000000000000000 P da5ee2a8fc594530bda9d3cb0baf3b20 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "da5ee2a8fc594530bda9d3cb0baf3b20" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da5ee2a8fc594530bda9d3cb0baf3b20" member_type: VOTER } }
I20260709 12:11:45.327911  3993 sys_catalog.cc:458] T 00000000000000000000000000000000 P da5ee2a8fc594530bda9d3cb0baf3b20 [sys.catalog]: This master's current role is: LEADER
I20260709 12:11:45.327589  3994 sys_catalog.cc:455] T 00000000000000000000000000000000 P da5ee2a8fc594530bda9d3cb0baf3b20 [sys.catalog]: SysCatalogTable state changed. Reason: New leader da5ee2a8fc594530bda9d3cb0baf3b20. Latest consensus state: current_term: 1 leader_uuid: "da5ee2a8fc594530bda9d3cb0baf3b20" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da5ee2a8fc594530bda9d3cb0baf3b20" member_type: VOTER } }
I20260709 12:11:45.328365  3994 sys_catalog.cc:458] T 00000000000000000000000000000000 P da5ee2a8fc594530bda9d3cb0baf3b20 [sys.catalog]: This master's current role is: LEADER
I20260709 12:11:45.331331  4001 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:11:45.343981  4001 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:11:45.346482  3922 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:11:45.362818  4001 catalog_manager.cc:1383] Generated new cluster ID: 0791bf7d9c164b658f8415ffb25bb5cb
I20260709 12:11:45.363149  4001 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:11:45.386035  4001 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:11:45.387945  4001 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:11:45.405064  4001 catalog_manager.cc:6070] T 00000000000000000000000000000000 P da5ee2a8fc594530bda9d3cb0baf3b20: Generated new TSK 0
I20260709 12:11:45.406139  4001 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:11:45.413779  3922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:11:45.423172  4011 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:11:45.424425  4012 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:11:45.428795  3922 server_base.cc:1061] running on GCE node
W20260709 12:11:45.428794  4014 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:11:45.430053  3922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:11:45.430359  3922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:11:45.430563  3922 hybrid_clock.cc:648] HybridClock initialized: now 1783599105430546 us; error 0 us; skew 500 ppm
I20260709 12:11:45.431378  3922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:11:45.435597  3922 webserver.cc:533] Webserver started at http://127.3.212.129:38079/ using document root <none> and password file <none>
I20260709 12:11:45.436338  3922 fs_manager.cc:362] Metadata directory not provided
I20260709 12:11:45.436599  3922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:11:45.436942  3922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:11:45.438493  3922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599103767690-3922-0/minicluster-data/ts-0-root/instance:
uuid: "9d299deccaa74c2d8db110a6e6671fcc"
format_stamp: "Formatted at 2026-07-09 12:11:45 on dist-test-slave-442x"
I20260709 12:11:45.445791  3922 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:11:45.451215  4019 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:11:45.452159  3922 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.004s
I20260709 12:11:45.452543  3922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599103767690-3922-0/minicluster-data/ts-0-root
uuid: "9d299deccaa74c2d8db110a6e6671fcc"
format_stamp: "Formatted at 2026-07-09 12:11:45 on dist-test-slave-442x"
I20260709 12:11:45.452934  3922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599103767690-3922-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599103767690-3922-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599103767690-3922-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:11:45.499346  3922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:11:45.501158  3922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:11:45.504086  3922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:11:45.509903  3922 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:11:45.510253  3922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:11:45.510565  3922 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:11:45.510802  3922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:11:45.607306  3922 rpc_server.cc:307] RPC server started. Bound to: 127.3.212.129:35647
I20260709 12:11:45.607453  4081 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.212.129:35647 every 8 connection(s)
I20260709 12:11:45.614275  3922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:11:45.629802  4086 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:11:45.633976  4087 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:11:45.645290  4089 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:11:45.645866  3922 server_base.cc:1061] running on GCE node
I20260709 12:11:45.646677  3922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:11:45.646906  3922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:11:45.647064  3922 hybrid_clock.cc:648] HybridClock initialized: now 1783599105647049 us; error 0 us; skew 500 ppm
I20260709 12:11:45.647629  3922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:11:45.650552  3922 webserver.cc:533] Webserver started at http://127.3.212.130:39843/ using document root <none> and password file <none>
I20260709 12:11:45.651067  3922 fs_manager.cc:362] Metadata directory not provided
I20260709 12:11:45.651264  3922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:11:45.651532  3922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:11:45.652701  3922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599103767690-3922-0/minicluster-data/ts-1-root/instance:
uuid: "342b038803924b2b8625bfd6f2cf4c08"
format_stamp: "Formatted at 2026-07-09 12:11:45 on dist-test-slave-442x"
I20260709 12:11:45.658622  3922 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.003s
I20260709 12:11:45.662883  4082 heartbeater.cc:344] Connected to a master server at 127.3.212.190:36867
I20260709 12:11:45.663473  4082 heartbeater.cc:461] Registering TS with master...
I20260709 12:11:45.664132  4094 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:11:45.664785  4082 heartbeater.cc:507] Master 127.3.212.190:36867 requested a full tablet report, sending...
I20260709 12:11:45.665100  3922 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.000s
I20260709 12:11:45.665457  3922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599103767690-3922-0/minicluster-data/ts-1-root
uuid: "342b038803924b2b8625bfd6f2cf4c08"
format_stamp: "Formatted at 2026-07-09 12:11:45 on dist-test-slave-442x"
I20260709 12:11:45.665827  3922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599103767690-3922-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599103767690-3922-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599103767690-3922-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:11:45.668741  3954 ts_manager.cc:194] Registered new tserver with Master: 9d299deccaa74c2d8db110a6e6671fcc (127.3.212.129:35647)
I20260709 12:11:45.672526  3954 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58576
I20260709 12:11:45.701205  3922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:11:45.702600  3922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:11:45.705166  3922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:11:45.708289  3922 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:11:45.708487  3922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:11:45.708765  3922 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:11:45.708963  3922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:11:45.801111  3922 rpc_server.cc:307] RPC server started. Bound to: 127.3.212.130:39923
I20260709 12:11:45.801436  4156 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.212.130:39923 every 8 connection(s)
I20260709 12:11:45.807358  3922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:11:45.816530  4160 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:11:45.818145  4161 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:11:45.822317  3922 server_base.cc:1061] running on GCE node
I20260709 12:11:45.823199  4157 heartbeater.cc:344] Connected to a master server at 127.3.212.190:36867
I20260709 12:11:45.823559  4157 heartbeater.cc:461] Registering TS with master...
W20260709 12:11:45.823854  4163 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:11:45.824497  4157 heartbeater.cc:507] Master 127.3.212.190:36867 requested a full tablet report, sending...
I20260709 12:11:45.825037  3922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:11:45.825316  3922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:11:45.825556  3922 hybrid_clock.cc:648] HybridClock initialized: now 1783599105825534 us; error 0 us; skew 500 ppm
I20260709 12:11:45.826119  3922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:11:45.827663  3954 ts_manager.cc:194] Registered new tserver with Master: 342b038803924b2b8625bfd6f2cf4c08 (127.3.212.130:39923)
I20260709 12:11:45.829510  3922 webserver.cc:533] Webserver started at http://127.3.212.131:37059/ using document root <none> and password file <none>
I20260709 12:11:45.829613  3954 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58580
I20260709 12:11:45.830286  3922 fs_manager.cc:362] Metadata directory not provided
I20260709 12:11:45.830542  3922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:11:45.830839  3922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:11:45.832150  3922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599103767690-3922-0/minicluster-data/ts-2-root/instance:
uuid: "e4256387244444f3b9c0d54803e74760"
format_stamp: "Formatted at 2026-07-09 12:11:45 on dist-test-slave-442x"
I20260709 12:11:45.836881  3922 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.004s
I20260709 12:11:45.840313  4168 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:11:45.841214  3922 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:11:45.841609  3922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599103767690-3922-0/minicluster-data/ts-2-root
uuid: "e4256387244444f3b9c0d54803e74760"
format_stamp: "Formatted at 2026-07-09 12:11:45 on dist-test-slave-442x"
I20260709 12:11:45.841993  3922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599103767690-3922-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599103767690-3922-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599103767690-3922-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:11:45.897958  3922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:11:45.899207  3922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:11:45.900741  3922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:11:45.903896  3922 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:11:45.904199  3922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:11:45.904529  3922 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:11:45.904686  3922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:11:45.996920  3922 rpc_server.cc:307] RPC server started. Bound to: 127.3.212.131:34743
I20260709 12:11:45.997004  4230 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.212.131:34743 every 8 connection(s)
I20260709 12:11:46.014853  4231 heartbeater.cc:344] Connected to a master server at 127.3.212.190:36867
I20260709 12:11:46.015268  4231 heartbeater.cc:461] Registering TS with master...
I20260709 12:11:46.016012  4231 heartbeater.cc:507] Master 127.3.212.190:36867 requested a full tablet report, sending...
I20260709 12:11:46.018303  3954 ts_manager.cc:194] Registered new tserver with Master: e4256387244444f3b9c0d54803e74760 (127.3.212.131:34743)
I20260709 12:11:46.018879  3922 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017186068s
I20260709 12:11:46.020148  3954 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58586
I20260709 12:11:46.083688  3954 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58602:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:11:46.088891  3954 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:11:46.197561  4196 tablet_service.cc:1511] Processing CreateTablet for tablet b52aa28f64ae441783bcb12eeeb24273 (DEFAULT_TABLE table=test-workload [id=466c89587e2145a888107fc00b8a6fe4]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:11:46.199369  4196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b52aa28f64ae441783bcb12eeeb24273. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:46.202677  4195 tablet_service.cc:1511] Processing CreateTablet for tablet 9e90122ac65e486e80674ceb6d6fcb21 (DEFAULT_TABLE table=test-workload [id=466c89587e2145a888107fc00b8a6fe4]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:11:46.204272  4195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e90122ac65e486e80674ceb6d6fcb21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:46.207279  4194 tablet_service.cc:1511] Processing CreateTablet for tablet 67fd9c39bf234dcb8815c7ce2fd1a07e (DEFAULT_TABLE table=test-workload [id=466c89587e2145a888107fc00b8a6fe4]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:11:46.211431  4193 tablet_service.cc:1511] Processing CreateTablet for tablet 57a371ce6a7d437380ff59166848f1bc (DEFAULT_TABLE table=test-workload [id=466c89587e2145a888107fc00b8a6fe4]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:11:46.214154  4193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57a371ce6a7d437380ff59166848f1bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:46.215322  4192 tablet_service.cc:1511] Processing CreateTablet for tablet 1f7ab1e5604a4859b97af9f666098497 (DEFAULT_TABLE table=test-workload [id=466c89587e2145a888107fc00b8a6fe4]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:11:46.213284  4122 tablet_service.cc:1511] Processing CreateTablet for tablet b52aa28f64ae441783bcb12eeeb24273 (DEFAULT_TABLE table=test-workload [id=466c89587e2145a888107fc00b8a6fe4]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:11:46.219573  4120 tablet_service.cc:1511] Processing CreateTablet for tablet 67fd9c39bf234dcb8815c7ce2fd1a07e (DEFAULT_TABLE table=test-workload [id=466c89587e2145a888107fc00b8a6fe4]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:11:46.222052  4194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67fd9c39bf234dcb8815c7ce2fd1a07e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:46.217124  4121 tablet_service.cc:1511] Processing CreateTablet for tablet 9e90122ac65e486e80674ceb6d6fcb21 (DEFAULT_TABLE table=test-workload [id=466c89587e2145a888107fc00b8a6fe4]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:11:46.225577  4119 tablet_service.cc:1511] Processing CreateTablet for tablet 57a371ce6a7d437380ff59166848f1bc (DEFAULT_TABLE table=test-workload [id=466c89587e2145a888107fc00b8a6fe4]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:11:46.226749  4121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e90122ac65e486e80674ceb6d6fcb21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:46.228982  4192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f7ab1e5604a4859b97af9f666098497. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:46.227934  4117 tablet_service.cc:1511] Processing CreateTablet for tablet 4b596235d44b4a6e976316208bada57c (DEFAULT_TABLE table=test-workload [id=466c89587e2145a888107fc00b8a6fe4]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:11:46.230046  4118 tablet_service.cc:1511] Processing CreateTablet for tablet 1f7ab1e5604a4859b97af9f666098497 (DEFAULT_TABLE table=test-workload [id=466c89587e2145a888107fc00b8a6fe4]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:11:46.233814  4119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57a371ce6a7d437380ff59166848f1bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:46.233203  4191 tablet_service.cc:1511] Processing CreateTablet for tablet 4b596235d44b4a6e976316208bada57c (DEFAULT_TABLE table=test-workload [id=466c89587e2145a888107fc00b8a6fe4]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:11:46.240828  4191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b596235d44b4a6e976316208bada57c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:46.242726  4122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b52aa28f64ae441783bcb12eeeb24273. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:46.244758  4118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f7ab1e5604a4859b97af9f666098497. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:46.248046  4120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67fd9c39bf234dcb8815c7ce2fd1a07e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:46.259109  4116 tablet_service.cc:1511] Processing CreateTablet for tablet 11d2d5e583974e3ea41a0a3ea8e05dd5 (DEFAULT_TABLE table=test-workload [id=466c89587e2145a888107fc00b8a6fe4]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:11:46.263025  4117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b596235d44b4a6e976316208bada57c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:46.268436  4116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11d2d5e583974e3ea41a0a3ea8e05dd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:46.306874  4190 tablet_service.cc:1511] Processing CreateTablet for tablet 11d2d5e583974e3ea41a0a3ea8e05dd5 (DEFAULT_TABLE table=test-workload [id=466c89587e2145a888107fc00b8a6fe4]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:11:46.312505  4190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11d2d5e583974e3ea41a0a3ea8e05dd5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:11:46.336154  4002 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:11:46.366984  4116 tablet_service.cc:1511] Processing CreateTablet for tablet a3682e1e40804ae0a9d4a7a03f7983b2 (DEFAULT_TABLE table=test-workload [id=466c89587e2145a888107fc00b8a6fe4]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:11:46.369807  4189 tablet_service.cc:1511] Processing CreateTablet for tablet a3682e1e40804ae0a9d4a7a03f7983b2 (DEFAULT_TABLE table=test-workload [id=466c89587e2145a888107fc00b8a6fe4]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:11:46.371642  4189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3682e1e40804ae0a9d4a7a03f7983b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:46.369117  4116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3682e1e40804ae0a9d4a7a03f7983b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:46.391710  4249 tablet_bootstrap.cc:492] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P 342b038803924b2b8625bfd6f2cf4c08: Bootstrap starting.
I20260709 12:11:46.396345  4044 tablet_service.cc:1511] Processing CreateTablet for tablet 57a371ce6a7d437380ff59166848f1bc (DEFAULT_TABLE table=test-workload [id=466c89587e2145a888107fc00b8a6fe4]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:11:46.398329  4047 tablet_service.cc:1511] Processing CreateTablet for tablet b52aa28f64ae441783bcb12eeeb24273 (DEFAULT_TABLE table=test-workload [id=466c89587e2145a888107fc00b8a6fe4]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:11:46.405674  4046 tablet_service.cc:1511] Processing CreateTablet for tablet 9e90122ac65e486e80674ceb6d6fcb21 (DEFAULT_TABLE table=test-workload [id=466c89587e2145a888107fc00b8a6fe4]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:11:46.408613  4044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57a371ce6a7d437380ff59166848f1bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:46.401168  4045 tablet_service.cc:1511] Processing CreateTablet for tablet 67fd9c39bf234dcb8815c7ce2fd1a07e (DEFAULT_TABLE table=test-workload [id=466c89587e2145a888107fc00b8a6fe4]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:11:46.415199  4047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b52aa28f64ae441783bcb12eeeb24273. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:46.424252  4039 tablet_service.cc:1511] Processing CreateTablet for tablet a6ccb39b2a244abd87777efcef76ab72 (DEFAULT_TABLE table=test-workload [id=466c89587e2145a888107fc00b8a6fe4]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:11:46.425791  4040 tablet_service.cc:1511] Processing CreateTablet for tablet a3682e1e40804ae0a9d4a7a03f7983b2 (DEFAULT_TABLE table=test-workload [id=466c89587e2145a888107fc00b8a6fe4]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:11:46.421545  4043 tablet_service.cc:1511] Processing CreateTablet for tablet 1f7ab1e5604a4859b97af9f666098497 (DEFAULT_TABLE table=test-workload [id=466c89587e2145a888107fc00b8a6fe4]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:11:46.429240  4250 tablet_bootstrap.cc:492] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P e4256387244444f3b9c0d54803e74760: Bootstrap starting.
I20260709 12:11:46.430600  4041 tablet_service.cc:1511] Processing CreateTablet for tablet 11d2d5e583974e3ea41a0a3ea8e05dd5 (DEFAULT_TABLE table=test-workload [id=466c89587e2145a888107fc00b8a6fe4]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:11:46.432453  4046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e90122ac65e486e80674ceb6d6fcb21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:46.429291  4042 tablet_service.cc:1511] Processing CreateTablet for tablet 4b596235d44b4a6e976316208bada57c (DEFAULT_TABLE table=test-workload [id=466c89587e2145a888107fc00b8a6fe4]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:11:46.434332  4040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3682e1e40804ae0a9d4a7a03f7983b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:46.438011  4043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f7ab1e5604a4859b97af9f666098497. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:46.439534  4045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67fd9c39bf234dcb8815c7ce2fd1a07e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:46.439715  4121 tablet_service.cc:1511] Processing CreateTablet for tablet a6ccb39b2a244abd87777efcef76ab72 (DEFAULT_TABLE table=test-workload [id=466c89587e2145a888107fc00b8a6fe4]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:11:46.447631  4039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6ccb39b2a244abd87777efcef76ab72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:46.448639  4041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11d2d5e583974e3ea41a0a3ea8e05dd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:46.452004  4042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b596235d44b4a6e976316208bada57c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:46.452068  4121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6ccb39b2a244abd87777efcef76ab72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:46.464900  4194 tablet_service.cc:1511] Processing CreateTablet for tablet a6ccb39b2a244abd87777efcef76ab72 (DEFAULT_TABLE table=test-workload [id=466c89587e2145a888107fc00b8a6fe4]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:11:46.467098  4194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6ccb39b2a244abd87777efcef76ab72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:46.485991  4250 tablet_bootstrap.cc:654] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P e4256387244444f3b9c0d54803e74760: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:46.496140  4249 tablet_bootstrap.cc:654] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P 342b038803924b2b8625bfd6f2cf4c08: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:46.559266  4251 tablet_bootstrap.cc:492] T 57a371ce6a7d437380ff59166848f1bc P 9d299deccaa74c2d8db110a6e6671fcc: Bootstrap starting.
I20260709 12:11:46.562438  4250 tablet_bootstrap.cc:492] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P e4256387244444f3b9c0d54803e74760: No bootstrap required, opened a new log
I20260709 12:11:46.562992  4250 ts_tablet_manager.cc:1403] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P e4256387244444f3b9c0d54803e74760: Time spent bootstrapping tablet: real 0.149s	user 0.022s	sys 0.000s
I20260709 12:11:46.565934  4251 tablet_bootstrap.cc:654] T 57a371ce6a7d437380ff59166848f1bc P 9d299deccaa74c2d8db110a6e6671fcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:46.566665  4250 raft_consensus.cc:359] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:46.567492  4250 raft_consensus.cc:385] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:46.567821  4250 raft_consensus.cc:740] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4256387244444f3b9c0d54803e74760, State: Initialized, Role: FOLLOWER
I20260709 12:11:46.568642  4250 consensus_queue.cc:260] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P e4256387244444f3b9c0d54803e74760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:46.570917  4249 tablet_bootstrap.cc:492] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P 342b038803924b2b8625bfd6f2cf4c08: No bootstrap required, opened a new log
I20260709 12:11:46.571696  4249 ts_tablet_manager.cc:1403] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P 342b038803924b2b8625bfd6f2cf4c08: Time spent bootstrapping tablet: real 0.185s	user 0.007s	sys 0.017s
I20260709 12:11:46.575160  4250 ts_tablet_manager.cc:1434] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P e4256387244444f3b9c0d54803e74760: Time spent starting tablet: real 0.012s	user 0.011s	sys 0.000s
I20260709 12:11:46.575378  4249 raft_consensus.cc:359] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:46.576154  4231 heartbeater.cc:499] Master 127.3.212.190:36867 was elected leader, sending a full tablet report...
I20260709 12:11:46.576550  4249 raft_consensus.cc:385] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:46.576920  4249 raft_consensus.cc:740] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 342b038803924b2b8625bfd6f2cf4c08, State: Initialized, Role: FOLLOWER
I20260709 12:11:46.580681  4249 consensus_queue.cc:260] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P 342b038803924b2b8625bfd6f2cf4c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:46.595486  4249 ts_tablet_manager.cc:1434] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P 342b038803924b2b8625bfd6f2cf4c08: Time spent starting tablet: real 0.023s	user 0.010s	sys 0.008s
I20260709 12:11:46.596277  4157 heartbeater.cc:499] Master 127.3.212.190:36867 was elected leader, sending a full tablet report...
I20260709 12:11:46.580669  4250 tablet_bootstrap.cc:492] T 1f7ab1e5604a4859b97af9f666098497 P e4256387244444f3b9c0d54803e74760: Bootstrap starting.
I20260709 12:11:46.606268  4249 tablet_bootstrap.cc:492] T 1f7ab1e5604a4859b97af9f666098497 P 342b038803924b2b8625bfd6f2cf4c08: Bootstrap starting.
I20260709 12:11:46.610231  4250 tablet_bootstrap.cc:654] T 1f7ab1e5604a4859b97af9f666098497 P e4256387244444f3b9c0d54803e74760: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:46.615010  4251 tablet_bootstrap.cc:492] T 57a371ce6a7d437380ff59166848f1bc P 9d299deccaa74c2d8db110a6e6671fcc: No bootstrap required, opened a new log
I20260709 12:11:46.615631  4251 ts_tablet_manager.cc:1403] T 57a371ce6a7d437380ff59166848f1bc P 9d299deccaa74c2d8db110a6e6671fcc: Time spent bootstrapping tablet: real 0.057s	user 0.018s	sys 0.031s
I20260709 12:11:46.617446  4249 tablet_bootstrap.cc:654] T 1f7ab1e5604a4859b97af9f666098497 P 342b038803924b2b8625bfd6f2cf4c08: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:46.618856  4251 raft_consensus.cc:359] T 57a371ce6a7d437380ff59166848f1bc P 9d299deccaa74c2d8db110a6e6671fcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:46.619735  4251 raft_consensus.cc:385] T 57a371ce6a7d437380ff59166848f1bc P 9d299deccaa74c2d8db110a6e6671fcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:46.620105  4251 raft_consensus.cc:740] T 57a371ce6a7d437380ff59166848f1bc P 9d299deccaa74c2d8db110a6e6671fcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d299deccaa74c2d8db110a6e6671fcc, State: Initialized, Role: FOLLOWER
I20260709 12:11:46.620982  4251 consensus_queue.cc:260] T 57a371ce6a7d437380ff59166848f1bc P 9d299deccaa74c2d8db110a6e6671fcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:46.631227  4251 ts_tablet_manager.cc:1434] T 57a371ce6a7d437380ff59166848f1bc P 9d299deccaa74c2d8db110a6e6671fcc: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.004s
I20260709 12:11:46.632186  4082 heartbeater.cc:499] Master 127.3.212.190:36867 was elected leader, sending a full tablet report...
I20260709 12:11:46.632536  4251 tablet_bootstrap.cc:492] T b52aa28f64ae441783bcb12eeeb24273 P 9d299deccaa74c2d8db110a6e6671fcc: Bootstrap starting.
I20260709 12:11:46.645977  4250 tablet_bootstrap.cc:492] T 1f7ab1e5604a4859b97af9f666098497 P e4256387244444f3b9c0d54803e74760: No bootstrap required, opened a new log
I20260709 12:11:46.646713  4250 ts_tablet_manager.cc:1403] T 1f7ab1e5604a4859b97af9f666098497 P e4256387244444f3b9c0d54803e74760: Time spent bootstrapping tablet: real 0.066s	user 0.007s	sys 0.008s
I20260709 12:11:46.650067  4251 tablet_bootstrap.cc:654] T b52aa28f64ae441783bcb12eeeb24273 P 9d299deccaa74c2d8db110a6e6671fcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:46.650650  4250 raft_consensus.cc:359] T 1f7ab1e5604a4859b97af9f666098497 P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:46.652832  4250 raft_consensus.cc:385] T 1f7ab1e5604a4859b97af9f666098497 P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:46.653250  4250 raft_consensus.cc:740] T 1f7ab1e5604a4859b97af9f666098497 P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4256387244444f3b9c0d54803e74760, State: Initialized, Role: FOLLOWER
I20260709 12:11:46.654109  4250 consensus_queue.cc:260] T 1f7ab1e5604a4859b97af9f666098497 P e4256387244444f3b9c0d54803e74760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:46.654718  4249 tablet_bootstrap.cc:492] T 1f7ab1e5604a4859b97af9f666098497 P 342b038803924b2b8625bfd6f2cf4c08: No bootstrap required, opened a new log
I20260709 12:11:46.655629  4249 ts_tablet_manager.cc:1403] T 1f7ab1e5604a4859b97af9f666098497 P 342b038803924b2b8625bfd6f2cf4c08: Time spent bootstrapping tablet: real 0.050s	user 0.018s	sys 0.026s
I20260709 12:11:46.656886  4250 ts_tablet_manager.cc:1434] T 1f7ab1e5604a4859b97af9f666098497 P e4256387244444f3b9c0d54803e74760: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.002s
I20260709 12:11:46.658315  4250 tablet_bootstrap.cc:492] T 57a371ce6a7d437380ff59166848f1bc P e4256387244444f3b9c0d54803e74760: Bootstrap starting.
I20260709 12:11:46.658982  4249 raft_consensus.cc:359] T 1f7ab1e5604a4859b97af9f666098497 P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:46.659789  4249 raft_consensus.cc:385] T 1f7ab1e5604a4859b97af9f666098497 P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:46.660090  4249 raft_consensus.cc:740] T 1f7ab1e5604a4859b97af9f666098497 P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 342b038803924b2b8625bfd6f2cf4c08, State: Initialized, Role: FOLLOWER
I20260709 12:11:46.660861  4249 consensus_queue.cc:260] T 1f7ab1e5604a4859b97af9f666098497 P 342b038803924b2b8625bfd6f2cf4c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:46.663335  4249 ts_tablet_manager.cc:1434] T 1f7ab1e5604a4859b97af9f666098497 P 342b038803924b2b8625bfd6f2cf4c08: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:11:46.664256  4249 tablet_bootstrap.cc:492] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08: Bootstrap starting.
I20260709 12:11:46.671252  4249 tablet_bootstrap.cc:654] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:46.673339  4250 tablet_bootstrap.cc:654] T 57a371ce6a7d437380ff59166848f1bc P e4256387244444f3b9c0d54803e74760: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:46.683190  4251 tablet_bootstrap.cc:492] T b52aa28f64ae441783bcb12eeeb24273 P 9d299deccaa74c2d8db110a6e6671fcc: No bootstrap required, opened a new log
I20260709 12:11:46.683687  4251 ts_tablet_manager.cc:1403] T b52aa28f64ae441783bcb12eeeb24273 P 9d299deccaa74c2d8db110a6e6671fcc: Time spent bootstrapping tablet: real 0.051s	user 0.013s	sys 0.005s
I20260709 12:11:46.686617  4251 raft_consensus.cc:359] T b52aa28f64ae441783bcb12eeeb24273 P 9d299deccaa74c2d8db110a6e6671fcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } }
I20260709 12:11:46.687366  4251 raft_consensus.cc:385] T b52aa28f64ae441783bcb12eeeb24273 P 9d299deccaa74c2d8db110a6e6671fcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:46.687652  4251 raft_consensus.cc:740] T b52aa28f64ae441783bcb12eeeb24273 P 9d299deccaa74c2d8db110a6e6671fcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d299deccaa74c2d8db110a6e6671fcc, State: Initialized, Role: FOLLOWER
I20260709 12:11:46.688377  4251 consensus_queue.cc:260] T b52aa28f64ae441783bcb12eeeb24273 P 9d299deccaa74c2d8db110a6e6671fcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } }
I20260709 12:11:46.690474  4256 raft_consensus.cc:493] T 1f7ab1e5604a4859b97af9f666098497 P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.690960  4256 raft_consensus.cc:515] T 1f7ab1e5604a4859b97af9f666098497 P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:46.693487  4250 tablet_bootstrap.cc:492] T 57a371ce6a7d437380ff59166848f1bc P e4256387244444f3b9c0d54803e74760: No bootstrap required, opened a new log
I20260709 12:11:46.694221  4256 leader_election.cc:290] T 1f7ab1e5604a4859b97af9f666098497 P 342b038803924b2b8625bfd6f2cf4c08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9d299deccaa74c2d8db110a6e6671fcc (127.3.212.129:35647), e4256387244444f3b9c0d54803e74760 (127.3.212.131:34743)
I20260709 12:11:46.695796  4259 raft_consensus.cc:493] T b52aa28f64ae441783bcb12eeeb24273 P 9d299deccaa74c2d8db110a6e6671fcc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.696359  4259 raft_consensus.cc:515] T b52aa28f64ae441783bcb12eeeb24273 P 9d299deccaa74c2d8db110a6e6671fcc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } }
I20260709 12:11:46.699204  4259 leader_election.cc:290] T b52aa28f64ae441783bcb12eeeb24273 P 9d299deccaa74c2d8db110a6e6671fcc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4256387244444f3b9c0d54803e74760 (127.3.212.131:34743), 342b038803924b2b8625bfd6f2cf4c08 (127.3.212.130:39923)
I20260709 12:11:46.701993  4251 ts_tablet_manager.cc:1434] T b52aa28f64ae441783bcb12eeeb24273 P 9d299deccaa74c2d8db110a6e6671fcc: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.002s
I20260709 12:11:46.702986  4251 tablet_bootstrap.cc:492] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P 9d299deccaa74c2d8db110a6e6671fcc: Bootstrap starting.
I20260709 12:11:46.694036  4250 ts_tablet_manager.cc:1403] T 57a371ce6a7d437380ff59166848f1bc P e4256387244444f3b9c0d54803e74760: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.008s
I20260709 12:11:46.719528  4250 raft_consensus.cc:359] T 57a371ce6a7d437380ff59166848f1bc P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:46.722601  4250 raft_consensus.cc:385] T 57a371ce6a7d437380ff59166848f1bc P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:46.720825  4249 tablet_bootstrap.cc:492] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08: No bootstrap required, opened a new log
I20260709 12:11:46.724301  4249 ts_tablet_manager.cc:1403] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08: Time spent bootstrapping tablet: real 0.060s	user 0.017s	sys 0.015s
I20260709 12:11:46.729815  4251 tablet_bootstrap.cc:654] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P 9d299deccaa74c2d8db110a6e6671fcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:46.729754  4249 raft_consensus.cc:359] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:46.730562  4249 raft_consensus.cc:385] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:46.731015  4249 raft_consensus.cc:740] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 342b038803924b2b8625bfd6f2cf4c08, State: Initialized, Role: FOLLOWER
I20260709 12:11:46.731729  4249 consensus_queue.cc:260] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:46.733927  4250 raft_consensus.cc:740] T 57a371ce6a7d437380ff59166848f1bc P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4256387244444f3b9c0d54803e74760, State: Initialized, Role: FOLLOWER
I20260709 12:11:46.739156  4250 consensus_queue.cc:260] T 57a371ce6a7d437380ff59166848f1bc P e4256387244444f3b9c0d54803e74760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:46.740912  4249 ts_tablet_manager.cc:1434] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:11:46.741972  4249 tablet_bootstrap.cc:492] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08: Bootstrap starting.
I20260709 12:11:46.747695  4250 ts_tablet_manager.cc:1434] T 57a371ce6a7d437380ff59166848f1bc P e4256387244444f3b9c0d54803e74760: Time spent starting tablet: real 0.032s	user 0.002s	sys 0.004s
I20260709 12:11:46.748365  4249 tablet_bootstrap.cc:654] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:46.748765  4250 tablet_bootstrap.cc:492] T b52aa28f64ae441783bcb12eeeb24273 P e4256387244444f3b9c0d54803e74760: Bootstrap starting.
W20260709 12:11:46.753964  4232 tablet.cc:2406] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P e4256387244444f3b9c0d54803e74760: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:11:46.760371  4057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f7ab1e5604a4859b97af9f666098497" candidate_uuid: "342b038803924b2b8625bfd6f2cf4c08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d299deccaa74c2d8db110a6e6671fcc" is_pre_election: true
I20260709 12:11:46.766021  4251 tablet_bootstrap.cc:492] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P 9d299deccaa74c2d8db110a6e6671fcc: No bootstrap required, opened a new log
I20260709 12:11:46.766558  4251 ts_tablet_manager.cc:1403] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P 9d299deccaa74c2d8db110a6e6671fcc: Time spent bootstrapping tablet: real 0.064s	user 0.014s	sys 0.008s
W20260709 12:11:46.769079  4095 leader_election.cc:343] T 1f7ab1e5604a4859b97af9f666098497 P 342b038803924b2b8625bfd6f2cf4c08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d299deccaa74c2d8db110a6e6671fcc (127.3.212.129:35647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:11:46.770977  4251 raft_consensus.cc:359] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P 9d299deccaa74c2d8db110a6e6671fcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:46.771857  4251 raft_consensus.cc:385] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P 9d299deccaa74c2d8db110a6e6671fcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:46.772210  4251 raft_consensus.cc:740] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P 9d299deccaa74c2d8db110a6e6671fcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d299deccaa74c2d8db110a6e6671fcc, State: Initialized, Role: FOLLOWER
I20260709 12:11:46.772966  4251 consensus_queue.cc:260] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P 9d299deccaa74c2d8db110a6e6671fcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:46.780848  4206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f7ab1e5604a4859b97af9f666098497" candidate_uuid: "342b038803924b2b8625bfd6f2cf4c08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4256387244444f3b9c0d54803e74760" is_pre_election: true
I20260709 12:11:46.781889  4206 raft_consensus.cc:2468] T 1f7ab1e5604a4859b97af9f666098497 P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 342b038803924b2b8625bfd6f2cf4c08 in term 0.
I20260709 12:11:46.783619  4098 leader_election.cc:304] T 1f7ab1e5604a4859b97af9f666098497 P 342b038803924b2b8625bfd6f2cf4c08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 342b038803924b2b8625bfd6f2cf4c08, e4256387244444f3b9c0d54803e74760; no voters: 9d299deccaa74c2d8db110a6e6671fcc
I20260709 12:11:46.784607  4256 raft_consensus.cc:2804] T 1f7ab1e5604a4859b97af9f666098497 P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:11:46.784962  4256 raft_consensus.cc:493] T 1f7ab1e5604a4859b97af9f666098497 P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:46.785282  4256 raft_consensus.cc:3060] T 1f7ab1e5604a4859b97af9f666098497 P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:46.787233  4251 ts_tablet_manager.cc:1434] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P 9d299deccaa74c2d8db110a6e6671fcc: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 12:11:46.787119  4132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52aa28f64ae441783bcb12eeeb24273" candidate_uuid: "9d299deccaa74c2d8db110a6e6671fcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "342b038803924b2b8625bfd6f2cf4c08" is_pre_election: true
I20260709 12:11:46.788369  4251 tablet_bootstrap.cc:492] T a3682e1e40804ae0a9d4a7a03f7983b2 P 9d299deccaa74c2d8db110a6e6671fcc: Bootstrap starting.
I20260709 12:11:46.788595  4255 raft_consensus.cc:493] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.789052  4255 raft_consensus.cc:515] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
W20260709 12:11:46.790458  4020 leader_election.cc:343] T b52aa28f64ae441783bcb12eeeb24273 P 9d299deccaa74c2d8db110a6e6671fcc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 342b038803924b2b8625bfd6f2cf4c08 (127.3.212.130:39923): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:11:46.792812  4255 leader_election.cc:290] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P e4256387244444f3b9c0d54803e74760 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9d299deccaa74c2d8db110a6e6671fcc (127.3.212.129:35647), 342b038803924b2b8625bfd6f2cf4c08 (127.3.212.130:39923)
I20260709 12:11:46.793517  4256 raft_consensus.cc:515] T 1f7ab1e5604a4859b97af9f666098497 P 342b038803924b2b8625bfd6f2cf4c08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:46.794148  4206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52aa28f64ae441783bcb12eeeb24273" candidate_uuid: "9d299deccaa74c2d8db110a6e6671fcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4256387244444f3b9c0d54803e74760" is_pre_election: true
I20260709 12:11:46.795185  4249 tablet_bootstrap.cc:492] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08: No bootstrap required, opened a new log
I20260709 12:11:46.795651  4249 ts_tablet_manager.cc:1403] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08: Time spent bootstrapping tablet: real 0.054s	user 0.009s	sys 0.021s
W20260709 12:11:46.795969  4023 leader_election.cc:343] T b52aa28f64ae441783bcb12eeeb24273 P 9d299deccaa74c2d8db110a6e6671fcc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4256387244444f3b9c0d54803e74760 (127.3.212.131:34743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:11:46.796398  4023 leader_election.cc:304] T b52aa28f64ae441783bcb12eeeb24273 P 9d299deccaa74c2d8db110a6e6671fcc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d299deccaa74c2d8db110a6e6671fcc; no voters: 342b038803924b2b8625bfd6f2cf4c08, e4256387244444f3b9c0d54803e74760
I20260709 12:11:46.797042  4057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f7ab1e5604a4859b97af9f666098497" candidate_uuid: "342b038803924b2b8625bfd6f2cf4c08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d299deccaa74c2d8db110a6e6671fcc"
I20260709 12:11:46.797324  4259 raft_consensus.cc:2749] T b52aa28f64ae441783bcb12eeeb24273 P 9d299deccaa74c2d8db110a6e6671fcc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:11:46.797974  4206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f7ab1e5604a4859b97af9f666098497" candidate_uuid: "342b038803924b2b8625bfd6f2cf4c08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4256387244444f3b9c0d54803e74760"
W20260709 12:11:46.798372  4095 leader_election.cc:343] T 1f7ab1e5604a4859b97af9f666098497 P 342b038803924b2b8625bfd6f2cf4c08 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9d299deccaa74c2d8db110a6e6671fcc (127.3.212.129:35647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:11:46.798501  4206 raft_consensus.cc:3060] T 1f7ab1e5604a4859b97af9f666098497 P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:46.805506  4256 leader_election.cc:290] T 1f7ab1e5604a4859b97af9f666098497 P 342b038803924b2b8625bfd6f2cf4c08 [CANDIDATE]: Term 1 election: Requested vote from peers 9d299deccaa74c2d8db110a6e6671fcc (127.3.212.129:35647), e4256387244444f3b9c0d54803e74760 (127.3.212.131:34743)
I20260709 12:11:46.806522  4251 tablet_bootstrap.cc:654] T a3682e1e40804ae0a9d4a7a03f7983b2 P 9d299deccaa74c2d8db110a6e6671fcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:46.807066  4206 raft_consensus.cc:2468] T 1f7ab1e5604a4859b97af9f666098497 P e4256387244444f3b9c0d54803e74760 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 342b038803924b2b8625bfd6f2cf4c08 in term 1.
I20260709 12:11:46.807858  4250 tablet_bootstrap.cc:654] T b52aa28f64ae441783bcb12eeeb24273 P e4256387244444f3b9c0d54803e74760: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:46.808475  4098 leader_election.cc:304] T 1f7ab1e5604a4859b97af9f666098497 P 342b038803924b2b8625bfd6f2cf4c08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 342b038803924b2b8625bfd6f2cf4c08, e4256387244444f3b9c0d54803e74760; no voters: 9d299deccaa74c2d8db110a6e6671fcc
I20260709 12:11:46.809317  4256 raft_consensus.cc:2804] T 1f7ab1e5604a4859b97af9f666098497 P 342b038803924b2b8625bfd6f2cf4c08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:11:46.812228  4249 raft_consensus.cc:359] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:46.813788  4249 raft_consensus.cc:385] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:46.814208  4249 raft_consensus.cc:740] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 342b038803924b2b8625bfd6f2cf4c08, State: Initialized, Role: FOLLOWER
I20260709 12:11:46.815200  4256 raft_consensus.cc:697] T 1f7ab1e5604a4859b97af9f666098497 P 342b038803924b2b8625bfd6f2cf4c08 [term 1 LEADER]: Becoming Leader. State: Replica: 342b038803924b2b8625bfd6f2cf4c08, State: Running, Role: LEADER
I20260709 12:11:46.815044  4249 consensus_queue.cc:260] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:46.816205  4256 consensus_queue.cc:237] T 1f7ab1e5604a4859b97af9f666098497 P 342b038803924b2b8625bfd6f2cf4c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:46.817735  4249 ts_tablet_manager.cc:1434] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.006s
I20260709 12:11:46.818930  4249 tablet_bootstrap.cc:492] T b52aa28f64ae441783bcb12eeeb24273 P 342b038803924b2b8625bfd6f2cf4c08: Bootstrap starting.
I20260709 12:11:46.820607  4251 tablet_bootstrap.cc:492] T a3682e1e40804ae0a9d4a7a03f7983b2 P 9d299deccaa74c2d8db110a6e6671fcc: No bootstrap required, opened a new log
I20260709 12:11:46.821102  4251 ts_tablet_manager.cc:1403] T a3682e1e40804ae0a9d4a7a03f7983b2 P 9d299deccaa74c2d8db110a6e6671fcc: Time spent bootstrapping tablet: real 0.033s	user 0.006s	sys 0.006s
I20260709 12:11:46.825572  4249 tablet_bootstrap.cc:654] T b52aa28f64ae441783bcb12eeeb24273 P 342b038803924b2b8625bfd6f2cf4c08: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:46.828329  4251 raft_consensus.cc:359] T a3682e1e40804ae0a9d4a7a03f7983b2 P 9d299deccaa74c2d8db110a6e6671fcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:46.829164  4251 raft_consensus.cc:385] T a3682e1e40804ae0a9d4a7a03f7983b2 P 9d299deccaa74c2d8db110a6e6671fcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:46.829320  4057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d2d5e583974e3ea41a0a3ea8e05dd5" candidate_uuid: "e4256387244444f3b9c0d54803e74760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d299deccaa74c2d8db110a6e6671fcc" is_pre_election: true
I20260709 12:11:46.829528  4251 raft_consensus.cc:740] T a3682e1e40804ae0a9d4a7a03f7983b2 P 9d299deccaa74c2d8db110a6e6671fcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d299deccaa74c2d8db110a6e6671fcc, State: Initialized, Role: FOLLOWER
I20260709 12:11:46.830159  4057 raft_consensus.cc:2468] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P 9d299deccaa74c2d8db110a6e6671fcc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4256387244444f3b9c0d54803e74760 in term 0.
I20260709 12:11:46.830689  4251 consensus_queue.cc:260] T a3682e1e40804ae0a9d4a7a03f7983b2 P 9d299deccaa74c2d8db110a6e6671fcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:46.831996  4169 leader_election.cc:304] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P e4256387244444f3b9c0d54803e74760 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d299deccaa74c2d8db110a6e6671fcc, e4256387244444f3b9c0d54803e74760; no voters: 
I20260709 12:11:46.832909  4255 raft_consensus.cc:2804] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:11:46.833284  4255 raft_consensus.cc:493] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:46.833647  4255 raft_consensus.cc:3060] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:46.834158  4251 ts_tablet_manager.cc:1434] T a3682e1e40804ae0a9d4a7a03f7983b2 P 9d299deccaa74c2d8db110a6e6671fcc: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:11:46.835225  4251 tablet_bootstrap.cc:492] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 9d299deccaa74c2d8db110a6e6671fcc: Bootstrap starting.
I20260709 12:11:46.842423  4255 raft_consensus.cc:515] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P e4256387244444f3b9c0d54803e74760 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:46.843824  4249 tablet_bootstrap.cc:492] T b52aa28f64ae441783bcb12eeeb24273 P 342b038803924b2b8625bfd6f2cf4c08: No bootstrap required, opened a new log
I20260709 12:11:46.844462  4249 ts_tablet_manager.cc:1403] T b52aa28f64ae441783bcb12eeeb24273 P 342b038803924b2b8625bfd6f2cf4c08: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.004s
I20260709 12:11:46.844748  4255 leader_election.cc:290] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P e4256387244444f3b9c0d54803e74760 [CANDIDATE]: Term 1 election: Requested vote from peers 9d299deccaa74c2d8db110a6e6671fcc (127.3.212.129:35647), 342b038803924b2b8625bfd6f2cf4c08 (127.3.212.130:39923)
I20260709 12:11:46.840756  4259 raft_consensus.cc:493] T a3682e1e40804ae0a9d4a7a03f7983b2 P 9d299deccaa74c2d8db110a6e6671fcc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.845587  4259 raft_consensus.cc:515] T a3682e1e40804ae0a9d4a7a03f7983b2 P 9d299deccaa74c2d8db110a6e6671fcc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:46.846117  4057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d2d5e583974e3ea41a0a3ea8e05dd5" candidate_uuid: "e4256387244444f3b9c0d54803e74760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d299deccaa74c2d8db110a6e6671fcc"
I20260709 12:11:46.846735  4057 raft_consensus.cc:3060] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P 9d299deccaa74c2d8db110a6e6671fcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:46.849017  4132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3682e1e40804ae0a9d4a7a03f7983b2" candidate_uuid: "9d299deccaa74c2d8db110a6e6671fcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "342b038803924b2b8625bfd6f2cf4c08" is_pre_election: true
I20260709 12:11:46.849790  4259 leader_election.cc:290] T a3682e1e40804ae0a9d4a7a03f7983b2 P 9d299deccaa74c2d8db110a6e6671fcc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 342b038803924b2b8625bfd6f2cf4c08 (127.3.212.130:39923), e4256387244444f3b9c0d54803e74760 (127.3.212.131:34743)
W20260709 12:11:46.850538  4020 leader_election.cc:343] T a3682e1e40804ae0a9d4a7a03f7983b2 P 9d299deccaa74c2d8db110a6e6671fcc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 342b038803924b2b8625bfd6f2cf4c08 (127.3.212.130:39923): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:11:46.851320  4206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3682e1e40804ae0a9d4a7a03f7983b2" candidate_uuid: "9d299deccaa74c2d8db110a6e6671fcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4256387244444f3b9c0d54803e74760" is_pre_election: true
W20260709 12:11:46.853238  4023 leader_election.cc:343] T a3682e1e40804ae0a9d4a7a03f7983b2 P 9d299deccaa74c2d8db110a6e6671fcc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4256387244444f3b9c0d54803e74760 (127.3.212.131:34743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:11:46.853905  4023 leader_election.cc:304] T a3682e1e40804ae0a9d4a7a03f7983b2 P 9d299deccaa74c2d8db110a6e6671fcc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d299deccaa74c2d8db110a6e6671fcc; no voters: 342b038803924b2b8625bfd6f2cf4c08, e4256387244444f3b9c0d54803e74760
I20260709 12:11:46.854651  4259 raft_consensus.cc:2749] T a3682e1e40804ae0a9d4a7a03f7983b2 P 9d299deccaa74c2d8db110a6e6671fcc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:11:46.857401  4249 raft_consensus.cc:359] T b52aa28f64ae441783bcb12eeeb24273 P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } }
I20260709 12:11:46.859097  4057 raft_consensus.cc:2468] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P 9d299deccaa74c2d8db110a6e6671fcc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4256387244444f3b9c0d54803e74760 in term 1.
I20260709 12:11:46.857798  3954 catalog_manager.cc:5697] T 1f7ab1e5604a4859b97af9f666098497 P 342b038803924b2b8625bfd6f2cf4c08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 342b038803924b2b8625bfd6f2cf4c08 (127.3.212.130). New cstate: current_term: 1 leader_uuid: "342b038803924b2b8625bfd6f2cf4c08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:46.860812  4169 leader_election.cc:304] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P e4256387244444f3b9c0d54803e74760 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d299deccaa74c2d8db110a6e6671fcc, e4256387244444f3b9c0d54803e74760; no voters: 
I20260709 12:11:46.861356  4251 tablet_bootstrap.cc:654] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 9d299deccaa74c2d8db110a6e6671fcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:46.858668  4249 raft_consensus.cc:385] T b52aa28f64ae441783bcb12eeeb24273 P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:46.862406  4255 raft_consensus.cc:2804] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P e4256387244444f3b9c0d54803e74760 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:11:46.862262  4249 raft_consensus.cc:740] T b52aa28f64ae441783bcb12eeeb24273 P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 342b038803924b2b8625bfd6f2cf4c08, State: Initialized, Role: FOLLOWER
I20260709 12:11:46.866225  4250 tablet_bootstrap.cc:492] T b52aa28f64ae441783bcb12eeeb24273 P e4256387244444f3b9c0d54803e74760: No bootstrap required, opened a new log
I20260709 12:11:46.866756  4250 ts_tablet_manager.cc:1403] T b52aa28f64ae441783bcb12eeeb24273 P e4256387244444f3b9c0d54803e74760: Time spent bootstrapping tablet: real 0.118s	user 0.028s	sys 0.003s
I20260709 12:11:46.869235  4249 consensus_queue.cc:260] T b52aa28f64ae441783bcb12eeeb24273 P 342b038803924b2b8625bfd6f2cf4c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } }
I20260709 12:11:46.876595  4249 ts_tablet_manager.cc:1434] T b52aa28f64ae441783bcb12eeeb24273 P 342b038803924b2b8625bfd6f2cf4c08: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.002s
I20260709 12:11:46.877897  4249 tablet_bootstrap.cc:492] T 9e90122ac65e486e80674ceb6d6fcb21 P 342b038803924b2b8625bfd6f2cf4c08: Bootstrap starting.
I20260709 12:11:46.877763  4132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d2d5e583974e3ea41a0a3ea8e05dd5" candidate_uuid: "e4256387244444f3b9c0d54803e74760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "342b038803924b2b8625bfd6f2cf4c08" is_pre_election: true
I20260709 12:11:46.879109  4255 raft_consensus.cc:697] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P e4256387244444f3b9c0d54803e74760 [term 1 LEADER]: Becoming Leader. State: Replica: e4256387244444f3b9c0d54803e74760, State: Running, Role: LEADER
I20260709 12:11:46.878418  4132 raft_consensus.cc:2468] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4256387244444f3b9c0d54803e74760 in term 0.
I20260709 12:11:46.879810  4131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d2d5e583974e3ea41a0a3ea8e05dd5" candidate_uuid: "e4256387244444f3b9c0d54803e74760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "342b038803924b2b8625bfd6f2cf4c08"
I20260709 12:11:46.879561  4250 raft_consensus.cc:359] T b52aa28f64ae441783bcb12eeeb24273 P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } }
I20260709 12:11:46.881886  4250 raft_consensus.cc:385] T b52aa28f64ae441783bcb12eeeb24273 P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:46.881945  4131 raft_consensus.cc:3060] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:46.882284  4250 raft_consensus.cc:740] T b52aa28f64ae441783bcb12eeeb24273 P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4256387244444f3b9c0d54803e74760, State: Initialized, Role: FOLLOWER
I20260709 12:11:46.883041  4250 consensus_queue.cc:260] T b52aa28f64ae441783bcb12eeeb24273 P e4256387244444f3b9c0d54803e74760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } }
I20260709 12:11:46.888397  4249 tablet_bootstrap.cc:654] T 9e90122ac65e486e80674ceb6d6fcb21 P 342b038803924b2b8625bfd6f2cf4c08: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:46.880753  4255 consensus_queue.cc:237] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P e4256387244444f3b9c0d54803e74760 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:46.891680  4251 tablet_bootstrap.cc:492] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 9d299deccaa74c2d8db110a6e6671fcc: No bootstrap required, opened a new log
I20260709 12:11:46.892285  4251 ts_tablet_manager.cc:1403] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 9d299deccaa74c2d8db110a6e6671fcc: Time spent bootstrapping tablet: real 0.057s	user 0.020s	sys 0.004s
I20260709 12:11:46.895404  4251 raft_consensus.cc:359] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 9d299deccaa74c2d8db110a6e6671fcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:46.896355  4251 raft_consensus.cc:385] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 9d299deccaa74c2d8db110a6e6671fcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:46.896708  4251 raft_consensus.cc:740] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 9d299deccaa74c2d8db110a6e6671fcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d299deccaa74c2d8db110a6e6671fcc, State: Initialized, Role: FOLLOWER
I20260709 12:11:46.897544  4251 consensus_queue.cc:260] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 9d299deccaa74c2d8db110a6e6671fcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:46.898952  4131 raft_consensus.cc:2468] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P 342b038803924b2b8625bfd6f2cf4c08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4256387244444f3b9c0d54803e74760 in term 1.
I20260709 12:11:46.899850  4251 ts_tablet_manager.cc:1434] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 9d299deccaa74c2d8db110a6e6671fcc: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:11:46.901209  4251 tablet_bootstrap.cc:492] T a6ccb39b2a244abd87777efcef76ab72 P 9d299deccaa74c2d8db110a6e6671fcc: Bootstrap starting.
I20260709 12:11:46.902887  4249 tablet_bootstrap.cc:492] T 9e90122ac65e486e80674ceb6d6fcb21 P 342b038803924b2b8625bfd6f2cf4c08: No bootstrap required, opened a new log
I20260709 12:11:46.903369  4249 ts_tablet_manager.cc:1403] T 9e90122ac65e486e80674ceb6d6fcb21 P 342b038803924b2b8625bfd6f2cf4c08: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.003s
I20260709 12:11:46.907395  4251 tablet_bootstrap.cc:654] T a6ccb39b2a244abd87777efcef76ab72 P 9d299deccaa74c2d8db110a6e6671fcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:46.909744  4250 ts_tablet_manager.cc:1434] T b52aa28f64ae441783bcb12eeeb24273 P e4256387244444f3b9c0d54803e74760: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.010s
I20260709 12:11:46.910871  4250 tablet_bootstrap.cc:492] T 9e90122ac65e486e80674ceb6d6fcb21 P e4256387244444f3b9c0d54803e74760: Bootstrap starting.
I20260709 12:11:46.912900  4249 raft_consensus.cc:359] T 9e90122ac65e486e80674ceb6d6fcb21 P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:46.913749  4249 raft_consensus.cc:385] T 9e90122ac65e486e80674ceb6d6fcb21 P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:46.914064  4249 raft_consensus.cc:740] T 9e90122ac65e486e80674ceb6d6fcb21 P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 342b038803924b2b8625bfd6f2cf4c08, State: Initialized, Role: FOLLOWER
I20260709 12:11:46.914863  4249 consensus_queue.cc:260] T 9e90122ac65e486e80674ceb6d6fcb21 P 342b038803924b2b8625bfd6f2cf4c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:46.917832  4250 tablet_bootstrap.cc:654] T 9e90122ac65e486e80674ceb6d6fcb21 P e4256387244444f3b9c0d54803e74760: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:46.918566  4251 tablet_bootstrap.cc:492] T a6ccb39b2a244abd87777efcef76ab72 P 9d299deccaa74c2d8db110a6e6671fcc: No bootstrap required, opened a new log
I20260709 12:11:46.918773  4249 ts_tablet_manager.cc:1434] T 9e90122ac65e486e80674ceb6d6fcb21 P 342b038803924b2b8625bfd6f2cf4c08: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.001s
I20260709 12:11:46.919064  4251 ts_tablet_manager.cc:1403] T a6ccb39b2a244abd87777efcef76ab72 P 9d299deccaa74c2d8db110a6e6671fcc: Time spent bootstrapping tablet: real 0.018s	user 0.005s	sys 0.012s
I20260709 12:11:46.919755  4249 tablet_bootstrap.cc:492] T 4b596235d44b4a6e976316208bada57c P 342b038803924b2b8625bfd6f2cf4c08: Bootstrap starting.
I20260709 12:11:46.921936  4251 raft_consensus.cc:359] T a6ccb39b2a244abd87777efcef76ab72 P 9d299deccaa74c2d8db110a6e6671fcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:46.922672  4251 raft_consensus.cc:385] T a6ccb39b2a244abd87777efcef76ab72 P 9d299deccaa74c2d8db110a6e6671fcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:46.923017  4251 raft_consensus.cc:740] T a6ccb39b2a244abd87777efcef76ab72 P 9d299deccaa74c2d8db110a6e6671fcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d299deccaa74c2d8db110a6e6671fcc, State: Initialized, Role: FOLLOWER
I20260709 12:11:46.924079  4251 consensus_queue.cc:260] T a6ccb39b2a244abd87777efcef76ab72 P 9d299deccaa74c2d8db110a6e6671fcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:46.922912  3951 catalog_manager.cc:5697] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P e4256387244444f3b9c0d54803e74760 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4256387244444f3b9c0d54803e74760 (127.3.212.131). New cstate: current_term: 1 leader_uuid: "e4256387244444f3b9c0d54803e74760" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:46.927506  4249 tablet_bootstrap.cc:654] T 4b596235d44b4a6e976316208bada57c P 342b038803924b2b8625bfd6f2cf4c08: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:46.934444  4251 ts_tablet_manager.cc:1434] T a6ccb39b2a244abd87777efcef76ab72 P 9d299deccaa74c2d8db110a6e6671fcc: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:11:46.935673  4251 tablet_bootstrap.cc:492] T 9e90122ac65e486e80674ceb6d6fcb21 P 9d299deccaa74c2d8db110a6e6671fcc: Bootstrap starting.
I20260709 12:11:46.940500  4249 tablet_bootstrap.cc:492] T 4b596235d44b4a6e976316208bada57c P 342b038803924b2b8625bfd6f2cf4c08: No bootstrap required, opened a new log
I20260709 12:11:46.941048  4249 ts_tablet_manager.cc:1403] T 4b596235d44b4a6e976316208bada57c P 342b038803924b2b8625bfd6f2cf4c08: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.000s
I20260709 12:11:46.942369  4251 tablet_bootstrap.cc:654] T 9e90122ac65e486e80674ceb6d6fcb21 P 9d299deccaa74c2d8db110a6e6671fcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:46.944201  4249 raft_consensus.cc:359] T 4b596235d44b4a6e976316208bada57c P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:46.944947  4249 raft_consensus.cc:385] T 4b596235d44b4a6e976316208bada57c P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:46.945222  4249 raft_consensus.cc:740] T 4b596235d44b4a6e976316208bada57c P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 342b038803924b2b8625bfd6f2cf4c08, State: Initialized, Role: FOLLOWER
I20260709 12:11:46.946141  4249 consensus_queue.cc:260] T 4b596235d44b4a6e976316208bada57c P 342b038803924b2b8625bfd6f2cf4c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:46.947665  4256 raft_consensus.cc:493] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.948151  4256 raft_consensus.cc:515] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:46.950515  4256 leader_election.cc:290] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9d299deccaa74c2d8db110a6e6671fcc (127.3.212.129:35647), e4256387244444f3b9c0d54803e74760 (127.3.212.131:34743)
I20260709 12:11:46.951855  4057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fd9c39bf234dcb8815c7ce2fd1a07e" candidate_uuid: "342b038803924b2b8625bfd6f2cf4c08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d299deccaa74c2d8db110a6e6671fcc" is_pre_election: true
I20260709 12:11:46.952598  4249 ts_tablet_manager.cc:1434] T 4b596235d44b4a6e976316208bada57c P 342b038803924b2b8625bfd6f2cf4c08: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 12:11:46.953022  4206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fd9c39bf234dcb8815c7ce2fd1a07e" candidate_uuid: "342b038803924b2b8625bfd6f2cf4c08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4256387244444f3b9c0d54803e74760" is_pre_election: true
I20260709 12:11:46.953708  4249 tablet_bootstrap.cc:492] T a3682e1e40804ae0a9d4a7a03f7983b2 P 342b038803924b2b8625bfd6f2cf4c08: Bootstrap starting.
W20260709 12:11:46.954594  4098 leader_election.cc:343] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4256387244444f3b9c0d54803e74760 (127.3.212.131:34743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:11:46.952512  4057 raft_consensus.cc:2468] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 9d299deccaa74c2d8db110a6e6671fcc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 342b038803924b2b8625bfd6f2cf4c08 in term 0.
I20260709 12:11:46.956436  4095 leader_election.cc:304] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 342b038803924b2b8625bfd6f2cf4c08, 9d299deccaa74c2d8db110a6e6671fcc; no voters: e4256387244444f3b9c0d54803e74760
I20260709 12:11:46.957896  4256 raft_consensus.cc:2804] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:11:46.958304  4256 raft_consensus.cc:493] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:46.958650  4256 raft_consensus.cc:3060] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:46.963804  4273 raft_consensus.cc:493] T 9e90122ac65e486e80674ceb6d6fcb21 P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.964347  4273 raft_consensus.cc:515] T 9e90122ac65e486e80674ceb6d6fcb21 P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:46.968214  4206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e90122ac65e486e80674ceb6d6fcb21" candidate_uuid: "342b038803924b2b8625bfd6f2cf4c08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4256387244444f3b9c0d54803e74760" is_pre_election: true
I20260709 12:11:46.974884  4255 raft_consensus.cc:493] T b52aa28f64ae441783bcb12eeeb24273 P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.988649  4255 raft_consensus.cc:515] T b52aa28f64ae441783bcb12eeeb24273 P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } }
I20260709 12:11:46.991138  4255 leader_election.cc:290] T b52aa28f64ae441783bcb12eeeb24273 P e4256387244444f3b9c0d54803e74760 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 342b038803924b2b8625bfd6f2cf4c08 (127.3.212.130:39923), 9d299deccaa74c2d8db110a6e6671fcc (127.3.212.129:35647)
I20260709 12:11:46.966735  4273 leader_election.cc:290] T 9e90122ac65e486e80674ceb6d6fcb21 P 342b038803924b2b8625bfd6f2cf4c08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9d299deccaa74c2d8db110a6e6671fcc (127.3.212.129:35647), e4256387244444f3b9c0d54803e74760 (127.3.212.131:34743)
I20260709 12:11:46.991871  4273 raft_consensus.cc:493] T b52aa28f64ae441783bcb12eeeb24273 P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.992333  4273 raft_consensus.cc:515] T b52aa28f64ae441783bcb12eeeb24273 P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } }
I20260709 12:11:46.992915  4131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52aa28f64ae441783bcb12eeeb24273" candidate_uuid: "e4256387244444f3b9c0d54803e74760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "342b038803924b2b8625bfd6f2cf4c08" is_pre_election: true
I20260709 12:11:46.993921  4056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52aa28f64ae441783bcb12eeeb24273" candidate_uuid: "e4256387244444f3b9c0d54803e74760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d299deccaa74c2d8db110a6e6671fcc" is_pre_election: true
I20260709 12:11:46.994534  4273 leader_election.cc:290] T b52aa28f64ae441783bcb12eeeb24273 P 342b038803924b2b8625bfd6f2cf4c08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4256387244444f3b9c0d54803e74760 (127.3.212.131:34743), 9d299deccaa74c2d8db110a6e6671fcc (127.3.212.129:35647)
I20260709 12:11:46.969345  4250 tablet_bootstrap.cc:492] T 9e90122ac65e486e80674ceb6d6fcb21 P e4256387244444f3b9c0d54803e74760: No bootstrap required, opened a new log
I20260709 12:11:46.996006  4131 raft_consensus.cc:2468] T b52aa28f64ae441783bcb12eeeb24273 P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4256387244444f3b9c0d54803e74760 in term 0.
I20260709 12:11:46.997272  4205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52aa28f64ae441783bcb12eeeb24273" candidate_uuid: "342b038803924b2b8625bfd6f2cf4c08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4256387244444f3b9c0d54803e74760" is_pre_election: true
I20260709 12:11:46.997478  4169 leader_election.cc:304] T b52aa28f64ae441783bcb12eeeb24273 P e4256387244444f3b9c0d54803e74760 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 342b038803924b2b8625bfd6f2cf4c08, e4256387244444f3b9c0d54803e74760; no voters: 
I20260709 12:11:46.998027  4205 raft_consensus.cc:2468] T b52aa28f64ae441783bcb12eeeb24273 P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 342b038803924b2b8625bfd6f2cf4c08 in term 0.
I20260709 12:11:46.998513  4255 raft_consensus.cc:2804] T b52aa28f64ae441783bcb12eeeb24273 P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:11:46.998906  4255 raft_consensus.cc:493] T b52aa28f64ae441783bcb12eeeb24273 P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:46.999271  4255 raft_consensus.cc:3060] T b52aa28f64ae441783bcb12eeeb24273 P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:46.999449  4098 leader_election.cc:304] T b52aa28f64ae441783bcb12eeeb24273 P 342b038803924b2b8625bfd6f2cf4c08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 342b038803924b2b8625bfd6f2cf4c08, e4256387244444f3b9c0d54803e74760; no voters: 
I20260709 12:11:46.967859  4057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e90122ac65e486e80674ceb6d6fcb21" candidate_uuid: "342b038803924b2b8625bfd6f2cf4c08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d299deccaa74c2d8db110a6e6671fcc" is_pre_election: true
W20260709 12:11:47.005477  4098 leader_election.cc:343] T 9e90122ac65e486e80674ceb6d6fcb21 P 342b038803924b2b8625bfd6f2cf4c08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4256387244444f3b9c0d54803e74760 (127.3.212.131:34743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:11:46.965358  4256 raft_consensus.cc:515] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:46.994686  4056 raft_consensus.cc:2468] T b52aa28f64ae441783bcb12eeeb24273 P 9d299deccaa74c2d8db110a6e6671fcc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4256387244444f3b9c0d54803e74760 in term 0.
I20260709 12:11:47.008299  4250 ts_tablet_manager.cc:1403] T 9e90122ac65e486e80674ceb6d6fcb21 P e4256387244444f3b9c0d54803e74760: Time spent bootstrapping tablet: real 0.098s	user 0.026s	sys 0.018s
I20260709 12:11:47.011839  4250 raft_consensus.cc:359] T 9e90122ac65e486e80674ceb6d6fcb21 P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:47.012688  4250 raft_consensus.cc:385] T 9e90122ac65e486e80674ceb6d6fcb21 P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:47.013041  4250 raft_consensus.cc:740] T 9e90122ac65e486e80674ceb6d6fcb21 P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4256387244444f3b9c0d54803e74760, State: Initialized, Role: FOLLOWER
I20260709 12:11:47.013718  4273 raft_consensus.cc:2804] T b52aa28f64ae441783bcb12eeeb24273 P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:11:47.014343  4273 raft_consensus.cc:493] T b52aa28f64ae441783bcb12eeeb24273 P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:47.014735  4273 raft_consensus.cc:3060] T b52aa28f64ae441783bcb12eeeb24273 P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:47.021010  4057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52aa28f64ae441783bcb12eeeb24273" candidate_uuid: "342b038803924b2b8625bfd6f2cf4c08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d299deccaa74c2d8db110a6e6671fcc" is_pre_election: true
I20260709 12:11:47.022768  4057 raft_consensus.cc:2468] T b52aa28f64ae441783bcb12eeeb24273 P 9d299deccaa74c2d8db110a6e6671fcc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 342b038803924b2b8625bfd6f2cf4c08 in term 0.
W20260709 12:11:47.022042  4095 leader_election.cc:343] T 9e90122ac65e486e80674ceb6d6fcb21 P 342b038803924b2b8625bfd6f2cf4c08 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d299deccaa74c2d8db110a6e6671fcc (127.3.212.129:35647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:11:47.023921  4095 leader_election.cc:304] T 9e90122ac65e486e80674ceb6d6fcb21 P 342b038803924b2b8625bfd6f2cf4c08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 342b038803924b2b8625bfd6f2cf4c08; no voters: 9d299deccaa74c2d8db110a6e6671fcc, e4256387244444f3b9c0d54803e74760
I20260709 12:11:47.023798  4255 raft_consensus.cc:515] T b52aa28f64ae441783bcb12eeeb24273 P e4256387244444f3b9c0d54803e74760 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } }
I20260709 12:11:47.024813  4250 consensus_queue.cc:260] T 9e90122ac65e486e80674ceb6d6fcb21 P e4256387244444f3b9c0d54803e74760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:47.028949  4256 leader_election.cc:290] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08 [CANDIDATE]: Term 1 election: Requested vote from peers 9d299deccaa74c2d8db110a6e6671fcc (127.3.212.129:35647), e4256387244444f3b9c0d54803e74760 (127.3.212.131:34743)
I20260709 12:11:47.032058  4291 raft_consensus.cc:2749] T 9e90122ac65e486e80674ceb6d6fcb21 P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:11:47.033921  4249 tablet_bootstrap.cc:654] T a3682e1e40804ae0a9d4a7a03f7983b2 P 342b038803924b2b8625bfd6f2cf4c08: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:47.035277  4255 leader_election.cc:290] T b52aa28f64ae441783bcb12eeeb24273 P e4256387244444f3b9c0d54803e74760 [CANDIDATE]: Term 1 election: Requested vote from peers 342b038803924b2b8625bfd6f2cf4c08 (127.3.212.130:39923), 9d299deccaa74c2d8db110a6e6671fcc (127.3.212.129:35647)
I20260709 12:11:47.035856  4057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fd9c39bf234dcb8815c7ce2fd1a07e" candidate_uuid: "342b038803924b2b8625bfd6f2cf4c08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d299deccaa74c2d8db110a6e6671fcc"
I20260709 12:11:47.035913  4131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52aa28f64ae441783bcb12eeeb24273" candidate_uuid: "e4256387244444f3b9c0d54803e74760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "342b038803924b2b8625bfd6f2cf4c08"
I20260709 12:11:47.037232  4250 ts_tablet_manager.cc:1434] T 9e90122ac65e486e80674ceb6d6fcb21 P e4256387244444f3b9c0d54803e74760: Time spent starting tablet: real 0.028s	user 0.011s	sys 0.001s
I20260709 12:11:47.037134  4056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52aa28f64ae441783bcb12eeeb24273" candidate_uuid: "e4256387244444f3b9c0d54803e74760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d299deccaa74c2d8db110a6e6671fcc"
I20260709 12:11:47.037873  4057 raft_consensus.cc:3060] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 9d299deccaa74c2d8db110a6e6671fcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:47.037838  4056 raft_consensus.cc:3060] T b52aa28f64ae441783bcb12eeeb24273 P 9d299deccaa74c2d8db110a6e6671fcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:47.038849  4206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fd9c39bf234dcb8815c7ce2fd1a07e" candidate_uuid: "342b038803924b2b8625bfd6f2cf4c08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4256387244444f3b9c0d54803e74760"
I20260709 12:11:47.039296  4273 raft_consensus.cc:515] T b52aa28f64ae441783bcb12eeeb24273 P 342b038803924b2b8625bfd6f2cf4c08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } }
I20260709 12:11:47.041729  4251 tablet_bootstrap.cc:492] T 9e90122ac65e486e80674ceb6d6fcb21 P 9d299deccaa74c2d8db110a6e6671fcc: No bootstrap required, opened a new log
I20260709 12:11:47.042225  4131 raft_consensus.cc:2393] T b52aa28f64ae441783bcb12eeeb24273 P 342b038803924b2b8625bfd6f2cf4c08 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e4256387244444f3b9c0d54803e74760 in current term 1: Already voted for candidate 342b038803924b2b8625bfd6f2cf4c08 in this term.
I20260709 12:11:47.042192  4251 ts_tablet_manager.cc:1403] T 9e90122ac65e486e80674ceb6d6fcb21 P 9d299deccaa74c2d8db110a6e6671fcc: Time spent bootstrapping tablet: real 0.107s	user 0.034s	sys 0.031s
I20260709 12:11:47.042627  4250 tablet_bootstrap.cc:492] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760: Bootstrap starting.
I20260709 12:11:47.044521  4255 raft_consensus.cc:493] T 57a371ce6a7d437380ff59166848f1bc P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.048643  4251 raft_consensus.cc:359] T 9e90122ac65e486e80674ceb6d6fcb21 P 9d299deccaa74c2d8db110a6e6671fcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:47.049466  4251 raft_consensus.cc:385] T 9e90122ac65e486e80674ceb6d6fcb21 P 9d299deccaa74c2d8db110a6e6671fcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:47.049767  4251 raft_consensus.cc:740] T 9e90122ac65e486e80674ceb6d6fcb21 P 9d299deccaa74c2d8db110a6e6671fcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d299deccaa74c2d8db110a6e6671fcc, State: Initialized, Role: FOLLOWER
W20260709 12:11:47.051651  4098 leader_election.cc:343] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e4256387244444f3b9c0d54803e74760 (127.3.212.131:34743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:11:47.053232  4291 raft_consensus.cc:493] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.050530  4251 consensus_queue.cc:260] T 9e90122ac65e486e80674ceb6d6fcb21 P 9d299deccaa74c2d8db110a6e6671fcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:47.053771  4291 raft_consensus.cc:515] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:47.059718  4251 ts_tablet_manager.cc:1434] T 9e90122ac65e486e80674ceb6d6fcb21 P 9d299deccaa74c2d8db110a6e6671fcc: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 12:11:47.061789  4251 tablet_bootstrap.cc:492] T 1f7ab1e5604a4859b97af9f666098497 P 9d299deccaa74c2d8db110a6e6671fcc: Bootstrap starting.
I20260709 12:11:47.067902  4205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a371ce6a7d437380ff59166848f1bc" candidate_uuid: "342b038803924b2b8625bfd6f2cf4c08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4256387244444f3b9c0d54803e74760" is_pre_election: true
I20260709 12:11:47.045292  4255 raft_consensus.cc:515] T 57a371ce6a7d437380ff59166848f1bc P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:47.066563  4055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52aa28f64ae441783bcb12eeeb24273" candidate_uuid: "342b038803924b2b8625bfd6f2cf4c08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d299deccaa74c2d8db110a6e6671fcc"
I20260709 12:11:47.065518  4291 leader_election.cc:290] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9d299deccaa74c2d8db110a6e6671fcc (127.3.212.129:35647), e4256387244444f3b9c0d54803e74760 (127.3.212.131:34743)
I20260709 12:11:47.068712  4273 leader_election.cc:290] T b52aa28f64ae441783bcb12eeeb24273 P 342b038803924b2b8625bfd6f2cf4c08 [CANDIDATE]: Term 1 election: Requested vote from peers e4256387244444f3b9c0d54803e74760 (127.3.212.131:34743), 9d299deccaa74c2d8db110a6e6671fcc (127.3.212.129:35647)
I20260709 12:11:47.071895  4054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a371ce6a7d437380ff59166848f1bc" candidate_uuid: "342b038803924b2b8625bfd6f2cf4c08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d299deccaa74c2d8db110a6e6671fcc" is_pre_election: true
I20260709 12:11:47.073880  4054 raft_consensus.cc:2468] T 57a371ce6a7d437380ff59166848f1bc P 9d299deccaa74c2d8db110a6e6671fcc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 342b038803924b2b8625bfd6f2cf4c08 in term 0.
I20260709 12:11:47.073880  4205 raft_consensus.cc:2468] T 57a371ce6a7d437380ff59166848f1bc P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 342b038803924b2b8625bfd6f2cf4c08 in term 0.
I20260709 12:11:47.076994  4250 tablet_bootstrap.cc:654] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:47.076426  4098 leader_election.cc:304] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 342b038803924b2b8625bfd6f2cf4c08, e4256387244444f3b9c0d54803e74760; no voters: 
I20260709 12:11:47.080648  4206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52aa28f64ae441783bcb12eeeb24273" candidate_uuid: "342b038803924b2b8625bfd6f2cf4c08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4256387244444f3b9c0d54803e74760"
I20260709 12:11:47.081490  4206 raft_consensus.cc:2393] T b52aa28f64ae441783bcb12eeeb24273 P e4256387244444f3b9c0d54803e74760 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 342b038803924b2b8625bfd6f2cf4c08 in current term 1: Already voted for candidate e4256387244444f3b9c0d54803e74760 in this term.
I20260709 12:11:47.082063  4273 raft_consensus.cc:2804] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:11:47.082422  4273 raft_consensus.cc:493] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:47.082779  4273 raft_consensus.cc:3060] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:47.082597  4098 leader_election.cc:304] T b52aa28f64ae441783bcb12eeeb24273 P 342b038803924b2b8625bfd6f2cf4c08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 342b038803924b2b8625bfd6f2cf4c08; no voters: 9d299deccaa74c2d8db110a6e6671fcc, e4256387244444f3b9c0d54803e74760
I20260709 12:11:47.083849  4291 raft_consensus.cc:2749] T b52aa28f64ae441783bcb12eeeb24273 P 342b038803924b2b8625bfd6f2cf4c08 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:11:47.088147  4255 leader_election.cc:290] T 57a371ce6a7d437380ff59166848f1bc P e4256387244444f3b9c0d54803e74760 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9d299deccaa74c2d8db110a6e6671fcc (127.3.212.129:35647), 342b038803924b2b8625bfd6f2cf4c08 (127.3.212.130:39923)
I20260709 12:11:47.086103  4056 raft_consensus.cc:2468] T b52aa28f64ae441783bcb12eeeb24273 P 9d299deccaa74c2d8db110a6e6671fcc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4256387244444f3b9c0d54803e74760 in term 1.
I20260709 12:11:47.089402  4131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a371ce6a7d437380ff59166848f1bc" candidate_uuid: "e4256387244444f3b9c0d54803e74760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "342b038803924b2b8625bfd6f2cf4c08" is_pre_election: true
I20260709 12:11:47.089732  4054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a371ce6a7d437380ff59166848f1bc" candidate_uuid: "e4256387244444f3b9c0d54803e74760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d299deccaa74c2d8db110a6e6671fcc" is_pre_election: true
I20260709 12:11:47.072836  4057 raft_consensus.cc:2468] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 9d299deccaa74c2d8db110a6e6671fcc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 342b038803924b2b8625bfd6f2cf4c08 in term 1.
I20260709 12:11:47.092005  4169 leader_election.cc:304] T b52aa28f64ae441783bcb12eeeb24273 P e4256387244444f3b9c0d54803e74760 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d299deccaa74c2d8db110a6e6671fcc, e4256387244444f3b9c0d54803e74760; no voters: 342b038803924b2b8625bfd6f2cf4c08
I20260709 12:11:47.092463  4095 leader_election.cc:304] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 342b038803924b2b8625bfd6f2cf4c08, 9d299deccaa74c2d8db110a6e6671fcc; no voters: e4256387244444f3b9c0d54803e74760
I20260709 12:11:47.090999  4054 raft_consensus.cc:2468] T 57a371ce6a7d437380ff59166848f1bc P 9d299deccaa74c2d8db110a6e6671fcc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4256387244444f3b9c0d54803e74760 in term 0.
I20260709 12:11:47.095508  4251 tablet_bootstrap.cc:654] T 1f7ab1e5604a4859b97af9f666098497 P 9d299deccaa74c2d8db110a6e6671fcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:47.095325  4169 leader_election.cc:304] T 57a371ce6a7d437380ff59166848f1bc P e4256387244444f3b9c0d54803e74760 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d299deccaa74c2d8db110a6e6671fcc, e4256387244444f3b9c0d54803e74760; no voters: 
I20260709 12:11:47.096338  4281 raft_consensus.cc:2804] T b52aa28f64ae441783bcb12eeeb24273 P e4256387244444f3b9c0d54803e74760 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:11:47.096349  4291 raft_consensus.cc:2804] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:11:47.096866  4281 raft_consensus.cc:697] T b52aa28f64ae441783bcb12eeeb24273 P e4256387244444f3b9c0d54803e74760 [term 1 LEADER]: Becoming Leader. State: Replica: e4256387244444f3b9c0d54803e74760, State: Running, Role: LEADER
I20260709 12:11:47.097266  4291 raft_consensus.cc:697] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08 [term 1 LEADER]: Becoming Leader. State: Replica: 342b038803924b2b8625bfd6f2cf4c08, State: Running, Role: LEADER
I20260709 12:11:47.097779  4281 consensus_queue.cc:237] T b52aa28f64ae441783bcb12eeeb24273 P e4256387244444f3b9c0d54803e74760 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } }
I20260709 12:11:47.098394  4291 consensus_queue.cc:237] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:47.096490  4255 raft_consensus.cc:2804] T 57a371ce6a7d437380ff59166848f1bc P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:11:47.101227  4255 raft_consensus.cc:493] T 57a371ce6a7d437380ff59166848f1bc P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:47.101724  4255 raft_consensus.cc:3060] T 57a371ce6a7d437380ff59166848f1bc P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:47.105962  4249 tablet_bootstrap.cc:492] T a3682e1e40804ae0a9d4a7a03f7983b2 P 342b038803924b2b8625bfd6f2cf4c08: No bootstrap required, opened a new log
I20260709 12:11:47.106437  4249 ts_tablet_manager.cc:1403] T a3682e1e40804ae0a9d4a7a03f7983b2 P 342b038803924b2b8625bfd6f2cf4c08: Time spent bootstrapping tablet: real 0.153s	user 0.010s	sys 0.004s
I20260709 12:11:47.112214  4255 raft_consensus.cc:515] T 57a371ce6a7d437380ff59166848f1bc P e4256387244444f3b9c0d54803e74760 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:47.095288  4273 raft_consensus.cc:515] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:47.115598  4131 raft_consensus.cc:2393] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4256387244444f3b9c0d54803e74760 in current term 1: Already voted for candidate 342b038803924b2b8625bfd6f2cf4c08 in this term.
I20260709 12:11:47.120010  4054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a371ce6a7d437380ff59166848f1bc" candidate_uuid: "342b038803924b2b8625bfd6f2cf4c08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d299deccaa74c2d8db110a6e6671fcc"
I20260709 12:11:47.120746  4054 raft_consensus.cc:3060] T 57a371ce6a7d437380ff59166848f1bc P 9d299deccaa74c2d8db110a6e6671fcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:47.121286  4273 leader_election.cc:290] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08 [CANDIDATE]: Term 1 election: Requested vote from peers 9d299deccaa74c2d8db110a6e6671fcc (127.3.212.129:35647), e4256387244444f3b9c0d54803e74760 (127.3.212.131:34743)
I20260709 12:11:47.109153  4249 raft_consensus.cc:359] T a3682e1e40804ae0a9d4a7a03f7983b2 P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:47.122319  4249 raft_consensus.cc:385] T a3682e1e40804ae0a9d4a7a03f7983b2 P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:47.122599  4249 raft_consensus.cc:740] T a3682e1e40804ae0a9d4a7a03f7983b2 P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 342b038803924b2b8625bfd6f2cf4c08, State: Initialized, Role: FOLLOWER
I20260709 12:11:47.123317  4249 consensus_queue.cc:260] T a3682e1e40804ae0a9d4a7a03f7983b2 P 342b038803924b2b8625bfd6f2cf4c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:47.127635  4206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a371ce6a7d437380ff59166848f1bc" candidate_uuid: "342b038803924b2b8625bfd6f2cf4c08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4256387244444f3b9c0d54803e74760"
I20260709 12:11:47.128460  4206 raft_consensus.cc:2393] T 57a371ce6a7d437380ff59166848f1bc P e4256387244444f3b9c0d54803e74760 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 342b038803924b2b8625bfd6f2cf4c08 in current term 1: Already voted for candidate e4256387244444f3b9c0d54803e74760 in this term.
I20260709 12:11:47.126531  3951 catalog_manager.cc:5697] T b52aa28f64ae441783bcb12eeeb24273 P e4256387244444f3b9c0d54803e74760 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4256387244444f3b9c0d54803e74760 (127.3.212.131). New cstate: current_term: 1 leader_uuid: "e4256387244444f3b9c0d54803e74760" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:47.131753  4259 raft_consensus.cc:493] T a6ccb39b2a244abd87777efcef76ab72 P 9d299deccaa74c2d8db110a6e6671fcc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.132248  4259 raft_consensus.cc:515] T a6ccb39b2a244abd87777efcef76ab72 P 9d299deccaa74c2d8db110a6e6671fcc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:47.136344  4259 leader_election.cc:290] T a6ccb39b2a244abd87777efcef76ab72 P 9d299deccaa74c2d8db110a6e6671fcc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 342b038803924b2b8625bfd6f2cf4c08 (127.3.212.130:39923), e4256387244444f3b9c0d54803e74760 (127.3.212.131:34743)
I20260709 12:11:47.138166  4206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ccb39b2a244abd87777efcef76ab72" candidate_uuid: "9d299deccaa74c2d8db110a6e6671fcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4256387244444f3b9c0d54803e74760" is_pre_election: true
I20260709 12:11:47.138376  4131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ccb39b2a244abd87777efcef76ab72" candidate_uuid: "9d299deccaa74c2d8db110a6e6671fcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "342b038803924b2b8625bfd6f2cf4c08" is_pre_election: true
I20260709 12:11:47.139647  4054 raft_consensus.cc:2468] T 57a371ce6a7d437380ff59166848f1bc P 9d299deccaa74c2d8db110a6e6671fcc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 342b038803924b2b8625bfd6f2cf4c08 in term 1.
W20260709 12:11:47.139976  4023 leader_election.cc:343] T a6ccb39b2a244abd87777efcef76ab72 P 9d299deccaa74c2d8db110a6e6671fcc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4256387244444f3b9c0d54803e74760 (127.3.212.131:34743): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:11:47.140956  4095 leader_election.cc:304] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 342b038803924b2b8625bfd6f2cf4c08, 9d299deccaa74c2d8db110a6e6671fcc; no voters: e4256387244444f3b9c0d54803e74760
W20260709 12:11:47.142460  4020 leader_election.cc:343] T a6ccb39b2a244abd87777efcef76ab72 P 9d299deccaa74c2d8db110a6e6671fcc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 342b038803924b2b8625bfd6f2cf4c08 (127.3.212.130:39923): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:11:47.142938  4020 leader_election.cc:304] T a6ccb39b2a244abd87777efcef76ab72 P 9d299deccaa74c2d8db110a6e6671fcc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d299deccaa74c2d8db110a6e6671fcc; no voters: 342b038803924b2b8625bfd6f2cf4c08, e4256387244444f3b9c0d54803e74760
I20260709 12:11:47.144151  4259 raft_consensus.cc:2749] T a6ccb39b2a244abd87777efcef76ab72 P 9d299deccaa74c2d8db110a6e6671fcc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:11:47.145586  4250 tablet_bootstrap.cc:492] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760: No bootstrap required, opened a new log
I20260709 12:11:47.146080  4250 ts_tablet_manager.cc:1403] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760: Time spent bootstrapping tablet: real 0.104s	user 0.013s	sys 0.004s
I20260709 12:11:47.149631  4273 raft_consensus.cc:2804] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:11:47.150652  4273 raft_consensus.cc:697] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08 [term 1 LEADER]: Becoming Leader. State: Replica: 342b038803924b2b8625bfd6f2cf4c08, State: Running, Role: LEADER
I20260709 12:11:47.151024  4054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a371ce6a7d437380ff59166848f1bc" candidate_uuid: "e4256387244444f3b9c0d54803e74760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d299deccaa74c2d8db110a6e6671fcc"
I20260709 12:11:47.151798  4054 raft_consensus.cc:2393] T 57a371ce6a7d437380ff59166848f1bc P 9d299deccaa74c2d8db110a6e6671fcc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e4256387244444f3b9c0d54803e74760 in current term 1: Already voted for candidate 342b038803924b2b8625bfd6f2cf4c08 in this term.
I20260709 12:11:47.151495  4273 consensus_queue.cc:237] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:47.155102  4249 ts_tablet_manager.cc:1434] T a3682e1e40804ae0a9d4a7a03f7983b2 P 342b038803924b2b8625bfd6f2cf4c08: Time spent starting tablet: real 0.048s	user 0.005s	sys 0.003s
I20260709 12:11:47.154803  4131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a371ce6a7d437380ff59166848f1bc" candidate_uuid: "e4256387244444f3b9c0d54803e74760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "342b038803924b2b8625bfd6f2cf4c08"
I20260709 12:11:47.154888  3951 catalog_manager.cc:5697] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 342b038803924b2b8625bfd6f2cf4c08 (127.3.212.130). New cstate: current_term: 1 leader_uuid: "342b038803924b2b8625bfd6f2cf4c08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:47.156186  4249 tablet_bootstrap.cc:492] T a6ccb39b2a244abd87777efcef76ab72 P 342b038803924b2b8625bfd6f2cf4c08: Bootstrap starting.
I20260709 12:11:47.156654  4169 leader_election.cc:304] T 57a371ce6a7d437380ff59166848f1bc P e4256387244444f3b9c0d54803e74760 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4256387244444f3b9c0d54803e74760; no voters: 342b038803924b2b8625bfd6f2cf4c08, 9d299deccaa74c2d8db110a6e6671fcc
I20260709 12:11:47.157477  4255 leader_election.cc:290] T 57a371ce6a7d437380ff59166848f1bc P e4256387244444f3b9c0d54803e74760 [CANDIDATE]: Term 1 election: Requested vote from peers 9d299deccaa74c2d8db110a6e6671fcc (127.3.212.129:35647), 342b038803924b2b8625bfd6f2cf4c08 (127.3.212.130:39923)
I20260709 12:11:47.157444  4281 raft_consensus.cc:2749] T 57a371ce6a7d437380ff59166848f1bc P e4256387244444f3b9c0d54803e74760 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:11:47.149092  4250 raft_consensus.cc:359] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:47.158998  4250 raft_consensus.cc:385] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:47.159368  4250 raft_consensus.cc:740] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4256387244444f3b9c0d54803e74760, State: Initialized, Role: FOLLOWER
I20260709 12:11:47.160195  4250 consensus_queue.cc:260] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:47.162714  4250 ts_tablet_manager.cc:1434] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:11:47.163635  4250 tablet_bootstrap.cc:492] T 67fd9c39bf234dcb8815c7ce2fd1a07e P e4256387244444f3b9c0d54803e74760: Bootstrap starting.
I20260709 12:11:47.167280  4251 tablet_bootstrap.cc:492] T 1f7ab1e5604a4859b97af9f666098497 P 9d299deccaa74c2d8db110a6e6671fcc: No bootstrap required, opened a new log
I20260709 12:11:47.167753  4251 ts_tablet_manager.cc:1403] T 1f7ab1e5604a4859b97af9f666098497 P 9d299deccaa74c2d8db110a6e6671fcc: Time spent bootstrapping tablet: real 0.107s	user 0.027s	sys 0.024s
I20260709 12:11:47.170400  4251 raft_consensus.cc:359] T 1f7ab1e5604a4859b97af9f666098497 P 9d299deccaa74c2d8db110a6e6671fcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:47.172461  4251 raft_consensus.cc:385] T 1f7ab1e5604a4859b97af9f666098497 P 9d299deccaa74c2d8db110a6e6671fcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:47.172781  4251 raft_consensus.cc:740] T 1f7ab1e5604a4859b97af9f666098497 P 9d299deccaa74c2d8db110a6e6671fcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d299deccaa74c2d8db110a6e6671fcc, State: Initialized, Role: FOLLOWER
I20260709 12:11:47.173553  4251 consensus_queue.cc:260] T 1f7ab1e5604a4859b97af9f666098497 P 9d299deccaa74c2d8db110a6e6671fcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:47.175825  4251 ts_tablet_manager.cc:1434] T 1f7ab1e5604a4859b97af9f666098497 P 9d299deccaa74c2d8db110a6e6671fcc: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 12:11:47.176769  4251 tablet_bootstrap.cc:492] T 4b596235d44b4a6e976316208bada57c P 9d299deccaa74c2d8db110a6e6671fcc: Bootstrap starting.
I20260709 12:11:47.177701  4249 tablet_bootstrap.cc:654] T a6ccb39b2a244abd87777efcef76ab72 P 342b038803924b2b8625bfd6f2cf4c08: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:47.182410  4251 tablet_bootstrap.cc:654] T 4b596235d44b4a6e976316208bada57c P 9d299deccaa74c2d8db110a6e6671fcc: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:47.188179  3953 catalog_manager.cc:5697] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 342b038803924b2b8625bfd6f2cf4c08 (127.3.212.130). New cstate: current_term: 1 leader_uuid: "342b038803924b2b8625bfd6f2cf4c08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:47.191874  4251 tablet_bootstrap.cc:492] T 4b596235d44b4a6e976316208bada57c P 9d299deccaa74c2d8db110a6e6671fcc: No bootstrap required, opened a new log
I20260709 12:11:47.192242  4251 ts_tablet_manager.cc:1403] T 4b596235d44b4a6e976316208bada57c P 9d299deccaa74c2d8db110a6e6671fcc: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.007s
I20260709 12:11:47.194398  4251 raft_consensus.cc:359] T 4b596235d44b4a6e976316208bada57c P 9d299deccaa74c2d8db110a6e6671fcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:47.195063  4251 raft_consensus.cc:385] T 4b596235d44b4a6e976316208bada57c P 9d299deccaa74c2d8db110a6e6671fcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:47.195358  4249 tablet_bootstrap.cc:492] T a6ccb39b2a244abd87777efcef76ab72 P 342b038803924b2b8625bfd6f2cf4c08: No bootstrap required, opened a new log
I20260709 12:11:47.195328  4251 raft_consensus.cc:740] T 4b596235d44b4a6e976316208bada57c P 9d299deccaa74c2d8db110a6e6671fcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d299deccaa74c2d8db110a6e6671fcc, State: Initialized, Role: FOLLOWER
I20260709 12:11:47.195825  4249 ts_tablet_manager.cc:1403] T a6ccb39b2a244abd87777efcef76ab72 P 342b038803924b2b8625bfd6f2cf4c08: Time spent bootstrapping tablet: real 0.040s	user 0.010s	sys 0.000s
I20260709 12:11:47.196170  4251 consensus_queue.cc:260] T 4b596235d44b4a6e976316208bada57c P 9d299deccaa74c2d8db110a6e6671fcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:47.198370  4249 raft_consensus.cc:359] T a6ccb39b2a244abd87777efcef76ab72 P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:47.198877  4251 ts_tablet_manager.cc:1434] T 4b596235d44b4a6e976316208bada57c P 9d299deccaa74c2d8db110a6e6671fcc: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 12:11:47.199019  4249 raft_consensus.cc:385] T a6ccb39b2a244abd87777efcef76ab72 P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:47.199312  4249 raft_consensus.cc:740] T a6ccb39b2a244abd87777efcef76ab72 P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 342b038803924b2b8625bfd6f2cf4c08, State: Initialized, Role: FOLLOWER
I20260709 12:11:47.199899  4249 consensus_queue.cc:260] T a6ccb39b2a244abd87777efcef76ab72 P 342b038803924b2b8625bfd6f2cf4c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:47.202052  4249 ts_tablet_manager.cc:1434] T a6ccb39b2a244abd87777efcef76ab72 P 342b038803924b2b8625bfd6f2cf4c08: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:11:47.204303  4259 raft_consensus.cc:493] T 1f7ab1e5604a4859b97af9f666098497 P 9d299deccaa74c2d8db110a6e6671fcc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.204803  4259 raft_consensus.cc:515] T 1f7ab1e5604a4859b97af9f666098497 P 9d299deccaa74c2d8db110a6e6671fcc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:47.206527  4250 tablet_bootstrap.cc:654] T 67fd9c39bf234dcb8815c7ce2fd1a07e P e4256387244444f3b9c0d54803e74760: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:47.206907  4259 leader_election.cc:290] T 1f7ab1e5604a4859b97af9f666098497 P 9d299deccaa74c2d8db110a6e6671fcc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 342b038803924b2b8625bfd6f2cf4c08 (127.3.212.130:39923), e4256387244444f3b9c0d54803e74760 (127.3.212.131:34743)
I20260709 12:11:47.208542  4131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f7ab1e5604a4859b97af9f666098497" candidate_uuid: "9d299deccaa74c2d8db110a6e6671fcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "342b038803924b2b8625bfd6f2cf4c08" is_pre_election: true
I20260709 12:11:47.209007  4206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f7ab1e5604a4859b97af9f666098497" candidate_uuid: "9d299deccaa74c2d8db110a6e6671fcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4256387244444f3b9c0d54803e74760" is_pre_election: true
I20260709 12:11:47.210721  4206 raft_consensus.cc:2393] T 1f7ab1e5604a4859b97af9f666098497 P e4256387244444f3b9c0d54803e74760 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d299deccaa74c2d8db110a6e6671fcc in current term 1: Already voted for candidate 342b038803924b2b8625bfd6f2cf4c08 in this term.
I20260709 12:11:47.211974  4023 leader_election.cc:304] T 1f7ab1e5604a4859b97af9f666098497 P 9d299deccaa74c2d8db110a6e6671fcc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d299deccaa74c2d8db110a6e6671fcc; no voters: 342b038803924b2b8625bfd6f2cf4c08, e4256387244444f3b9c0d54803e74760
I20260709 12:11:47.214479  4259 raft_consensus.cc:3060] T 1f7ab1e5604a4859b97af9f666098497 P 9d299deccaa74c2d8db110a6e6671fcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:47.214730  4255 raft_consensus.cc:493] T 9e90122ac65e486e80674ceb6d6fcb21 P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.215220  4255 raft_consensus.cc:515] T 9e90122ac65e486e80674ceb6d6fcb21 P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:47.217288  4255 leader_election.cc:290] T 9e90122ac65e486e80674ceb6d6fcb21 P e4256387244444f3b9c0d54803e74760 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9d299deccaa74c2d8db110a6e6671fcc (127.3.212.129:35647), 342b038803924b2b8625bfd6f2cf4c08 (127.3.212.130:39923)
I20260709 12:11:47.218694  4054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e90122ac65e486e80674ceb6d6fcb21" candidate_uuid: "e4256387244444f3b9c0d54803e74760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d299deccaa74c2d8db110a6e6671fcc" is_pre_election: true
I20260709 12:11:47.218991  4131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e90122ac65e486e80674ceb6d6fcb21" candidate_uuid: "e4256387244444f3b9c0d54803e74760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "342b038803924b2b8625bfd6f2cf4c08" is_pre_election: true
I20260709 12:11:47.219363  4054 raft_consensus.cc:2468] T 9e90122ac65e486e80674ceb6d6fcb21 P 9d299deccaa74c2d8db110a6e6671fcc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4256387244444f3b9c0d54803e74760 in term 0.
I20260709 12:11:47.219748  4131 raft_consensus.cc:2468] T 9e90122ac65e486e80674ceb6d6fcb21 P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4256387244444f3b9c0d54803e74760 in term 0.
I20260709 12:11:47.220789  4169 leader_election.cc:304] T 9e90122ac65e486e80674ceb6d6fcb21 P e4256387244444f3b9c0d54803e74760 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d299deccaa74c2d8db110a6e6671fcc, e4256387244444f3b9c0d54803e74760; no voters: 
I20260709 12:11:47.221661  4255 raft_consensus.cc:2804] T 9e90122ac65e486e80674ceb6d6fcb21 P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:11:47.222005  4255 raft_consensus.cc:493] T 9e90122ac65e486e80674ceb6d6fcb21 P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:47.222368  4255 raft_consensus.cc:3060] T 9e90122ac65e486e80674ceb6d6fcb21 P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:47.225330  4250 tablet_bootstrap.cc:492] T 67fd9c39bf234dcb8815c7ce2fd1a07e P e4256387244444f3b9c0d54803e74760: No bootstrap required, opened a new log
I20260709 12:11:47.225922  4250 ts_tablet_manager.cc:1403] T 67fd9c39bf234dcb8815c7ce2fd1a07e P e4256387244444f3b9c0d54803e74760: Time spent bootstrapping tablet: real 0.063s	user 0.015s	sys 0.009s
I20260709 12:11:47.228214  4273 consensus_queue.cc:1048] T 1f7ab1e5604a4859b97af9f666098497 P 342b038803924b2b8625bfd6f2cf4c08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:47.228899  4259 raft_consensus.cc:2749] T 1f7ab1e5604a4859b97af9f666098497 P 9d299deccaa74c2d8db110a6e6671fcc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:11:47.229027  4255 raft_consensus.cc:515] T 9e90122ac65e486e80674ceb6d6fcb21 P e4256387244444f3b9c0d54803e74760 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:47.229794  4250 raft_consensus.cc:359] T 67fd9c39bf234dcb8815c7ce2fd1a07e P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:47.230576  4250 raft_consensus.cc:385] T 67fd9c39bf234dcb8815c7ce2fd1a07e P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:47.230935  4250 raft_consensus.cc:740] T 67fd9c39bf234dcb8815c7ce2fd1a07e P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4256387244444f3b9c0d54803e74760, State: Initialized, Role: FOLLOWER
I20260709 12:11:47.232662  4054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e90122ac65e486e80674ceb6d6fcb21" candidate_uuid: "e4256387244444f3b9c0d54803e74760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d299deccaa74c2d8db110a6e6671fcc"
I20260709 12:11:47.233297  4054 raft_consensus.cc:3060] T 9e90122ac65e486e80674ceb6d6fcb21 P 9d299deccaa74c2d8db110a6e6671fcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:47.232939  4250 consensus_queue.cc:260] T 67fd9c39bf234dcb8815c7ce2fd1a07e P e4256387244444f3b9c0d54803e74760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:47.231647  4255 leader_election.cc:290] T 9e90122ac65e486e80674ceb6d6fcb21 P e4256387244444f3b9c0d54803e74760 [CANDIDATE]: Term 1 election: Requested vote from peers 9d299deccaa74c2d8db110a6e6671fcc (127.3.212.129:35647), 342b038803924b2b8625bfd6f2cf4c08 (127.3.212.130:39923)
I20260709 12:11:47.233717  4131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e90122ac65e486e80674ceb6d6fcb21" candidate_uuid: "e4256387244444f3b9c0d54803e74760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "342b038803924b2b8625bfd6f2cf4c08"
I20260709 12:11:47.234284  4131 raft_consensus.cc:3060] T 9e90122ac65e486e80674ceb6d6fcb21 P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:47.235913  4250 ts_tablet_manager.cc:1434] T 67fd9c39bf234dcb8815c7ce2fd1a07e P e4256387244444f3b9c0d54803e74760: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:11:47.236935  4250 tablet_bootstrap.cc:492] T 4b596235d44b4a6e976316208bada57c P e4256387244444f3b9c0d54803e74760: Bootstrap starting.
I20260709 12:11:47.240859  4054 raft_consensus.cc:2468] T 9e90122ac65e486e80674ceb6d6fcb21 P 9d299deccaa74c2d8db110a6e6671fcc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4256387244444f3b9c0d54803e74760 in term 1.
I20260709 12:11:47.242368  4169 leader_election.cc:304] T 9e90122ac65e486e80674ceb6d6fcb21 P e4256387244444f3b9c0d54803e74760 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d299deccaa74c2d8db110a6e6671fcc, e4256387244444f3b9c0d54803e74760; no voters: 
I20260709 12:11:47.243167  4255 raft_consensus.cc:2804] T 9e90122ac65e486e80674ceb6d6fcb21 P e4256387244444f3b9c0d54803e74760 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:11:47.243637  4255 raft_consensus.cc:697] T 9e90122ac65e486e80674ceb6d6fcb21 P e4256387244444f3b9c0d54803e74760 [term 1 LEADER]: Becoming Leader. State: Replica: e4256387244444f3b9c0d54803e74760, State: Running, Role: LEADER
I20260709 12:11:47.244477  4255 consensus_queue.cc:237] T 9e90122ac65e486e80674ceb6d6fcb21 P e4256387244444f3b9c0d54803e74760 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:47.241159  4131 raft_consensus.cc:2468] T 9e90122ac65e486e80674ceb6d6fcb21 P 342b038803924b2b8625bfd6f2cf4c08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4256387244444f3b9c0d54803e74760 in term 1.
I20260709 12:11:47.249867  4250 tablet_bootstrap.cc:654] T 4b596235d44b4a6e976316208bada57c P e4256387244444f3b9c0d54803e74760: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:47.262635  4291 consensus_queue.cc:1048] T 1f7ab1e5604a4859b97af9f666098497 P 342b038803924b2b8625bfd6f2cf4c08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:11:47.269822  4250 tablet_bootstrap.cc:492] T 4b596235d44b4a6e976316208bada57c P e4256387244444f3b9c0d54803e74760: No bootstrap required, opened a new log
I20260709 12:11:47.270326  4250 ts_tablet_manager.cc:1403] T 4b596235d44b4a6e976316208bada57c P e4256387244444f3b9c0d54803e74760: Time spent bootstrapping tablet: real 0.034s	user 0.007s	sys 0.009s
I20260709 12:11:47.274397  4250 raft_consensus.cc:359] T 4b596235d44b4a6e976316208bada57c P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:47.273609  3951 catalog_manager.cc:5697] T 9e90122ac65e486e80674ceb6d6fcb21 P e4256387244444f3b9c0d54803e74760 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4256387244444f3b9c0d54803e74760 (127.3.212.131). New cstate: current_term: 1 leader_uuid: "e4256387244444f3b9c0d54803e74760" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:47.275238  4250 raft_consensus.cc:385] T 4b596235d44b4a6e976316208bada57c P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:47.275683  4250 raft_consensus.cc:740] T 4b596235d44b4a6e976316208bada57c P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4256387244444f3b9c0d54803e74760, State: Initialized, Role: FOLLOWER
I20260709 12:11:47.276590  4250 consensus_queue.cc:260] T 4b596235d44b4a6e976316208bada57c P e4256387244444f3b9c0d54803e74760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:47.278861  4250 ts_tablet_manager.cc:1434] T 4b596235d44b4a6e976316208bada57c P e4256387244444f3b9c0d54803e74760: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:11:47.279906  4250 tablet_bootstrap.cc:492] T a6ccb39b2a244abd87777efcef76ab72 P e4256387244444f3b9c0d54803e74760: Bootstrap starting.
I20260709 12:11:47.286793  4250 tablet_bootstrap.cc:654] T a6ccb39b2a244abd87777efcef76ab72 P e4256387244444f3b9c0d54803e74760: Neither blocks nor log segments found. Creating new log.
I20260709 12:11:47.304388  4250 tablet_bootstrap.cc:492] T a6ccb39b2a244abd87777efcef76ab72 P e4256387244444f3b9c0d54803e74760: No bootstrap required, opened a new log
I20260709 12:11:47.304860  4250 ts_tablet_manager.cc:1403] T a6ccb39b2a244abd87777efcef76ab72 P e4256387244444f3b9c0d54803e74760: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.004s
I20260709 12:11:47.306685  4250 raft_consensus.cc:359] T a6ccb39b2a244abd87777efcef76ab72 P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:47.307314  4250 raft_consensus.cc:385] T a6ccb39b2a244abd87777efcef76ab72 P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:11:47.307519  4250 raft_consensus.cc:740] T a6ccb39b2a244abd87777efcef76ab72 P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4256387244444f3b9c0d54803e74760, State: Initialized, Role: FOLLOWER
I20260709 12:11:47.308248  4250 consensus_queue.cc:260] T a6ccb39b2a244abd87777efcef76ab72 P e4256387244444f3b9c0d54803e74760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:47.310300  4250 ts_tablet_manager.cc:1434] T a6ccb39b2a244abd87777efcef76ab72 P e4256387244444f3b9c0d54803e74760: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:11:47.326876  4291 raft_consensus.cc:493] T a6ccb39b2a244abd87777efcef76ab72 P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.327463  4291 raft_consensus.cc:515] T a6ccb39b2a244abd87777efcef76ab72 P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:47.329499  4291 leader_election.cc:290] T a6ccb39b2a244abd87777efcef76ab72 P 342b038803924b2b8625bfd6f2cf4c08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9d299deccaa74c2d8db110a6e6671fcc (127.3.212.129:35647), e4256387244444f3b9c0d54803e74760 (127.3.212.131:34743)
I20260709 12:11:47.330449  4054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ccb39b2a244abd87777efcef76ab72" candidate_uuid: "342b038803924b2b8625bfd6f2cf4c08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d299deccaa74c2d8db110a6e6671fcc" is_pre_election: true
I20260709 12:11:47.330624  4206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ccb39b2a244abd87777efcef76ab72" candidate_uuid: "342b038803924b2b8625bfd6f2cf4c08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4256387244444f3b9c0d54803e74760" is_pre_election: true
I20260709 12:11:47.330996  4054 raft_consensus.cc:2468] T a6ccb39b2a244abd87777efcef76ab72 P 9d299deccaa74c2d8db110a6e6671fcc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 342b038803924b2b8625bfd6f2cf4c08 in term 0.
I20260709 12:11:47.331307  4206 raft_consensus.cc:2468] T a6ccb39b2a244abd87777efcef76ab72 P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 342b038803924b2b8625bfd6f2cf4c08 in term 0.
I20260709 12:11:47.332130  4095 leader_election.cc:304] T a6ccb39b2a244abd87777efcef76ab72 P 342b038803924b2b8625bfd6f2cf4c08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 342b038803924b2b8625bfd6f2cf4c08, 9d299deccaa74c2d8db110a6e6671fcc; no voters: 
I20260709 12:11:47.332813  4291 raft_consensus.cc:2804] T a6ccb39b2a244abd87777efcef76ab72 P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:11:47.333139  4291 raft_consensus.cc:493] T a6ccb39b2a244abd87777efcef76ab72 P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:47.333413  4291 raft_consensus.cc:3060] T a6ccb39b2a244abd87777efcef76ab72 P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:47.337877  4291 raft_consensus.cc:515] T a6ccb39b2a244abd87777efcef76ab72 P 342b038803924b2b8625bfd6f2cf4c08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:47.340538  4054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ccb39b2a244abd87777efcef76ab72" candidate_uuid: "342b038803924b2b8625bfd6f2cf4c08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d299deccaa74c2d8db110a6e6671fcc"
I20260709 12:11:47.340766  4206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ccb39b2a244abd87777efcef76ab72" candidate_uuid: "342b038803924b2b8625bfd6f2cf4c08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4256387244444f3b9c0d54803e74760"
I20260709 12:11:47.341367  4054 raft_consensus.cc:3060] T a6ccb39b2a244abd87777efcef76ab72 P 9d299deccaa74c2d8db110a6e6671fcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:47.341511  4206 raft_consensus.cc:3060] T a6ccb39b2a244abd87777efcef76ab72 P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:11:47.343560  4002 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:11:47.344276  4291 leader_election.cc:290] T a6ccb39b2a244abd87777efcef76ab72 P 342b038803924b2b8625bfd6f2cf4c08 [CANDIDATE]: Term 1 election: Requested vote from peers 9d299deccaa74c2d8db110a6e6671fcc (127.3.212.129:35647), e4256387244444f3b9c0d54803e74760 (127.3.212.131:34743)
I20260709 12:11:47.348861  4206 raft_consensus.cc:2468] T a6ccb39b2a244abd87777efcef76ab72 P e4256387244444f3b9c0d54803e74760 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 342b038803924b2b8625bfd6f2cf4c08 in term 1.
I20260709 12:11:47.348794  4054 raft_consensus.cc:2468] T a6ccb39b2a244abd87777efcef76ab72 P 9d299deccaa74c2d8db110a6e6671fcc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 342b038803924b2b8625bfd6f2cf4c08 in term 1.
I20260709 12:11:47.350118  4098 leader_election.cc:304] T a6ccb39b2a244abd87777efcef76ab72 P 342b038803924b2b8625bfd6f2cf4c08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 342b038803924b2b8625bfd6f2cf4c08, e4256387244444f3b9c0d54803e74760; no voters: 
I20260709 12:11:47.350903  4291 raft_consensus.cc:2804] T a6ccb39b2a244abd87777efcef76ab72 P 342b038803924b2b8625bfd6f2cf4c08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:11:47.351351  4291 raft_consensus.cc:697] T a6ccb39b2a244abd87777efcef76ab72 P 342b038803924b2b8625bfd6f2cf4c08 [term 1 LEADER]: Becoming Leader. State: Replica: 342b038803924b2b8625bfd6f2cf4c08, State: Running, Role: LEADER
I20260709 12:11:47.352027  4291 consensus_queue.cc:237] T a6ccb39b2a244abd87777efcef76ab72 P 342b038803924b2b8625bfd6f2cf4c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:47.359086  3951 catalog_manager.cc:5697] T a6ccb39b2a244abd87777efcef76ab72 P 342b038803924b2b8625bfd6f2cf4c08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 342b038803924b2b8625bfd6f2cf4c08 (127.3.212.130). New cstate: current_term: 1 leader_uuid: "342b038803924b2b8625bfd6f2cf4c08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:47.368439  4281 consensus_queue.cc:1048] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P e4256387244444f3b9c0d54803e74760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:47.380738  4255 consensus_queue.cc:1048] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P e4256387244444f3b9c0d54803e74760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:11:47.390934  4291 raft_consensus.cc:493] T 4b596235d44b4a6e976316208bada57c P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.391366  4291 raft_consensus.cc:515] T 4b596235d44b4a6e976316208bada57c P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:47.394584  4057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b596235d44b4a6e976316208bada57c" candidate_uuid: "342b038803924b2b8625bfd6f2cf4c08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d299deccaa74c2d8db110a6e6671fcc" is_pre_election: true
I20260709 12:11:47.394951  4291 leader_election.cc:290] T 4b596235d44b4a6e976316208bada57c P 342b038803924b2b8625bfd6f2cf4c08 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9d299deccaa74c2d8db110a6e6671fcc (127.3.212.129:35647), e4256387244444f3b9c0d54803e74760 (127.3.212.131:34743)
I20260709 12:11:47.396049  4206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b596235d44b4a6e976316208bada57c" candidate_uuid: "342b038803924b2b8625bfd6f2cf4c08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4256387244444f3b9c0d54803e74760" is_pre_election: true
I20260709 12:11:47.396749  4206 raft_consensus.cc:2468] T 4b596235d44b4a6e976316208bada57c P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 342b038803924b2b8625bfd6f2cf4c08 in term 0.
I20260709 12:11:47.396802  4057 raft_consensus.cc:2468] T 4b596235d44b4a6e976316208bada57c P 9d299deccaa74c2d8db110a6e6671fcc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 342b038803924b2b8625bfd6f2cf4c08 in term 0.
I20260709 12:11:47.397990  4098 leader_election.cc:304] T 4b596235d44b4a6e976316208bada57c P 342b038803924b2b8625bfd6f2cf4c08 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 342b038803924b2b8625bfd6f2cf4c08, e4256387244444f3b9c0d54803e74760; no voters: 
I20260709 12:11:47.398955  4291 raft_consensus.cc:2804] T 4b596235d44b4a6e976316208bada57c P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:11:47.399451  4291 raft_consensus.cc:493] T 4b596235d44b4a6e976316208bada57c P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:47.399943  4291 raft_consensus.cc:3060] T 4b596235d44b4a6e976316208bada57c P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:47.402451  4255 raft_consensus.cc:493] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.402927  4255 raft_consensus.cc:515] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:47.404976  4255 leader_election.cc:290] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9d299deccaa74c2d8db110a6e6671fcc (127.3.212.129:35647), 342b038803924b2b8625bfd6f2cf4c08 (127.3.212.130:39923)
I20260709 12:11:47.406432  4291 raft_consensus.cc:515] T 4b596235d44b4a6e976316208bada57c P 342b038803924b2b8625bfd6f2cf4c08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:47.407589  4131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3682e1e40804ae0a9d4a7a03f7983b2" candidate_uuid: "e4256387244444f3b9c0d54803e74760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "342b038803924b2b8625bfd6f2cf4c08" is_pre_election: true
I20260709 12:11:47.408231  4131 raft_consensus.cc:2468] T a3682e1e40804ae0a9d4a7a03f7983b2 P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4256387244444f3b9c0d54803e74760 in term 0.
I20260709 12:11:47.409241  4057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3682e1e40804ae0a9d4a7a03f7983b2" candidate_uuid: "e4256387244444f3b9c0d54803e74760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d299deccaa74c2d8db110a6e6671fcc" is_pre_election: true
I20260709 12:11:47.409323  4206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b596235d44b4a6e976316208bada57c" candidate_uuid: "342b038803924b2b8625bfd6f2cf4c08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4256387244444f3b9c0d54803e74760"
I20260709 12:11:47.409320  4054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b596235d44b4a6e976316208bada57c" candidate_uuid: "342b038803924b2b8625bfd6f2cf4c08" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d299deccaa74c2d8db110a6e6671fcc"
I20260709 12:11:47.409969  4206 raft_consensus.cc:3060] T 4b596235d44b4a6e976316208bada57c P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:47.410291  4054 raft_consensus.cc:3060] T 4b596235d44b4a6e976316208bada57c P 9d299deccaa74c2d8db110a6e6671fcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:47.410446  4169 leader_election.cc:304] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 342b038803924b2b8625bfd6f2cf4c08, e4256387244444f3b9c0d54803e74760; no voters: 
I20260709 12:11:47.411584  4255 raft_consensus.cc:2804] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:11:47.411939  4255 raft_consensus.cc:493] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:47.412251  4255 raft_consensus.cc:3060] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:47.417177  4291 leader_election.cc:290] T 4b596235d44b4a6e976316208bada57c P 342b038803924b2b8625bfd6f2cf4c08 [CANDIDATE]: Term 1 election: Requested vote from peers 9d299deccaa74c2d8db110a6e6671fcc (127.3.212.129:35647), e4256387244444f3b9c0d54803e74760 (127.3.212.131:34743)
I20260709 12:11:47.417075  4054 raft_consensus.cc:2468] T 4b596235d44b4a6e976316208bada57c P 9d299deccaa74c2d8db110a6e6671fcc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 342b038803924b2b8625bfd6f2cf4c08 in term 1.
I20260709 12:11:47.417075  4206 raft_consensus.cc:2468] T 4b596235d44b4a6e976316208bada57c P e4256387244444f3b9c0d54803e74760 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 342b038803924b2b8625bfd6f2cf4c08 in term 1.
I20260709 12:11:47.418736  4255 raft_consensus.cc:515] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:47.419210  4095 leader_election.cc:304] T 4b596235d44b4a6e976316208bada57c P 342b038803924b2b8625bfd6f2cf4c08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 342b038803924b2b8625bfd6f2cf4c08, 9d299deccaa74c2d8db110a6e6671fcc; no voters: 
I20260709 12:11:47.420019  4291 raft_consensus.cc:2804] T 4b596235d44b4a6e976316208bada57c P 342b038803924b2b8625bfd6f2cf4c08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:11:47.420733  4291 raft_consensus.cc:697] T 4b596235d44b4a6e976316208bada57c P 342b038803924b2b8625bfd6f2cf4c08 [term 1 LEADER]: Becoming Leader. State: Replica: 342b038803924b2b8625bfd6f2cf4c08, State: Running, Role: LEADER
I20260709 12:11:47.421012  4255 leader_election.cc:290] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 [CANDIDATE]: Term 1 election: Requested vote from peers 9d299deccaa74c2d8db110a6e6671fcc (127.3.212.129:35647), 342b038803924b2b8625bfd6f2cf4c08 (127.3.212.130:39923)
I20260709 12:11:47.409914  4057 raft_consensus.cc:2468] T a3682e1e40804ae0a9d4a7a03f7983b2 P 9d299deccaa74c2d8db110a6e6671fcc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4256387244444f3b9c0d54803e74760 in term 0.
I20260709 12:11:47.421638  4291 consensus_queue.cc:237] T 4b596235d44b4a6e976316208bada57c P 342b038803924b2b8625bfd6f2cf4c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:47.422459  4057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3682e1e40804ae0a9d4a7a03f7983b2" candidate_uuid: "e4256387244444f3b9c0d54803e74760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d299deccaa74c2d8db110a6e6671fcc"
I20260709 12:11:47.423032  4057 raft_consensus.cc:3060] T a3682e1e40804ae0a9d4a7a03f7983b2 P 9d299deccaa74c2d8db110a6e6671fcc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:47.423599  4131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3682e1e40804ae0a9d4a7a03f7983b2" candidate_uuid: "e4256387244444f3b9c0d54803e74760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "342b038803924b2b8625bfd6f2cf4c08"
I20260709 12:11:47.424170  4131 raft_consensus.cc:3060] T a3682e1e40804ae0a9d4a7a03f7983b2 P 342b038803924b2b8625bfd6f2cf4c08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:47.430222  4057 raft_consensus.cc:2468] T a3682e1e40804ae0a9d4a7a03f7983b2 P 9d299deccaa74c2d8db110a6e6671fcc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4256387244444f3b9c0d54803e74760 in term 1.
I20260709 12:11:47.431092  4255 raft_consensus.cc:493] T 67fd9c39bf234dcb8815c7ce2fd1a07e P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.431591  4255 raft_consensus.cc:515] T 67fd9c39bf234dcb8815c7ce2fd1a07e P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:47.431900  4169 leader_election.cc:304] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d299deccaa74c2d8db110a6e6671fcc, e4256387244444f3b9c0d54803e74760; no voters: 
I20260709 12:11:47.433650  4255 leader_election.cc:290] T 67fd9c39bf234dcb8815c7ce2fd1a07e P e4256387244444f3b9c0d54803e74760 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9d299deccaa74c2d8db110a6e6671fcc (127.3.212.129:35647), 342b038803924b2b8625bfd6f2cf4c08 (127.3.212.130:39923)
I20260709 12:11:47.434015  4278 raft_consensus.cc:2804] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:11:47.434549  4278 raft_consensus.cc:697] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 [term 1 LEADER]: Becoming Leader. State: Replica: e4256387244444f3b9c0d54803e74760, State: Running, Role: LEADER
I20260709 12:11:47.435418  4278 consensus_queue.cc:237] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:47.439752  4057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fd9c39bf234dcb8815c7ce2fd1a07e" candidate_uuid: "e4256387244444f3b9c0d54803e74760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d299deccaa74c2d8db110a6e6671fcc" is_pre_election: true
I20260709 12:11:47.440562  4057 raft_consensus.cc:2393] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 9d299deccaa74c2d8db110a6e6671fcc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4256387244444f3b9c0d54803e74760 in current term 1: Already voted for candidate 342b038803924b2b8625bfd6f2cf4c08 in this term.
I20260709 12:11:47.440698  4132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fd9c39bf234dcb8815c7ce2fd1a07e" candidate_uuid: "e4256387244444f3b9c0d54803e74760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "342b038803924b2b8625bfd6f2cf4c08" is_pre_election: true
I20260709 12:11:47.442701  4131 raft_consensus.cc:2468] T a3682e1e40804ae0a9d4a7a03f7983b2 P 342b038803924b2b8625bfd6f2cf4c08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4256387244444f3b9c0d54803e74760 in term 1.
I20260709 12:11:47.444238  4169 leader_election.cc:304] T 67fd9c39bf234dcb8815c7ce2fd1a07e P e4256387244444f3b9c0d54803e74760 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4256387244444f3b9c0d54803e74760; no voters: 342b038803924b2b8625bfd6f2cf4c08, 9d299deccaa74c2d8db110a6e6671fcc
I20260709 12:11:47.445220  4278 raft_consensus.cc:3060] T 67fd9c39bf234dcb8815c7ce2fd1a07e P e4256387244444f3b9c0d54803e74760 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:11:47.444998  3951 catalog_manager.cc:5697] T 4b596235d44b4a6e976316208bada57c P 342b038803924b2b8625bfd6f2cf4c08 reported cstate change: term changed from 0 to 1, leader changed from <none> to 342b038803924b2b8625bfd6f2cf4c08 (127.3.212.130). New cstate: current_term: 1 leader_uuid: "342b038803924b2b8625bfd6f2cf4c08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:47.451066  3953 catalog_manager.cc:5697] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4256387244444f3b9c0d54803e74760 (127.3.212.131). New cstate: current_term: 1 leader_uuid: "e4256387244444f3b9c0d54803e74760" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:47.452942  4278 raft_consensus.cc:2749] T 67fd9c39bf234dcb8815c7ce2fd1a07e P e4256387244444f3b9c0d54803e74760 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:11:47.533577  4291 consensus_queue.cc:1048] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:47.533969  4278 consensus_queue.cc:1048] T b52aa28f64ae441783bcb12eeeb24273 P e4256387244444f3b9c0d54803e74760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:47.546365  4256 consensus_queue.cc:1048] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:47.549788  4256 consensus_queue.cc:1048] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:47.568748  4291 consensus_queue.cc:1048] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:47.599074  4281 consensus_queue.cc:1048] T b52aa28f64ae441783bcb12eeeb24273 P e4256387244444f3b9c0d54803e74760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:47.640245  4206 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b52aa28f64ae441783bcb12eeeb24273"
dest_uuid: "e4256387244444f3b9c0d54803e74760"
mode: GRACEFUL
new_leader_uuid: "9d299deccaa74c2d8db110a6e6671fcc"
 from {username='slave'} at 127.0.0.1:45650
I20260709 12:11:47.640991  4206 raft_consensus.cc:606] T b52aa28f64ae441783bcb12eeeb24273 P e4256387244444f3b9c0d54803e74760 [term 1 LEADER]: Received request to transfer leadership to TS 9d299deccaa74c2d8db110a6e6671fcc
I20260709 12:11:47.647240  4206 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e90122ac65e486e80674ceb6d6fcb21"
dest_uuid: "e4256387244444f3b9c0d54803e74760"
mode: GRACEFUL
new_leader_uuid: "9d299deccaa74c2d8db110a6e6671fcc"
 from {username='slave'} at 127.0.0.1:45650
I20260709 12:11:47.647750  4206 raft_consensus.cc:606] T 9e90122ac65e486e80674ceb6d6fcb21 P e4256387244444f3b9c0d54803e74760 [term 1 LEADER]: Received request to transfer leadership to TS 9d299deccaa74c2d8db110a6e6671fcc
I20260709 12:11:47.663033  4131 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67fd9c39bf234dcb8815c7ce2fd1a07e"
dest_uuid: "342b038803924b2b8625bfd6f2cf4c08"
mode: GRACEFUL
new_leader_uuid: "9d299deccaa74c2d8db110a6e6671fcc"
 from {username='slave'} at 127.0.0.1:46656
I20260709 12:11:47.663583  4131 raft_consensus.cc:606] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08 [term 1 LEADER]: Received request to transfer leadership to TS 9d299deccaa74c2d8db110a6e6671fcc
I20260709 12:11:47.669505  4131 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57a371ce6a7d437380ff59166848f1bc"
dest_uuid: "342b038803924b2b8625bfd6f2cf4c08"
mode: GRACEFUL
new_leader_uuid: "9d299deccaa74c2d8db110a6e6671fcc"
 from {username='slave'} at 127.0.0.1:46656
I20260709 12:11:47.670145  4131 raft_consensus.cc:606] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08 [term 1 LEADER]: Received request to transfer leadership to TS 9d299deccaa74c2d8db110a6e6671fcc
I20260709 12:11:47.672971  4281 consensus_queue.cc:1048] T 9e90122ac65e486e80674ceb6d6fcb21 P e4256387244444f3b9c0d54803e74760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:47.684139  4206 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11d2d5e583974e3ea41a0a3ea8e05dd5"
dest_uuid: "e4256387244444f3b9c0d54803e74760"
mode: GRACEFUL
new_leader_uuid: "342b038803924b2b8625bfd6f2cf4c08"
 from {username='slave'} at 127.0.0.1:45650
I20260709 12:11:47.684799  4206 raft_consensus.cc:606] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P e4256387244444f3b9c0d54803e74760 [term 1 LEADER]: Received request to transfer leadership to TS 342b038803924b2b8625bfd6f2cf4c08
I20260709 12:11:47.691386  4206 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a3682e1e40804ae0a9d4a7a03f7983b2"
dest_uuid: "e4256387244444f3b9c0d54803e74760"
mode: GRACEFUL
new_leader_uuid: "342b038803924b2b8625bfd6f2cf4c08"
 from {username='slave'} at 127.0.0.1:45650
I20260709 12:11:47.692003  4206 raft_consensus.cc:606] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 [term 1 LEADER]: Received request to transfer leadership to TS 342b038803924b2b8625bfd6f2cf4c08
I20260709 12:11:47.692090  4281 consensus_queue.cc:1048] T 9e90122ac65e486e80674ceb6d6fcb21 P e4256387244444f3b9c0d54803e74760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:47.702297  4278 raft_consensus.cc:993] T 9e90122ac65e486e80674ceb6d6fcb21 P e4256387244444f3b9c0d54803e74760: : Instructing follower 9d299deccaa74c2d8db110a6e6671fcc to start an election
I20260709 12:11:47.702773  4278 raft_consensus.cc:1081] T 9e90122ac65e486e80674ceb6d6fcb21 P e4256387244444f3b9c0d54803e74760 [term 1 LEADER]: Signalling peer 9d299deccaa74c2d8db110a6e6671fcc to start an election
I20260709 12:11:47.704079  4132 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6ccb39b2a244abd87777efcef76ab72"
dest_uuid: "342b038803924b2b8625bfd6f2cf4c08"
mode: GRACEFUL
new_leader_uuid: "e4256387244444f3b9c0d54803e74760"
 from {username='slave'} at 127.0.0.1:46656
I20260709 12:11:47.704703  4132 raft_consensus.cc:606] T a6ccb39b2a244abd87777efcef76ab72 P 342b038803924b2b8625bfd6f2cf4c08 [term 1 LEADER]: Received request to transfer leadership to TS e4256387244444f3b9c0d54803e74760
I20260709 12:11:47.704757  4056 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e90122ac65e486e80674ceb6d6fcb21"
dest_uuid: "9d299deccaa74c2d8db110a6e6671fcc"
 from {username='slave'} at 127.0.0.1:56062
I20260709 12:11:47.705451  4056 raft_consensus.cc:493] T 9e90122ac65e486e80674ceb6d6fcb21 P 9d299deccaa74c2d8db110a6e6671fcc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:47.705837  4056 raft_consensus.cc:3060] T 9e90122ac65e486e80674ceb6d6fcb21 P 9d299deccaa74c2d8db110a6e6671fcc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:47.712782  4056 raft_consensus.cc:515] T 9e90122ac65e486e80674ceb6d6fcb21 P 9d299deccaa74c2d8db110a6e6671fcc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:47.715142  4056 leader_election.cc:290] T 9e90122ac65e486e80674ceb6d6fcb21 P 9d299deccaa74c2d8db110a6e6671fcc [CANDIDATE]: Term 2 election: Requested vote from peers 342b038803924b2b8625bfd6f2cf4c08 (127.3.212.130:39923), e4256387244444f3b9c0d54803e74760 (127.3.212.131:34743)
I20260709 12:11:47.716409  4132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e90122ac65e486e80674ceb6d6fcb21" candidate_uuid: "9d299deccaa74c2d8db110a6e6671fcc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "342b038803924b2b8625bfd6f2cf4c08"
I20260709 12:11:47.717005  4206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e90122ac65e486e80674ceb6d6fcb21" candidate_uuid: "9d299deccaa74c2d8db110a6e6671fcc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4256387244444f3b9c0d54803e74760"
I20260709 12:11:47.717196  4132 raft_consensus.cc:3060] T 9e90122ac65e486e80674ceb6d6fcb21 P 342b038803924b2b8625bfd6f2cf4c08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:47.717633  4206 raft_consensus.cc:3055] T 9e90122ac65e486e80674ceb6d6fcb21 P e4256387244444f3b9c0d54803e74760 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:11:47.717993  4206 raft_consensus.cc:740] T 9e90122ac65e486e80674ceb6d6fcb21 P e4256387244444f3b9c0d54803e74760 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4256387244444f3b9c0d54803e74760, State: Running, Role: LEADER
I20260709 12:11:47.718851  4206 consensus_queue.cc:260] T 9e90122ac65e486e80674ceb6d6fcb21 P e4256387244444f3b9c0d54803e74760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:47.720278  4206 raft_consensus.cc:3060] T 9e90122ac65e486e80674ceb6d6fcb21 P e4256387244444f3b9c0d54803e74760 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:47.724524  4132 raft_consensus.cc:2468] T 9e90122ac65e486e80674ceb6d6fcb21 P 342b038803924b2b8625bfd6f2cf4c08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d299deccaa74c2d8db110a6e6671fcc in term 2.
I20260709 12:11:47.725871  4206 raft_consensus.cc:2468] T 9e90122ac65e486e80674ceb6d6fcb21 P e4256387244444f3b9c0d54803e74760 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d299deccaa74c2d8db110a6e6671fcc in term 2.
I20260709 12:11:47.725899  4020 leader_election.cc:304] T 9e90122ac65e486e80674ceb6d6fcb21 P 9d299deccaa74c2d8db110a6e6671fcc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 342b038803924b2b8625bfd6f2cf4c08, 9d299deccaa74c2d8db110a6e6671fcc; no voters: 
I20260709 12:11:47.726940  4259 raft_consensus.cc:2804] T 9e90122ac65e486e80674ceb6d6fcb21 P 9d299deccaa74c2d8db110a6e6671fcc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:11:47.728061  4259 raft_consensus.cc:697] T 9e90122ac65e486e80674ceb6d6fcb21 P 9d299deccaa74c2d8db110a6e6671fcc [term 2 LEADER]: Becoming Leader. State: Replica: 9d299deccaa74c2d8db110a6e6671fcc, State: Running, Role: LEADER
I20260709 12:11:47.728935  4259 consensus_queue.cc:237] T 9e90122ac65e486e80674ceb6d6fcb21 P 9d299deccaa74c2d8db110a6e6671fcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:47.736352  3951 catalog_manager.cc:5697] T 9e90122ac65e486e80674ceb6d6fcb21 P 9d299deccaa74c2d8db110a6e6671fcc reported cstate change: term changed from 1 to 2, leader changed from e4256387244444f3b9c0d54803e74760 (127.3.212.131) to 9d299deccaa74c2d8db110a6e6671fcc (127.3.212.129). New cstate: current_term: 2 leader_uuid: "9d299deccaa74c2d8db110a6e6671fcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:47.752100  4291 consensus_queue.cc:1048] T a6ccb39b2a244abd87777efcef76ab72 P 342b038803924b2b8625bfd6f2cf4c08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:47.759920  4273 raft_consensus.cc:993] T a6ccb39b2a244abd87777efcef76ab72 P 342b038803924b2b8625bfd6f2cf4c08: : Instructing follower e4256387244444f3b9c0d54803e74760 to start an election
I20260709 12:11:47.760413  4273 raft_consensus.cc:1081] T a6ccb39b2a244abd87777efcef76ab72 P 342b038803924b2b8625bfd6f2cf4c08 [term 1 LEADER]: Signalling peer e4256387244444f3b9c0d54803e74760 to start an election
I20260709 12:11:47.762633  4205 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a6ccb39b2a244abd87777efcef76ab72"
dest_uuid: "e4256387244444f3b9c0d54803e74760"
 from {username='slave'} at 127.0.0.1:45636
I20260709 12:11:47.763267  4205 raft_consensus.cc:493] T a6ccb39b2a244abd87777efcef76ab72 P e4256387244444f3b9c0d54803e74760 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:47.763643  4205 raft_consensus.cc:3060] T a6ccb39b2a244abd87777efcef76ab72 P e4256387244444f3b9c0d54803e74760 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:47.772796  4256 consensus_queue.cc:1048] T a6ccb39b2a244abd87777efcef76ab72 P 342b038803924b2b8625bfd6f2cf4c08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:47.775043  4205 raft_consensus.cc:515] T a6ccb39b2a244abd87777efcef76ab72 P e4256387244444f3b9c0d54803e74760 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:47.778671  4206 raft_consensus.cc:1240] T a6ccb39b2a244abd87777efcef76ab72 P e4256387244444f3b9c0d54803e74760 [term 2 FOLLOWER]: Rejecting Update request from peer 342b038803924b2b8625bfd6f2cf4c08 for earlier term 1. Current term is 2. Ops: []
I20260709 12:11:47.783010  4205 leader_election.cc:290] T a6ccb39b2a244abd87777efcef76ab72 P e4256387244444f3b9c0d54803e74760 [CANDIDATE]: Term 2 election: Requested vote from peers 9d299deccaa74c2d8db110a6e6671fcc (127.3.212.129:35647), 342b038803924b2b8625bfd6f2cf4c08 (127.3.212.130:39923)
I20260709 12:11:47.784006  4132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ccb39b2a244abd87777efcef76ab72" candidate_uuid: "e4256387244444f3b9c0d54803e74760" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "342b038803924b2b8625bfd6f2cf4c08"
I20260709 12:11:47.784286  4054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ccb39b2a244abd87777efcef76ab72" candidate_uuid: "e4256387244444f3b9c0d54803e74760" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9d299deccaa74c2d8db110a6e6671fcc"
I20260709 12:11:47.784801  4132 raft_consensus.cc:3055] T a6ccb39b2a244abd87777efcef76ab72 P 342b038803924b2b8625bfd6f2cf4c08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:11:47.784884  4054 raft_consensus.cc:3060] T a6ccb39b2a244abd87777efcef76ab72 P 9d299deccaa74c2d8db110a6e6671fcc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:47.785392  4132 raft_consensus.cc:740] T a6ccb39b2a244abd87777efcef76ab72 P 342b038803924b2b8625bfd6f2cf4c08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 342b038803924b2b8625bfd6f2cf4c08, State: Running, Role: LEADER
I20260709 12:11:47.786419  4132 consensus_queue.cc:260] T a6ccb39b2a244abd87777efcef76ab72 P 342b038803924b2b8625bfd6f2cf4c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:47.787606  4132 raft_consensus.cc:3060] T a6ccb39b2a244abd87777efcef76ab72 P 342b038803924b2b8625bfd6f2cf4c08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:47.796880  4054 raft_consensus.cc:2468] T a6ccb39b2a244abd87777efcef76ab72 P 9d299deccaa74c2d8db110a6e6671fcc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4256387244444f3b9c0d54803e74760 in term 2.
I20260709 12:11:47.796885  4132 raft_consensus.cc:2468] T a6ccb39b2a244abd87777efcef76ab72 P 342b038803924b2b8625bfd6f2cf4c08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4256387244444f3b9c0d54803e74760 in term 2.
I20260709 12:11:47.798378  4169 leader_election.cc:304] T a6ccb39b2a244abd87777efcef76ab72 P e4256387244444f3b9c0d54803e74760 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d299deccaa74c2d8db110a6e6671fcc, e4256387244444f3b9c0d54803e74760; no voters: 
I20260709 12:11:47.799604  4255 raft_consensus.cc:2804] T a6ccb39b2a244abd87777efcef76ab72 P e4256387244444f3b9c0d54803e74760 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:11:47.800151  4255 raft_consensus.cc:697] T a6ccb39b2a244abd87777efcef76ab72 P e4256387244444f3b9c0d54803e74760 [term 2 LEADER]: Becoming Leader. State: Replica: e4256387244444f3b9c0d54803e74760, State: Running, Role: LEADER
I20260709 12:11:47.800971  4255 consensus_queue.cc:237] T a6ccb39b2a244abd87777efcef76ab72 P e4256387244444f3b9c0d54803e74760 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:47.808053  3951 catalog_manager.cc:5697] T a6ccb39b2a244abd87777efcef76ab72 P e4256387244444f3b9c0d54803e74760 reported cstate change: term changed from 1 to 2, leader changed from 342b038803924b2b8625bfd6f2cf4c08 (127.3.212.130) to e4256387244444f3b9c0d54803e74760 (127.3.212.131). New cstate: current_term: 2 leader_uuid: "e4256387244444f3b9c0d54803e74760" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:47.828912  4291 consensus_queue.cc:1048] T 4b596235d44b4a6e976316208bada57c P 342b038803924b2b8625bfd6f2cf4c08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:47.846870  4281 raft_consensus.cc:993] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P e4256387244444f3b9c0d54803e74760: : Instructing follower 342b038803924b2b8625bfd6f2cf4c08 to start an election
I20260709 12:11:47.847301  4281 raft_consensus.cc:1081] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P e4256387244444f3b9c0d54803e74760 [term 1 LEADER]: Signalling peer 342b038803924b2b8625bfd6f2cf4c08 to start an election
I20260709 12:11:47.849313  4273 consensus_queue.cc:1048] T 4b596235d44b4a6e976316208bada57c P 342b038803924b2b8625bfd6f2cf4c08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:47.849596  4132 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "11d2d5e583974e3ea41a0a3ea8e05dd5"
dest_uuid: "342b038803924b2b8625bfd6f2cf4c08"
 from {username='slave'} at 127.0.0.1:46650
I20260709 12:11:47.850157  4132 raft_consensus.cc:493] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P 342b038803924b2b8625bfd6f2cf4c08 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:47.850525  4132 raft_consensus.cc:3060] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P 342b038803924b2b8625bfd6f2cf4c08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:47.857443  4132 raft_consensus.cc:515] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P 342b038803924b2b8625bfd6f2cf4c08 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:47.860510  4056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d2d5e583974e3ea41a0a3ea8e05dd5" candidate_uuid: "342b038803924b2b8625bfd6f2cf4c08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9d299deccaa74c2d8db110a6e6671fcc"
I20260709 12:11:47.860510  4206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11d2d5e583974e3ea41a0a3ea8e05dd5" candidate_uuid: "342b038803924b2b8625bfd6f2cf4c08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4256387244444f3b9c0d54803e74760"
I20260709 12:11:47.861279  4056 raft_consensus.cc:3060] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P 9d299deccaa74c2d8db110a6e6671fcc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:47.861513  4206 raft_consensus.cc:3055] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P e4256387244444f3b9c0d54803e74760 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:11:47.861852  4206 raft_consensus.cc:740] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P e4256387244444f3b9c0d54803e74760 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4256387244444f3b9c0d54803e74760, State: Running, Role: LEADER
I20260709 12:11:47.862696  4206 consensus_queue.cc:260] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P e4256387244444f3b9c0d54803e74760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:47.863772  4206 raft_consensus.cc:3060] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P e4256387244444f3b9c0d54803e74760 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:47.868146  4056 raft_consensus.cc:2468] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P 9d299deccaa74c2d8db110a6e6671fcc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 342b038803924b2b8625bfd6f2cf4c08 in term 2.
I20260709 12:11:47.869107  4132 leader_election.cc:290] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P 342b038803924b2b8625bfd6f2cf4c08 [CANDIDATE]: Term 2 election: Requested vote from peers 9d299deccaa74c2d8db110a6e6671fcc (127.3.212.129:35647), e4256387244444f3b9c0d54803e74760 (127.3.212.131:34743)
I20260709 12:11:47.869532  4095 leader_election.cc:304] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P 342b038803924b2b8625bfd6f2cf4c08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 342b038803924b2b8625bfd6f2cf4c08, 9d299deccaa74c2d8db110a6e6671fcc; no voters: 
I20260709 12:11:47.870374  4273 raft_consensus.cc:2804] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P 342b038803924b2b8625bfd6f2cf4c08 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:11:47.870858  4273 raft_consensus.cc:697] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P 342b038803924b2b8625bfd6f2cf4c08 [term 2 LEADER]: Becoming Leader. State: Replica: 342b038803924b2b8625bfd6f2cf4c08, State: Running, Role: LEADER
I20260709 12:11:47.871634  4273 consensus_queue.cc:237] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P 342b038803924b2b8625bfd6f2cf4c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:47.872430  4206 raft_consensus.cc:2468] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P e4256387244444f3b9c0d54803e74760 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 342b038803924b2b8625bfd6f2cf4c08 in term 2.
I20260709 12:11:47.878549  3951 catalog_manager.cc:5697] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P 342b038803924b2b8625bfd6f2cf4c08 reported cstate change: term changed from 1 to 2, leader changed from e4256387244444f3b9c0d54803e74760 (127.3.212.131) to 342b038803924b2b8625bfd6f2cf4c08 (127.3.212.130). New cstate: current_term: 2 leader_uuid: "342b038803924b2b8625bfd6f2cf4c08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:47.943068  4255 consensus_queue.cc:1048] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:47.949829  4281 raft_consensus.cc:993] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760: : Instructing follower 342b038803924b2b8625bfd6f2cf4c08 to start an election
I20260709 12:11:47.950387  4281 raft_consensus.cc:1081] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 [term 1 LEADER]: Signalling peer 342b038803924b2b8625bfd6f2cf4c08 to start an election
I20260709 12:11:47.956627  4281 consensus_queue.cc:1048] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:11:47.957466  4132 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a3682e1e40804ae0a9d4a7a03f7983b2"
dest_uuid: "342b038803924b2b8625bfd6f2cf4c08"
 from {username='slave'} at 127.0.0.1:46650
I20260709 12:11:47.960109  4132 raft_consensus.cc:493] T a3682e1e40804ae0a9d4a7a03f7983b2 P 342b038803924b2b8625bfd6f2cf4c08 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:47.961936  4132 raft_consensus.cc:3060] T a3682e1e40804ae0a9d4a7a03f7983b2 P 342b038803924b2b8625bfd6f2cf4c08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:47.968756  4132 raft_consensus.cc:515] T a3682e1e40804ae0a9d4a7a03f7983b2 P 342b038803924b2b8625bfd6f2cf4c08 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:47.970616  4132 leader_election.cc:290] T a3682e1e40804ae0a9d4a7a03f7983b2 P 342b038803924b2b8625bfd6f2cf4c08 [CANDIDATE]: Term 2 election: Requested vote from peers 9d299deccaa74c2d8db110a6e6671fcc (127.3.212.129:35647), e4256387244444f3b9c0d54803e74760 (127.3.212.131:34743)
I20260709 12:11:47.971827  4206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3682e1e40804ae0a9d4a7a03f7983b2" candidate_uuid: "342b038803924b2b8625bfd6f2cf4c08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4256387244444f3b9c0d54803e74760"
I20260709 12:11:47.972081  4056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3682e1e40804ae0a9d4a7a03f7983b2" candidate_uuid: "342b038803924b2b8625bfd6f2cf4c08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9d299deccaa74c2d8db110a6e6671fcc"
I20260709 12:11:47.972455  4206 raft_consensus.cc:3055] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:11:47.972775  4056 raft_consensus.cc:3060] T a3682e1e40804ae0a9d4a7a03f7983b2 P 9d299deccaa74c2d8db110a6e6671fcc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:47.972820  4206 raft_consensus.cc:740] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4256387244444f3b9c0d54803e74760, State: Running, Role: LEADER
I20260709 12:11:47.974428  4206 consensus_queue.cc:260] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:47.975587  4206 raft_consensus.cc:3060] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:47.981415  4056 raft_consensus.cc:2468] T a3682e1e40804ae0a9d4a7a03f7983b2 P 9d299deccaa74c2d8db110a6e6671fcc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 342b038803924b2b8625bfd6f2cf4c08 in term 2.
I20260709 12:11:47.981679  4206 raft_consensus.cc:2468] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 342b038803924b2b8625bfd6f2cf4c08 in term 2.
I20260709 12:11:47.982856  4098 leader_election.cc:304] T a3682e1e40804ae0a9d4a7a03f7983b2 P 342b038803924b2b8625bfd6f2cf4c08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 342b038803924b2b8625bfd6f2cf4c08, e4256387244444f3b9c0d54803e74760; no voters: 
I20260709 12:11:47.983753  4273 raft_consensus.cc:2804] T a3682e1e40804ae0a9d4a7a03f7983b2 P 342b038803924b2b8625bfd6f2cf4c08 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:11:47.984265  4273 raft_consensus.cc:697] T a3682e1e40804ae0a9d4a7a03f7983b2 P 342b038803924b2b8625bfd6f2cf4c08 [term 2 LEADER]: Becoming Leader. State: Replica: 342b038803924b2b8625bfd6f2cf4c08, State: Running, Role: LEADER
I20260709 12:11:47.985160  4273 consensus_queue.cc:237] T a3682e1e40804ae0a9d4a7a03f7983b2 P 342b038803924b2b8625bfd6f2cf4c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:47.992904  3954 catalog_manager.cc:5697] T a3682e1e40804ae0a9d4a7a03f7983b2 P 342b038803924b2b8625bfd6f2cf4c08 reported cstate change: term changed from 1 to 2, leader changed from e4256387244444f3b9c0d54803e74760 (127.3.212.131) to 342b038803924b2b8625bfd6f2cf4c08 (127.3.212.130). New cstate: current_term: 2 leader_uuid: "342b038803924b2b8625bfd6f2cf4c08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:48.036657  4255 raft_consensus.cc:993] T b52aa28f64ae441783bcb12eeeb24273 P e4256387244444f3b9c0d54803e74760: : Instructing follower 9d299deccaa74c2d8db110a6e6671fcc to start an election
I20260709 12:11:48.037178  4255 raft_consensus.cc:1081] T b52aa28f64ae441783bcb12eeeb24273 P e4256387244444f3b9c0d54803e74760 [term 1 LEADER]: Signalling peer 9d299deccaa74c2d8db110a6e6671fcc to start an election
I20260709 12:11:48.039026  4056 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b52aa28f64ae441783bcb12eeeb24273"
dest_uuid: "9d299deccaa74c2d8db110a6e6671fcc"
 from {username='slave'} at 127.0.0.1:56062
I20260709 12:11:48.040628  4056 raft_consensus.cc:493] T b52aa28f64ae441783bcb12eeeb24273 P 9d299deccaa74c2d8db110a6e6671fcc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:48.041004  4056 raft_consensus.cc:3060] T b52aa28f64ae441783bcb12eeeb24273 P 9d299deccaa74c2d8db110a6e6671fcc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:48.048110  4056 raft_consensus.cc:515] T b52aa28f64ae441783bcb12eeeb24273 P 9d299deccaa74c2d8db110a6e6671fcc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } }
I20260709 12:11:48.050709  4056 leader_election.cc:290] T b52aa28f64ae441783bcb12eeeb24273 P 9d299deccaa74c2d8db110a6e6671fcc [CANDIDATE]: Term 2 election: Requested vote from peers e4256387244444f3b9c0d54803e74760 (127.3.212.131:34743), 342b038803924b2b8625bfd6f2cf4c08 (127.3.212.130:39923)
I20260709 12:11:48.051985  4132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52aa28f64ae441783bcb12eeeb24273" candidate_uuid: "9d299deccaa74c2d8db110a6e6671fcc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "342b038803924b2b8625bfd6f2cf4c08"
I20260709 12:11:48.052187  4206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52aa28f64ae441783bcb12eeeb24273" candidate_uuid: "9d299deccaa74c2d8db110a6e6671fcc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4256387244444f3b9c0d54803e74760"
I20260709 12:11:48.052649  4132 raft_consensus.cc:3060] T b52aa28f64ae441783bcb12eeeb24273 P 342b038803924b2b8625bfd6f2cf4c08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:48.052706  4206 raft_consensus.cc:3055] T b52aa28f64ae441783bcb12eeeb24273 P e4256387244444f3b9c0d54803e74760 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:11:48.053112  4206 raft_consensus.cc:740] T b52aa28f64ae441783bcb12eeeb24273 P e4256387244444f3b9c0d54803e74760 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4256387244444f3b9c0d54803e74760, State: Running, Role: LEADER
I20260709 12:11:48.053982  4206 consensus_queue.cc:260] T b52aa28f64ae441783bcb12eeeb24273 P e4256387244444f3b9c0d54803e74760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } }
I20260709 12:11:48.055234  4206 raft_consensus.cc:3060] T b52aa28f64ae441783bcb12eeeb24273 P e4256387244444f3b9c0d54803e74760 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:48.059760  4132 raft_consensus.cc:2468] T b52aa28f64ae441783bcb12eeeb24273 P 342b038803924b2b8625bfd6f2cf4c08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d299deccaa74c2d8db110a6e6671fcc in term 2.
I20260709 12:11:48.061188  4020 leader_election.cc:304] T b52aa28f64ae441783bcb12eeeb24273 P 9d299deccaa74c2d8db110a6e6671fcc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 342b038803924b2b8625bfd6f2cf4c08, 9d299deccaa74c2d8db110a6e6671fcc; no voters: 
I20260709 12:11:48.062067  4259 raft_consensus.cc:2804] T b52aa28f64ae441783bcb12eeeb24273 P 9d299deccaa74c2d8db110a6e6671fcc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:11:48.062667  4259 raft_consensus.cc:697] T b52aa28f64ae441783bcb12eeeb24273 P 9d299deccaa74c2d8db110a6e6671fcc [term 2 LEADER]: Becoming Leader. State: Replica: 9d299deccaa74c2d8db110a6e6671fcc, State: Running, Role: LEADER
I20260709 12:11:48.061982  4206 raft_consensus.cc:2468] T b52aa28f64ae441783bcb12eeeb24273 P e4256387244444f3b9c0d54803e74760 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d299deccaa74c2d8db110a6e6671fcc in term 2.
I20260709 12:11:48.063496  4259 consensus_queue.cc:237] T b52aa28f64ae441783bcb12eeeb24273 P 9d299deccaa74c2d8db110a6e6671fcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } }
I20260709 12:11:48.072633  3954 catalog_manager.cc:5697] T b52aa28f64ae441783bcb12eeeb24273 P 9d299deccaa74c2d8db110a6e6671fcc reported cstate change: term changed from 1 to 2, leader changed from e4256387244444f3b9c0d54803e74760 (127.3.212.131) to 9d299deccaa74c2d8db110a6e6671fcc (127.3.212.129). New cstate: current_term: 2 leader_uuid: "9d299deccaa74c2d8db110a6e6671fcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:48.118685  4256 raft_consensus.cc:993] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08: : Instructing follower 9d299deccaa74c2d8db110a6e6671fcc to start an election
I20260709 12:11:48.119215  4273 raft_consensus.cc:1081] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08 [term 1 LEADER]: Signalling peer 9d299deccaa74c2d8db110a6e6671fcc to start an election
I20260709 12:11:48.120999  4056 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "67fd9c39bf234dcb8815c7ce2fd1a07e"
dest_uuid: "9d299deccaa74c2d8db110a6e6671fcc"
 from {username='slave'} at 127.0.0.1:56048
I20260709 12:11:48.121681  4056 raft_consensus.cc:493] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 9d299deccaa74c2d8db110a6e6671fcc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:48.122020  4056 raft_consensus.cc:3060] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 9d299deccaa74c2d8db110a6e6671fcc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:48.127038  4056 raft_consensus.cc:515] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 9d299deccaa74c2d8db110a6e6671fcc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:48.129657  4056 leader_election.cc:290] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 9d299deccaa74c2d8db110a6e6671fcc [CANDIDATE]: Term 2 election: Requested vote from peers 342b038803924b2b8625bfd6f2cf4c08 (127.3.212.130:39923), e4256387244444f3b9c0d54803e74760 (127.3.212.131:34743)
I20260709 12:11:48.130857  4206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fd9c39bf234dcb8815c7ce2fd1a07e" candidate_uuid: "9d299deccaa74c2d8db110a6e6671fcc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4256387244444f3b9c0d54803e74760"
I20260709 12:11:48.132062  4206 raft_consensus.cc:3060] T 67fd9c39bf234dcb8815c7ce2fd1a07e P e4256387244444f3b9c0d54803e74760 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:48.133594  4132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fd9c39bf234dcb8815c7ce2fd1a07e" candidate_uuid: "9d299deccaa74c2d8db110a6e6671fcc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "342b038803924b2b8625bfd6f2cf4c08"
I20260709 12:11:48.134238  4132 raft_consensus.cc:3055] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:11:48.134662  4132 raft_consensus.cc:740] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 342b038803924b2b8625bfd6f2cf4c08, State: Running, Role: LEADER
I20260709 12:11:48.135542  4132 consensus_queue.cc:260] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:48.136831  4132 raft_consensus.cc:3060] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:48.141322  4206 raft_consensus.cc:2468] T 67fd9c39bf234dcb8815c7ce2fd1a07e P e4256387244444f3b9c0d54803e74760 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d299deccaa74c2d8db110a6e6671fcc in term 2.
I20260709 12:11:48.143405  4023 leader_election.cc:304] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 9d299deccaa74c2d8db110a6e6671fcc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d299deccaa74c2d8db110a6e6671fcc, e4256387244444f3b9c0d54803e74760; no voters: 
I20260709 12:11:48.144387  4326 raft_consensus.cc:2804] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 9d299deccaa74c2d8db110a6e6671fcc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:11:48.145696  4131 raft_consensus.cc:1275] T 9e90122ac65e486e80674ceb6d6fcb21 P 342b038803924b2b8625bfd6f2cf4c08 [term 2 FOLLOWER]: Refusing update from remote peer 9d299deccaa74c2d8db110a6e6671fcc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:48.146168  4326 raft_consensus.cc:697] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 9d299deccaa74c2d8db110a6e6671fcc [term 2 LEADER]: Becoming Leader. State: Replica: 9d299deccaa74c2d8db110a6e6671fcc, State: Running, Role: LEADER
I20260709 12:11:48.147119  4132 raft_consensus.cc:2468] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d299deccaa74c2d8db110a6e6671fcc in term 2.
I20260709 12:11:48.147151  4326 consensus_queue.cc:237] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 9d299deccaa74c2d8db110a6e6671fcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:48.148363  4333 consensus_queue.cc:1048] T 9e90122ac65e486e80674ceb6d6fcb21 P 9d299deccaa74c2d8db110a6e6671fcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:11:48.156891  3954 catalog_manager.cc:5697] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 9d299deccaa74c2d8db110a6e6671fcc reported cstate change: term changed from 1 to 2, leader changed from 342b038803924b2b8625bfd6f2cf4c08 (127.3.212.130) to 9d299deccaa74c2d8db110a6e6671fcc (127.3.212.129). New cstate: current_term: 2 leader_uuid: "9d299deccaa74c2d8db110a6e6671fcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:48.167899  4206 raft_consensus.cc:1275] T 9e90122ac65e486e80674ceb6d6fcb21 P e4256387244444f3b9c0d54803e74760 [term 2 FOLLOWER]: Refusing update from remote peer 9d299deccaa74c2d8db110a6e6671fcc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:48.169817  4334 consensus_queue.cc:1048] T 9e90122ac65e486e80674ceb6d6fcb21 P 9d299deccaa74c2d8db110a6e6671fcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:48.197669  4256 raft_consensus.cc:993] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08: : Instructing follower 9d299deccaa74c2d8db110a6e6671fcc to start an election
I20260709 12:11:48.198190  4273 raft_consensus.cc:1081] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08 [term 1 LEADER]: Signalling peer 9d299deccaa74c2d8db110a6e6671fcc to start an election
I20260709 12:11:48.199931  4056 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57a371ce6a7d437380ff59166848f1bc"
dest_uuid: "9d299deccaa74c2d8db110a6e6671fcc"
 from {username='slave'} at 127.0.0.1:56048
I20260709 12:11:48.200565  4056 raft_consensus.cc:493] T 57a371ce6a7d437380ff59166848f1bc P 9d299deccaa74c2d8db110a6e6671fcc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:48.200922  4056 raft_consensus.cc:3060] T 57a371ce6a7d437380ff59166848f1bc P 9d299deccaa74c2d8db110a6e6671fcc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:48.207756  4056 raft_consensus.cc:515] T 57a371ce6a7d437380ff59166848f1bc P 9d299deccaa74c2d8db110a6e6671fcc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:48.210284  4056 leader_election.cc:290] T 57a371ce6a7d437380ff59166848f1bc P 9d299deccaa74c2d8db110a6e6671fcc [CANDIDATE]: Term 2 election: Requested vote from peers 342b038803924b2b8625bfd6f2cf4c08 (127.3.212.130:39923), e4256387244444f3b9c0d54803e74760 (127.3.212.131:34743)
I20260709 12:11:48.211297  4132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a371ce6a7d437380ff59166848f1bc" candidate_uuid: "9d299deccaa74c2d8db110a6e6671fcc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "342b038803924b2b8625bfd6f2cf4c08"
I20260709 12:11:48.211726  4206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a371ce6a7d437380ff59166848f1bc" candidate_uuid: "9d299deccaa74c2d8db110a6e6671fcc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4256387244444f3b9c0d54803e74760"
I20260709 12:11:48.212124  4132 raft_consensus.cc:3055] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:11:48.212286  4206 raft_consensus.cc:3060] T 57a371ce6a7d437380ff59166848f1bc P e4256387244444f3b9c0d54803e74760 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:48.212507  4132 raft_consensus.cc:740] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 342b038803924b2b8625bfd6f2cf4c08, State: Running, Role: LEADER
I20260709 12:11:48.213338  4132 consensus_queue.cc:260] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:48.214308  4132 raft_consensus.cc:3060] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:11:48.219028  4132 raft_consensus.cc:2468] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d299deccaa74c2d8db110a6e6671fcc in term 2.
I20260709 12:11:48.219388  4206 raft_consensus.cc:2468] T 57a371ce6a7d437380ff59166848f1bc P e4256387244444f3b9c0d54803e74760 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d299deccaa74c2d8db110a6e6671fcc in term 2.
I20260709 12:11:48.220031  4020 leader_election.cc:304] T 57a371ce6a7d437380ff59166848f1bc P 9d299deccaa74c2d8db110a6e6671fcc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 342b038803924b2b8625bfd6f2cf4c08, 9d299deccaa74c2d8db110a6e6671fcc; no voters: 
I20260709 12:11:48.220820  4334 raft_consensus.cc:2804] T 57a371ce6a7d437380ff59166848f1bc P 9d299deccaa74c2d8db110a6e6671fcc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:11:48.221261  4334 raft_consensus.cc:697] T 57a371ce6a7d437380ff59166848f1bc P 9d299deccaa74c2d8db110a6e6671fcc [term 2 LEADER]: Becoming Leader. State: Replica: 9d299deccaa74c2d8db110a6e6671fcc, State: Running, Role: LEADER
I20260709 12:11:48.222015  4334 consensus_queue.cc:237] T 57a371ce6a7d437380ff59166848f1bc P 9d299deccaa74c2d8db110a6e6671fcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:48.228427  3954 catalog_manager.cc:5697] T 57a371ce6a7d437380ff59166848f1bc P 9d299deccaa74c2d8db110a6e6671fcc reported cstate change: term changed from 1 to 2, leader changed from 342b038803924b2b8625bfd6f2cf4c08 (127.3.212.130) to 9d299deccaa74c2d8db110a6e6671fcc (127.3.212.129). New cstate: current_term: 2 leader_uuid: "9d299deccaa74c2d8db110a6e6671fcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:48.283396  4132 raft_consensus.cc:1275] T a6ccb39b2a244abd87777efcef76ab72 P 342b038803924b2b8625bfd6f2cf4c08 [term 2 FOLLOWER]: Refusing update from remote peer e4256387244444f3b9c0d54803e74760: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:48.285449  4281 consensus_queue.cc:1048] T a6ccb39b2a244abd87777efcef76ab72 P e4256387244444f3b9c0d54803e74760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:11:48.294905  4056 raft_consensus.cc:1275] T a6ccb39b2a244abd87777efcef76ab72 P 9d299deccaa74c2d8db110a6e6671fcc [term 2 FOLLOWER]: Refusing update from remote peer e4256387244444f3b9c0d54803e74760: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:48.296804  4324 consensus_queue.cc:1048] T a6ccb39b2a244abd87777efcef76ab72 P e4256387244444f3b9c0d54803e74760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:11:48.378300  4206 raft_consensus.cc:1275] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 [term 2 FOLLOWER]: Refusing update from remote peer 342b038803924b2b8625bfd6f2cf4c08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:48.379750  4273 consensus_queue.cc:1048] T a3682e1e40804ae0a9d4a7a03f7983b2 P 342b038803924b2b8625bfd6f2cf4c08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:48.388131  4056 raft_consensus.cc:1275] T a3682e1e40804ae0a9d4a7a03f7983b2 P 9d299deccaa74c2d8db110a6e6671fcc [term 2 FOLLOWER]: Refusing update from remote peer 342b038803924b2b8625bfd6f2cf4c08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:48.389726  4291 consensus_queue.cc:1048] T a3682e1e40804ae0a9d4a7a03f7983b2 P 342b038803924b2b8625bfd6f2cf4c08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:48.400321  4206 raft_consensus.cc:1275] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P e4256387244444f3b9c0d54803e74760 [term 2 FOLLOWER]: Refusing update from remote peer 342b038803924b2b8625bfd6f2cf4c08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:48.401469  4291 consensus_queue.cc:1048] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P 342b038803924b2b8625bfd6f2cf4c08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:48.410663  4056 raft_consensus.cc:1275] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P 9d299deccaa74c2d8db110a6e6671fcc [term 2 FOLLOWER]: Refusing update from remote peer 342b038803924b2b8625bfd6f2cf4c08: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:48.412483  4273 consensus_queue.cc:1048] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P 342b038803924b2b8625bfd6f2cf4c08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:11:48.449004  4206 raft_consensus.cc:1275] T b52aa28f64ae441783bcb12eeeb24273 P e4256387244444f3b9c0d54803e74760 [term 2 FOLLOWER]: Refusing update from remote peer 9d299deccaa74c2d8db110a6e6671fcc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:48.450477  4334 consensus_queue.cc:1048] T b52aa28f64ae441783bcb12eeeb24273 P 9d299deccaa74c2d8db110a6e6671fcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:48.457875  4132 raft_consensus.cc:1275] T b52aa28f64ae441783bcb12eeeb24273 P 342b038803924b2b8625bfd6f2cf4c08 [term 2 FOLLOWER]: Refusing update from remote peer 9d299deccaa74c2d8db110a6e6671fcc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:48.459841  4333 consensus_queue.cc:1048] T b52aa28f64ae441783bcb12eeeb24273 P 9d299deccaa74c2d8db110a6e6671fcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:48.614637  4206 raft_consensus.cc:1275] T 57a371ce6a7d437380ff59166848f1bc P e4256387244444f3b9c0d54803e74760 [term 2 FOLLOWER]: Refusing update from remote peer 9d299deccaa74c2d8db110a6e6671fcc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:48.615814  4333 consensus_queue.cc:1048] T 57a371ce6a7d437380ff59166848f1bc P 9d299deccaa74c2d8db110a6e6671fcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:48.624259  4132 raft_consensus.cc:1275] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08 [term 2 FOLLOWER]: Refusing update from remote peer 9d299deccaa74c2d8db110a6e6671fcc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:48.626370  4334 consensus_queue.cc:1048] T 57a371ce6a7d437380ff59166848f1bc P 9d299deccaa74c2d8db110a6e6671fcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:48.639842  4206 raft_consensus.cc:1275] T 67fd9c39bf234dcb8815c7ce2fd1a07e P e4256387244444f3b9c0d54803e74760 [term 2 FOLLOWER]: Refusing update from remote peer 9d299deccaa74c2d8db110a6e6671fcc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:48.641129  4334 consensus_queue.cc:1048] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 9d299deccaa74c2d8db110a6e6671fcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:48.650175  4132 raft_consensus.cc:1275] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08 [term 2 FOLLOWER]: Refusing update from remote peer 9d299deccaa74c2d8db110a6e6671fcc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:11:48.651640  4326 consensus_queue.cc:1048] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 9d299deccaa74c2d8db110a6e6671fcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:50.736863  3922 auto_leader_rebalancer-test.cc:294] The leader distribution is 
I20260709 12:11:50.737673  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:50.758404  4054 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67fd9c39bf234dcb8815c7ce2fd1a07e"
dest_uuid: "9d299deccaa74c2d8db110a6e6671fcc"
mode: GRACEFUL
new_leader_uuid: "e4256387244444f3b9c0d54803e74760"
 from {username='slave'} at 127.0.0.1:56066
I20260709 12:11:50.758955  4054 raft_consensus.cc:606] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 9d299deccaa74c2d8db110a6e6671fcc [term 2 LEADER]: Received request to transfer leadership to TS e4256387244444f3b9c0d54803e74760
I20260709 12:11:50.769876  4132 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a3682e1e40804ae0a9d4a7a03f7983b2"
dest_uuid: "342b038803924b2b8625bfd6f2cf4c08"
mode: GRACEFUL
new_leader_uuid: "e4256387244444f3b9c0d54803e74760"
 from {username='slave'} at 127.0.0.1:46672
I20260709 12:11:50.770390  4132 raft_consensus.cc:606] T a3682e1e40804ae0a9d4a7a03f7983b2 P 342b038803924b2b8625bfd6f2cf4c08 [term 2 LEADER]: Received request to transfer leadership to TS e4256387244444f3b9c0d54803e74760
I20260709 12:11:50.771621  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:11:50.772066  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:50.907302  4350 raft_consensus.cc:993] T a3682e1e40804ae0a9d4a7a03f7983b2 P 342b038803924b2b8625bfd6f2cf4c08: : Instructing follower e4256387244444f3b9c0d54803e74760 to start an election
I20260709 12:11:50.907764  4350 raft_consensus.cc:1081] T a3682e1e40804ae0a9d4a7a03f7983b2 P 342b038803924b2b8625bfd6f2cf4c08 [term 2 LEADER]: Signalling peer e4256387244444f3b9c0d54803e74760 to start an election
I20260709 12:11:50.909677  4206 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a3682e1e40804ae0a9d4a7a03f7983b2"
dest_uuid: "e4256387244444f3b9c0d54803e74760"
 from {username='slave'} at 127.0.0.1:45636
I20260709 12:11:50.910282  4206 raft_consensus.cc:493] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:50.910573  4206 raft_consensus.cc:3060] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:11:50.915189  4206 raft_consensus.cc:515] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:50.916697  4206 leader_election.cc:290] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 [CANDIDATE]: Term 3 election: Requested vote from peers 9d299deccaa74c2d8db110a6e6671fcc (127.3.212.129:35647), 342b038803924b2b8625bfd6f2cf4c08 (127.3.212.130:39923)
I20260709 12:11:50.917768  4054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3682e1e40804ae0a9d4a7a03f7983b2" candidate_uuid: "e4256387244444f3b9c0d54803e74760" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9d299deccaa74c2d8db110a6e6671fcc"
I20260709 12:11:50.918485  4054 raft_consensus.cc:3060] T a3682e1e40804ae0a9d4a7a03f7983b2 P 9d299deccaa74c2d8db110a6e6671fcc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:11:50.918408  4132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3682e1e40804ae0a9d4a7a03f7983b2" candidate_uuid: "e4256387244444f3b9c0d54803e74760" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "342b038803924b2b8625bfd6f2cf4c08"
I20260709 12:11:50.919077  4132 raft_consensus.cc:3055] T a3682e1e40804ae0a9d4a7a03f7983b2 P 342b038803924b2b8625bfd6f2cf4c08 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:11:50.919421  4132 raft_consensus.cc:740] T a3682e1e40804ae0a9d4a7a03f7983b2 P 342b038803924b2b8625bfd6f2cf4c08 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 342b038803924b2b8625bfd6f2cf4c08, State: Running, Role: LEADER
I20260709 12:11:50.920344  4132 consensus_queue.cc:260] T a3682e1e40804ae0a9d4a7a03f7983b2 P 342b038803924b2b8625bfd6f2cf4c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:50.921605  4132 raft_consensus.cc:3060] T a3682e1e40804ae0a9d4a7a03f7983b2 P 342b038803924b2b8625bfd6f2cf4c08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:11:50.925592  4054 raft_consensus.cc:2468] T a3682e1e40804ae0a9d4a7a03f7983b2 P 9d299deccaa74c2d8db110a6e6671fcc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4256387244444f3b9c0d54803e74760 in term 3.
I20260709 12:11:50.927145  4169 leader_election.cc:304] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d299deccaa74c2d8db110a6e6671fcc, e4256387244444f3b9c0d54803e74760; no voters: 
I20260709 12:11:50.928018  4343 raft_consensus.cc:2804] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:11:50.928318  4132 raft_consensus.cc:2468] T a3682e1e40804ae0a9d4a7a03f7983b2 P 342b038803924b2b8625bfd6f2cf4c08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4256387244444f3b9c0d54803e74760 in term 3.
I20260709 12:11:50.929632  4343 raft_consensus.cc:697] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 [term 3 LEADER]: Becoming Leader. State: Replica: e4256387244444f3b9c0d54803e74760, State: Running, Role: LEADER
I20260709 12:11:50.930702  4343 consensus_queue.cc:237] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:50.937937  3951 catalog_manager.cc:5697] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 reported cstate change: term changed from 2 to 3, leader changed from 342b038803924b2b8625bfd6f2cf4c08 (127.3.212.130) to e4256387244444f3b9c0d54803e74760 (127.3.212.131). New cstate: current_term: 3 leader_uuid: "e4256387244444f3b9c0d54803e74760" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:51.231782  4357 raft_consensus.cc:993] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 9d299deccaa74c2d8db110a6e6671fcc: : Instructing follower e4256387244444f3b9c0d54803e74760 to start an election
I20260709 12:11:51.232366  4346 raft_consensus.cc:1081] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 9d299deccaa74c2d8db110a6e6671fcc [term 2 LEADER]: Signalling peer e4256387244444f3b9c0d54803e74760 to start an election
I20260709 12:11:51.234294  4206 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "67fd9c39bf234dcb8815c7ce2fd1a07e"
dest_uuid: "e4256387244444f3b9c0d54803e74760"
 from {username='slave'} at 127.0.0.1:45642
I20260709 12:11:51.234750  4206 raft_consensus.cc:493] T 67fd9c39bf234dcb8815c7ce2fd1a07e P e4256387244444f3b9c0d54803e74760 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:51.235021  4206 raft_consensus.cc:3060] T 67fd9c39bf234dcb8815c7ce2fd1a07e P e4256387244444f3b9c0d54803e74760 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:11:51.238982  4206 raft_consensus.cc:515] T 67fd9c39bf234dcb8815c7ce2fd1a07e P e4256387244444f3b9c0d54803e74760 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:51.240542  4206 leader_election.cc:290] T 67fd9c39bf234dcb8815c7ce2fd1a07e P e4256387244444f3b9c0d54803e74760 [CANDIDATE]: Term 3 election: Requested vote from peers 9d299deccaa74c2d8db110a6e6671fcc (127.3.212.129:35647), 342b038803924b2b8625bfd6f2cf4c08 (127.3.212.130:39923)
I20260709 12:11:51.241679  4054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fd9c39bf234dcb8815c7ce2fd1a07e" candidate_uuid: "e4256387244444f3b9c0d54803e74760" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9d299deccaa74c2d8db110a6e6671fcc"
I20260709 12:11:51.241711  4132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fd9c39bf234dcb8815c7ce2fd1a07e" candidate_uuid: "e4256387244444f3b9c0d54803e74760" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "342b038803924b2b8625bfd6f2cf4c08"
I20260709 12:11:51.242311  4054 raft_consensus.cc:3055] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 9d299deccaa74c2d8db110a6e6671fcc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:11:51.242362  4132 raft_consensus.cc:3060] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:11:51.242615  4054 raft_consensus.cc:740] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 9d299deccaa74c2d8db110a6e6671fcc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9d299deccaa74c2d8db110a6e6671fcc, State: Running, Role: LEADER
I20260709 12:11:51.243379  4054 consensus_queue.cc:260] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 9d299deccaa74c2d8db110a6e6671fcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:51.244359  4054 raft_consensus.cc:3060] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 9d299deccaa74c2d8db110a6e6671fcc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:11:51.247540  4132 raft_consensus.cc:2468] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4256387244444f3b9c0d54803e74760 in term 3.
I20260709 12:11:51.248730  4169 leader_election.cc:304] T 67fd9c39bf234dcb8815c7ce2fd1a07e P e4256387244444f3b9c0d54803e74760 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 342b038803924b2b8625bfd6f2cf4c08, e4256387244444f3b9c0d54803e74760; no voters: 
I20260709 12:11:51.249482  4054 raft_consensus.cc:2468] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 9d299deccaa74c2d8db110a6e6671fcc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4256387244444f3b9c0d54803e74760 in term 3.
I20260709 12:11:51.249697  4343 raft_consensus.cc:2804] T 67fd9c39bf234dcb8815c7ce2fd1a07e P e4256387244444f3b9c0d54803e74760 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:11:51.250138  4343 raft_consensus.cc:697] T 67fd9c39bf234dcb8815c7ce2fd1a07e P e4256387244444f3b9c0d54803e74760 [term 3 LEADER]: Becoming Leader. State: Replica: e4256387244444f3b9c0d54803e74760, State: Running, Role: LEADER
I20260709 12:11:51.250939  4343 consensus_queue.cc:237] T 67fd9c39bf234dcb8815c7ce2fd1a07e P e4256387244444f3b9c0d54803e74760 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:11:51.261624  3951 catalog_manager.cc:5697] T 67fd9c39bf234dcb8815c7ce2fd1a07e P e4256387244444f3b9c0d54803e74760 reported cstate change: term changed from 2 to 3, leader changed from 9d299deccaa74c2d8db110a6e6671fcc (127.3.212.129) to e4256387244444f3b9c0d54803e74760 (127.3.212.131). New cstate: current_term: 3 leader_uuid: "e4256387244444f3b9c0d54803e74760" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:51.348862  4132 raft_consensus.cc:1275] T a3682e1e40804ae0a9d4a7a03f7983b2 P 342b038803924b2b8625bfd6f2cf4c08 [term 3 FOLLOWER]: Refusing update from remote peer e4256387244444f3b9c0d54803e74760: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:11:51.350260  4343 consensus_queue.cc:1048] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:11:51.359439  4054 raft_consensus.cc:1275] T a3682e1e40804ae0a9d4a7a03f7983b2 P 9d299deccaa74c2d8db110a6e6671fcc [term 3 FOLLOWER]: Refusing update from remote peer e4256387244444f3b9c0d54803e74760: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:11:51.360875  4343 consensus_queue.cc:1048] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:11:51.705224  4132 raft_consensus.cc:1275] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08 [term 3 FOLLOWER]: Refusing update from remote peer e4256387244444f3b9c0d54803e74760: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:11:51.706812  4343 consensus_queue.cc:1048] T 67fd9c39bf234dcb8815c7ce2fd1a07e P e4256387244444f3b9c0d54803e74760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:11:51.716714  4054 raft_consensus.cc:1275] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 9d299deccaa74c2d8db110a6e6671fcc [term 3 FOLLOWER]: Refusing update from remote peer e4256387244444f3b9c0d54803e74760: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:11:51.718247  4351 consensus_queue.cc:1048] T 67fd9c39bf234dcb8815c7ce2fd1a07e P e4256387244444f3b9c0d54803e74760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:11:51.773119  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:51.778362  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:11:51.778735  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:52.779781  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:52.784744  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:11:52.785130  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:53.786072  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:53.792083  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:11:53.792593  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:54.793771  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:54.798827  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:11:54.799226  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:55.800254  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:55.805770  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:11:55.806128  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:56.807015  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:56.812201  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:11:56.812657  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:57.813736  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:57.818516  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:11:57.818907  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:58.819777  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:58.825001  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:11:58.825408  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:59.826306  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:59.831835  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:11:59.832293  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:00.862252  3922 auto_leader_rebalancer-test.cc:313] The leader distribution is 
I20260709 12:12:00.879352  4056 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b52aa28f64ae441783bcb12eeeb24273"
dest_uuid: "9d299deccaa74c2d8db110a6e6671fcc"
mode: GRACEFUL
new_leader_uuid: "342b038803924b2b8625bfd6f2cf4c08"
 from {username='slave'} at 127.0.0.1:48782
I20260709 12:12:00.879989  4056 raft_consensus.cc:606] T b52aa28f64ae441783bcb12eeeb24273 P 9d299deccaa74c2d8db110a6e6671fcc [term 2 LEADER]: Received request to transfer leadership to TS 342b038803924b2b8625bfd6f2cf4c08
I20260709 12:12:00.885288  4056 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e90122ac65e486e80674ceb6d6fcb21"
dest_uuid: "9d299deccaa74c2d8db110a6e6671fcc"
mode: GRACEFUL
new_leader_uuid: "342b038803924b2b8625bfd6f2cf4c08"
 from {username='slave'} at 127.0.0.1:48782
I20260709 12:12:00.885789  4056 raft_consensus.cc:606] T 9e90122ac65e486e80674ceb6d6fcb21 P 9d299deccaa74c2d8db110a6e6671fcc [term 2 LEADER]: Received request to transfer leadership to TS 342b038803924b2b8625bfd6f2cf4c08
I20260709 12:12:00.891484  4206 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67fd9c39bf234dcb8815c7ce2fd1a07e"
dest_uuid: "e4256387244444f3b9c0d54803e74760"
mode: GRACEFUL
new_leader_uuid: "342b038803924b2b8625bfd6f2cf4c08"
 from {username='slave'} at 127.0.0.1:45650
I20260709 12:12:00.892007  4206 raft_consensus.cc:606] T 67fd9c39bf234dcb8815c7ce2fd1a07e P e4256387244444f3b9c0d54803e74760 [term 3 LEADER]: Received request to transfer leadership to TS 342b038803924b2b8625bfd6f2cf4c08
I20260709 12:12:00.897107  4056 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57a371ce6a7d437380ff59166848f1bc"
dest_uuid: "9d299deccaa74c2d8db110a6e6671fcc"
mode: GRACEFUL
new_leader_uuid: "342b038803924b2b8625bfd6f2cf4c08"
 from {username='slave'} at 127.0.0.1:48782
I20260709 12:12:00.897601  4056 raft_consensus.cc:606] T 57a371ce6a7d437380ff59166848f1bc P 9d299deccaa74c2d8db110a6e6671fcc [term 2 LEADER]: Received request to transfer leadership to TS 342b038803924b2b8625bfd6f2cf4c08
I20260709 12:12:00.910781  4206 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a3682e1e40804ae0a9d4a7a03f7983b2"
dest_uuid: "e4256387244444f3b9c0d54803e74760"
mode: GRACEFUL
new_leader_uuid: "342b038803924b2b8625bfd6f2cf4c08"
 from {username='slave'} at 127.0.0.1:45650
I20260709 12:12:00.911254  4206 raft_consensus.cc:606] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 [term 3 LEADER]: Received request to transfer leadership to TS 342b038803924b2b8625bfd6f2cf4c08
I20260709 12:12:01.099546  4370 raft_consensus.cc:993] T 57a371ce6a7d437380ff59166848f1bc P 9d299deccaa74c2d8db110a6e6671fcc: : Instructing follower 342b038803924b2b8625bfd6f2cf4c08 to start an election
I20260709 12:12:01.099969  4370 raft_consensus.cc:1081] T 57a371ce6a7d437380ff59166848f1bc P 9d299deccaa74c2d8db110a6e6671fcc [term 2 LEADER]: Signalling peer 342b038803924b2b8625bfd6f2cf4c08 to start an election
I20260709 12:12:01.101475  4132 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57a371ce6a7d437380ff59166848f1bc"
dest_uuid: "342b038803924b2b8625bfd6f2cf4c08"
 from {username='slave'} at 127.0.0.1:46642
I20260709 12:12:01.101966  4132 raft_consensus.cc:493] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:01.102260  4132 raft_consensus.cc:3060] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:01.107024  4132 raft_consensus.cc:515] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:12:01.108664  4132 leader_election.cc:290] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08 [CANDIDATE]: Term 3 election: Requested vote from peers 9d299deccaa74c2d8db110a6e6671fcc (127.3.212.129:35647), e4256387244444f3b9c0d54803e74760 (127.3.212.131:34743)
I20260709 12:12:01.109701  4206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a371ce6a7d437380ff59166848f1bc" candidate_uuid: "342b038803924b2b8625bfd6f2cf4c08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e4256387244444f3b9c0d54803e74760"
I20260709 12:12:01.110277  4056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a371ce6a7d437380ff59166848f1bc" candidate_uuid: "342b038803924b2b8625bfd6f2cf4c08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9d299deccaa74c2d8db110a6e6671fcc"
I20260709 12:12:01.110299  4206 raft_consensus.cc:3060] T 57a371ce6a7d437380ff59166848f1bc P e4256387244444f3b9c0d54803e74760 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:01.110924  4056 raft_consensus.cc:3055] T 57a371ce6a7d437380ff59166848f1bc P 9d299deccaa74c2d8db110a6e6671fcc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:01.111174  4056 raft_consensus.cc:740] T 57a371ce6a7d437380ff59166848f1bc P 9d299deccaa74c2d8db110a6e6671fcc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9d299deccaa74c2d8db110a6e6671fcc, State: Running, Role: LEADER
I20260709 12:12:01.111811  4056 consensus_queue.cc:260] T 57a371ce6a7d437380ff59166848f1bc P 9d299deccaa74c2d8db110a6e6671fcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:12:01.112730  4056 raft_consensus.cc:3060] T 57a371ce6a7d437380ff59166848f1bc P 9d299deccaa74c2d8db110a6e6671fcc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:01.115211  4206 raft_consensus.cc:2468] T 57a371ce6a7d437380ff59166848f1bc P e4256387244444f3b9c0d54803e74760 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 342b038803924b2b8625bfd6f2cf4c08 in term 3.
I20260709 12:12:01.116575  4098 leader_election.cc:304] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 342b038803924b2b8625bfd6f2cf4c08, e4256387244444f3b9c0d54803e74760; no voters: 
I20260709 12:12:01.117256  4056 raft_consensus.cc:2468] T 57a371ce6a7d437380ff59166848f1bc P 9d299deccaa74c2d8db110a6e6671fcc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 342b038803924b2b8625bfd6f2cf4c08 in term 3.
I20260709 12:12:01.117313  4350 raft_consensus.cc:2804] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:01.118603  4350 raft_consensus.cc:697] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08 [term 3 LEADER]: Becoming Leader. State: Replica: 342b038803924b2b8625bfd6f2cf4c08, State: Running, Role: LEADER
I20260709 12:12:01.119418  4350 consensus_queue.cc:237] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:12:01.126233  3951 catalog_manager.cc:5697] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08 reported cstate change: term changed from 2 to 3, leader changed from 9d299deccaa74c2d8db110a6e6671fcc (127.3.212.129) to 342b038803924b2b8625bfd6f2cf4c08 (127.3.212.130). New cstate: current_term: 3 leader_uuid: "342b038803924b2b8625bfd6f2cf4c08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:01.260887  4375 raft_consensus.cc:993] T 9e90122ac65e486e80674ceb6d6fcb21 P 9d299deccaa74c2d8db110a6e6671fcc: : Instructing follower 342b038803924b2b8625bfd6f2cf4c08 to start an election
I20260709 12:12:01.261369  4370 raft_consensus.cc:1081] T 9e90122ac65e486e80674ceb6d6fcb21 P 9d299deccaa74c2d8db110a6e6671fcc [term 2 LEADER]: Signalling peer 342b038803924b2b8625bfd6f2cf4c08 to start an election
I20260709 12:12:01.263190  4132 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e90122ac65e486e80674ceb6d6fcb21"
dest_uuid: "342b038803924b2b8625bfd6f2cf4c08"
 from {username='slave'} at 127.0.0.1:46642
I20260709 12:12:01.263733  4132 raft_consensus.cc:493] T 9e90122ac65e486e80674ceb6d6fcb21 P 342b038803924b2b8625bfd6f2cf4c08 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:01.264025  4132 raft_consensus.cc:3060] T 9e90122ac65e486e80674ceb6d6fcb21 P 342b038803924b2b8625bfd6f2cf4c08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:01.268267  4132 raft_consensus.cc:515] T 9e90122ac65e486e80674ceb6d6fcb21 P 342b038803924b2b8625bfd6f2cf4c08 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:12:01.269780  4132 leader_election.cc:290] T 9e90122ac65e486e80674ceb6d6fcb21 P 342b038803924b2b8625bfd6f2cf4c08 [CANDIDATE]: Term 3 election: Requested vote from peers 9d299deccaa74c2d8db110a6e6671fcc (127.3.212.129:35647), e4256387244444f3b9c0d54803e74760 (127.3.212.131:34743)
I20260709 12:12:01.270720  4056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e90122ac65e486e80674ceb6d6fcb21" candidate_uuid: "342b038803924b2b8625bfd6f2cf4c08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9d299deccaa74c2d8db110a6e6671fcc"
I20260709 12:12:01.270871  4206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e90122ac65e486e80674ceb6d6fcb21" candidate_uuid: "342b038803924b2b8625bfd6f2cf4c08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e4256387244444f3b9c0d54803e74760"
I20260709 12:12:01.271240  4056 raft_consensus.cc:3055] T 9e90122ac65e486e80674ceb6d6fcb21 P 9d299deccaa74c2d8db110a6e6671fcc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:01.271497  4206 raft_consensus.cc:3060] T 9e90122ac65e486e80674ceb6d6fcb21 P e4256387244444f3b9c0d54803e74760 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:01.271528  4056 raft_consensus.cc:740] T 9e90122ac65e486e80674ceb6d6fcb21 P 9d299deccaa74c2d8db110a6e6671fcc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9d299deccaa74c2d8db110a6e6671fcc, State: Running, Role: LEADER
I20260709 12:12:01.272303  4056 consensus_queue.cc:260] T 9e90122ac65e486e80674ceb6d6fcb21 P 9d299deccaa74c2d8db110a6e6671fcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:12:01.273289  4056 raft_consensus.cc:3060] T 9e90122ac65e486e80674ceb6d6fcb21 P 9d299deccaa74c2d8db110a6e6671fcc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:01.277297  4206 raft_consensus.cc:2468] T 9e90122ac65e486e80674ceb6d6fcb21 P e4256387244444f3b9c0d54803e74760 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 342b038803924b2b8625bfd6f2cf4c08 in term 3.
I20260709 12:12:01.278460  4056 raft_consensus.cc:2468] T 9e90122ac65e486e80674ceb6d6fcb21 P 9d299deccaa74c2d8db110a6e6671fcc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 342b038803924b2b8625bfd6f2cf4c08 in term 3.
I20260709 12:12:01.278400  4098 leader_election.cc:304] T 9e90122ac65e486e80674ceb6d6fcb21 P 342b038803924b2b8625bfd6f2cf4c08 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 342b038803924b2b8625bfd6f2cf4c08, e4256387244444f3b9c0d54803e74760; no voters: 
I20260709 12:12:01.279373  4350 raft_consensus.cc:2804] T 9e90122ac65e486e80674ceb6d6fcb21 P 342b038803924b2b8625bfd6f2cf4c08 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:01.279801  4350 raft_consensus.cc:697] T 9e90122ac65e486e80674ceb6d6fcb21 P 342b038803924b2b8625bfd6f2cf4c08 [term 3 LEADER]: Becoming Leader. State: Replica: 342b038803924b2b8625bfd6f2cf4c08, State: Running, Role: LEADER
I20260709 12:12:01.280673  4350 consensus_queue.cc:237] T 9e90122ac65e486e80674ceb6d6fcb21 P 342b038803924b2b8625bfd6f2cf4c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:12:01.282598  4375 raft_consensus.cc:993] T b52aa28f64ae441783bcb12eeeb24273 P 9d299deccaa74c2d8db110a6e6671fcc: : Instructing follower 342b038803924b2b8625bfd6f2cf4c08 to start an election
I20260709 12:12:01.283059  4370 raft_consensus.cc:1081] T b52aa28f64ae441783bcb12eeeb24273 P 9d299deccaa74c2d8db110a6e6671fcc [term 2 LEADER]: Signalling peer 342b038803924b2b8625bfd6f2cf4c08 to start an election
I20260709 12:12:01.286221  4132 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b52aa28f64ae441783bcb12eeeb24273"
dest_uuid: "342b038803924b2b8625bfd6f2cf4c08"
 from {username='slave'} at 127.0.0.1:46642
I20260709 12:12:01.286747  4132 raft_consensus.cc:493] T b52aa28f64ae441783bcb12eeeb24273 P 342b038803924b2b8625bfd6f2cf4c08 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:01.287026  4132 raft_consensus.cc:3060] T b52aa28f64ae441783bcb12eeeb24273 P 342b038803924b2b8625bfd6f2cf4c08 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:01.288033  3951 catalog_manager.cc:5697] T 9e90122ac65e486e80674ceb6d6fcb21 P 342b038803924b2b8625bfd6f2cf4c08 reported cstate change: term changed from 2 to 3, leader changed from 9d299deccaa74c2d8db110a6e6671fcc (127.3.212.129) to 342b038803924b2b8625bfd6f2cf4c08 (127.3.212.130). New cstate: current_term: 3 leader_uuid: "342b038803924b2b8625bfd6f2cf4c08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:01.291173  4132 raft_consensus.cc:515] T b52aa28f64ae441783bcb12eeeb24273 P 342b038803924b2b8625bfd6f2cf4c08 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } }
I20260709 12:12:01.292986  4132 leader_election.cc:290] T b52aa28f64ae441783bcb12eeeb24273 P 342b038803924b2b8625bfd6f2cf4c08 [CANDIDATE]: Term 3 election: Requested vote from peers e4256387244444f3b9c0d54803e74760 (127.3.212.131:34743), 9d299deccaa74c2d8db110a6e6671fcc (127.3.212.129:35647)
I20260709 12:12:01.293980  4056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52aa28f64ae441783bcb12eeeb24273" candidate_uuid: "342b038803924b2b8625bfd6f2cf4c08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9d299deccaa74c2d8db110a6e6671fcc"
I20260709 12:12:01.294457  4056 raft_consensus.cc:3055] T b52aa28f64ae441783bcb12eeeb24273 P 9d299deccaa74c2d8db110a6e6671fcc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:01.294149  4206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52aa28f64ae441783bcb12eeeb24273" candidate_uuid: "342b038803924b2b8625bfd6f2cf4c08" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e4256387244444f3b9c0d54803e74760"
I20260709 12:12:01.294736  4056 raft_consensus.cc:740] T b52aa28f64ae441783bcb12eeeb24273 P 9d299deccaa74c2d8db110a6e6671fcc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9d299deccaa74c2d8db110a6e6671fcc, State: Running, Role: LEADER
I20260709 12:12:01.294904  4206 raft_consensus.cc:3060] T b52aa28f64ae441783bcb12eeeb24273 P e4256387244444f3b9c0d54803e74760 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:01.295514  4056 consensus_queue.cc:260] T b52aa28f64ae441783bcb12eeeb24273 P 9d299deccaa74c2d8db110a6e6671fcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } }
I20260709 12:12:01.296352  4056 raft_consensus.cc:3060] T b52aa28f64ae441783bcb12eeeb24273 P 9d299deccaa74c2d8db110a6e6671fcc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:01.300163  4206 raft_consensus.cc:2468] T b52aa28f64ae441783bcb12eeeb24273 P e4256387244444f3b9c0d54803e74760 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 342b038803924b2b8625bfd6f2cf4c08 in term 3.
I20260709 12:12:01.300568  4056 raft_consensus.cc:2468] T b52aa28f64ae441783bcb12eeeb24273 P 9d299deccaa74c2d8db110a6e6671fcc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 342b038803924b2b8625bfd6f2cf4c08 in term 3.
I20260709 12:12:01.301208  4098 leader_election.cc:304] T b52aa28f64ae441783bcb12eeeb24273 P 342b038803924b2b8625bfd6f2cf4c08 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 342b038803924b2b8625bfd6f2cf4c08, e4256387244444f3b9c0d54803e74760; no voters: 
I20260709 12:12:01.301973  4350 raft_consensus.cc:2804] T b52aa28f64ae441783bcb12eeeb24273 P 342b038803924b2b8625bfd6f2cf4c08 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:01.302332  4350 raft_consensus.cc:697] T b52aa28f64ae441783bcb12eeeb24273 P 342b038803924b2b8625bfd6f2cf4c08 [term 3 LEADER]: Becoming Leader. State: Replica: 342b038803924b2b8625bfd6f2cf4c08, State: Running, Role: LEADER
I20260709 12:12:01.303006  4350 consensus_queue.cc:237] T b52aa28f64ae441783bcb12eeeb24273 P 342b038803924b2b8625bfd6f2cf4c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } }
I20260709 12:12:01.309916  3951 catalog_manager.cc:5697] T b52aa28f64ae441783bcb12eeeb24273 P 342b038803924b2b8625bfd6f2cf4c08 reported cstate change: term changed from 2 to 3, leader changed from 9d299deccaa74c2d8db110a6e6671fcc (127.3.212.129) to 342b038803924b2b8625bfd6f2cf4c08 (127.3.212.130). New cstate: current_term: 3 leader_uuid: "342b038803924b2b8625bfd6f2cf4c08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:01.416879  4374 raft_consensus.cc:993] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760: : Instructing follower 342b038803924b2b8625bfd6f2cf4c08 to start an election
I20260709 12:12:01.417284  4374 raft_consensus.cc:1081] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 [term 3 LEADER]: Signalling peer 342b038803924b2b8625bfd6f2cf4c08 to start an election
I20260709 12:12:01.418680  4132 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a3682e1e40804ae0a9d4a7a03f7983b2"
dest_uuid: "342b038803924b2b8625bfd6f2cf4c08"
 from {username='slave'} at 127.0.0.1:46650
I20260709 12:12:01.419094  4132 raft_consensus.cc:493] T a3682e1e40804ae0a9d4a7a03f7983b2 P 342b038803924b2b8625bfd6f2cf4c08 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:01.419315  4132 raft_consensus.cc:3060] T a3682e1e40804ae0a9d4a7a03f7983b2 P 342b038803924b2b8625bfd6f2cf4c08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:01.424288  4132 raft_consensus.cc:515] T a3682e1e40804ae0a9d4a7a03f7983b2 P 342b038803924b2b8625bfd6f2cf4c08 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:12:01.425686  4132 leader_election.cc:290] T a3682e1e40804ae0a9d4a7a03f7983b2 P 342b038803924b2b8625bfd6f2cf4c08 [CANDIDATE]: Term 4 election: Requested vote from peers 9d299deccaa74c2d8db110a6e6671fcc (127.3.212.129:35647), e4256387244444f3b9c0d54803e74760 (127.3.212.131:34743)
I20260709 12:12:01.426616  4206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3682e1e40804ae0a9d4a7a03f7983b2" candidate_uuid: "342b038803924b2b8625bfd6f2cf4c08" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e4256387244444f3b9c0d54803e74760"
I20260709 12:12:01.427130  4206 raft_consensus.cc:3055] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:12:01.427081  4056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3682e1e40804ae0a9d4a7a03f7983b2" candidate_uuid: "342b038803924b2b8625bfd6f2cf4c08" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9d299deccaa74c2d8db110a6e6671fcc"
I20260709 12:12:01.427517  4206 raft_consensus.cc:740] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e4256387244444f3b9c0d54803e74760, State: Running, Role: LEADER
I20260709 12:12:01.427747  4056 raft_consensus.cc:3060] T a3682e1e40804ae0a9d4a7a03f7983b2 P 9d299deccaa74c2d8db110a6e6671fcc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:01.428310  4206 consensus_queue.cc:260] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:12:01.429523  4206 raft_consensus.cc:3060] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:01.434043  4056 raft_consensus.cc:2468] T a3682e1e40804ae0a9d4a7a03f7983b2 P 9d299deccaa74c2d8db110a6e6671fcc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 342b038803924b2b8625bfd6f2cf4c08 in term 4.
I20260709 12:12:01.435395  4206 raft_consensus.cc:2468] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 342b038803924b2b8625bfd6f2cf4c08 in term 4.
I20260709 12:12:01.435305  4095 leader_election.cc:304] T a3682e1e40804ae0a9d4a7a03f7983b2 P 342b038803924b2b8625bfd6f2cf4c08 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 342b038803924b2b8625bfd6f2cf4c08, 9d299deccaa74c2d8db110a6e6671fcc; no voters: 
I20260709 12:12:01.436247  4350 raft_consensus.cc:2804] T a3682e1e40804ae0a9d4a7a03f7983b2 P 342b038803924b2b8625bfd6f2cf4c08 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:12:01.436672  4350 raft_consensus.cc:697] T a3682e1e40804ae0a9d4a7a03f7983b2 P 342b038803924b2b8625bfd6f2cf4c08 [term 4 LEADER]: Becoming Leader. State: Replica: 342b038803924b2b8625bfd6f2cf4c08, State: Running, Role: LEADER
I20260709 12:12:01.437258  4350 consensus_queue.cc:237] T a3682e1e40804ae0a9d4a7a03f7983b2 P 342b038803924b2b8625bfd6f2cf4c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:12:01.443251  3951 catalog_manager.cc:5697] T a3682e1e40804ae0a9d4a7a03f7983b2 P 342b038803924b2b8625bfd6f2cf4c08 reported cstate change: term changed from 3 to 4, leader changed from e4256387244444f3b9c0d54803e74760 (127.3.212.131) to 342b038803924b2b8625bfd6f2cf4c08 (127.3.212.130). New cstate: current_term: 4 leader_uuid: "342b038803924b2b8625bfd6f2cf4c08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:01.478602  4384 raft_consensus.cc:993] T 67fd9c39bf234dcb8815c7ce2fd1a07e P e4256387244444f3b9c0d54803e74760: : Instructing follower 342b038803924b2b8625bfd6f2cf4c08 to start an election
I20260709 12:12:01.479023  4374 raft_consensus.cc:1081] T 67fd9c39bf234dcb8815c7ce2fd1a07e P e4256387244444f3b9c0d54803e74760 [term 3 LEADER]: Signalling peer 342b038803924b2b8625bfd6f2cf4c08 to start an election
I20260709 12:12:01.480469  4132 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "67fd9c39bf234dcb8815c7ce2fd1a07e"
dest_uuid: "342b038803924b2b8625bfd6f2cf4c08"
 from {username='slave'} at 127.0.0.1:46650
I20260709 12:12:01.481005  4132 raft_consensus.cc:493] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:01.481423  4132 raft_consensus.cc:3060] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:01.486688  4132 raft_consensus.cc:515] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:12:01.488082  4132 leader_election.cc:290] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08 [CANDIDATE]: Term 4 election: Requested vote from peers 9d299deccaa74c2d8db110a6e6671fcc (127.3.212.129:35647), e4256387244444f3b9c0d54803e74760 (127.3.212.131:34743)
I20260709 12:12:01.488945  4056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fd9c39bf234dcb8815c7ce2fd1a07e" candidate_uuid: "342b038803924b2b8625bfd6f2cf4c08" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9d299deccaa74c2d8db110a6e6671fcc"
I20260709 12:12:01.489087  4206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fd9c39bf234dcb8815c7ce2fd1a07e" candidate_uuid: "342b038803924b2b8625bfd6f2cf4c08" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e4256387244444f3b9c0d54803e74760"
I20260709 12:12:01.489444  4056 raft_consensus.cc:3060] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 9d299deccaa74c2d8db110a6e6671fcc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:01.489537  4206 raft_consensus.cc:3055] T 67fd9c39bf234dcb8815c7ce2fd1a07e P e4256387244444f3b9c0d54803e74760 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:12:01.489831  4206 raft_consensus.cc:740] T 67fd9c39bf234dcb8815c7ce2fd1a07e P e4256387244444f3b9c0d54803e74760 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e4256387244444f3b9c0d54803e74760, State: Running, Role: LEADER
I20260709 12:12:01.490363  4206 consensus_queue.cc:260] T 67fd9c39bf234dcb8815c7ce2fd1a07e P e4256387244444f3b9c0d54803e74760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:12:01.491142  4206 raft_consensus.cc:3060] T 67fd9c39bf234dcb8815c7ce2fd1a07e P e4256387244444f3b9c0d54803e74760 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:01.493712  4056 raft_consensus.cc:2468] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 9d299deccaa74c2d8db110a6e6671fcc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 342b038803924b2b8625bfd6f2cf4c08 in term 4.
I20260709 12:12:01.494668  4095 leader_election.cc:304] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 342b038803924b2b8625bfd6f2cf4c08, 9d299deccaa74c2d8db110a6e6671fcc; no voters: 
I20260709 12:12:01.495316  4206 raft_consensus.cc:2468] T 67fd9c39bf234dcb8815c7ce2fd1a07e P e4256387244444f3b9c0d54803e74760 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 342b038803924b2b8625bfd6f2cf4c08 in term 4.
I20260709 12:12:01.495461  4350 raft_consensus.cc:2804] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:12:01.495899  4350 raft_consensus.cc:697] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08 [term 4 LEADER]: Becoming Leader. State: Replica: 342b038803924b2b8625bfd6f2cf4c08, State: Running, Role: LEADER
I20260709 12:12:01.496647  4350 consensus_queue.cc:237] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:12:01.502386  3951 catalog_manager.cc:5697] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08 reported cstate change: term changed from 3 to 4, leader changed from e4256387244444f3b9c0d54803e74760 (127.3.212.131) to 342b038803924b2b8625bfd6f2cf4c08 (127.3.212.130). New cstate: current_term: 4 leader_uuid: "342b038803924b2b8625bfd6f2cf4c08" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:01.519341  4206 raft_consensus.cc:1275] T 57a371ce6a7d437380ff59166848f1bc P e4256387244444f3b9c0d54803e74760 [term 3 FOLLOWER]: Refusing update from remote peer 342b038803924b2b8625bfd6f2cf4c08: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:01.520643  4350 consensus_queue.cc:1048] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:01.531729  4056 raft_consensus.cc:1275] T 57a371ce6a7d437380ff59166848f1bc P 9d299deccaa74c2d8db110a6e6671fcc [term 3 FOLLOWER]: Refusing update from remote peer 342b038803924b2b8625bfd6f2cf4c08: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:01.533622  4376 consensus_queue.cc:1048] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:12:01.664505  4056 raft_consensus.cc:1275] T 9e90122ac65e486e80674ceb6d6fcb21 P 9d299deccaa74c2d8db110a6e6671fcc [term 3 FOLLOWER]: Refusing update from remote peer 342b038803924b2b8625bfd6f2cf4c08: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:01.665674  4376 consensus_queue.cc:1048] T 9e90122ac65e486e80674ceb6d6fcb21 P 342b038803924b2b8625bfd6f2cf4c08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:01.675683  4206 raft_consensus.cc:1275] T 9e90122ac65e486e80674ceb6d6fcb21 P e4256387244444f3b9c0d54803e74760 [term 3 FOLLOWER]: Refusing update from remote peer 342b038803924b2b8625bfd6f2cf4c08: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:01.676900  4376 consensus_queue.cc:1048] T 9e90122ac65e486e80674ceb6d6fcb21 P 342b038803924b2b8625bfd6f2cf4c08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:01.729681  4206 raft_consensus.cc:1275] T b52aa28f64ae441783bcb12eeeb24273 P e4256387244444f3b9c0d54803e74760 [term 3 FOLLOWER]: Refusing update from remote peer 342b038803924b2b8625bfd6f2cf4c08: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:01.730835  4376 consensus_queue.cc:1048] T b52aa28f64ae441783bcb12eeeb24273 P 342b038803924b2b8625bfd6f2cf4c08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:01.739280  4056 raft_consensus.cc:1275] T b52aa28f64ae441783bcb12eeeb24273 P 9d299deccaa74c2d8db110a6e6671fcc [term 3 FOLLOWER]: Refusing update from remote peer 342b038803924b2b8625bfd6f2cf4c08: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:01.740653  4388 consensus_queue.cc:1048] T b52aa28f64ae441783bcb12eeeb24273 P 342b038803924b2b8625bfd6f2cf4c08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:12:01.900774  4056 raft_consensus.cc:1275] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 9d299deccaa74c2d8db110a6e6671fcc [term 4 FOLLOWER]: Refusing update from remote peer 342b038803924b2b8625bfd6f2cf4c08: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:01.902783  4388 consensus_queue.cc:1048] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:12:01.913230  4206 raft_consensus.cc:1275] T 67fd9c39bf234dcb8815c7ce2fd1a07e P e4256387244444f3b9c0d54803e74760 [term 4 FOLLOWER]: Refusing update from remote peer 342b038803924b2b8625bfd6f2cf4c08: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:01.914742  4350 consensus_queue.cc:1048] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:12:01.977290  4206 raft_consensus.cc:1275] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 [term 4 FOLLOWER]: Refusing update from remote peer 342b038803924b2b8625bfd6f2cf4c08: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:01.978471  4350 consensus_queue.cc:1048] T a3682e1e40804ae0a9d4a7a03f7983b2 P 342b038803924b2b8625bfd6f2cf4c08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:12:01.987534  4054 raft_consensus.cc:1275] T a3682e1e40804ae0a9d4a7a03f7983b2 P 9d299deccaa74c2d8db110a6e6671fcc [term 4 FOLLOWER]: Refusing update from remote peer 342b038803924b2b8625bfd6f2cf4c08: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:01.989081  4376 consensus_queue.cc:1048] T a3682e1e40804ae0a9d4a7a03f7983b2 P 342b038803924b2b8625bfd6f2cf4c08 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:12:03.946573  3922 auto_leader_rebalancer-test.cc:328] The leader distribution is 
I20260709 12:12:03.947315  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:03.954231  4132 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f7ab1e5604a4859b97af9f666098497"
dest_uuid: "342b038803924b2b8625bfd6f2cf4c08"
mode: GRACEFUL
new_leader_uuid: "9d299deccaa74c2d8db110a6e6671fcc"
 from {username='slave'} at 127.0.0.1:46672
I20260709 12:12:03.954749  4132 raft_consensus.cc:606] T 1f7ab1e5604a4859b97af9f666098497 P 342b038803924b2b8625bfd6f2cf4c08 [term 1 LEADER]: Received request to transfer leadership to TS 9d299deccaa74c2d8db110a6e6671fcc
I20260709 12:12:03.957444  4132 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57a371ce6a7d437380ff59166848f1bc"
dest_uuid: "342b038803924b2b8625bfd6f2cf4c08"
mode: GRACEFUL
new_leader_uuid: "9d299deccaa74c2d8db110a6e6671fcc"
 from {username='slave'} at 127.0.0.1:46672
I20260709 12:12:03.957917  4132 raft_consensus.cc:606] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08 [term 3 LEADER]: Received request to transfer leadership to TS 9d299deccaa74c2d8db110a6e6671fcc
I20260709 12:12:03.960312  4132 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67fd9c39bf234dcb8815c7ce2fd1a07e"
dest_uuid: "342b038803924b2b8625bfd6f2cf4c08"
mode: GRACEFUL
new_leader_uuid: "e4256387244444f3b9c0d54803e74760"
 from {username='slave'} at 127.0.0.1:46672
I20260709 12:12:03.960776  4132 raft_consensus.cc:606] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08 [term 4 LEADER]: Received request to transfer leadership to TS e4256387244444f3b9c0d54803e74760
I20260709 12:12:03.963119  4132 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a3682e1e40804ae0a9d4a7a03f7983b2"
dest_uuid: "342b038803924b2b8625bfd6f2cf4c08"
mode: GRACEFUL
new_leader_uuid: "e4256387244444f3b9c0d54803e74760"
 from {username='slave'} at 127.0.0.1:46672
I20260709 12:12:03.963569  4132 raft_consensus.cc:606] T a3682e1e40804ae0a9d4a7a03f7983b2 P 342b038803924b2b8625bfd6f2cf4c08 [term 4 LEADER]: Received request to transfer leadership to TS e4256387244444f3b9c0d54803e74760
I20260709 12:12:03.965873  4132 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b52aa28f64ae441783bcb12eeeb24273"
dest_uuid: "342b038803924b2b8625bfd6f2cf4c08"
mode: GRACEFUL
new_leader_uuid: "9d299deccaa74c2d8db110a6e6671fcc"
 from {username='slave'} at 127.0.0.1:46672
I20260709 12:12:03.966300  4132 raft_consensus.cc:606] T b52aa28f64ae441783bcb12eeeb24273 P 342b038803924b2b8625bfd6f2cf4c08 [term 3 LEADER]: Received request to transfer leadership to TS 9d299deccaa74c2d8db110a6e6671fcc
I20260709 12:12:03.967310  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:12:03.967742  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:03.975978  4376 raft_consensus.cc:993] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08: : Instructing follower 9d299deccaa74c2d8db110a6e6671fcc to start an election
I20260709 12:12:03.976420  4350 raft_consensus.cc:1081] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08 [term 3 LEADER]: Signalling peer 9d299deccaa74c2d8db110a6e6671fcc to start an election
I20260709 12:12:03.977849  4054 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57a371ce6a7d437380ff59166848f1bc"
dest_uuid: "9d299deccaa74c2d8db110a6e6671fcc"
 from {username='slave'} at 127.0.0.1:56048
I20260709 12:12:03.978317  4054 raft_consensus.cc:493] T 57a371ce6a7d437380ff59166848f1bc P 9d299deccaa74c2d8db110a6e6671fcc [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:03.978590  4054 raft_consensus.cc:3060] T 57a371ce6a7d437380ff59166848f1bc P 9d299deccaa74c2d8db110a6e6671fcc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:03.983146  4054 raft_consensus.cc:515] T 57a371ce6a7d437380ff59166848f1bc P 9d299deccaa74c2d8db110a6e6671fcc [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:12:03.985100  4054 leader_election.cc:290] T 57a371ce6a7d437380ff59166848f1bc P 9d299deccaa74c2d8db110a6e6671fcc [CANDIDATE]: Term 4 election: Requested vote from peers 342b038803924b2b8625bfd6f2cf4c08 (127.3.212.130:39923), e4256387244444f3b9c0d54803e74760 (127.3.212.131:34743)
I20260709 12:12:03.986167  4132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a371ce6a7d437380ff59166848f1bc" candidate_uuid: "9d299deccaa74c2d8db110a6e6671fcc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "342b038803924b2b8625bfd6f2cf4c08"
I20260709 12:12:03.986533  4205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57a371ce6a7d437380ff59166848f1bc" candidate_uuid: "9d299deccaa74c2d8db110a6e6671fcc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e4256387244444f3b9c0d54803e74760"
I20260709 12:12:03.986706  4132 raft_consensus.cc:3055] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:12:03.987093  4205 raft_consensus.cc:3060] T 57a371ce6a7d437380ff59166848f1bc P e4256387244444f3b9c0d54803e74760 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:03.987093  4132 raft_consensus.cc:740] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 342b038803924b2b8625bfd6f2cf4c08, State: Running, Role: LEADER
I20260709 12:12:03.988054  4132 consensus_queue.cc:260] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:12:03.989180  4132 raft_consensus.cc:3060] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:03.994216  4205 raft_consensus.cc:2468] T 57a371ce6a7d437380ff59166848f1bc P e4256387244444f3b9c0d54803e74760 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d299deccaa74c2d8db110a6e6671fcc in term 4.
I20260709 12:12:03.995445  4132 raft_consensus.cc:2468] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d299deccaa74c2d8db110a6e6671fcc in term 4.
I20260709 12:12:04.010211  4020 leader_election.cc:304] T 57a371ce6a7d437380ff59166848f1bc P 9d299deccaa74c2d8db110a6e6671fcc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 342b038803924b2b8625bfd6f2cf4c08, 9d299deccaa74c2d8db110a6e6671fcc; no voters: 
I20260709 12:12:04.018983  4402 raft_consensus.cc:2804] T 57a371ce6a7d437380ff59166848f1bc P 9d299deccaa74c2d8db110a6e6671fcc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:12:04.020539  4402 raft_consensus.cc:697] T 57a371ce6a7d437380ff59166848f1bc P 9d299deccaa74c2d8db110a6e6671fcc [term 4 LEADER]: Becoming Leader. State: Replica: 9d299deccaa74c2d8db110a6e6671fcc, State: Running, Role: LEADER
I20260709 12:12:04.021586  4402 consensus_queue.cc:237] T 57a371ce6a7d437380ff59166848f1bc P 9d299deccaa74c2d8db110a6e6671fcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:12:04.030365  3954 catalog_manager.cc:5697] T 57a371ce6a7d437380ff59166848f1bc P 9d299deccaa74c2d8db110a6e6671fcc reported cstate change: term changed from 3 to 4, leader changed from 342b038803924b2b8625bfd6f2cf4c08 (127.3.212.130) to 9d299deccaa74c2d8db110a6e6671fcc (127.3.212.129). New cstate: current_term: 4 leader_uuid: "9d299deccaa74c2d8db110a6e6671fcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:04.053702  4376 raft_consensus.cc:993] T b52aa28f64ae441783bcb12eeeb24273 P 342b038803924b2b8625bfd6f2cf4c08: : Instructing follower 9d299deccaa74c2d8db110a6e6671fcc to start an election
I20260709 12:12:04.054199  4376 raft_consensus.cc:1081] T b52aa28f64ae441783bcb12eeeb24273 P 342b038803924b2b8625bfd6f2cf4c08 [term 3 LEADER]: Signalling peer 9d299deccaa74c2d8db110a6e6671fcc to start an election
I20260709 12:12:04.055954  4054 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b52aa28f64ae441783bcb12eeeb24273"
dest_uuid: "9d299deccaa74c2d8db110a6e6671fcc"
 from {username='slave'} at 127.0.0.1:56048
I20260709 12:12:04.056490  4054 raft_consensus.cc:493] T b52aa28f64ae441783bcb12eeeb24273 P 9d299deccaa74c2d8db110a6e6671fcc [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:04.056756  4054 raft_consensus.cc:3060] T b52aa28f64ae441783bcb12eeeb24273 P 9d299deccaa74c2d8db110a6e6671fcc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:04.061805  4054 raft_consensus.cc:515] T b52aa28f64ae441783bcb12eeeb24273 P 9d299deccaa74c2d8db110a6e6671fcc [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } }
I20260709 12:12:04.063239  4054 leader_election.cc:290] T b52aa28f64ae441783bcb12eeeb24273 P 9d299deccaa74c2d8db110a6e6671fcc [CANDIDATE]: Term 4 election: Requested vote from peers e4256387244444f3b9c0d54803e74760 (127.3.212.131:34743), 342b038803924b2b8625bfd6f2cf4c08 (127.3.212.130:39923)
I20260709 12:12:04.065049  4205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52aa28f64ae441783bcb12eeeb24273" candidate_uuid: "9d299deccaa74c2d8db110a6e6671fcc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e4256387244444f3b9c0d54803e74760"
I20260709 12:12:04.064996  4132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52aa28f64ae441783bcb12eeeb24273" candidate_uuid: "9d299deccaa74c2d8db110a6e6671fcc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "342b038803924b2b8625bfd6f2cf4c08"
I20260709 12:12:04.065938  4205 raft_consensus.cc:3060] T b52aa28f64ae441783bcb12eeeb24273 P e4256387244444f3b9c0d54803e74760 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:04.065901  4132 raft_consensus.cc:3055] T b52aa28f64ae441783bcb12eeeb24273 P 342b038803924b2b8625bfd6f2cf4c08 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:12:04.066514  4132 raft_consensus.cc:740] T b52aa28f64ae441783bcb12eeeb24273 P 342b038803924b2b8625bfd6f2cf4c08 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 342b038803924b2b8625bfd6f2cf4c08, State: Running, Role: LEADER
I20260709 12:12:04.067454  4132 consensus_queue.cc:260] T b52aa28f64ae441783bcb12eeeb24273 P 342b038803924b2b8625bfd6f2cf4c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } }
I20260709 12:12:04.068845  4132 raft_consensus.cc:3060] T b52aa28f64ae441783bcb12eeeb24273 P 342b038803924b2b8625bfd6f2cf4c08 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:04.074707  4205 raft_consensus.cc:2468] T b52aa28f64ae441783bcb12eeeb24273 P e4256387244444f3b9c0d54803e74760 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d299deccaa74c2d8db110a6e6671fcc in term 4.
I20260709 12:12:04.075402  4132 raft_consensus.cc:2468] T b52aa28f64ae441783bcb12eeeb24273 P 342b038803924b2b8625bfd6f2cf4c08 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d299deccaa74c2d8db110a6e6671fcc in term 4.
I20260709 12:12:04.076591  4023 leader_election.cc:304] T b52aa28f64ae441783bcb12eeeb24273 P 9d299deccaa74c2d8db110a6e6671fcc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d299deccaa74c2d8db110a6e6671fcc, e4256387244444f3b9c0d54803e74760; no voters: 
I20260709 12:12:04.077937  4402 raft_consensus.cc:2804] T b52aa28f64ae441783bcb12eeeb24273 P 9d299deccaa74c2d8db110a6e6671fcc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:12:04.078663  4402 raft_consensus.cc:697] T b52aa28f64ae441783bcb12eeeb24273 P 9d299deccaa74c2d8db110a6e6671fcc [term 4 LEADER]: Becoming Leader. State: Replica: 9d299deccaa74c2d8db110a6e6671fcc, State: Running, Role: LEADER
I20260709 12:12:04.079989  4402 consensus_queue.cc:237] T b52aa28f64ae441783bcb12eeeb24273 P 9d299deccaa74c2d8db110a6e6671fcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } }
I20260709 12:12:04.081525  4376 raft_consensus.cc:993] T 1f7ab1e5604a4859b97af9f666098497 P 342b038803924b2b8625bfd6f2cf4c08: : Instructing follower 9d299deccaa74c2d8db110a6e6671fcc to start an election
I20260709 12:12:04.082190  4410 raft_consensus.cc:1081] T 1f7ab1e5604a4859b97af9f666098497 P 342b038803924b2b8625bfd6f2cf4c08 [term 1 LEADER]: Signalling peer 9d299deccaa74c2d8db110a6e6671fcc to start an election
I20260709 12:12:04.083621  4410 raft_consensus.cc:993] T a3682e1e40804ae0a9d4a7a03f7983b2 P 342b038803924b2b8625bfd6f2cf4c08: : Instructing follower e4256387244444f3b9c0d54803e74760 to start an election
I20260709 12:12:04.083788  4054 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f7ab1e5604a4859b97af9f666098497"
dest_uuid: "9d299deccaa74c2d8db110a6e6671fcc"
 from {username='slave'} at 127.0.0.1:56048
I20260709 12:12:04.084169  4376 raft_consensus.cc:1081] T a3682e1e40804ae0a9d4a7a03f7983b2 P 342b038803924b2b8625bfd6f2cf4c08 [term 4 LEADER]: Signalling peer e4256387244444f3b9c0d54803e74760 to start an election
I20260709 12:12:04.084635  4054 raft_consensus.cc:493] T 1f7ab1e5604a4859b97af9f666098497 P 9d299deccaa74c2d8db110a6e6671fcc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:04.085043  4054 raft_consensus.cc:3060] T 1f7ab1e5604a4859b97af9f666098497 P 9d299deccaa74c2d8db110a6e6671fcc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:04.086076  4205 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a3682e1e40804ae0a9d4a7a03f7983b2"
dest_uuid: "e4256387244444f3b9c0d54803e74760"
 from {username='slave'} at 127.0.0.1:45636
I20260709 12:12:04.086843  4205 raft_consensus.cc:493] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:04.087337  4205 raft_consensus.cc:3060] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:04.092156  3954 catalog_manager.cc:5697] T b52aa28f64ae441783bcb12eeeb24273 P 9d299deccaa74c2d8db110a6e6671fcc reported cstate change: term changed from 3 to 4, leader changed from 342b038803924b2b8625bfd6f2cf4c08 (127.3.212.130) to 9d299deccaa74c2d8db110a6e6671fcc (127.3.212.129). New cstate: current_term: 4 leader_uuid: "9d299deccaa74c2d8db110a6e6671fcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:04.093151  4054 raft_consensus.cc:515] T 1f7ab1e5604a4859b97af9f666098497 P 9d299deccaa74c2d8db110a6e6671fcc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:12:04.094599  4205 raft_consensus.cc:515] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:12:04.095997  4132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f7ab1e5604a4859b97af9f666098497" candidate_uuid: "9d299deccaa74c2d8db110a6e6671fcc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "342b038803924b2b8625bfd6f2cf4c08"
I20260709 12:12:04.096608  4132 raft_consensus.cc:3055] T 1f7ab1e5604a4859b97af9f666098497 P 342b038803924b2b8625bfd6f2cf4c08 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:04.096884  4132 raft_consensus.cc:740] T 1f7ab1e5604a4859b97af9f666098497 P 342b038803924b2b8625bfd6f2cf4c08 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 342b038803924b2b8625bfd6f2cf4c08, State: Running, Role: LEADER
I20260709 12:12:04.097810  4132 consensus_queue.cc:260] T 1f7ab1e5604a4859b97af9f666098497 P 342b038803924b2b8625bfd6f2cf4c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:12:04.098615  4056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3682e1e40804ae0a9d4a7a03f7983b2" candidate_uuid: "e4256387244444f3b9c0d54803e74760" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "9d299deccaa74c2d8db110a6e6671fcc"
I20260709 12:12:04.098918  4132 raft_consensus.cc:3060] T 1f7ab1e5604a4859b97af9f666098497 P 342b038803924b2b8625bfd6f2cf4c08 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:04.099049  4056 raft_consensus.cc:3060] T a3682e1e40804ae0a9d4a7a03f7983b2 P 9d299deccaa74c2d8db110a6e6671fcc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:04.100688  4205 leader_election.cc:290] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 [CANDIDATE]: Term 5 election: Requested vote from peers 9d299deccaa74c2d8db110a6e6671fcc (127.3.212.129:35647), 342b038803924b2b8625bfd6f2cf4c08 (127.3.212.130:39923)
I20260709 12:12:04.101122  4131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3682e1e40804ae0a9d4a7a03f7983b2" candidate_uuid: "e4256387244444f3b9c0d54803e74760" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "342b038803924b2b8625bfd6f2cf4c08"
I20260709 12:12:04.101929  4131 raft_consensus.cc:3055] T a3682e1e40804ae0a9d4a7a03f7983b2 P 342b038803924b2b8625bfd6f2cf4c08 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:12:04.102258  4131 raft_consensus.cc:740] T a3682e1e40804ae0a9d4a7a03f7983b2 P 342b038803924b2b8625bfd6f2cf4c08 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 342b038803924b2b8625bfd6f2cf4c08, State: Running, Role: LEADER
I20260709 12:12:04.103067  4131 consensus_queue.cc:260] T a3682e1e40804ae0a9d4a7a03f7983b2 P 342b038803924b2b8625bfd6f2cf4c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:12:04.104162  4131 raft_consensus.cc:3060] T a3682e1e40804ae0a9d4a7a03f7983b2 P 342b038803924b2b8625bfd6f2cf4c08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:04.105556  4056 raft_consensus.cc:2468] T a3682e1e40804ae0a9d4a7a03f7983b2 P 9d299deccaa74c2d8db110a6e6671fcc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4256387244444f3b9c0d54803e74760 in term 5.
I20260709 12:12:04.106961  4169 leader_election.cc:304] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d299deccaa74c2d8db110a6e6671fcc, e4256387244444f3b9c0d54803e74760; no voters: 
I20260709 12:12:04.107973  4374 raft_consensus.cc:2804] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:12:04.109589  4132 raft_consensus.cc:2468] T 1f7ab1e5604a4859b97af9f666098497 P 342b038803924b2b8625bfd6f2cf4c08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d299deccaa74c2d8db110a6e6671fcc in term 2.
I20260709 12:12:04.110383  4054 leader_election.cc:290] T 1f7ab1e5604a4859b97af9f666098497 P 9d299deccaa74c2d8db110a6e6671fcc [CANDIDATE]: Term 2 election: Requested vote from peers 342b038803924b2b8625bfd6f2cf4c08 (127.3.212.130:39923), e4256387244444f3b9c0d54803e74760 (127.3.212.131:34743)
I20260709 12:12:04.110656  4020 leader_election.cc:304] T 1f7ab1e5604a4859b97af9f666098497 P 9d299deccaa74c2d8db110a6e6671fcc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 342b038803924b2b8625bfd6f2cf4c08, 9d299deccaa74c2d8db110a6e6671fcc; no voters: 
I20260709 12:12:04.110067  4131 raft_consensus.cc:2468] T a3682e1e40804ae0a9d4a7a03f7983b2 P 342b038803924b2b8625bfd6f2cf4c08 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4256387244444f3b9c0d54803e74760 in term 5.
I20260709 12:12:04.111670  4402 raft_consensus.cc:2804] T 1f7ab1e5604a4859b97af9f666098497 P 9d299deccaa74c2d8db110a6e6671fcc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:04.112154  4402 raft_consensus.cc:697] T 1f7ab1e5604a4859b97af9f666098497 P 9d299deccaa74c2d8db110a6e6671fcc [term 2 LEADER]: Becoming Leader. State: Replica: 9d299deccaa74c2d8db110a6e6671fcc, State: Running, Role: LEADER
I20260709 12:12:04.112486  4374 raft_consensus.cc:697] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 [term 5 LEADER]: Becoming Leader. State: Replica: e4256387244444f3b9c0d54803e74760, State: Running, Role: LEADER
I20260709 12:12:04.113072  4402 consensus_queue.cc:237] T 1f7ab1e5604a4859b97af9f666098497 P 9d299deccaa74c2d8db110a6e6671fcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:12:04.113525  4374 consensus_queue.cc:237] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:12:04.114094  4205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f7ab1e5604a4859b97af9f666098497" candidate_uuid: "9d299deccaa74c2d8db110a6e6671fcc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4256387244444f3b9c0d54803e74760"
I20260709 12:12:04.114802  4205 raft_consensus.cc:3060] T 1f7ab1e5604a4859b97af9f666098497 P e4256387244444f3b9c0d54803e74760 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:04.122360  4205 raft_consensus.cc:2468] T 1f7ab1e5604a4859b97af9f666098497 P e4256387244444f3b9c0d54803e74760 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d299deccaa74c2d8db110a6e6671fcc in term 2.
I20260709 12:12:04.123585  3954 catalog_manager.cc:5697] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 reported cstate change: term changed from 4 to 5, leader changed from 342b038803924b2b8625bfd6f2cf4c08 (127.3.212.130) to e4256387244444f3b9c0d54803e74760 (127.3.212.131). New cstate: current_term: 5 leader_uuid: "e4256387244444f3b9c0d54803e74760" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:04.124825  3952 catalog_manager.cc:5697] T 1f7ab1e5604a4859b97af9f666098497 P 9d299deccaa74c2d8db110a6e6671fcc reported cstate change: term changed from 1 to 2, leader changed from 342b038803924b2b8625bfd6f2cf4c08 (127.3.212.130) to 9d299deccaa74c2d8db110a6e6671fcc (127.3.212.129). New cstate: current_term: 2 leader_uuid: "9d299deccaa74c2d8db110a6e6671fcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:04.378602  4410 raft_consensus.cc:993] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08: : Instructing follower e4256387244444f3b9c0d54803e74760 to start an election
I20260709 12:12:04.379084  4410 raft_consensus.cc:1081] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08 [term 4 LEADER]: Signalling peer e4256387244444f3b9c0d54803e74760 to start an election
I20260709 12:12:04.380632  4205 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "67fd9c39bf234dcb8815c7ce2fd1a07e"
dest_uuid: "e4256387244444f3b9c0d54803e74760"
 from {username='slave'} at 127.0.0.1:45636
I20260709 12:12:04.381127  4205 raft_consensus.cc:493] T 67fd9c39bf234dcb8815c7ce2fd1a07e P e4256387244444f3b9c0d54803e74760 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:04.381568  4205 raft_consensus.cc:3060] T 67fd9c39bf234dcb8815c7ce2fd1a07e P e4256387244444f3b9c0d54803e74760 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:04.386272  4205 raft_consensus.cc:515] T 67fd9c39bf234dcb8815c7ce2fd1a07e P e4256387244444f3b9c0d54803e74760 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:12:04.388023  4205 leader_election.cc:290] T 67fd9c39bf234dcb8815c7ce2fd1a07e P e4256387244444f3b9c0d54803e74760 [CANDIDATE]: Term 5 election: Requested vote from peers 9d299deccaa74c2d8db110a6e6671fcc (127.3.212.129:35647), 342b038803924b2b8625bfd6f2cf4c08 (127.3.212.130:39923)
I20260709 12:12:04.388777  4054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fd9c39bf234dcb8815c7ce2fd1a07e" candidate_uuid: "e4256387244444f3b9c0d54803e74760" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "9d299deccaa74c2d8db110a6e6671fcc"
I20260709 12:12:04.389185  4131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67fd9c39bf234dcb8815c7ce2fd1a07e" candidate_uuid: "e4256387244444f3b9c0d54803e74760" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "342b038803924b2b8625bfd6f2cf4c08"
I20260709 12:12:04.389361  4054 raft_consensus.cc:3060] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 9d299deccaa74c2d8db110a6e6671fcc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:04.389715  4131 raft_consensus.cc:3055] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:12:04.390028  4131 raft_consensus.cc:740] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 342b038803924b2b8625bfd6f2cf4c08, State: Running, Role: LEADER
I20260709 12:12:04.390761  4131 consensus_queue.cc:260] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:12:04.391750  4131 raft_consensus.cc:3060] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:04.393680  4054 raft_consensus.cc:2468] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 9d299deccaa74c2d8db110a6e6671fcc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4256387244444f3b9c0d54803e74760 in term 5.
I20260709 12:12:04.394598  4169 leader_election.cc:304] T 67fd9c39bf234dcb8815c7ce2fd1a07e P e4256387244444f3b9c0d54803e74760 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d299deccaa74c2d8db110a6e6671fcc, e4256387244444f3b9c0d54803e74760; no voters: 
I20260709 12:12:04.395203  4374 raft_consensus.cc:2804] T 67fd9c39bf234dcb8815c7ce2fd1a07e P e4256387244444f3b9c0d54803e74760 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:12:04.395566  4374 raft_consensus.cc:697] T 67fd9c39bf234dcb8815c7ce2fd1a07e P e4256387244444f3b9c0d54803e74760 [term 5 LEADER]: Becoming Leader. State: Replica: e4256387244444f3b9c0d54803e74760, State: Running, Role: LEADER
I20260709 12:12:04.396551  4131 raft_consensus.cc:2468] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4256387244444f3b9c0d54803e74760 in term 5.
I20260709 12:12:04.396314  4374 consensus_queue.cc:237] T 67fd9c39bf234dcb8815c7ce2fd1a07e P e4256387244444f3b9c0d54803e74760 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } }
I20260709 12:12:04.403260  3952 catalog_manager.cc:5697] T 67fd9c39bf234dcb8815c7ce2fd1a07e P e4256387244444f3b9c0d54803e74760 reported cstate change: term changed from 4 to 5, leader changed from 342b038803924b2b8625bfd6f2cf4c08 (127.3.212.130) to e4256387244444f3b9c0d54803e74760 (127.3.212.131). New cstate: current_term: 5 leader_uuid: "e4256387244444f3b9c0d54803e74760" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:04.447540  4131 raft_consensus.cc:1275] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08 [term 4 FOLLOWER]: Refusing update from remote peer 9d299deccaa74c2d8db110a6e6671fcc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:04.448855  4402 consensus_queue.cc:1048] T 57a371ce6a7d437380ff59166848f1bc P 9d299deccaa74c2d8db110a6e6671fcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:12:04.462443  4205 raft_consensus.cc:1275] T 57a371ce6a7d437380ff59166848f1bc P e4256387244444f3b9c0d54803e74760 [term 4 FOLLOWER]: Refusing update from remote peer 9d299deccaa74c2d8db110a6e6671fcc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:04.463981  4418 consensus_queue.cc:1048] T 57a371ce6a7d437380ff59166848f1bc P 9d299deccaa74c2d8db110a6e6671fcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:12:04.521459  4054 raft_consensus.cc:1275] T a3682e1e40804ae0a9d4a7a03f7983b2 P 9d299deccaa74c2d8db110a6e6671fcc [term 5 FOLLOWER]: Refusing update from remote peer e4256387244444f3b9c0d54803e74760: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:12:04.522594  4374 consensus_queue.cc:1048] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:12:04.532282  4131 raft_consensus.cc:1275] T a3682e1e40804ae0a9d4a7a03f7983b2 P 342b038803924b2b8625bfd6f2cf4c08 [term 5 FOLLOWER]: Refusing update from remote peer e4256387244444f3b9c0d54803e74760: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:12:04.533638  4412 consensus_queue.cc:1048] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:12:04.556057  4131 raft_consensus.cc:1275] T 1f7ab1e5604a4859b97af9f666098497 P 342b038803924b2b8625bfd6f2cf4c08 [term 2 FOLLOWER]: Refusing update from remote peer 9d299deccaa74c2d8db110a6e6671fcc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:04.557143  4418 consensus_queue.cc:1048] T 1f7ab1e5604a4859b97af9f666098497 P 9d299deccaa74c2d8db110a6e6671fcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:04.565994  4205 raft_consensus.cc:1275] T 1f7ab1e5604a4859b97af9f666098497 P e4256387244444f3b9c0d54803e74760 [term 2 FOLLOWER]: Refusing update from remote peer 9d299deccaa74c2d8db110a6e6671fcc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:04.567634  4403 consensus_queue.cc:1048] T 1f7ab1e5604a4859b97af9f666098497 P 9d299deccaa74c2d8db110a6e6671fcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:04.569667  4132 raft_consensus.cc:1275] T b52aa28f64ae441783bcb12eeeb24273 P 342b038803924b2b8625bfd6f2cf4c08 [term 4 FOLLOWER]: Refusing update from remote peer 9d299deccaa74c2d8db110a6e6671fcc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:04.573348  4418 consensus_queue.cc:1048] T b52aa28f64ae441783bcb12eeeb24273 P 9d299deccaa74c2d8db110a6e6671fcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:12:04.586859  4206 raft_consensus.cc:1275] T b52aa28f64ae441783bcb12eeeb24273 P e4256387244444f3b9c0d54803e74760 [term 4 FOLLOWER]: Refusing update from remote peer 9d299deccaa74c2d8db110a6e6671fcc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:04.588265  4403 consensus_queue.cc:1048] T b52aa28f64ae441783bcb12eeeb24273 P 9d299deccaa74c2d8db110a6e6671fcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4256387244444f3b9c0d54803e74760" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:12:04.911696  4054 raft_consensus.cc:1275] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 9d299deccaa74c2d8db110a6e6671fcc [term 5 FOLLOWER]: Refusing update from remote peer e4256387244444f3b9c0d54803e74760: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:12:04.912887  4412 consensus_queue.cc:1048] T 67fd9c39bf234dcb8815c7ce2fd1a07e P e4256387244444f3b9c0d54803e74760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d299deccaa74c2d8db110a6e6671fcc" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:12:04.921271  4132 raft_consensus.cc:1275] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08 [term 5 FOLLOWER]: Refusing update from remote peer e4256387244444f3b9c0d54803e74760: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:12:04.922791  4412 consensus_queue.cc:1048] T 67fd9c39bf234dcb8815c7ce2fd1a07e P e4256387244444f3b9c0d54803e74760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "342b038803924b2b8625bfd6f2cf4c08" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:12:04.969092  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:04.974645  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:04.975112  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:05.976377  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:05.981658  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:05.982088  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:06.983331  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:06.988629  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:06.989145  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:07.990305  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:07.995693  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:07.996155  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:08.997303  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:09.002573  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:09.003015  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:10.004065  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:10.009239  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:10.009727  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:11.010875  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:11.016209  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:11.016646  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:12.244024  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:12.249833  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:12.250244  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:12:12.861070  4078 debug-util.cc:398] Leaking SignalData structure 0x7b08000e7060 after lost signal to thread 3925
W20260709 12:12:12.861917  4078 debug-util.cc:398] Leaking SignalData structure 0x7b08000e7740 after lost signal to thread 3988
W20260709 12:12:12.862730  4078 debug-util.cc:398] Leaking SignalData structure 0x7b08001e4160 after lost signal to thread 4081
W20260709 12:12:12.863415  4078 debug-util.cc:398] Leaking SignalData structure 0x7b08001e3f60 after lost signal to thread 4156
W20260709 12:12:12.864146  4078 debug-util.cc:398] Leaking SignalData structure 0x7b0800096b80 after lost signal to thread 4230
I20260709 12:12:13.251331  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:13.256397  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:13.256837  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:14.295328  3922 auto_leader_rebalancer-test.cc:340] The leader distribution is 
I20260709 12:12:14.295997  3922 tablet_server.cc:179] TabletServer@127.3.212.129:0 shutting down...
I20260709 12:12:14.333092  3922 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:14.333956  3922 tablet_replica.cc:333] T 4b596235d44b4a6e976316208bada57c P 9d299deccaa74c2d8db110a6e6671fcc: stopping tablet replica
I20260709 12:12:14.334777  3922 raft_consensus.cc:2243] T 4b596235d44b4a6e976316208bada57c P 9d299deccaa74c2d8db110a6e6671fcc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:14.335474  3922 raft_consensus.cc:2272] T 4b596235d44b4a6e976316208bada57c P 9d299deccaa74c2d8db110a6e6671fcc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:14.338418  3922 tablet_replica.cc:333] T 9e90122ac65e486e80674ceb6d6fcb21 P 9d299deccaa74c2d8db110a6e6671fcc: stopping tablet replica
I20260709 12:12:14.339113  3922 raft_consensus.cc:2243] T 9e90122ac65e486e80674ceb6d6fcb21 P 9d299deccaa74c2d8db110a6e6671fcc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:14.339591  3922 raft_consensus.cc:2272] T 9e90122ac65e486e80674ceb6d6fcb21 P 9d299deccaa74c2d8db110a6e6671fcc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:14.341518  3922 tablet_replica.cc:333] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 9d299deccaa74c2d8db110a6e6671fcc: stopping tablet replica
I20260709 12:12:14.342012  3922 raft_consensus.cc:2243] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 9d299deccaa74c2d8db110a6e6671fcc [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:14.342556  3922 raft_consensus.cc:2272] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 9d299deccaa74c2d8db110a6e6671fcc [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:14.344501  3922 tablet_replica.cc:333] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P 9d299deccaa74c2d8db110a6e6671fcc: stopping tablet replica
I20260709 12:12:14.345055  3922 raft_consensus.cc:2243] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P 9d299deccaa74c2d8db110a6e6671fcc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:14.345594  3922 raft_consensus.cc:2272] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P 9d299deccaa74c2d8db110a6e6671fcc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:14.347678  3922 tablet_replica.cc:333] T b52aa28f64ae441783bcb12eeeb24273 P 9d299deccaa74c2d8db110a6e6671fcc: stopping tablet replica
I20260709 12:12:14.348357  3922 raft_consensus.cc:2243] T b52aa28f64ae441783bcb12eeeb24273 P 9d299deccaa74c2d8db110a6e6671fcc [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:12:14.349689  3922 raft_consensus.cc:2272] T b52aa28f64ae441783bcb12eeeb24273 P 9d299deccaa74c2d8db110a6e6671fcc [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:14.351801  3922 tablet_replica.cc:333] T a6ccb39b2a244abd87777efcef76ab72 P 9d299deccaa74c2d8db110a6e6671fcc: stopping tablet replica
I20260709 12:12:14.352298  3922 raft_consensus.cc:2243] T a6ccb39b2a244abd87777efcef76ab72 P 9d299deccaa74c2d8db110a6e6671fcc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:14.352753  3922 raft_consensus.cc:2272] T a6ccb39b2a244abd87777efcef76ab72 P 9d299deccaa74c2d8db110a6e6671fcc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:14.354650  3922 tablet_replica.cc:333] T a3682e1e40804ae0a9d4a7a03f7983b2 P 9d299deccaa74c2d8db110a6e6671fcc: stopping tablet replica
I20260709 12:12:14.355121  3922 raft_consensus.cc:2243] T a3682e1e40804ae0a9d4a7a03f7983b2 P 9d299deccaa74c2d8db110a6e6671fcc [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:14.355610  3922 raft_consensus.cc:2272] T a3682e1e40804ae0a9d4a7a03f7983b2 P 9d299deccaa74c2d8db110a6e6671fcc [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:14.357470  3922 tablet_replica.cc:333] T 1f7ab1e5604a4859b97af9f666098497 P 9d299deccaa74c2d8db110a6e6671fcc: stopping tablet replica
I20260709 12:12:14.357950  3922 raft_consensus.cc:2243] T 1f7ab1e5604a4859b97af9f666098497 P 9d299deccaa74c2d8db110a6e6671fcc [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:14.358692  3922 raft_consensus.cc:2272] T 1f7ab1e5604a4859b97af9f666098497 P 9d299deccaa74c2d8db110a6e6671fcc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:14.360457  3922 tablet_replica.cc:333] T 57a371ce6a7d437380ff59166848f1bc P 9d299deccaa74c2d8db110a6e6671fcc: stopping tablet replica
I20260709 12:12:14.360893  3922 raft_consensus.cc:2243] T 57a371ce6a7d437380ff59166848f1bc P 9d299deccaa74c2d8db110a6e6671fcc [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:12:14.361922  3922 raft_consensus.cc:2272] T 57a371ce6a7d437380ff59166848f1bc P 9d299deccaa74c2d8db110a6e6671fcc [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:14.470018  4169 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.212.129:35647: connect: Connection refused (error 111)
W20260709 12:12:14.473907  4169 consensus_peers.cc:597] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 -> Peer 9d299deccaa74c2d8db110a6e6671fcc (127.3.212.129:35647): Couldn't send request to peer 9d299deccaa74c2d8db110a6e6671fcc. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:35647: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:14.686669  4095 consensus_peers.cc:597] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P 342b038803924b2b8625bfd6f2cf4c08 -> Peer 9d299deccaa74c2d8db110a6e6671fcc (127.3.212.129:35647): Couldn't send request to peer 9d299deccaa74c2d8db110a6e6671fcc. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:35647: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:14.723634  4169 consensus_peers.cc:597] T 67fd9c39bf234dcb8815c7ce2fd1a07e P e4256387244444f3b9c0d54803e74760 -> Peer 9d299deccaa74c2d8db110a6e6671fcc (127.3.212.129:35647): Couldn't send request to peer 9d299deccaa74c2d8db110a6e6671fcc. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:35647: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:14.734515  4095 consensus_peers.cc:597] T 9e90122ac65e486e80674ceb6d6fcb21 P 342b038803924b2b8625bfd6f2cf4c08 -> Peer 9d299deccaa74c2d8db110a6e6671fcc (127.3.212.129:35647): Couldn't send request to peer 9d299deccaa74c2d8db110a6e6671fcc. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:35647: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:14.778811  4169 consensus_peers.cc:597] T a6ccb39b2a244abd87777efcef76ab72 P e4256387244444f3b9c0d54803e74760 -> Peer 9d299deccaa74c2d8db110a6e6671fcc (127.3.212.129:35647): Couldn't send request to peer 9d299deccaa74c2d8db110a6e6671fcc. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:35647: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:14.886384  4095 consensus_peers.cc:597] T 4b596235d44b4a6e976316208bada57c P 342b038803924b2b8625bfd6f2cf4c08 -> Peer 9d299deccaa74c2d8db110a6e6671fcc (127.3.212.129:35647): Couldn't send request to peer 9d299deccaa74c2d8db110a6e6671fcc. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:35647: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:14.989847  3922 tablet_server.cc:196] TabletServer@127.3.212.129:0 shutdown complete.
I20260709 12:12:15.009503  3922 tablet_server.cc:179] TabletServer@127.3.212.130:0 shutting down...
I20260709 12:12:15.037036  3922 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:15.037933  3922 tablet_replica.cc:333] T a6ccb39b2a244abd87777efcef76ab72 P 342b038803924b2b8625bfd6f2cf4c08: stopping tablet replica
I20260709 12:12:15.038552  3922 raft_consensus.cc:2243] T a6ccb39b2a244abd87777efcef76ab72 P 342b038803924b2b8625bfd6f2cf4c08 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:15.039036  3922 raft_consensus.cc:2272] T a6ccb39b2a244abd87777efcef76ab72 P 342b038803924b2b8625bfd6f2cf4c08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.041124  3922 tablet_replica.cc:333] T a3682e1e40804ae0a9d4a7a03f7983b2 P 342b038803924b2b8625bfd6f2cf4c08: stopping tablet replica
I20260709 12:12:15.041802  3922 raft_consensus.cc:2243] T a3682e1e40804ae0a9d4a7a03f7983b2 P 342b038803924b2b8625bfd6f2cf4c08 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:15.042281  3922 raft_consensus.cc:2272] T a3682e1e40804ae0a9d4a7a03f7983b2 P 342b038803924b2b8625bfd6f2cf4c08 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.044967  3922 tablet_replica.cc:333] T 4b596235d44b4a6e976316208bada57c P 342b038803924b2b8625bfd6f2cf4c08: stopping tablet replica
I20260709 12:12:15.045624  3922 raft_consensus.cc:2243] T 4b596235d44b4a6e976316208bada57c P 342b038803924b2b8625bfd6f2cf4c08 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:15.046904  3922 raft_consensus.cc:2272] T 4b596235d44b4a6e976316208bada57c P 342b038803924b2b8625bfd6f2cf4c08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.049537  3922 tablet_replica.cc:333] T 9e90122ac65e486e80674ceb6d6fcb21 P 342b038803924b2b8625bfd6f2cf4c08: stopping tablet replica
I20260709 12:12:15.050338  3922 raft_consensus.cc:2243] T 9e90122ac65e486e80674ceb6d6fcb21 P 342b038803924b2b8625bfd6f2cf4c08 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:12:15.051364  3922 raft_consensus.cc:2272] T 9e90122ac65e486e80674ceb6d6fcb21 P 342b038803924b2b8625bfd6f2cf4c08 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.053722  3922 tablet_replica.cc:333] T b52aa28f64ae441783bcb12eeeb24273 P 342b038803924b2b8625bfd6f2cf4c08: stopping tablet replica
I20260709 12:12:15.054239  3922 raft_consensus.cc:2243] T b52aa28f64ae441783bcb12eeeb24273 P 342b038803924b2b8625bfd6f2cf4c08 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:15.054774  3922 raft_consensus.cc:2272] T b52aa28f64ae441783bcb12eeeb24273 P 342b038803924b2b8625bfd6f2cf4c08 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.056821  3922 tablet_replica.cc:333] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08: stopping tablet replica
I20260709 12:12:15.057396  3922 raft_consensus.cc:2243] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:15.057869  3922 raft_consensus.cc:2272] T 57a371ce6a7d437380ff59166848f1bc P 342b038803924b2b8625bfd6f2cf4c08 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.059628  3922 tablet_replica.cc:333] T 1f7ab1e5604a4859b97af9f666098497 P 342b038803924b2b8625bfd6f2cf4c08: stopping tablet replica
I20260709 12:12:15.060114  3922 raft_consensus.cc:2243] T 1f7ab1e5604a4859b97af9f666098497 P 342b038803924b2b8625bfd6f2cf4c08 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:15.060544  3922 raft_consensus.cc:2272] T 1f7ab1e5604a4859b97af9f666098497 P 342b038803924b2b8625bfd6f2cf4c08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.062207  3922 tablet_replica.cc:333] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08: stopping tablet replica
I20260709 12:12:15.062687  3922 raft_consensus.cc:2243] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:15.063112  3922 raft_consensus.cc:2272] T 67fd9c39bf234dcb8815c7ce2fd1a07e P 342b038803924b2b8625bfd6f2cf4c08 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.064767  3922 tablet_replica.cc:333] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P 342b038803924b2b8625bfd6f2cf4c08: stopping tablet replica
I20260709 12:12:15.065196  3922 raft_consensus.cc:2243] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P 342b038803924b2b8625bfd6f2cf4c08 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:15.067588  3922 raft_consensus.cc:2272] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P 342b038803924b2b8625bfd6f2cf4c08 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.100373  3922 tablet_server.cc:196] TabletServer@127.3.212.130:0 shutdown complete.
I20260709 12:12:15.120143  3922 tablet_server.cc:179] TabletServer@127.3.212.131:0 shutting down...
I20260709 12:12:15.143255  3922 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:15.143996  3922 tablet_replica.cc:333] T a6ccb39b2a244abd87777efcef76ab72 P e4256387244444f3b9c0d54803e74760: stopping tablet replica
I20260709 12:12:15.144707  3922 raft_consensus.cc:2243] T a6ccb39b2a244abd87777efcef76ab72 P e4256387244444f3b9c0d54803e74760 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:15.145565  3922 raft_consensus.cc:2272] T a6ccb39b2a244abd87777efcef76ab72 P e4256387244444f3b9c0d54803e74760 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.147611  3922 tablet_replica.cc:333] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760: stopping tablet replica
I20260709 12:12:15.148259  3922 raft_consensus.cc:2243] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:12:15.149068  3922 raft_consensus.cc:2272] T a3682e1e40804ae0a9d4a7a03f7983b2 P e4256387244444f3b9c0d54803e74760 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.151167  3922 tablet_replica.cc:333] T 67fd9c39bf234dcb8815c7ce2fd1a07e P e4256387244444f3b9c0d54803e74760: stopping tablet replica
I20260709 12:12:15.151732  3922 raft_consensus.cc:2243] T 67fd9c39bf234dcb8815c7ce2fd1a07e P e4256387244444f3b9c0d54803e74760 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:12:15.152527  3922 raft_consensus.cc:2272] T 67fd9c39bf234dcb8815c7ce2fd1a07e P e4256387244444f3b9c0d54803e74760 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.154325  3922 tablet_replica.cc:333] T b52aa28f64ae441783bcb12eeeb24273 P e4256387244444f3b9c0d54803e74760: stopping tablet replica
I20260709 12:12:15.154821  3922 raft_consensus.cc:2243] T b52aa28f64ae441783bcb12eeeb24273 P e4256387244444f3b9c0d54803e74760 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:15.155328  3922 raft_consensus.cc:2272] T b52aa28f64ae441783bcb12eeeb24273 P e4256387244444f3b9c0d54803e74760 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.157258  3922 tablet_replica.cc:333] T 4b596235d44b4a6e976316208bada57c P e4256387244444f3b9c0d54803e74760: stopping tablet replica
I20260709 12:12:15.157883  3922 raft_consensus.cc:2243] T 4b596235d44b4a6e976316208bada57c P e4256387244444f3b9c0d54803e74760 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:15.158317  3922 raft_consensus.cc:2272] T 4b596235d44b4a6e976316208bada57c P e4256387244444f3b9c0d54803e74760 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.159981  3922 tablet_replica.cc:333] T 9e90122ac65e486e80674ceb6d6fcb21 P e4256387244444f3b9c0d54803e74760: stopping tablet replica
I20260709 12:12:15.160458  3922 raft_consensus.cc:2243] T 9e90122ac65e486e80674ceb6d6fcb21 P e4256387244444f3b9c0d54803e74760 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:15.160916  3922 raft_consensus.cc:2272] T 9e90122ac65e486e80674ceb6d6fcb21 P e4256387244444f3b9c0d54803e74760 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.162523  3922 tablet_replica.cc:333] T 57a371ce6a7d437380ff59166848f1bc P e4256387244444f3b9c0d54803e74760: stopping tablet replica
I20260709 12:12:15.163007  3922 raft_consensus.cc:2243] T 57a371ce6a7d437380ff59166848f1bc P e4256387244444f3b9c0d54803e74760 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:15.163394  3922 raft_consensus.cc:2272] T 57a371ce6a7d437380ff59166848f1bc P e4256387244444f3b9c0d54803e74760 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.165196  3922 tablet_replica.cc:333] T 1f7ab1e5604a4859b97af9f666098497 P e4256387244444f3b9c0d54803e74760: stopping tablet replica
I20260709 12:12:15.165726  3922 raft_consensus.cc:2243] T 1f7ab1e5604a4859b97af9f666098497 P e4256387244444f3b9c0d54803e74760 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:15.166154  3922 raft_consensus.cc:2272] T 1f7ab1e5604a4859b97af9f666098497 P e4256387244444f3b9c0d54803e74760 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.167905  3922 tablet_replica.cc:333] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P e4256387244444f3b9c0d54803e74760: stopping tablet replica
I20260709 12:12:15.168354  3922 raft_consensus.cc:2243] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P e4256387244444f3b9c0d54803e74760 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:15.168761  3922 raft_consensus.cc:2272] T 11d2d5e583974e3ea41a0a3ea8e05dd5 P e4256387244444f3b9c0d54803e74760 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.199795  3922 tablet_server.cc:196] TabletServer@127.3.212.131:0 shutdown complete.
I20260709 12:12:15.217927  3922 master.cc:562] Master@127.3.212.190:36867 shutting down...
I20260709 12:12:15.331490  3922 raft_consensus.cc:2243] T 00000000000000000000000000000000 P da5ee2a8fc594530bda9d3cb0baf3b20 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:15.332147  3922 raft_consensus.cc:2272] T 00000000000000000000000000000000 P da5ee2a8fc594530bda9d3cb0baf3b20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:15.332508  3922 tablet_replica.cc:333] T 00000000000000000000000000000000 P da5ee2a8fc594530bda9d3cb0baf3b20: stopping tablet replica
I20260709 12:12:15.352308  3922 master.cc:584] Master@127.3.212.190:36867 shutdown complete.
342b038803924b2b8625bfd6f2cf4c08  4
9d299deccaa74c2d8db110a6e6671fcc  4
e4256387244444f3b9c0d54803e74760  1
342b038803924b2b8625bfd6f2cf4c08  3
9d299deccaa74c2d8db110a6e6671fcc  3
e4256387244444f3b9c0d54803e74760  3
342b038803924b2b8625bfd6f2cf4c08  8
9d299deccaa74c2d8db110a6e6671fcc  0
e4256387244444f3b9c0d54803e74760  1
342b038803924b2b8625bfd6f2cf4c08  3
9d299deccaa74c2d8db110a6e6671fcc  3
e4256387244444f3b9c0d54803e74760  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (31457 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:12:15.392966  3922 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.212.190:33345
I20260709 12:12:15.394212  3922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:15.400202  4450 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:15.400349  4451 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:15.401122  4453 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:15.401209  3922 server_base.cc:1061] running on GCE node
I20260709 12:12:15.402518  3922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:15.402714  3922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:15.402832  3922 hybrid_clock.cc:648] HybridClock initialized: now 1783599135402820 us; error 0 us; skew 500 ppm
I20260709 12:12:15.403276  3922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:15.406061  3922 webserver.cc:533] Webserver started at http://127.3.212.190:46035/ using document root <none> and password file <none>
I20260709 12:12:15.406538  3922 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:15.406689  3922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:15.406944  3922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:15.408044  3922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599103767690-3922-0/minicluster-data/master-0-root/instance:
uuid: "bd683515aeeb4bc9ab96030184df3347"
format_stamp: "Formatted at 2026-07-09 12:12:15 on dist-test-slave-442x"
I20260709 12:12:15.412586  3922 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 12:12:15.416096  4458 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:15.416939  3922 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:12:15.417205  3922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599103767690-3922-0/minicluster-data/master-0-root
uuid: "bd683515aeeb4bc9ab96030184df3347"
format_stamp: "Formatted at 2026-07-09 12:12:15 on dist-test-slave-442x"
I20260709 12:12:15.417522  3922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599103767690-3922-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599103767690-3922-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599103767690-3922-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:15.455379  3922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:15.456894  3922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:15.496003  3922 rpc_server.cc:307] RPC server started. Bound to: 127.3.212.190:33345
I20260709 12:12:15.496114  4509 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.212.190:33345 every 8 connection(s)
I20260709 12:12:15.500108  4510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:15.510468  4510 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd683515aeeb4bc9ab96030184df3347: Bootstrap starting.
I20260709 12:12:15.515167  4510 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bd683515aeeb4bc9ab96030184df3347: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:15.519528  4510 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd683515aeeb4bc9ab96030184df3347: No bootstrap required, opened a new log
I20260709 12:12:15.521864  4510 raft_consensus.cc:359] T 00000000000000000000000000000000 P bd683515aeeb4bc9ab96030184df3347 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd683515aeeb4bc9ab96030184df3347" member_type: VOTER }
I20260709 12:12:15.522455  4510 raft_consensus.cc:385] T 00000000000000000000000000000000 P bd683515aeeb4bc9ab96030184df3347 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:15.522645  4510 raft_consensus.cc:740] T 00000000000000000000000000000000 P bd683515aeeb4bc9ab96030184df3347 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd683515aeeb4bc9ab96030184df3347, State: Initialized, Role: FOLLOWER
I20260709 12:12:15.523145  4510 consensus_queue.cc:260] T 00000000000000000000000000000000 P bd683515aeeb4bc9ab96030184df3347 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd683515aeeb4bc9ab96030184df3347" member_type: VOTER }
I20260709 12:12:15.523581  4510 raft_consensus.cc:399] T 00000000000000000000000000000000 P bd683515aeeb4bc9ab96030184df3347 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:12:15.523780  4510 raft_consensus.cc:493] T 00000000000000000000000000000000 P bd683515aeeb4bc9ab96030184df3347 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:12:15.523981  4510 raft_consensus.cc:3060] T 00000000000000000000000000000000 P bd683515aeeb4bc9ab96030184df3347 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:15.527995  4510 raft_consensus.cc:515] T 00000000000000000000000000000000 P bd683515aeeb4bc9ab96030184df3347 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd683515aeeb4bc9ab96030184df3347" member_type: VOTER }
I20260709 12:12:15.528507  4510 leader_election.cc:304] T 00000000000000000000000000000000 P bd683515aeeb4bc9ab96030184df3347 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bd683515aeeb4bc9ab96030184df3347; no voters: 
I20260709 12:12:15.529654  4510 leader_election.cc:290] T 00000000000000000000000000000000 P bd683515aeeb4bc9ab96030184df3347 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:12:15.530062  4513 raft_consensus.cc:2804] T 00000000000000000000000000000000 P bd683515aeeb4bc9ab96030184df3347 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:15.531355  4513 raft_consensus.cc:697] T 00000000000000000000000000000000 P bd683515aeeb4bc9ab96030184df3347 [term 1 LEADER]: Becoming Leader. State: Replica: bd683515aeeb4bc9ab96030184df3347, State: Running, Role: LEADER
I20260709 12:12:15.532063  4513 consensus_queue.cc:237] T 00000000000000000000000000000000 P bd683515aeeb4bc9ab96030184df3347 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd683515aeeb4bc9ab96030184df3347" member_type: VOTER }
I20260709 12:12:15.532444  4510 sys_catalog.cc:565] T 00000000000000000000000000000000 P bd683515aeeb4bc9ab96030184df3347 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:12:15.536479  4514 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd683515aeeb4bc9ab96030184df3347 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bd683515aeeb4bc9ab96030184df3347" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd683515aeeb4bc9ab96030184df3347" member_type: VOTER } }
I20260709 12:12:15.537108  4514 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd683515aeeb4bc9ab96030184df3347 [sys.catalog]: This master's current role is: LEADER
I20260709 12:12:15.537421  4515 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd683515aeeb4bc9ab96030184df3347 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bd683515aeeb4bc9ab96030184df3347. Latest consensus state: current_term: 1 leader_uuid: "bd683515aeeb4bc9ab96030184df3347" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd683515aeeb4bc9ab96030184df3347" member_type: VOTER } }
I20260709 12:12:15.538044  4515 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd683515aeeb4bc9ab96030184df3347 [sys.catalog]: This master's current role is: LEADER
I20260709 12:12:15.544872  4521 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:12:15.551159  4521 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:12:15.552280  3922 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:12:15.560170  4521 catalog_manager.cc:1383] Generated new cluster ID: 761c5ba899bd450198bf640441344ae4
I20260709 12:12:15.560508  4521 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:12:15.586232  4521 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:12:15.587517  4521 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:12:15.601644  4521 catalog_manager.cc:6070] T 00000000000000000000000000000000 P bd683515aeeb4bc9ab96030184df3347: Generated new TSK 0
I20260709 12:12:15.602284  4521 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:12:15.619264  3922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:15.624979  4531 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:15.626001  4532 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:15.628566  3922 server_base.cc:1061] running on GCE node
W20260709 12:12:15.628635  4534 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:15.629678  3922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:15.629869  3922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:15.630013  3922 hybrid_clock.cc:648] HybridClock initialized: now 1783599135629997 us; error 0 us; skew 500 ppm
I20260709 12:12:15.630501  3922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:15.632674  3922 webserver.cc:533] Webserver started at http://127.3.212.129:37423/ using document root <none> and password file <none>
I20260709 12:12:15.633133  3922 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:15.633316  3922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:15.633595  3922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:15.634646  3922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599103767690-3922-0/minicluster-data/ts-0-root/instance:
uuid: "c66b12e0a1cc44b58565da795b7a4b8e"
format_stamp: "Formatted at 2026-07-09 12:12:15 on dist-test-slave-442x"
I20260709 12:12:15.639139  3922 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:12:15.642719  4539 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:15.643507  3922 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:12:15.643800  3922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599103767690-3922-0/minicluster-data/ts-0-root
uuid: "c66b12e0a1cc44b58565da795b7a4b8e"
format_stamp: "Formatted at 2026-07-09 12:12:15 on dist-test-slave-442x"
I20260709 12:12:15.644075  3922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599103767690-3922-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599103767690-3922-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599103767690-3922-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:15.655333  3922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:15.656570  3922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:15.658092  3922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:15.660486  3922 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:15.660696  3922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:15.660925  3922 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:15.661090  3922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:15.701136  3922 rpc_server.cc:307] RPC server started. Bound to: 127.3.212.129:37153
I20260709 12:12:15.701236  4601 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.212.129:37153 every 8 connection(s)
I20260709 12:12:15.705853  3922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:15.712706  4606 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:15.714156  4607 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:15.716351  3922 server_base.cc:1061] running on GCE node
W20260709 12:12:15.716747  4610 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:15.717919  3922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:15.718133  3922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:15.718294  3922 hybrid_clock.cc:648] HybridClock initialized: now 1783599135718278 us; error 0 us; skew 500 ppm
I20260709 12:12:15.718789  3922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:15.721833  3922 webserver.cc:533] Webserver started at http://127.3.212.130:38673/ using document root <none> and password file <none>
I20260709 12:12:15.722430  3922 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:15.722621  3922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:15.722671  4602 heartbeater.cc:344] Connected to a master server at 127.3.212.190:33345
I20260709 12:12:15.722978  3922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:15.723140  4602 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:15.724089  4602 heartbeater.cc:507] Master 127.3.212.190:33345 requested a full tablet report, sending...
I20260709 12:12:15.724500  3922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599103767690-3922-0/minicluster-data/ts-1-root/instance:
uuid: "0d5eb6a44dd24ba196d9026aec41ff61"
format_stamp: "Formatted at 2026-07-09 12:12:15 on dist-test-slave-442x"
I20260709 12:12:15.726500  4475 ts_manager.cc:194] Registered new tserver with Master: c66b12e0a1cc44b58565da795b7a4b8e (127.3.212.129:37153)
I20260709 12:12:15.728852  4475 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52704
I20260709 12:12:15.730050  3922 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.003s
I20260709 12:12:15.734107  4614 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:15.734998  3922 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:12:15.735292  3922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599103767690-3922-0/minicluster-data/ts-1-root
uuid: "0d5eb6a44dd24ba196d9026aec41ff61"
format_stamp: "Formatted at 2026-07-09 12:12:15 on dist-test-slave-442x"
I20260709 12:12:15.735553  3922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599103767690-3922-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599103767690-3922-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599103767690-3922-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:15.747026  3922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:15.748250  3922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:15.749683  3922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:15.751775  3922 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:15.751964  3922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:15.752188  3922 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:15.752336  3922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:15.791682  3922 rpc_server.cc:307] RPC server started. Bound to: 127.3.212.130:34847
I20260709 12:12:15.791846  4676 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.212.130:34847 every 8 connection(s)
I20260709 12:12:15.796213  3922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:15.803084  4680 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:15.803944  4681 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:15.807111  4683 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:15.807312  3922 server_base.cc:1061] running on GCE node
I20260709 12:12:15.808311  3922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:15.808566  3922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:15.808531  4677 heartbeater.cc:344] Connected to a master server at 127.3.212.190:33345
I20260709 12:12:15.808897  3922 hybrid_clock.cc:648] HybridClock initialized: now 1783599135808875 us; error 0 us; skew 500 ppm
I20260709 12:12:15.809034  4677 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:15.809648  3922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:15.809955  4677 heartbeater.cc:507] Master 127.3.212.190:33345 requested a full tablet report, sending...
I20260709 12:12:15.812307  3922 webserver.cc:533] Webserver started at http://127.3.212.131:45159/ using document root <none> and password file <none>
I20260709 12:12:15.812371  4475 ts_manager.cc:194] Registered new tserver with Master: 0d5eb6a44dd24ba196d9026aec41ff61 (127.3.212.130:34847)
I20260709 12:12:15.812825  3922 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:15.813027  3922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:15.813261  3922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:15.813862  4475 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52720
I20260709 12:12:15.814394  3922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599103767690-3922-0/minicluster-data/ts-2-root/instance:
uuid: "a754210d0a2b403184f611fd5864442b"
format_stamp: "Formatted at 2026-07-09 12:12:15 on dist-test-slave-442x"
I20260709 12:12:15.819494  3922 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:12:15.822927  4688 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:15.823909  3922 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:12:15.824182  3922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599103767690-3922-0/minicluster-data/ts-2-root
uuid: "a754210d0a2b403184f611fd5864442b"
format_stamp: "Formatted at 2026-07-09 12:12:15 on dist-test-slave-442x"
I20260709 12:12:15.824431  3922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599103767690-3922-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599103767690-3922-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599103767690-3922-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:15.855681  3922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:15.856846  3922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:15.858441  3922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:15.860792  3922 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:15.861008  3922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:15.861238  3922 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:15.861428  3922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:12:15.900457  3922 rpc_server.cc:307] RPC server started. Bound to: 127.3.212.131:37739
I20260709 12:12:15.900574  4750 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.212.131:37739 every 8 connection(s)
I20260709 12:12:15.914561  4751 heartbeater.cc:344] Connected to a master server at 127.3.212.190:33345
I20260709 12:12:15.914923  4751 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:15.915802  4751 heartbeater.cc:507] Master 127.3.212.190:33345 requested a full tablet report, sending...
I20260709 12:12:15.917925  4475 ts_manager.cc:194] Registered new tserver with Master: a754210d0a2b403184f611fd5864442b (127.3.212.131:37739)
I20260709 12:12:15.918006  3922 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014519967s
I20260709 12:12:15.919435  4475 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52726
I20260709 12:12:15.944984  4475 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52736:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:12:15.948101  4475 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:12:16.030581  4642 tablet_service.cc:1511] Processing CreateTablet for tablet c3035351b7444712b999d435424960d0 (DEFAULT_TABLE table=test-workload [id=3253608c9c314c31bdec8a8df9c6dbde]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:12:16.032184  4642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3035351b7444712b999d435424960d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.035637  4641 tablet_service.cc:1511] Processing CreateTablet for tablet 978105aee434435f91eb9b3ddda005c4 (DEFAULT_TABLE table=test-workload [id=3253608c9c314c31bdec8a8df9c6dbde]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:12:16.037320  4641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 978105aee434435f91eb9b3ddda005c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.046845  4640 tablet_service.cc:1511] Processing CreateTablet for tablet 2993ac2125df4c1696029a2d0663531a (DEFAULT_TABLE table=test-workload [id=3253608c9c314c31bdec8a8df9c6dbde]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:12:16.048357  4640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2993ac2125df4c1696029a2d0663531a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.065686  4635 tablet_service.cc:1511] Processing CreateTablet for tablet 0c7d085ac21245e2a3de979566582db6 (DEFAULT_TABLE table=test-workload [id=3253608c9c314c31bdec8a8df9c6dbde]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:12:16.068270  4638 tablet_service.cc:1511] Processing CreateTablet for tablet e35f477c83c04eb089f4ccd3042dd99c (DEFAULT_TABLE table=test-workload [id=3253608c9c314c31bdec8a8df9c6dbde]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:12:16.070818  4634 tablet_service.cc:1511] Processing CreateTablet for tablet 559fa0760acb4538bfce94dc6cc9e553 (DEFAULT_TABLE table=test-workload [id=3253608c9c314c31bdec8a8df9c6dbde]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:12:16.071919  4642 tablet_service.cc:1511] Processing CreateTablet for tablet 239da9ff3cf24b88a55a845f2978db90 (DEFAULT_TABLE table=test-workload [id=3253608c9c314c31bdec8a8df9c6dbde]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:12:16.073431  4637 tablet_service.cc:1511] Processing CreateTablet for tablet 643771d1f41240b5a002a62fdaa0b0d0 (DEFAULT_TABLE table=test-workload [id=3253608c9c314c31bdec8a8df9c6dbde]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:12:16.075704  4716 tablet_service.cc:1511] Processing CreateTablet for tablet c3035351b7444712b999d435424960d0 (DEFAULT_TABLE table=test-workload [id=3253608c9c314c31bdec8a8df9c6dbde]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:12:16.075875  4639 tablet_service.cc:1511] Processing CreateTablet for tablet a6a637307cbc440eb70af83b47cc78b0 (DEFAULT_TABLE table=test-workload [id=3253608c9c314c31bdec8a8df9c6dbde]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:12:16.077267  4716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3035351b7444712b999d435424960d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.077749  4635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c7d085ac21245e2a3de979566582db6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.078585  4636 tablet_service.cc:1511] Processing CreateTablet for tablet 62d99d5944b14dca82789362b6d798ce (DEFAULT_TABLE table=test-workload [id=3253608c9c314c31bdec8a8df9c6dbde]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:12:16.080116  4636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62d99d5944b14dca82789362b6d798ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.081732  4634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 559fa0760acb4538bfce94dc6cc9e553. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.089883  4638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e35f477c83c04eb089f4ccd3042dd99c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.093777  4637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 643771d1f41240b5a002a62fdaa0b0d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.095028  4715 tablet_service.cc:1511] Processing CreateTablet for tablet 978105aee434435f91eb9b3ddda005c4 (DEFAULT_TABLE table=test-workload [id=3253608c9c314c31bdec8a8df9c6dbde]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:12:16.096511  4715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 978105aee434435f91eb9b3ddda005c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.096566  4712 tablet_service.cc:1511] Processing CreateTablet for tablet e35f477c83c04eb089f4ccd3042dd99c (DEFAULT_TABLE table=test-workload [id=3253608c9c314c31bdec8a8df9c6dbde]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:12:16.097508  4639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6a637307cbc440eb70af83b47cc78b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.097975  4712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e35f477c83c04eb089f4ccd3042dd99c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.101432  4714 tablet_service.cc:1511] Processing CreateTablet for tablet 2993ac2125df4c1696029a2d0663531a (DEFAULT_TABLE table=test-workload [id=3253608c9c314c31bdec8a8df9c6dbde]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:12:16.103027  4714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2993ac2125df4c1696029a2d0663531a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.106510  4713 tablet_service.cc:1511] Processing CreateTablet for tablet a6a637307cbc440eb70af83b47cc78b0 (DEFAULT_TABLE table=test-workload [id=3253608c9c314c31bdec8a8df9c6dbde]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:12:16.107852  4713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6a637307cbc440eb70af83b47cc78b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.115377  4711 tablet_service.cc:1511] Processing CreateTablet for tablet 643771d1f41240b5a002a62fdaa0b0d0 (DEFAULT_TABLE table=test-workload [id=3253608c9c314c31bdec8a8df9c6dbde]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:12:16.116816  4711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 643771d1f41240b5a002a62fdaa0b0d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.127374  4710 tablet_service.cc:1511] Processing CreateTablet for tablet 62d99d5944b14dca82789362b6d798ce (DEFAULT_TABLE table=test-workload [id=3253608c9c314c31bdec8a8df9c6dbde]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:12:16.128841  4710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62d99d5944b14dca82789362b6d798ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.138343  4765 tablet_bootstrap.cc:492] T 978105aee434435f91eb9b3ddda005c4 P 0d5eb6a44dd24ba196d9026aec41ff61: Bootstrap starting.
I20260709 12:12:16.139340  4709 tablet_service.cc:1511] Processing CreateTablet for tablet 0c7d085ac21245e2a3de979566582db6 (DEFAULT_TABLE table=test-workload [id=3253608c9c314c31bdec8a8df9c6dbde]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:12:16.140754  4709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c7d085ac21245e2a3de979566582db6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.144600  4708 tablet_service.cc:1511] Processing CreateTablet for tablet 559fa0760acb4538bfce94dc6cc9e553 (DEFAULT_TABLE table=test-workload [id=3253608c9c314c31bdec8a8df9c6dbde]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:12:16.146116  4708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 559fa0760acb4538bfce94dc6cc9e553. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.151254  4707 tablet_service.cc:1511] Processing CreateTablet for tablet 239da9ff3cf24b88a55a845f2978db90 (DEFAULT_TABLE table=test-workload [id=3253608c9c314c31bdec8a8df9c6dbde]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:12:16.152689  4707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 239da9ff3cf24b88a55a845f2978db90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.160270  4567 tablet_service.cc:1511] Processing CreateTablet for tablet c3035351b7444712b999d435424960d0 (DEFAULT_TABLE table=test-workload [id=3253608c9c314c31bdec8a8df9c6dbde]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:12:16.162477  4566 tablet_service.cc:1511] Processing CreateTablet for tablet 978105aee434435f91eb9b3ddda005c4 (DEFAULT_TABLE table=test-workload [id=3253608c9c314c31bdec8a8df9c6dbde]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:12:16.163972  4566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 978105aee434435f91eb9b3ddda005c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.162384  4563 tablet_service.cc:1511] Processing CreateTablet for tablet e35f477c83c04eb089f4ccd3042dd99c (DEFAULT_TABLE table=test-workload [id=3253608c9c314c31bdec8a8df9c6dbde]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:12:16.168036  4563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e35f477c83c04eb089f4ccd3042dd99c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.168184  4565 tablet_service.cc:1511] Processing CreateTablet for tablet 2993ac2125df4c1696029a2d0663531a (DEFAULT_TABLE table=test-workload [id=3253608c9c314c31bdec8a8df9c6dbde]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:12:16.170567  4765 tablet_bootstrap.cc:654] T 978105aee434435f91eb9b3ddda005c4 P 0d5eb6a44dd24ba196d9026aec41ff61: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.170655  4564 tablet_service.cc:1511] Processing CreateTablet for tablet a6a637307cbc440eb70af83b47cc78b0 (DEFAULT_TABLE table=test-workload [id=3253608c9c314c31bdec8a8df9c6dbde]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:12:16.164970  4562 tablet_service.cc:1511] Processing CreateTablet for tablet 643771d1f41240b5a002a62fdaa0b0d0 (DEFAULT_TABLE table=test-workload [id=3253608c9c314c31bdec8a8df9c6dbde]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:12:16.173159  4565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2993ac2125df4c1696029a2d0663531a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.177735  4562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 643771d1f41240b5a002a62fdaa0b0d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.179927  4564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6a637307cbc440eb70af83b47cc78b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.182735  4567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3035351b7444712b999d435424960d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.187719  4561 tablet_service.cc:1511] Processing CreateTablet for tablet 62d99d5944b14dca82789362b6d798ce (DEFAULT_TABLE table=test-workload [id=3253608c9c314c31bdec8a8df9c6dbde]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:12:16.190871  4560 tablet_service.cc:1511] Processing CreateTablet for tablet 0c7d085ac21245e2a3de979566582db6 (DEFAULT_TABLE table=test-workload [id=3253608c9c314c31bdec8a8df9c6dbde]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:12:16.193565  4559 tablet_service.cc:1511] Processing CreateTablet for tablet 559fa0760acb4538bfce94dc6cc9e553 (DEFAULT_TABLE table=test-workload [id=3253608c9c314c31bdec8a8df9c6dbde]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:12:16.196255  4558 tablet_service.cc:1511] Processing CreateTablet for tablet 239da9ff3cf24b88a55a845f2978db90 (DEFAULT_TABLE table=test-workload [id=3253608c9c314c31bdec8a8df9c6dbde]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:12:16.198093  4561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62d99d5944b14dca82789362b6d798ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.201805  4558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 239da9ff3cf24b88a55a845f2978db90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.204811  4560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c7d085ac21245e2a3de979566582db6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.208093  4642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 239da9ff3cf24b88a55a845f2978db90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.208817  4559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 559fa0760acb4538bfce94dc6cc9e553. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:16.213482  4766 tablet_bootstrap.cc:492] T 978105aee434435f91eb9b3ddda005c4 P a754210d0a2b403184f611fd5864442b: Bootstrap starting.
I20260709 12:12:16.238633  4768 tablet_bootstrap.cc:492] T c3035351b7444712b999d435424960d0 P c66b12e0a1cc44b58565da795b7a4b8e: Bootstrap starting.
I20260709 12:12:16.237428  4766 tablet_bootstrap.cc:654] T 978105aee434435f91eb9b3ddda005c4 P a754210d0a2b403184f611fd5864442b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.243517  4765 tablet_bootstrap.cc:492] T 978105aee434435f91eb9b3ddda005c4 P 0d5eb6a44dd24ba196d9026aec41ff61: No bootstrap required, opened a new log
I20260709 12:12:16.244033  4765 ts_tablet_manager.cc:1403] T 978105aee434435f91eb9b3ddda005c4 P 0d5eb6a44dd24ba196d9026aec41ff61: Time spent bootstrapping tablet: real 0.106s	user 0.016s	sys 0.036s
I20260709 12:12:16.246910  4765 raft_consensus.cc:359] T 978105aee434435f91eb9b3ddda005c4 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.247633  4765 raft_consensus.cc:385] T 978105aee434435f91eb9b3ddda005c4 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.247938  4765 raft_consensus.cc:740] T 978105aee434435f91eb9b3ddda005c4 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d5eb6a44dd24ba196d9026aec41ff61, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.248838  4765 consensus_queue.cc:260] T 978105aee434435f91eb9b3ddda005c4 P 0d5eb6a44dd24ba196d9026aec41ff61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.253265  4768 tablet_bootstrap.cc:654] T c3035351b7444712b999d435424960d0 P c66b12e0a1cc44b58565da795b7a4b8e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.260510  4677 heartbeater.cc:499] Master 127.3.212.190:33345 was elected leader, sending a full tablet report...
I20260709 12:12:16.261660  4765 ts_tablet_manager.cc:1434] T 978105aee434435f91eb9b3ddda005c4 P 0d5eb6a44dd24ba196d9026aec41ff61: Time spent starting tablet: real 0.017s	user 0.011s	sys 0.001s
I20260709 12:12:16.262643  4765 tablet_bootstrap.cc:492] T c3035351b7444712b999d435424960d0 P 0d5eb6a44dd24ba196d9026aec41ff61: Bootstrap starting.
I20260709 12:12:16.266461  4768 tablet_bootstrap.cc:492] T c3035351b7444712b999d435424960d0 P c66b12e0a1cc44b58565da795b7a4b8e: No bootstrap required, opened a new log
I20260709 12:12:16.266970  4768 ts_tablet_manager.cc:1403] T c3035351b7444712b999d435424960d0 P c66b12e0a1cc44b58565da795b7a4b8e: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.001s
I20260709 12:12:16.269925  4768 raft_consensus.cc:359] T c3035351b7444712b999d435424960d0 P c66b12e0a1cc44b58565da795b7a4b8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } } peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } }
I20260709 12:12:16.270664  4768 raft_consensus.cc:385] T c3035351b7444712b999d435424960d0 P c66b12e0a1cc44b58565da795b7a4b8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.270967  4768 raft_consensus.cc:740] T c3035351b7444712b999d435424960d0 P c66b12e0a1cc44b58565da795b7a4b8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c66b12e0a1cc44b58565da795b7a4b8e, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.271598  4766 tablet_bootstrap.cc:492] T 978105aee434435f91eb9b3ddda005c4 P a754210d0a2b403184f611fd5864442b: No bootstrap required, opened a new log
I20260709 12:12:16.271816  4770 raft_consensus.cc:493] T 978105aee434435f91eb9b3ddda005c4 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.272049  4766 ts_tablet_manager.cc:1403] T 978105aee434435f91eb9b3ddda005c4 P a754210d0a2b403184f611fd5864442b: Time spent bootstrapping tablet: real 0.059s	user 0.016s	sys 0.012s
I20260709 12:12:16.274364  4766 raft_consensus.cc:359] T 978105aee434435f91eb9b3ddda005c4 P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.274945  4766 raft_consensus.cc:385] T 978105aee434435f91eb9b3ddda005c4 P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.275188  4766 raft_consensus.cc:740] T 978105aee434435f91eb9b3ddda005c4 P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a754210d0a2b403184f611fd5864442b, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.275856  4766 consensus_queue.cc:260] T 978105aee434435f91eb9b3ddda005c4 P a754210d0a2b403184f611fd5864442b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.277201  4765 tablet_bootstrap.cc:654] T c3035351b7444712b999d435424960d0 P 0d5eb6a44dd24ba196d9026aec41ff61: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.278035  4751 heartbeater.cc:499] Master 127.3.212.190:33345 was elected leader, sending a full tablet report...
I20260709 12:12:16.272308  4770 raft_consensus.cc:515] T 978105aee434435f91eb9b3ddda005c4 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.281782  4766 ts_tablet_manager.cc:1434] T 978105aee434435f91eb9b3ddda005c4 P a754210d0a2b403184f611fd5864442b: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 12:12:16.282927  4766 tablet_bootstrap.cc:492] T e35f477c83c04eb089f4ccd3042dd99c P a754210d0a2b403184f611fd5864442b: Bootstrap starting.
I20260709 12:12:16.285470  4770 leader_election.cc:290] T 978105aee434435f91eb9b3ddda005c4 P 0d5eb6a44dd24ba196d9026aec41ff61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c66b12e0a1cc44b58565da795b7a4b8e (127.3.212.129:37153), a754210d0a2b403184f611fd5864442b (127.3.212.131:37739)
I20260709 12:12:16.289546  4766 tablet_bootstrap.cc:654] T e35f477c83c04eb089f4ccd3042dd99c P a754210d0a2b403184f611fd5864442b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.293848  4768 consensus_queue.cc:260] T c3035351b7444712b999d435424960d0 P c66b12e0a1cc44b58565da795b7a4b8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } } peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } }
I20260709 12:12:16.300595  4765 tablet_bootstrap.cc:492] T c3035351b7444712b999d435424960d0 P 0d5eb6a44dd24ba196d9026aec41ff61: No bootstrap required, opened a new log
I20260709 12:12:16.301214  4765 ts_tablet_manager.cc:1403] T c3035351b7444712b999d435424960d0 P 0d5eb6a44dd24ba196d9026aec41ff61: Time spent bootstrapping tablet: real 0.039s	user 0.005s	sys 0.005s
I20260709 12:12:16.304210  4765 raft_consensus.cc:359] T c3035351b7444712b999d435424960d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } } peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } }
I20260709 12:12:16.304986  4765 raft_consensus.cc:385] T c3035351b7444712b999d435424960d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.305423  4602 heartbeater.cc:499] Master 127.3.212.190:33345 was elected leader, sending a full tablet report...
I20260709 12:12:16.306620  4768 ts_tablet_manager.cc:1434] T c3035351b7444712b999d435424960d0 P c66b12e0a1cc44b58565da795b7a4b8e: Time spent starting tablet: real 0.039s	user 0.004s	sys 0.004s
I20260709 12:12:16.307392  4726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978105aee434435f91eb9b3ddda005c4" candidate_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a754210d0a2b403184f611fd5864442b" is_pre_election: true
I20260709 12:12:16.305301  4765 raft_consensus.cc:740] T c3035351b7444712b999d435424960d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d5eb6a44dd24ba196d9026aec41ff61, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.308188  4726 raft_consensus.cc:2468] T 978105aee434435f91eb9b3ddda005c4 P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d5eb6a44dd24ba196d9026aec41ff61 in term 0.
I20260709 12:12:16.308566  4765 consensus_queue.cc:260] T c3035351b7444712b999d435424960d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } } peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } }
I20260709 12:12:16.310573  4615 leader_election.cc:304] T 978105aee434435f91eb9b3ddda005c4 P 0d5eb6a44dd24ba196d9026aec41ff61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d5eb6a44dd24ba196d9026aec41ff61, a754210d0a2b403184f611fd5864442b; no voters: 
I20260709 12:12:16.310830  4765 ts_tablet_manager.cc:1434] T c3035351b7444712b999d435424960d0 P 0d5eb6a44dd24ba196d9026aec41ff61: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:12:16.312049  4765 tablet_bootstrap.cc:492] T 62d99d5944b14dca82789362b6d798ce P 0d5eb6a44dd24ba196d9026aec41ff61: Bootstrap starting.
I20260709 12:12:16.315526  4770 raft_consensus.cc:2804] T 978105aee434435f91eb9b3ddda005c4 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:16.315932  4770 raft_consensus.cc:493] T 978105aee434435f91eb9b3ddda005c4 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:16.316246  4770 raft_consensus.cc:3060] T 978105aee434435f91eb9b3ddda005c4 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.317678  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978105aee434435f91eb9b3ddda005c4" candidate_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" is_pre_election: true
I20260709 12:12:16.319216  4765 tablet_bootstrap.cc:654] T 62d99d5944b14dca82789362b6d798ce P 0d5eb6a44dd24ba196d9026aec41ff61: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.319738  4768 tablet_bootstrap.cc:492] T 978105aee434435f91eb9b3ddda005c4 P c66b12e0a1cc44b58565da795b7a4b8e: Bootstrap starting.
I20260709 12:12:16.327869  4766 tablet_bootstrap.cc:492] T e35f477c83c04eb089f4ccd3042dd99c P a754210d0a2b403184f611fd5864442b: No bootstrap required, opened a new log
I20260709 12:12:16.328471  4766 ts_tablet_manager.cc:1403] T e35f477c83c04eb089f4ccd3042dd99c P a754210d0a2b403184f611fd5864442b: Time spent bootstrapping tablet: real 0.046s	user 0.012s	sys 0.023s
I20260709 12:12:16.331609  4766 raft_consensus.cc:359] T e35f477c83c04eb089f4ccd3042dd99c P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.332403  4766 raft_consensus.cc:385] T e35f477c83c04eb089f4ccd3042dd99c P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.332692  4766 raft_consensus.cc:740] T e35f477c83c04eb089f4ccd3042dd99c P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a754210d0a2b403184f611fd5864442b, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.333592  4766 consensus_queue.cc:260] T e35f477c83c04eb089f4ccd3042dd99c P a754210d0a2b403184f611fd5864442b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.335135  4768 tablet_bootstrap.cc:654] T 978105aee434435f91eb9b3ddda005c4 P c66b12e0a1cc44b58565da795b7a4b8e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.368803  4765 tablet_bootstrap.cc:492] T 62d99d5944b14dca82789362b6d798ce P 0d5eb6a44dd24ba196d9026aec41ff61: No bootstrap required, opened a new log
I20260709 12:12:16.340243  4766 ts_tablet_manager.cc:1434] T e35f477c83c04eb089f4ccd3042dd99c P a754210d0a2b403184f611fd5864442b: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
W20260709 12:12:16.360033  4615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:37739, user_credentials={real_user=slave}} blocked reactor thread for 49619.4us
I20260709 12:12:16.369997  4765 ts_tablet_manager.cc:1403] T 62d99d5944b14dca82789362b6d798ce P 0d5eb6a44dd24ba196d9026aec41ff61: Time spent bootstrapping tablet: real 0.058s	user 0.022s	sys 0.034s
I20260709 12:12:16.343823  4770 raft_consensus.cc:515] T 978105aee434435f91eb9b3ddda005c4 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.363334  4768 tablet_bootstrap.cc:492] T 978105aee434435f91eb9b3ddda005c4 P c66b12e0a1cc44b58565da795b7a4b8e: No bootstrap required, opened a new log
I20260709 12:12:16.370697  4768 ts_tablet_manager.cc:1403] T 978105aee434435f91eb9b3ddda005c4 P c66b12e0a1cc44b58565da795b7a4b8e: Time spent bootstrapping tablet: real 0.051s	user 0.014s	sys 0.001s
I20260709 12:12:16.371941  4770 leader_election.cc:290] T 978105aee434435f91eb9b3ddda005c4 P 0d5eb6a44dd24ba196d9026aec41ff61 [CANDIDATE]: Term 1 election: Requested vote from peers c66b12e0a1cc44b58565da795b7a4b8e (127.3.212.129:37153), a754210d0a2b403184f611fd5864442b (127.3.212.131:37739)
I20260709 12:12:16.373009  4766 tablet_bootstrap.cc:492] T 643771d1f41240b5a002a62fdaa0b0d0 P a754210d0a2b403184f611fd5864442b: Bootstrap starting.
I20260709 12:12:16.373196  4765 raft_consensus.cc:359] T 62d99d5944b14dca82789362b6d798ce P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.373579  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978105aee434435f91eb9b3ddda005c4" candidate_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c66b12e0a1cc44b58565da795b7a4b8e"
I20260709 12:12:16.373908  4765 raft_consensus.cc:385] T 62d99d5944b14dca82789362b6d798ce P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.374254  4765 raft_consensus.cc:740] T 62d99d5944b14dca82789362b6d798ce P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d5eb6a44dd24ba196d9026aec41ff61, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.374406  4726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978105aee434435f91eb9b3ddda005c4" candidate_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a754210d0a2b403184f611fd5864442b"
I20260709 12:12:16.374939  4726 raft_consensus.cc:3060] T 978105aee434435f91eb9b3ddda005c4 P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.375099  4768 raft_consensus.cc:359] T 978105aee434435f91eb9b3ddda005c4 P c66b12e0a1cc44b58565da795b7a4b8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.375059  4765 consensus_queue.cc:260] T 62d99d5944b14dca82789362b6d798ce P 0d5eb6a44dd24ba196d9026aec41ff61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.375905  4768 raft_consensus.cc:385] T 978105aee434435f91eb9b3ddda005c4 P c66b12e0a1cc44b58565da795b7a4b8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.376212  4768 raft_consensus.cc:740] T 978105aee434435f91eb9b3ddda005c4 P c66b12e0a1cc44b58565da795b7a4b8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c66b12e0a1cc44b58565da795b7a4b8e, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.377075  4768 consensus_queue.cc:260] T 978105aee434435f91eb9b3ddda005c4 P c66b12e0a1cc44b58565da795b7a4b8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.377624  4765 ts_tablet_manager.cc:1434] T 62d99d5944b14dca82789362b6d798ce P 0d5eb6a44dd24ba196d9026aec41ff61: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 12:12:16.379863  4766 tablet_bootstrap.cc:654] T 643771d1f41240b5a002a62fdaa0b0d0 P a754210d0a2b403184f611fd5864442b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.380743  4765 tablet_bootstrap.cc:492] T 643771d1f41240b5a002a62fdaa0b0d0 P 0d5eb6a44dd24ba196d9026aec41ff61: Bootstrap starting.
I20260709 12:12:16.382664  4726 raft_consensus.cc:2468] T 978105aee434435f91eb9b3ddda005c4 P a754210d0a2b403184f611fd5864442b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d5eb6a44dd24ba196d9026aec41ff61 in term 1.
W20260709 12:12:16.384436  4615 leader_election.cc:343] T 978105aee434435f91eb9b3ddda005c4 P 0d5eb6a44dd24ba196d9026aec41ff61 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c66b12e0a1cc44b58565da795b7a4b8e (127.3.212.129:37153): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:16.385408  4615 leader_election.cc:343] T 978105aee434435f91eb9b3ddda005c4 P 0d5eb6a44dd24ba196d9026aec41ff61 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c66b12e0a1cc44b58565da795b7a4b8e (127.3.212.129:37153): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:16.386154  4615 leader_election.cc:304] T 978105aee434435f91eb9b3ddda005c4 P 0d5eb6a44dd24ba196d9026aec41ff61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d5eb6a44dd24ba196d9026aec41ff61, a754210d0a2b403184f611fd5864442b; no voters: c66b12e0a1cc44b58565da795b7a4b8e
I20260709 12:12:16.387019  4770 raft_consensus.cc:2804] T 978105aee434435f91eb9b3ddda005c4 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:16.387436  4765 tablet_bootstrap.cc:654] T 643771d1f41240b5a002a62fdaa0b0d0 P 0d5eb6a44dd24ba196d9026aec41ff61: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.387821  4770 raft_consensus.cc:697] T 978105aee434435f91eb9b3ddda005c4 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 1 LEADER]: Becoming Leader. State: Replica: 0d5eb6a44dd24ba196d9026aec41ff61, State: Running, Role: LEADER
I20260709 12:12:16.388736  4770 consensus_queue.cc:237] T 978105aee434435f91eb9b3ddda005c4 P 0d5eb6a44dd24ba196d9026aec41ff61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.389230  4766 tablet_bootstrap.cc:492] T 643771d1f41240b5a002a62fdaa0b0d0 P a754210d0a2b403184f611fd5864442b: No bootstrap required, opened a new log
I20260709 12:12:16.389293  4768 ts_tablet_manager.cc:1434] T 978105aee434435f91eb9b3ddda005c4 P c66b12e0a1cc44b58565da795b7a4b8e: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:12:16.389868  4766 ts_tablet_manager.cc:1403] T 643771d1f41240b5a002a62fdaa0b0d0 P a754210d0a2b403184f611fd5864442b: Time spent bootstrapping tablet: real 0.017s	user 0.003s	sys 0.009s
I20260709 12:12:16.392529  4768 tablet_bootstrap.cc:492] T e35f477c83c04eb089f4ccd3042dd99c P c66b12e0a1cc44b58565da795b7a4b8e: Bootstrap starting.
I20260709 12:12:16.393489  4766 raft_consensus.cc:359] T 643771d1f41240b5a002a62fdaa0b0d0 P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.394307  4766 raft_consensus.cc:385] T 643771d1f41240b5a002a62fdaa0b0d0 P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.394608  4766 raft_consensus.cc:740] T 643771d1f41240b5a002a62fdaa0b0d0 P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a754210d0a2b403184f611fd5864442b, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.396842  4766 consensus_queue.cc:260] T 643771d1f41240b5a002a62fdaa0b0d0 P a754210d0a2b403184f611fd5864442b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.399677  4768 tablet_bootstrap.cc:654] T e35f477c83c04eb089f4ccd3042dd99c P c66b12e0a1cc44b58565da795b7a4b8e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.404086  4475 catalog_manager.cc:5697] T 978105aee434435f91eb9b3ddda005c4 P 0d5eb6a44dd24ba196d9026aec41ff61 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d5eb6a44dd24ba196d9026aec41ff61 (127.3.212.130). New cstate: current_term: 1 leader_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:16.405215  4766 ts_tablet_manager.cc:1434] T 643771d1f41240b5a002a62fdaa0b0d0 P a754210d0a2b403184f611fd5864442b: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 12:12:16.411018  4765 tablet_bootstrap.cc:492] T 643771d1f41240b5a002a62fdaa0b0d0 P 0d5eb6a44dd24ba196d9026aec41ff61: No bootstrap required, opened a new log
I20260709 12:12:16.411530  4765 ts_tablet_manager.cc:1403] T 643771d1f41240b5a002a62fdaa0b0d0 P 0d5eb6a44dd24ba196d9026aec41ff61: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.009s
I20260709 12:12:16.412467  4766 tablet_bootstrap.cc:492] T 62d99d5944b14dca82789362b6d798ce P a754210d0a2b403184f611fd5864442b: Bootstrap starting.
I20260709 12:12:16.416067  4765 raft_consensus.cc:359] T 643771d1f41240b5a002a62fdaa0b0d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.416806  4765 raft_consensus.cc:385] T 643771d1f41240b5a002a62fdaa0b0d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.417097  4765 raft_consensus.cc:740] T 643771d1f41240b5a002a62fdaa0b0d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d5eb6a44dd24ba196d9026aec41ff61, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.417873  4765 consensus_queue.cc:260] T 643771d1f41240b5a002a62fdaa0b0d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.419731  4766 tablet_bootstrap.cc:654] T 62d99d5944b14dca82789362b6d798ce P a754210d0a2b403184f611fd5864442b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.420346  4765 ts_tablet_manager.cc:1434] T 643771d1f41240b5a002a62fdaa0b0d0 P 0d5eb6a44dd24ba196d9026aec41ff61: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 12:12:16.421298  4765 tablet_bootstrap.cc:492] T 2993ac2125df4c1696029a2d0663531a P 0d5eb6a44dd24ba196d9026aec41ff61: Bootstrap starting.
I20260709 12:12:16.429544  4765 tablet_bootstrap.cc:654] T 2993ac2125df4c1696029a2d0663531a P 0d5eb6a44dd24ba196d9026aec41ff61: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.428755  4768 tablet_bootstrap.cc:492] T e35f477c83c04eb089f4ccd3042dd99c P c66b12e0a1cc44b58565da795b7a4b8e: No bootstrap required, opened a new log
I20260709 12:12:16.432897  4768 ts_tablet_manager.cc:1403] T e35f477c83c04eb089f4ccd3042dd99c P c66b12e0a1cc44b58565da795b7a4b8e: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.024s
I20260709 12:12:16.435406  4766 tablet_bootstrap.cc:492] T 62d99d5944b14dca82789362b6d798ce P a754210d0a2b403184f611fd5864442b: No bootstrap required, opened a new log
I20260709 12:12:16.435199  4768 raft_consensus.cc:359] T e35f477c83c04eb089f4ccd3042dd99c P c66b12e0a1cc44b58565da795b7a4b8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.435835  4768 raft_consensus.cc:385] T e35f477c83c04eb089f4ccd3042dd99c P c66b12e0a1cc44b58565da795b7a4b8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.436012  4766 ts_tablet_manager.cc:1403] T 62d99d5944b14dca82789362b6d798ce P a754210d0a2b403184f611fd5864442b: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.007s
I20260709 12:12:16.436170  4768 raft_consensus.cc:740] T e35f477c83c04eb089f4ccd3042dd99c P c66b12e0a1cc44b58565da795b7a4b8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c66b12e0a1cc44b58565da795b7a4b8e, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.437040  4772 raft_consensus.cc:493] T 643771d1f41240b5a002a62fdaa0b0d0 P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.437556  4772 raft_consensus.cc:515] T 643771d1f41240b5a002a62fdaa0b0d0 P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.439816  4765 tablet_bootstrap.cc:492] T 2993ac2125df4c1696029a2d0663531a P 0d5eb6a44dd24ba196d9026aec41ff61: No bootstrap required, opened a new log
I20260709 12:12:16.439868  4772 leader_election.cc:290] T 643771d1f41240b5a002a62fdaa0b0d0 P a754210d0a2b403184f611fd5864442b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c66b12e0a1cc44b58565da795b7a4b8e (127.3.212.129:37153), 0d5eb6a44dd24ba196d9026aec41ff61 (127.3.212.130:34847)
I20260709 12:12:16.436844  4768 consensus_queue.cc:260] T e35f477c83c04eb089f4ccd3042dd99c P c66b12e0a1cc44b58565da795b7a4b8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.440395  4765 ts_tablet_manager.cc:1403] T 2993ac2125df4c1696029a2d0663531a P 0d5eb6a44dd24ba196d9026aec41ff61: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.003s
I20260709 12:12:16.442039  4768 ts_tablet_manager.cc:1434] T e35f477c83c04eb089f4ccd3042dd99c P c66b12e0a1cc44b58565da795b7a4b8e: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.005s
I20260709 12:12:16.443029  4768 tablet_bootstrap.cc:492] T a6a637307cbc440eb70af83b47cc78b0 P c66b12e0a1cc44b58565da795b7a4b8e: Bootstrap starting.
I20260709 12:12:16.443166  4765 raft_consensus.cc:359] T 2993ac2125df4c1696029a2d0663531a P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.443890  4765 raft_consensus.cc:385] T 2993ac2125df4c1696029a2d0663531a P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.444186  4765 raft_consensus.cc:740] T 2993ac2125df4c1696029a2d0663531a P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d5eb6a44dd24ba196d9026aec41ff61, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.445050  4765 consensus_queue.cc:260] T 2993ac2125df4c1696029a2d0663531a P 0d5eb6a44dd24ba196d9026aec41ff61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.447276  4765 ts_tablet_manager.cc:1434] T 2993ac2125df4c1696029a2d0663531a P 0d5eb6a44dd24ba196d9026aec41ff61: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:12:16.448267  4765 tablet_bootstrap.cc:492] T 559fa0760acb4538bfce94dc6cc9e553 P 0d5eb6a44dd24ba196d9026aec41ff61: Bootstrap starting.
I20260709 12:12:16.451689  4766 raft_consensus.cc:359] T 62d99d5944b14dca82789362b6d798ce P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.452446  4766 raft_consensus.cc:385] T 62d99d5944b14dca82789362b6d798ce P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.452744  4766 raft_consensus.cc:740] T 62d99d5944b14dca82789362b6d798ce P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a754210d0a2b403184f611fd5864442b, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.453477  4766 consensus_queue.cc:260] T 62d99d5944b14dca82789362b6d798ce P a754210d0a2b403184f611fd5864442b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.454800  4765 tablet_bootstrap.cc:654] T 559fa0760acb4538bfce94dc6cc9e553 P 0d5eb6a44dd24ba196d9026aec41ff61: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.458302  4772 raft_consensus.cc:493] T e35f477c83c04eb089f4ccd3042dd99c P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.458856  4772 raft_consensus.cc:515] T e35f477c83c04eb089f4ccd3042dd99c P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.460950  4772 leader_election.cc:290] T e35f477c83c04eb089f4ccd3042dd99c P a754210d0a2b403184f611fd5864442b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c66b12e0a1cc44b58565da795b7a4b8e (127.3.212.129:37153), 0d5eb6a44dd24ba196d9026aec41ff61 (127.3.212.130:34847)
I20260709 12:12:16.462960  4766 ts_tablet_manager.cc:1434] T 62d99d5944b14dca82789362b6d798ce P a754210d0a2b403184f611fd5864442b: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 12:12:16.464008  4766 tablet_bootstrap.cc:492] T a6a637307cbc440eb70af83b47cc78b0 P a754210d0a2b403184f611fd5864442b: Bootstrap starting.
I20260709 12:12:16.466594  4765 tablet_bootstrap.cc:492] T 559fa0760acb4538bfce94dc6cc9e553 P 0d5eb6a44dd24ba196d9026aec41ff61: No bootstrap required, opened a new log
I20260709 12:12:16.467082  4765 ts_tablet_manager.cc:1403] T 559fa0760acb4538bfce94dc6cc9e553 P 0d5eb6a44dd24ba196d9026aec41ff61: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.006s
I20260709 12:12:16.467779  4768 tablet_bootstrap.cc:654] T a6a637307cbc440eb70af83b47cc78b0 P c66b12e0a1cc44b58565da795b7a4b8e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.468405  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "643771d1f41240b5a002a62fdaa0b0d0" candidate_uuid: "a754210d0a2b403184f611fd5864442b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" is_pre_election: true
I20260709 12:12:16.470439  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35f477c83c04eb089f4ccd3042dd99c" candidate_uuid: "a754210d0a2b403184f611fd5864442b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" is_pre_election: true
I20260709 12:12:16.470170  4765 raft_consensus.cc:359] T 559fa0760acb4538bfce94dc6cc9e553 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.471025  4765 raft_consensus.cc:385] T 559fa0760acb4538bfce94dc6cc9e553 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.471067  4577 raft_consensus.cc:2468] T e35f477c83c04eb089f4ccd3042dd99c P c66b12e0a1cc44b58565da795b7a4b8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a754210d0a2b403184f611fd5864442b in term 0.
I20260709 12:12:16.471469  4765 raft_consensus.cc:740] T 559fa0760acb4538bfce94dc6cc9e553 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d5eb6a44dd24ba196d9026aec41ff61, State: Initialized, Role: FOLLOWER
W20260709 12:12:16.472584  4689 leader_election.cc:343] T 643771d1f41240b5a002a62fdaa0b0d0 P a754210d0a2b403184f611fd5864442b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c66b12e0a1cc44b58565da795b7a4b8e (127.3.212.129:37153): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:16.472417  4765 consensus_queue.cc:260] T 559fa0760acb4538bfce94dc6cc9e553 P 0d5eb6a44dd24ba196d9026aec41ff61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.473537  4689 leader_election.cc:304] T e35f477c83c04eb089f4ccd3042dd99c P a754210d0a2b403184f611fd5864442b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a754210d0a2b403184f611fd5864442b, c66b12e0a1cc44b58565da795b7a4b8e; no voters: 
I20260709 12:12:16.474283  4766 tablet_bootstrap.cc:654] T a6a637307cbc440eb70af83b47cc78b0 P a754210d0a2b403184f611fd5864442b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.475140  4765 ts_tablet_manager.cc:1434] T 559fa0760acb4538bfce94dc6cc9e553 P 0d5eb6a44dd24ba196d9026aec41ff61: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:12:16.476102  4770 raft_consensus.cc:493] T c3035351b7444712b999d435424960d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.476565  4770 raft_consensus.cc:515] T c3035351b7444712b999d435424960d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } } peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } }
I20260709 12:12:16.478794  4770 leader_election.cc:290] T c3035351b7444712b999d435424960d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a754210d0a2b403184f611fd5864442b (127.3.212.131:37739), c66b12e0a1cc44b58565da795b7a4b8e (127.3.212.129:37153)
I20260709 12:12:16.479633  4772 raft_consensus.cc:2804] T e35f477c83c04eb089f4ccd3042dd99c P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:16.479751  4765 tablet_bootstrap.cc:492] T 0c7d085ac21245e2a3de979566582db6 P 0d5eb6a44dd24ba196d9026aec41ff61: Bootstrap starting.
I20260709 12:12:16.480067  4772 raft_consensus.cc:493] T e35f477c83c04eb089f4ccd3042dd99c P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:16.480448  4772 raft_consensus.cc:3060] T e35f477c83c04eb089f4ccd3042dd99c P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.479931  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3035351b7444712b999d435424960d0" candidate_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" is_pre_election: true
I20260709 12:12:16.485723  4577 raft_consensus.cc:2468] T c3035351b7444712b999d435424960d0 P c66b12e0a1cc44b58565da795b7a4b8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d5eb6a44dd24ba196d9026aec41ff61 in term 0.
I20260709 12:12:16.486634  4765 tablet_bootstrap.cc:654] T 0c7d085ac21245e2a3de979566582db6 P 0d5eb6a44dd24ba196d9026aec41ff61: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.487095  4615 leader_election.cc:304] T c3035351b7444712b999d435424960d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d5eb6a44dd24ba196d9026aec41ff61, c66b12e0a1cc44b58565da795b7a4b8e; no voters: 
I20260709 12:12:16.487380  4726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3035351b7444712b999d435424960d0" candidate_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a754210d0a2b403184f611fd5864442b" is_pre_election: true
I20260709 12:12:16.487955  4770 raft_consensus.cc:2804] T c3035351b7444712b999d435424960d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:16.488302  4770 raft_consensus.cc:493] T c3035351b7444712b999d435424960d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:16.488638  4770 raft_consensus.cc:3060] T c3035351b7444712b999d435424960d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.489883  4652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "643771d1f41240b5a002a62fdaa0b0d0" candidate_uuid: "a754210d0a2b403184f611fd5864442b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" is_pre_election: true
I20260709 12:12:16.492398  4652 raft_consensus.cc:2468] T 643771d1f41240b5a002a62fdaa0b0d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a754210d0a2b403184f611fd5864442b in term 0.
I20260709 12:12:16.492520  4766 tablet_bootstrap.cc:492] T a6a637307cbc440eb70af83b47cc78b0 P a754210d0a2b403184f611fd5864442b: No bootstrap required, opened a new log
I20260709 12:12:16.493130  4766 ts_tablet_manager.cc:1403] T a6a637307cbc440eb70af83b47cc78b0 P a754210d0a2b403184f611fd5864442b: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.002s
W20260709 12:12:16.493667  4615 leader_election.cc:343] T c3035351b7444712b999d435424960d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a754210d0a2b403184f611fd5864442b (127.3.212.131:37739): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:16.493808  4689 leader_election.cc:304] T 643771d1f41240b5a002a62fdaa0b0d0 P a754210d0a2b403184f611fd5864442b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d5eb6a44dd24ba196d9026aec41ff61, a754210d0a2b403184f611fd5864442b; no voters: c66b12e0a1cc44b58565da795b7a4b8e
I20260709 12:12:16.495447  4776 raft_consensus.cc:493] T 978105aee434435f91eb9b3ddda005c4 P c66b12e0a1cc44b58565da795b7a4b8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.490363  4651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35f477c83c04eb089f4ccd3042dd99c" candidate_uuid: "a754210d0a2b403184f611fd5864442b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" is_pre_election: true
I20260709 12:12:16.496075  4776 raft_consensus.cc:515] T 978105aee434435f91eb9b3ddda005c4 P c66b12e0a1cc44b58565da795b7a4b8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.497056  4768 tablet_bootstrap.cc:492] T a6a637307cbc440eb70af83b47cc78b0 P c66b12e0a1cc44b58565da795b7a4b8e: No bootstrap required, opened a new log
I20260709 12:12:16.497612  4768 ts_tablet_manager.cc:1403] T a6a637307cbc440eb70af83b47cc78b0 P c66b12e0a1cc44b58565da795b7a4b8e: Time spent bootstrapping tablet: real 0.055s	user 0.011s	sys 0.010s
I20260709 12:12:16.498780  4776 leader_election.cc:290] T 978105aee434435f91eb9b3ddda005c4 P c66b12e0a1cc44b58565da795b7a4b8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d5eb6a44dd24ba196d9026aec41ff61 (127.3.212.130:34847), a754210d0a2b403184f611fd5864442b (127.3.212.131:37739)
I20260709 12:12:16.500674  4768 raft_consensus.cc:359] T a6a637307cbc440eb70af83b47cc78b0 P c66b12e0a1cc44b58565da795b7a4b8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.501507  4768 raft_consensus.cc:385] T a6a637307cbc440eb70af83b47cc78b0 P c66b12e0a1cc44b58565da795b7a4b8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.501820  4768 raft_consensus.cc:740] T a6a637307cbc440eb70af83b47cc78b0 P c66b12e0a1cc44b58565da795b7a4b8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c66b12e0a1cc44b58565da795b7a4b8e, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.503952  4766 raft_consensus.cc:359] T a6a637307cbc440eb70af83b47cc78b0 P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.504786  4766 raft_consensus.cc:385] T a6a637307cbc440eb70af83b47cc78b0 P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.505071  4791 raft_consensus.cc:2804] T 643771d1f41240b5a002a62fdaa0b0d0 P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:16.495436  4772 raft_consensus.cc:515] T e35f477c83c04eb089f4ccd3042dd99c P a754210d0a2b403184f611fd5864442b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.505532  4768 consensus_queue.cc:260] T a6a637307cbc440eb70af83b47cc78b0 P c66b12e0a1cc44b58565da795b7a4b8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
W20260709 12:12:16.506614  4689 leader_election.cc:343] T e35f477c83c04eb089f4ccd3042dd99c P a754210d0a2b403184f611fd5864442b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d5eb6a44dd24ba196d9026aec41ff61 (127.3.212.130:34847): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:16.504259  4770 raft_consensus.cc:515] T c3035351b7444712b999d435424960d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } } peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } }
I20260709 12:12:16.505204  4766 raft_consensus.cc:740] T a6a637307cbc440eb70af83b47cc78b0 P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a754210d0a2b403184f611fd5864442b, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.505513  4791 raft_consensus.cc:493] T 643771d1f41240b5a002a62fdaa0b0d0 P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:16.509243  4651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35f477c83c04eb089f4ccd3042dd99c" candidate_uuid: "a754210d0a2b403184f611fd5864442b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d5eb6a44dd24ba196d9026aec41ff61"
I20260709 12:12:16.509541  4791 raft_consensus.cc:3060] T 643771d1f41240b5a002a62fdaa0b0d0 P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.509210  4766 consensus_queue.cc:260] T a6a637307cbc440eb70af83b47cc78b0 P a754210d0a2b403184f611fd5864442b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.511256  4770 leader_election.cc:290] T c3035351b7444712b999d435424960d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [CANDIDATE]: Term 1 election: Requested vote from peers a754210d0a2b403184f611fd5864442b (127.3.212.131:37739), c66b12e0a1cc44b58565da795b7a4b8e (127.3.212.129:37153)
I20260709 12:12:16.508276  4768 ts_tablet_manager.cc:1434] T a6a637307cbc440eb70af83b47cc78b0 P c66b12e0a1cc44b58565da795b7a4b8e: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
W20260709 12:12:16.511722  4689 leader_election.cc:343] T e35f477c83c04eb089f4ccd3042dd99c P a754210d0a2b403184f611fd5864442b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0d5eb6a44dd24ba196d9026aec41ff61 (127.3.212.130:34847): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:16.513015  4768 tablet_bootstrap.cc:492] T 643771d1f41240b5a002a62fdaa0b0d0 P c66b12e0a1cc44b58565da795b7a4b8e: Bootstrap starting.
I20260709 12:12:16.508173  4772 leader_election.cc:290] T e35f477c83c04eb089f4ccd3042dd99c P a754210d0a2b403184f611fd5864442b [CANDIDATE]: Term 1 election: Requested vote from peers c66b12e0a1cc44b58565da795b7a4b8e (127.3.212.129:37153), 0d5eb6a44dd24ba196d9026aec41ff61 (127.3.212.130:34847)
I20260709 12:12:16.513247  4726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3035351b7444712b999d435424960d0" candidate_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a754210d0a2b403184f611fd5864442b"
W20260709 12:12:16.514698  4615 leader_election.cc:343] T c3035351b7444712b999d435424960d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a754210d0a2b403184f611fd5864442b (127.3.212.131:37739): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:16.527127  4791 raft_consensus.cc:515] T 643771d1f41240b5a002a62fdaa0b0d0 P a754210d0a2b403184f611fd5864442b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.527931  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3035351b7444712b999d435424960d0" candidate_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c66b12e0a1cc44b58565da795b7a4b8e"
I20260709 12:12:16.528508  4577 raft_consensus.cc:3060] T c3035351b7444712b999d435424960d0 P c66b12e0a1cc44b58565da795b7a4b8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.532116  4791 leader_election.cc:290] T 643771d1f41240b5a002a62fdaa0b0d0 P a754210d0a2b403184f611fd5864442b [CANDIDATE]: Term 1 election: Requested vote from peers c66b12e0a1cc44b58565da795b7a4b8e (127.3.212.129:37153), 0d5eb6a44dd24ba196d9026aec41ff61 (127.3.212.130:34847)
I20260709 12:12:16.533689  4765 tablet_bootstrap.cc:492] T 0c7d085ac21245e2a3de979566582db6 P 0d5eb6a44dd24ba196d9026aec41ff61: No bootstrap required, opened a new log
I20260709 12:12:16.533857  4651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "643771d1f41240b5a002a62fdaa0b0d0" candidate_uuid: "a754210d0a2b403184f611fd5864442b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d5eb6a44dd24ba196d9026aec41ff61"
I20260709 12:12:16.534279  4765 ts_tablet_manager.cc:1403] T 0c7d085ac21245e2a3de979566582db6 P 0d5eb6a44dd24ba196d9026aec41ff61: Time spent bootstrapping tablet: real 0.055s	user 0.015s	sys 0.003s
I20260709 12:12:16.534518  4651 raft_consensus.cc:3060] T 643771d1f41240b5a002a62fdaa0b0d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.537993  4577 raft_consensus.cc:2468] T c3035351b7444712b999d435424960d0 P c66b12e0a1cc44b58565da795b7a4b8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d5eb6a44dd24ba196d9026aec41ff61 in term 1.
I20260709 12:12:16.545321  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35f477c83c04eb089f4ccd3042dd99c" candidate_uuid: "a754210d0a2b403184f611fd5864442b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c66b12e0a1cc44b58565da795b7a4b8e"
I20260709 12:12:16.546070  4576 raft_consensus.cc:3060] T e35f477c83c04eb089f4ccd3042dd99c P c66b12e0a1cc44b58565da795b7a4b8e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:16.546196  4523 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:16.546353  4615 leader_election.cc:304] T c3035351b7444712b999d435424960d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d5eb6a44dd24ba196d9026aec41ff61, c66b12e0a1cc44b58565da795b7a4b8e; no voters: a754210d0a2b403184f611fd5864442b
I20260709 12:12:16.547199  4770 raft_consensus.cc:2804] T c3035351b7444712b999d435424960d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:16.547657  4770 raft_consensus.cc:697] T c3035351b7444712b999d435424960d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 1 LEADER]: Becoming Leader. State: Replica: 0d5eb6a44dd24ba196d9026aec41ff61, State: Running, Role: LEADER
I20260709 12:12:16.548486  4770 consensus_queue.cc:237] T c3035351b7444712b999d435424960d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } } peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } }
I20260709 12:12:16.549927  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "643771d1f41240b5a002a62fdaa0b0d0" candidate_uuid: "a754210d0a2b403184f611fd5864442b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c66b12e0a1cc44b58565da795b7a4b8e"
I20260709 12:12:16.542320  4768 tablet_bootstrap.cc:654] T 643771d1f41240b5a002a62fdaa0b0d0 P c66b12e0a1cc44b58565da795b7a4b8e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.542045  4651 raft_consensus.cc:2468] T 643771d1f41240b5a002a62fdaa0b0d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a754210d0a2b403184f611fd5864442b in term 1.
I20260709 12:12:16.553488  4689 leader_election.cc:304] T 643771d1f41240b5a002a62fdaa0b0d0 P a754210d0a2b403184f611fd5864442b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d5eb6a44dd24ba196d9026aec41ff61, a754210d0a2b403184f611fd5864442b; no voters: 
W20260709 12:12:16.554512  4689 leader_election.cc:343] T 643771d1f41240b5a002a62fdaa0b0d0 P a754210d0a2b403184f611fd5864442b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c66b12e0a1cc44b58565da795b7a4b8e (127.3.212.129:37153): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:16.543409  4766 ts_tablet_manager.cc:1434] T a6a637307cbc440eb70af83b47cc78b0 P a754210d0a2b403184f611fd5864442b: Time spent starting tablet: real 0.050s	user 0.002s	sys 0.028s
I20260709 12:12:16.555575  4793 raft_consensus.cc:2804] T 643771d1f41240b5a002a62fdaa0b0d0 P a754210d0a2b403184f611fd5864442b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:16.556325  4793 raft_consensus.cc:697] T 643771d1f41240b5a002a62fdaa0b0d0 P a754210d0a2b403184f611fd5864442b [term 1 LEADER]: Becoming Leader. State: Replica: a754210d0a2b403184f611fd5864442b, State: Running, Role: LEADER
I20260709 12:12:16.556746  4766 tablet_bootstrap.cc:492] T 239da9ff3cf24b88a55a845f2978db90 P a754210d0a2b403184f611fd5864442b: Bootstrap starting.
I20260709 12:12:16.557139  4793 consensus_queue.cc:237] T 643771d1f41240b5a002a62fdaa0b0d0 P a754210d0a2b403184f611fd5864442b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.560443  4576 raft_consensus.cc:2468] T e35f477c83c04eb089f4ccd3042dd99c P c66b12e0a1cc44b58565da795b7a4b8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a754210d0a2b403184f611fd5864442b in term 1.
I20260709 12:12:16.537674  4765 raft_consensus.cc:359] T 0c7d085ac21245e2a3de979566582db6 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.561568  4765 raft_consensus.cc:385] T 0c7d085ac21245e2a3de979566582db6 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.561728  4689 leader_election.cc:304] T e35f477c83c04eb089f4ccd3042dd99c P a754210d0a2b403184f611fd5864442b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a754210d0a2b403184f611fd5864442b, c66b12e0a1cc44b58565da795b7a4b8e; no voters: 0d5eb6a44dd24ba196d9026aec41ff61
I20260709 12:12:16.562731  4772 raft_consensus.cc:2804] T e35f477c83c04eb089f4ccd3042dd99c P a754210d0a2b403184f611fd5864442b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:16.563179  4772 raft_consensus.cc:697] T e35f477c83c04eb089f4ccd3042dd99c P a754210d0a2b403184f611fd5864442b [term 1 LEADER]: Becoming Leader. State: Replica: a754210d0a2b403184f611fd5864442b, State: Running, Role: LEADER
I20260709 12:12:16.564144  4772 consensus_queue.cc:237] T e35f477c83c04eb089f4ccd3042dd99c P a754210d0a2b403184f611fd5864442b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.561949  4765 raft_consensus.cc:740] T 0c7d085ac21245e2a3de979566582db6 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d5eb6a44dd24ba196d9026aec41ff61, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.568598  4765 consensus_queue.cc:260] T 0c7d085ac21245e2a3de979566582db6 P 0d5eb6a44dd24ba196d9026aec41ff61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.569984  4651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978105aee434435f91eb9b3ddda005c4" candidate_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" is_pre_election: true
I20260709 12:12:16.571368  4765 ts_tablet_manager.cc:1434] T 0c7d085ac21245e2a3de979566582db6 P 0d5eb6a44dd24ba196d9026aec41ff61: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 12:12:16.572655  4778 raft_consensus.cc:493] T 62d99d5944b14dca82789362b6d798ce P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.573553  4766 tablet_bootstrap.cc:654] T 239da9ff3cf24b88a55a845f2978db90 P a754210d0a2b403184f611fd5864442b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.573150  4778 raft_consensus.cc:515] T 62d99d5944b14dca82789362b6d798ce P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.576512  4778 leader_election.cc:290] T 62d99d5944b14dca82789362b6d798ce P 0d5eb6a44dd24ba196d9026aec41ff61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c66b12e0a1cc44b58565da795b7a4b8e (127.3.212.129:37153), a754210d0a2b403184f611fd5864442b (127.3.212.131:37739)
I20260709 12:12:16.576836  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d99d5944b14dca82789362b6d798ce" candidate_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" is_pre_election: true
I20260709 12:12:16.577668  4726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d99d5944b14dca82789362b6d798ce" candidate_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a754210d0a2b403184f611fd5864442b" is_pre_election: true
I20260709 12:12:16.578274  4726 raft_consensus.cc:2468] T 62d99d5944b14dca82789362b6d798ce P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d5eb6a44dd24ba196d9026aec41ff61 in term 0.
W20260709 12:12:16.578344  4615 leader_election.cc:343] T 62d99d5944b14dca82789362b6d798ce P 0d5eb6a44dd24ba196d9026aec41ff61 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c66b12e0a1cc44b58565da795b7a4b8e (127.3.212.129:37153): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:16.578774  4768 tablet_bootstrap.cc:492] T 643771d1f41240b5a002a62fdaa0b0d0 P c66b12e0a1cc44b58565da795b7a4b8e: No bootstrap required, opened a new log
I20260709 12:12:16.579264  4768 ts_tablet_manager.cc:1403] T 643771d1f41240b5a002a62fdaa0b0d0 P c66b12e0a1cc44b58565da795b7a4b8e: Time spent bootstrapping tablet: real 0.066s	user 0.020s	sys 0.011s
I20260709 12:12:16.579398  4615 leader_election.cc:304] T 62d99d5944b14dca82789362b6d798ce P 0d5eb6a44dd24ba196d9026aec41ff61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d5eb6a44dd24ba196d9026aec41ff61, a754210d0a2b403184f611fd5864442b; no voters: c66b12e0a1cc44b58565da795b7a4b8e
I20260709 12:12:16.580447  4778 raft_consensus.cc:2804] T 62d99d5944b14dca82789362b6d798ce P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:16.580833  4765 tablet_bootstrap.cc:492] T e35f477c83c04eb089f4ccd3042dd99c P 0d5eb6a44dd24ba196d9026aec41ff61: Bootstrap starting.
I20260709 12:12:16.582000  4768 raft_consensus.cc:359] T 643771d1f41240b5a002a62fdaa0b0d0 P c66b12e0a1cc44b58565da795b7a4b8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.582770  4768 raft_consensus.cc:385] T 643771d1f41240b5a002a62fdaa0b0d0 P c66b12e0a1cc44b58565da795b7a4b8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.580806  4778 raft_consensus.cc:493] T 62d99d5944b14dca82789362b6d798ce P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:16.582345  4474 catalog_manager.cc:5697] T c3035351b7444712b999d435424960d0 P 0d5eb6a44dd24ba196d9026aec41ff61 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d5eb6a44dd24ba196d9026aec41ff61 (127.3.212.130). New cstate: current_term: 1 leader_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:16.583043  4726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978105aee434435f91eb9b3ddda005c4" candidate_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a754210d0a2b403184f611fd5864442b" is_pre_election: true
I20260709 12:12:16.583995  4726 raft_consensus.cc:2393] T 978105aee434435f91eb9b3ddda005c4 P a754210d0a2b403184f611fd5864442b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c66b12e0a1cc44b58565da795b7a4b8e in current term 1: Already voted for candidate 0d5eb6a44dd24ba196d9026aec41ff61 in this term.
I20260709 12:12:16.585173  4540 leader_election.cc:304] T 978105aee434435f91eb9b3ddda005c4 P c66b12e0a1cc44b58565da795b7a4b8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c66b12e0a1cc44b58565da795b7a4b8e; no voters: 0d5eb6a44dd24ba196d9026aec41ff61, a754210d0a2b403184f611fd5864442b
I20260709 12:12:16.583077  4768 raft_consensus.cc:740] T 643771d1f41240b5a002a62fdaa0b0d0 P c66b12e0a1cc44b58565da795b7a4b8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c66b12e0a1cc44b58565da795b7a4b8e, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.586277  4776 raft_consensus.cc:3060] T 978105aee434435f91eb9b3ddda005c4 P c66b12e0a1cc44b58565da795b7a4b8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.587404  4768 consensus_queue.cc:260] T 643771d1f41240b5a002a62fdaa0b0d0 P c66b12e0a1cc44b58565da795b7a4b8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.590929  4765 tablet_bootstrap.cc:654] T e35f477c83c04eb089f4ccd3042dd99c P 0d5eb6a44dd24ba196d9026aec41ff61: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.593423  4766 tablet_bootstrap.cc:492] T 239da9ff3cf24b88a55a845f2978db90 P a754210d0a2b403184f611fd5864442b: No bootstrap required, opened a new log
I20260709 12:12:16.593919  4766 ts_tablet_manager.cc:1403] T 239da9ff3cf24b88a55a845f2978db90 P a754210d0a2b403184f611fd5864442b: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.003s
I20260709 12:12:16.594058  4778 raft_consensus.cc:3060] T 62d99d5944b14dca82789362b6d798ce P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.596505  4768 ts_tablet_manager.cc:1434] T 643771d1f41240b5a002a62fdaa0b0d0 P c66b12e0a1cc44b58565da795b7a4b8e: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 12:12:16.593943  4776 raft_consensus.cc:2749] T 978105aee434435f91eb9b3ddda005c4 P c66b12e0a1cc44b58565da795b7a4b8e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:16.601591  4766 raft_consensus.cc:359] T 239da9ff3cf24b88a55a845f2978db90 P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.602385  4766 raft_consensus.cc:385] T 239da9ff3cf24b88a55a845f2978db90 P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.602725  4766 raft_consensus.cc:740] T 239da9ff3cf24b88a55a845f2978db90 P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a754210d0a2b403184f611fd5864442b, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.602501  4778 raft_consensus.cc:515] T 62d99d5944b14dca82789362b6d798ce P 0d5eb6a44dd24ba196d9026aec41ff61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.604054  4768 tablet_bootstrap.cc:492] T 559fa0760acb4538bfce94dc6cc9e553 P c66b12e0a1cc44b58565da795b7a4b8e: Bootstrap starting.
I20260709 12:12:16.605634  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d99d5944b14dca82789362b6d798ce" candidate_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c66b12e0a1cc44b58565da795b7a4b8e"
W20260709 12:12:16.607158  4615 leader_election.cc:343] T 62d99d5944b14dca82789362b6d798ce P 0d5eb6a44dd24ba196d9026aec41ff61 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c66b12e0a1cc44b58565da795b7a4b8e (127.3.212.129:37153): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:16.609490  4726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d99d5944b14dca82789362b6d798ce" candidate_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a754210d0a2b403184f611fd5864442b"
I20260709 12:12:16.610136  4726 raft_consensus.cc:3060] T 62d99d5944b14dca82789362b6d798ce P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.610255  4766 consensus_queue.cc:260] T 239da9ff3cf24b88a55a845f2978db90 P a754210d0a2b403184f611fd5864442b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.612864  4766 ts_tablet_manager.cc:1434] T 239da9ff3cf24b88a55a845f2978db90 P a754210d0a2b403184f611fd5864442b: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:12:16.613914  4766 tablet_bootstrap.cc:492] T 559fa0760acb4538bfce94dc6cc9e553 P a754210d0a2b403184f611fd5864442b: Bootstrap starting.
I20260709 12:12:16.615231  4772 raft_consensus.cc:493] T a6a637307cbc440eb70af83b47cc78b0 P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.615818  4772 raft_consensus.cc:515] T a6a637307cbc440eb70af83b47cc78b0 P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.618101  4772 leader_election.cc:290] T a6a637307cbc440eb70af83b47cc78b0 P a754210d0a2b403184f611fd5864442b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c66b12e0a1cc44b58565da795b7a4b8e (127.3.212.129:37153), 0d5eb6a44dd24ba196d9026aec41ff61 (127.3.212.130:34847)
I20260709 12:12:16.619185  4768 tablet_bootstrap.cc:654] T 559fa0760acb4538bfce94dc6cc9e553 P c66b12e0a1cc44b58565da795b7a4b8e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.619266  4651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a637307cbc440eb70af83b47cc78b0" candidate_uuid: "a754210d0a2b403184f611fd5864442b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" is_pre_election: true
I20260709 12:12:16.619644  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a637307cbc440eb70af83b47cc78b0" candidate_uuid: "a754210d0a2b403184f611fd5864442b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" is_pre_election: true
I20260709 12:12:16.620332  4576 raft_consensus.cc:2468] T a6a637307cbc440eb70af83b47cc78b0 P c66b12e0a1cc44b58565da795b7a4b8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a754210d0a2b403184f611fd5864442b in term 0.
W20260709 12:12:16.620940  4689 leader_election.cc:343] T a6a637307cbc440eb70af83b47cc78b0 P a754210d0a2b403184f611fd5864442b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d5eb6a44dd24ba196d9026aec41ff61 (127.3.212.130:34847): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:16.617497  4726 raft_consensus.cc:2468] T 62d99d5944b14dca82789362b6d798ce P a754210d0a2b403184f611fd5864442b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d5eb6a44dd24ba196d9026aec41ff61 in term 1.
I20260709 12:12:16.621702  4689 leader_election.cc:304] T a6a637307cbc440eb70af83b47cc78b0 P a754210d0a2b403184f611fd5864442b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a754210d0a2b403184f611fd5864442b, c66b12e0a1cc44b58565da795b7a4b8e; no voters: 0d5eb6a44dd24ba196d9026aec41ff61
I20260709 12:12:16.623149  4772 raft_consensus.cc:2804] T a6a637307cbc440eb70af83b47cc78b0 P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:16.623127  4615 leader_election.cc:304] T 62d99d5944b14dca82789362b6d798ce P 0d5eb6a44dd24ba196d9026aec41ff61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d5eb6a44dd24ba196d9026aec41ff61, a754210d0a2b403184f611fd5864442b; no voters: c66b12e0a1cc44b58565da795b7a4b8e
I20260709 12:12:16.623471  4766 tablet_bootstrap.cc:654] T 559fa0760acb4538bfce94dc6cc9e553 P a754210d0a2b403184f611fd5864442b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.623667  4772 raft_consensus.cc:493] T a6a637307cbc440eb70af83b47cc78b0 P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:16.624050  4772 raft_consensus.cc:3060] T a6a637307cbc440eb70af83b47cc78b0 P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.624512  4770 raft_consensus.cc:2804] T 62d99d5944b14dca82789362b6d798ce P 0d5eb6a44dd24ba196d9026aec41ff61 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:16.625176  4778 leader_election.cc:290] T 62d99d5944b14dca82789362b6d798ce P 0d5eb6a44dd24ba196d9026aec41ff61 [CANDIDATE]: Term 1 election: Requested vote from peers c66b12e0a1cc44b58565da795b7a4b8e (127.3.212.129:37153), a754210d0a2b403184f611fd5864442b (127.3.212.131:37739)
I20260709 12:12:16.631791  4770 raft_consensus.cc:697] T 62d99d5944b14dca82789362b6d798ce P 0d5eb6a44dd24ba196d9026aec41ff61 [term 1 LEADER]: Becoming Leader. State: Replica: 0d5eb6a44dd24ba196d9026aec41ff61, State: Running, Role: LEADER
I20260709 12:12:16.635052  4765 tablet_bootstrap.cc:492] T e35f477c83c04eb089f4ccd3042dd99c P 0d5eb6a44dd24ba196d9026aec41ff61: No bootstrap required, opened a new log
I20260709 12:12:16.635949  4765 ts_tablet_manager.cc:1403] T e35f477c83c04eb089f4ccd3042dd99c P 0d5eb6a44dd24ba196d9026aec41ff61: Time spent bootstrapping tablet: real 0.064s	user 0.019s	sys 0.004s
I20260709 12:12:16.635164  4474 catalog_manager.cc:5697] T 643771d1f41240b5a002a62fdaa0b0d0 P a754210d0a2b403184f611fd5864442b reported cstate change: term changed from 0 to 1, leader changed from <none> to a754210d0a2b403184f611fd5864442b (127.3.212.131). New cstate: current_term: 1 leader_uuid: "a754210d0a2b403184f611fd5864442b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:16.638653  4765 raft_consensus.cc:359] T e35f477c83c04eb089f4ccd3042dd99c P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.639541  4765 raft_consensus.cc:385] T e35f477c83c04eb089f4ccd3042dd99c P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.640110  4768 tablet_bootstrap.cc:492] T 559fa0760acb4538bfce94dc6cc9e553 P c66b12e0a1cc44b58565da795b7a4b8e: No bootstrap required, opened a new log
I20260709 12:12:16.639869  4770 consensus_queue.cc:237] T 62d99d5944b14dca82789362b6d798ce P 0d5eb6a44dd24ba196d9026aec41ff61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.640770  4768 ts_tablet_manager.cc:1403] T 559fa0760acb4538bfce94dc6cc9e553 P c66b12e0a1cc44b58565da795b7a4b8e: Time spent bootstrapping tablet: real 0.037s	user 0.014s	sys 0.011s
I20260709 12:12:16.642256  4772 raft_consensus.cc:515] T a6a637307cbc440eb70af83b47cc78b0 P a754210d0a2b403184f611fd5864442b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.643806  4768 raft_consensus.cc:359] T 559fa0760acb4538bfce94dc6cc9e553 P c66b12e0a1cc44b58565da795b7a4b8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.644134  4772 leader_election.cc:290] T a6a637307cbc440eb70af83b47cc78b0 P a754210d0a2b403184f611fd5864442b [CANDIDATE]: Term 1 election: Requested vote from peers c66b12e0a1cc44b58565da795b7a4b8e (127.3.212.129:37153), 0d5eb6a44dd24ba196d9026aec41ff61 (127.3.212.130:34847)
I20260709 12:12:16.644694  4768 raft_consensus.cc:385] T 559fa0760acb4538bfce94dc6cc9e553 P c66b12e0a1cc44b58565da795b7a4b8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.645022  4768 raft_consensus.cc:740] T 559fa0760acb4538bfce94dc6cc9e553 P c66b12e0a1cc44b58565da795b7a4b8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c66b12e0a1cc44b58565da795b7a4b8e, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.645684  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a637307cbc440eb70af83b47cc78b0" candidate_uuid: "a754210d0a2b403184f611fd5864442b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c66b12e0a1cc44b58565da795b7a4b8e"
I20260709 12:12:16.646260  4576 raft_consensus.cc:3060] T a6a637307cbc440eb70af83b47cc78b0 P c66b12e0a1cc44b58565da795b7a4b8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.639954  4765 raft_consensus.cc:740] T e35f477c83c04eb089f4ccd3042dd99c P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d5eb6a44dd24ba196d9026aec41ff61, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.648216  4768 consensus_queue.cc:260] T 559fa0760acb4538bfce94dc6cc9e553 P c66b12e0a1cc44b58565da795b7a4b8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.648697  4765 consensus_queue.cc:260] T e35f477c83c04eb089f4ccd3042dd99c P 0d5eb6a44dd24ba196d9026aec41ff61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.650873  4768 ts_tablet_manager.cc:1434] T 559fa0760acb4538bfce94dc6cc9e553 P c66b12e0a1cc44b58565da795b7a4b8e: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:12:16.651897  4768 tablet_bootstrap.cc:492] T 2993ac2125df4c1696029a2d0663531a P c66b12e0a1cc44b58565da795b7a4b8e: Bootstrap starting.
I20260709 12:12:16.652114  4765 ts_tablet_manager.cc:1434] T e35f477c83c04eb089f4ccd3042dd99c P 0d5eb6a44dd24ba196d9026aec41ff61: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:12:16.647876  4651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a637307cbc440eb70af83b47cc78b0" candidate_uuid: "a754210d0a2b403184f611fd5864442b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d5eb6a44dd24ba196d9026aec41ff61"
W20260709 12:12:16.654359  4689 leader_election.cc:343] T a6a637307cbc440eb70af83b47cc78b0 P a754210d0a2b403184f611fd5864442b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0d5eb6a44dd24ba196d9026aec41ff61 (127.3.212.130:34847): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:16.647826  4766 tablet_bootstrap.cc:492] T 559fa0760acb4538bfce94dc6cc9e553 P a754210d0a2b403184f611fd5864442b: No bootstrap required, opened a new log
I20260709 12:12:16.655197  4766 ts_tablet_manager.cc:1403] T 559fa0760acb4538bfce94dc6cc9e553 P a754210d0a2b403184f611fd5864442b: Time spent bootstrapping tablet: real 0.041s	user 0.007s	sys 0.005s
I20260709 12:12:16.653015  4765 tablet_bootstrap.cc:492] T a6a637307cbc440eb70af83b47cc78b0 P 0d5eb6a44dd24ba196d9026aec41ff61: Bootstrap starting.
I20260709 12:12:16.657120  4576 raft_consensus.cc:2468] T a6a637307cbc440eb70af83b47cc78b0 P c66b12e0a1cc44b58565da795b7a4b8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a754210d0a2b403184f611fd5864442b in term 1.
I20260709 12:12:16.658130  4766 raft_consensus.cc:359] T 559fa0760acb4538bfce94dc6cc9e553 P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.658480  4689 leader_election.cc:304] T a6a637307cbc440eb70af83b47cc78b0 P a754210d0a2b403184f611fd5864442b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a754210d0a2b403184f611fd5864442b, c66b12e0a1cc44b58565da795b7a4b8e; no voters: 0d5eb6a44dd24ba196d9026aec41ff61
I20260709 12:12:16.658941  4766 raft_consensus.cc:385] T 559fa0760acb4538bfce94dc6cc9e553 P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.659277  4766 raft_consensus.cc:740] T 559fa0760acb4538bfce94dc6cc9e553 P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a754210d0a2b403184f611fd5864442b, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.659791  4772 raft_consensus.cc:2804] T a6a637307cbc440eb70af83b47cc78b0 P a754210d0a2b403184f611fd5864442b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:16.660748  4768 tablet_bootstrap.cc:654] T 2993ac2125df4c1696029a2d0663531a P c66b12e0a1cc44b58565da795b7a4b8e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.661120  4772 raft_consensus.cc:697] T a6a637307cbc440eb70af83b47cc78b0 P a754210d0a2b403184f611fd5864442b [term 1 LEADER]: Becoming Leader. State: Replica: a754210d0a2b403184f611fd5864442b, State: Running, Role: LEADER
I20260709 12:12:16.662271  4772 consensus_queue.cc:237] T a6a637307cbc440eb70af83b47cc78b0 P a754210d0a2b403184f611fd5864442b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.660234  4766 consensus_queue.cc:260] T 559fa0760acb4538bfce94dc6cc9e553 P a754210d0a2b403184f611fd5864442b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.673218  4768 tablet_bootstrap.cc:492] T 2993ac2125df4c1696029a2d0663531a P c66b12e0a1cc44b58565da795b7a4b8e: No bootstrap required, opened a new log
I20260709 12:12:16.673756  4768 ts_tablet_manager.cc:1403] T 2993ac2125df4c1696029a2d0663531a P c66b12e0a1cc44b58565da795b7a4b8e: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.004s
I20260709 12:12:16.674722  4766 ts_tablet_manager.cc:1434] T 559fa0760acb4538bfce94dc6cc9e553 P a754210d0a2b403184f611fd5864442b: Time spent starting tablet: real 0.019s	user 0.002s	sys 0.005s
I20260709 12:12:16.674221  4473 catalog_manager.cc:5697] T 62d99d5944b14dca82789362b6d798ce P 0d5eb6a44dd24ba196d9026aec41ff61 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d5eb6a44dd24ba196d9026aec41ff61 (127.3.212.130). New cstate: current_term: 1 leader_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:16.675732  4766 tablet_bootstrap.cc:492] T 2993ac2125df4c1696029a2d0663531a P a754210d0a2b403184f611fd5864442b: Bootstrap starting.
I20260709 12:12:16.676721  4768 raft_consensus.cc:359] T 2993ac2125df4c1696029a2d0663531a P c66b12e0a1cc44b58565da795b7a4b8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.677443  4768 raft_consensus.cc:385] T 2993ac2125df4c1696029a2d0663531a P c66b12e0a1cc44b58565da795b7a4b8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.677731  4768 raft_consensus.cc:740] T 2993ac2125df4c1696029a2d0663531a P c66b12e0a1cc44b58565da795b7a4b8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c66b12e0a1cc44b58565da795b7a4b8e, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.678473  4768 consensus_queue.cc:260] T 2993ac2125df4c1696029a2d0663531a P c66b12e0a1cc44b58565da795b7a4b8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.680770  4768 ts_tablet_manager.cc:1434] T 2993ac2125df4c1696029a2d0663531a P c66b12e0a1cc44b58565da795b7a4b8e: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:12:16.667996  4765 tablet_bootstrap.cc:654] T a6a637307cbc440eb70af83b47cc78b0 P 0d5eb6a44dd24ba196d9026aec41ff61: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.681867  4768 tablet_bootstrap.cc:492] T 239da9ff3cf24b88a55a845f2978db90 P c66b12e0a1cc44b58565da795b7a4b8e: Bootstrap starting.
I20260709 12:12:16.686486  4766 tablet_bootstrap.cc:654] T 2993ac2125df4c1696029a2d0663531a P a754210d0a2b403184f611fd5864442b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.688592  4768 tablet_bootstrap.cc:654] T 239da9ff3cf24b88a55a845f2978db90 P c66b12e0a1cc44b58565da795b7a4b8e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.693643  4474 catalog_manager.cc:5697] T a6a637307cbc440eb70af83b47cc78b0 P a754210d0a2b403184f611fd5864442b reported cstate change: term changed from 0 to 1, leader changed from <none> to a754210d0a2b403184f611fd5864442b (127.3.212.131). New cstate: current_term: 1 leader_uuid: "a754210d0a2b403184f611fd5864442b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:16.694738  4765 tablet_bootstrap.cc:492] T a6a637307cbc440eb70af83b47cc78b0 P 0d5eb6a44dd24ba196d9026aec41ff61: No bootstrap required, opened a new log
I20260709 12:12:16.695400  4765 ts_tablet_manager.cc:1403] T a6a637307cbc440eb70af83b47cc78b0 P 0d5eb6a44dd24ba196d9026aec41ff61: Time spent bootstrapping tablet: real 0.043s	user 0.009s	sys 0.004s
I20260709 12:12:16.695609  4474 catalog_manager.cc:5697] T e35f477c83c04eb089f4ccd3042dd99c P a754210d0a2b403184f611fd5864442b reported cstate change: term changed from 0 to 1, leader changed from <none> to a754210d0a2b403184f611fd5864442b (127.3.212.131). New cstate: current_term: 1 leader_uuid: "a754210d0a2b403184f611fd5864442b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:16.698046  4765 raft_consensus.cc:359] T a6a637307cbc440eb70af83b47cc78b0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.698776  4765 raft_consensus.cc:385] T a6a637307cbc440eb70af83b47cc78b0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.699108  4765 raft_consensus.cc:740] T a6a637307cbc440eb70af83b47cc78b0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d5eb6a44dd24ba196d9026aec41ff61, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.699851  4765 consensus_queue.cc:260] T a6a637307cbc440eb70af83b47cc78b0 P 0d5eb6a44dd24ba196d9026aec41ff61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.702813  4765 ts_tablet_manager.cc:1434] T a6a637307cbc440eb70af83b47cc78b0 P 0d5eb6a44dd24ba196d9026aec41ff61: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:12:16.703764  4765 tablet_bootstrap.cc:492] T 239da9ff3cf24b88a55a845f2978db90 P 0d5eb6a44dd24ba196d9026aec41ff61: Bootstrap starting.
I20260709 12:12:16.707561  4766 tablet_bootstrap.cc:492] T 2993ac2125df4c1696029a2d0663531a P a754210d0a2b403184f611fd5864442b: No bootstrap required, opened a new log
I20260709 12:12:16.708033  4766 ts_tablet_manager.cc:1403] T 2993ac2125df4c1696029a2d0663531a P a754210d0a2b403184f611fd5864442b: Time spent bootstrapping tablet: real 0.032s	user 0.020s	sys 0.003s
I20260709 12:12:16.711534  4768 tablet_bootstrap.cc:492] T 239da9ff3cf24b88a55a845f2978db90 P c66b12e0a1cc44b58565da795b7a4b8e: No bootstrap required, opened a new log
I20260709 12:12:16.710750  4766 raft_consensus.cc:359] T 2993ac2125df4c1696029a2d0663531a P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.712236  4768 ts_tablet_manager.cc:1403] T 239da9ff3cf24b88a55a845f2978db90 P c66b12e0a1cc44b58565da795b7a4b8e: Time spent bootstrapping tablet: real 0.031s	user 0.003s	sys 0.009s
I20260709 12:12:16.709369  4765 tablet_bootstrap.cc:654] T 239da9ff3cf24b88a55a845f2978db90 P 0d5eb6a44dd24ba196d9026aec41ff61: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.715044  4768 raft_consensus.cc:359] T 239da9ff3cf24b88a55a845f2978db90 P c66b12e0a1cc44b58565da795b7a4b8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.715742  4768 raft_consensus.cc:385] T 239da9ff3cf24b88a55a845f2978db90 P c66b12e0a1cc44b58565da795b7a4b8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.716012  4768 raft_consensus.cc:740] T 239da9ff3cf24b88a55a845f2978db90 P c66b12e0a1cc44b58565da795b7a4b8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c66b12e0a1cc44b58565da795b7a4b8e, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.716688  4768 consensus_queue.cc:260] T 239da9ff3cf24b88a55a845f2978db90 P c66b12e0a1cc44b58565da795b7a4b8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.717847  4770 raft_consensus.cc:493] T 2993ac2125df4c1696029a2d0663531a P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.718724  4768 ts_tablet_manager.cc:1434] T 239da9ff3cf24b88a55a845f2978db90 P c66b12e0a1cc44b58565da795b7a4b8e: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:12:16.718386  4770 raft_consensus.cc:515] T 2993ac2125df4c1696029a2d0663531a P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.719659  4768 tablet_bootstrap.cc:492] T 62d99d5944b14dca82789362b6d798ce P c66b12e0a1cc44b58565da795b7a4b8e: Bootstrap starting.
I20260709 12:12:16.720765  4770 leader_election.cc:290] T 2993ac2125df4c1696029a2d0663531a P 0d5eb6a44dd24ba196d9026aec41ff61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c66b12e0a1cc44b58565da795b7a4b8e (127.3.212.129:37153), a754210d0a2b403184f611fd5864442b (127.3.212.131:37739)
I20260709 12:12:16.722163  4766 raft_consensus.cc:385] T 2993ac2125df4c1696029a2d0663531a P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.722468  4766 raft_consensus.cc:740] T 2993ac2125df4c1696029a2d0663531a P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a754210d0a2b403184f611fd5864442b, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.723238  4770 raft_consensus.cc:493] T a6a637307cbc440eb70af83b47cc78b0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.723157  4766 consensus_queue.cc:260] T 2993ac2125df4c1696029a2d0663531a P a754210d0a2b403184f611fd5864442b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.723773  4770 raft_consensus.cc:515] T a6a637307cbc440eb70af83b47cc78b0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.724779  4726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2993ac2125df4c1696029a2d0663531a" candidate_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a754210d0a2b403184f611fd5864442b" is_pre_election: true
I20260709 12:12:16.726838  4770 leader_election.cc:290] T a6a637307cbc440eb70af83b47cc78b0 P 0d5eb6a44dd24ba196d9026aec41ff61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c66b12e0a1cc44b58565da795b7a4b8e (127.3.212.129:37153), a754210d0a2b403184f611fd5864442b (127.3.212.131:37739)
I20260709 12:12:16.727372  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a637307cbc440eb70af83b47cc78b0" candidate_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" is_pre_election: true
I20260709 12:12:16.728137  4768 tablet_bootstrap.cc:654] T 62d99d5944b14dca82789362b6d798ce P c66b12e0a1cc44b58565da795b7a4b8e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.728336  4726 raft_consensus.cc:2468] T 2993ac2125df4c1696029a2d0663531a P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d5eb6a44dd24ba196d9026aec41ff61 in term 0.
I20260709 12:12:16.729883  4615 leader_election.cc:304] T 2993ac2125df4c1696029a2d0663531a P 0d5eb6a44dd24ba196d9026aec41ff61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d5eb6a44dd24ba196d9026aec41ff61, a754210d0a2b403184f611fd5864442b; no voters: 
I20260709 12:12:16.730121  4765 tablet_bootstrap.cc:492] T 239da9ff3cf24b88a55a845f2978db90 P 0d5eb6a44dd24ba196d9026aec41ff61: No bootstrap required, opened a new log
I20260709 12:12:16.730654  4765 ts_tablet_manager.cc:1403] T 239da9ff3cf24b88a55a845f2978db90 P 0d5eb6a44dd24ba196d9026aec41ff61: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.011s
I20260709 12:12:16.730774  4770 raft_consensus.cc:2804] T 2993ac2125df4c1696029a2d0663531a P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:16.731015  4766 ts_tablet_manager.cc:1434] T 2993ac2125df4c1696029a2d0663531a P a754210d0a2b403184f611fd5864442b: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.002s
I20260709 12:12:16.731178  4770 raft_consensus.cc:493] T 2993ac2125df4c1696029a2d0663531a P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:16.731532  4770 raft_consensus.cc:3060] T 2993ac2125df4c1696029a2d0663531a P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.731912  4766 tablet_bootstrap.cc:492] T 0c7d085ac21245e2a3de979566582db6 P a754210d0a2b403184f611fd5864442b: Bootstrap starting.
I20260709 12:12:16.728168  4575 raft_consensus.cc:2393] T a6a637307cbc440eb70af83b47cc78b0 P c66b12e0a1cc44b58565da795b7a4b8e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0d5eb6a44dd24ba196d9026aec41ff61 in current term 1: Already voted for candidate a754210d0a2b403184f611fd5864442b in this term.
I20260709 12:12:16.733564  4765 raft_consensus.cc:359] T 239da9ff3cf24b88a55a845f2978db90 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.734324  4765 raft_consensus.cc:385] T 239da9ff3cf24b88a55a845f2978db90 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.734596  4765 raft_consensus.cc:740] T 239da9ff3cf24b88a55a845f2978db90 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d5eb6a44dd24ba196d9026aec41ff61, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.735172  4726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a637307cbc440eb70af83b47cc78b0" candidate_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a754210d0a2b403184f611fd5864442b" is_pre_election: true
I20260709 12:12:16.735176  4765 consensus_queue.cc:260] T 239da9ff3cf24b88a55a845f2978db90 P 0d5eb6a44dd24ba196d9026aec41ff61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.737566  4615 leader_election.cc:304] T a6a637307cbc440eb70af83b47cc78b0 P 0d5eb6a44dd24ba196d9026aec41ff61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d5eb6a44dd24ba196d9026aec41ff61; no voters: a754210d0a2b403184f611fd5864442b, c66b12e0a1cc44b58565da795b7a4b8e
I20260709 12:12:16.737912  4765 ts_tablet_manager.cc:1434] T 239da9ff3cf24b88a55a845f2978db90 P 0d5eb6a44dd24ba196d9026aec41ff61: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:12:16.738590  4778 raft_consensus.cc:3060] T a6a637307cbc440eb70af83b47cc78b0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.738060  4766 tablet_bootstrap.cc:654] T 0c7d085ac21245e2a3de979566582db6 P a754210d0a2b403184f611fd5864442b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.724316  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2993ac2125df4c1696029a2d0663531a" candidate_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" is_pre_election: true
I20260709 12:12:16.744771  4778 raft_consensus.cc:2749] T a6a637307cbc440eb70af83b47cc78b0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:16.745069  4768 tablet_bootstrap.cc:492] T 62d99d5944b14dca82789362b6d798ce P c66b12e0a1cc44b58565da795b7a4b8e: No bootstrap required, opened a new log
I20260709 12:12:16.745846  4768 ts_tablet_manager.cc:1403] T 62d99d5944b14dca82789362b6d798ce P c66b12e0a1cc44b58565da795b7a4b8e: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.003s
I20260709 12:12:16.746623  4772 raft_consensus.cc:493] T 559fa0760acb4538bfce94dc6cc9e553 P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.747179  4772 raft_consensus.cc:515] T 559fa0760acb4538bfce94dc6cc9e553 P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.745260  4576 raft_consensus.cc:2468] T 2993ac2125df4c1696029a2d0663531a P c66b12e0a1cc44b58565da795b7a4b8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d5eb6a44dd24ba196d9026aec41ff61 in term 0.
I20260709 12:12:16.748662  4768 raft_consensus.cc:359] T 62d99d5944b14dca82789362b6d798ce P c66b12e0a1cc44b58565da795b7a4b8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.749338  4768 raft_consensus.cc:385] T 62d99d5944b14dca82789362b6d798ce P c66b12e0a1cc44b58565da795b7a4b8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.749414  4772 leader_election.cc:290] T 559fa0760acb4538bfce94dc6cc9e553 P a754210d0a2b403184f611fd5864442b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c66b12e0a1cc44b58565da795b7a4b8e (127.3.212.129:37153), 0d5eb6a44dd24ba196d9026aec41ff61 (127.3.212.130:34847)
I20260709 12:12:16.749687  4768 raft_consensus.cc:740] T 62d99d5944b14dca82789362b6d798ce P c66b12e0a1cc44b58565da795b7a4b8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c66b12e0a1cc44b58565da795b7a4b8e, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.749804  4770 raft_consensus.cc:515] T 2993ac2125df4c1696029a2d0663531a P 0d5eb6a44dd24ba196d9026aec41ff61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.750500  4768 consensus_queue.cc:260] T 62d99d5944b14dca82789362b6d798ce P c66b12e0a1cc44b58565da795b7a4b8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.750993  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "559fa0760acb4538bfce94dc6cc9e553" candidate_uuid: "a754210d0a2b403184f611fd5864442b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" is_pre_election: true
I20260709 12:12:16.751178  4651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "559fa0760acb4538bfce94dc6cc9e553" candidate_uuid: "a754210d0a2b403184f611fd5864442b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" is_pre_election: true
I20260709 12:12:16.751643  4576 raft_consensus.cc:2468] T 559fa0760acb4538bfce94dc6cc9e553 P c66b12e0a1cc44b58565da795b7a4b8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a754210d0a2b403184f611fd5864442b in term 0.
I20260709 12:12:16.751726  4651 raft_consensus.cc:2468] T 559fa0760acb4538bfce94dc6cc9e553 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a754210d0a2b403184f611fd5864442b in term 0.
I20260709 12:12:16.752256  4770 leader_election.cc:290] T 2993ac2125df4c1696029a2d0663531a P 0d5eb6a44dd24ba196d9026aec41ff61 [CANDIDATE]: Term 1 election: Requested vote from peers c66b12e0a1cc44b58565da795b7a4b8e (127.3.212.129:37153), a754210d0a2b403184f611fd5864442b (127.3.212.131:37739)
I20260709 12:12:16.752574  4768 ts_tablet_manager.cc:1434] T 62d99d5944b14dca82789362b6d798ce P c66b12e0a1cc44b58565da795b7a4b8e: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:12:16.753364  4768 tablet_bootstrap.cc:492] T 0c7d085ac21245e2a3de979566582db6 P c66b12e0a1cc44b58565da795b7a4b8e: Bootstrap starting.
I20260709 12:12:16.753199  4689 leader_election.cc:304] T 559fa0760acb4538bfce94dc6cc9e553 P a754210d0a2b403184f611fd5864442b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a754210d0a2b403184f611fd5864442b, c66b12e0a1cc44b58565da795b7a4b8e; no voters: 
I20260709 12:12:16.754151  4772 raft_consensus.cc:2804] T 559fa0760acb4538bfce94dc6cc9e553 P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:16.754503  4772 raft_consensus.cc:493] T 559fa0760acb4538bfce94dc6cc9e553 P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:16.754786  4772 raft_consensus.cc:3060] T 559fa0760acb4538bfce94dc6cc9e553 P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.758733  4776 raft_consensus.cc:493] T 239da9ff3cf24b88a55a845f2978db90 P c66b12e0a1cc44b58565da795b7a4b8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.759308  4776 raft_consensus.cc:515] T 239da9ff3cf24b88a55a845f2978db90 P c66b12e0a1cc44b58565da795b7a4b8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.759950  4768 tablet_bootstrap.cc:654] T 0c7d085ac21245e2a3de979566582db6 P c66b12e0a1cc44b58565da795b7a4b8e: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:16.762869  4726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2993ac2125df4c1696029a2d0663531a" candidate_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a754210d0a2b403184f611fd5864442b"
I20260709 12:12:16.762769  4772 raft_consensus.cc:515] T 559fa0760acb4538bfce94dc6cc9e553 P a754210d0a2b403184f611fd5864442b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.763603  4726 raft_consensus.cc:3060] T 2993ac2125df4c1696029a2d0663531a P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.764915  4772 leader_election.cc:290] T 559fa0760acb4538bfce94dc6cc9e553 P a754210d0a2b403184f611fd5864442b [CANDIDATE]: Term 1 election: Requested vote from peers c66b12e0a1cc44b58565da795b7a4b8e (127.3.212.129:37153), 0d5eb6a44dd24ba196d9026aec41ff61 (127.3.212.130:34847)
I20260709 12:12:16.768173  4776 leader_election.cc:290] T 239da9ff3cf24b88a55a845f2978db90 P c66b12e0a1cc44b58565da795b7a4b8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d5eb6a44dd24ba196d9026aec41ff61 (127.3.212.130:34847), a754210d0a2b403184f611fd5864442b (127.3.212.131:37739)
I20260709 12:12:16.768160  4651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "239da9ff3cf24b88a55a845f2978db90" candidate_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" is_pre_election: true
I20260709 12:12:16.769045  4651 raft_consensus.cc:2468] T 239da9ff3cf24b88a55a845f2978db90 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c66b12e0a1cc44b58565da795b7a4b8e in term 0.
I20260709 12:12:16.770715  4651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "559fa0760acb4538bfce94dc6cc9e553" candidate_uuid: "a754210d0a2b403184f611fd5864442b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d5eb6a44dd24ba196d9026aec41ff61"
I20260709 12:12:16.771277  4651 raft_consensus.cc:3060] T 559fa0760acb4538bfce94dc6cc9e553 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.771668  4768 tablet_bootstrap.cc:492] T 0c7d085ac21245e2a3de979566582db6 P c66b12e0a1cc44b58565da795b7a4b8e: No bootstrap required, opened a new log
I20260709 12:12:16.772114  4768 ts_tablet_manager.cc:1403] T 0c7d085ac21245e2a3de979566582db6 P c66b12e0a1cc44b58565da795b7a4b8e: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 12:12:16.774782  4768 raft_consensus.cc:359] T 0c7d085ac21245e2a3de979566582db6 P c66b12e0a1cc44b58565da795b7a4b8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.775447  4768 raft_consensus.cc:385] T 0c7d085ac21245e2a3de979566582db6 P c66b12e0a1cc44b58565da795b7a4b8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.775709  4768 raft_consensus.cc:740] T 0c7d085ac21245e2a3de979566582db6 P c66b12e0a1cc44b58565da795b7a4b8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c66b12e0a1cc44b58565da795b7a4b8e, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.776047  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2993ac2125df4c1696029a2d0663531a" candidate_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c66b12e0a1cc44b58565da795b7a4b8e"
I20260709 12:12:16.776357  4768 consensus_queue.cc:260] T 0c7d085ac21245e2a3de979566582db6 P c66b12e0a1cc44b58565da795b7a4b8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.776705  4576 raft_consensus.cc:3060] T 2993ac2125df4c1696029a2d0663531a P c66b12e0a1cc44b58565da795b7a4b8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.776757  4540 leader_election.cc:304] T 239da9ff3cf24b88a55a845f2978db90 P c66b12e0a1cc44b58565da795b7a4b8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d5eb6a44dd24ba196d9026aec41ff61, c66b12e0a1cc44b58565da795b7a4b8e; no voters: 
I20260709 12:12:16.784067  4576 raft_consensus.cc:2468] T 2993ac2125df4c1696029a2d0663531a P c66b12e0a1cc44b58565da795b7a4b8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d5eb6a44dd24ba196d9026aec41ff61 in term 1.
I20260709 12:12:16.785110  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "559fa0760acb4538bfce94dc6cc9e553" candidate_uuid: "a754210d0a2b403184f611fd5864442b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c66b12e0a1cc44b58565da795b7a4b8e"
I20260709 12:12:16.785804  4575 raft_consensus.cc:3060] T 559fa0760acb4538bfce94dc6cc9e553 P c66b12e0a1cc44b58565da795b7a4b8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.786016  4766 tablet_bootstrap.cc:492] T 0c7d085ac21245e2a3de979566582db6 P a754210d0a2b403184f611fd5864442b: No bootstrap required, opened a new log
I20260709 12:12:16.785986  4615 leader_election.cc:304] T 2993ac2125df4c1696029a2d0663531a P 0d5eb6a44dd24ba196d9026aec41ff61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d5eb6a44dd24ba196d9026aec41ff61, c66b12e0a1cc44b58565da795b7a4b8e; no voters: 
I20260709 12:12:16.786645  4766 ts_tablet_manager.cc:1403] T 0c7d085ac21245e2a3de979566582db6 P a754210d0a2b403184f611fd5864442b: Time spent bootstrapping tablet: real 0.055s	user 0.011s	sys 0.000s
I20260709 12:12:16.778429  4768 ts_tablet_manager.cc:1434] T 0c7d085ac21245e2a3de979566582db6 P c66b12e0a1cc44b58565da795b7a4b8e: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:12:16.779179  4726 raft_consensus.cc:2468] T 2993ac2125df4c1696029a2d0663531a P a754210d0a2b403184f611fd5864442b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d5eb6a44dd24ba196d9026aec41ff61 in term 1.
I20260709 12:12:16.780380  4725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "239da9ff3cf24b88a55a845f2978db90" candidate_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a754210d0a2b403184f611fd5864442b" is_pre_election: true
I20260709 12:12:16.788509  4776 raft_consensus.cc:2804] T 239da9ff3cf24b88a55a845f2978db90 P c66b12e0a1cc44b58565da795b7a4b8e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:16.788565  4725 raft_consensus.cc:2468] T 239da9ff3cf24b88a55a845f2978db90 P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c66b12e0a1cc44b58565da795b7a4b8e in term 0.
I20260709 12:12:16.789578  4770 raft_consensus.cc:2804] T 2993ac2125df4c1696029a2d0663531a P 0d5eb6a44dd24ba196d9026aec41ff61 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:16.789700  4776 raft_consensus.cc:493] T 239da9ff3cf24b88a55a845f2978db90 P c66b12e0a1cc44b58565da795b7a4b8e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:16.790318  4776 raft_consensus.cc:3060] T 239da9ff3cf24b88a55a845f2978db90 P c66b12e0a1cc44b58565da795b7a4b8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.792203  4766 raft_consensus.cc:359] T 0c7d085ac21245e2a3de979566582db6 P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.792915  4766 raft_consensus.cc:385] T 0c7d085ac21245e2a3de979566582db6 P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.790153  4770 raft_consensus.cc:697] T 2993ac2125df4c1696029a2d0663531a P 0d5eb6a44dd24ba196d9026aec41ff61 [term 1 LEADER]: Becoming Leader. State: Replica: 0d5eb6a44dd24ba196d9026aec41ff61, State: Running, Role: LEADER
I20260709 12:12:16.793316  4766 raft_consensus.cc:740] T 0c7d085ac21245e2a3de979566582db6 P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a754210d0a2b403184f611fd5864442b, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.793996  4770 consensus_queue.cc:237] T 2993ac2125df4c1696029a2d0663531a P 0d5eb6a44dd24ba196d9026aec41ff61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.794261  4766 consensus_queue.cc:260] T 0c7d085ac21245e2a3de979566582db6 P a754210d0a2b403184f611fd5864442b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.793397  4575 raft_consensus.cc:2468] T 559fa0760acb4538bfce94dc6cc9e553 P c66b12e0a1cc44b58565da795b7a4b8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a754210d0a2b403184f611fd5864442b in term 1.
I20260709 12:12:16.796265  4766 ts_tablet_manager.cc:1434] T 0c7d085ac21245e2a3de979566582db6 P a754210d0a2b403184f611fd5864442b: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:12:16.796566  4689 leader_election.cc:304] T 559fa0760acb4538bfce94dc6cc9e553 P a754210d0a2b403184f611fd5864442b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a754210d0a2b403184f611fd5864442b, c66b12e0a1cc44b58565da795b7a4b8e; no voters: 
I20260709 12:12:16.797156  4766 tablet_bootstrap.cc:492] T c3035351b7444712b999d435424960d0 P a754210d0a2b403184f611fd5864442b: Bootstrap starting.
I20260709 12:12:16.797761  4793 raft_consensus.cc:2804] T 559fa0760acb4538bfce94dc6cc9e553 P a754210d0a2b403184f611fd5864442b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:16.798372  4793 raft_consensus.cc:697] T 559fa0760acb4538bfce94dc6cc9e553 P a754210d0a2b403184f611fd5864442b [term 1 LEADER]: Becoming Leader. State: Replica: a754210d0a2b403184f611fd5864442b, State: Running, Role: LEADER
I20260709 12:12:16.799539  4793 consensus_queue.cc:237] T 559fa0760acb4538bfce94dc6cc9e553 P a754210d0a2b403184f611fd5864442b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.804172  4766 tablet_bootstrap.cc:654] T c3035351b7444712b999d435424960d0 P a754210d0a2b403184f611fd5864442b: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:16.806082  4678 tablet.cc:2406] T 0c7d085ac21245e2a3de979566582db6 P 0d5eb6a44dd24ba196d9026aec41ff61: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:12:16.810932  4776 raft_consensus.cc:515] T 239da9ff3cf24b88a55a845f2978db90 P c66b12e0a1cc44b58565da795b7a4b8e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.815203  4766 tablet_bootstrap.cc:492] T c3035351b7444712b999d435424960d0 P a754210d0a2b403184f611fd5864442b: No bootstrap required, opened a new log
I20260709 12:12:16.815699  4766 ts_tablet_manager.cc:1403] T c3035351b7444712b999d435424960d0 P a754210d0a2b403184f611fd5864442b: Time spent bootstrapping tablet: real 0.019s	user 0.004s	sys 0.012s
I20260709 12:12:16.815987  4652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "239da9ff3cf24b88a55a845f2978db90" candidate_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d5eb6a44dd24ba196d9026aec41ff61"
I20260709 12:12:16.816625  4652 raft_consensus.cc:3060] T 239da9ff3cf24b88a55a845f2978db90 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.816752  4470 catalog_manager.cc:5697] T 2993ac2125df4c1696029a2d0663531a P 0d5eb6a44dd24ba196d9026aec41ff61 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d5eb6a44dd24ba196d9026aec41ff61 (127.3.212.130). New cstate: current_term: 1 leader_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:16.818431  4766 raft_consensus.cc:359] T c3035351b7444712b999d435424960d0 P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } } peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } }
I20260709 12:12:16.819103  4766 raft_consensus.cc:385] T c3035351b7444712b999d435424960d0 P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:16.819382  4766 raft_consensus.cc:740] T c3035351b7444712b999d435424960d0 P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a754210d0a2b403184f611fd5864442b, State: Initialized, Role: FOLLOWER
I20260709 12:12:16.820226  4766 consensus_queue.cc:260] T c3035351b7444712b999d435424960d0 P a754210d0a2b403184f611fd5864442b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } } peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } }
I20260709 12:12:16.822115  4776 leader_election.cc:290] T 239da9ff3cf24b88a55a845f2978db90 P c66b12e0a1cc44b58565da795b7a4b8e [CANDIDATE]: Term 1 election: Requested vote from peers 0d5eb6a44dd24ba196d9026aec41ff61 (127.3.212.130:34847), a754210d0a2b403184f611fd5864442b (127.3.212.131:37739)
I20260709 12:12:16.822257  4766 ts_tablet_manager.cc:1434] T c3035351b7444712b999d435424960d0 P a754210d0a2b403184f611fd5864442b: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 12:12:16.823280  4726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "239da9ff3cf24b88a55a845f2978db90" candidate_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a754210d0a2b403184f611fd5864442b"
I20260709 12:12:16.823742  4726 raft_consensus.cc:3060] T 239da9ff3cf24b88a55a845f2978db90 P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.825533  4652 raft_consensus.cc:2468] T 239da9ff3cf24b88a55a845f2978db90 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c66b12e0a1cc44b58565da795b7a4b8e in term 1.
I20260709 12:12:16.826864  4540 leader_election.cc:304] T 239da9ff3cf24b88a55a845f2978db90 P c66b12e0a1cc44b58565da795b7a4b8e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d5eb6a44dd24ba196d9026aec41ff61, c66b12e0a1cc44b58565da795b7a4b8e; no voters: 
I20260709 12:12:16.827836  4776 raft_consensus.cc:2804] T 239da9ff3cf24b88a55a845f2978db90 P c66b12e0a1cc44b58565da795b7a4b8e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:16.782980  4651 raft_consensus.cc:2468] T 559fa0760acb4538bfce94dc6cc9e553 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a754210d0a2b403184f611fd5864442b in term 1.
I20260709 12:12:16.828430  4776 raft_consensus.cc:697] T 239da9ff3cf24b88a55a845f2978db90 P c66b12e0a1cc44b58565da795b7a4b8e [term 1 LEADER]: Becoming Leader. State: Replica: c66b12e0a1cc44b58565da795b7a4b8e, State: Running, Role: LEADER
I20260709 12:12:16.826897  4469 catalog_manager.cc:5697] T 559fa0760acb4538bfce94dc6cc9e553 P a754210d0a2b403184f611fd5864442b reported cstate change: term changed from 0 to 1, leader changed from <none> to a754210d0a2b403184f611fd5864442b (127.3.212.131). New cstate: current_term: 1 leader_uuid: "a754210d0a2b403184f611fd5864442b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:16.829401  4776 consensus_queue.cc:237] T 239da9ff3cf24b88a55a845f2978db90 P c66b12e0a1cc44b58565da795b7a4b8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:16.830430  4726 raft_consensus.cc:2468] T 239da9ff3cf24b88a55a845f2978db90 P a754210d0a2b403184f611fd5864442b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c66b12e0a1cc44b58565da795b7a4b8e in term 1.
I20260709 12:12:16.838510  4470 catalog_manager.cc:5697] T 239da9ff3cf24b88a55a845f2978db90 P c66b12e0a1cc44b58565da795b7a4b8e reported cstate change: term changed from 0 to 1, leader changed from <none> to c66b12e0a1cc44b58565da795b7a4b8e (127.3.212.129). New cstate: current_term: 1 leader_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:16.921356  4770 consensus_queue.cc:1048] T 978105aee434435f91eb9b3ddda005c4 P 0d5eb6a44dd24ba196d9026aec41ff61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:16.932700  4778 consensus_queue.cc:1048] T 978105aee434435f91eb9b3ddda005c4 P 0d5eb6a44dd24ba196d9026aec41ff61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:16.980006  4778 consensus_queue.cc:1048] T c3035351b7444712b999d435424960d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:16.989073  4726 raft_consensus.cc:3060] T c3035351b7444712b999d435424960d0 P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:16.998427  4825 consensus_queue.cc:1048] T c3035351b7444712b999d435424960d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:17.021661  4825 raft_consensus.cc:493] T 0c7d085ac21245e2a3de979566582db6 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:17.022384  4776 raft_consensus.cc:493] T 62d99d5944b14dca82789362b6d798ce P c66b12e0a1cc44b58565da795b7a4b8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:17.022235  4825 raft_consensus.cc:515] T 0c7d085ac21245e2a3de979566582db6 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:17.022959  4776 raft_consensus.cc:515] T 62d99d5944b14dca82789362b6d798ce P c66b12e0a1cc44b58565da795b7a4b8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:17.024530  4825 leader_election.cc:290] T 0c7d085ac21245e2a3de979566582db6 P 0d5eb6a44dd24ba196d9026aec41ff61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c66b12e0a1cc44b58565da795b7a4b8e (127.3.212.129:37153), a754210d0a2b403184f611fd5864442b (127.3.212.131:37739)
I20260709 12:12:17.024924  4776 leader_election.cc:290] T 62d99d5944b14dca82789362b6d798ce P c66b12e0a1cc44b58565da795b7a4b8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d5eb6a44dd24ba196d9026aec41ff61 (127.3.212.130:34847), a754210d0a2b403184f611fd5864442b (127.3.212.131:37739)
I20260709 12:12:17.025730  4726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7d085ac21245e2a3de979566582db6" candidate_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a754210d0a2b403184f611fd5864442b" is_pre_election: true
I20260709 12:12:17.025805  4651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d99d5944b14dca82789362b6d798ce" candidate_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" is_pre_election: true
I20260709 12:12:17.026010  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7d085ac21245e2a3de979566582db6" candidate_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" is_pre_election: true
I20260709 12:12:17.026417  4726 raft_consensus.cc:2468] T 0c7d085ac21245e2a3de979566582db6 P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d5eb6a44dd24ba196d9026aec41ff61 in term 0.
I20260709 12:12:17.026479  4725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d99d5944b14dca82789362b6d798ce" candidate_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a754210d0a2b403184f611fd5864442b" is_pre_election: true
I20260709 12:12:17.027143  4776 raft_consensus.cc:493] T 643771d1f41240b5a002a62fdaa0b0d0 P c66b12e0a1cc44b58565da795b7a4b8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:17.027304  4725 raft_consensus.cc:2393] T 62d99d5944b14dca82789362b6d798ce P a754210d0a2b403184f611fd5864442b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c66b12e0a1cc44b58565da795b7a4b8e in current term 1: Already voted for candidate 0d5eb6a44dd24ba196d9026aec41ff61 in this term.
I20260709 12:12:17.027606  4776 raft_consensus.cc:515] T 643771d1f41240b5a002a62fdaa0b0d0 P c66b12e0a1cc44b58565da795b7a4b8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:17.027981  4575 raft_consensus.cc:2468] T 0c7d085ac21245e2a3de979566582db6 P c66b12e0a1cc44b58565da795b7a4b8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d5eb6a44dd24ba196d9026aec41ff61 in term 0.
I20260709 12:12:17.029078  4615 leader_election.cc:304] T 0c7d085ac21245e2a3de979566582db6 P 0d5eb6a44dd24ba196d9026aec41ff61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d5eb6a44dd24ba196d9026aec41ff61, a754210d0a2b403184f611fd5864442b; no voters: 
I20260709 12:12:17.029348  4540 leader_election.cc:304] T 62d99d5944b14dca82789362b6d798ce P c66b12e0a1cc44b58565da795b7a4b8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c66b12e0a1cc44b58565da795b7a4b8e; no voters: 0d5eb6a44dd24ba196d9026aec41ff61, a754210d0a2b403184f611fd5864442b
I20260709 12:12:17.029569  4651 raft_consensus.cc:3060] T e35f477c83c04eb089f4ccd3042dd99c P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:17.029768  4776 leader_election.cc:290] T 643771d1f41240b5a002a62fdaa0b0d0 P c66b12e0a1cc44b58565da795b7a4b8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d5eb6a44dd24ba196d9026aec41ff61 (127.3.212.130:34847), a754210d0a2b403184f611fd5864442b (127.3.212.131:37739)
I20260709 12:12:17.030284  4776 raft_consensus.cc:3060] T 62d99d5944b14dca82789362b6d798ce P c66b12e0a1cc44b58565da795b7a4b8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:17.030632  4825 raft_consensus.cc:2804] T 0c7d085ac21245e2a3de979566582db6 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:17.031052  4825 raft_consensus.cc:493] T 0c7d085ac21245e2a3de979566582db6 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:17.031461  4825 raft_consensus.cc:3060] T 0c7d085ac21245e2a3de979566582db6 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:17.031806  4652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "643771d1f41240b5a002a62fdaa0b0d0" candidate_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" is_pre_election: true
I20260709 12:12:17.032670  4652 raft_consensus.cc:2393] T 643771d1f41240b5a002a62fdaa0b0d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c66b12e0a1cc44b58565da795b7a4b8e in current term 1: Already voted for candidate a754210d0a2b403184f611fd5864442b in this term.
I20260709 12:12:17.035207  4726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "643771d1f41240b5a002a62fdaa0b0d0" candidate_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a754210d0a2b403184f611fd5864442b" is_pre_election: true
I20260709 12:12:17.036748  4540 leader_election.cc:304] T 643771d1f41240b5a002a62fdaa0b0d0 P c66b12e0a1cc44b58565da795b7a4b8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c66b12e0a1cc44b58565da795b7a4b8e; no voters: 0d5eb6a44dd24ba196d9026aec41ff61, a754210d0a2b403184f611fd5864442b
I20260709 12:12:17.037082  4776 raft_consensus.cc:2749] T 62d99d5944b14dca82789362b6d798ce P c66b12e0a1cc44b58565da795b7a4b8e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:17.037901  4800 raft_consensus.cc:3060] T 643771d1f41240b5a002a62fdaa0b0d0 P c66b12e0a1cc44b58565da795b7a4b8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:17.038553  4793 consensus_queue.cc:1048] T e35f477c83c04eb089f4ccd3042dd99c P a754210d0a2b403184f611fd5864442b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:17.039207  4825 raft_consensus.cc:515] T 0c7d085ac21245e2a3de979566582db6 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:17.041278  4825 leader_election.cc:290] T 0c7d085ac21245e2a3de979566582db6 P 0d5eb6a44dd24ba196d9026aec41ff61 [CANDIDATE]: Term 1 election: Requested vote from peers c66b12e0a1cc44b58565da795b7a4b8e (127.3.212.129:37153), a754210d0a2b403184f611fd5864442b (127.3.212.131:37739)
I20260709 12:12:17.043141  4726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7d085ac21245e2a3de979566582db6" candidate_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a754210d0a2b403184f611fd5864442b"
I20260709 12:12:17.043864  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7d085ac21245e2a3de979566582db6" candidate_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c66b12e0a1cc44b58565da795b7a4b8e"
I20260709 12:12:17.044358  4726 raft_consensus.cc:3060] T 0c7d085ac21245e2a3de979566582db6 P a754210d0a2b403184f611fd5864442b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:17.044499  4575 raft_consensus.cc:3060] T 0c7d085ac21245e2a3de979566582db6 P c66b12e0a1cc44b58565da795b7a4b8e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:17.045255  4800 raft_consensus.cc:2749] T 643771d1f41240b5a002a62fdaa0b0d0 P c66b12e0a1cc44b58565da795b7a4b8e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:17.051397  4793 consensus_queue.cc:1048] T 643771d1f41240b5a002a62fdaa0b0d0 P a754210d0a2b403184f611fd5864442b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:17.052385  4575 raft_consensus.cc:2468] T 0c7d085ac21245e2a3de979566582db6 P c66b12e0a1cc44b58565da795b7a4b8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d5eb6a44dd24ba196d9026aec41ff61 in term 1.
I20260709 12:12:17.052791  4726 raft_consensus.cc:2468] T 0c7d085ac21245e2a3de979566582db6 P a754210d0a2b403184f611fd5864442b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d5eb6a44dd24ba196d9026aec41ff61 in term 1.
I20260709 12:12:17.054242  4615 leader_election.cc:304] T 0c7d085ac21245e2a3de979566582db6 P 0d5eb6a44dd24ba196d9026aec41ff61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d5eb6a44dd24ba196d9026aec41ff61, a754210d0a2b403184f611fd5864442b; no voters: 
I20260709 12:12:17.055841  4803 raft_consensus.cc:2804] T 0c7d085ac21245e2a3de979566582db6 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:17.056324  4803 raft_consensus.cc:697] T 0c7d085ac21245e2a3de979566582db6 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 1 LEADER]: Becoming Leader. State: Replica: 0d5eb6a44dd24ba196d9026aec41ff61, State: Running, Role: LEADER
I20260709 12:12:17.057194  4803 consensus_queue.cc:237] T 0c7d085ac21245e2a3de979566582db6 P 0d5eb6a44dd24ba196d9026aec41ff61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:17.059501  4793 consensus_queue.cc:1048] T e35f477c83c04eb089f4ccd3042dd99c P a754210d0a2b403184f611fd5864442b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:17.071511  4793 consensus_queue.cc:1048] T 643771d1f41240b5a002a62fdaa0b0d0 P a754210d0a2b403184f611fd5864442b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:17.075479  4469 catalog_manager.cc:5697] T 0c7d085ac21245e2a3de979566582db6 P 0d5eb6a44dd24ba196d9026aec41ff61 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d5eb6a44dd24ba196d9026aec41ff61 (127.3.212.130). New cstate: current_term: 1 leader_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:17.150271  4791 consensus_queue.cc:1048] T a6a637307cbc440eb70af83b47cc78b0 P a754210d0a2b403184f611fd5864442b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:17.160781  4772 consensus_queue.cc:1048] T a6a637307cbc440eb70af83b47cc78b0 P a754210d0a2b403184f611fd5864442b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:17.189042  4793 consensus_queue.cc:1048] T 559fa0760acb4538bfce94dc6cc9e553 P a754210d0a2b403184f611fd5864442b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:17.191445  4652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3035351b7444712b999d435424960d0"
dest_uuid: "0d5eb6a44dd24ba196d9026aec41ff61"
mode: GRACEFUL
new_leader_uuid: "c66b12e0a1cc44b58565da795b7a4b8e"
 from {username='slave'} at 127.0.0.1:59726
I20260709 12:12:17.192095  4652 raft_consensus.cc:606] T c3035351b7444712b999d435424960d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 1 LEADER]: Received request to transfer leadership to TS c66b12e0a1cc44b58565da795b7a4b8e
I20260709 12:12:17.201541  4652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "978105aee434435f91eb9b3ddda005c4"
dest_uuid: "0d5eb6a44dd24ba196d9026aec41ff61"
mode: GRACEFUL
new_leader_uuid: "c66b12e0a1cc44b58565da795b7a4b8e"
 from {username='slave'} at 127.0.0.1:59726
I20260709 12:12:17.202200  4652 raft_consensus.cc:606] T 978105aee434435f91eb9b3ddda005c4 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 1 LEADER]: Received request to transfer leadership to TS c66b12e0a1cc44b58565da795b7a4b8e
I20260709 12:12:17.201987  4772 consensus_queue.cc:1048] T 559fa0760acb4538bfce94dc6cc9e553 P a754210d0a2b403184f611fd5864442b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:17.209656  4652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2993ac2125df4c1696029a2d0663531a"
dest_uuid: "0d5eb6a44dd24ba196d9026aec41ff61"
mode: GRACEFUL
new_leader_uuid: "c66b12e0a1cc44b58565da795b7a4b8e"
 from {username='slave'} at 127.0.0.1:59726
I20260709 12:12:17.210302  4652 raft_consensus.cc:606] T 2993ac2125df4c1696029a2d0663531a P 0d5eb6a44dd24ba196d9026aec41ff61 [term 1 LEADER]: Received request to transfer leadership to TS c66b12e0a1cc44b58565da795b7a4b8e
I20260709 12:12:17.226548  4726 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6a637307cbc440eb70af83b47cc78b0"
dest_uuid: "a754210d0a2b403184f611fd5864442b"
mode: GRACEFUL
new_leader_uuid: "c66b12e0a1cc44b58565da795b7a4b8e"
 from {username='slave'} at 127.0.0.1:39704
I20260709 12:12:17.227047  4726 raft_consensus.cc:606] T a6a637307cbc440eb70af83b47cc78b0 P a754210d0a2b403184f611fd5864442b [term 1 LEADER]: Received request to transfer leadership to TS c66b12e0a1cc44b58565da795b7a4b8e
I20260709 12:12:17.233043  4726 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e35f477c83c04eb089f4ccd3042dd99c"
dest_uuid: "a754210d0a2b403184f611fd5864442b"
mode: GRACEFUL
new_leader_uuid: "c66b12e0a1cc44b58565da795b7a4b8e"
 from {username='slave'} at 127.0.0.1:39704
I20260709 12:12:17.233623  4726 raft_consensus.cc:606] T e35f477c83c04eb089f4ccd3042dd99c P a754210d0a2b403184f611fd5864442b [term 1 LEADER]: Received request to transfer leadership to TS c66b12e0a1cc44b58565da795b7a4b8e
I20260709 12:12:17.239135  4726 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "643771d1f41240b5a002a62fdaa0b0d0"
dest_uuid: "a754210d0a2b403184f611fd5864442b"
mode: GRACEFUL
new_leader_uuid: "0d5eb6a44dd24ba196d9026aec41ff61"
 from {username='slave'} at 127.0.0.1:39704
I20260709 12:12:17.239619  4726 raft_consensus.cc:606] T 643771d1f41240b5a002a62fdaa0b0d0 P a754210d0a2b403184f611fd5864442b [term 1 LEADER]: Received request to transfer leadership to TS 0d5eb6a44dd24ba196d9026aec41ff61
I20260709 12:12:17.239514  4803 consensus_queue.cc:1048] T 62d99d5944b14dca82789362b6d798ce P 0d5eb6a44dd24ba196d9026aec41ff61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:17.252846  4770 consensus_queue.cc:1048] T 62d99d5944b14dca82789362b6d798ce P 0d5eb6a44dd24ba196d9026aec41ff61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:17.260164  4726 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "559fa0760acb4538bfce94dc6cc9e553"
dest_uuid: "a754210d0a2b403184f611fd5864442b"
mode: GRACEFUL
new_leader_uuid: "0d5eb6a44dd24ba196d9026aec41ff61"
 from {username='slave'} at 127.0.0.1:39704
I20260709 12:12:17.260725  4726 raft_consensus.cc:606] T 559fa0760acb4538bfce94dc6cc9e553 P a754210d0a2b403184f611fd5864442b [term 1 LEADER]: Received request to transfer leadership to TS 0d5eb6a44dd24ba196d9026aec41ff61
I20260709 12:12:17.278126  4575 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "239da9ff3cf24b88a55a845f2978db90"
dest_uuid: "c66b12e0a1cc44b58565da795b7a4b8e"
mode: GRACEFUL
new_leader_uuid: "a754210d0a2b403184f611fd5864442b"
 from {username='slave'} at 127.0.0.1:46068
I20260709 12:12:17.278729  4575 raft_consensus.cc:606] T 239da9ff3cf24b88a55a845f2978db90 P c66b12e0a1cc44b58565da795b7a4b8e [term 1 LEADER]: Received request to transfer leadership to TS a754210d0a2b403184f611fd5864442b
I20260709 12:12:17.295002  4770 consensus_queue.cc:1048] T 2993ac2125df4c1696029a2d0663531a P 0d5eb6a44dd24ba196d9026aec41ff61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:17.302601  4825 raft_consensus.cc:993] T 2993ac2125df4c1696029a2d0663531a P 0d5eb6a44dd24ba196d9026aec41ff61: : Instructing follower c66b12e0a1cc44b58565da795b7a4b8e to start an election
I20260709 12:12:17.303059  4778 raft_consensus.cc:1081] T 2993ac2125df4c1696029a2d0663531a P 0d5eb6a44dd24ba196d9026aec41ff61 [term 1 LEADER]: Signalling peer c66b12e0a1cc44b58565da795b7a4b8e to start an election
I20260709 12:12:17.304574  4576 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2993ac2125df4c1696029a2d0663531a"
dest_uuid: "c66b12e0a1cc44b58565da795b7a4b8e"
 from {username='slave'} at 127.0.0.1:46052
I20260709 12:12:17.305835  4576 raft_consensus.cc:493] T 2993ac2125df4c1696029a2d0663531a P c66b12e0a1cc44b58565da795b7a4b8e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:17.306237  4576 raft_consensus.cc:3060] T 2993ac2125df4c1696029a2d0663531a P c66b12e0a1cc44b58565da795b7a4b8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.308915  4825 consensus_queue.cc:1048] T 2993ac2125df4c1696029a2d0663531a P 0d5eb6a44dd24ba196d9026aec41ff61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:17.313411  4576 raft_consensus.cc:515] T 2993ac2125df4c1696029a2d0663531a P c66b12e0a1cc44b58565da795b7a4b8e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:17.316722  4652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2993ac2125df4c1696029a2d0663531a" candidate_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d5eb6a44dd24ba196d9026aec41ff61"
I20260709 12:12:17.317358  4652 raft_consensus.cc:3055] T 2993ac2125df4c1696029a2d0663531a P 0d5eb6a44dd24ba196d9026aec41ff61 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:17.317706  4652 raft_consensus.cc:740] T 2993ac2125df4c1696029a2d0663531a P 0d5eb6a44dd24ba196d9026aec41ff61 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0d5eb6a44dd24ba196d9026aec41ff61, State: Running, Role: LEADER
I20260709 12:12:17.317641  4725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2993ac2125df4c1696029a2d0663531a" candidate_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a754210d0a2b403184f611fd5864442b"
I20260709 12:12:17.317942  4576 leader_election.cc:290] T 2993ac2125df4c1696029a2d0663531a P c66b12e0a1cc44b58565da795b7a4b8e [CANDIDATE]: Term 2 election: Requested vote from peers 0d5eb6a44dd24ba196d9026aec41ff61 (127.3.212.130:34847), a754210d0a2b403184f611fd5864442b (127.3.212.131:37739)
I20260709 12:12:17.318645  4652 consensus_queue.cc:260] T 2993ac2125df4c1696029a2d0663531a P 0d5eb6a44dd24ba196d9026aec41ff61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:17.319698  4652 raft_consensus.cc:3060] T 2993ac2125df4c1696029a2d0663531a P 0d5eb6a44dd24ba196d9026aec41ff61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.325929  4652 raft_consensus.cc:2468] T 2993ac2125df4c1696029a2d0663531a P 0d5eb6a44dd24ba196d9026aec41ff61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c66b12e0a1cc44b58565da795b7a4b8e in term 2.
I20260709 12:12:17.327006  4540 leader_election.cc:304] T 2993ac2125df4c1696029a2d0663531a P c66b12e0a1cc44b58565da795b7a4b8e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d5eb6a44dd24ba196d9026aec41ff61, c66b12e0a1cc44b58565da795b7a4b8e; no voters: a754210d0a2b403184f611fd5864442b
I20260709 12:12:17.327848  4800 raft_consensus.cc:2804] T 2993ac2125df4c1696029a2d0663531a P c66b12e0a1cc44b58565da795b7a4b8e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:17.328238  4800 raft_consensus.cc:697] T 2993ac2125df4c1696029a2d0663531a P c66b12e0a1cc44b58565da795b7a4b8e [term 2 LEADER]: Becoming Leader. State: Replica: c66b12e0a1cc44b58565da795b7a4b8e, State: Running, Role: LEADER
I20260709 12:12:17.328907  4800 consensus_queue.cc:237] T 2993ac2125df4c1696029a2d0663531a P c66b12e0a1cc44b58565da795b7a4b8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:17.335323  4470 catalog_manager.cc:5697] T 2993ac2125df4c1696029a2d0663531a P c66b12e0a1cc44b58565da795b7a4b8e reported cstate change: term changed from 1 to 2, leader changed from 0d5eb6a44dd24ba196d9026aec41ff61 (127.3.212.130) to c66b12e0a1cc44b58565da795b7a4b8e (127.3.212.129). New cstate: current_term: 2 leader_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:17.349920  4800 consensus_queue.cc:1048] T 239da9ff3cf24b88a55a845f2978db90 P c66b12e0a1cc44b58565da795b7a4b8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:17.356817  4776 raft_consensus.cc:993] T 239da9ff3cf24b88a55a845f2978db90 P c66b12e0a1cc44b58565da795b7a4b8e: : Instructing follower a754210d0a2b403184f611fd5864442b to start an election
I20260709 12:12:17.357616  4800 raft_consensus.cc:1081] T 239da9ff3cf24b88a55a845f2978db90 P c66b12e0a1cc44b58565da795b7a4b8e [term 1 LEADER]: Signalling peer a754210d0a2b403184f611fd5864442b to start an election
I20260709 12:12:17.362208  4725 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "239da9ff3cf24b88a55a845f2978db90"
dest_uuid: "a754210d0a2b403184f611fd5864442b"
 from {username='slave'} at 127.0.0.1:39694
I20260709 12:12:17.362808  4725 raft_consensus.cc:493] T 239da9ff3cf24b88a55a845f2978db90 P a754210d0a2b403184f611fd5864442b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:17.363188  4725 raft_consensus.cc:3060] T 239da9ff3cf24b88a55a845f2978db90 P a754210d0a2b403184f611fd5864442b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.363422  4825 raft_consensus.cc:993] T 978105aee434435f91eb9b3ddda005c4 P 0d5eb6a44dd24ba196d9026aec41ff61: : Instructing follower c66b12e0a1cc44b58565da795b7a4b8e to start an election
I20260709 12:12:17.363867  4825 raft_consensus.cc:1081] T 978105aee434435f91eb9b3ddda005c4 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 1 LEADER]: Signalling peer c66b12e0a1cc44b58565da795b7a4b8e to start an election
I20260709 12:12:17.365582  4576 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "978105aee434435f91eb9b3ddda005c4"
dest_uuid: "c66b12e0a1cc44b58565da795b7a4b8e"
 from {username='slave'} at 127.0.0.1:46052
I20260709 12:12:17.365576  4845 consensus_queue.cc:1048] T 239da9ff3cf24b88a55a845f2978db90 P c66b12e0a1cc44b58565da795b7a4b8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:17.366266  4576 raft_consensus.cc:493] T 978105aee434435f91eb9b3ddda005c4 P c66b12e0a1cc44b58565da795b7a4b8e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:17.366664  4576 raft_consensus.cc:3060] T 978105aee434435f91eb9b3ddda005c4 P c66b12e0a1cc44b58565da795b7a4b8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.371480  4725 raft_consensus.cc:515] T 239da9ff3cf24b88a55a845f2978db90 P a754210d0a2b403184f611fd5864442b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:17.374814  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "239da9ff3cf24b88a55a845f2978db90" candidate_uuid: "a754210d0a2b403184f611fd5864442b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c66b12e0a1cc44b58565da795b7a4b8e"
I20260709 12:12:17.375249  4651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "239da9ff3cf24b88a55a845f2978db90" candidate_uuid: "a754210d0a2b403184f611fd5864442b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d5eb6a44dd24ba196d9026aec41ff61"
I20260709 12:12:17.375531  4575 raft_consensus.cc:3055] T 239da9ff3cf24b88a55a845f2978db90 P c66b12e0a1cc44b58565da795b7a4b8e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:17.376008  4575 raft_consensus.cc:740] T 239da9ff3cf24b88a55a845f2978db90 P c66b12e0a1cc44b58565da795b7a4b8e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c66b12e0a1cc44b58565da795b7a4b8e, State: Running, Role: LEADER
I20260709 12:12:17.376924  4575 consensus_queue.cc:260] T 239da9ff3cf24b88a55a845f2978db90 P c66b12e0a1cc44b58565da795b7a4b8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:17.378149  4575 raft_consensus.cc:3060] T 239da9ff3cf24b88a55a845f2978db90 P c66b12e0a1cc44b58565da795b7a4b8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.374178  4576 raft_consensus.cc:515] T 978105aee434435f91eb9b3ddda005c4 P c66b12e0a1cc44b58565da795b7a4b8e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:17.380681  4825 raft_consensus.cc:993] T c3035351b7444712b999d435424960d0 P 0d5eb6a44dd24ba196d9026aec41ff61: : Instructing follower c66b12e0a1cc44b58565da795b7a4b8e to start an election
I20260709 12:12:17.374137  4725 leader_election.cc:290] T 239da9ff3cf24b88a55a845f2978db90 P a754210d0a2b403184f611fd5864442b [CANDIDATE]: Term 2 election: Requested vote from peers c66b12e0a1cc44b58565da795b7a4b8e (127.3.212.129:37153), 0d5eb6a44dd24ba196d9026aec41ff61 (127.3.212.130:34847)
I20260709 12:12:17.380909  4576 leader_election.cc:290] T 978105aee434435f91eb9b3ddda005c4 P c66b12e0a1cc44b58565da795b7a4b8e [CANDIDATE]: Term 2 election: Requested vote from peers 0d5eb6a44dd24ba196d9026aec41ff61 (127.3.212.130:34847), a754210d0a2b403184f611fd5864442b (127.3.212.131:37739)
I20260709 12:12:17.381156  4825 raft_consensus.cc:1081] T c3035351b7444712b999d435424960d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 1 LEADER]: Signalling peer c66b12e0a1cc44b58565da795b7a4b8e to start an election
I20260709 12:12:17.383824  4652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978105aee434435f91eb9b3ddda005c4" candidate_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d5eb6a44dd24ba196d9026aec41ff61"
I20260709 12:12:17.384511  4652 raft_consensus.cc:3055] T 978105aee434435f91eb9b3ddda005c4 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:17.384912  4652 raft_consensus.cc:740] T 978105aee434435f91eb9b3ddda005c4 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0d5eb6a44dd24ba196d9026aec41ff61, State: Running, Role: LEADER
I20260709 12:12:17.385810  4725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978105aee434435f91eb9b3ddda005c4" candidate_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a754210d0a2b403184f611fd5864442b"
I20260709 12:12:17.386034  4576 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c3035351b7444712b999d435424960d0"
dest_uuid: "c66b12e0a1cc44b58565da795b7a4b8e"
 from {username='slave'} at 127.0.0.1:46052
I20260709 12:12:17.386408  4725 raft_consensus.cc:3060] T 978105aee434435f91eb9b3ddda005c4 P a754210d0a2b403184f611fd5864442b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.386598  4576 raft_consensus.cc:493] T c3035351b7444712b999d435424960d0 P c66b12e0a1cc44b58565da795b7a4b8e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:17.387074  4576 raft_consensus.cc:3060] T c3035351b7444712b999d435424960d0 P c66b12e0a1cc44b58565da795b7a4b8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.385926  4652 consensus_queue.cc:260] T 978105aee434435f91eb9b3ddda005c4 P 0d5eb6a44dd24ba196d9026aec41ff61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:17.386456  4575 raft_consensus.cc:2468] T 239da9ff3cf24b88a55a845f2978db90 P c66b12e0a1cc44b58565da795b7a4b8e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a754210d0a2b403184f611fd5864442b in term 2.
I20260709 12:12:17.388190  4652 raft_consensus.cc:3060] T 978105aee434435f91eb9b3ddda005c4 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.388952  4689 leader_election.cc:304] T 239da9ff3cf24b88a55a845f2978db90 P a754210d0a2b403184f611fd5864442b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a754210d0a2b403184f611fd5864442b, c66b12e0a1cc44b58565da795b7a4b8e; no voters: 0d5eb6a44dd24ba196d9026aec41ff61
I20260709 12:12:17.390143  4791 raft_consensus.cc:2804] T 239da9ff3cf24b88a55a845f2978db90 P a754210d0a2b403184f611fd5864442b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:17.390736  4791 raft_consensus.cc:697] T 239da9ff3cf24b88a55a845f2978db90 P a754210d0a2b403184f611fd5864442b [term 2 LEADER]: Becoming Leader. State: Replica: a754210d0a2b403184f611fd5864442b, State: Running, Role: LEADER
I20260709 12:12:17.391556  4791 consensus_queue.cc:237] T 239da9ff3cf24b88a55a845f2978db90 P a754210d0a2b403184f611fd5864442b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:17.394627  4576 raft_consensus.cc:515] T c3035351b7444712b999d435424960d0 P c66b12e0a1cc44b58565da795b7a4b8e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } } peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } }
I20260709 12:12:17.396802  4576 leader_election.cc:290] T c3035351b7444712b999d435424960d0 P c66b12e0a1cc44b58565da795b7a4b8e [CANDIDATE]: Term 2 election: Requested vote from peers 0d5eb6a44dd24ba196d9026aec41ff61 (127.3.212.130:34847), a754210d0a2b403184f611fd5864442b (127.3.212.131:37739)
I20260709 12:12:17.397816  4725 raft_consensus.cc:2468] T 978105aee434435f91eb9b3ddda005c4 P a754210d0a2b403184f611fd5864442b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c66b12e0a1cc44b58565da795b7a4b8e in term 2.
I20260709 12:12:17.397994  4651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3035351b7444712b999d435424960d0" candidate_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d5eb6a44dd24ba196d9026aec41ff61"
I20260709 12:12:17.398178  4726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3035351b7444712b999d435424960d0" candidate_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a754210d0a2b403184f611fd5864442b"
I20260709 12:12:17.398669  4651 raft_consensus.cc:3055] T c3035351b7444712b999d435424960d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:17.398689  4726 raft_consensus.cc:3060] T c3035351b7444712b999d435424960d0 P a754210d0a2b403184f611fd5864442b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.399441  4652 raft_consensus.cc:2468] T 978105aee434435f91eb9b3ddda005c4 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c66b12e0a1cc44b58565da795b7a4b8e in term 2.
I20260709 12:12:17.399610  4540 leader_election.cc:304] T 978105aee434435f91eb9b3ddda005c4 P c66b12e0a1cc44b58565da795b7a4b8e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a754210d0a2b403184f611fd5864442b, c66b12e0a1cc44b58565da795b7a4b8e; no voters: 
I20260709 12:12:17.400754  4845 raft_consensus.cc:2804] T 978105aee434435f91eb9b3ddda005c4 P c66b12e0a1cc44b58565da795b7a4b8e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:17.399053  4651 raft_consensus.cc:740] T c3035351b7444712b999d435424960d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0d5eb6a44dd24ba196d9026aec41ff61, State: Running, Role: LEADER
I20260709 12:12:17.401480  4845 raft_consensus.cc:697] T 978105aee434435f91eb9b3ddda005c4 P c66b12e0a1cc44b58565da795b7a4b8e [term 2 LEADER]: Becoming Leader. State: Replica: c66b12e0a1cc44b58565da795b7a4b8e, State: Running, Role: LEADER
I20260709 12:12:17.400983  4470 catalog_manager.cc:5697] T 239da9ff3cf24b88a55a845f2978db90 P a754210d0a2b403184f611fd5864442b reported cstate change: term changed from 1 to 2, leader changed from c66b12e0a1cc44b58565da795b7a4b8e (127.3.212.129) to a754210d0a2b403184f611fd5864442b (127.3.212.131). New cstate: current_term: 2 leader_uuid: "a754210d0a2b403184f611fd5864442b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:17.401969  4651 consensus_queue.cc:260] T c3035351b7444712b999d435424960d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } } peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } }
I20260709 12:12:17.402292  4845 consensus_queue.cc:237] T 978105aee434435f91eb9b3ddda005c4 P c66b12e0a1cc44b58565da795b7a4b8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:17.403590  4651 raft_consensus.cc:3060] T c3035351b7444712b999d435424960d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.406577  4726 raft_consensus.cc:2468] T c3035351b7444712b999d435424960d0 P a754210d0a2b403184f611fd5864442b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c66b12e0a1cc44b58565da795b7a4b8e in term 2.
I20260709 12:12:17.408080  4540 leader_election.cc:304] T c3035351b7444712b999d435424960d0 P c66b12e0a1cc44b58565da795b7a4b8e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a754210d0a2b403184f611fd5864442b, c66b12e0a1cc44b58565da795b7a4b8e; no voters: 
I20260709 12:12:17.409006  4845 raft_consensus.cc:2804] T c3035351b7444712b999d435424960d0 P c66b12e0a1cc44b58565da795b7a4b8e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:17.409549  4845 raft_consensus.cc:697] T c3035351b7444712b999d435424960d0 P c66b12e0a1cc44b58565da795b7a4b8e [term 2 LEADER]: Becoming Leader. State: Replica: c66b12e0a1cc44b58565da795b7a4b8e, State: Running, Role: LEADER
I20260709 12:12:17.410362  4845 consensus_queue.cc:237] T c3035351b7444712b999d435424960d0 P c66b12e0a1cc44b58565da795b7a4b8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } } peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } }
I20260709 12:12:17.412319  4651 raft_consensus.cc:2468] T c3035351b7444712b999d435424960d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c66b12e0a1cc44b58565da795b7a4b8e in term 2.
I20260709 12:12:17.411665  4471 catalog_manager.cc:5697] T 978105aee434435f91eb9b3ddda005c4 P c66b12e0a1cc44b58565da795b7a4b8e reported cstate change: term changed from 1 to 2, leader changed from 0d5eb6a44dd24ba196d9026aec41ff61 (127.3.212.130) to c66b12e0a1cc44b58565da795b7a4b8e (127.3.212.129). New cstate: current_term: 2 leader_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:17.425127  4471 catalog_manager.cc:5697] T c3035351b7444712b999d435424960d0 P c66b12e0a1cc44b58565da795b7a4b8e reported cstate change: term changed from 1 to 2, leader changed from 0d5eb6a44dd24ba196d9026aec41ff61 (127.3.212.130) to c66b12e0a1cc44b58565da795b7a4b8e (127.3.212.129). New cstate: current_term: 2 leader_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:17.450953  4825 consensus_queue.cc:1048] T 0c7d085ac21245e2a3de979566582db6 P 0d5eb6a44dd24ba196d9026aec41ff61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:17.461838  4825 consensus_queue.cc:1048] T 0c7d085ac21245e2a3de979566582db6 P 0d5eb6a44dd24ba196d9026aec41ff61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:17.508968  4791 raft_consensus.cc:993] T e35f477c83c04eb089f4ccd3042dd99c P a754210d0a2b403184f611fd5864442b: : Instructing follower c66b12e0a1cc44b58565da795b7a4b8e to start an election
I20260709 12:12:17.509496  4772 raft_consensus.cc:1081] T e35f477c83c04eb089f4ccd3042dd99c P a754210d0a2b403184f611fd5864442b [term 1 LEADER]: Signalling peer c66b12e0a1cc44b58565da795b7a4b8e to start an election
I20260709 12:12:17.510953  4576 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e35f477c83c04eb089f4ccd3042dd99c"
dest_uuid: "c66b12e0a1cc44b58565da795b7a4b8e"
 from {username='slave'} at 127.0.0.1:46058
I20260709 12:12:17.511538  4576 raft_consensus.cc:493] T e35f477c83c04eb089f4ccd3042dd99c P c66b12e0a1cc44b58565da795b7a4b8e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:17.511924  4576 raft_consensus.cc:3060] T e35f477c83c04eb089f4ccd3042dd99c P c66b12e0a1cc44b58565da795b7a4b8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.516778  4576 raft_consensus.cc:515] T e35f477c83c04eb089f4ccd3042dd99c P c66b12e0a1cc44b58565da795b7a4b8e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:17.518352  4576 leader_election.cc:290] T e35f477c83c04eb089f4ccd3042dd99c P c66b12e0a1cc44b58565da795b7a4b8e [CANDIDATE]: Term 2 election: Requested vote from peers 0d5eb6a44dd24ba196d9026aec41ff61 (127.3.212.130:34847), a754210d0a2b403184f611fd5864442b (127.3.212.131:37739)
I20260709 12:12:17.519454  4651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35f477c83c04eb089f4ccd3042dd99c" candidate_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d5eb6a44dd24ba196d9026aec41ff61"
I20260709 12:12:17.519801  4726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35f477c83c04eb089f4ccd3042dd99c" candidate_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a754210d0a2b403184f611fd5864442b"
I20260709 12:12:17.520046  4651 raft_consensus.cc:3060] T e35f477c83c04eb089f4ccd3042dd99c P 0d5eb6a44dd24ba196d9026aec41ff61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.520323  4726 raft_consensus.cc:3055] T e35f477c83c04eb089f4ccd3042dd99c P a754210d0a2b403184f611fd5864442b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:17.520583  4726 raft_consensus.cc:740] T e35f477c83c04eb089f4ccd3042dd99c P a754210d0a2b403184f611fd5864442b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a754210d0a2b403184f611fd5864442b, State: Running, Role: LEADER
I20260709 12:12:17.521443  4726 consensus_queue.cc:260] T e35f477c83c04eb089f4ccd3042dd99c P a754210d0a2b403184f611fd5864442b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:17.522408  4726 raft_consensus.cc:3060] T e35f477c83c04eb089f4ccd3042dd99c P a754210d0a2b403184f611fd5864442b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.525431  4651 raft_consensus.cc:2468] T e35f477c83c04eb089f4ccd3042dd99c P 0d5eb6a44dd24ba196d9026aec41ff61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c66b12e0a1cc44b58565da795b7a4b8e in term 2.
I20260709 12:12:17.526636  4540 leader_election.cc:304] T e35f477c83c04eb089f4ccd3042dd99c P c66b12e0a1cc44b58565da795b7a4b8e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d5eb6a44dd24ba196d9026aec41ff61, c66b12e0a1cc44b58565da795b7a4b8e; no voters: 
I20260709 12:12:17.527238  4726 raft_consensus.cc:2468] T e35f477c83c04eb089f4ccd3042dd99c P a754210d0a2b403184f611fd5864442b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c66b12e0a1cc44b58565da795b7a4b8e in term 2.
I20260709 12:12:17.527330  4845 raft_consensus.cc:2804] T e35f477c83c04eb089f4ccd3042dd99c P c66b12e0a1cc44b58565da795b7a4b8e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:17.527912  4845 raft_consensus.cc:697] T e35f477c83c04eb089f4ccd3042dd99c P c66b12e0a1cc44b58565da795b7a4b8e [term 2 LEADER]: Becoming Leader. State: Replica: c66b12e0a1cc44b58565da795b7a4b8e, State: Running, Role: LEADER
I20260709 12:12:17.528692  4845 consensus_queue.cc:237] T e35f477c83c04eb089f4ccd3042dd99c P c66b12e0a1cc44b58565da795b7a4b8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:17.534953  4470 catalog_manager.cc:5697] T e35f477c83c04eb089f4ccd3042dd99c P c66b12e0a1cc44b58565da795b7a4b8e reported cstate change: term changed from 1 to 2, leader changed from a754210d0a2b403184f611fd5864442b (127.3.212.131) to c66b12e0a1cc44b58565da795b7a4b8e (127.3.212.129). New cstate: current_term: 2 leader_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:17.648370  4791 raft_consensus.cc:993] T a6a637307cbc440eb70af83b47cc78b0 P a754210d0a2b403184f611fd5864442b: : Instructing follower c66b12e0a1cc44b58565da795b7a4b8e to start an election
I20260709 12:12:17.648854  4772 raft_consensus.cc:1081] T a6a637307cbc440eb70af83b47cc78b0 P a754210d0a2b403184f611fd5864442b [term 1 LEADER]: Signalling peer c66b12e0a1cc44b58565da795b7a4b8e to start an election
I20260709 12:12:17.650342  4576 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a6a637307cbc440eb70af83b47cc78b0"
dest_uuid: "c66b12e0a1cc44b58565da795b7a4b8e"
 from {username='slave'} at 127.0.0.1:46058
I20260709 12:12:17.650921  4576 raft_consensus.cc:493] T a6a637307cbc440eb70af83b47cc78b0 P c66b12e0a1cc44b58565da795b7a4b8e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:17.651301  4576 raft_consensus.cc:3060] T a6a637307cbc440eb70af83b47cc78b0 P c66b12e0a1cc44b58565da795b7a4b8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.656153  4576 raft_consensus.cc:515] T a6a637307cbc440eb70af83b47cc78b0 P c66b12e0a1cc44b58565da795b7a4b8e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:17.657907  4576 leader_election.cc:290] T a6a637307cbc440eb70af83b47cc78b0 P c66b12e0a1cc44b58565da795b7a4b8e [CANDIDATE]: Term 2 election: Requested vote from peers 0d5eb6a44dd24ba196d9026aec41ff61 (127.3.212.130:34847), a754210d0a2b403184f611fd5864442b (127.3.212.131:37739)
I20260709 12:12:17.658840  4651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a637307cbc440eb70af83b47cc78b0" candidate_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d5eb6a44dd24ba196d9026aec41ff61"
I20260709 12:12:17.659082  4726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6a637307cbc440eb70af83b47cc78b0" candidate_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a754210d0a2b403184f611fd5864442b"
I20260709 12:12:17.659332  4651 raft_consensus.cc:3060] T a6a637307cbc440eb70af83b47cc78b0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.659603  4726 raft_consensus.cc:3055] T a6a637307cbc440eb70af83b47cc78b0 P a754210d0a2b403184f611fd5864442b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:17.659885  4726 raft_consensus.cc:740] T a6a637307cbc440eb70af83b47cc78b0 P a754210d0a2b403184f611fd5864442b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a754210d0a2b403184f611fd5864442b, State: Running, Role: LEADER
I20260709 12:12:17.660576  4726 consensus_queue.cc:260] T a6a637307cbc440eb70af83b47cc78b0 P a754210d0a2b403184f611fd5864442b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:17.661774  4726 raft_consensus.cc:3060] T a6a637307cbc440eb70af83b47cc78b0 P a754210d0a2b403184f611fd5864442b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.664269  4793 raft_consensus.cc:993] T 643771d1f41240b5a002a62fdaa0b0d0 P a754210d0a2b403184f611fd5864442b: : Instructing follower 0d5eb6a44dd24ba196d9026aec41ff61 to start an election
I20260709 12:12:17.664716  4793 raft_consensus.cc:1081] T 643771d1f41240b5a002a62fdaa0b0d0 P a754210d0a2b403184f611fd5864442b [term 1 LEADER]: Signalling peer 0d5eb6a44dd24ba196d9026aec41ff61 to start an election
I20260709 12:12:17.666461  4652 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "643771d1f41240b5a002a62fdaa0b0d0"
dest_uuid: "0d5eb6a44dd24ba196d9026aec41ff61"
 from {username='slave'} at 127.0.0.1:59700
I20260709 12:12:17.666950  4652 raft_consensus.cc:493] T 643771d1f41240b5a002a62fdaa0b0d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:17.667304  4652 raft_consensus.cc:3060] T 643771d1f41240b5a002a62fdaa0b0d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.668124  4651 raft_consensus.cc:2468] T a6a637307cbc440eb70af83b47cc78b0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c66b12e0a1cc44b58565da795b7a4b8e in term 2.
I20260709 12:12:17.668728  4726 raft_consensus.cc:2468] T a6a637307cbc440eb70af83b47cc78b0 P a754210d0a2b403184f611fd5864442b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c66b12e0a1cc44b58565da795b7a4b8e in term 2.
I20260709 12:12:17.669621  4540 leader_election.cc:304] T a6a637307cbc440eb70af83b47cc78b0 P c66b12e0a1cc44b58565da795b7a4b8e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d5eb6a44dd24ba196d9026aec41ff61, c66b12e0a1cc44b58565da795b7a4b8e; no voters: 
I20260709 12:12:17.670289  4845 raft_consensus.cc:2804] T a6a637307cbc440eb70af83b47cc78b0 P c66b12e0a1cc44b58565da795b7a4b8e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:17.670747  4845 raft_consensus.cc:697] T a6a637307cbc440eb70af83b47cc78b0 P c66b12e0a1cc44b58565da795b7a4b8e [term 2 LEADER]: Becoming Leader. State: Replica: c66b12e0a1cc44b58565da795b7a4b8e, State: Running, Role: LEADER
I20260709 12:12:17.671343  4845 consensus_queue.cc:237] T a6a637307cbc440eb70af83b47cc78b0 P c66b12e0a1cc44b58565da795b7a4b8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:17.675941  4652 raft_consensus.cc:515] T 643771d1f41240b5a002a62fdaa0b0d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:17.677345  4791 raft_consensus.cc:993] T 559fa0760acb4538bfce94dc6cc9e553 P a754210d0a2b403184f611fd5864442b: : Instructing follower 0d5eb6a44dd24ba196d9026aec41ff61 to start an election
I20260709 12:12:17.677875  4791 raft_consensus.cc:1081] T 559fa0760acb4538bfce94dc6cc9e553 P a754210d0a2b403184f611fd5864442b [term 1 LEADER]: Signalling peer 0d5eb6a44dd24ba196d9026aec41ff61 to start an election
I20260709 12:12:17.678030  4652 leader_election.cc:290] T 643771d1f41240b5a002a62fdaa0b0d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [CANDIDATE]: Term 2 election: Requested vote from peers c66b12e0a1cc44b58565da795b7a4b8e (127.3.212.129:37153), a754210d0a2b403184f611fd5864442b (127.3.212.131:37739)
I20260709 12:12:17.679234  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "643771d1f41240b5a002a62fdaa0b0d0" candidate_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c66b12e0a1cc44b58565da795b7a4b8e"
I20260709 12:12:17.679915  4576 raft_consensus.cc:3060] T 643771d1f41240b5a002a62fdaa0b0d0 P c66b12e0a1cc44b58565da795b7a4b8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.679996  4726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "643771d1f41240b5a002a62fdaa0b0d0" candidate_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a754210d0a2b403184f611fd5864442b"
I20260709 12:12:17.680105  4652 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "559fa0760acb4538bfce94dc6cc9e553"
dest_uuid: "0d5eb6a44dd24ba196d9026aec41ff61"
 from {username='slave'} at 127.0.0.1:59700
I20260709 12:12:17.679386  4470 catalog_manager.cc:5697] T a6a637307cbc440eb70af83b47cc78b0 P c66b12e0a1cc44b58565da795b7a4b8e reported cstate change: term changed from 1 to 2, leader changed from a754210d0a2b403184f611fd5864442b (127.3.212.131) to c66b12e0a1cc44b58565da795b7a4b8e (127.3.212.129). New cstate: current_term: 2 leader_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:17.680652  4726 raft_consensus.cc:3055] T 643771d1f41240b5a002a62fdaa0b0d0 P a754210d0a2b403184f611fd5864442b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:17.680701  4652 raft_consensus.cc:493] T 559fa0760acb4538bfce94dc6cc9e553 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:17.681109  4726 raft_consensus.cc:740] T 643771d1f41240b5a002a62fdaa0b0d0 P a754210d0a2b403184f611fd5864442b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a754210d0a2b403184f611fd5864442b, State: Running, Role: LEADER
I20260709 12:12:17.681236  4652 raft_consensus.cc:3060] T 559fa0760acb4538bfce94dc6cc9e553 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.682138  4726 consensus_queue.cc:260] T 643771d1f41240b5a002a62fdaa0b0d0 P a754210d0a2b403184f611fd5864442b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:17.685431  4726 raft_consensus.cc:3060] T 643771d1f41240b5a002a62fdaa0b0d0 P a754210d0a2b403184f611fd5864442b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.687914  4576 raft_consensus.cc:2468] T 643771d1f41240b5a002a62fdaa0b0d0 P c66b12e0a1cc44b58565da795b7a4b8e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d5eb6a44dd24ba196d9026aec41ff61 in term 2.
I20260709 12:12:17.688287  4652 raft_consensus.cc:515] T 559fa0760acb4538bfce94dc6cc9e553 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:17.689452  4615 leader_election.cc:304] T 643771d1f41240b5a002a62fdaa0b0d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d5eb6a44dd24ba196d9026aec41ff61, c66b12e0a1cc44b58565da795b7a4b8e; no voters: 
I20260709 12:12:17.690503  4652 leader_election.cc:290] T 559fa0760acb4538bfce94dc6cc9e553 P 0d5eb6a44dd24ba196d9026aec41ff61 [CANDIDATE]: Term 2 election: Requested vote from peers c66b12e0a1cc44b58565da795b7a4b8e (127.3.212.129:37153), a754210d0a2b403184f611fd5864442b (127.3.212.131:37739)
I20260709 12:12:17.691395  4575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "559fa0760acb4538bfce94dc6cc9e553" candidate_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c66b12e0a1cc44b58565da795b7a4b8e"
I20260709 12:12:17.691627  4825 raft_consensus.cc:2804] T 643771d1f41240b5a002a62fdaa0b0d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:17.691989  4575 raft_consensus.cc:3060] T 559fa0760acb4538bfce94dc6cc9e553 P c66b12e0a1cc44b58565da795b7a4b8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.692111  4825 raft_consensus.cc:697] T 643771d1f41240b5a002a62fdaa0b0d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 2 LEADER]: Becoming Leader. State: Replica: 0d5eb6a44dd24ba196d9026aec41ff61, State: Running, Role: LEADER
I20260709 12:12:17.692000  4725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "559fa0760acb4538bfce94dc6cc9e553" candidate_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a754210d0a2b403184f611fd5864442b"
I20260709 12:12:17.693434  4725 raft_consensus.cc:3055] T 559fa0760acb4538bfce94dc6cc9e553 P a754210d0a2b403184f611fd5864442b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:17.692992  4825 consensus_queue.cc:237] T 643771d1f41240b5a002a62fdaa0b0d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:17.693763  4725 raft_consensus.cc:740] T 559fa0760acb4538bfce94dc6cc9e553 P a754210d0a2b403184f611fd5864442b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a754210d0a2b403184f611fd5864442b, State: Running, Role: LEADER
I20260709 12:12:17.694751  4726 raft_consensus.cc:2468] T 643771d1f41240b5a002a62fdaa0b0d0 P a754210d0a2b403184f611fd5864442b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d5eb6a44dd24ba196d9026aec41ff61 in term 2.
I20260709 12:12:17.694605  4725 consensus_queue.cc:260] T 559fa0760acb4538bfce94dc6cc9e553 P a754210d0a2b403184f611fd5864442b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:17.695971  4725 raft_consensus.cc:3060] T 559fa0760acb4538bfce94dc6cc9e553 P a754210d0a2b403184f611fd5864442b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:17.698571  4575 raft_consensus.cc:2468] T 559fa0760acb4538bfce94dc6cc9e553 P c66b12e0a1cc44b58565da795b7a4b8e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d5eb6a44dd24ba196d9026aec41ff61 in term 2.
I20260709 12:12:17.699637  4615 leader_election.cc:304] T 559fa0760acb4538bfce94dc6cc9e553 P 0d5eb6a44dd24ba196d9026aec41ff61 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d5eb6a44dd24ba196d9026aec41ff61, c66b12e0a1cc44b58565da795b7a4b8e; no voters: 
I20260709 12:12:17.700456  4825 raft_consensus.cc:2804] T 559fa0760acb4538bfce94dc6cc9e553 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:17.700845  4825 raft_consensus.cc:697] T 559fa0760acb4538bfce94dc6cc9e553 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 2 LEADER]: Becoming Leader. State: Replica: 0d5eb6a44dd24ba196d9026aec41ff61, State: Running, Role: LEADER
I20260709 12:12:17.701588  4825 consensus_queue.cc:237] T 559fa0760acb4538bfce94dc6cc9e553 P 0d5eb6a44dd24ba196d9026aec41ff61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:17.702353  4470 catalog_manager.cc:5697] T 643771d1f41240b5a002a62fdaa0b0d0 P 0d5eb6a44dd24ba196d9026aec41ff61 reported cstate change: term changed from 1 to 2, leader changed from a754210d0a2b403184f611fd5864442b (127.3.212.131) to 0d5eb6a44dd24ba196d9026aec41ff61 (127.3.212.130). New cstate: current_term: 2 leader_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:17.703788  4725 raft_consensus.cc:2468] T 559fa0760acb4538bfce94dc6cc9e553 P a754210d0a2b403184f611fd5864442b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d5eb6a44dd24ba196d9026aec41ff61 in term 2.
I20260709 12:12:17.715528  4470 catalog_manager.cc:5697] T 559fa0760acb4538bfce94dc6cc9e553 P 0d5eb6a44dd24ba196d9026aec41ff61 reported cstate change: term changed from 1 to 2, leader changed from a754210d0a2b403184f611fd5864442b (127.3.212.131) to 0d5eb6a44dd24ba196d9026aec41ff61 (127.3.212.130). New cstate: current_term: 2 leader_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:17.993060  4725 raft_consensus.cc:1275] T 978105aee434435f91eb9b3ddda005c4 P a754210d0a2b403184f611fd5864442b [term 2 FOLLOWER]: Refusing update from remote peer c66b12e0a1cc44b58565da795b7a4b8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:17.994935  4845 consensus_queue.cc:1048] T 978105aee434435f91eb9b3ddda005c4 P c66b12e0a1cc44b58565da795b7a4b8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:18.055325  4725 raft_consensus.cc:1275] T e35f477c83c04eb089f4ccd3042dd99c P a754210d0a2b403184f611fd5864442b [term 2 FOLLOWER]: Refusing update from remote peer c66b12e0a1cc44b58565da795b7a4b8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:18.057689  4800 consensus_queue.cc:1048] T e35f477c83c04eb089f4ccd3042dd99c P c66b12e0a1cc44b58565da795b7a4b8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:18.210506  4725 raft_consensus.cc:1275] T a6a637307cbc440eb70af83b47cc78b0 P a754210d0a2b403184f611fd5864442b [term 2 FOLLOWER]: Refusing update from remote peer c66b12e0a1cc44b58565da795b7a4b8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:18.212288  4800 consensus_queue.cc:1048] T a6a637307cbc440eb70af83b47cc78b0 P c66b12e0a1cc44b58565da795b7a4b8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:12:18.342734  4854 log.cc:927] Time spent T a6a637307cbc440eb70af83b47cc78b0 P a754210d0a2b403184f611fd5864442b: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 12:12:18.345057  4575 raft_consensus.cc:1275] T 239da9ff3cf24b88a55a845f2978db90 P c66b12e0a1cc44b58565da795b7a4b8e [term 2 FOLLOWER]: Refusing update from remote peer a754210d0a2b403184f611fd5864442b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:18.632093  4652 raft_consensus.cc:3060] T 239da9ff3cf24b88a55a845f2978db90 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:18.648633  4651 raft_consensus.cc:1275] T e35f477c83c04eb089f4ccd3042dd99c P 0d5eb6a44dd24ba196d9026aec41ff61 [term 2 FOLLOWER]: Refusing update from remote peer c66b12e0a1cc44b58565da795b7a4b8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:18.654608  4576 raft_consensus.cc:1275] T 559fa0760acb4538bfce94dc6cc9e553 P c66b12e0a1cc44b58565da795b7a4b8e [term 2 FOLLOWER]: Refusing update from remote peer 0d5eb6a44dd24ba196d9026aec41ff61: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:18.654611  4575 raft_consensus.cc:1275] T 643771d1f41240b5a002a62fdaa0b0d0 P c66b12e0a1cc44b58565da795b7a4b8e [term 2 FOLLOWER]: Refusing update from remote peer 0d5eb6a44dd24ba196d9026aec41ff61: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:18.657431  4651 raft_consensus.cc:1275] T 978105aee434435f91eb9b3ddda005c4 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 2 FOLLOWER]: Refusing update from remote peer c66b12e0a1cc44b58565da795b7a4b8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:18.657564  4652 raft_consensus.cc:1275] T 239da9ff3cf24b88a55a845f2978db90 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 2 FOLLOWER]: Refusing update from remote peer a754210d0a2b403184f611fd5864442b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:18.659284  4652 raft_consensus.cc:1275] T a6a637307cbc440eb70af83b47cc78b0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 2 FOLLOWER]: Refusing update from remote peer c66b12e0a1cc44b58565da795b7a4b8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:18.660974  4859 consensus_queue.cc:1048] T 559fa0760acb4538bfce94dc6cc9e553 P 0d5eb6a44dd24ba196d9026aec41ff61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:18.661356  4855 consensus_queue.cc:1048] T 643771d1f41240b5a002a62fdaa0b0d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:18.663542  4651 raft_consensus.cc:1275] T 2993ac2125df4c1696029a2d0663531a P 0d5eb6a44dd24ba196d9026aec41ff61 [term 2 FOLLOWER]: Refusing update from remote peer c66b12e0a1cc44b58565da795b7a4b8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:18.665537  4651 raft_consensus.cc:1275] T c3035351b7444712b999d435424960d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 2 FOLLOWER]: Refusing update from remote peer c66b12e0a1cc44b58565da795b7a4b8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:18.665419  4800 consensus_queue.cc:1048] T e35f477c83c04eb089f4ccd3042dd99c P c66b12e0a1cc44b58565da795b7a4b8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:18.666783  4800 consensus_queue.cc:1048] T 978105aee434435f91eb9b3ddda005c4 P c66b12e0a1cc44b58565da795b7a4b8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:12:18.683045  4726 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.015s	sys 0.025s
W20260709 12:12:18.683480  4726 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.015s	sys 0.025s
I20260709 12:12:18.688977  4772 consensus_queue.cc:1048] T 239da9ff3cf24b88a55a845f2978db90 P a754210d0a2b403184f611fd5864442b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:18.704923  4726 raft_consensus.cc:1275] T 559fa0760acb4538bfce94dc6cc9e553 P a754210d0a2b403184f611fd5864442b [term 2 FOLLOWER]: Refusing update from remote peer 0d5eb6a44dd24ba196d9026aec41ff61: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:18.705073  4861 consensus_queue.cc:1048] T a6a637307cbc440eb70af83b47cc78b0 P c66b12e0a1cc44b58565da795b7a4b8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
W20260709 12:12:18.708871  4724 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.012s	sys 0.010s
I20260709 12:12:18.719972  4862 consensus_queue.cc:1048] T c3035351b7444712b999d435424960d0 P c66b12e0a1cc44b58565da795b7a4b8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:12:18.717356  4724 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.012s	sys 0.011s
I20260709 12:12:18.707840  4861 consensus_queue.cc:1048] T 2993ac2125df4c1696029a2d0663531a P c66b12e0a1cc44b58565da795b7a4b8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:12:18.735608  4726 raft_consensus.cc:1275] T 643771d1f41240b5a002a62fdaa0b0d0 P a754210d0a2b403184f611fd5864442b [term 2 FOLLOWER]: Refusing update from remote peer 0d5eb6a44dd24ba196d9026aec41ff61: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:18.741541  4772 consensus_queue.cc:1048] T 239da9ff3cf24b88a55a845f2978db90 P a754210d0a2b403184f611fd5864442b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:18.741910  4725 raft_consensus.cc:1275] T c3035351b7444712b999d435424960d0 P a754210d0a2b403184f611fd5864442b [term 2 FOLLOWER]: Refusing update from remote peer c66b12e0a1cc44b58565da795b7a4b8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:18.744663  4726 raft_consensus.cc:3060] T 2993ac2125df4c1696029a2d0663531a P a754210d0a2b403184f611fd5864442b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:18.758515  4825 consensus_queue.cc:1048] T 559fa0760acb4538bfce94dc6cc9e553 P 0d5eb6a44dd24ba196d9026aec41ff61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:18.758929  4856 consensus_queue.cc:1048] T 643771d1f41240b5a002a62fdaa0b0d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 12:12:18.800637  4800 consensus_queue.cc:1048] T c3035351b7444712b999d435424960d0 P c66b12e0a1cc44b58565da795b7a4b8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:12:18.829545  4726 raft_consensus.cc:1275] T 2993ac2125df4c1696029a2d0663531a P a754210d0a2b403184f611fd5864442b [term 2 FOLLOWER]: Refusing update from remote peer c66b12e0a1cc44b58565da795b7a4b8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:18.830159  4772 raft_consensus.cc:493] T 2993ac2125df4c1696029a2d0663531a P a754210d0a2b403184f611fd5864442b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.833535  4772 raft_consensus.cc:515] T 2993ac2125df4c1696029a2d0663531a P a754210d0a2b403184f611fd5864442b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:18.864869  4873 consensus_queue.cc:1048] T 2993ac2125df4c1696029a2d0663531a P c66b12e0a1cc44b58565da795b7a4b8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:12:18.879805  4772 leader_election.cc:290] T 2993ac2125df4c1696029a2d0663531a P a754210d0a2b403184f611fd5864442b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c66b12e0a1cc44b58565da795b7a4b8e (127.3.212.129:37153), 0d5eb6a44dd24ba196d9026aec41ff61 (127.3.212.130:34847)
I20260709 12:12:18.884944  4649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2993ac2125df4c1696029a2d0663531a" candidate_uuid: "a754210d0a2b403184f611fd5864442b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" is_pre_election: true
I20260709 12:12:18.905756  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2993ac2125df4c1696029a2d0663531a" candidate_uuid: "a754210d0a2b403184f611fd5864442b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" is_pre_election: true
I20260709 12:12:18.912422  4689 leader_election.cc:304] T 2993ac2125df4c1696029a2d0663531a P a754210d0a2b403184f611fd5864442b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a754210d0a2b403184f611fd5864442b; no voters: 0d5eb6a44dd24ba196d9026aec41ff61, c66b12e0a1cc44b58565da795b7a4b8e
I20260709 12:12:18.934216  4772 raft_consensus.cc:2749] T 2993ac2125df4c1696029a2d0663531a P a754210d0a2b403184f611fd5864442b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:12:19.357054  4673 debug-util.cc:398] Leaking SignalData structure 0x7b0800105b60 after lost signal to thread 3925
W20260709 12:12:19.357947  4673 debug-util.cc:398] Leaking SignalData structure 0x7b08000fb240 after lost signal to thread 4509
W20260709 12:12:19.358718  4673 debug-util.cc:398] Leaking SignalData structure 0x7b080001be60 after lost signal to thread 4601
W20260709 12:12:19.359400  4673 debug-util.cc:398] Leaking SignalData structure 0x7b080001b120 after lost signal to thread 4676
W20260709 12:12:19.360034  4673 debug-util.cc:398] Leaking SignalData structure 0x7b08000aad40 after lost signal to thread 4750
W20260709 12:12:19.497001  3927 debug-util.cc:398] Leaking SignalData structure 0x7b080000f460 after lost signal to thread 4726
I20260709 12:12:20.378958  3922 auto_leader_rebalancer-test.cc:365] The leader distribution is 
I20260709 12:12:20.379920  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:20.401348  4576 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2993ac2125df4c1696029a2d0663531a"
dest_uuid: "c66b12e0a1cc44b58565da795b7a4b8e"
mode: GRACEFUL
new_leader_uuid: "a754210d0a2b403184f611fd5864442b"
 from {username='slave'} at 127.0.0.1:46078
I20260709 12:12:20.401970  4576 raft_consensus.cc:606] T 2993ac2125df4c1696029a2d0663531a P c66b12e0a1cc44b58565da795b7a4b8e [term 2 LEADER]: Received request to transfer leadership to TS a754210d0a2b403184f611fd5864442b
I20260709 12:12:20.404780  4576 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3035351b7444712b999d435424960d0"
dest_uuid: "c66b12e0a1cc44b58565da795b7a4b8e"
mode: GRACEFUL
new_leader_uuid: "a754210d0a2b403184f611fd5864442b"
 from {username='slave'} at 127.0.0.1:46078
I20260709 12:12:20.405272  4576 raft_consensus.cc:606] T c3035351b7444712b999d435424960d0 P c66b12e0a1cc44b58565da795b7a4b8e [term 2 LEADER]: Received request to transfer leadership to TS a754210d0a2b403184f611fd5864442b
I20260709 12:12:20.406417  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:12:20.406992  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:20.528165  4889 raft_consensus.cc:993] T c3035351b7444712b999d435424960d0 P c66b12e0a1cc44b58565da795b7a4b8e: : Instructing follower a754210d0a2b403184f611fd5864442b to start an election
I20260709 12:12:20.528728  4800 raft_consensus.cc:1081] T c3035351b7444712b999d435424960d0 P c66b12e0a1cc44b58565da795b7a4b8e [term 2 LEADER]: Signalling peer a754210d0a2b403184f611fd5864442b to start an election
I20260709 12:12:20.530547  4726 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c3035351b7444712b999d435424960d0"
dest_uuid: "a754210d0a2b403184f611fd5864442b"
 from {username='slave'} at 127.0.0.1:39694
I20260709 12:12:20.531081  4726 raft_consensus.cc:493] T c3035351b7444712b999d435424960d0 P a754210d0a2b403184f611fd5864442b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:20.531373  4726 raft_consensus.cc:3060] T c3035351b7444712b999d435424960d0 P a754210d0a2b403184f611fd5864442b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:20.536005  4726 raft_consensus.cc:515] T c3035351b7444712b999d435424960d0 P a754210d0a2b403184f611fd5864442b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } } peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } }
I20260709 12:12:20.537575  4726 leader_election.cc:290] T c3035351b7444712b999d435424960d0 P a754210d0a2b403184f611fd5864442b [CANDIDATE]: Term 3 election: Requested vote from peers 0d5eb6a44dd24ba196d9026aec41ff61 (127.3.212.130:34847), c66b12e0a1cc44b58565da795b7a4b8e (127.3.212.129:37153)
I20260709 12:12:20.538632  4648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3035351b7444712b999d435424960d0" candidate_uuid: "a754210d0a2b403184f611fd5864442b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0d5eb6a44dd24ba196d9026aec41ff61"
I20260709 12:12:20.538836  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3035351b7444712b999d435424960d0" candidate_uuid: "a754210d0a2b403184f611fd5864442b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c66b12e0a1cc44b58565da795b7a4b8e"
I20260709 12:12:20.539354  4648 raft_consensus.cc:3060] T c3035351b7444712b999d435424960d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:20.539559  4576 raft_consensus.cc:3055] T c3035351b7444712b999d435424960d0 P c66b12e0a1cc44b58565da795b7a4b8e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:20.539975  4576 raft_consensus.cc:740] T c3035351b7444712b999d435424960d0 P c66b12e0a1cc44b58565da795b7a4b8e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c66b12e0a1cc44b58565da795b7a4b8e, State: Running, Role: LEADER
I20260709 12:12:20.540799  4576 consensus_queue.cc:260] T c3035351b7444712b999d435424960d0 P c66b12e0a1cc44b58565da795b7a4b8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } } peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } }
I20260709 12:12:20.542120  4576 raft_consensus.cc:3060] T c3035351b7444712b999d435424960d0 P c66b12e0a1cc44b58565da795b7a4b8e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:20.544771  4648 raft_consensus.cc:2468] T c3035351b7444712b999d435424960d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a754210d0a2b403184f611fd5864442b in term 3.
I20260709 12:12:20.546051  4689 leader_election.cc:304] T c3035351b7444712b999d435424960d0 P a754210d0a2b403184f611fd5864442b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d5eb6a44dd24ba196d9026aec41ff61, a754210d0a2b403184f611fd5864442b; no voters: 
I20260709 12:12:20.546725  4888 raft_consensus.cc:2804] T c3035351b7444712b999d435424960d0 P a754210d0a2b403184f611fd5864442b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:20.547792  4888 raft_consensus.cc:697] T c3035351b7444712b999d435424960d0 P a754210d0a2b403184f611fd5864442b [term 3 LEADER]: Becoming Leader. State: Replica: a754210d0a2b403184f611fd5864442b, State: Running, Role: LEADER
I20260709 12:12:20.548656  4888 consensus_queue.cc:237] T c3035351b7444712b999d435424960d0 P a754210d0a2b403184f611fd5864442b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } } peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } }
I20260709 12:12:20.549327  4576 raft_consensus.cc:2468] T c3035351b7444712b999d435424960d0 P c66b12e0a1cc44b58565da795b7a4b8e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a754210d0a2b403184f611fd5864442b in term 3.
I20260709 12:12:20.556772  4475 catalog_manager.cc:5697] T c3035351b7444712b999d435424960d0 P a754210d0a2b403184f611fd5864442b reported cstate change: term changed from 2 to 3, leader changed from c66b12e0a1cc44b58565da795b7a4b8e (127.3.212.129) to a754210d0a2b403184f611fd5864442b (127.3.212.131). New cstate: current_term: 3 leader_uuid: "a754210d0a2b403184f611fd5864442b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:20.727905  4800 raft_consensus.cc:993] T 2993ac2125df4c1696029a2d0663531a P c66b12e0a1cc44b58565da795b7a4b8e: : Instructing follower a754210d0a2b403184f611fd5864442b to start an election
I20260709 12:12:20.728391  4800 raft_consensus.cc:1081] T 2993ac2125df4c1696029a2d0663531a P c66b12e0a1cc44b58565da795b7a4b8e [term 2 LEADER]: Signalling peer a754210d0a2b403184f611fd5864442b to start an election
I20260709 12:12:20.730217  4726 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2993ac2125df4c1696029a2d0663531a"
dest_uuid: "a754210d0a2b403184f611fd5864442b"
 from {username='slave'} at 127.0.0.1:39694
I20260709 12:12:20.730794  4726 raft_consensus.cc:493] T 2993ac2125df4c1696029a2d0663531a P a754210d0a2b403184f611fd5864442b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:20.731123  4726 raft_consensus.cc:3060] T 2993ac2125df4c1696029a2d0663531a P a754210d0a2b403184f611fd5864442b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:20.737792  4726 raft_consensus.cc:515] T 2993ac2125df4c1696029a2d0663531a P a754210d0a2b403184f611fd5864442b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:20.739880  4726 leader_election.cc:290] T 2993ac2125df4c1696029a2d0663531a P a754210d0a2b403184f611fd5864442b [CANDIDATE]: Term 3 election: Requested vote from peers c66b12e0a1cc44b58565da795b7a4b8e (127.3.212.129:37153), 0d5eb6a44dd24ba196d9026aec41ff61 (127.3.212.130:34847)
I20260709 12:12:20.740962  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2993ac2125df4c1696029a2d0663531a" candidate_uuid: "a754210d0a2b403184f611fd5864442b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c66b12e0a1cc44b58565da795b7a4b8e"
I20260709 12:12:20.741012  4648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2993ac2125df4c1696029a2d0663531a" candidate_uuid: "a754210d0a2b403184f611fd5864442b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0d5eb6a44dd24ba196d9026aec41ff61"
I20260709 12:12:20.741729  4576 raft_consensus.cc:3055] T 2993ac2125df4c1696029a2d0663531a P c66b12e0a1cc44b58565da795b7a4b8e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:20.741791  4648 raft_consensus.cc:3060] T 2993ac2125df4c1696029a2d0663531a P 0d5eb6a44dd24ba196d9026aec41ff61 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:20.742264  4576 raft_consensus.cc:740] T 2993ac2125df4c1696029a2d0663531a P c66b12e0a1cc44b58565da795b7a4b8e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c66b12e0a1cc44b58565da795b7a4b8e, State: Running, Role: LEADER
I20260709 12:12:20.743168  4576 consensus_queue.cc:260] T 2993ac2125df4c1696029a2d0663531a P c66b12e0a1cc44b58565da795b7a4b8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:20.744529  4576 raft_consensus.cc:3060] T 2993ac2125df4c1696029a2d0663531a P c66b12e0a1cc44b58565da795b7a4b8e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:20.747696  4648 raft_consensus.cc:2468] T 2993ac2125df4c1696029a2d0663531a P 0d5eb6a44dd24ba196d9026aec41ff61 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a754210d0a2b403184f611fd5864442b in term 3.
I20260709 12:12:20.748768  4689 leader_election.cc:304] T 2993ac2125df4c1696029a2d0663531a P a754210d0a2b403184f611fd5864442b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d5eb6a44dd24ba196d9026aec41ff61, a754210d0a2b403184f611fd5864442b; no voters: 
I20260709 12:12:20.749495  4888 raft_consensus.cc:2804] T 2993ac2125df4c1696029a2d0663531a P a754210d0a2b403184f611fd5864442b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:20.749938  4888 raft_consensus.cc:697] T 2993ac2125df4c1696029a2d0663531a P a754210d0a2b403184f611fd5864442b [term 3 LEADER]: Becoming Leader. State: Replica: a754210d0a2b403184f611fd5864442b, State: Running, Role: LEADER
I20260709 12:12:20.750808  4888 consensus_queue.cc:237] T 2993ac2125df4c1696029a2d0663531a P a754210d0a2b403184f611fd5864442b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:20.751715  4576 raft_consensus.cc:2468] T 2993ac2125df4c1696029a2d0663531a P c66b12e0a1cc44b58565da795b7a4b8e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a754210d0a2b403184f611fd5864442b in term 3.
I20260709 12:12:20.759094  4475 catalog_manager.cc:5697] T 2993ac2125df4c1696029a2d0663531a P a754210d0a2b403184f611fd5864442b reported cstate change: term changed from 2 to 3, leader changed from c66b12e0a1cc44b58565da795b7a4b8e (127.3.212.129) to a754210d0a2b403184f611fd5864442b (127.3.212.131). New cstate: current_term: 3 leader_uuid: "a754210d0a2b403184f611fd5864442b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:20.960862  4648 raft_consensus.cc:1275] T c3035351b7444712b999d435424960d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 3 FOLLOWER]: Refusing update from remote peer a754210d0a2b403184f611fd5864442b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:20.962338  4888 consensus_queue.cc:1048] T c3035351b7444712b999d435424960d0 P a754210d0a2b403184f611fd5864442b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:20.978117  4576 raft_consensus.cc:1275] T c3035351b7444712b999d435424960d0 P c66b12e0a1cc44b58565da795b7a4b8e [term 3 FOLLOWER]: Refusing update from remote peer a754210d0a2b403184f611fd5864442b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:20.981963  4888 consensus_queue.cc:1048] T c3035351b7444712b999d435424960d0 P a754210d0a2b403184f611fd5864442b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:21.337344  4648 raft_consensus.cc:1275] T 2993ac2125df4c1696029a2d0663531a P 0d5eb6a44dd24ba196d9026aec41ff61 [term 3 FOLLOWER]: Refusing update from remote peer a754210d0a2b403184f611fd5864442b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:21.338973  4888 consensus_queue.cc:1048] T 2993ac2125df4c1696029a2d0663531a P a754210d0a2b403184f611fd5864442b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:21.342381  4576 raft_consensus.cc:1275] T 2993ac2125df4c1696029a2d0663531a P c66b12e0a1cc44b58565da795b7a4b8e [term 3 FOLLOWER]: Refusing update from remote peer a754210d0a2b403184f611fd5864442b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:21.343801  4888 consensus_queue.cc:1048] T 2993ac2125df4c1696029a2d0663531a P a754210d0a2b403184f611fd5864442b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:12:21.408349  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:21.417181  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:21.417812  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:22.418849  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:22.425462  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:22.425837  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:23.426690  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:23.431965  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:23.432392  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:24.433931  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:24.442906  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:24.443387  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:25.444433  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:25.450057  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:25.450501  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:26.451460  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:26.456947  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:26.457403  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:27.458370  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:27.463713  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:27.464107  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:28.465042  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:28.470424  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:28.470863  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:29.471724  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:29.477104  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:29.477610  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:30.514163  3922 auto_leader_rebalancer-test.cc:384] The leader distribution is 
I20260709 12:12:30.519928  4724 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3035351b7444712b999d435424960d0"
dest_uuid: "a754210d0a2b403184f611fd5864442b"
mode: GRACEFUL
new_leader_uuid: "c66b12e0a1cc44b58565da795b7a4b8e"
 from {username='slave'} at 127.0.0.1:39704
I20260709 12:12:30.520774  4724 raft_consensus.cc:606] T c3035351b7444712b999d435424960d0 P a754210d0a2b403184f611fd5864442b [term 3 LEADER]: Received request to transfer leadership to TS c66b12e0a1cc44b58565da795b7a4b8e
I20260709 12:12:30.529668  4724 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2993ac2125df4c1696029a2d0663531a"
dest_uuid: "a754210d0a2b403184f611fd5864442b"
mode: GRACEFUL
new_leader_uuid: "c66b12e0a1cc44b58565da795b7a4b8e"
 from {username='slave'} at 127.0.0.1:39704
I20260709 12:12:30.530252  4724 raft_consensus.cc:606] T 2993ac2125df4c1696029a2d0663531a P a754210d0a2b403184f611fd5864442b [term 3 LEADER]: Received request to transfer leadership to TS c66b12e0a1cc44b58565da795b7a4b8e
I20260709 12:12:30.541359  4648 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "643771d1f41240b5a002a62fdaa0b0d0"
dest_uuid: "0d5eb6a44dd24ba196d9026aec41ff61"
mode: GRACEFUL
new_leader_uuid: "c66b12e0a1cc44b58565da795b7a4b8e"
 from {username='slave'} at 127.0.0.1:59726
I20260709 12:12:30.541921  4648 raft_consensus.cc:606] T 643771d1f41240b5a002a62fdaa0b0d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 2 LEADER]: Received request to transfer leadership to TS c66b12e0a1cc44b58565da795b7a4b8e
I20260709 12:12:30.547358  4648 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62d99d5944b14dca82789362b6d798ce"
dest_uuid: "0d5eb6a44dd24ba196d9026aec41ff61"
mode: GRACEFUL
new_leader_uuid: "c66b12e0a1cc44b58565da795b7a4b8e"
 from {username='slave'} at 127.0.0.1:59726
I20260709 12:12:30.547837  4648 raft_consensus.cc:606] T 62d99d5944b14dca82789362b6d798ce P 0d5eb6a44dd24ba196d9026aec41ff61 [term 1 LEADER]: Received request to transfer leadership to TS c66b12e0a1cc44b58565da795b7a4b8e
I20260709 12:12:30.552598  4648 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0c7d085ac21245e2a3de979566582db6"
dest_uuid: "0d5eb6a44dd24ba196d9026aec41ff61"
mode: GRACEFUL
new_leader_uuid: "c66b12e0a1cc44b58565da795b7a4b8e"
 from {username='slave'} at 127.0.0.1:59726
I20260709 12:12:30.553068  4648 raft_consensus.cc:606] T 0c7d085ac21245e2a3de979566582db6 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 1 LEADER]: Received request to transfer leadership to TS c66b12e0a1cc44b58565da795b7a4b8e
I20260709 12:12:30.652113  4920 raft_consensus.cc:993] T 0c7d085ac21245e2a3de979566582db6 P 0d5eb6a44dd24ba196d9026aec41ff61: : Instructing follower c66b12e0a1cc44b58565da795b7a4b8e to start an election
I20260709 12:12:30.652540  4920 raft_consensus.cc:1081] T 0c7d085ac21245e2a3de979566582db6 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 1 LEADER]: Signalling peer c66b12e0a1cc44b58565da795b7a4b8e to start an election
I20260709 12:12:30.654247  4577 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0c7d085ac21245e2a3de979566582db6"
dest_uuid: "c66b12e0a1cc44b58565da795b7a4b8e"
 from {username='slave'} at 127.0.0.1:46052
I20260709 12:12:30.654785  4577 raft_consensus.cc:493] T 0c7d085ac21245e2a3de979566582db6 P c66b12e0a1cc44b58565da795b7a4b8e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:30.655107  4577 raft_consensus.cc:3060] T 0c7d085ac21245e2a3de979566582db6 P c66b12e0a1cc44b58565da795b7a4b8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:30.661358  4577 raft_consensus.cc:515] T 0c7d085ac21245e2a3de979566582db6 P c66b12e0a1cc44b58565da795b7a4b8e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:30.663467  4577 leader_election.cc:290] T 0c7d085ac21245e2a3de979566582db6 P c66b12e0a1cc44b58565da795b7a4b8e [CANDIDATE]: Term 2 election: Requested vote from peers 0d5eb6a44dd24ba196d9026aec41ff61 (127.3.212.130:34847), a754210d0a2b403184f611fd5864442b (127.3.212.131:37739)
I20260709 12:12:30.664247  4648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7d085ac21245e2a3de979566582db6" candidate_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d5eb6a44dd24ba196d9026aec41ff61"
I20260709 12:12:30.664510  4724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7d085ac21245e2a3de979566582db6" candidate_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a754210d0a2b403184f611fd5864442b"
I20260709 12:12:30.665162  4648 raft_consensus.cc:3055] T 0c7d085ac21245e2a3de979566582db6 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:30.665211  4724 raft_consensus.cc:3060] T 0c7d085ac21245e2a3de979566582db6 P a754210d0a2b403184f611fd5864442b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:30.665589  4648 raft_consensus.cc:740] T 0c7d085ac21245e2a3de979566582db6 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0d5eb6a44dd24ba196d9026aec41ff61, State: Running, Role: LEADER
I20260709 12:12:30.666440  4648 consensus_queue.cc:260] T 0c7d085ac21245e2a3de979566582db6 P 0d5eb6a44dd24ba196d9026aec41ff61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:30.667730  4648 raft_consensus.cc:3060] T 0c7d085ac21245e2a3de979566582db6 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:30.672767  4724 raft_consensus.cc:2468] T 0c7d085ac21245e2a3de979566582db6 P a754210d0a2b403184f611fd5864442b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c66b12e0a1cc44b58565da795b7a4b8e in term 2.
I20260709 12:12:30.674238  4540 leader_election.cc:304] T 0c7d085ac21245e2a3de979566582db6 P c66b12e0a1cc44b58565da795b7a4b8e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a754210d0a2b403184f611fd5864442b, c66b12e0a1cc44b58565da795b7a4b8e; no voters: 
I20260709 12:12:30.674710  4648 raft_consensus.cc:2468] T 0c7d085ac21245e2a3de979566582db6 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c66b12e0a1cc44b58565da795b7a4b8e in term 2.
I20260709 12:12:30.675007  4917 raft_consensus.cc:2804] T 0c7d085ac21245e2a3de979566582db6 P c66b12e0a1cc44b58565da795b7a4b8e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:30.676002  4917 raft_consensus.cc:697] T 0c7d085ac21245e2a3de979566582db6 P c66b12e0a1cc44b58565da795b7a4b8e [term 2 LEADER]: Becoming Leader. State: Replica: c66b12e0a1cc44b58565da795b7a4b8e, State: Running, Role: LEADER
I20260709 12:12:30.676879  4917 consensus_queue.cc:237] T 0c7d085ac21245e2a3de979566582db6 P c66b12e0a1cc44b58565da795b7a4b8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:30.683763  4471 catalog_manager.cc:5697] T 0c7d085ac21245e2a3de979566582db6 P c66b12e0a1cc44b58565da795b7a4b8e reported cstate change: term changed from 1 to 2, leader changed from 0d5eb6a44dd24ba196d9026aec41ff61 (127.3.212.130) to c66b12e0a1cc44b58565da795b7a4b8e (127.3.212.129). New cstate: current_term: 2 leader_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:30.774971  4918 raft_consensus.cc:993] T 2993ac2125df4c1696029a2d0663531a P a754210d0a2b403184f611fd5864442b: : Instructing follower c66b12e0a1cc44b58565da795b7a4b8e to start an election
I20260709 12:12:30.775461  4927 raft_consensus.cc:1081] T 2993ac2125df4c1696029a2d0663531a P a754210d0a2b403184f611fd5864442b [term 3 LEADER]: Signalling peer c66b12e0a1cc44b58565da795b7a4b8e to start an election
I20260709 12:12:30.777235  4577 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2993ac2125df4c1696029a2d0663531a"
dest_uuid: "c66b12e0a1cc44b58565da795b7a4b8e"
 from {username='slave'} at 127.0.0.1:46058
I20260709 12:12:30.777819  4577 raft_consensus.cc:493] T 2993ac2125df4c1696029a2d0663531a P c66b12e0a1cc44b58565da795b7a4b8e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:30.778164  4577 raft_consensus.cc:3060] T 2993ac2125df4c1696029a2d0663531a P c66b12e0a1cc44b58565da795b7a4b8e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:30.783128  4577 raft_consensus.cc:515] T 2993ac2125df4c1696029a2d0663531a P c66b12e0a1cc44b58565da795b7a4b8e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:30.784698  4577 leader_election.cc:290] T 2993ac2125df4c1696029a2d0663531a P c66b12e0a1cc44b58565da795b7a4b8e [CANDIDATE]: Term 4 election: Requested vote from peers 0d5eb6a44dd24ba196d9026aec41ff61 (127.3.212.130:34847), a754210d0a2b403184f611fd5864442b (127.3.212.131:37739)
I20260709 12:12:30.785554  4648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2993ac2125df4c1696029a2d0663531a" candidate_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0d5eb6a44dd24ba196d9026aec41ff61"
I20260709 12:12:30.785843  4724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2993ac2125df4c1696029a2d0663531a" candidate_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a754210d0a2b403184f611fd5864442b"
I20260709 12:12:30.786120  4648 raft_consensus.cc:3060] T 2993ac2125df4c1696029a2d0663531a P 0d5eb6a44dd24ba196d9026aec41ff61 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:30.786346  4724 raft_consensus.cc:3055] T 2993ac2125df4c1696029a2d0663531a P a754210d0a2b403184f611fd5864442b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:12:30.786669  4724 raft_consensus.cc:740] T 2993ac2125df4c1696029a2d0663531a P a754210d0a2b403184f611fd5864442b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a754210d0a2b403184f611fd5864442b, State: Running, Role: LEADER
I20260709 12:12:30.787484  4724 consensus_queue.cc:260] T 2993ac2125df4c1696029a2d0663531a P a754210d0a2b403184f611fd5864442b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:30.788770  4724 raft_consensus.cc:3060] T 2993ac2125df4c1696029a2d0663531a P a754210d0a2b403184f611fd5864442b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:30.792690  4648 raft_consensus.cc:2468] T 2993ac2125df4c1696029a2d0663531a P 0d5eb6a44dd24ba196d9026aec41ff61 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c66b12e0a1cc44b58565da795b7a4b8e in term 4.
I20260709 12:12:30.793975  4540 leader_election.cc:304] T 2993ac2125df4c1696029a2d0663531a P c66b12e0a1cc44b58565da795b7a4b8e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d5eb6a44dd24ba196d9026aec41ff61, c66b12e0a1cc44b58565da795b7a4b8e; no voters: 
I20260709 12:12:30.794627  4917 raft_consensus.cc:2804] T 2993ac2125df4c1696029a2d0663531a P c66b12e0a1cc44b58565da795b7a4b8e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:12:30.794996  4917 raft_consensus.cc:697] T 2993ac2125df4c1696029a2d0663531a P c66b12e0a1cc44b58565da795b7a4b8e [term 4 LEADER]: Becoming Leader. State: Replica: c66b12e0a1cc44b58565da795b7a4b8e, State: Running, Role: LEADER
I20260709 12:12:30.795171  4724 raft_consensus.cc:2468] T 2993ac2125df4c1696029a2d0663531a P a754210d0a2b403184f611fd5864442b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c66b12e0a1cc44b58565da795b7a4b8e in term 4.
I20260709 12:12:30.795913  4917 consensus_queue.cc:237] T 2993ac2125df4c1696029a2d0663531a P c66b12e0a1cc44b58565da795b7a4b8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:30.803115  4471 catalog_manager.cc:5697] T 2993ac2125df4c1696029a2d0663531a P c66b12e0a1cc44b58565da795b7a4b8e reported cstate change: term changed from 3 to 4, leader changed from a754210d0a2b403184f611fd5864442b (127.3.212.131) to c66b12e0a1cc44b58565da795b7a4b8e (127.3.212.129). New cstate: current_term: 4 leader_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:30.811028  4918 raft_consensus.cc:993] T c3035351b7444712b999d435424960d0 P a754210d0a2b403184f611fd5864442b: : Instructing follower c66b12e0a1cc44b58565da795b7a4b8e to start an election
I20260709 12:12:30.811534  4918 raft_consensus.cc:1081] T c3035351b7444712b999d435424960d0 P a754210d0a2b403184f611fd5864442b [term 3 LEADER]: Signalling peer c66b12e0a1cc44b58565da795b7a4b8e to start an election
I20260709 12:12:30.812964  4577 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c3035351b7444712b999d435424960d0"
dest_uuid: "c66b12e0a1cc44b58565da795b7a4b8e"
 from {username='slave'} at 127.0.0.1:46058
I20260709 12:12:30.813520  4577 raft_consensus.cc:493] T c3035351b7444712b999d435424960d0 P c66b12e0a1cc44b58565da795b7a4b8e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:30.813864  4577 raft_consensus.cc:3060] T c3035351b7444712b999d435424960d0 P c66b12e0a1cc44b58565da795b7a4b8e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:30.815291  4919 raft_consensus.cc:993] T 62d99d5944b14dca82789362b6d798ce P 0d5eb6a44dd24ba196d9026aec41ff61: : Instructing follower c66b12e0a1cc44b58565da795b7a4b8e to start an election
I20260709 12:12:30.815724  4920 raft_consensus.cc:1081] T 62d99d5944b14dca82789362b6d798ce P 0d5eb6a44dd24ba196d9026aec41ff61 [term 1 LEADER]: Signalling peer c66b12e0a1cc44b58565da795b7a4b8e to start an election
I20260709 12:12:30.817365  4576 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "62d99d5944b14dca82789362b6d798ce"
dest_uuid: "c66b12e0a1cc44b58565da795b7a4b8e"
 from {username='slave'} at 127.0.0.1:46052
I20260709 12:12:30.817888  4576 raft_consensus.cc:493] T 62d99d5944b14dca82789362b6d798ce P c66b12e0a1cc44b58565da795b7a4b8e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:30.818194  4576 raft_consensus.cc:3060] T 62d99d5944b14dca82789362b6d798ce P c66b12e0a1cc44b58565da795b7a4b8e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:30.819687  4577 raft_consensus.cc:515] T c3035351b7444712b999d435424960d0 P c66b12e0a1cc44b58565da795b7a4b8e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } } peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } }
I20260709 12:12:30.821693  4577 leader_election.cc:290] T c3035351b7444712b999d435424960d0 P c66b12e0a1cc44b58565da795b7a4b8e [CANDIDATE]: Term 4 election: Requested vote from peers 0d5eb6a44dd24ba196d9026aec41ff61 (127.3.212.130:34847), a754210d0a2b403184f611fd5864442b (127.3.212.131:37739)
I20260709 12:12:30.822544  4648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3035351b7444712b999d435424960d0" candidate_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0d5eb6a44dd24ba196d9026aec41ff61"
I20260709 12:12:30.822826  4724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3035351b7444712b999d435424960d0" candidate_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a754210d0a2b403184f611fd5864442b"
I20260709 12:12:30.823180  4648 raft_consensus.cc:3060] T c3035351b7444712b999d435424960d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:30.823396  4724 raft_consensus.cc:3055] T c3035351b7444712b999d435424960d0 P a754210d0a2b403184f611fd5864442b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:12:30.823738  4724 raft_consensus.cc:740] T c3035351b7444712b999d435424960d0 P a754210d0a2b403184f611fd5864442b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a754210d0a2b403184f611fd5864442b, State: Running, Role: LEADER
I20260709 12:12:30.824524  4724 consensus_queue.cc:260] T c3035351b7444712b999d435424960d0 P a754210d0a2b403184f611fd5864442b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } } peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } }
I20260709 12:12:30.824766  4576 raft_consensus.cc:515] T 62d99d5944b14dca82789362b6d798ce P c66b12e0a1cc44b58565da795b7a4b8e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:30.825894  4724 raft_consensus.cc:3060] T c3035351b7444712b999d435424960d0 P a754210d0a2b403184f611fd5864442b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:30.826797  4576 leader_election.cc:290] T 62d99d5944b14dca82789362b6d798ce P c66b12e0a1cc44b58565da795b7a4b8e [CANDIDATE]: Term 2 election: Requested vote from peers 0d5eb6a44dd24ba196d9026aec41ff61 (127.3.212.130:34847), a754210d0a2b403184f611fd5864442b (127.3.212.131:37739)
I20260709 12:12:30.827812  4647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d99d5944b14dca82789362b6d798ce" candidate_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d5eb6a44dd24ba196d9026aec41ff61"
I20260709 12:12:30.828419  4647 raft_consensus.cc:3055] T 62d99d5944b14dca82789362b6d798ce P 0d5eb6a44dd24ba196d9026aec41ff61 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:30.828733  4647 raft_consensus.cc:740] T 62d99d5944b14dca82789362b6d798ce P 0d5eb6a44dd24ba196d9026aec41ff61 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0d5eb6a44dd24ba196d9026aec41ff61, State: Running, Role: LEADER
I20260709 12:12:30.829300  4726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d99d5944b14dca82789362b6d798ce" candidate_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a754210d0a2b403184f611fd5864442b"
I20260709 12:12:30.829865  4726 raft_consensus.cc:3060] T 62d99d5944b14dca82789362b6d798ce P a754210d0a2b403184f611fd5864442b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:30.829840  4647 consensus_queue.cc:260] T 62d99d5944b14dca82789362b6d798ce P 0d5eb6a44dd24ba196d9026aec41ff61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:30.831595  4647 raft_consensus.cc:3060] T 62d99d5944b14dca82789362b6d798ce P 0d5eb6a44dd24ba196d9026aec41ff61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:30.833528  4724 raft_consensus.cc:2468] T c3035351b7444712b999d435424960d0 P a754210d0a2b403184f611fd5864442b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c66b12e0a1cc44b58565da795b7a4b8e in term 4.
I20260709 12:12:30.838156  4540 leader_election.cc:304] T c3035351b7444712b999d435424960d0 P c66b12e0a1cc44b58565da795b7a4b8e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a754210d0a2b403184f611fd5864442b, c66b12e0a1cc44b58565da795b7a4b8e; no voters: 
I20260709 12:12:30.838624  4648 raft_consensus.cc:2468] T c3035351b7444712b999d435424960d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c66b12e0a1cc44b58565da795b7a4b8e in term 4.
I20260709 12:12:30.839013  4917 raft_consensus.cc:2804] T c3035351b7444712b999d435424960d0 P c66b12e0a1cc44b58565da795b7a4b8e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:12:30.838316  4726 raft_consensus.cc:2468] T 62d99d5944b14dca82789362b6d798ce P a754210d0a2b403184f611fd5864442b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c66b12e0a1cc44b58565da795b7a4b8e in term 2.
I20260709 12:12:30.839433  4917 raft_consensus.cc:697] T c3035351b7444712b999d435424960d0 P c66b12e0a1cc44b58565da795b7a4b8e [term 4 LEADER]: Becoming Leader. State: Replica: c66b12e0a1cc44b58565da795b7a4b8e, State: Running, Role: LEADER
I20260709 12:12:30.840335  4540 leader_election.cc:304] T 62d99d5944b14dca82789362b6d798ce P c66b12e0a1cc44b58565da795b7a4b8e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a754210d0a2b403184f611fd5864442b, c66b12e0a1cc44b58565da795b7a4b8e; no voters: 
I20260709 12:12:30.840646  4917 consensus_queue.cc:237] T c3035351b7444712b999d435424960d0 P c66b12e0a1cc44b58565da795b7a4b8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } } peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } }
I20260709 12:12:30.841238  4647 raft_consensus.cc:2468] T 62d99d5944b14dca82789362b6d798ce P 0d5eb6a44dd24ba196d9026aec41ff61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c66b12e0a1cc44b58565da795b7a4b8e in term 2.
I20260709 12:12:30.841903  4921 raft_consensus.cc:2804] T 62d99d5944b14dca82789362b6d798ce P c66b12e0a1cc44b58565da795b7a4b8e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:30.843283  4921 raft_consensus.cc:697] T 62d99d5944b14dca82789362b6d798ce P c66b12e0a1cc44b58565da795b7a4b8e [term 2 LEADER]: Becoming Leader. State: Replica: c66b12e0a1cc44b58565da795b7a4b8e, State: Running, Role: LEADER
I20260709 12:12:30.844189  4921 consensus_queue.cc:237] T 62d99d5944b14dca82789362b6d798ce P c66b12e0a1cc44b58565da795b7a4b8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:30.849046  4471 catalog_manager.cc:5697] T c3035351b7444712b999d435424960d0 P c66b12e0a1cc44b58565da795b7a4b8e reported cstate change: term changed from 3 to 4, leader changed from a754210d0a2b403184f611fd5864442b (127.3.212.131) to c66b12e0a1cc44b58565da795b7a4b8e (127.3.212.129). New cstate: current_term: 4 leader_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:30.860500  4471 catalog_manager.cc:5697] T 62d99d5944b14dca82789362b6d798ce P c66b12e0a1cc44b58565da795b7a4b8e reported cstate change: term changed from 1 to 2, leader changed from 0d5eb6a44dd24ba196d9026aec41ff61 (127.3.212.130) to c66b12e0a1cc44b58565da795b7a4b8e (127.3.212.129). New cstate: current_term: 2 leader_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:30.969696  4919 raft_consensus.cc:993] T 643771d1f41240b5a002a62fdaa0b0d0 P 0d5eb6a44dd24ba196d9026aec41ff61: : Instructing follower c66b12e0a1cc44b58565da795b7a4b8e to start an election
I20260709 12:12:30.970188  4920 raft_consensus.cc:1081] T 643771d1f41240b5a002a62fdaa0b0d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 2 LEADER]: Signalling peer c66b12e0a1cc44b58565da795b7a4b8e to start an election
I20260709 12:12:30.971808  4576 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "643771d1f41240b5a002a62fdaa0b0d0"
dest_uuid: "c66b12e0a1cc44b58565da795b7a4b8e"
 from {username='slave'} at 127.0.0.1:46052
I20260709 12:12:30.972352  4576 raft_consensus.cc:493] T 643771d1f41240b5a002a62fdaa0b0d0 P c66b12e0a1cc44b58565da795b7a4b8e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:30.972643  4576 raft_consensus.cc:3060] T 643771d1f41240b5a002a62fdaa0b0d0 P c66b12e0a1cc44b58565da795b7a4b8e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:30.976823  4576 raft_consensus.cc:515] T 643771d1f41240b5a002a62fdaa0b0d0 P c66b12e0a1cc44b58565da795b7a4b8e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:30.978221  4576 leader_election.cc:290] T 643771d1f41240b5a002a62fdaa0b0d0 P c66b12e0a1cc44b58565da795b7a4b8e [CANDIDATE]: Term 3 election: Requested vote from peers 0d5eb6a44dd24ba196d9026aec41ff61 (127.3.212.130:34847), a754210d0a2b403184f611fd5864442b (127.3.212.131:37739)
I20260709 12:12:30.979206  4647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "643771d1f41240b5a002a62fdaa0b0d0" candidate_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0d5eb6a44dd24ba196d9026aec41ff61"
I20260709 12:12:30.979283  4726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "643771d1f41240b5a002a62fdaa0b0d0" candidate_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a754210d0a2b403184f611fd5864442b"
I20260709 12:12:30.979770  4647 raft_consensus.cc:3055] T 643771d1f41240b5a002a62fdaa0b0d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:30.979863  4726 raft_consensus.cc:3060] T 643771d1f41240b5a002a62fdaa0b0d0 P a754210d0a2b403184f611fd5864442b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:30.980067  4647 raft_consensus.cc:740] T 643771d1f41240b5a002a62fdaa0b0d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0d5eb6a44dd24ba196d9026aec41ff61, State: Running, Role: LEADER
I20260709 12:12:30.980823  4647 consensus_queue.cc:260] T 643771d1f41240b5a002a62fdaa0b0d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:30.981865  4647 raft_consensus.cc:3060] T 643771d1f41240b5a002a62fdaa0b0d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:30.984371  4726 raft_consensus.cc:2468] T 643771d1f41240b5a002a62fdaa0b0d0 P a754210d0a2b403184f611fd5864442b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c66b12e0a1cc44b58565da795b7a4b8e in term 3.
I20260709 12:12:30.985350  4540 leader_election.cc:304] T 643771d1f41240b5a002a62fdaa0b0d0 P c66b12e0a1cc44b58565da795b7a4b8e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a754210d0a2b403184f611fd5864442b, c66b12e0a1cc44b58565da795b7a4b8e; no voters: 
I20260709 12:12:30.986174  4921 raft_consensus.cc:2804] T 643771d1f41240b5a002a62fdaa0b0d0 P c66b12e0a1cc44b58565da795b7a4b8e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:30.986601  4921 raft_consensus.cc:697] T 643771d1f41240b5a002a62fdaa0b0d0 P c66b12e0a1cc44b58565da795b7a4b8e [term 3 LEADER]: Becoming Leader. State: Replica: c66b12e0a1cc44b58565da795b7a4b8e, State: Running, Role: LEADER
I20260709 12:12:30.987169  4647 raft_consensus.cc:2468] T 643771d1f41240b5a002a62fdaa0b0d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c66b12e0a1cc44b58565da795b7a4b8e in term 3.
I20260709 12:12:30.987429  4921 consensus_queue.cc:237] T 643771d1f41240b5a002a62fdaa0b0d0 P c66b12e0a1cc44b58565da795b7a4b8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:30.994503  4471 catalog_manager.cc:5697] T 643771d1f41240b5a002a62fdaa0b0d0 P c66b12e0a1cc44b58565da795b7a4b8e reported cstate change: term changed from 2 to 3, leader changed from 0d5eb6a44dd24ba196d9026aec41ff61 (127.3.212.130) to c66b12e0a1cc44b58565da795b7a4b8e (127.3.212.129). New cstate: current_term: 3 leader_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:31.191097  4647 raft_consensus.cc:1275] T 0c7d085ac21245e2a3de979566582db6 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 2 FOLLOWER]: Refusing update from remote peer c66b12e0a1cc44b58565da795b7a4b8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:31.192448  4921 consensus_queue.cc:1048] T 0c7d085ac21245e2a3de979566582db6 P c66b12e0a1cc44b58565da795b7a4b8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:31.205037  4726 raft_consensus.cc:1275] T 0c7d085ac21245e2a3de979566582db6 P a754210d0a2b403184f611fd5864442b [term 2 FOLLOWER]: Refusing update from remote peer c66b12e0a1cc44b58565da795b7a4b8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:31.206605  4917 consensus_queue.cc:1048] T 0c7d085ac21245e2a3de979566582db6 P c66b12e0a1cc44b58565da795b7a4b8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:31.229189  4648 raft_consensus.cc:1275] T c3035351b7444712b999d435424960d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 4 FOLLOWER]: Refusing update from remote peer c66b12e0a1cc44b58565da795b7a4b8e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:31.230409  4929 consensus_queue.cc:1048] T c3035351b7444712b999d435424960d0 P c66b12e0a1cc44b58565da795b7a4b8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:12:31.239410  4726 raft_consensus.cc:1275] T c3035351b7444712b999d435424960d0 P a754210d0a2b403184f611fd5864442b [term 4 FOLLOWER]: Refusing update from remote peer c66b12e0a1cc44b58565da795b7a4b8e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:31.241436  4929 consensus_queue.cc:1048] T c3035351b7444712b999d435424960d0 P c66b12e0a1cc44b58565da795b7a4b8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:12:31.255237  4648 raft_consensus.cc:1275] T 2993ac2125df4c1696029a2d0663531a P 0d5eb6a44dd24ba196d9026aec41ff61 [term 4 FOLLOWER]: Refusing update from remote peer c66b12e0a1cc44b58565da795b7a4b8e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:31.256567  4929 consensus_queue.cc:1048] T 2993ac2125df4c1696029a2d0663531a P c66b12e0a1cc44b58565da795b7a4b8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:12:31.266739  4726 raft_consensus.cc:1275] T 2993ac2125df4c1696029a2d0663531a P a754210d0a2b403184f611fd5864442b [term 4 FOLLOWER]: Refusing update from remote peer c66b12e0a1cc44b58565da795b7a4b8e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:31.269469  4921 consensus_queue.cc:1048] T 2993ac2125df4c1696029a2d0663531a P c66b12e0a1cc44b58565da795b7a4b8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:12:31.272248  4648 raft_consensus.cc:1275] T 62d99d5944b14dca82789362b6d798ce P 0d5eb6a44dd24ba196d9026aec41ff61 [term 2 FOLLOWER]: Refusing update from remote peer c66b12e0a1cc44b58565da795b7a4b8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:31.274180  4921 consensus_queue.cc:1048] T 62d99d5944b14dca82789362b6d798ce P c66b12e0a1cc44b58565da795b7a4b8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:31.287817  4726 raft_consensus.cc:1275] T 62d99d5944b14dca82789362b6d798ce P a754210d0a2b403184f611fd5864442b [term 2 FOLLOWER]: Refusing update from remote peer c66b12e0a1cc44b58565da795b7a4b8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:31.289054  4921 consensus_queue.cc:1048] T 62d99d5944b14dca82789362b6d798ce P c66b12e0a1cc44b58565da795b7a4b8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:31.418352  4726 raft_consensus.cc:1275] T 643771d1f41240b5a002a62fdaa0b0d0 P a754210d0a2b403184f611fd5864442b [term 3 FOLLOWER]: Refusing update from remote peer c66b12e0a1cc44b58565da795b7a4b8e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:31.419685  4921 consensus_queue.cc:1048] T 643771d1f41240b5a002a62fdaa0b0d0 P c66b12e0a1cc44b58565da795b7a4b8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:31.429013  4648 raft_consensus.cc:1275] T 643771d1f41240b5a002a62fdaa0b0d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 3 FOLLOWER]: Refusing update from remote peer c66b12e0a1cc44b58565da795b7a4b8e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:31.430866  4917 consensus_queue.cc:1048] T 643771d1f41240b5a002a62fdaa0b0d0 P c66b12e0a1cc44b58565da795b7a4b8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:33.667137  3922 auto_leader_rebalancer-test.cc:399] The leader distribution is 
I20260709 12:12:33.668072  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:33.676043  4576 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0c7d085ac21245e2a3de979566582db6"
dest_uuid: "c66b12e0a1cc44b58565da795b7a4b8e"
mode: GRACEFUL
new_leader_uuid: "a754210d0a2b403184f611fd5864442b"
 from {username='slave'} at 127.0.0.1:46078
I20260709 12:12:33.676537  4576 raft_consensus.cc:606] T 0c7d085ac21245e2a3de979566582db6 P c66b12e0a1cc44b58565da795b7a4b8e [term 2 LEADER]: Received request to transfer leadership to TS a754210d0a2b403184f611fd5864442b
I20260709 12:12:33.679299  4576 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2993ac2125df4c1696029a2d0663531a"
dest_uuid: "c66b12e0a1cc44b58565da795b7a4b8e"
mode: GRACEFUL
new_leader_uuid: "0d5eb6a44dd24ba196d9026aec41ff61"
 from {username='slave'} at 127.0.0.1:46078
I20260709 12:12:33.679847  4576 raft_consensus.cc:606] T 2993ac2125df4c1696029a2d0663531a P c66b12e0a1cc44b58565da795b7a4b8e [term 4 LEADER]: Received request to transfer leadership to TS 0d5eb6a44dd24ba196d9026aec41ff61
I20260709 12:12:33.682196  4576 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62d99d5944b14dca82789362b6d798ce"
dest_uuid: "c66b12e0a1cc44b58565da795b7a4b8e"
mode: GRACEFUL
new_leader_uuid: "0d5eb6a44dd24ba196d9026aec41ff61"
 from {username='slave'} at 127.0.0.1:46078
I20260709 12:12:33.682633  4576 raft_consensus.cc:606] T 62d99d5944b14dca82789362b6d798ce P c66b12e0a1cc44b58565da795b7a4b8e [term 2 LEADER]: Received request to transfer leadership to TS 0d5eb6a44dd24ba196d9026aec41ff61
I20260709 12:12:33.684813  4576 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "978105aee434435f91eb9b3ddda005c4"
dest_uuid: "c66b12e0a1cc44b58565da795b7a4b8e"
mode: GRACEFUL
new_leader_uuid: "a754210d0a2b403184f611fd5864442b"
 from {username='slave'} at 127.0.0.1:46078
I20260709 12:12:33.685290  4576 raft_consensus.cc:606] T 978105aee434435f91eb9b3ddda005c4 P c66b12e0a1cc44b58565da795b7a4b8e [term 2 LEADER]: Received request to transfer leadership to TS a754210d0a2b403184f611fd5864442b
I20260709 12:12:33.686400  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:12:33.686810  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:33.718372  4951 raft_consensus.cc:993] T 0c7d085ac21245e2a3de979566582db6 P c66b12e0a1cc44b58565da795b7a4b8e: : Instructing follower a754210d0a2b403184f611fd5864442b to start an election
I20260709 12:12:33.719513  4952 raft_consensus.cc:1081] T 0c7d085ac21245e2a3de979566582db6 P c66b12e0a1cc44b58565da795b7a4b8e [term 2 LEADER]: Signalling peer a754210d0a2b403184f611fd5864442b to start an election
I20260709 12:12:33.721119  4725 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0c7d085ac21245e2a3de979566582db6"
dest_uuid: "a754210d0a2b403184f611fd5864442b"
 from {username='slave'} at 127.0.0.1:39694
I20260709 12:12:33.721681  4725 raft_consensus.cc:493] T 0c7d085ac21245e2a3de979566582db6 P a754210d0a2b403184f611fd5864442b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:33.722062  4725 raft_consensus.cc:3060] T 0c7d085ac21245e2a3de979566582db6 P a754210d0a2b403184f611fd5864442b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:33.727155  4725 raft_consensus.cc:515] T 0c7d085ac21245e2a3de979566582db6 P a754210d0a2b403184f611fd5864442b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:33.729127  4725 leader_election.cc:290] T 0c7d085ac21245e2a3de979566582db6 P a754210d0a2b403184f611fd5864442b [CANDIDATE]: Term 3 election: Requested vote from peers c66b12e0a1cc44b58565da795b7a4b8e (127.3.212.129:37153), 0d5eb6a44dd24ba196d9026aec41ff61 (127.3.212.130:34847)
I20260709 12:12:33.730165  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7d085ac21245e2a3de979566582db6" candidate_uuid: "a754210d0a2b403184f611fd5864442b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c66b12e0a1cc44b58565da795b7a4b8e"
I20260709 12:12:33.730659  4576 raft_consensus.cc:3055] T 0c7d085ac21245e2a3de979566582db6 P c66b12e0a1cc44b58565da795b7a4b8e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:33.730484  4651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c7d085ac21245e2a3de979566582db6" candidate_uuid: "a754210d0a2b403184f611fd5864442b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0d5eb6a44dd24ba196d9026aec41ff61"
I20260709 12:12:33.730973  4576 raft_consensus.cc:740] T 0c7d085ac21245e2a3de979566582db6 P c66b12e0a1cc44b58565da795b7a4b8e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c66b12e0a1cc44b58565da795b7a4b8e, State: Running, Role: LEADER
I20260709 12:12:33.731164  4651 raft_consensus.cc:3060] T 0c7d085ac21245e2a3de979566582db6 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:33.731648  4576 consensus_queue.cc:260] T 0c7d085ac21245e2a3de979566582db6 P c66b12e0a1cc44b58565da795b7a4b8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:33.732486  4576 raft_consensus.cc:3060] T 0c7d085ac21245e2a3de979566582db6 P c66b12e0a1cc44b58565da795b7a4b8e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:33.736660  4576 raft_consensus.cc:2468] T 0c7d085ac21245e2a3de979566582db6 P c66b12e0a1cc44b58565da795b7a4b8e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a754210d0a2b403184f611fd5864442b in term 3.
I20260709 12:12:33.736660  4651 raft_consensus.cc:2468] T 0c7d085ac21245e2a3de979566582db6 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a754210d0a2b403184f611fd5864442b in term 3.
I20260709 12:12:33.738090  4689 leader_election.cc:304] T 0c7d085ac21245e2a3de979566582db6 P a754210d0a2b403184f611fd5864442b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d5eb6a44dd24ba196d9026aec41ff61, a754210d0a2b403184f611fd5864442b; no voters: 
I20260709 12:12:33.738754  4927 raft_consensus.cc:2804] T 0c7d085ac21245e2a3de979566582db6 P a754210d0a2b403184f611fd5864442b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:33.739711  4927 raft_consensus.cc:697] T 0c7d085ac21245e2a3de979566582db6 P a754210d0a2b403184f611fd5864442b [term 3 LEADER]: Becoming Leader. State: Replica: a754210d0a2b403184f611fd5864442b, State: Running, Role: LEADER
I20260709 12:12:33.740533  4927 consensus_queue.cc:237] T 0c7d085ac21245e2a3de979566582db6 P a754210d0a2b403184f611fd5864442b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:33.749557  4470 catalog_manager.cc:5697] T 0c7d085ac21245e2a3de979566582db6 P a754210d0a2b403184f611fd5864442b reported cstate change: term changed from 2 to 3, leader changed from c66b12e0a1cc44b58565da795b7a4b8e (127.3.212.129) to a754210d0a2b403184f611fd5864442b (127.3.212.131). New cstate: current_term: 3 leader_uuid: "a754210d0a2b403184f611fd5864442b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:34.035010  4953 raft_consensus.cc:993] T 978105aee434435f91eb9b3ddda005c4 P c66b12e0a1cc44b58565da795b7a4b8e: : Instructing follower a754210d0a2b403184f611fd5864442b to start an election
I20260709 12:12:34.035440  4953 raft_consensus.cc:1081] T 978105aee434435f91eb9b3ddda005c4 P c66b12e0a1cc44b58565da795b7a4b8e [term 2 LEADER]: Signalling peer a754210d0a2b403184f611fd5864442b to start an election
I20260709 12:12:34.037112  4725 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "978105aee434435f91eb9b3ddda005c4"
dest_uuid: "a754210d0a2b403184f611fd5864442b"
 from {username='slave'} at 127.0.0.1:39694
I20260709 12:12:34.037683  4725 raft_consensus.cc:493] T 978105aee434435f91eb9b3ddda005c4 P a754210d0a2b403184f611fd5864442b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:34.038069  4725 raft_consensus.cc:3060] T 978105aee434435f91eb9b3ddda005c4 P a754210d0a2b403184f611fd5864442b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:34.040125  4952 raft_consensus.cc:993] T 2993ac2125df4c1696029a2d0663531a P c66b12e0a1cc44b58565da795b7a4b8e: : Instructing follower 0d5eb6a44dd24ba196d9026aec41ff61 to start an election
I20260709 12:12:34.040597  4953 raft_consensus.cc:1081] T 2993ac2125df4c1696029a2d0663531a P c66b12e0a1cc44b58565da795b7a4b8e [term 4 LEADER]: Signalling peer 0d5eb6a44dd24ba196d9026aec41ff61 to start an election
I20260709 12:12:34.042232  4651 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2993ac2125df4c1696029a2d0663531a"
dest_uuid: "0d5eb6a44dd24ba196d9026aec41ff61"
 from {username='slave'} at 127.0.0.1:59714
I20260709 12:12:34.042707  4651 raft_consensus.cc:493] T 2993ac2125df4c1696029a2d0663531a P 0d5eb6a44dd24ba196d9026aec41ff61 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:34.042987  4651 raft_consensus.cc:3060] T 2993ac2125df4c1696029a2d0663531a P 0d5eb6a44dd24ba196d9026aec41ff61 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:34.043764  4725 raft_consensus.cc:515] T 978105aee434435f91eb9b3ddda005c4 P a754210d0a2b403184f611fd5864442b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:34.045615  4725 leader_election.cc:290] T 978105aee434435f91eb9b3ddda005c4 P a754210d0a2b403184f611fd5864442b [CANDIDATE]: Term 3 election: Requested vote from peers c66b12e0a1cc44b58565da795b7a4b8e (127.3.212.129:37153), 0d5eb6a44dd24ba196d9026aec41ff61 (127.3.212.130:34847)
I20260709 12:12:34.046692  4650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978105aee434435f91eb9b3ddda005c4" candidate_uuid: "a754210d0a2b403184f611fd5864442b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0d5eb6a44dd24ba196d9026aec41ff61"
I20260709 12:12:34.046708  4576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978105aee434435f91eb9b3ddda005c4" candidate_uuid: "a754210d0a2b403184f611fd5864442b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c66b12e0a1cc44b58565da795b7a4b8e"
I20260709 12:12:34.047446  4650 raft_consensus.cc:3060] T 978105aee434435f91eb9b3ddda005c4 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:34.047473  4576 raft_consensus.cc:3055] T 978105aee434435f91eb9b3ddda005c4 P c66b12e0a1cc44b58565da795b7a4b8e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:34.047973  4576 raft_consensus.cc:740] T 978105aee434435f91eb9b3ddda005c4 P c66b12e0a1cc44b58565da795b7a4b8e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c66b12e0a1cc44b58565da795b7a4b8e, State: Running, Role: LEADER
I20260709 12:12:34.048727  4576 consensus_queue.cc:260] T 978105aee434435f91eb9b3ddda005c4 P c66b12e0a1cc44b58565da795b7a4b8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:34.049103  4651 raft_consensus.cc:515] T 2993ac2125df4c1696029a2d0663531a P 0d5eb6a44dd24ba196d9026aec41ff61 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:34.049978  4576 raft_consensus.cc:3060] T 978105aee434435f91eb9b3ddda005c4 P c66b12e0a1cc44b58565da795b7a4b8e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:34.052207  4651 leader_election.cc:290] T 2993ac2125df4c1696029a2d0663531a P 0d5eb6a44dd24ba196d9026aec41ff61 [CANDIDATE]: Term 5 election: Requested vote from peers c66b12e0a1cc44b58565da795b7a4b8e (127.3.212.129:37153), a754210d0a2b403184f611fd5864442b (127.3.212.131:37739)
I20260709 12:12:34.053812  4725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2993ac2125df4c1696029a2d0663531a" candidate_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "a754210d0a2b403184f611fd5864442b"
I20260709 12:12:34.054039  4650 raft_consensus.cc:2468] T 978105aee434435f91eb9b3ddda005c4 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a754210d0a2b403184f611fd5864442b in term 3.
I20260709 12:12:34.054459  4725 raft_consensus.cc:3060] T 2993ac2125df4c1696029a2d0663531a P a754210d0a2b403184f611fd5864442b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:34.055115  4689 leader_election.cc:304] T 978105aee434435f91eb9b3ddda005c4 P a754210d0a2b403184f611fd5864442b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d5eb6a44dd24ba196d9026aec41ff61, a754210d0a2b403184f611fd5864442b; no voters: 
I20260709 12:12:34.055902  4927 raft_consensus.cc:2804] T 978105aee434435f91eb9b3ddda005c4 P a754210d0a2b403184f611fd5864442b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:34.056198  4576 raft_consensus.cc:2468] T 978105aee434435f91eb9b3ddda005c4 P c66b12e0a1cc44b58565da795b7a4b8e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a754210d0a2b403184f611fd5864442b in term 3.
I20260709 12:12:34.056362  4927 raft_consensus.cc:697] T 978105aee434435f91eb9b3ddda005c4 P a754210d0a2b403184f611fd5864442b [term 3 LEADER]: Becoming Leader. State: Replica: a754210d0a2b403184f611fd5864442b, State: Running, Role: LEADER
I20260709 12:12:34.056833  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2993ac2125df4c1696029a2d0663531a" candidate_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "c66b12e0a1cc44b58565da795b7a4b8e"
I20260709 12:12:34.057404  4577 raft_consensus.cc:3055] T 2993ac2125df4c1696029a2d0663531a P c66b12e0a1cc44b58565da795b7a4b8e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:12:34.057282  4927 consensus_queue.cc:237] T 978105aee434435f91eb9b3ddda005c4 P a754210d0a2b403184f611fd5864442b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:34.057736  4577 raft_consensus.cc:740] T 2993ac2125df4c1696029a2d0663531a P c66b12e0a1cc44b58565da795b7a4b8e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c66b12e0a1cc44b58565da795b7a4b8e, State: Running, Role: LEADER
I20260709 12:12:34.058580  4577 consensus_queue.cc:260] T 2993ac2125df4c1696029a2d0663531a P c66b12e0a1cc44b58565da795b7a4b8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:34.059705  4577 raft_consensus.cc:3060] T 2993ac2125df4c1696029a2d0663531a P c66b12e0a1cc44b58565da795b7a4b8e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:12:34.062563  4725 raft_consensus.cc:2468] T 2993ac2125df4c1696029a2d0663531a P a754210d0a2b403184f611fd5864442b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d5eb6a44dd24ba196d9026aec41ff61 in term 5.
I20260709 12:12:34.064009  4615 leader_election.cc:304] T 2993ac2125df4c1696029a2d0663531a P 0d5eb6a44dd24ba196d9026aec41ff61 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d5eb6a44dd24ba196d9026aec41ff61, a754210d0a2b403184f611fd5864442b; no voters: 
I20260709 12:12:34.064663  4950 raft_consensus.cc:2804] T 2993ac2125df4c1696029a2d0663531a P 0d5eb6a44dd24ba196d9026aec41ff61 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:12:34.065910  4950 raft_consensus.cc:697] T 2993ac2125df4c1696029a2d0663531a P 0d5eb6a44dd24ba196d9026aec41ff61 [term 5 LEADER]: Becoming Leader. State: Replica: 0d5eb6a44dd24ba196d9026aec41ff61, State: Running, Role: LEADER
I20260709 12:12:34.066874  4950 consensus_queue.cc:237] T 2993ac2125df4c1696029a2d0663531a P 0d5eb6a44dd24ba196d9026aec41ff61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:34.066916  4470 catalog_manager.cc:5697] T 978105aee434435f91eb9b3ddda005c4 P a754210d0a2b403184f611fd5864442b reported cstate change: term changed from 2 to 3, leader changed from c66b12e0a1cc44b58565da795b7a4b8e (127.3.212.129) to a754210d0a2b403184f611fd5864442b (127.3.212.131). New cstate: current_term: 3 leader_uuid: "a754210d0a2b403184f611fd5864442b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:34.068482  4577 raft_consensus.cc:2468] T 2993ac2125df4c1696029a2d0663531a P c66b12e0a1cc44b58565da795b7a4b8e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d5eb6a44dd24ba196d9026aec41ff61 in term 5.
I20260709 12:12:34.075721  4471 catalog_manager.cc:5697] T 2993ac2125df4c1696029a2d0663531a P 0d5eb6a44dd24ba196d9026aec41ff61 reported cstate change: term changed from 4 to 5, leader changed from c66b12e0a1cc44b58565da795b7a4b8e (127.3.212.129) to 0d5eb6a44dd24ba196d9026aec41ff61 (127.3.212.130). New cstate: current_term: 5 leader_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:34.156888  4673 debug-util.cc:398] Leaking SignalData structure 0x7b080017d800 after lost signal to thread 3925
W20260709 12:12:34.157999  4673 debug-util.cc:398] Leaking SignalData structure 0x7b08000e89a0 after lost signal to thread 4509
W20260709 12:12:34.158917  4673 debug-util.cc:398] Leaking SignalData structure 0x7b0800105ea0 after lost signal to thread 4601
W20260709 12:12:34.159751  4673 debug-util.cc:398] Leaking SignalData structure 0x7b08001dbae0 after lost signal to thread 4676
W20260709 12:12:34.161123  4673 debug-util.cc:398] Leaking SignalData structure 0x7b08001f1660 after lost signal to thread 4750
I20260709 12:12:34.207603  4952 raft_consensus.cc:993] T 62d99d5944b14dca82789362b6d798ce P c66b12e0a1cc44b58565da795b7a4b8e: : Instructing follower 0d5eb6a44dd24ba196d9026aec41ff61 to start an election
I20260709 12:12:34.208245  4953 raft_consensus.cc:1081] T 62d99d5944b14dca82789362b6d798ce P c66b12e0a1cc44b58565da795b7a4b8e [term 2 LEADER]: Signalling peer 0d5eb6a44dd24ba196d9026aec41ff61 to start an election
I20260709 12:12:34.210237  4650 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "62d99d5944b14dca82789362b6d798ce"
dest_uuid: "0d5eb6a44dd24ba196d9026aec41ff61"
 from {username='slave'} at 127.0.0.1:59714
I20260709 12:12:34.210815  4650 raft_consensus.cc:493] T 62d99d5944b14dca82789362b6d798ce P 0d5eb6a44dd24ba196d9026aec41ff61 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:34.211170  4650 raft_consensus.cc:3060] T 62d99d5944b14dca82789362b6d798ce P 0d5eb6a44dd24ba196d9026aec41ff61 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:34.217644  4650 raft_consensus.cc:515] T 62d99d5944b14dca82789362b6d798ce P 0d5eb6a44dd24ba196d9026aec41ff61 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:34.219444  4650 leader_election.cc:290] T 62d99d5944b14dca82789362b6d798ce P 0d5eb6a44dd24ba196d9026aec41ff61 [CANDIDATE]: Term 3 election: Requested vote from peers c66b12e0a1cc44b58565da795b7a4b8e (127.3.212.129:37153), a754210d0a2b403184f611fd5864442b (127.3.212.131:37739)
I20260709 12:12:34.220944  4577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d99d5944b14dca82789362b6d798ce" candidate_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c66b12e0a1cc44b58565da795b7a4b8e"
I20260709 12:12:34.221050  4725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d99d5944b14dca82789362b6d798ce" candidate_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a754210d0a2b403184f611fd5864442b"
I20260709 12:12:34.221568  4577 raft_consensus.cc:3055] T 62d99d5944b14dca82789362b6d798ce P c66b12e0a1cc44b58565da795b7a4b8e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:34.221714  4725 raft_consensus.cc:3060] T 62d99d5944b14dca82789362b6d798ce P a754210d0a2b403184f611fd5864442b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:34.221809  4577 raft_consensus.cc:740] T 62d99d5944b14dca82789362b6d798ce P c66b12e0a1cc44b58565da795b7a4b8e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c66b12e0a1cc44b58565da795b7a4b8e, State: Running, Role: LEADER
I20260709 12:12:34.222712  4577 consensus_queue.cc:260] T 62d99d5944b14dca82789362b6d798ce P c66b12e0a1cc44b58565da795b7a4b8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:34.223888  4577 raft_consensus.cc:3060] T 62d99d5944b14dca82789362b6d798ce P c66b12e0a1cc44b58565da795b7a4b8e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:34.228027  4725 raft_consensus.cc:2468] T 62d99d5944b14dca82789362b6d798ce P a754210d0a2b403184f611fd5864442b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d5eb6a44dd24ba196d9026aec41ff61 in term 3.
I20260709 12:12:34.228715  4577 raft_consensus.cc:2468] T 62d99d5944b14dca82789362b6d798ce P c66b12e0a1cc44b58565da795b7a4b8e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d5eb6a44dd24ba196d9026aec41ff61 in term 3.
I20260709 12:12:34.229313  4615 leader_election.cc:304] T 62d99d5944b14dca82789362b6d798ce P 0d5eb6a44dd24ba196d9026aec41ff61 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d5eb6a44dd24ba196d9026aec41ff61, a754210d0a2b403184f611fd5864442b; no voters: 
I20260709 12:12:34.230145  4950 raft_consensus.cc:2804] T 62d99d5944b14dca82789362b6d798ce P 0d5eb6a44dd24ba196d9026aec41ff61 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:34.230567  4950 raft_consensus.cc:697] T 62d99d5944b14dca82789362b6d798ce P 0d5eb6a44dd24ba196d9026aec41ff61 [term 3 LEADER]: Becoming Leader. State: Replica: 0d5eb6a44dd24ba196d9026aec41ff61, State: Running, Role: LEADER
I20260709 12:12:34.231463  4950 consensus_queue.cc:237] T 62d99d5944b14dca82789362b6d798ce P 0d5eb6a44dd24ba196d9026aec41ff61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } }
I20260709 12:12:34.238704  4471 catalog_manager.cc:5697] T 62d99d5944b14dca82789362b6d798ce P 0d5eb6a44dd24ba196d9026aec41ff61 reported cstate change: term changed from 2 to 3, leader changed from c66b12e0a1cc44b58565da795b7a4b8e (127.3.212.129) to 0d5eb6a44dd24ba196d9026aec41ff61 (127.3.212.130). New cstate: current_term: 3 leader_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:34.274195  4650 raft_consensus.cc:1275] T 0c7d085ac21245e2a3de979566582db6 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 3 FOLLOWER]: Refusing update from remote peer a754210d0a2b403184f611fd5864442b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:34.275750  4927 consensus_queue.cc:1048] T 0c7d085ac21245e2a3de979566582db6 P a754210d0a2b403184f611fd5864442b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:12:34.291841  4577 raft_consensus.cc:1275] T 0c7d085ac21245e2a3de979566582db6 P c66b12e0a1cc44b58565da795b7a4b8e [term 3 FOLLOWER]: Refusing update from remote peer a754210d0a2b403184f611fd5864442b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:34.293118  4927 consensus_queue.cc:1048] T 0c7d085ac21245e2a3de979566582db6 P a754210d0a2b403184f611fd5864442b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:34.493070  4725 raft_consensus.cc:1275] T 2993ac2125df4c1696029a2d0663531a P a754210d0a2b403184f611fd5864442b [term 5 FOLLOWER]: Refusing update from remote peer 0d5eb6a44dd24ba196d9026aec41ff61: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:12:34.494242  4950 consensus_queue.cc:1048] T 2993ac2125df4c1696029a2d0663531a P 0d5eb6a44dd24ba196d9026aec41ff61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:12:34.506120  4577 raft_consensus.cc:1275] T 2993ac2125df4c1696029a2d0663531a P c66b12e0a1cc44b58565da795b7a4b8e [term 5 FOLLOWER]: Refusing update from remote peer 0d5eb6a44dd24ba196d9026aec41ff61: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:12:34.507277  4650 raft_consensus.cc:1275] T 978105aee434435f91eb9b3ddda005c4 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 3 FOLLOWER]: Refusing update from remote peer a754210d0a2b403184f611fd5864442b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:34.507740  4961 consensus_queue.cc:1048] T 2993ac2125df4c1696029a2d0663531a P 0d5eb6a44dd24ba196d9026aec41ff61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:12:34.508728  4927 consensus_queue.cc:1048] T 978105aee434435f91eb9b3ddda005c4 P a754210d0a2b403184f611fd5864442b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d5eb6a44dd24ba196d9026aec41ff61" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 34847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:34.524058  4577 raft_consensus.cc:1275] T 978105aee434435f91eb9b3ddda005c4 P c66b12e0a1cc44b58565da795b7a4b8e [term 3 FOLLOWER]: Refusing update from remote peer a754210d0a2b403184f611fd5864442b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:34.527154  4927 consensus_queue.cc:1048] T 978105aee434435f91eb9b3ddda005c4 P a754210d0a2b403184f611fd5864442b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:34.667896  4577 raft_consensus.cc:1275] T 62d99d5944b14dca82789362b6d798ce P c66b12e0a1cc44b58565da795b7a4b8e [term 3 FOLLOWER]: Refusing update from remote peer 0d5eb6a44dd24ba196d9026aec41ff61: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:34.669334  4961 consensus_queue.cc:1048] T 62d99d5944b14dca82789362b6d798ce P 0d5eb6a44dd24ba196d9026aec41ff61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c66b12e0a1cc44b58565da795b7a4b8e" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:34.677768  4725 raft_consensus.cc:1275] T 62d99d5944b14dca82789362b6d798ce P a754210d0a2b403184f611fd5864442b [term 3 FOLLOWER]: Refusing update from remote peer 0d5eb6a44dd24ba196d9026aec41ff61: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:34.679303  4950 consensus_queue.cc:1048] T 62d99d5944b14dca82789362b6d798ce P 0d5eb6a44dd24ba196d9026aec41ff61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a754210d0a2b403184f611fd5864442b" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 37739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:34.687922  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:34.695067  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:34.695617  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:35.696549  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:35.702119  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:35.702535  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:36.703590  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:36.709939  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:36.710394  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:37.799029  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:37.807971  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:37.808663  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:12:38.401737  4543 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.025s	sys 0.000s
W20260709 12:12:38.402374  4543 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.025s	sys 0.000s
W20260709 12:12:38.541983  4598 debug-util.cc:398] Leaking SignalData structure 0x7b080010e560 after lost signal to thread 3925
W20260709 12:12:38.542977  4598 debug-util.cc:398] Leaking SignalData structure 0x7b08001c6d20 after lost signal to thread 4509
W20260709 12:12:38.543923  4598 debug-util.cc:398] Leaking SignalData structure 0x7b08001e1d40 after lost signal to thread 4601
W20260709 12:12:38.544727  4598 debug-util.cc:398] Leaking SignalData structure 0x7b08000eede0 after lost signal to thread 4676
W20260709 12:12:38.545531  4598 debug-util.cc:398] Leaking SignalData structure 0x7b08001385a0 after lost signal to thread 4750
I20260709 12:12:38.812709  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:38.818814  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:38.819279  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:39.820385  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:39.826519  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:39.826941  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:40.827857  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:40.834507  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:40.834946  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:41.835940  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:41.841548  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:41.841964  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:42.842984  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:42.848719  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:42.849164  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:43.884799  3922 auto_leader_rebalancer-test.cc:410] The leader distribution is 
I20260709 12:12:43.885437  3922 tablet_server.cc:179] TabletServer@127.3.212.129:0 shutting down...
I20260709 12:12:43.908833  3922 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:43.909569  3922 tablet_replica.cc:333] T 0c7d085ac21245e2a3de979566582db6 P c66b12e0a1cc44b58565da795b7a4b8e: stopping tablet replica
I20260709 12:12:43.910444  3922 raft_consensus.cc:2243] T 0c7d085ac21245e2a3de979566582db6 P c66b12e0a1cc44b58565da795b7a4b8e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:43.910858  3922 raft_consensus.cc:2272] T 0c7d085ac21245e2a3de979566582db6 P c66b12e0a1cc44b58565da795b7a4b8e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:43.912582  3922 tablet_replica.cc:333] T 62d99d5944b14dca82789362b6d798ce P c66b12e0a1cc44b58565da795b7a4b8e: stopping tablet replica
I20260709 12:12:43.913069  3922 raft_consensus.cc:2243] T 62d99d5944b14dca82789362b6d798ce P c66b12e0a1cc44b58565da795b7a4b8e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:43.913506  3922 raft_consensus.cc:2272] T 62d99d5944b14dca82789362b6d798ce P c66b12e0a1cc44b58565da795b7a4b8e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:43.915234  3922 tablet_replica.cc:333] T 2993ac2125df4c1696029a2d0663531a P c66b12e0a1cc44b58565da795b7a4b8e: stopping tablet replica
I20260709 12:12:43.915686  3922 raft_consensus.cc:2243] T 2993ac2125df4c1696029a2d0663531a P c66b12e0a1cc44b58565da795b7a4b8e [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:43.916049  3922 raft_consensus.cc:2272] T 2993ac2125df4c1696029a2d0663531a P c66b12e0a1cc44b58565da795b7a4b8e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:43.917798  3922 tablet_replica.cc:333] T 559fa0760acb4538bfce94dc6cc9e553 P c66b12e0a1cc44b58565da795b7a4b8e: stopping tablet replica
I20260709 12:12:43.918246  3922 raft_consensus.cc:2243] T 559fa0760acb4538bfce94dc6cc9e553 P c66b12e0a1cc44b58565da795b7a4b8e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:43.918625  3922 raft_consensus.cc:2272] T 559fa0760acb4538bfce94dc6cc9e553 P c66b12e0a1cc44b58565da795b7a4b8e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:43.920570  3922 tablet_replica.cc:333] T 978105aee434435f91eb9b3ddda005c4 P c66b12e0a1cc44b58565da795b7a4b8e: stopping tablet replica
I20260709 12:12:43.921298  3922 raft_consensus.cc:2243] T 978105aee434435f91eb9b3ddda005c4 P c66b12e0a1cc44b58565da795b7a4b8e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:43.922215  3922 raft_consensus.cc:2272] T 978105aee434435f91eb9b3ddda005c4 P c66b12e0a1cc44b58565da795b7a4b8e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:43.924671  3922 tablet_replica.cc:333] T 643771d1f41240b5a002a62fdaa0b0d0 P c66b12e0a1cc44b58565da795b7a4b8e: stopping tablet replica
I20260709 12:12:43.925335  3922 raft_consensus.cc:2243] T 643771d1f41240b5a002a62fdaa0b0d0 P c66b12e0a1cc44b58565da795b7a4b8e [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:12:43.926302  3922 raft_consensus.cc:2272] T 643771d1f41240b5a002a62fdaa0b0d0 P c66b12e0a1cc44b58565da795b7a4b8e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:43.928695  3922 tablet_replica.cc:333] T 239da9ff3cf24b88a55a845f2978db90 P c66b12e0a1cc44b58565da795b7a4b8e: stopping tablet replica
I20260709 12:12:43.929229  3922 raft_consensus.cc:2243] T 239da9ff3cf24b88a55a845f2978db90 P c66b12e0a1cc44b58565da795b7a4b8e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:43.929749  3922 raft_consensus.cc:2272] T 239da9ff3cf24b88a55a845f2978db90 P c66b12e0a1cc44b58565da795b7a4b8e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:43.931388  3922 tablet_replica.cc:333] T c3035351b7444712b999d435424960d0 P c66b12e0a1cc44b58565da795b7a4b8e: stopping tablet replica
I20260709 12:12:43.931865  3922 raft_consensus.cc:2243] T c3035351b7444712b999d435424960d0 P c66b12e0a1cc44b58565da795b7a4b8e [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:12:43.932634  3922 raft_consensus.cc:2272] T c3035351b7444712b999d435424960d0 P c66b12e0a1cc44b58565da795b7a4b8e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:43.934489  3922 tablet_replica.cc:333] T a6a637307cbc440eb70af83b47cc78b0 P c66b12e0a1cc44b58565da795b7a4b8e: stopping tablet replica
I20260709 12:12:43.934964  3922 raft_consensus.cc:2243] T a6a637307cbc440eb70af83b47cc78b0 P c66b12e0a1cc44b58565da795b7a4b8e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:43.935707  3922 raft_consensus.cc:2272] T a6a637307cbc440eb70af83b47cc78b0 P c66b12e0a1cc44b58565da795b7a4b8e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:43.937469  3922 tablet_replica.cc:333] T e35f477c83c04eb089f4ccd3042dd99c P c66b12e0a1cc44b58565da795b7a4b8e: stopping tablet replica
I20260709 12:12:43.937937  3922 raft_consensus.cc:2243] T e35f477c83c04eb089f4ccd3042dd99c P c66b12e0a1cc44b58565da795b7a4b8e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:43.938697  3922 raft_consensus.cc:2272] T e35f477c83c04eb089f4ccd3042dd99c P c66b12e0a1cc44b58565da795b7a4b8e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:43.988425  3922 tablet_server.cc:196] TabletServer@127.3.212.129:0 shutdown complete.
I20260709 12:12:44.009071  3922 tablet_server.cc:179] TabletServer@127.3.212.130:0 shutting down...
W20260709 12:12:44.030970  4689 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 7 similar messages]
W20260709 12:12:44.035452  4689 consensus_peers.cc:597] T 0c7d085ac21245e2a3de979566582db6 P a754210d0a2b403184f611fd5864442b -> Peer 0d5eb6a44dd24ba196d9026aec41ff61 (127.3.212.130:34847): Couldn't send request to peer 0d5eb6a44dd24ba196d9026aec41ff61. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:44.039100  3922 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:44.039824  3922 tablet_replica.cc:333] T e35f477c83c04eb089f4ccd3042dd99c P 0d5eb6a44dd24ba196d9026aec41ff61: stopping tablet replica
I20260709 12:12:44.040467  3922 raft_consensus.cc:2243] T e35f477c83c04eb089f4ccd3042dd99c P 0d5eb6a44dd24ba196d9026aec41ff61 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.040958  3922 raft_consensus.cc:2272] T e35f477c83c04eb089f4ccd3042dd99c P 0d5eb6a44dd24ba196d9026aec41ff61 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.042918  3922 tablet_replica.cc:333] T 0c7d085ac21245e2a3de979566582db6 P 0d5eb6a44dd24ba196d9026aec41ff61: stopping tablet replica
I20260709 12:12:44.043433  3922 raft_consensus.cc:2243] T 0c7d085ac21245e2a3de979566582db6 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.043862  3922 raft_consensus.cc:2272] T 0c7d085ac21245e2a3de979566582db6 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.045569  3922 tablet_replica.cc:333] T 559fa0760acb4538bfce94dc6cc9e553 P 0d5eb6a44dd24ba196d9026aec41ff61: stopping tablet replica
I20260709 12:12:44.046082  3922 raft_consensus.cc:2243] T 559fa0760acb4538bfce94dc6cc9e553 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:44.046820  3922 raft_consensus.cc:2272] T 559fa0760acb4538bfce94dc6cc9e553 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.048501  3922 tablet_replica.cc:333] T 978105aee434435f91eb9b3ddda005c4 P 0d5eb6a44dd24ba196d9026aec41ff61: stopping tablet replica
I20260709 12:12:44.049036  3922 raft_consensus.cc:2243] T 978105aee434435f91eb9b3ddda005c4 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.049530  3922 raft_consensus.cc:2272] T 978105aee434435f91eb9b3ddda005c4 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.051321  3922 tablet_replica.cc:333] T 643771d1f41240b5a002a62fdaa0b0d0 P 0d5eb6a44dd24ba196d9026aec41ff61: stopping tablet replica
I20260709 12:12:44.051843  3922 raft_consensus.cc:2243] T 643771d1f41240b5a002a62fdaa0b0d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.052274  3922 raft_consensus.cc:2272] T 643771d1f41240b5a002a62fdaa0b0d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.054154  3922 tablet_replica.cc:333] T 62d99d5944b14dca82789362b6d798ce P 0d5eb6a44dd24ba196d9026aec41ff61: stopping tablet replica
I20260709 12:12:44.054734  3922 raft_consensus.cc:2243] T 62d99d5944b14dca82789362b6d798ce P 0d5eb6a44dd24ba196d9026aec41ff61 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:12:44.055507  3922 raft_consensus.cc:2272] T 62d99d5944b14dca82789362b6d798ce P 0d5eb6a44dd24ba196d9026aec41ff61 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.057258  3922 tablet_replica.cc:333] T 2993ac2125df4c1696029a2d0663531a P 0d5eb6a44dd24ba196d9026aec41ff61: stopping tablet replica
I20260709 12:12:44.057910  3922 raft_consensus.cc:2243] T 2993ac2125df4c1696029a2d0663531a P 0d5eb6a44dd24ba196d9026aec41ff61 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:12:44.058593  3922 raft_consensus.cc:2272] T 2993ac2125df4c1696029a2d0663531a P 0d5eb6a44dd24ba196d9026aec41ff61 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.060277  3922 tablet_replica.cc:333] T 239da9ff3cf24b88a55a845f2978db90 P 0d5eb6a44dd24ba196d9026aec41ff61: stopping tablet replica
I20260709 12:12:44.060774  3922 raft_consensus.cc:2243] T 239da9ff3cf24b88a55a845f2978db90 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.061175  3922 raft_consensus.cc:2272] T 239da9ff3cf24b88a55a845f2978db90 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.062923  3922 tablet_replica.cc:333] T a6a637307cbc440eb70af83b47cc78b0 P 0d5eb6a44dd24ba196d9026aec41ff61: stopping tablet replica
I20260709 12:12:44.063395  3922 raft_consensus.cc:2243] T a6a637307cbc440eb70af83b47cc78b0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.063789  3922 raft_consensus.cc:2272] T a6a637307cbc440eb70af83b47cc78b0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.065784  3922 tablet_replica.cc:333] T c3035351b7444712b999d435424960d0 P 0d5eb6a44dd24ba196d9026aec41ff61: stopping tablet replica
I20260709 12:12:44.066241  3922 raft_consensus.cc:2243] T c3035351b7444712b999d435424960d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.066659  3922 raft_consensus.cc:2272] T c3035351b7444712b999d435424960d0 P 0d5eb6a44dd24ba196d9026aec41ff61 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:44.119141  4689 consensus_peers.cc:597] T 239da9ff3cf24b88a55a845f2978db90 P a754210d0a2b403184f611fd5864442b -> Peer 0d5eb6a44dd24ba196d9026aec41ff61 (127.3.212.130:34847): Couldn't send request to peer 0d5eb6a44dd24ba196d9026aec41ff61. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:34847: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:44.120836  3922 tablet_server.cc:196] TabletServer@127.3.212.130:0 shutdown complete.
W20260709 12:12:44.141108  4689 consensus_peers.cc:597] T 0c7d085ac21245e2a3de979566582db6 P a754210d0a2b403184f611fd5864442b -> Peer c66b12e0a1cc44b58565da795b7a4b8e (127.3.212.129:37153): Couldn't send request to peer c66b12e0a1cc44b58565da795b7a4b8e. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37153: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:44.146180  4689 consensus_peers.cc:597] T 978105aee434435f91eb9b3ddda005c4 P a754210d0a2b403184f611fd5864442b -> Peer 0d5eb6a44dd24ba196d9026aec41ff61 (127.3.212.130:34847): Couldn't send request to peer 0d5eb6a44dd24ba196d9026aec41ff61. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:34847: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:44.162149  3922 tablet_server.cc:179] TabletServer@127.3.212.131:0 shutting down...
I20260709 12:12:44.190896  3922 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:44.191883  3922 tablet_replica.cc:333] T 0c7d085ac21245e2a3de979566582db6 P a754210d0a2b403184f611fd5864442b: stopping tablet replica
I20260709 12:12:44.193414  3922 raft_consensus.cc:2243] T 0c7d085ac21245e2a3de979566582db6 P a754210d0a2b403184f611fd5864442b [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:12:44.195083  3922 raft_consensus.cc:2272] T 0c7d085ac21245e2a3de979566582db6 P a754210d0a2b403184f611fd5864442b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.197620  3922 tablet_replica.cc:333] T 2993ac2125df4c1696029a2d0663531a P a754210d0a2b403184f611fd5864442b: stopping tablet replica
I20260709 12:12:44.198185  3922 raft_consensus.cc:2243] T 2993ac2125df4c1696029a2d0663531a P a754210d0a2b403184f611fd5864442b [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.198802  3922 raft_consensus.cc:2272] T 2993ac2125df4c1696029a2d0663531a P a754210d0a2b403184f611fd5864442b [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.200878  3922 tablet_replica.cc:333] T c3035351b7444712b999d435424960d0 P a754210d0a2b403184f611fd5864442b: stopping tablet replica
I20260709 12:12:44.201653  3922 raft_consensus.cc:2243] T c3035351b7444712b999d435424960d0 P a754210d0a2b403184f611fd5864442b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.202229  3922 raft_consensus.cc:2272] T c3035351b7444712b999d435424960d0 P a754210d0a2b403184f611fd5864442b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.204080  3922 tablet_replica.cc:333] T 239da9ff3cf24b88a55a845f2978db90 P a754210d0a2b403184f611fd5864442b: stopping tablet replica
I20260709 12:12:44.204903  3922 raft_consensus.cc:2243] T 239da9ff3cf24b88a55a845f2978db90 P a754210d0a2b403184f611fd5864442b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:44.206264  3922 raft_consensus.cc:2272] T 239da9ff3cf24b88a55a845f2978db90 P a754210d0a2b403184f611fd5864442b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.208231  3922 tablet_replica.cc:333] T a6a637307cbc440eb70af83b47cc78b0 P a754210d0a2b403184f611fd5864442b: stopping tablet replica
I20260709 12:12:44.208701  3922 raft_consensus.cc:2243] T a6a637307cbc440eb70af83b47cc78b0 P a754210d0a2b403184f611fd5864442b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.209178  3922 raft_consensus.cc:2272] T a6a637307cbc440eb70af83b47cc78b0 P a754210d0a2b403184f611fd5864442b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.211127  3922 tablet_replica.cc:333] T 62d99d5944b14dca82789362b6d798ce P a754210d0a2b403184f611fd5864442b: stopping tablet replica
I20260709 12:12:44.211593  3922 raft_consensus.cc:2243] T 62d99d5944b14dca82789362b6d798ce P a754210d0a2b403184f611fd5864442b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.212060  3922 raft_consensus.cc:2272] T 62d99d5944b14dca82789362b6d798ce P a754210d0a2b403184f611fd5864442b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.214047  3922 tablet_replica.cc:333] T 559fa0760acb4538bfce94dc6cc9e553 P a754210d0a2b403184f611fd5864442b: stopping tablet replica
I20260709 12:12:44.214537  3922 raft_consensus.cc:2243] T 559fa0760acb4538bfce94dc6cc9e553 P a754210d0a2b403184f611fd5864442b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.214987  3922 raft_consensus.cc:2272] T 559fa0760acb4538bfce94dc6cc9e553 P a754210d0a2b403184f611fd5864442b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.216708  3922 tablet_replica.cc:333] T 978105aee434435f91eb9b3ddda005c4 P a754210d0a2b403184f611fd5864442b: stopping tablet replica
I20260709 12:12:44.217168  3922 raft_consensus.cc:2243] T 978105aee434435f91eb9b3ddda005c4 P a754210d0a2b403184f611fd5864442b [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:12:44.218211  3922 raft_consensus.cc:2272] T 978105aee434435f91eb9b3ddda005c4 P a754210d0a2b403184f611fd5864442b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.220288  3922 tablet_replica.cc:333] T 643771d1f41240b5a002a62fdaa0b0d0 P a754210d0a2b403184f611fd5864442b: stopping tablet replica
I20260709 12:12:44.220836  3922 raft_consensus.cc:2243] T 643771d1f41240b5a002a62fdaa0b0d0 P a754210d0a2b403184f611fd5864442b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.221328  3922 raft_consensus.cc:2272] T 643771d1f41240b5a002a62fdaa0b0d0 P a754210d0a2b403184f611fd5864442b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.223089  3922 tablet_replica.cc:333] T e35f477c83c04eb089f4ccd3042dd99c P a754210d0a2b403184f611fd5864442b: stopping tablet replica
I20260709 12:12:44.223522  3922 raft_consensus.cc:2243] T e35f477c83c04eb089f4ccd3042dd99c P a754210d0a2b403184f611fd5864442b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:44.223966  3922 raft_consensus.cc:2272] T e35f477c83c04eb089f4ccd3042dd99c P a754210d0a2b403184f611fd5864442b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.254990  3922 tablet_server.cc:196] TabletServer@127.3.212.131:0 shutdown complete.
I20260709 12:12:44.276748  3922 master.cc:562] Master@127.3.212.190:33345 shutting down...
I20260709 12:12:44.297824  3922 raft_consensus.cc:2243] T 00000000000000000000000000000000 P bd683515aeeb4bc9ab96030184df3347 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:44.298558  3922 raft_consensus.cc:2272] T 00000000000000000000000000000000 P bd683515aeeb4bc9ab96030184df3347 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:44.298894  3922 tablet_replica.cc:333] T 00000000000000000000000000000000 P bd683515aeeb4bc9ab96030184df3347: stopping tablet replica
I20260709 12:12:44.319886  3922 master.cc:584] Master@127.3.212.190:33345 shutdown complete.
0d5eb6a44dd24ba196d9026aec41ff61  4
a754210d0a2b403184f611fd5864442b  1
c66b12e0a1cc44b58565da795b7a4b8e  5
0d5eb6a44dd24ba196d9026aec41ff61  4
a754210d0a2b403184f611fd5864442b  3
c66b12e0a1cc44b58565da795b7a4b8e  3
0d5eb6a44dd24ba196d9026aec41ff61  1
a754210d0a2b403184f611fd5864442b  1
c66b12e0a1cc44b58565da795b7a4b8e  8
0d5eb6a44dd24ba196d9026aec41ff61  3
a754210d0a2b403184f611fd5864442b  3
c66b12e0a1cc44b58565da795b7a4b8e  4
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (28969 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:12:44.362668  3922 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.212.190:33295
I20260709 12:12:44.363833  3922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:44.369987  4999 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:44.370487  4998 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:44.370748  5001 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:44.371363  3922 server_base.cc:1061] running on GCE node
I20260709 12:12:44.372287  3922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:44.372505  3922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:44.372638  3922 hybrid_clock.cc:648] HybridClock initialized: now 1783599164372626 us; error 0 us; skew 500 ppm
I20260709 12:12:44.373138  3922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:44.375780  3922 webserver.cc:533] Webserver started at http://127.3.212.190:34571/ using document root <none> and password file <none>
I20260709 12:12:44.376258  3922 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:44.376422  3922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:44.376695  3922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:44.378036  3922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/master-0-root/instance:
uuid: "221aa011207d421b9725197ff8bed389"
format_stamp: "Formatted at 2026-07-09 12:12:44 on dist-test-slave-442x"
I20260709 12:12:44.382952  3922 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 12:12:44.386734  5006 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:44.387451  3922 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:12:44.387734  3922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/master-0-root
uuid: "221aa011207d421b9725197ff8bed389"
format_stamp: "Formatted at 2026-07-09 12:12:44 on dist-test-slave-442x"
I20260709 12:12:44.387993  3922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:44.398088  3922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:44.399291  3922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:44.436950  3922 rpc_server.cc:307] RPC server started. Bound to: 127.3.212.190:33295
I20260709 12:12:44.437064  5057 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.212.190:33295 every 8 connection(s)
I20260709 12:12:44.440798  5058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:44.450943  5058 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 221aa011207d421b9725197ff8bed389: Bootstrap starting.
I20260709 12:12:44.455785  5058 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 221aa011207d421b9725197ff8bed389: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:44.460093  5058 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 221aa011207d421b9725197ff8bed389: No bootstrap required, opened a new log
I20260709 12:12:44.462428  5058 raft_consensus.cc:359] T 00000000000000000000000000000000 P 221aa011207d421b9725197ff8bed389 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "221aa011207d421b9725197ff8bed389" member_type: VOTER }
I20260709 12:12:44.462877  5058 raft_consensus.cc:385] T 00000000000000000000000000000000 P 221aa011207d421b9725197ff8bed389 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:44.463097  5058 raft_consensus.cc:740] T 00000000000000000000000000000000 P 221aa011207d421b9725197ff8bed389 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221aa011207d421b9725197ff8bed389, State: Initialized, Role: FOLLOWER
I20260709 12:12:44.463646  5058 consensus_queue.cc:260] T 00000000000000000000000000000000 P 221aa011207d421b9725197ff8bed389 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "221aa011207d421b9725197ff8bed389" member_type: VOTER }
I20260709 12:12:44.464095  5058 raft_consensus.cc:399] T 00000000000000000000000000000000 P 221aa011207d421b9725197ff8bed389 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:12:44.464298  5058 raft_consensus.cc:493] T 00000000000000000000000000000000 P 221aa011207d421b9725197ff8bed389 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:12:44.464509  5058 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 221aa011207d421b9725197ff8bed389 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:44.468701  5058 raft_consensus.cc:515] T 00000000000000000000000000000000 P 221aa011207d421b9725197ff8bed389 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "221aa011207d421b9725197ff8bed389" member_type: VOTER }
I20260709 12:12:44.469197  5058 leader_election.cc:304] T 00000000000000000000000000000000 P 221aa011207d421b9725197ff8bed389 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 221aa011207d421b9725197ff8bed389; no voters: 
I20260709 12:12:44.470309  5058 leader_election.cc:290] T 00000000000000000000000000000000 P 221aa011207d421b9725197ff8bed389 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:12:44.470597  5061 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 221aa011207d421b9725197ff8bed389 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:44.471910  5061 raft_consensus.cc:697] T 00000000000000000000000000000000 P 221aa011207d421b9725197ff8bed389 [term 1 LEADER]: Becoming Leader. State: Replica: 221aa011207d421b9725197ff8bed389, State: Running, Role: LEADER
I20260709 12:12:44.472504  5061 consensus_queue.cc:237] T 00000000000000000000000000000000 P 221aa011207d421b9725197ff8bed389 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "221aa011207d421b9725197ff8bed389" member_type: VOTER }
I20260709 12:12:44.473146  5058 sys_catalog.cc:565] T 00000000000000000000000000000000 P 221aa011207d421b9725197ff8bed389 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:12:44.478730  5063 sys_catalog.cc:455] T 00000000000000000000000000000000 P 221aa011207d421b9725197ff8bed389 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 221aa011207d421b9725197ff8bed389. Latest consensus state: current_term: 1 leader_uuid: "221aa011207d421b9725197ff8bed389" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "221aa011207d421b9725197ff8bed389" member_type: VOTER } }
I20260709 12:12:44.479123  5062 sys_catalog.cc:455] T 00000000000000000000000000000000 P 221aa011207d421b9725197ff8bed389 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "221aa011207d421b9725197ff8bed389" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "221aa011207d421b9725197ff8bed389" member_type: VOTER } }
I20260709 12:12:44.479425  5063 sys_catalog.cc:458] T 00000000000000000000000000000000 P 221aa011207d421b9725197ff8bed389 [sys.catalog]: This master's current role is: LEADER
I20260709 12:12:44.479679  5062 sys_catalog.cc:458] T 00000000000000000000000000000000 P 221aa011207d421b9725197ff8bed389 [sys.catalog]: This master's current role is: LEADER
I20260709 12:12:44.481189  5069 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:12:44.486191  5069 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:12:44.488638  3922 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:12:44.495832  5069 catalog_manager.cc:1383] Generated new cluster ID: 43d2d801e3ff4ef98ab862249c1a9a23
I20260709 12:12:44.496142  5069 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:12:44.533059  5069 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:12:44.534488  5069 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:12:44.550273  5069 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 221aa011207d421b9725197ff8bed389: Generated new TSK 0
I20260709 12:12:44.550943  5069 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:12:44.559244  3922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:44.565366  5079 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:44.566093  5080 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:44.568173  5082 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:44.569941  3922 server_base.cc:1061] running on GCE node
I20260709 12:12:44.570864  3922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:44.571043  3922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:44.571178  3922 hybrid_clock.cc:648] HybridClock initialized: now 1783599164571166 us; error 0 us; skew 500 ppm
I20260709 12:12:44.571688  3922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:44.574165  3922 webserver.cc:533] Webserver started at http://127.3.212.129:44529/ using document root <none> and password file <none>
I20260709 12:12:44.574620  3922 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:44.574792  3922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:44.575058  3922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:44.576359  3922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/ts-0-root/instance:
uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
format_stamp: "Formatted at 2026-07-09 12:12:44 on dist-test-slave-442x"
I20260709 12:12:44.580955  3922 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:12:44.584544  5087 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:44.585318  3922 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 12:12:44.585651  3922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/ts-0-root
uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
format_stamp: "Formatted at 2026-07-09 12:12:44 on dist-test-slave-442x"
I20260709 12:12:44.585983  3922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:44.598416  3922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:44.599640  3922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:44.601130  3922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:44.603473  3922 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:44.603677  3922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:44.603915  3922 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:44.604076  3922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:44.643967  3922 rpc_server.cc:307] RPC server started. Bound to: 127.3.212.129:34443
I20260709 12:12:44.644064  5149 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.212.129:34443 every 8 connection(s)
I20260709 12:12:44.648880  3922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:44.656278  5154 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:44.657212  5155 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:44.660583  3922 server_base.cc:1061] running on GCE node
W20260709 12:12:44.660717  5158 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:44.662204  3922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:44.662400  3922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:44.662581  3922 hybrid_clock.cc:648] HybridClock initialized: now 1783599164662562 us; error 0 us; skew 500 ppm
I20260709 12:12:44.663223  3922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:44.666219  3922 webserver.cc:533] Webserver started at http://127.3.212.130:39091/ using document root <none> and password file <none>
I20260709 12:12:44.666800  3922 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:44.667039  3922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:44.667292  5150 heartbeater.cc:344] Connected to a master server at 127.3.212.190:33295
I20260709 12:12:44.667368  3922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:44.667683  5150 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:44.668437  5150 heartbeater.cc:507] Master 127.3.212.190:33295 requested a full tablet report, sending...
I20260709 12:12:44.668798  3922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/ts-1-root/instance:
uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
format_stamp: "Formatted at 2026-07-09 12:12:44 on dist-test-slave-442x"
I20260709 12:12:44.670847  5023 ts_manager.cc:194] Registered new tserver with Master: ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443)
I20260709 12:12:44.673446  5023 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58198
I20260709 12:12:44.675367  3922 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.002s
I20260709 12:12:44.678912  5162 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:44.679664  3922 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:12:44.679975  3922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/ts-1-root
uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
format_stamp: "Formatted at 2026-07-09 12:12:44 on dist-test-slave-442x"
I20260709 12:12:44.680297  3922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:44.711859  3922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:44.713078  3922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:44.714576  3922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:44.716799  3922 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:44.716974  3922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:44.717219  3922 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:44.717360  3922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:44.759508  3922 rpc_server.cc:307] RPC server started. Bound to: 127.3.212.130:44455
I20260709 12:12:44.759603  5224 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.212.130:44455 every 8 connection(s)
I20260709 12:12:44.764166  3922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:44.771205  5228 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:44.772763  5229 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:44.774605  5231 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:44.775142  3922 server_base.cc:1061] running on GCE node
I20260709 12:12:44.776041  3922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:44.776317  3922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:44.776530  3922 hybrid_clock.cc:648] HybridClock initialized: now 1783599164776511 us; error 0 us; skew 500 ppm
I20260709 12:12:44.776562  5225 heartbeater.cc:344] Connected to a master server at 127.3.212.190:33295
I20260709 12:12:44.776947  5225 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:44.777184  3922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:44.777685  5225 heartbeater.cc:507] Master 127.3.212.190:33295 requested a full tablet report, sending...
I20260709 12:12:44.780036  5023 ts_manager.cc:194] Registered new tserver with Master: dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:44.780057  3922 webserver.cc:533] Webserver started at http://127.3.212.131:37311/ using document root <none> and password file <none>
I20260709 12:12:44.780687  3922 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:44.780884  3922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:44.781136  3922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:44.781599  5023 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33888
I20260709 12:12:44.782426  3922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/ts-2-root/instance:
uuid: "9e794b72ed7640219f90ec4232363929"
format_stamp: "Formatted at 2026-07-09 12:12:44 on dist-test-slave-442x"
I20260709 12:12:44.787243  3922 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:12:44.790884  5236 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:44.791654  3922 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 12:12:44.791953  3922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/ts-2-root
uuid: "9e794b72ed7640219f90ec4232363929"
format_stamp: "Formatted at 2026-07-09 12:12:44 on dist-test-slave-442x"
I20260709 12:12:44.792239  3922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:44.805900  3922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:44.807123  3922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:44.808573  3922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:44.810967  3922 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:44.811242  3922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:44.811527  3922 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:44.811677  3922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:44.853053  3922 rpc_server.cc:307] RPC server started. Bound to: 127.3.212.131:46709
I20260709 12:12:44.853140  5298 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.212.131:46709 every 8 connection(s)
I20260709 12:12:44.866926  5299 heartbeater.cc:344] Connected to a master server at 127.3.212.190:33295
I20260709 12:12:44.867329  5299 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:44.868041  5299 heartbeater.cc:507] Master 127.3.212.190:33295 requested a full tablet report, sending...
I20260709 12:12:44.870078  5023 ts_manager.cc:194] Registered new tserver with Master: 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:44.870558  3922 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014367574s
I20260709 12:12:44.871536  5023 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33896
I20260709 12:12:44.898900  5023 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33906:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:12:44.905169  5023 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:12:45.098141  5115 tablet_service.cc:1511] Processing CreateTablet for tablet 8a4dd376f83a42a896a5e1aca58d3221 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:12:45.099160  5112 tablet_service.cc:1511] Processing CreateTablet for tablet 4d8224f2bf564e7197a33ee531527a15 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:12:45.099684  5115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a4dd376f83a42a896a5e1aca58d3221. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.100567  5112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d8224f2bf564e7197a33ee531527a15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.101917  5114 tablet_service.cc:1511] Processing CreateTablet for tablet a71edf310ae54d6981a7c37794f6ba4d (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:12:45.103399  5114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a71edf310ae54d6981a7c37794f6ba4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.099727  5111 tablet_service.cc:1511] Processing CreateTablet for tablet 93f7ce8a804f431dbbc5adfbca8d745e (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:12:45.104588  5111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93f7ce8a804f431dbbc5adfbca8d745e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.110756  5113 tablet_service.cc:1511] Processing CreateTablet for tablet c63fe19b7c5e4c73b49eee26ad00e88d (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:12:45.112154  5113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c63fe19b7c5e4c73b49eee26ad00e88d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.113229  5190 tablet_service.cc:1511] Processing CreateTablet for tablet 8a4dd376f83a42a896a5e1aca58d3221 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:12:45.114528  5190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a4dd376f83a42a896a5e1aca58d3221. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.129159  5189 tablet_service.cc:1511] Processing CreateTablet for tablet a71edf310ae54d6981a7c37794f6ba4d (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:12:45.130013  5110 tablet_service.cc:1511] Processing CreateTablet for tablet 33f09d9f057844568fb4a24c314a746a (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:12:45.130649  5189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a71edf310ae54d6981a7c37794f6ba4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.131322  5110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33f09d9f057844568fb4a24c314a746a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.139739  5111 tablet_service.cc:1511] Processing CreateTablet for tablet 271b0c7d258142798f30accd6aaba829 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:12:45.142783  5111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 271b0c7d258142798f30accd6aaba829. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.144150  5113 tablet_service.cc:1511] Processing CreateTablet for tablet 41c65b96548e49b3863d03db116fd8d0 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:12:45.145483  5113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41c65b96548e49b3863d03db116fd8d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.147890  5313 tablet_bootstrap.cc:492] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
I20260709 12:12:45.150431  5114 tablet_service.cc:1511] Processing CreateTablet for tablet c69b050cdaeb4f1db6cd4993ad703192 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:12:45.153007  5188 tablet_service.cc:1511] Processing CreateTablet for tablet c63fe19b7c5e4c73b49eee26ad00e88d (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:12:45.155493  5264 tablet_service.cc:1511] Processing CreateTablet for tablet 8a4dd376f83a42a896a5e1aca58d3221 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:12:45.156344  5114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c69b050cdaeb4f1db6cd4993ad703192. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.156473  5188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c63fe19b7c5e4c73b49eee26ad00e88d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.156912  5264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a4dd376f83a42a896a5e1aca58d3221. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.158636  5263 tablet_service.cc:1511] Processing CreateTablet for tablet a71edf310ae54d6981a7c37794f6ba4d (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:12:45.159987  5263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a71edf310ae54d6981a7c37794f6ba4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.167872  5262 tablet_service.cc:1511] Processing CreateTablet for tablet c63fe19b7c5e4c73b49eee26ad00e88d (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:12:45.169355  5262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c63fe19b7c5e4c73b49eee26ad00e88d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.170874  5110 tablet_service.cc:1511] Processing CreateTablet for tablet 71729ba8cfa049e8b7dac6674d1ba13b (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:12:45.171550  5261 tablet_service.cc:1511] Processing CreateTablet for tablet 4d8224f2bf564e7197a33ee531527a15 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:12:45.172231  5110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71729ba8cfa049e8b7dac6674d1ba13b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.172845  5261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d8224f2bf564e7197a33ee531527a15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.176602  5112 tablet_service.cc:1511] Processing CreateTablet for tablet 4f87264424df422fa5223dd7a8803eab (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:12:45.178421  5112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f87264424df422fa5223dd7a8803eab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.179080  5260 tablet_service.cc:1511] Processing CreateTablet for tablet 93f7ce8a804f431dbbc5adfbca8d745e (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:12:45.180438  5313 tablet_bootstrap.cc:654] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:45.182355  5259 tablet_service.cc:1511] Processing CreateTablet for tablet 33f09d9f057844568fb4a24c314a746a (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:12:45.182534  5113 tablet_service.cc:1511] Processing CreateTablet for tablet 62577fc91bb44d3a882109dc63f74008 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:12:45.183913  5113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62577fc91bb44d3a882109dc63f74008. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.185498  5258 tablet_service.cc:1511] Processing CreateTablet for tablet 271b0c7d258142798f30accd6aaba829 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:12:45.188625  5257 tablet_service.cc:1511] Processing CreateTablet for tablet c69b050cdaeb4f1db6cd4993ad703192 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:12:45.191780  5256 tablet_service.cc:1511] Processing CreateTablet for tablet 41c65b96548e49b3863d03db116fd8d0 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:12:45.180457  5260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93f7ce8a804f431dbbc5adfbca8d745e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.194945  5115 tablet_service.cc:1511] Processing CreateTablet for tablet b0fcb55471024c3d818106c4bfdf84d4 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:12:45.196337  5115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0fcb55471024c3d818106c4bfdf84d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.197894  5256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41c65b96548e49b3863d03db116fd8d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.200145  5257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c69b050cdaeb4f1db6cd4993ad703192. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.201838  5258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 271b0c7d258142798f30accd6aaba829. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.203567  5259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33f09d9f057844568fb4a24c314a746a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.203624  5109 tablet_service.cc:1511] Processing CreateTablet for tablet e3beaf3ce31042719868401157039ee9 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:12:45.205222  5109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3beaf3ce31042719868401157039ee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.205886  5255 tablet_service.cc:1511] Processing CreateTablet for tablet 71729ba8cfa049e8b7dac6674d1ba13b (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:12:45.207293  5255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71729ba8cfa049e8b7dac6674d1ba13b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.207795  5186 tablet_service.cc:1511] Processing CreateTablet for tablet 33f09d9f057844568fb4a24c314a746a (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:12:45.208437  5187 tablet_service.cc:1511] Processing CreateTablet for tablet 93f7ce8a804f431dbbc5adfbca8d745e (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:12:45.209146  5186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33f09d9f057844568fb4a24c314a746a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.209838  5187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93f7ce8a804f431dbbc5adfbca8d745e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.213883  5190 tablet_service.cc:1511] Processing CreateTablet for tablet 4d8224f2bf564e7197a33ee531527a15 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:12:45.214174  5184 tablet_service.cc:1511] Processing CreateTablet for tablet c69b050cdaeb4f1db6cd4993ad703192 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:12:45.215304  5190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d8224f2bf564e7197a33ee531527a15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.216039  5183 tablet_service.cc:1511] Processing CreateTablet for tablet 41c65b96548e49b3863d03db116fd8d0 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:12:45.218088  5182 tablet_service.cc:1511] Processing CreateTablet for tablet 71729ba8cfa049e8b7dac6674d1ba13b (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:12:45.218502  5185 tablet_service.cc:1511] Processing CreateTablet for tablet 271b0c7d258142798f30accd6aaba829 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:12:45.219977  5183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41c65b96548e49b3863d03db116fd8d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.220242  5181 tablet_service.cc:1511] Processing CreateTablet for tablet 4f87264424df422fa5223dd7a8803eab (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:12:45.221524  5181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f87264424df422fa5223dd7a8803eab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.226115  5182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71729ba8cfa049e8b7dac6674d1ba13b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.230193  5185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 271b0c7d258142798f30accd6aaba829. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.234055  5184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c69b050cdaeb4f1db6cd4993ad703192. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.253335  5188 tablet_service.cc:1511] Processing CreateTablet for tablet 62577fc91bb44d3a882109dc63f74008 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:12:45.255038  5188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62577fc91bb44d3a882109dc63f74008. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.270153  5314 tablet_bootstrap.cc:492] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
I20260709 12:12:45.280897  5314 tablet_bootstrap.cc:654] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:45.280818  5186 tablet_service.cc:1511] Processing CreateTablet for tablet b0fcb55471024c3d818106c4bfdf84d4 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:12:45.295444  5259 tablet_service.cc:1511] Processing CreateTablet for tablet 4f87264424df422fa5223dd7a8803eab (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:12:45.296887  5259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f87264424df422fa5223dd7a8803eab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.298460  5110 tablet_service.cc:1511] Processing CreateTablet for tablet a975d4f227214562b6fc39ea53081961 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:12:45.305331  5110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a975d4f227214562b6fc39ea53081961. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.319175  5260 tablet_service.cc:1511] Processing CreateTablet for tablet b0fcb55471024c3d818106c4bfdf84d4 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:12:45.320670  5260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0fcb55471024c3d818106c4bfdf84d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.321485  5259 tablet_service.cc:1511] Processing CreateTablet for tablet e3beaf3ce31042719868401157039ee9 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:12:45.322701  5259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3beaf3ce31042719868401157039ee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.301064  5256 tablet_service.cc:1511] Processing CreateTablet for tablet 62577fc91bb44d3a882109dc63f74008 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:12:45.324919  5256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62577fc91bb44d3a882109dc63f74008. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.329500  5263 tablet_service.cc:1511] Processing CreateTablet for tablet a975d4f227214562b6fc39ea53081961 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:12:45.330842  5263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a975d4f227214562b6fc39ea53081961. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.344002  5185 tablet_service.cc:1511] Processing CreateTablet for tablet e3beaf3ce31042719868401157039ee9 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:12:45.347194  5188 tablet_service.cc:1511] Processing CreateTablet for tablet a975d4f227214562b6fc39ea53081961 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:12:45.352649  5190 tablet_service.cc:1511] Processing CreateTablet for tablet e63d70b5bbd74a49be2a18fef7617e3e (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:12:45.354179  5316 tablet_bootstrap.cc:492] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
I20260709 12:12:45.353404  5262 tablet_service.cc:1511] Processing CreateTablet for tablet e63d70b5bbd74a49be2a18fef7617e3e (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:12:45.356189  5262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e63d70b5bbd74a49be2a18fef7617e3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.359897  5113 tablet_service.cc:1511] Processing CreateTablet for tablet 4e275c844ff54adea37252a082eae526 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:12:45.360639  5261 tablet_service.cc:1511] Processing CreateTablet for tablet 01b3c9565b564c6d934ce652edaabd1f (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:12:45.361171  5113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e275c844ff54adea37252a082eae526. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.361892  5261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01b3c9565b564c6d934ce652edaabd1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.365002  5110 tablet_service.cc:1511] Processing CreateTablet for tablet 01b3c9565b564c6d934ce652edaabd1f (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:12:45.354384  5183 tablet_service.cc:1511] Processing CreateTablet for tablet 01b3c9565b564c6d934ce652edaabd1f (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:12:45.368850  5109 tablet_service.cc:1511] Processing CreateTablet for tablet e63d70b5bbd74a49be2a18fef7617e3e (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:12:45.374217  5186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0fcb55471024c3d818106c4bfdf84d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.375141  5313 tablet_bootstrap.cc:492] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:45.375696  5110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01b3c9565b564c6d934ce652edaabd1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.379648  5181 tablet_service.cc:1511] Processing CreateTablet for tablet 4e275c844ff54adea37252a082eae526 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:12:45.384114  5190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e63d70b5bbd74a49be2a18fef7617e3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.387037  5314 tablet_bootstrap.cc:492] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:45.394869  5314 ts_tablet_manager.cc:1403] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.125s	user 0.015s	sys 0.021s
I20260709 12:12:45.395406  5189 tablet_service.cc:1511] Processing CreateTablet for tablet 84919c977be24017b74e122582f71fbe (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:12:45.396857  5316 tablet_bootstrap.cc:654] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:45.384673  5114 tablet_service.cc:1511] Processing CreateTablet for tablet 84919c977be24017b74e122582f71fbe (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:12:45.398140  5114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84919c977be24017b74e122582f71fbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.397974  5314 raft_consensus.cc:359] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:45.394393  5185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3beaf3ce31042719868401157039ee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.398818  5109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e63d70b5bbd74a49be2a18fef7617e3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.385262  5257 tablet_service.cc:1511] Processing CreateTablet for tablet 4e275c844ff54adea37252a082eae526 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:12:45.414621  5257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e275c844ff54adea37252a082eae526. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.416507  5314 raft_consensus.cc:385] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:45.416946  5314 raft_consensus.cc:740] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
I20260709 12:12:45.417821  5314 consensus_queue.cc:260] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:45.417708  5181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e275c844ff54adea37252a082eae526. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.422127  5259 tablet_service.cc:1511] Processing CreateTablet for tablet 84919c977be24017b74e122582f71fbe (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:12:45.423453  5259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84919c977be24017b74e122582f71fbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.425693  5188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a975d4f227214562b6fc39ea53081961. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.427400  5183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01b3c9565b564c6d934ce652edaabd1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.391815  5313 ts_tablet_manager.cc:1403] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.244s	user 0.045s	sys 0.018s
I20260709 12:12:45.429674  5189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84919c977be24017b74e122582f71fbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.430048  5113 tablet_service.cc:1511] Processing CreateTablet for tablet 60d88a24e03749b5a24c6baea8ab27f6 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:12:45.431298  5113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60d88a24e03749b5a24c6baea8ab27f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.432266  5313 raft_consensus.cc:359] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:45.433104  5313 raft_consensus.cc:385] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:45.433449  5313 raft_consensus.cc:740] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
I20260709 12:12:45.437461  5182 tablet_service.cc:1511] Processing CreateTablet for tablet 60d88a24e03749b5a24c6baea8ab27f6 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:12:45.438515  5225 heartbeater.cc:499] Master 127.3.212.190:33295 was elected leader, sending a full tablet report...
I20260709 12:12:45.438849  5182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60d88a24e03749b5a24c6baea8ab27f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.438995  5115 tablet_service.cc:1511] Processing CreateTablet for tablet a6b2fb64d40642259e41424cef193db0 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:12:45.440369  5115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6b2fb64d40642259e41424cef193db0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.447592  5262 tablet_service.cc:1511] Processing CreateTablet for tablet 60d88a24e03749b5a24c6baea8ab27f6 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:12:45.449065  5262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60d88a24e03749b5a24c6baea8ab27f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.436848  5313 consensus_queue.cc:260] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:45.457927  5314 ts_tablet_manager.cc:1434] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.063s	user 0.009s	sys 0.001s
I20260709 12:12:45.475481  5314 tablet_bootstrap.cc:492] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
I20260709 12:12:45.471400  5313 ts_tablet_manager.cc:1434] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260709 12:12:45.471983  5150 heartbeater.cc:499] Master 127.3.212.190:33295 was elected leader, sending a full tablet report...
I20260709 12:12:45.482535  5313 tablet_bootstrap.cc:492] T c63fe19b7c5e4c73b49eee26ad00e88d P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
W20260709 12:12:45.484586  5071 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:45.487845  5187 tablet_service.cc:1511] Processing CreateTablet for tablet 45e701f062f14e4e80492fc08144cca6 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:12:45.490957  5110 tablet_service.cc:1511] Processing CreateTablet for tablet 45e701f062f14e4e80492fc08144cca6 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:12:45.501209  5110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45e701f062f14e4e80492fc08144cca6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.501209  5187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45e701f062f14e4e80492fc08144cca6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.472352  5184 tablet_service.cc:1511] Processing CreateTablet for tablet a6b2fb64d40642259e41424cef193db0 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:12:45.510246  5184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6b2fb64d40642259e41424cef193db0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.492740  5257 tablet_service.cc:1511] Processing CreateTablet for tablet a6b2fb64d40642259e41424cef193db0 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:12:45.497059  5256 tablet_service.cc:1511] Processing CreateTablet for tablet 45e701f062f14e4e80492fc08144cca6 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:12:45.515192  5256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45e701f062f14e4e80492fc08144cca6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.520511  5313 tablet_bootstrap.cc:654] T c63fe19b7c5e4c73b49eee26ad00e88d P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:45.526082  5257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6b2fb64d40642259e41424cef193db0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.535815  5314 tablet_bootstrap.cc:654] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:45.540339  5113 tablet_service.cc:1511] Processing CreateTablet for tablet 62cb582e4337464894d9eb032a3b2cd2 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:12:45.560086  5113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62cb582e4337464894d9eb032a3b2cd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.541523  5316 tablet_bootstrap.cc:492] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
I20260709 12:12:45.565850  5316 ts_tablet_manager.cc:1403] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.212s	user 0.013s	sys 0.016s
I20260709 12:12:45.569288  5316 raft_consensus.cc:359] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:45.583418  5316 raft_consensus.cc:385] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:45.583745  5316 raft_consensus.cc:740] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:45.584529  5316 consensus_queue.cc:260] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:45.586237  5314 tablet_bootstrap.cc:492] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:45.586788  5313 tablet_bootstrap.cc:492] T c63fe19b7c5e4c73b49eee26ad00e88d P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:45.586874  5314 ts_tablet_manager.cc:1403] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.112s	user 0.024s	sys 0.011s
I20260709 12:12:45.588521  5261 tablet_service.cc:1511] Processing CreateTablet for tablet 62cb582e4337464894d9eb032a3b2cd2 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:12:45.590082  5261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62cb582e4337464894d9eb032a3b2cd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.590135  5314 raft_consensus.cc:359] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } }
I20260709 12:12:45.591037  5314 raft_consensus.cc:385] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:45.591390  5314 raft_consensus.cc:740] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
I20260709 12:12:45.592319  5314 consensus_queue.cc:260] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } }
I20260709 12:12:45.594434  5113 tablet_service.cc:1511] Processing CreateTablet for tablet f34c97113147431584d6336e0d849164 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:12:45.595755  5113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f34c97113147431584d6336e0d849164. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.596124  5184 tablet_service.cc:1511] Processing CreateTablet for tablet f34c97113147431584d6336e0d849164 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:12:45.597544  5184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f34c97113147431584d6336e0d849164. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.602629  5313 ts_tablet_manager.cc:1403] T c63fe19b7c5e4c73b49eee26ad00e88d P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.120s	user 0.020s	sys 0.013s
I20260709 12:12:45.603422  5314 ts_tablet_manager.cc:1434] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 12:12:45.605225  5256 tablet_service.cc:1511] Processing CreateTablet for tablet f34c97113147431584d6336e0d849164 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:12:45.605676  5313 raft_consensus.cc:359] T c63fe19b7c5e4c73b49eee26ad00e88d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:45.606442  5313 raft_consensus.cc:385] T c63fe19b7c5e4c73b49eee26ad00e88d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:45.606743  5313 raft_consensus.cc:740] T c63fe19b7c5e4c73b49eee26ad00e88d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
I20260709 12:12:45.606844  5256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f34c97113147431584d6336e0d849164. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.609889  5313 consensus_queue.cc:260] T c63fe19b7c5e4c73b49eee26ad00e88d P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:45.614305  5314 tablet_bootstrap.cc:492] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
I20260709 12:12:45.586300  5187 tablet_service.cc:1511] Processing CreateTablet for tablet 62cb582e4337464894d9eb032a3b2cd2 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:12:45.614717  5115 tablet_service.cc:1511] Processing CreateTablet for tablet ecdd526dba8b4d84859ef5f6ee618387 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:12:45.615597  5187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62cb582e4337464894d9eb032a3b2cd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.615518  5183 tablet_service.cc:1511] Processing CreateTablet for tablet ecdd526dba8b4d84859ef5f6ee618387 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:12:45.616771  5183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecdd526dba8b4d84859ef5f6ee618387. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.619881  5114 tablet_service.cc:1511] Processing CreateTablet for tablet cd07c3eb35104201a0e6b64cd77cb6b6 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:12:45.620339  5314 tablet_bootstrap.cc:654] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:45.621246  5115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecdd526dba8b4d84859ef5f6ee618387. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.622380  5260 tablet_service.cc:1511] Processing CreateTablet for tablet ecdd526dba8b4d84859ef5f6ee618387 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:12:45.623651  5260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecdd526dba8b4d84859ef5f6ee618387. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.626381  5114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd07c3eb35104201a0e6b64cd77cb6b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.635421  5319 raft_consensus.cc:493] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.635942  5319 raft_consensus.cc:515] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:45.640527  5319 leader_election.cc:290] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:45.673326  5190 tablet_service.cc:1511] Processing CreateTablet for tablet cd07c3eb35104201a0e6b64cd77cb6b6 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:12:45.673700  5260 tablet_service.cc:1511] Processing CreateTablet for tablet cd07c3eb35104201a0e6b64cd77cb6b6 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:12:45.674913  5110 tablet_service.cc:1511] Processing CreateTablet for tablet d87fb855c56c430f896b24f98722bd61 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:12:45.674834  5190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd07c3eb35104201a0e6b64cd77cb6b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.676138  5110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d87fb855c56c430f896b24f98722bd61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.676051  5260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd07c3eb35104201a0e6b64cd77cb6b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.676044  5186 tablet_service.cc:1511] Processing CreateTablet for tablet d87fb855c56c430f896b24f98722bd61 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:12:45.677986  5262 tablet_service.cc:1511] Processing CreateTablet for tablet d87fb855c56c430f896b24f98722bd61 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:12:45.679186  5262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d87fb855c56c430f896b24f98722bd61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.683611  5313 ts_tablet_manager.cc:1434] T c63fe19b7c5e4c73b49eee26ad00e88d P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.081s	user 0.006s	sys 0.000s
I20260709 12:12:45.684597  5313 tablet_bootstrap.cc:492] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
I20260709 12:12:45.704262  5109 tablet_service.cc:1511] Processing CreateTablet for tablet 68b0d002ca1342c9b1b6eb6ed1f0f958 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:12:45.708027  5316 ts_tablet_manager.cc:1434] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.142s	user 0.028s	sys 0.022s
I20260709 12:12:45.709764  5323 raft_consensus.cc:493] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.710261  5323 raft_consensus.cc:515] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:45.710927  5299 heartbeater.cc:499] Master 127.3.212.190:33295 was elected leader, sending a full tablet report...
I20260709 12:12:45.712751  5323 leader_election.cc:290] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:45.701460  5186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d87fb855c56c430f896b24f98722bd61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.717068  5319 raft_consensus.cc:493] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.717569  5319 raft_consensus.cc:515] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } }
I20260709 12:12:45.757644  5320 raft_consensus.cc:493] T c63fe19b7c5e4c73b49eee26ad00e88d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.758216  5320 raft_consensus.cc:515] T c63fe19b7c5e4c73b49eee26ad00e88d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:45.761015  5320 leader_election.cc:290] T c63fe19b7c5e4c73b49eee26ad00e88d P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:45.759976  5115 tablet_service.cc:1511] Processing CreateTablet for tablet 00645b1f1e014de995e4a937f842d909 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:12:45.762526  5109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68b0d002ca1342c9b1b6eb6ed1f0f958. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.752977  5181 tablet_service.cc:1511] Processing CreateTablet for tablet 68b0d002ca1342c9b1b6eb6ed1f0f958 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:12:45.773059  5320 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.773633  5320 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:45.778148  5314 tablet_bootstrap.cc:492] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:45.778795  5314 ts_tablet_manager.cc:1403] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.165s	user 0.039s	sys 0.040s
I20260709 12:12:45.769081  5319 leader_election.cc:290] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:45.783412  5256 tablet_service.cc:1511] Processing CreateTablet for tablet 68b0d002ca1342c9b1b6eb6ed1f0f958 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:12:45.785801  5314 raft_consensus.cc:359] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:45.786580  5314 raft_consensus.cc:385] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:45.786871  5314 raft_consensus.cc:740] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
I20260709 12:12:45.790019  5181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68b0d002ca1342c9b1b6eb6ed1f0f958. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.816722  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:45.818955  5183 tablet_service.cc:1511] Processing CreateTablet for tablet 00645b1f1e014de995e4a937f842d909 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:12:45.819990  5256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68b0d002ca1342c9b1b6eb6ed1f0f958. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.820411  5314 consensus_queue.cc:260] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:45.823109  5314 ts_tablet_manager.cc:1434] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.044s	user 0.010s	sys 0.000s
I20260709 12:12:45.831229  5260 tablet_service.cc:1511] Processing CreateTablet for tablet 00645b1f1e014de995e4a937f842d909 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:12:45.831776  5261 tablet_service.cc:1511] Processing CreateTablet for tablet 7a9971183fee4e958cff325230a31b26 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:12:45.831955  5189 tablet_service.cc:1511] Processing CreateTablet for tablet d8dc93d0992c4324872c6aab5aa9db8c (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:12:45.834419  5257 tablet_service.cc:1511] Processing CreateTablet for tablet d8dc93d0992c4324872c6aab5aa9db8c (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:12:45.834867  5264 tablet_service.cc:1511] Processing CreateTablet for tablet 87f29f851a0e43738cf01ef3724e5533 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:12:45.835255  5188 tablet_service.cc:1511] Processing CreateTablet for tablet 88f51ae73df747849e2f3cd63547a1d0 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:12:45.836299  5182 tablet_service.cc:1511] Processing CreateTablet for tablet 21832120214f4b8fb9e2e0de351565f0 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:12:45.836825  5259 tablet_service.cc:1511] Processing CreateTablet for tablet 88f51ae73df747849e2f3cd63547a1d0 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:12:45.837641  5263 tablet_service.cc:1511] Processing CreateTablet for tablet 21832120214f4b8fb9e2e0de351565f0 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:12:45.838510  5260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00645b1f1e014de995e4a937f842d909. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.838708  5258 tablet_service.cc:1511] Processing CreateTablet for tablet d8017a2b75074e4b9f0691c32850f71a (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:12:45.839717  5184 tablet_service.cc:1511] Processing CreateTablet for tablet 87f29f851a0e43738cf01ef3724e5533 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:12:45.841042  5115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00645b1f1e014de995e4a937f842d909. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.841746  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:45.833045  5185 tablet_service.cc:1511] Processing CreateTablet for tablet 7a9971183fee4e958cff325230a31b26 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
W20260709 12:12:45.843533  5237 leader_election.cc:343] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:45.844466  5320 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:45.844660  5183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00645b1f1e014de995e4a937f842d909. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.858028  5188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88f51ae73df747849e2f3cd63547a1d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.858669  5184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87f29f851a0e43738cf01ef3724e5533. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.859354  5185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a9971183fee4e958cff325230a31b26. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:12:45.858361  5163 leader_election.cc:343] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:45.859715  5313 tablet_bootstrap.cc:654] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:45.860692  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:45.861660  5182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21832120214f4b8fb9e2e0de351565f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.863168  5190 tablet_service.cc:1511] Processing CreateTablet for tablet d8017a2b75074e4b9f0691c32850f71a (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
W20260709 12:12:45.864269  5163 leader_election.cc:343] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:45.864760  5189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8dc93d0992c4324872c6aab5aa9db8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.872934  5316 tablet_bootstrap.cc:492] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
I20260709 12:12:45.880981  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:45.881752  5125 raft_consensus.cc:2468] T c63fe19b7c5e4c73b49eee26ad00e88d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 0.
I20260709 12:12:45.883064  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:45.884527  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:45.885003  5190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8017a2b75074e4b9f0691c32850f71a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:12:45.886510  5240 leader_election.cc:343] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:45.887024  5240 leader_election.cc:304] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:12:45.888343  5332 raft_consensus.cc:2749] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:45.889869  5166 leader_election.cc:304] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:12:45.891088  5319 raft_consensus.cc:2804] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:45.891438  5319 raft_consensus.cc:493] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:45.895033  5259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88f51ae73df747849e2f3cd63547a1d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.895390  5319 raft_consensus.cc:3060] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:45.895686  5263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21832120214f4b8fb9e2e0de351565f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.897729  5257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8dc93d0992c4324872c6aab5aa9db8c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:12:45.897914  5166 leader_election.cc:343] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:45.898397  5166 leader_election.cc:304] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:12:45.901767  5258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8017a2b75074e4b9f0691c32850f71a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.904654  5319 raft_consensus.cc:515] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:45.905802  5261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a9971183fee4e958cff325230a31b26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.913780  5264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87f29f851a0e43738cf01ef3724e5533. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.922278  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
W20260709 12:12:45.923784  5163 leader_election.cc:343] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:45.926491  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:12:45.910102  5314 tablet_bootstrap.cc:492] T 271b0c7d258142798f30accd6aaba829 P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
I20260709 12:12:45.927148  5123 raft_consensus.cc:3060] T c63fe19b7c5e4c73b49eee26ad00e88d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:45.934168  5123 raft_consensus.cc:2468] T c63fe19b7c5e4c73b49eee26ad00e88d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 1.
I20260709 12:12:45.935422  5166 leader_election.cc:304] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:12:45.936414  5319 leader_election.cc:290] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:45.945762  5262 tablet_service.cc:1511] Processing CreateTablet for tablet 56627990da7d49f7a12669f23294a596 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:12:45.946504  5319 raft_consensus.cc:2749] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:45.946398  5183 tablet_service.cc:1511] Processing CreateTablet for tablet 756d32b8c4d642a6955517f66ac5bb45 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:12:45.947082  5262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56627990da7d49f7a12669f23294a596. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.947381  5319 raft_consensus.cc:2804] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:45.947693  5183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 756d32b8c4d642a6955517f66ac5bb45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.948030  5319 raft_consensus.cc:697] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:12:45.950456  5255 tablet_service.cc:1511] Processing CreateTablet for tablet 756d32b8c4d642a6955517f66ac5bb45 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:12:45.951794  5255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 756d32b8c4d642a6955517f66ac5bb45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.958781  5316 tablet_bootstrap.cc:654] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:45.962245  5181 tablet_service.cc:1511] Processing CreateTablet for tablet 56627990da7d49f7a12669f23294a596 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:12:45.948939  5319 consensus_queue.cc:237] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:45.963611  5181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56627990da7d49f7a12669f23294a596. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:45.941568  5314 tablet_bootstrap.cc:654] T 271b0c7d258142798f30accd6aaba829 P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:46.005187  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 69868us
I20260709 12:12:46.007957  5187 tablet_service.cc:1511] Processing CreateTablet for tablet 89852cae0bd14fd8be73b84dc4a49b2a (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:12:46.009498  5339 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.009972  5339 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:46.016100  5187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89852cae0bd14fd8be73b84dc4a49b2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.017542  5339 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:46.017710  5260 tablet_service.cc:1511] Processing CreateTablet for tablet 63f38af52cc54adeb374ef3d32a43af6 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:12:46.018522  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:46.011373  5313 tablet_bootstrap.cc:492] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
W20260709 12:12:46.021591  5166 leader_election.cc:343] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:46.022363  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:12:46.023818  5163 leader_election.cc:343] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:46.024267  5163 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:12:46.025434  5339 raft_consensus.cc:2749] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:46.020229  5260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63f38af52cc54adeb374ef3d32a43af6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.031044  5115 tablet_service.cc:1511] Processing CreateTablet for tablet 7a9971183fee4e958cff325230a31b26 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:12:46.033100  5115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a9971183fee4e958cff325230a31b26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.021536  5313 ts_tablet_manager.cc:1403] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.337s	user 0.015s	sys 0.001s
I20260709 12:12:46.041734  5316 tablet_bootstrap.cc:492] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
I20260709 12:12:46.042122  5113 tablet_service.cc:1511] Processing CreateTablet for tablet d8dc93d0992c4324872c6aab5aa9db8c (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:12:46.043452  5113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8dc93d0992c4324872c6aab5aa9db8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.043296  5110 tablet_service.cc:1511] Processing CreateTablet for tablet 88f51ae73df747849e2f3cd63547a1d0 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:12:46.044059  5316 ts_tablet_manager.cc:1403] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.177s	user 0.016s	sys 0.022s
I20260709 12:12:46.049935  5023 catalog_manager.cc:5697] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 0 to 1, leader changed from <none> to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 1 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:46.053319  5255 tablet_service.cc:1511] Processing CreateTablet for tablet 89852cae0bd14fd8be73b84dc4a49b2a (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:12:46.053844  5110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88f51ae73df747849e2f3cd63547a1d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.054023  5316 raft_consensus.cc:359] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:46.054714  5255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89852cae0bd14fd8be73b84dc4a49b2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.054740  5316 raft_consensus.cc:385] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:46.055166  5316 raft_consensus.cc:740] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:46.056015  5316 consensus_queue.cc:260] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:46.065753  5114 tablet_service.cc:1511] Processing CreateTablet for tablet 87f29f851a0e43738cf01ef3724e5533 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:12:46.067051  5114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87f29f851a0e43738cf01ef3724e5533. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.069408  5109 tablet_service.cc:1511] Processing CreateTablet for tablet 21832120214f4b8fb9e2e0de351565f0 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:12:46.070711  5109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21832120214f4b8fb9e2e0de351565f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.076920  5113 tablet_service.cc:1511] Processing CreateTablet for tablet d8017a2b75074e4b9f0691c32850f71a (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:12:46.078145  5113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8017a2b75074e4b9f0691c32850f71a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.079294  5316 ts_tablet_manager.cc:1434] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.001s
I20260709 12:12:46.080271  5316 tablet_bootstrap.cc:492] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
I20260709 12:12:46.080371  5184 tablet_service.cc:1511] Processing CreateTablet for tablet 9f927a751b4041e99eb5ac25ddf214ec (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:12:46.081925  5184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f927a751b4041e99eb5ac25ddf214ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.089596  5186 tablet_service.cc:1511] Processing CreateTablet for tablet 20ba878da4e3492fbdf2f90c6bb202c4 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:12:46.091342  5186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20ba878da4e3492fbdf2f90c6bb202c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.100240  5259 tablet_service.cc:1511] Processing CreateTablet for tablet 9f927a751b4041e99eb5ac25ddf214ec (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:12:46.101645  5259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f927a751b4041e99eb5ac25ddf214ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.106446  5313 raft_consensus.cc:359] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:46.107219  5313 raft_consensus.cc:385] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:46.107525  5313 raft_consensus.cc:740] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
I20260709 12:12:46.108295  5313 consensus_queue.cc:260] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:46.101198  5316 tablet_bootstrap.cc:654] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:46.080371  5182 tablet_service.cc:1511] Processing CreateTablet for tablet 8d081e937c2741c9b646839e29e5599f (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:12:46.112614  5182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d081e937c2741c9b646839e29e5599f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.113041  5260 tablet_service.cc:1511] Processing CreateTablet for tablet 8d081e937c2741c9b646839e29e5599f (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:12:46.114419  5260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d081e937c2741c9b646839e29e5599f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.119063  5183 tablet_service.cc:1511] Processing CreateTablet for tablet fe3c5015888a494085f9a8b6eb204bcf (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:12:46.120507  5183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe3c5015888a494085f9a8b6eb204bcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.123328  5263 tablet_service.cc:1511] Processing CreateTablet for tablet fe3c5015888a494085f9a8b6eb204bcf (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:12:46.124964  5263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe3c5015888a494085f9a8b6eb204bcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.129845  5189 tablet_service.cc:1511] Processing CreateTablet for tablet 63f38af52cc54adeb374ef3d32a43af6 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:12:46.131213  5189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63f38af52cc54adeb374ef3d32a43af6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.141913  5190 tablet_service.cc:1511] Processing CreateTablet for tablet 9212b0f778ec4455b8054add86b66d78 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:12:46.142774  5313 ts_tablet_manager.cc:1434] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.104s	user 0.005s	sys 0.001s
I20260709 12:12:46.143685  5190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9212b0f778ec4455b8054add86b66d78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.143913  5261 tablet_service.cc:1511] Processing CreateTablet for tablet 20ba878da4e3492fbdf2f90c6bb202c4 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:12:46.147634  5314 tablet_bootstrap.cc:492] T 271b0c7d258142798f30accd6aaba829 P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:46.148173  5314 ts_tablet_manager.cc:1403] T 271b0c7d258142798f30accd6aaba829 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.271s	user 0.013s	sys 0.003s
I20260709 12:12:46.151234  5314 raft_consensus.cc:359] T 271b0c7d258142798f30accd6aaba829 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:46.152001  5314 raft_consensus.cc:385] T 271b0c7d258142798f30accd6aaba829 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:46.152300  5314 raft_consensus.cc:740] T 271b0c7d258142798f30accd6aaba829 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
I20260709 12:12:46.153203  5314 consensus_queue.cc:260] T 271b0c7d258142798f30accd6aaba829 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:46.156136  5314 ts_tablet_manager.cc:1434] T 271b0c7d258142798f30accd6aaba829 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:12:46.153791  5313 tablet_bootstrap.cc:492] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
I20260709 12:12:46.159782  5115 tablet_service.cc:1511] Processing CreateTablet for tablet 89852cae0bd14fd8be73b84dc4a49b2a (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:12:46.160005  5112 tablet_service.cc:1511] Processing CreateTablet for tablet 63f38af52cc54adeb374ef3d32a43af6 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:12:46.162225  5115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89852cae0bd14fd8be73b84dc4a49b2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.162179  5108 tablet_service.cc:1511] Processing CreateTablet for tablet 9f927a751b4041e99eb5ac25ddf214ec (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:12:46.163872  5113 tablet_service.cc:1511] Processing CreateTablet for tablet 56627990da7d49f7a12669f23294a596 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:12:46.166870  5257 tablet_service.cc:1511] Processing CreateTablet for tablet 9212b0f778ec4455b8054add86b66d78 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:12:46.162416  5111 tablet_service.cc:1511] Processing CreateTablet for tablet 20ba878da4e3492fbdf2f90c6bb202c4 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:12:46.169641  5112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63f38af52cc54adeb374ef3d32a43af6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.157223  5314 tablet_bootstrap.cc:492] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
I20260709 12:12:46.145331  5261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20ba878da4e3492fbdf2f90c6bb202c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.176646  5108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f927a751b4041e99eb5ac25ddf214ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.184109  5111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20ba878da4e3492fbdf2f90c6bb202c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.193050  5113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56627990da7d49f7a12669f23294a596. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.197165  5107 tablet_service.cc:1511] Processing CreateTablet for tablet 8d081e937c2741c9b646839e29e5599f (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:12:46.198783  5107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d081e937c2741c9b646839e29e5599f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.199507  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:46.205101  5106 tablet_service.cc:1511] Processing CreateTablet for tablet fe3c5015888a494085f9a8b6eb204bcf (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:12:46.206609  5106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe3c5015888a494085f9a8b6eb204bcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.207540  5114 tablet_service.cc:1511] Processing CreateTablet for tablet 756d32b8c4d642a6955517f66ac5bb45 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:12:46.208930  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:12:46.210178  5088 leader_election.cc:343] T c63fe19b7c5e4c73b49eee26ad00e88d P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:46.210912  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:46.212741  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:12:46.213721  5088 leader_election.cc:343] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:46.199548  5257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9212b0f778ec4455b8054add86b66d78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.222019  5088 leader_election.cc:304] T c63fe19b7c5e4c73b49eee26ad00e88d P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:12:46.224375  5264 tablet_service.cc:1511] Processing CreateTablet for tablet ecedf48dca8a4a35adc39d76a9a93513 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:12:46.226877  5186 tablet_service.cc:1511] Processing CreateTablet for tablet ba4d42e47cfd4d859ca8f5ee6401379c (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:12:46.230302  5186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba4d42e47cfd4d859ca8f5ee6401379c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.234498  5316 tablet_bootstrap.cc:492] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
I20260709 12:12:46.235014  5316 ts_tablet_manager.cc:1403] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.155s	user 0.030s	sys 0.017s
I20260709 12:12:46.208956  5114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 756d32b8c4d642a6955517f66ac5bb45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.242118  5320 raft_consensus.cc:2749] T c63fe19b7c5e4c73b49eee26ad00e88d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:12:46.242257  5088 leader_election.cc:343] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:46.242775  5088 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:12:46.243788  5258 tablet_service.cc:1511] Processing CreateTablet for tablet ba4d42e47cfd4d859ca8f5ee6401379c (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:12:46.243917  5183 tablet_service.cc:1511] Processing CreateTablet for tablet b4b265799c1c447794c6126f3ae47e5d (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:12:46.245251  5320 raft_consensus.cc:2749] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:46.245251  5183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4b265799c1c447794c6126f3ae47e5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.250685  5264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecedf48dca8a4a35adc39d76a9a93513. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.250478  5110 tablet_service.cc:1511] Processing CreateTablet for tablet 9212b0f778ec4455b8054add86b66d78 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:12:46.255511  5313 tablet_bootstrap.cc:654] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:46.256183  5258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba4d42e47cfd4d859ca8f5ee6401379c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.256620  5262 tablet_service.cc:1511] Processing CreateTablet for tablet b4b265799c1c447794c6126f3ae47e5d (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:12:46.262791  5332 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.263304  5332 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:46.265939  5332 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:46.263190  5262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4b265799c1c447794c6126f3ae47e5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.267575  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:46.268806  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:12:46.269003  5240 leader_election.cc:343] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:46.269110  5314 tablet_bootstrap.cc:654] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:46.269524  5199 raft_consensus.cc:2468] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 0.
I20260709 12:12:46.270918  5237 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:12:46.277256  5110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9212b0f778ec4455b8054add86b66d78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.284260  5316 raft_consensus.cc:359] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:46.285120  5316 raft_consensus.cc:385] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:46.273550  5332 raft_consensus.cc:2804] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:46.285795  5332 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:46.286182  5332 raft_consensus.cc:3060] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:46.291005  5256 tablet_service.cc:1511] Processing CreateTablet for tablet ddd16ccf58f24f6db29e5fc39a06e5c4 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:12:46.292346  5256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddd16ccf58f24f6db29e5fc39a06e5c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.285583  5316 raft_consensus.cc:740] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:46.299136  5316 consensus_queue.cc:260] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:46.314284  5112 tablet_service.cc:1511] Processing CreateTablet for tablet b4b265799c1c447794c6126f3ae47e5d (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:12:46.315752  5112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4b265799c1c447794c6126f3ae47e5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.322034  5111 tablet_service.cc:1511] Processing CreateTablet for tablet ecedf48dca8a4a35adc39d76a9a93513 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:12:46.323426  5111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecedf48dca8a4a35adc39d76a9a93513. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.326459  5190 tablet_service.cc:1511] Processing CreateTablet for tablet ddd16ccf58f24f6db29e5fc39a06e5c4 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:12:46.327950  5190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddd16ccf58f24f6db29e5fc39a06e5c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.332103  5320 raft_consensus.cc:493] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.332598  5320 raft_consensus.cc:515] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:46.333343  5112 tablet_service.cc:1511] Processing CreateTablet for tablet ddd16ccf58f24f6db29e5fc39a06e5c4 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:12:46.334677  5112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddd16ccf58f24f6db29e5fc39a06e5c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.334630  5320 leader_election.cc:290] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:46.343338  5109 tablet_service.cc:1511] Processing CreateTablet for tablet ba4d42e47cfd4d859ca8f5ee6401379c (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:12:46.344769  5109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba4d42e47cfd4d859ca8f5ee6401379c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.347672  5319 consensus_queue.cc:1048] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:46.385723  5313 tablet_bootstrap.cc:492] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:46.386268  5313 ts_tablet_manager.cc:1403] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.233s	user 0.017s	sys 0.012s
I20260709 12:12:46.385970  5189 tablet_service.cc:1511] Processing CreateTablet for tablet 90cb6c9306054ce3b2bc1bbd21c7345f (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:12:46.387409  5189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90cb6c9306054ce3b2bc1bbd21c7345f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.389317  5313 raft_consensus.cc:359] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:46.390045  5313 raft_consensus.cc:385] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:46.390365  5313 raft_consensus.cc:740] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
I20260709 12:12:46.391120  5313 consensus_queue.cc:260] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:46.389662  5112 tablet_service.cc:1511] Processing CreateTablet for tablet 90cb6c9306054ce3b2bc1bbd21c7345f (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:12:46.396467  5262 tablet_service.cc:1511] Processing CreateTablet for tablet 90cb6c9306054ce3b2bc1bbd21c7345f (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:12:46.397799  5262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90cb6c9306054ce3b2bc1bbd21c7345f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.430644  5112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90cb6c9306054ce3b2bc1bbd21c7345f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.431097  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:46.437681  5313 ts_tablet_manager.cc:1434] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.007s
I20260709 12:12:46.431867  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:46.438750  5274 raft_consensus.cc:2468] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 0.
I20260709 12:12:46.441077  5183 tablet_service.cc:1511] Processing CreateTablet for tablet c0500c51d8bf49ff987108802ec3ee12 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:12:46.442447  5183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0500c51d8bf49ff987108802ec3ee12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.437065  5316 ts_tablet_manager.cc:1434] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.202s	user 0.033s	sys 0.012s
I20260709 12:12:46.438730  5313 tablet_bootstrap.cc:492] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
I20260709 12:12:46.454444  5314 tablet_bootstrap.cc:492] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:46.454938  5314 ts_tablet_manager.cc:1403] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.298s	user 0.015s	sys 0.011s
I20260709 12:12:46.447991  5187 tablet_service.cc:1511] Processing CreateTablet for tablet ecedf48dca8a4a35adc39d76a9a93513 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:12:46.457875  5187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecedf48dca8a4a35adc39d76a9a93513. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.457814  5314 raft_consensus.cc:359] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:46.458789  5314 raft_consensus.cc:385] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:46.459139  5314 raft_consensus.cc:740] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
I20260709 12:12:46.451234  5332 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:46.472920  5184 tablet_service.cc:1511] Processing CreateTablet for tablet 3db164e3a1ce4a43b0a112a777118daa (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:12:46.463060  5088 leader_election.cc:304] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:12:46.474064  5320 raft_consensus.cc:2804] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:46.474372  5184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3db164e3a1ce4a43b0a112a777118daa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.474489  5320 raft_consensus.cc:493] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:46.474910  5320 raft_consensus.cc:3060] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:46.473783  5182 tablet_service.cc:1511] Processing CreateTablet for tablet 2a6867413d1d4b49bcd267c1e134d12e (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:12:46.485605  5313 tablet_bootstrap.cc:654] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:46.487605  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:12:46.488677  5182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a6867413d1d4b49bcd267c1e134d12e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:12:46.489127  5240 leader_election.cc:343] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:46.460012  5314 consensus_queue.cc:260] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:46.492348  5314 ts_tablet_manager.cc:1434] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
W20260709 12:12:46.474196  5088 leader_election.cc:343] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:46.493857  5320 raft_consensus.cc:515] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:46.508816  5320 leader_election.cc:290] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:46.493356  5314 tablet_bootstrap.cc:492] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
I20260709 12:12:46.512238  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:12:46.512890  5181 tablet_service.cc:1511] Processing CreateTablet for tablet 9f93759199ab4820a9a807a0f1c70c85 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:12:46.514300  5181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f93759199ab4820a9a807a0f1c70c85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.515450  5263 tablet_service.cc:1511] Processing CreateTablet for tablet 9f93759199ab4820a9a807a0f1c70c85 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:12:46.517340  5314 tablet_bootstrap.cc:654] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:46.502327  5071 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:46.502383  5107 tablet_service.cc:1511] Processing CreateTablet for tablet c0500c51d8bf49ff987108802ec3ee12 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
W20260709 12:12:46.518769  5163 consensus_peers.cc:597] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Couldn't send request to peer 9e794b72ed7640219f90ec4232363929. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:46.519460  5263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f93759199ab4820a9a807a0f1c70c85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.503213  5260 tablet_service.cc:1511] Processing CreateTablet for tablet 2a6867413d1d4b49bcd267c1e134d12e (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:12:46.520093  5110 tablet_service.cc:1511] Processing CreateTablet for tablet 3db164e3a1ce4a43b0a112a777118daa (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:12:46.520630  5260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a6867413d1d4b49bcd267c1e134d12e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.508708  5108 tablet_service.cc:1511] Processing CreateTablet for tablet 9f93759199ab4820a9a807a0f1c70c85 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:12:46.481261  5316 tablet_bootstrap.cc:492] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
I20260709 12:12:46.526000  5108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f93759199ab4820a9a807a0f1c70c85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.505693  5261 tablet_service.cc:1511] Processing CreateTablet for tablet 3db164e3a1ce4a43b0a112a777118daa (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:12:46.530189  5115 tablet_service.cc:1511] Processing CreateTablet for tablet 2a6867413d1d4b49bcd267c1e134d12e (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:12:46.530790  5261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3db164e3a1ce4a43b0a112a777118daa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.531458  5115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a6867413d1d4b49bcd267c1e134d12e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.540414  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
W20260709 12:12:46.540792  5088 leader_election.cc:343] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:46.540463  5106 tablet_service.cc:1511] Processing CreateTablet for tablet 9634d2debd9f4e7ea32cf4479f9242e1 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:12:46.542876  5106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9634d2debd9f4e7ea32cf4479f9242e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.545779  5274 raft_consensus.cc:3060] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:46.546756  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:12:46.547365  5199 raft_consensus.cc:3060] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:46.553503  5332 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:46.494499  5255 tablet_service.cc:1511] Processing CreateTablet for tablet c0500c51d8bf49ff987108802ec3ee12 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:12:46.554759  5255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0500c51d8bf49ff987108802ec3ee12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.558755  5186 tablet_service.cc:1511] Processing CreateTablet for tablet 9634d2debd9f4e7ea32cf4479f9242e1 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:12:46.560688  5186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9634d2debd9f4e7ea32cf4479f9242e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.565169  5110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3db164e3a1ce4a43b0a112a777118daa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.566978  5256 tablet_service.cc:1511] Processing CreateTablet for tablet 9634d2debd9f4e7ea32cf4479f9242e1 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:12:46.568519  5256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9634d2debd9f4e7ea32cf4479f9242e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.570483  5107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0500c51d8bf49ff987108802ec3ee12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.588876  5184 tablet_service.cc:1511] Processing CreateTablet for tablet f5815aa6770341a7ae03cf8dc1b8a05e (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:12:46.590675  5184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5815aa6770341a7ae03cf8dc1b8a05e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.594331  5332 raft_consensus.cc:493] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.594875  5332 raft_consensus.cc:515] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:46.595355  5110 tablet_service.cc:1511] Processing CreateTablet for tablet f5815aa6770341a7ae03cf8dc1b8a05e (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:12:46.596680  5110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5815aa6770341a7ae03cf8dc1b8a05e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.597074  5332 leader_election.cc:290] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:46.598197  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:46.599865  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:12:46.601811  5237 leader_election.cc:343] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:46.602571  5240 leader_election.cc:343] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:46.603001  5240 leader_election.cc:304] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:12:46.604914  5339 raft_consensus.cc:493] T 271b0c7d258142798f30accd6aaba829 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.605441  5339 raft_consensus.cc:515] T 271b0c7d258142798f30accd6aaba829 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:46.607630  5339 leader_election.cc:290] T 271b0c7d258142798f30accd6aaba829 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:46.609066  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:12:46.610903  5163 leader_election.cc:343] T 271b0c7d258142798f30accd6aaba829 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:46.612685  5264 tablet_service.cc:1511] Processing CreateTablet for tablet f5815aa6770341a7ae03cf8dc1b8a05e (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:12:46.614104  5264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5815aa6770341a7ae03cf8dc1b8a05e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.614251  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:12:46.615718  5166 leader_election.cc:343] T 271b0c7d258142798f30accd6aaba829 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:46.616194  5166 leader_election.cc:304] T 271b0c7d258142798f30accd6aaba829 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:12:46.604079  5332 raft_consensus.cc:2749] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:46.618714  5339 raft_consensus.cc:2749] T 271b0c7d258142798f30accd6aaba829 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:46.630352  5199 raft_consensus.cc:2468] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 1.
I20260709 12:12:46.632045  5237 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:12:46.633020  5332 raft_consensus.cc:2804] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:46.634315  5332 raft_consensus.cc:697] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:12:46.635154  5332 consensus_queue.cc:237] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:46.649926  5313 tablet_bootstrap.cc:492] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:46.650490  5313 ts_tablet_manager.cc:1403] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.212s	user 0.014s	sys 0.011s
I20260709 12:12:46.651656  5316 tablet_bootstrap.cc:654] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:46.665273  5187 tablet_service.cc:1511] Processing CreateTablet for tablet c7bb7b814fea4a2488cc39d06fc90483 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:12:46.666817  5187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7bb7b814fea4a2488cc39d06fc90483. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.667527  5319 raft_consensus.cc:493] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.668005  5319 raft_consensus.cc:515] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:46.668763  5115 tablet_service.cc:1511] Processing CreateTablet for tablet c7bb7b814fea4a2488cc39d06fc90483 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:12:46.669752  5115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7bb7b814fea4a2488cc39d06fc90483. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.688570  5262 tablet_service.cc:1511] Processing CreateTablet for tablet c7bb7b814fea4a2488cc39d06fc90483 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:12:46.688679  5108 tablet_service.cc:1511] Processing CreateTablet for tablet 2f01a696969543e4ba24b4a07185fce8 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:12:46.694103  5108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f01a696969543e4ba24b4a07185fce8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.690522  5319 leader_election.cc:290] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:46.692281  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:12:46.699393  5166 leader_election.cc:343] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:46.675511  5274 raft_consensus.cc:2468] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 1.
I20260709 12:12:46.711259  5088 leader_election.cc:304] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:12:46.712671  5320 raft_consensus.cc:2804] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:46.672461  5313 raft_consensus.cc:359] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } }
I20260709 12:12:46.722147  5313 raft_consensus.cc:385] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:46.722546  5313 raft_consensus.cc:740] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
I20260709 12:12:46.723317  5313 consensus_queue.cc:260] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } }
I20260709 12:12:46.728091  5182 tablet_service.cc:1511] Processing CreateTablet for tablet 2f01a696969543e4ba24b4a07185fce8 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:12:46.729579  5314 tablet_bootstrap.cc:492] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:46.732215  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:46.734117  5262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7bb7b814fea4a2488cc39d06fc90483. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.737962  5110 tablet_service.cc:1511] Processing CreateTablet for tablet ed974c2bf41a490ca098100bdfc63351 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:12:46.742067  5110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed974c2bf41a490ca098100bdfc63351. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.742411  5314 ts_tablet_manager.cc:1403] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.249s	user 0.053s	sys 0.055s
I20260709 12:12:46.749359  5181 tablet_service.cc:1511] Processing CreateTablet for tablet ed974c2bf41a490ca098100bdfc63351 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:12:46.749593  5256 tablet_service.cc:1511] Processing CreateTablet for tablet ed974c2bf41a490ca098100bdfc63351 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:12:46.750733  5181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed974c2bf41a490ca098100bdfc63351. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.751006  5256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed974c2bf41a490ca098100bdfc63351. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.751833  5314 raft_consensus.cc:359] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:46.752612  5314 raft_consensus.cc:385] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:46.752897  5314 raft_consensus.cc:740] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
W20260709 12:12:46.754109  5163 leader_election.cc:343] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:46.754573  5163 leader_election.cc:304] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:12:46.755534  5319 raft_consensus.cc:2749] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:46.757898  5263 tablet_service.cc:1511] Processing CreateTablet for tablet 2f01a696969543e4ba24b4a07185fce8 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:12:46.763136  5115 tablet_service.cc:1511] Processing CreateTablet for tablet d09ac3a18bc549dabadd7ec3c3f57017 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:12:46.763655  5316 tablet_bootstrap.cc:492] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
I20260709 12:12:46.764110  5316 ts_tablet_manager.cc:1403] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.296s	user 0.031s	sys 0.015s
I20260709 12:12:46.764364  5115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d09ac3a18bc549dabadd7ec3c3f57017. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.767148  5316 raft_consensus.cc:359] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:46.767977  5316 raft_consensus.cc:385] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:46.768333  5316 raft_consensus.cc:740] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:46.773447  5320 raft_consensus.cc:697] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:12:46.789194  5320 consensus_queue.cc:237] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:46.787817  5261 tablet_service.cc:1511] Processing CreateTablet for tablet d09ac3a18bc549dabadd7ec3c3f57017 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:12:46.769322  5316 consensus_queue.cc:260] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:46.794721  5316 ts_tablet_manager.cc:1434] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 12:12:46.794564  5186 tablet_service.cc:1511] Processing CreateTablet for tablet d09ac3a18bc549dabadd7ec3c3f57017 (DEFAULT_TABLE table=test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:12:46.795815  5316 tablet_bootstrap.cc:492] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
I20260709 12:12:46.785310  5263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f01a696969543e4ba24b4a07185fce8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.796909  5261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d09ac3a18bc549dabadd7ec3c3f57017. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.797714  5022 catalog_manager.cc:5697] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 1 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:46.799767  5314 consensus_queue.cc:260] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:46.803733  5182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f01a696969543e4ba24b4a07185fce8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.808614  5313 ts_tablet_manager.cc:1434] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.158s	user 0.015s	sys 0.005s
I20260709 12:12:46.809844  5313 tablet_bootstrap.cc:492] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
I20260709 12:12:46.816399  5313 tablet_bootstrap.cc:654] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:46.827095  5314 ts_tablet_manager.cc:1434] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.078s	user 0.007s	sys 0.000s
I20260709 12:12:46.828337  5314 tablet_bootstrap.cc:492] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
I20260709 12:12:46.836371  5316 tablet_bootstrap.cc:654] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:46.845718  5186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d09ac3a18bc549dabadd7ec3c3f57017. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:46.848104  5314 tablet_bootstrap.cc:654] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:46.856977  5023 catalog_manager.cc:5697] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 1 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:46.869684  5313 tablet_bootstrap.cc:492] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:46.870263  5313 ts_tablet_manager.cc:1403] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.061s	user 0.015s	sys 0.008s
I20260709 12:12:46.873319  5313 raft_consensus.cc:359] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:46.874361  5313 raft_consensus.cc:385] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:46.874878  5313 raft_consensus.cc:740] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
I20260709 12:12:46.875748  5313 consensus_queue.cc:260] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:46.878412  5313 ts_tablet_manager.cc:1434] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.005s
I20260709 12:12:46.879498  5320 raft_consensus.cc:493] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.880051  5320 raft_consensus.cc:515] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:46.882386  5320 leader_election.cc:290] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:46.879498  5313 tablet_bootstrap.cc:492] T 41c65b96548e49b3863d03db116fd8d0 P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
I20260709 12:12:46.884481  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:46.885918  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:12:46.886150  5088 leader_election.cc:343] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:46.887573  5300 tablet.cc:2406] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260709 12:12:46.887708  5088 leader_election.cc:343] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:46.888280  5088 leader_election.cc:304] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:12:46.889668  5320 raft_consensus.cc:2749] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:46.892019  5313 tablet_bootstrap.cc:654] T 41c65b96548e49b3863d03db116fd8d0 P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:46.898371  5316 tablet_bootstrap.cc:492] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
I20260709 12:12:46.899112  5316 ts_tablet_manager.cc:1403] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.104s	user 0.007s	sys 0.010s
I20260709 12:12:46.902611  5316 raft_consensus.cc:359] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:46.904995  5316 raft_consensus.cc:385] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:46.905530  5316 raft_consensus.cc:740] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:46.906487  5316 consensus_queue.cc:260] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:46.908376  5314 tablet_bootstrap.cc:492] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:46.908406  5313 tablet_bootstrap.cc:492] T 41c65b96548e49b3863d03db116fd8d0 P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:46.908722  5316 ts_tablet_manager.cc:1434] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.004s
I20260709 12:12:46.908996  5314 ts_tablet_manager.cc:1403] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.081s	user 0.012s	sys 0.038s
I20260709 12:12:46.909078  5313 ts_tablet_manager.cc:1403] T 41c65b96548e49b3863d03db116fd8d0 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.015s
I20260709 12:12:46.909940  5316 tablet_bootstrap.cc:492] T 4d8224f2bf564e7197a33ee531527a15 P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
I20260709 12:12:46.911986  5314 raft_consensus.cc:359] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:46.912317  5313 raft_consensus.cc:359] T 41c65b96548e49b3863d03db116fd8d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:46.912819  5314 raft_consensus.cc:385] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:46.913157  5313 raft_consensus.cc:385] T 41c65b96548e49b3863d03db116fd8d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:46.913204  5314 raft_consensus.cc:740] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
I20260709 12:12:46.913738  5313 raft_consensus.cc:740] T 41c65b96548e49b3863d03db116fd8d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
I20260709 12:12:46.914284  5314 consensus_queue.cc:260] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:46.914638  5313 consensus_queue.cc:260] T 41c65b96548e49b3863d03db116fd8d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:46.916249  5316 tablet_bootstrap.cc:654] T 4d8224f2bf564e7197a33ee531527a15 P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:46.920615  5313 ts_tablet_manager.cc:1434] T 41c65b96548e49b3863d03db116fd8d0 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:12:46.921769  5313 tablet_bootstrap.cc:492] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
I20260709 12:12:46.925033  5314 ts_tablet_manager.cc:1434] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:12:46.928143  5313 tablet_bootstrap.cc:654] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:46.930202  5314 tablet_bootstrap.cc:492] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
I20260709 12:12:46.938046  5314 tablet_bootstrap.cc:654] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:46.948719  5316 tablet_bootstrap.cc:492] T 4d8224f2bf564e7197a33ee531527a15 P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
I20260709 12:12:46.949185  5316 ts_tablet_manager.cc:1403] T 4d8224f2bf564e7197a33ee531527a15 P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.039s	user 0.008s	sys 0.028s
I20260709 12:12:46.949221  5313 tablet_bootstrap.cc:492] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:46.949848  5313 ts_tablet_manager.cc:1403] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.015s
I20260709 12:12:46.950407  5314 tablet_bootstrap.cc:492] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:46.950858  5314 ts_tablet_manager.cc:1403] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.000s
I20260709 12:12:46.951786  5313 raft_consensus.cc:359] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:46.952329  5313 raft_consensus.cc:385] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:46.952744  5313 raft_consensus.cc:740] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
I20260709 12:12:46.952306  5316 raft_consensus.cc:359] T 4d8224f2bf564e7197a33ee531527a15 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:46.953193  5316 raft_consensus.cc:385] T 4d8224f2bf564e7197a33ee531527a15 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:46.953547  5316 raft_consensus.cc:740] T 4d8224f2bf564e7197a33ee531527a15 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:46.953365  5313 consensus_queue.cc:260] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:46.953444  5314 raft_consensus.cc:359] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:46.954253  5314 raft_consensus.cc:385] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:46.954536  5314 raft_consensus.cc:740] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
I20260709 12:12:46.954391  5316 consensus_queue.cc:260] T 4d8224f2bf564e7197a33ee531527a15 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:46.955693  5313 ts_tablet_manager.cc:1434] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:12:46.955384  5314 consensus_queue.cc:260] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:46.957413  5314 ts_tablet_manager.cc:1434] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:12:46.957988  5313 tablet_bootstrap.cc:492] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
I20260709 12:12:46.958317  5314 tablet_bootstrap.cc:492] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
I20260709 12:12:46.959277  5316 ts_tablet_manager.cc:1434] T 4d8224f2bf564e7197a33ee531527a15 P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:12:46.960433  5316 tablet_bootstrap.cc:492] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
I20260709 12:12:46.964102  5313 tablet_bootstrap.cc:654] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:46.964625  5314 tablet_bootstrap.cc:654] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:46.966449  5319 raft_consensus.cc:493] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.966991  5319 raft_consensus.cc:515] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:46.967406  5316 tablet_bootstrap.cc:654] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:46.970641  5319 leader_election.cc:290] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:46.972518  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:46.975857  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:46.976677  5123 raft_consensus.cc:2468] T 41c65b96548e49b3863d03db116fd8d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 0.
I20260709 12:12:46.978688  5166 leader_election.cc:304] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:12:46.979781  5319 raft_consensus.cc:2804] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:46.980321  5319 raft_consensus.cc:493] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:46.980687  5319 raft_consensus.cc:3060] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:46.981693  5314 tablet_bootstrap.cc:492] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:46.982363  5314 ts_tablet_manager.cc:1403] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.024s	user 0.006s	sys 0.012s
I20260709 12:12:46.973327  5273 raft_consensus.cc:2468] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 0.
I20260709 12:12:46.985565  5314 raft_consensus.cc:359] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:46.987099  5320 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.986512  5314 raft_consensus.cc:385] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:46.988022  5314 raft_consensus.cc:740] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
I20260709 12:12:46.987634  5320 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:46.988927  5314 consensus_queue.cc:260] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:46.990031  5320 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:46.991477  5314 ts_tablet_manager.cc:1434] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:12:46.992396  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:46.992781  5314 tablet_bootstrap.cc:492] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
I20260709 12:12:46.993144  5199 raft_consensus.cc:2393] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 1: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:12:46.994958  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:46.996568  5088 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:12:46.998018  5320 raft_consensus.cc:3060] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:46.999181  5314 tablet_bootstrap.cc:654] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.015576  5314 tablet_bootstrap.cc:492] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:47.016237  5314 ts_tablet_manager.cc:1403] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.000s
I20260709 12:12:47.016445  5360 raft_consensus.cc:493] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.017027  5360 raft_consensus.cc:515] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } }
I20260709 12:12:47.019075  5314 raft_consensus.cc:359] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.019550  5360 leader_election.cc:290] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:47.019851  5314 raft_consensus.cc:385] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.020346  5314 raft_consensus.cc:740] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.021171  5314 consensus_queue.cc:260] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.021508  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:47.023170  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:47.023725  5314 ts_tablet_manager.cc:1434] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:12:47.023826  5199 raft_consensus.cc:2468] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 0.
I20260709 12:12:47.024825  5314 tablet_bootstrap.cc:492] T c69b050cdaeb4f1db6cd4993ad703192 P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
W20260709 12:12:47.025470  5088 leader_election.cc:343] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:47.026197  5088 leader_election.cc:304] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:12:47.027288  5360 raft_consensus.cc:2804] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:47.027654  5360 raft_consensus.cc:493] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.027976  5360 raft_consensus.cc:3060] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.030957  5320 raft_consensus.cc:2749] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:47.031565  5314 tablet_bootstrap.cc:654] T c69b050cdaeb4f1db6cd4993ad703192 P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.039821  5360 raft_consensus.cc:515] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } }
I20260709 12:12:47.041811  5319 raft_consensus.cc:515] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.043778  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:12:47.044157  5314 tablet_bootstrap.cc:492] T c69b050cdaeb4f1db6cd4993ad703192 P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:47.044691  5314 ts_tablet_manager.cc:1403] T c69b050cdaeb4f1db6cd4993ad703192 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.005s
I20260709 12:12:47.044761  5332 raft_consensus.cc:493] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.044844  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:12:47.045548  5123 raft_consensus.cc:3060] T 41c65b96548e49b3863d03db116fd8d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.045329  5332 raft_consensus.cc:515] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.047519  5332 leader_election.cc:290] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:47.047834  5314 raft_consensus.cc:359] T c69b050cdaeb4f1db6cd4993ad703192 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.048422  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:47.048887  5360 leader_election.cc:290] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:47.049101  5124 raft_consensus.cc:2468] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 0.
I20260709 12:12:47.048511  5314 raft_consensus.cc:385] T c69b050cdaeb4f1db6cd4993ad703192 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.049636  5314 raft_consensus.cc:740] T c69b050cdaeb4f1db6cd4993ad703192 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
W20260709 12:12:47.050457  5088 leader_election.cc:343] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:47.049172  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:47.050462  5240 leader_election.cc:304] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:12:47.051220  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:12:47.051460  5199 raft_consensus.cc:2468] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 0.
I20260709 12:12:47.051802  5200 raft_consensus.cc:3060] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.052066  5332 raft_consensus.cc:2804] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:47.052518  5332 raft_consensus.cc:493] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.052870  5332 raft_consensus.cc:3060] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.053253  5360 raft_consensus.cc:493] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.053781  5360 raft_consensus.cc:515] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.056519  5123 raft_consensus.cc:2468] T 41c65b96548e49b3863d03db116fd8d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 1.
I20260709 12:12:47.056615  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:47.063995  5199 raft_consensus.cc:2468] T 271b0c7d258142798f30accd6aaba829 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 0.
I20260709 12:12:47.058739  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:47.059247  5360 leader_election.cc:290] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:47.064819  5166 leader_election.cc:304] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:12:47.050428  5314 consensus_queue.cc:260] T c69b050cdaeb4f1db6cd4993ad703192 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.065850  5339 raft_consensus.cc:2804] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:47.065987  5088 leader_election.cc:304] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:12:47.061309  5332 raft_consensus.cc:515] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:12:47.066928  5088 leader_election.cc:343] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:47.067790  5360 raft_consensus.cc:2804] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:47.068156  5360 raft_consensus.cc:493] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.068466  5360 raft_consensus.cc:3060] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.063050  5200 raft_consensus.cc:2468] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 1.
I20260709 12:12:47.069591  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:12:47.070046  5088 leader_election.cc:304] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:12:47.070196  5124 raft_consensus.cc:3060] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.071134  5332 leader_election.cc:290] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:47.070981  5350 consensus_queue.cc:1048] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:47.083707  5320 raft_consensus.cc:2804] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:47.084160  5377 raft_consensus.cc:493] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.084756  5377 raft_consensus.cc:515] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.088042  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:12:47.088240  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:47.088689  5273 raft_consensus.cc:3060] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.090253  5320 raft_consensus.cc:697] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:12:47.091197  5320 consensus_queue.cc:237] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } }
I20260709 12:12:47.096499  5273 raft_consensus.cc:2468] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 1.
I20260709 12:12:47.096417  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:47.097609  5274 raft_consensus.cc:2393] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 1: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:12:47.097791  5377 leader_election.cc:290] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:47.099037  5163 leader_election.cc:304] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:12:47.099573  5124 raft_consensus.cc:2468] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 1.
I20260709 12:12:47.100732  5240 leader_election.cc:304] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:12:47.101058  5339 raft_consensus.cc:697] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:12:47.101720  5350 raft_consensus.cc:2804] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:47.102190  5350 raft_consensus.cc:697] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:12:47.102201  5339 consensus_queue.cc:237] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.103139  5350 consensus_queue.cc:237] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.106432  5319 leader_election.cc:290] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:47.107463  5319 raft_consensus.cc:3060] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.115572  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:12:47.116328  5200 raft_consensus.cc:3060] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.116219  5023 catalog_manager.cc:5697] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 1 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:47.096820  5360 raft_consensus.cc:515] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.128822  5314 ts_tablet_manager.cc:1434] T c69b050cdaeb4f1db6cd4993ad703192 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.084s	user 0.039s	sys 0.011s
I20260709 12:12:47.130091  5314 tablet_bootstrap.cc:492] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
I20260709 12:12:47.119853  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:12:47.132925  5313 tablet_bootstrap.cc:492] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:47.133498  5313 ts_tablet_manager.cc:1403] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.176s	user 0.050s	sys 0.030s
I20260709 12:12:47.131558  5376 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.132869  5198 raft_consensus.cc:3060] T 271b0c7d258142798f30accd6aaba829 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.135445  5319 raft_consensus.cc:2749] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:47.135977  5021 catalog_manager.cc:5697] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 1 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:47.137352  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:12:47.132941  5360 leader_election.cc:290] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:47.137878  5313 raft_consensus.cc:359] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:12:47.140712  5088 leader_election.cc:343] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:47.146040  5313 raft_consensus.cc:385] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.146371  5313 raft_consensus.cc:740] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.147075  5313 consensus_queue.cc:260] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.148313  5200 raft_consensus.cc:2468] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 1.
I20260709 12:12:47.149319  5313 ts_tablet_manager.cc:1434] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.000s
I20260709 12:12:47.150279  5313 tablet_bootstrap.cc:492] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
I20260709 12:12:47.141229  5316 tablet_bootstrap.cc:492] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
I20260709 12:12:47.138063  5376 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.152470  5376 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:47.153275  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:12:47.154863  5166 leader_election.cc:343] T c69b050cdaeb4f1db6cd4993ad703192 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:47.155077  5198 raft_consensus.cc:2468] T 271b0c7d258142798f30accd6aaba829 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 1.
I20260709 12:12:47.155107  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:47.156293  5316 ts_tablet_manager.cc:1403] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.196s	user 0.048s	sys 0.095s
I20260709 12:12:47.156446  5088 leader_election.cc:304] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
W20260709 12:12:47.156865  5163 leader_election.cc:343] T c69b050cdaeb4f1db6cd4993ad703192 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:47.157331  5163 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:12:47.159610  5316 raft_consensus.cc:359] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.160425  5316 raft_consensus.cc:385] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.160722  5313 tablet_bootstrap.cc:654] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.160898  5314 tablet_bootstrap.cc:654] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.160704  5316 raft_consensus.cc:740] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.162510  5023 catalog_manager.cc:5697] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 0 to 1, leader changed from <none> to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 1 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:47.164101  5316 consensus_queue.cc:260] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.165706  5376 raft_consensus.cc:2749] T c69b050cdaeb4f1db6cd4993ad703192 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:47.167176  5316 ts_tablet_manager.cc:1434] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 12:12:47.168043  5360 raft_consensus.cc:2804] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:47.171315  5360 raft_consensus.cc:697] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:12:47.173573  5316 tablet_bootstrap.cc:492] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
I20260709 12:12:47.172412  5360 consensus_queue.cc:237] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.179356  5350 consensus_queue.cc:1048] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:47.181111  5350 raft_consensus.cc:493] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.181603  5350 raft_consensus.cc:515] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.185169  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:47.185607  5350 leader_election.cc:290] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:47.185978  5123 raft_consensus.cc:2468] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 0.
I20260709 12:12:47.187088  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:47.187836  5199 raft_consensus.cc:2468] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 0.
I20260709 12:12:47.188606  5240 leader_election.cc:304] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:12:47.187804  5314 tablet_bootstrap.cc:492] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:47.189970  5332 raft_consensus.cc:2804] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:47.190413  5332 raft_consensus.cc:493] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.190776  5332 raft_consensus.cc:3060] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.189990  5314 ts_tablet_manager.cc:1403] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.060s	user 0.014s	sys 0.004s
I20260709 12:12:47.200242  5332 raft_consensus.cc:515] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.208456  5314 raft_consensus.cc:359] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.209276  5314 raft_consensus.cc:385] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.209578  5314 raft_consensus.cc:740] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.210306  5314 consensus_queue.cc:260] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.212574  5314 ts_tablet_manager.cc:1434] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.000s
I20260709 12:12:47.204828  5316 tablet_bootstrap.cc:654] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.222255  5313 tablet_bootstrap.cc:492] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:47.222733  5313 ts_tablet_manager.cc:1403] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.073s	user 0.035s	sys 0.028s
I20260709 12:12:47.223922  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:12:47.224329  5314 tablet_bootstrap.cc:492] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
I20260709 12:12:47.224537  5124 raft_consensus.cc:3060] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.225463  5313 raft_consensus.cc:359] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.226147  5313 raft_consensus.cc:385] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.226415  5313 raft_consensus.cc:740] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.227192  5313 consensus_queue.cc:260] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.229516  5313 ts_tablet_manager.cc:1434] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:12:47.229851  5332 leader_election.cc:290] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:47.230062  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:12:47.230456  5313 tablet_bootstrap.cc:492] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
I20260709 12:12:47.230666  5198 raft_consensus.cc:3060] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.231669  5124 raft_consensus.cc:2468] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 1.
I20260709 12:12:47.232864  5240 leader_election.cc:304] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:12:47.233227  5314 tablet_bootstrap.cc:654] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.233857  5332 raft_consensus.cc:2804] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:47.234817  5332 raft_consensus.cc:697] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:12:47.235636  5332 consensus_queue.cc:237] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.238116  5198 raft_consensus.cc:2468] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 1.
I20260709 12:12:47.242663  5022 catalog_manager.cc:5697] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 1 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:47.247596  5316 tablet_bootstrap.cc:492] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
I20260709 12:12:47.248129  5316 ts_tablet_manager.cc:1403] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.075s	user 0.006s	sys 0.005s
I20260709 12:12:47.249336  5313 tablet_bootstrap.cc:654] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.250824  5316 raft_consensus.cc:359] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.251540  5316 raft_consensus.cc:385] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.251857  5316 raft_consensus.cc:740] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.252547  5316 consensus_queue.cc:260] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.254499  5316 ts_tablet_manager.cc:1434] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:12:47.255537  5316 tablet_bootstrap.cc:492] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
I20260709 12:12:47.258919  5313 tablet_bootstrap.cc:492] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:47.259442  5313 ts_tablet_manager.cc:1403] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.029s	user 0.006s	sys 0.003s
I20260709 12:12:47.261713  5376 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.261284  5316 tablet_bootstrap.cc:654] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.262241  5313 raft_consensus.cc:359] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.263087  5313 raft_consensus.cc:385] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.263283  5313 raft_consensus.cc:740] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.262231  5376 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.265224  5313 consensus_queue.cc:260] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.267342  5313 ts_tablet_manager.cc:1434] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:12:47.267352  5314 tablet_bootstrap.cc:492] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:47.267910  5314 ts_tablet_manager.cc:1403] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.055s	user 0.011s	sys 0.008s
I20260709 12:12:47.268983  5313 tablet_bootstrap.cc:492] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
I20260709 12:12:47.270918  5314 raft_consensus.cc:359] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.271649  5314 raft_consensus.cc:385] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.271948  5314 raft_consensus.cc:740] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.272722  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:47.273123  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:47.273543  5124 raft_consensus.cc:2468] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 0.
I20260709 12:12:47.273734  5273 raft_consensus.cc:2468] T 4d8224f2bf564e7197a33ee531527a15 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 0.
I20260709 12:12:47.274916  5163 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:12:47.275648  5319 raft_consensus.cc:2804] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:47.275996  5319 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.276324  5319 raft_consensus.cc:3060] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.279337  5360 consensus_queue.cc:1048] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:47.279454  5339 raft_consensus.cc:493] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.280885  5339 raft_consensus.cc:515] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.271580  5376 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:47.283325  5339 leader_election.cc:290] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:47.272797  5314 consensus_queue.cc:260] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.285436  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:47.287539  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:47.290133  5124 raft_consensus.cc:2468] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 0.
I20260709 12:12:47.284487  5319 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.288267  5313 tablet_bootstrap.cc:654] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.292517  5319 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:47.294414  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:12:47.295068  5124 raft_consensus.cc:3060] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.296258  5314 ts_tablet_manager.cc:1434] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 12:12:47.297139  5314 tablet_bootstrap.cc:492] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
W20260709 12:12:47.292407  5163 leader_election.cc:343] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:47.300643  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:12:47.301321  5273 raft_consensus.cc:3060] T 4d8224f2bf564e7197a33ee531527a15 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.302896  5314 tablet_bootstrap.cc:654] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.307484  5166 leader_election.cc:304] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:12:47.313992  5360 consensus_queue.cc:1048] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:47.317005  5316 tablet_bootstrap.cc:492] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
I20260709 12:12:47.317545  5316 ts_tablet_manager.cc:1403] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.062s	user 0.009s	sys 0.008s
I20260709 12:12:47.319389  5319 raft_consensus.cc:2804] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:47.319978  5319 raft_consensus.cc:493] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.320310  5319 raft_consensus.cc:3060] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.320667  5316 raft_consensus.cc:359] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.321349  5316 raft_consensus.cc:385] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.321645  5316 raft_consensus.cc:740] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.322316  5316 consensus_queue.cc:260] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.324257  5316 ts_tablet_manager.cc:1434] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.004s
I20260709 12:12:47.325112  5316 tablet_bootstrap.cc:492] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
I20260709 12:12:47.328862  5273 raft_consensus.cc:2468] T 4d8224f2bf564e7197a33ee531527a15 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 1.
I20260709 12:12:47.331194  5316 tablet_bootstrap.cc:654] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.331302  5319 raft_consensus.cc:515] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.293799  5023 catalog_manager.cc:5697] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 1 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:47.342440  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:12:47.343214  5123 raft_consensus.cc:3060] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.343544  5316 tablet_bootstrap.cc:492] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
I20260709 12:12:47.344019  5316 ts_tablet_manager.cc:1403] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.000s
I20260709 12:12:47.346673  5316 raft_consensus.cc:359] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.347348  5316 raft_consensus.cc:385] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.347612  5316 raft_consensus.cc:740] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.348256  5316 consensus_queue.cc:260] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.351650  5313 tablet_bootstrap.cc:492] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:47.352105  5313 ts_tablet_manager.cc:1403] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.084s	user 0.017s	sys 0.009s
I20260709 12:12:47.354353  5316 ts_tablet_manager.cc:1434] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:12:47.354717  5313 raft_consensus.cc:359] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.355230  5316 tablet_bootstrap.cc:492] T 8a4dd376f83a42a896a5e1aca58d3221 P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
I20260709 12:12:47.355433  5313 raft_consensus.cc:385] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.355744  5313 raft_consensus.cc:740] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.355701  5163 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:12:47.356608  5339 raft_consensus.cc:2804] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:47.356491  5313 consensus_queue.cc:260] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.357111  5339 raft_consensus.cc:697] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:12:47.358539  5313 ts_tablet_manager.cc:1434] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:12:47.358376  5339 consensus_queue.cc:237] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.359385  5313 tablet_bootstrap.cc:492] T a975d4f227214562b6fc39ea53081961 P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
I20260709 12:12:47.359964  5124 raft_consensus.cc:2468] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 1.
I20260709 12:12:47.358461  5319 leader_election.cc:290] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:47.361626  5332 raft_consensus.cc:493] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.362267  5332 raft_consensus.cc:515] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.362906  5316 tablet_bootstrap.cc:654] T 8a4dd376f83a42a896a5e1aca58d3221 P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.351456  5123 raft_consensus.cc:2468] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 1.
I20260709 12:12:47.358371  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:12:47.365703  5273 raft_consensus.cc:3060] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.366546  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:47.367336  5199 raft_consensus.cc:2393] T 271b0c7d258142798f30accd6aaba829 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 1: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:12:47.369731  5166 leader_election.cc:304] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:12:47.364392  5332 leader_election.cc:290] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:47.370925  5376 raft_consensus.cc:2804] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:47.371412  5376 raft_consensus.cc:697] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:12:47.372257  5376 consensus_queue.cc:237] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.377564  5313 tablet_bootstrap.cc:654] T a975d4f227214562b6fc39ea53081961 P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.385802  5273 raft_consensus.cc:2468] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 1.
I20260709 12:12:47.387717  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:47.388139  5316 tablet_bootstrap.cc:492] T 8a4dd376f83a42a896a5e1aca58d3221 P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
I20260709 12:12:47.388612  5316 ts_tablet_manager.cc:1403] T 8a4dd376f83a42a896a5e1aca58d3221 P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.001s
I20260709 12:12:47.389657  5360 raft_consensus.cc:493] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.390157  5360 raft_consensus.cc:515] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.391005  5332 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.391949  5332 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.392361  5316 raft_consensus.cc:359] T 8a4dd376f83a42a896a5e1aca58d3221 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } }
I20260709 12:12:47.392813  5360 leader_election.cc:290] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:47.393039  5316 raft_consensus.cc:385] T 8a4dd376f83a42a896a5e1aca58d3221 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.393306  5316 raft_consensus.cc:740] T 8a4dd376f83a42a896a5e1aca58d3221 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.395785  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:47.396553  5125 raft_consensus.cc:2468] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 0.
I20260709 12:12:47.396497  5316 consensus_queue.cc:260] T 8a4dd376f83a42a896a5e1aca58d3221 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } }
I20260709 12:12:47.398149  5240 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:12:47.400357  5385 raft_consensus.cc:2804] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:47.400831  5385 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.401160  5385 raft_consensus.cc:3060] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.399192  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:47.410652  5316 ts_tablet_manager.cc:1434] T 8a4dd376f83a42a896a5e1aca58d3221 P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.003s
I20260709 12:12:47.411213  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:12:47.413823  5088 leader_election.cc:343] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:47.413832  5199 raft_consensus.cc:2468] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 0.
I20260709 12:12:47.417271  5088 leader_election.cc:304] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:12:47.418656  5360 raft_consensus.cc:2804] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:47.419066  5360 raft_consensus.cc:493] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.419410  5360 raft_consensus.cc:3060] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.412596  5240 leader_election.cc:304] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:12:47.422338  5350 raft_consensus.cc:3060] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.422668  5332 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:47.423579  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:47.424360  5199 raft_consensus.cc:2468] T c69b050cdaeb4f1db6cd4993ad703192 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 0.
I20260709 12:12:47.427129  5316 tablet_bootstrap.cc:492] T 62577fc91bb44d3a882109dc63f74008 P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
I20260709 12:12:47.431465  5385 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.436082  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:12:47.436919  5123 raft_consensus.cc:3060] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.443557  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:12:47.444335  5199 raft_consensus.cc:3060] T c69b050cdaeb4f1db6cd4993ad703192 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.440843  5360 raft_consensus.cc:515] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.456897  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:12:47.457556  5198 raft_consensus.cc:3060] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.458227  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
W20260709 12:12:47.459681  5088 leader_election.cc:343] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:47.460227  5360 leader_election.cc:290] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:47.448858  5385 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:47.470763  5314 tablet_bootstrap.cc:492] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:47.470912  5199 raft_consensus.cc:2468] T c69b050cdaeb4f1db6cd4993ad703192 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 1.
I20260709 12:12:47.471298  5314 ts_tablet_manager.cc:1403] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.174s	user 0.051s	sys 0.074s
I20260709 12:12:47.472394  5198 raft_consensus.cc:2468] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 1.
I20260709 12:12:47.472563  5237 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:12:47.472378  5350 raft_consensus.cc:2749] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:47.472657  5123 raft_consensus.cc:2468] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 1.
I20260709 12:12:47.473742  5385 raft_consensus.cc:2804] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:47.473905  5088 leader_election.cc:304] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:12:47.475284  5385 raft_consensus.cc:697] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:12:47.475450  5360 raft_consensus.cc:2804] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:47.476123  5360 raft_consensus.cc:697] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:12:47.476159  5385 consensus_queue.cc:237] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.477221  5360 consensus_queue.cc:237] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.478534  5313 tablet_bootstrap.cc:492] T a975d4f227214562b6fc39ea53081961 P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:47.478927  5313 ts_tablet_manager.cc:1403] T a975d4f227214562b6fc39ea53081961 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.120s	user 0.033s	sys 0.054s
I20260709 12:12:47.481348  5314 raft_consensus.cc:359] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.482846  5313 raft_consensus.cc:359] T a975d4f227214562b6fc39ea53081961 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.483393  5313 raft_consensus.cc:385] T a975d4f227214562b6fc39ea53081961 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.483628  5313 raft_consensus.cc:740] T a975d4f227214562b6fc39ea53081961 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.484647  5316 tablet_bootstrap.cc:654] T 62577fc91bb44d3a882109dc63f74008 P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.484982  5023 catalog_manager.cc:5697] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 0 to 1, leader changed from <none> to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 1 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:47.482056  5314 raft_consensus.cc:385] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.486411  5314 raft_consensus.cc:740] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.487056  5274 raft_consensus.cc:3060] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.486614  5023 catalog_manager.cc:5697] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 0 to 1, leader changed from <none> to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 1 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:47.486725  5022 catalog_manager.cc:5697] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 1 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:47.495033  5021 catalog_manager.cc:5697] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 1 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:47.484323  5313 consensus_queue.cc:260] T a975d4f227214562b6fc39ea53081961 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.499687  5313 ts_tablet_manager.cc:1434] T a975d4f227214562b6fc39ea53081961 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:12:47.500754  5313 tablet_bootstrap.cc:492] T e3beaf3ce31042719868401157039ee9 P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
I20260709 12:12:47.487165  5314 consensus_queue.cc:260] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.504874  5385 raft_consensus.cc:493] T 8a4dd376f83a42a896a5e1aca58d3221 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.505610  5385 raft_consensus.cc:515] T 8a4dd376f83a42a896a5e1aca58d3221 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } }
I20260709 12:12:47.507742  5385 leader_election.cc:290] T 8a4dd376f83a42a896a5e1aca58d3221 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:47.508574  5314 ts_tablet_manager.cc:1434] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.037s	user 0.004s	sys 0.002s
I20260709 12:12:47.509667  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:47.510082  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:47.510915  5199 raft_consensus.cc:2393] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 1: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:12:47.511324  5376 raft_consensus.cc:493] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.511776  5376 raft_consensus.cc:515] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.513625  5240 leader_election.cc:304] T 8a4dd376f83a42a896a5e1aca58d3221 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:12:47.514446  5385 raft_consensus.cc:3060] T 8a4dd376f83a42a896a5e1aca58d3221 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.521629  5385 raft_consensus.cc:2749] T 8a4dd376f83a42a896a5e1aca58d3221 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:12:47.523571  5071 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:47.536088  5314 tablet_bootstrap.cc:492] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
I20260709 12:12:47.537029  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:47.537833  5123 raft_consensus.cc:2468] T a975d4f227214562b6fc39ea53081961 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 0.
I20260709 12:12:47.538347  5316 tablet_bootstrap.cc:492] T 62577fc91bb44d3a882109dc63f74008 P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
I20260709 12:12:47.538801  5316 ts_tablet_manager.cc:1403] T 62577fc91bb44d3a882109dc63f74008 P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.112s	user 0.018s	sys 0.017s
I20260709 12:12:47.539357  5166 leader_election.cc:304] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:12:47.540318  5319 raft_consensus.cc:2804] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:47.540678  5319 raft_consensus.cc:493] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.541111  5319 raft_consensus.cc:3060] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.543315  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:47.544574  5314 tablet_bootstrap.cc:654] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:47.544975  5163 leader_election.cc:343] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:47.513875  5313 tablet_bootstrap.cc:654] T e3beaf3ce31042719868401157039ee9 P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.545635  5376 leader_election.cc:290] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:47.546644  5316 raft_consensus.cc:359] T 62577fc91bb44d3a882109dc63f74008 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.547384  5316 raft_consensus.cc:385] T 62577fc91bb44d3a882109dc63f74008 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.547636  5316 raft_consensus.cc:740] T 62577fc91bb44d3a882109dc63f74008 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.548475  5316 consensus_queue.cc:260] T 62577fc91bb44d3a882109dc63f74008 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.555230  5313 tablet_bootstrap.cc:492] T e3beaf3ce31042719868401157039ee9 P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:47.555714  5313 ts_tablet_manager.cc:1403] T e3beaf3ce31042719868401157039ee9 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.055s	user 0.009s	sys 0.000s
I20260709 12:12:47.556315  5316 ts_tablet_manager.cc:1434] T 62577fc91bb44d3a882109dc63f74008 P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:12:47.556916  5360 consensus_queue.cc:1048] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:47.557299  5316 tablet_bootstrap.cc:492] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
I20260709 12:12:47.558732  5313 raft_consensus.cc:359] T e3beaf3ce31042719868401157039ee9 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.559414  5313 raft_consensus.cc:385] T e3beaf3ce31042719868401157039ee9 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.559713  5313 raft_consensus.cc:740] T e3beaf3ce31042719868401157039ee9 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.560376  5313 consensus_queue.cc:260] T e3beaf3ce31042719868401157039ee9 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.563211  5313 ts_tablet_manager.cc:1434] T e3beaf3ce31042719868401157039ee9 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:12:47.548219  5319 raft_consensus.cc:515] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.565011  5313 tablet_bootstrap.cc:492] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
I20260709 12:12:47.568104  5316 tablet_bootstrap.cc:654] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.569520  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:12:47.570127  5123 raft_consensus.cc:3060] T a975d4f227214562b6fc39ea53081961 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.569892  5360 consensus_queue.cc:1048] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:47.574216  5319 leader_election.cc:290] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:47.577625  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:12:47.582569  5313 tablet_bootstrap.cc:654] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.584631  5385 consensus_queue.cc:1048] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:12:47.584635  5163 leader_election.cc:343] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:47.594938  5320 consensus_queue.cc:1048] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:47.596462  5123 raft_consensus.cc:2468] T a975d4f227214562b6fc39ea53081961 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 1.
I20260709 12:12:47.596722  5314 tablet_bootstrap.cc:492] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:47.597276  5314 ts_tablet_manager.cc:1403] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.061s	user 0.008s	sys 0.007s
I20260709 12:12:47.597751  5166 leader_election.cc:304] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:12:47.600404  5377 raft_consensus.cc:2804] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:47.600955  5377 raft_consensus.cc:697] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:12:47.605753  5314 raft_consensus.cc:359] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.606585  5314 raft_consensus.cc:385] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.605890  5377 consensus_queue.cc:237] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.606875  5314 raft_consensus.cc:740] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.607580  5314 consensus_queue.cc:260] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.612934  5314 ts_tablet_manager.cc:1434] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 12:12:47.615130  5314 tablet_bootstrap.cc:492] T 84919c977be24017b74e122582f71fbe P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
I20260709 12:12:47.638806  5385 consensus_queue.cc:1048] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:47.641721  5377 consensus_queue.cc:1048] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:47.663136  5314 tablet_bootstrap.cc:654] T 84919c977be24017b74e122582f71fbe P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.665953  5316 tablet_bootstrap.cc:492] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
I20260709 12:12:47.666455  5316 ts_tablet_manager.cc:1403] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.109s	user 0.009s	sys 0.018s
I20260709 12:12:47.667176  5377 consensus_queue.cc:1048] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:47.670621  5316 raft_consensus.cc:359] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.671407  5316 raft_consensus.cc:385] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.671936  5316 raft_consensus.cc:740] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.672603  5316 consensus_queue.cc:260] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.673473  5313 tablet_bootstrap.cc:492] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:47.674005  5313 ts_tablet_manager.cc:1403] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.109s	user 0.010s	sys 0.012s
I20260709 12:12:47.675918  5316 ts_tablet_manager.cc:1434] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:12:47.676940  5316 tablet_bootstrap.cc:492] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
I20260709 12:12:47.686187  5313 raft_consensus.cc:359] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.686978  5313 raft_consensus.cc:385] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.687284  5313 raft_consensus.cc:740] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.685751  5377 raft_consensus.cc:493] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.688932  5313 consensus_queue.cc:260] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.688441  5319 raft_consensus.cc:493] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.690037  5319 raft_consensus.cc:515] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.692843  5319 leader_election.cc:290] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:47.689543  5377 raft_consensus.cc:515] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.695333  5313 ts_tablet_manager.cc:1434] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:12:47.695521  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:47.702950  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:47.705257  5274 raft_consensus.cc:2468] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 0.
I20260709 12:12:47.705365  5123 raft_consensus.cc:2468] T e3beaf3ce31042719868401157039ee9 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 0.
I20260709 12:12:47.706650  5163 leader_election.cc:304] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:12:47.707526  5376 raft_consensus.cc:2804] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:47.707878  5376 raft_consensus.cc:493] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.708205  5376 raft_consensus.cc:3060] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.710762  5377 leader_election.cc:290] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:47.711614  5313 tablet_bootstrap.cc:492] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
I20260709 12:12:47.713512  5359 consensus_queue.cc:1048] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:47.714440  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:12:47.715718  5163 leader_election.cc:343] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:47.722718  5023 catalog_manager.cc:5697] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 0 to 1, leader changed from <none> to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 1 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:47.736384  5376 raft_consensus.cc:515] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.753631  5350 consensus_queue.cc:1048] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:47.738195  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:12:47.755633  5166 leader_election.cc:343] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:47.756196  5166 leader_election.cc:304] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:12:47.757470  5377 raft_consensus.cc:2749] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:47.768405  5314 tablet_bootstrap.cc:492] T 84919c977be24017b74e122582f71fbe P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:47.768970  5314 ts_tablet_manager.cc:1403] T 84919c977be24017b74e122582f71fbe P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.154s	user 0.026s	sys 0.038s
I20260709 12:12:47.771309  5316 tablet_bootstrap.cc:654] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.771021  5350 consensus_queue.cc:1048] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:47.774870  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:12:47.775516  5274 raft_consensus.cc:3060] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.776554  5313 tablet_bootstrap.cc:654] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.773533  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:12:47.774698  5376 leader_election.cc:290] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:47.771711  5314 raft_consensus.cc:359] T 84919c977be24017b74e122582f71fbe P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.778740  5123 raft_consensus.cc:3060] T e3beaf3ce31042719868401157039ee9 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.778959  5314 raft_consensus.cc:385] T 84919c977be24017b74e122582f71fbe P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.779368  5314 raft_consensus.cc:740] T 84919c977be24017b74e122582f71fbe P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.780345  5314 consensus_queue.cc:260] T 84919c977be24017b74e122582f71fbe P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.786079  5123 raft_consensus.cc:2468] T e3beaf3ce31042719868401157039ee9 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 1.
I20260709 12:12:47.790692  5274 raft_consensus.cc:2468] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 1.
I20260709 12:12:47.792462  5163 leader_election.cc:304] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:12:47.794086  5375 raft_consensus.cc:2804] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:47.794613  5375 raft_consensus.cc:697] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:12:47.795751  5316 tablet_bootstrap.cc:492] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
I20260709 12:12:47.795486  5375 consensus_queue.cc:237] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.796319  5316 ts_tablet_manager.cc:1403] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.120s	user 0.010s	sys 0.002s
I20260709 12:12:47.800369  5314 ts_tablet_manager.cc:1434] T 84919c977be24017b74e122582f71fbe P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.031s	user 0.002s	sys 0.005s
I20260709 12:12:47.800663  5316 raft_consensus.cc:359] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.801224  5319 consensus_queue.cc:1048] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:47.803390  5314 tablet_bootstrap.cc:492] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
I20260709 12:12:47.803570  5316 raft_consensus.cc:385] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.807626  5316 raft_consensus.cc:740] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.810251  5316 consensus_queue.cc:260] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.815999  5313 tablet_bootstrap.cc:492] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:47.817600  5313 ts_tablet_manager.cc:1403] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.113s	user 0.007s	sys 0.009s
I20260709 12:12:47.825289  5316 ts_tablet_manager.cc:1434] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.001s
I20260709 12:12:47.827351  5316 tablet_bootstrap.cc:492] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
I20260709 12:12:47.832228  5313 raft_consensus.cc:359] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.832926  5313 raft_consensus.cc:385] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.833213  5313 raft_consensus.cc:740] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.833953  5313 consensus_queue.cc:260] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.835646  5314 tablet_bootstrap.cc:654] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.836580  5313 ts_tablet_manager.cc:1434] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.003s
I20260709 12:12:47.837558  5313 tablet_bootstrap.cc:492] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
I20260709 12:12:47.843634  5316 tablet_bootstrap.cc:654] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.853627  5319 consensus_queue.cc:1048] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:47.858840  5313 tablet_bootstrap.cc:654] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.859959  5022 catalog_manager.cc:5697] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 0 to 1, leader changed from <none> to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 1 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:47.862793  5314 tablet_bootstrap.cc:492] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:47.864459  5316 tablet_bootstrap.cc:492] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
I20260709 12:12:47.864933  5316 ts_tablet_manager.cc:1403] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.038s	user 0.010s	sys 0.001s
I20260709 12:12:47.865625  5314 ts_tablet_manager.cc:1403] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.062s	user 0.009s	sys 0.014s
I20260709 12:12:47.867636  5314 raft_consensus.cc:359] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.867491  5316 raft_consensus.cc:359] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.868181  5314 raft_consensus.cc:385] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.868247  5316 raft_consensus.cc:385] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.868500  5314 raft_consensus.cc:740] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.868592  5316 raft_consensus.cc:740] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.869323  5316 consensus_queue.cc:260] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.869475  5314 consensus_queue.cc:260] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.871781  5316 ts_tablet_manager.cc:1434] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:12:47.871906  5314 ts_tablet_manager.cc:1434] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:12:47.872892  5314 tablet_bootstrap.cc:492] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
I20260709 12:12:47.873036  5316 tablet_bootstrap.cc:492] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
I20260709 12:12:47.879295  5316 tablet_bootstrap.cc:654] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.880281  5314 tablet_bootstrap.cc:654] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.884123  5319 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.885244  5313 tablet_bootstrap.cc:492] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:47.884793  5319 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.885773  5313 ts_tablet_manager.cc:1403] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.048s	user 0.014s	sys 0.010s
I20260709 12:12:47.888455  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:47.888717  5319 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:47.888788  5313 raft_consensus.cc:359] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.889185  5274 raft_consensus.cc:2468] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 0.
I20260709 12:12:47.889665  5313 raft_consensus.cc:385] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.889974  5313 raft_consensus.cc:740] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.890009  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:47.890746  5313 consensus_queue.cc:260] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.891142  5163 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:12:47.892220  5319 raft_consensus.cc:2804] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:47.892663  5319 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.890646  5123 raft_consensus.cc:2468] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 0.
I20260709 12:12:47.893163  5319 raft_consensus.cc:3060] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.892795  5313 ts_tablet_manager.cc:1434] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:12:47.895323  5313 tablet_bootstrap.cc:492] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
I20260709 12:12:47.895466  5314 tablet_bootstrap.cc:492] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:47.895978  5314 ts_tablet_manager.cc:1403] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.000s
I20260709 12:12:47.897925  5359 raft_consensus.cc:493] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.898468  5359 raft_consensus.cc:515] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.899080  5316 tablet_bootstrap.cc:492] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
I20260709 12:12:47.899518  5316 ts_tablet_manager.cc:1403] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.005s
I20260709 12:12:47.900717  5359 leader_election.cc:290] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:47.902124  5316 raft_consensus.cc:359] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.902554  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:47.902834  5316 raft_consensus.cc:385] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.903147  5316 raft_consensus.cc:740] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
W20260709 12:12:47.904042  5088 leader_election.cc:343] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:47.903995  5316 consensus_queue.cc:260] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.905505  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:47.906924  5316 ts_tablet_manager.cc:1434] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
W20260709 12:12:47.907022  5088 leader_election.cc:343] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:47.907528  5088 leader_election.cc:304] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:12:47.908586  5359 raft_consensus.cc:2749] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:47.908612  5313 tablet_bootstrap.cc:654] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.909798  5316 tablet_bootstrap.cc:492] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
I20260709 12:12:47.909672  5314 raft_consensus.cc:359] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.910362  5314 raft_consensus.cc:385] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.910636  5314 raft_consensus.cc:740] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.911288  5314 consensus_queue.cc:260] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.913801  5314 ts_tablet_manager.cc:1434] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:12:47.919775  5316 tablet_bootstrap.cc:654] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.922091  5314 tablet_bootstrap.cc:492] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
I20260709 12:12:47.925765  5313 tablet_bootstrap.cc:492] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:47.925441  5319 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.926236  5313 ts_tablet_manager.cc:1403] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.008s
I20260709 12:12:47.928316  5314 tablet_bootstrap.cc:654] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.928701  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:12:47.928989  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:12:47.929298  5123 raft_consensus.cc:3060] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.929719  5274 raft_consensus.cc:3060] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.930559  5350 raft_consensus.cc:493] T 62577fc91bb44d3a882109dc63f74008 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.931028  5350 raft_consensus.cc:515] T 62577fc91bb44d3a882109dc63f74008 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.933035  5350 leader_election.cc:290] T 62577fc91bb44d3a882109dc63f74008 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:47.933614  5375 consensus_queue.cc:1048] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:47.934506  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:47.935271  5199 raft_consensus.cc:2393] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 1: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:12:47.935730  5123 raft_consensus.cc:2468] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 1.
I20260709 12:12:47.936471  5274 raft_consensus.cc:2468] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 1.
I20260709 12:12:47.937634  5163 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:12:47.939085  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:47.939613  5375 raft_consensus.cc:2804] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:47.940065  5375 raft_consensus.cc:697] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:12:47.940524  5240 leader_election.cc:304] T 62577fc91bb44d3a882109dc63f74008 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:12:47.940860  5375 consensus_queue.cc:237] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.941562  5385 raft_consensus.cc:3060] T 62577fc91bb44d3a882109dc63f74008 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.941649  5359 consensus_queue.cc:1048] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:47.944677  5313 raft_consensus.cc:359] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.945335  5313 raft_consensus.cc:385] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.945704  5319 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:47.945785  5313 raft_consensus.cc:740] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.946700  5313 consensus_queue.cc:260] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.950338  5316 tablet_bootstrap.cc:492] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
I20260709 12:12:47.950835  5316 ts_tablet_manager.cc:1403] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.043s	user 0.004s	sys 0.009s
I20260709 12:12:47.950981  5313 ts_tablet_manager.cc:1434] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 12:12:47.952219  5313 tablet_bootstrap.cc:492] T e63d70b5bbd74a49be2a18fef7617e3e P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
I20260709 12:12:47.953763  5316 raft_consensus.cc:359] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.954427  5316 raft_consensus.cc:385] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.954676  5316 raft_consensus.cc:740] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.957489  5385 raft_consensus.cc:2749] T 62577fc91bb44d3a882109dc63f74008 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:47.959983  5313 tablet_bootstrap.cc:654] T e63d70b5bbd74a49be2a18fef7617e3e P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.961081  5376 consensus_queue.cc:1048] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:47.962255  5316 consensus_queue.cc:260] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.964172  5316 ts_tablet_manager.cc:1434] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.003s
I20260709 12:12:47.965030  5316 tablet_bootstrap.cc:492] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
I20260709 12:12:47.970640  5316 tablet_bootstrap.cc:654] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.973999  5320 consensus_queue.cc:1048] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:47.988540  5313 tablet_bootstrap.cc:492] T e63d70b5bbd74a49be2a18fef7617e3e P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:47.989056  5313 ts_tablet_manager.cc:1403] T e63d70b5bbd74a49be2a18fef7617e3e P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.013s
I20260709 12:12:47.990473  5023 catalog_manager.cc:5697] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 0 to 1, leader changed from <none> to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 1 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:47.991747  5313 raft_consensus.cc:359] T e63d70b5bbd74a49be2a18fef7617e3e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.992497  5313 raft_consensus.cc:385] T e63d70b5bbd74a49be2a18fef7617e3e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.992743  5313 raft_consensus.cc:740] T e63d70b5bbd74a49be2a18fef7617e3e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.993503  5313 consensus_queue.cc:260] T e63d70b5bbd74a49be2a18fef7617e3e P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:47.996505  5313 ts_tablet_manager.cc:1434] T e63d70b5bbd74a49be2a18fef7617e3e P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:12:47.997529  5313 tablet_bootstrap.cc:492] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
I20260709 12:12:48.013132  5313 tablet_bootstrap.cc:654] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.017341  5385 raft_consensus.cc:493] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.017607  5316 tablet_bootstrap.cc:492] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
I20260709 12:12:48.018214  5316 ts_tablet_manager.cc:1403] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.053s	user 0.011s	sys 0.005s
I20260709 12:12:48.018009  5385 raft_consensus.cc:515] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.020840  5316 raft_consensus.cc:359] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.021593  5316 raft_consensus.cc:385] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.021873  5316 raft_consensus.cc:740] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.022797  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:48.023270  5316 consensus_queue.cc:260] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:12:48.025708  5240 leader_election.cc:343] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:48.026587  5385 leader_election.cc:290] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:48.028891  5313 tablet_bootstrap.cc:492] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:48.029320  5313 ts_tablet_manager.cc:1403] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.032s	user 0.017s	sys 0.002s
I20260709 12:12:48.029609  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:48.030313  5199 raft_consensus.cc:2468] T 84919c977be24017b74e122582f71fbe P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 0.
I20260709 12:12:48.031594  5237 leader_election.cc:304] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:12:48.025777  5316 ts_tablet_manager.cc:1434] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:12:48.031925  5313 raft_consensus.cc:359] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.032657  5313 raft_consensus.cc:385] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.032779  5385 raft_consensus.cc:2804] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:48.032954  5313 raft_consensus.cc:740] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.033236  5385 raft_consensus.cc:493] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.033663  5385 raft_consensus.cc:3060] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.033995  5314 tablet_bootstrap.cc:492] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:48.033804  5313 consensus_queue.cc:260] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.033406  5316 tablet_bootstrap.cc:492] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
I20260709 12:12:48.034535  5314 ts_tablet_manager.cc:1403] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.113s	user 0.010s	sys 0.015s
I20260709 12:12:48.036645  5313 ts_tablet_manager.cc:1434] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:12:48.038674  5313 tablet_bootstrap.cc:492] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
I20260709 12:12:48.038614  5314 raft_consensus.cc:359] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.039572  5314 raft_consensus.cc:385] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.039898  5314 raft_consensus.cc:740] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.040549  5350 consensus_queue.cc:1048] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:48.040649  5314 consensus_queue.cc:260] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.043205  5314 ts_tablet_manager.cc:1434] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:12:48.044261  5314 tablet_bootstrap.cc:492] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
I20260709 12:12:48.045293  5313 tablet_bootstrap.cc:654] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.046183  5385 raft_consensus.cc:515] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.040959  5316 tablet_bootstrap.cc:654] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.048493  5385 leader_election.cc:290] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:48.049482  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:12:48.050642  5314 tablet_bootstrap.cc:654] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:48.051067  5240 leader_election.cc:343] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:48.052665  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:12:48.053306  5198 raft_consensus.cc:3060] T 84919c977be24017b74e122582f71fbe P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.055402  5320 raft_consensus.cc:493] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.055938  5320 raft_consensus.cc:515] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.058228  5320 leader_election.cc:290] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:48.060578  5198 raft_consensus.cc:2468] T 84919c977be24017b74e122582f71fbe P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 1.
I20260709 12:12:48.061013  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:48.061069  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:48.061857  5237 leader_election.cc:304] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:12:48.062543  5088 leader_election.cc:343] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:48.063134  5385 raft_consensus.cc:2804] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:12:48.063292  5088 leader_election.cc:343] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:48.063716  5088 leader_election.cc:304] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:12:48.063860  5385 raft_consensus.cc:697] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:12:48.064776  5320 raft_consensus.cc:2749] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:48.064687  5385 consensus_queue.cc:237] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.069343  5313 tablet_bootstrap.cc:492] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:48.069895  5313 ts_tablet_manager.cc:1403] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.006s
I20260709 12:12:48.071591  5316 tablet_bootstrap.cc:492] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
I20260709 12:12:48.072046  5316 ts_tablet_manager.cc:1403] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.002s
I20260709 12:12:48.072453  5313 raft_consensus.cc:359] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.073109  5313 raft_consensus.cc:385] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.073505  5313 raft_consensus.cc:740] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.074968  5316 raft_consensus.cc:359] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.075621  5316 raft_consensus.cc:385] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.075891  5316 raft_consensus.cc:740] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.078675  5316 consensus_queue.cc:260] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.082317  5316 ts_tablet_manager.cc:1434] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:12:48.074118  5313 consensus_queue.cc:260] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.085443  5316 tablet_bootstrap.cc:492] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
I20260709 12:12:48.093191  5313 ts_tablet_manager.cc:1434] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.000s
I20260709 12:12:48.093886  5314 tablet_bootstrap.cc:492] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:48.094404  5314 ts_tablet_manager.cc:1403] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.050s	user 0.009s	sys 0.003s
I20260709 12:12:48.096007  5350 raft_consensus.cc:493] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.096486  5350 raft_consensus.cc:515] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.097071  5314 raft_consensus.cc:359] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.097936  5314 raft_consensus.cc:385] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.098294  5314 raft_consensus.cc:740] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.098629  5350 leader_election.cc:290] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:48.099174  5314 consensus_queue.cc:260] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.101449  5314 ts_tablet_manager.cc:1434] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:12:48.102406  5314 tablet_bootstrap.cc:492] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
I20260709 12:12:48.103495  5313 tablet_bootstrap.cc:492] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
I20260709 12:12:48.108479  5314 tablet_bootstrap.cc:654] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.116983  5023 catalog_manager.cc:5697] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 1 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:48.120863  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:48.121711  5199 raft_consensus.cc:2468] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 0.
I20260709 12:12:48.123201  5237 leader_election.cc:304] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:12:48.123956  5316 tablet_bootstrap.cc:654] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.124183  5332 raft_consensus.cc:2804] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:48.124557  5332 raft_consensus.cc:493] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.124902  5332 raft_consensus.cc:3060] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.127665  5313 tablet_bootstrap.cc:654] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.131345  5332 raft_consensus.cc:515] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.134505  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:12:48.135169  5198 raft_consensus.cc:3060] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.139163  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:48.139947  5123 raft_consensus.cc:2468] T e63d70b5bbd74a49be2a18fef7617e3e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 0.
I20260709 12:12:48.142766  5452 consensus_queue.cc:1048] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:48.150527  5452 raft_consensus.cc:493] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.152537  5274 raft_consensus.cc:3060] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.152701  5198 raft_consensus.cc:2468] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 1.
I20260709 12:12:48.154214  5237 leader_election.cc:304] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:12:48.155213  5350 raft_consensus.cc:2804] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:48.155730  5350 raft_consensus.cc:697] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:12:48.156618  5350 consensus_queue.cc:237] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.161370  5332 leader_election.cc:290] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:48.162133  5319 consensus_queue.cc:1048] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:48.174396  5339 consensus_queue.cc:1048] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:48.183660  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:12:48.184398  5125 raft_consensus.cc:3060] T e63d70b5bbd74a49be2a18fef7617e3e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.192098  5125 raft_consensus.cc:2468] T e63d70b5bbd74a49be2a18fef7617e3e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 1.
I20260709 12:12:48.193351  5452 raft_consensus.cc:515] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.205812  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:48.206562  5198 raft_consensus.cc:2468] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 0.
I20260709 12:12:48.207888  5237 leader_election.cc:304] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:12:48.208819  5385 raft_consensus.cc:2804] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:48.209196  5385 raft_consensus.cc:493] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.209544  5385 raft_consensus.cc:3060] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.217551  5319 consensus_queue.cc:1048] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:48.223963  5452 leader_election.cc:290] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:48.231372  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:48.232246  5122 raft_consensus.cc:2468] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 0.
I20260709 12:12:48.238395  5385 raft_consensus.cc:515] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.246151  5385 leader_election.cc:290] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:48.247793  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:12:48.249437  5198 raft_consensus.cc:3060] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.256601  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:12:48.257536  5125 raft_consensus.cc:3060] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.262399  5198 raft_consensus.cc:2468] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 1.
I20260709 12:12:48.264101  5237 leader_election.cc:304] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:12:48.265364  5385 raft_consensus.cc:2804] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:48.265981  5385 raft_consensus.cc:697] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:12:48.267319  5385 consensus_queue.cc:237] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.268086  5314 tablet_bootstrap.cc:492] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:48.268616  5314 ts_tablet_manager.cc:1403] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.166s	user 0.022s	sys 0.045s
I20260709 12:12:48.277225  5453 raft_consensus.cc:493] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.277940  5453 raft_consensus.cc:515] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.280774  5453 leader_election.cc:290] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:48.283272  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:48.283053  5314 raft_consensus.cc:359] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.283345  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:48.283972  5314 raft_consensus.cc:385] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.284154  5198 raft_consensus.cc:2468] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 0.
I20260709 12:12:48.284315  5314 raft_consensus.cc:740] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.284224  5122 raft_consensus.cc:2468] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 0.
I20260709 12:12:48.285575  5237 leader_election.cc:304] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:12:48.288687  5350 raft_consensus.cc:2804] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:48.289784  5316 tablet_bootstrap.cc:492] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
I20260709 12:12:48.291478  5316 ts_tablet_manager.cc:1403] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.208s	user 0.011s	sys 0.016s
I20260709 12:12:48.291771  5350 raft_consensus.cc:493] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.292325  5350 raft_consensus.cc:3060] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.290334  5023 catalog_manager.cc:5697] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 1 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:48.285161  5314 consensus_queue.cc:260] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.293838  5125 raft_consensus.cc:2468] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 1.
I20260709 12:12:48.304668  5350 raft_consensus.cc:515] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.308147  5314 ts_tablet_manager.cc:1434] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.002s
I20260709 12:12:48.308483  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:12:48.308563  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:12:48.309237  5314 tablet_bootstrap.cc:492] T 45e701f062f14e4e80492fc08144cca6 P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
I20260709 12:12:48.309350  5350 leader_election.cc:290] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:48.309811  5319 consensus_queue.cc:1048] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:48.311666  5124 raft_consensus.cc:3060] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.309456  5198 raft_consensus.cc:3060] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.319775  5314 tablet_bootstrap.cc:654] T 45e701f062f14e4e80492fc08144cca6 P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.326733  5198 raft_consensus.cc:2468] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 1.
I20260709 12:12:48.294821  5316 raft_consensus.cc:359] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.328096  5316 raft_consensus.cc:385] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.328357  5316 raft_consensus.cc:740] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.329142  5316 consensus_queue.cc:260] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.329682  5237 leader_election.cc:304] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:12:48.331116  5316 ts_tablet_manager.cc:1434] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.000s
I20260709 12:12:48.331650  5313 tablet_bootstrap.cc:492] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:48.332100  5313 ts_tablet_manager.cc:1403] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.229s	user 0.007s	sys 0.010s
I20260709 12:12:48.333184  5124 raft_consensus.cc:2468] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 1.
I20260709 12:12:48.334648  5313 raft_consensus.cc:359] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.335202  5316 tablet_bootstrap.cc:492] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
I20260709 12:12:48.335332  5313 raft_consensus.cc:385] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.338933  5313 raft_consensus.cc:740] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.339615  5313 consensus_queue.cc:260] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.339746  5023 catalog_manager.cc:5697] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 1 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:48.341889  5316 tablet_bootstrap.cc:654] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.344172  5313 ts_tablet_manager.cc:1434] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.002s
I20260709 12:12:48.344678  5319 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.344764  5350 raft_consensus.cc:2804] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:48.345597  5350 raft_consensus.cc:697] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:12:48.345088  5313 tablet_bootstrap.cc:492] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
I20260709 12:12:48.346555  5350 consensus_queue.cc:237] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.345212  5319 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.353690  5313 tablet_bootstrap.cc:654] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.355739  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:48.356315  5124 raft_consensus.cc:2468] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 0.
I20260709 12:12:48.357869  5360 raft_consensus.cc:493] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.358134  5314 tablet_bootstrap.cc:492] T 45e701f062f14e4e80492fc08144cca6 P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:48.358642  5314 ts_tablet_manager.cc:1403] T 45e701f062f14e4e80492fc08144cca6 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.050s	user 0.016s	sys 0.000s
I20260709 12:12:48.358616  5166 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:12:48.359632  5377 raft_consensus.cc:2804] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:48.359978  5377 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.360302  5377 raft_consensus.cc:3060] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.361559  5314 raft_consensus.cc:359] T 45e701f062f14e4e80492fc08144cca6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.361968  5319 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:48.362308  5314 raft_consensus.cc:385] T 45e701f062f14e4e80492fc08144cca6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.362646  5314 raft_consensus.cc:740] T 45e701f062f14e4e80492fc08144cca6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.364181  5314 consensus_queue.cc:260] T 45e701f062f14e4e80492fc08144cca6 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.366236  5314 ts_tablet_manager.cc:1434] T 45e701f062f14e4e80492fc08144cca6 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:12:48.367084  5314 tablet_bootstrap.cc:492] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
I20260709 12:12:48.373369  5021 catalog_manager.cc:5697] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 1 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:48.374140  5313 tablet_bootstrap.cc:492] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:48.374776  5313 ts_tablet_manager.cc:1403] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.030s	user 0.005s	sys 0.006s
I20260709 12:12:48.374078  5360 raft_consensus.cc:515] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.377410  5313 raft_consensus.cc:359] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.377732  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:48.378069  5360 leader_election.cc:290] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:48.378574  5198 raft_consensus.cc:2393] T 84919c977be24017b74e122582f71fbe P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 1: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:12:48.379057  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:48.379889  5314 tablet_bootstrap.cc:654] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.380978  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:48.378090  5313 raft_consensus.cc:385] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.381933  5313 raft_consensus.cc:740] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
W20260709 12:12:48.382879  5163 leader_election.cc:343] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:48.382623  5313 consensus_queue.cc:260] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.383014  5088 leader_election.cc:304] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:12:48.384920  5360 raft_consensus.cc:3060] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.385118  5313 ts_tablet_manager.cc:1434] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.002s
I20260709 12:12:48.386165  5313 tablet_bootstrap.cc:492] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
I20260709 12:12:48.386662  5319 consensus_queue.cc:1048] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:48.391551  5313 tablet_bootstrap.cc:654] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.391999  5360 raft_consensus.cc:2749] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:48.388041  5377 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.401335  5360 raft_consensus.cc:493] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.401978  5360 raft_consensus.cc:515] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.403833  5314 tablet_bootstrap.cc:492] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:48.404306  5314 ts_tablet_manager.cc:1403] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.000s
I20260709 12:12:48.405074  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:48.406294  5198 raft_consensus.cc:2468] T 45e701f062f14e4e80492fc08144cca6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 0.
I20260709 12:12:48.406849  5314 raft_consensus.cc:359] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.407511  5314 raft_consensus.cc:385] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.407709  5088 leader_election.cc:304] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:12:48.408098  5314 raft_consensus.cc:740] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.408708  5359 raft_consensus.cc:2804] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:48.408660  5314 consensus_queue.cc:260] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.409132  5359 raft_consensus.cc:493] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.409742  5359 raft_consensus.cc:3060] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.410935  5350 raft_consensus.cc:493] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.411032  5314 ts_tablet_manager.cc:1434] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:12:48.411445  5350 raft_consensus.cc:515] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.412068  5314 tablet_bootstrap.cc:492] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
I20260709 12:12:48.414963  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:48.415889  5350 leader_election.cc:290] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:48.418736  5314 tablet_bootstrap.cc:654] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.420313  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:48.420976  5198 raft_consensus.cc:2468] T 45e701f062f14e4e80492fc08144cca6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 0.
I20260709 12:12:48.422371  5237 leader_election.cc:304] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:12:48.423211  5350 raft_consensus.cc:2804] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:48.423557  5350 raft_consensus.cc:493] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.423909  5350 raft_consensus.cc:3060] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.437162  5314 tablet_bootstrap.cc:492] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:48.437706  5314 ts_tablet_manager.cc:1403] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.011s
I20260709 12:12:48.431607  5359 raft_consensus.cc:515] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.440387  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:48.440693  5124 raft_consensus.cc:2393] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 1: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:12:48.441033  5360 leader_election.cc:290] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:48.449124  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:12:48.442526  5314 raft_consensus.cc:359] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.450320  5314 raft_consensus.cc:385] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.450605  5314 raft_consensus.cc:740] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.445408  5350 raft_consensus.cc:515] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.452102  5274 raft_consensus.cc:2393] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 1: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:12:48.461432  5339 consensus_queue.cc:1048] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:48.446038  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:12:48.451866  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:12:48.464116  5124 raft_consensus.cc:3060] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.464481  5198 raft_consensus.cc:3060] T 45e701f062f14e4e80492fc08144cca6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.466549  5339 raft_consensus.cc:493] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.471235  5453 consensus_queue.cc:1048] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:48.447081  5377 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:12:48.476470  5163 leader_election.cc:343] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:48.515043  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 60741.9us
I20260709 12:12:48.517215  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:12:48.520186  5273 raft_consensus.cc:2393] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 1: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:12:48.515231  5359 leader_election.cc:290] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:48.546134  5314 consensus_queue.cc:260] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.546694  5313 tablet_bootstrap.cc:492] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:48.547297  5313 ts_tablet_manager.cc:1403] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.161s	user 0.017s	sys 0.029s
I20260709 12:12:48.548282  5350 leader_election.cc:290] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:48.549741  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:12:48.550035  5314 ts_tablet_manager.cc:1434] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.112s	user 0.009s	sys 0.011s
I20260709 12:12:48.549999  5313 raft_consensus.cc:359] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.550756  5313 raft_consensus.cc:385] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.551024  5313 raft_consensus.cc:740] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.551367  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:12:48.551735  5313 consensus_queue.cc:260] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.553694  5125 raft_consensus.cc:2393] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 1: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:12:48.553805  5313 ts_tablet_manager.cc:1434] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.004s
I20260709 12:12:48.554857  5313 tablet_bootstrap.cc:492] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
I20260709 12:12:48.555176  5240 leader_election.cc:304] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:12:48.555527  5198 raft_consensus.cc:2468] T 45e701f062f14e4e80492fc08144cca6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 1.
I20260709 12:12:48.551086  5314 tablet_bootstrap.cc:492] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
I20260709 12:12:48.557600  5088 leader_election.cc:304] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:12:48.558406  5350 raft_consensus.cc:2749] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:12:48.559216  5359 raft_consensus.cc:2804] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:48.559892  5359 raft_consensus.cc:697] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:12:48.560732  5359 consensus_queue.cc:237] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.564020  5314 tablet_bootstrap.cc:654] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:48.567085  5071 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:48.570336  5313 tablet_bootstrap.cc:654] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.577188  5385 consensus_queue.cc:1048] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:48.547075  5339 raft_consensus.cc:515] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.583761  5316 tablet_bootstrap.cc:492] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
I20260709 12:12:48.584244  5316 ts_tablet_manager.cc:1403] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.249s	user 0.041s	sys 0.030s
I20260709 12:12:48.585877  5339 leader_election.cc:290] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:48.586789  5316 raft_consensus.cc:359] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.587128  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:48.588040  5316 raft_consensus.cc:385] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.588183  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:48.588405  5316 raft_consensus.cc:740] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.588814  5121 raft_consensus.cc:2468] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 0.
I20260709 12:12:48.589190  5316 consensus_queue.cc:260] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.590071  5166 leader_election.cc:304] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:12:48.591347  5316 ts_tablet_manager.cc:1434] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:12:48.592410  5316 tablet_bootstrap.cc:492] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
I20260709 12:12:48.594280  5274 raft_consensus.cc:2468] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 0.
I20260709 12:12:48.598819  5023 catalog_manager.cc:5697] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 1 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:48.601764  5319 raft_consensus.cc:2804] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:48.602195  5319 raft_consensus.cc:493] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.602541  5319 raft_consensus.cc:3060] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.605598  5316 tablet_bootstrap.cc:654] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.620591  5124 raft_consensus.cc:2468] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 1.
I20260709 12:12:48.622197  5166 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:12:48.623572  5339 raft_consensus.cc:2804] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:48.624347  5339 raft_consensus.cc:697] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:12:48.625248  5339 consensus_queue.cc:237] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.634601  5313 tablet_bootstrap.cc:492] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:48.635118  5313 ts_tablet_manager.cc:1403] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.080s	user 0.022s	sys 0.018s
I20260709 12:12:48.639223  5313 raft_consensus.cc:359] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.639993  5313 raft_consensus.cc:385] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.640254  5313 raft_consensus.cc:740] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.647331  5319 raft_consensus.cc:515] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.649896  5319 leader_election.cc:290] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:48.650789  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:12:48.651441  5124 raft_consensus.cc:3060] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.651594  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:12:48.652264  5274 raft_consensus.cc:3060] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.652756  5021 catalog_manager.cc:5697] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 0 to 1, leader changed from <none> to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 1 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:48.655869  5316 tablet_bootstrap.cc:492] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
I20260709 12:12:48.656388  5316 ts_tablet_manager.cc:1403] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.064s	user 0.026s	sys 0.022s
I20260709 12:12:48.642710  5313 consensus_queue.cc:260] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.656801  5350 consensus_queue.cc:1048] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:48.659374  5274 raft_consensus.cc:2468] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 1.
I20260709 12:12:48.659149  5316 raft_consensus.cc:359] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.659878  5316 raft_consensus.cc:385] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.660177  5316 raft_consensus.cc:740] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.660669  5163 leader_election.cc:304] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:12:48.660851  5316 consensus_queue.cc:260] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.661626  5319 raft_consensus.cc:2804] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:48.662089  5319 raft_consensus.cc:697] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:12:48.663012  5316 ts_tablet_manager.cc:1434] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:12:48.662876  5319 consensus_queue.cc:237] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.667392  5316 tablet_bootstrap.cc:492] T a6b2fb64d40642259e41424cef193db0 P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
I20260709 12:12:48.667469  5313 ts_tablet_manager.cc:1434] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 12:12:48.670164  5124 raft_consensus.cc:2468] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 1.
I20260709 12:12:48.677347  5314 tablet_bootstrap.cc:492] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:48.677619  5313 tablet_bootstrap.cc:492] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
I20260709 12:12:48.677860  5314 ts_tablet_manager.cc:1403] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.127s	user 0.017s	sys 0.014s
I20260709 12:12:48.679340  5316 tablet_bootstrap.cc:654] T a6b2fb64d40642259e41424cef193db0 P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.680405  5314 raft_consensus.cc:359] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.681152  5314 raft_consensus.cc:385] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.686079  5314 raft_consensus.cc:740] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.691638  5350 consensus_queue.cc:1048] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:48.696847  5316 tablet_bootstrap.cc:492] T a6b2fb64d40642259e41424cef193db0 P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
I20260709 12:12:48.686877  5314 consensus_queue.cc:260] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.698947  5316 ts_tablet_manager.cc:1403] T a6b2fb64d40642259e41424cef193db0 P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.032s	user 0.007s	sys 0.011s
I20260709 12:12:48.701828  5316 raft_consensus.cc:359] T a6b2fb64d40642259e41424cef193db0 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.702723  5316 raft_consensus.cc:385] T a6b2fb64d40642259e41424cef193db0 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.703089  5316 raft_consensus.cc:740] T a6b2fb64d40642259e41424cef193db0 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.703963  5316 consensus_queue.cc:260] T a6b2fb64d40642259e41424cef193db0 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.704269  5020 catalog_manager.cc:5697] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 0 to 1, leader changed from <none> to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 1 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:48.706429  5313 tablet_bootstrap.cc:654] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.713371  5316 ts_tablet_manager.cc:1434] T a6b2fb64d40642259e41424cef193db0 P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:12:48.714527  5316 tablet_bootstrap.cc:492] T 62cb582e4337464894d9eb032a3b2cd2 P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
I20260709 12:12:48.717727  5314 ts_tablet_manager.cc:1434] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.002s
I20260709 12:12:48.718904  5314 tablet_bootstrap.cc:492] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
I20260709 12:12:48.721962  5453 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.722563  5453 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.724817  5453 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:48.725452  5316 tablet_bootstrap.cc:654] T 62cb582e4337464894d9eb032a3b2cd2 P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.727041  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:48.728336  5198 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 0.
I20260709 12:12:48.733623  5237 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:12:48.733644  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:48.735308  5124 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 0.
I20260709 12:12:48.739904  5332 raft_consensus.cc:2804] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:48.740443  5332 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.740818  5332 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.746248  5360 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.747466  5360 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.751150  5453 consensus_queue.cc:1048] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:48.752274  5332 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.756273  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:12:48.756906  5124 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.757750  5314 tablet_bootstrap.cc:654] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.756815  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:48.761042  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:48.761426  5316 tablet_bootstrap.cc:492] T 62cb582e4337464894d9eb032a3b2cd2 P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
W20260709 12:12:48.762274  5088 leader_election.cc:343] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:48.761910  5316 ts_tablet_manager.cc:1403] T 62cb582e4337464894d9eb032a3b2cd2 P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.048s	user 0.007s	sys 0.008s
I20260709 12:12:48.759523  5360 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:12:48.763615  5088 leader_election.cc:343] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:48.764057  5088 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:12:48.768903  5360 raft_consensus.cc:2749] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:48.776405  5313 tablet_bootstrap.cc:492] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:48.777302  5313 ts_tablet_manager.cc:1403] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.100s	user 0.020s	sys 0.024s
I20260709 12:12:48.779280  5316 raft_consensus.cc:359] T 62cb582e4337464894d9eb032a3b2cd2 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.779882  5316 raft_consensus.cc:385] T 62cb582e4337464894d9eb032a3b2cd2 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.780103  5316 raft_consensus.cc:740] T 62cb582e4337464894d9eb032a3b2cd2 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.772533  5124 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 1.
I20260709 12:12:48.780918  5316 consensus_queue.cc:260] T 62cb582e4337464894d9eb032a3b2cd2 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.783350  5316 ts_tablet_manager.cc:1434] T 62cb582e4337464894d9eb032a3b2cd2 P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:12:48.783725  5332 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:48.784379  5316 tablet_bootstrap.cc:492] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
I20260709 12:12:48.786448  5240 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:12:48.788012  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:12:48.788259  5453 raft_consensus.cc:2804] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:48.788635  5199 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.788866  5453 raft_consensus.cc:697] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:12:48.790264  5453 consensus_queue.cc:237] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.795706  5313 raft_consensus.cc:359] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.796916  5332 consensus_queue.cc:1048] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:48.797952  5316 tablet_bootstrap.cc:654] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.803377  5454 consensus_queue.cc:1048] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:48.807116  5199 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 1.
I20260709 12:12:48.807029  5313 raft_consensus.cc:385] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.808404  5313 raft_consensus.cc:740] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.809644  5314 tablet_bootstrap.cc:492] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:48.810117  5314 ts_tablet_manager.cc:1403] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.091s	user 0.018s	sys 0.003s
I20260709 12:12:48.810786  5313 consensus_queue.cc:260] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.813163  5314 raft_consensus.cc:359] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.813916  5314 raft_consensus.cc:385] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.814635  5314 raft_consensus.cc:740] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.818480  5313 ts_tablet_manager.cc:1434] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.001s
I20260709 12:12:48.819559  5313 tablet_bootstrap.cc:492] T f34c97113147431584d6336e0d849164 P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
I20260709 12:12:48.825825  5313 tablet_bootstrap.cc:654] T f34c97113147431584d6336e0d849164 P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.830662  5316 tablet_bootstrap.cc:492] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
I20260709 12:12:48.831156  5316 ts_tablet_manager.cc:1403] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.047s	user 0.012s	sys 0.001s
I20260709 12:12:48.825038  5020 catalog_manager.cc:5697] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 1 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:48.833845  5316 raft_consensus.cc:359] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.834496  5316 raft_consensus.cc:385] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.834787  5316 raft_consensus.cc:740] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.815454  5314 consensus_queue.cc:260] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.835220  5377 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.835381  5316 consensus_queue.cc:260] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.835731  5377 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.837885  5316 ts_tablet_manager.cc:1434] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 12:12:48.838830  5316 tablet_bootstrap.cc:492] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
I20260709 12:12:48.839840  5453 consensus_queue.cc:1048] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:48.840211  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:48.840891  5274 raft_consensus.cc:2468] T 62cb582e4337464894d9eb032a3b2cd2 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 0.
I20260709 12:12:48.844089  5163 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:12:48.844619  5316 tablet_bootstrap.cc:654] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.844977  5377 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:48.845016  5339 raft_consensus.cc:2804] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:48.845633  5339 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.845999  5339 raft_consensus.cc:3060] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.855890  5339 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.860651  5360 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.861188  5360 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.861747  5316 tablet_bootstrap.cc:492] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
I20260709 12:12:48.862241  5316 ts_tablet_manager.cc:1403] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.011s
I20260709 12:12:48.863332  5360 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:48.865163  5316 raft_consensus.cc:359] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.865904  5316 raft_consensus.cc:385] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.866242  5316 raft_consensus.cc:740] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.867053  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:48.866994  5316 consensus_queue.cc:260] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.866163  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:48.867811  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:48.868078  5123 raft_consensus.cc:2468] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 0.
W20260709 12:12:48.868506  5088 leader_election.cc:343] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:48.869206  5088 leader_election.cc:343] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:48.869607  5088 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:12:48.870486  5316 ts_tablet_manager.cc:1434] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:12:48.870639  5360 raft_consensus.cc:2749] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:48.871416  5316 tablet_bootstrap.cc:492] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
I20260709 12:12:48.876461  5314 ts_tablet_manager.cc:1434] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.066s	user 0.009s	sys 0.000s
I20260709 12:12:48.877559  5314 tablet_bootstrap.cc:492] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
I20260709 12:12:48.878095  5316 tablet_bootstrap.cc:654] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.883312  5316 tablet_bootstrap.cc:492] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
I20260709 12:12:48.883833  5316 ts_tablet_manager.cc:1403] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 12:12:48.885535  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:12:48.886185  5274 raft_consensus.cc:3060] T 62cb582e4337464894d9eb032a3b2cd2 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.886736  5316 raft_consensus.cc:359] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.887473  5316 raft_consensus.cc:385] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.887748  5316 raft_consensus.cc:740] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.888453  5316 consensus_queue.cc:260] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.889603  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:12:48.890221  5123 raft_consensus.cc:3060] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.890858  5316 ts_tablet_manager.cc:1434] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:12:48.891887  5316 tablet_bootstrap.cc:492] T 00645b1f1e014de995e4a937f842d909 P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
I20260709 12:12:48.893774  5453 raft_consensus.cc:493] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.894289  5453 raft_consensus.cc:515] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.899046  5316 tablet_bootstrap.cc:654] T 00645b1f1e014de995e4a937f842d909 P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.899917  5274 raft_consensus.cc:2468] T 62cb582e4337464894d9eb032a3b2cd2 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 1.
I20260709 12:12:48.901238  5163 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:12:48.902415  5453 leader_election.cc:290] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:48.902626  5375 raft_consensus.cc:2804] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:48.903087  5375 raft_consensus.cc:697] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:12:48.903734  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:48.903895  5375 consensus_queue.cc:237] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.904497  5199 raft_consensus.cc:2468] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 0.
I20260709 12:12:48.905023  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:48.905704  5124 raft_consensus.cc:2468] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 0.
I20260709 12:12:48.911715  5240 leader_election.cc:304] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:12:48.915143  5453 raft_consensus.cc:2804] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:48.915548  5453 raft_consensus.cc:493] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.915891  5453 raft_consensus.cc:3060] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.922552  5339 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:48.926280  5123 raft_consensus.cc:2468] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 1.
I20260709 12:12:48.932971  5314 tablet_bootstrap.cc:654] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.934000  5453 raft_consensus.cc:515] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.937148  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:12:48.937796  5123 raft_consensus.cc:3060] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.948297  5375 raft_consensus.cc:493] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.948832  5375 raft_consensus.cc:515] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.951517  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:12:48.952220  5199 raft_consensus.cc:3060] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.953199  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:12:48.954685  5166 leader_election.cc:343] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:48.956996  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:48.957931  5274 raft_consensus.cc:2468] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 0.
I20260709 12:12:48.960817  5199 raft_consensus.cc:2468] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 1.
I20260709 12:12:48.962010  5237 leader_election.cc:304] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:12:48.962414  5163 leader_election.cc:304] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:12:48.962929  5454 raft_consensus.cc:2804] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:48.963263  5377 raft_consensus.cc:2804] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:48.963414  5454 raft_consensus.cc:697] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:12:48.963651  5377 raft_consensus.cc:493] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.964015  5377 raft_consensus.cc:3060] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.964311  5454 consensus_queue.cc:237] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.967545  5385 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.968186  5385 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.969575  5375 leader_election.cc:290] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:48.970284  5385 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:48.972843  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:48.971791  5377 raft_consensus.cc:515] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.972779  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:48.974329  5124 raft_consensus.cc:2393] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 1: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:12:48.975426  5240 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:12:48.976703  5313 tablet_bootstrap.cc:492] T f34c97113147431584d6336e0d849164 P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:48.976766  5385 raft_consensus.cc:3060] T a6b2fb64d40642259e41424cef193db0 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.978091  5313 ts_tablet_manager.cc:1403] T f34c97113147431584d6336e0d849164 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.159s	user 0.055s	sys 0.052s
I20260709 12:12:48.979274  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
W20260709 12:12:48.980957  5166 leader_election.cc:343] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:48.981112  5313 raft_consensus.cc:359] T f34c97113147431584d6336e0d849164 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.982116  5313 raft_consensus.cc:385] T f34c97113147431584d6336e0d849164 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.982445  5313 raft_consensus.cc:740] T f34c97113147431584d6336e0d849164 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.982708  5021 catalog_manager.cc:5697] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 0 to 1, leader changed from <none> to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 1 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:48.983307  5313 consensus_queue.cc:260] T f34c97113147431584d6336e0d849164 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:48.985875  5313 ts_tablet_manager.cc:1434] T f34c97113147431584d6336e0d849164 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:12:48.987262  5313 tablet_bootstrap.cc:492] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
I20260709 12:12:48.992612  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:12:48.993292  5274 raft_consensus.cc:3060] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.993727  5313 tablet_bootstrap.cc:654] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.998646  5453 leader_election.cc:290] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:49.001138  5385 raft_consensus.cc:2749] T a6b2fb64d40642259e41424cef193db0 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:49.004024  5274 raft_consensus.cc:2468] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 1.
I20260709 12:12:49.005446  5163 leader_election.cc:304] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:12:49.006790  5375 raft_consensus.cc:2804] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:49.007066  5313 tablet_bootstrap.cc:492] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:49.007736  5313 ts_tablet_manager.cc:1403] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.009s
I20260709 12:12:49.007977  5375 raft_consensus.cc:697] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:12:49.009087  5375 consensus_queue.cc:237] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.011126  5313 raft_consensus.cc:359] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.012001  5313 raft_consensus.cc:385] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.012384  5313 raft_consensus.cc:740] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.013267  5313 consensus_queue.cc:260] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.014317  5123 raft_consensus.cc:2468] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 1.
I20260709 12:12:49.015574  5021 catalog_manager.cc:5697] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 1 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:49.015990  5313 ts_tablet_manager.cc:1434] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:12:49.017300  5313 tablet_bootstrap.cc:492] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
I20260709 12:12:49.018404  5316 tablet_bootstrap.cc:492] T 00645b1f1e014de995e4a937f842d909 P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
I20260709 12:12:49.018857  5316 ts_tablet_manager.cc:1403] T 00645b1f1e014de995e4a937f842d909 P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.127s	user 0.037s	sys 0.088s
I20260709 12:12:49.021528  5316 raft_consensus.cc:359] T 00645b1f1e014de995e4a937f842d909 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.022094  5316 raft_consensus.cc:385] T 00645b1f1e014de995e4a937f842d909 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.022465  5316 raft_consensus.cc:740] T 00645b1f1e014de995e4a937f842d909 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.023921  5313 tablet_bootstrap.cc:654] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.023710  5316 consensus_queue.cc:260] T 00645b1f1e014de995e4a937f842d909 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.022068  5377 leader_election.cc:290] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:49.025928  5316 ts_tablet_manager.cc:1434] T 00645b1f1e014de995e4a937f842d909 P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 12:12:49.027609  5316 tablet_bootstrap.cc:492] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
I20260709 12:12:49.033519  5316 tablet_bootstrap.cc:654] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.034963  5313 tablet_bootstrap.cc:492] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:49.035470  5313 ts_tablet_manager.cc:1403] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.002s
I20260709 12:12:49.038028  5313 raft_consensus.cc:359] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.038722  5313 raft_consensus.cc:385] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.038993  5313 raft_consensus.cc:740] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.039839  5313 consensus_queue.cc:260] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.042884  5313 ts_tablet_manager.cc:1434] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:12:49.044059  5313 tablet_bootstrap.cc:492] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
I20260709 12:12:49.045454  5023 catalog_manager.cc:5697] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 0 to 1, leader changed from <none> to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 1 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:49.050974  5313 tablet_bootstrap.cc:654] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.081689  5453 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.082222  5453 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.082753  5316 tablet_bootstrap.cc:492] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
I20260709 12:12:49.083338  5316 ts_tablet_manager.cc:1403] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.056s	user 0.017s	sys 0.015s
I20260709 12:12:49.084306  5314 tablet_bootstrap.cc:492] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:49.084836  5314 ts_tablet_manager.cc:1403] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.208s	user 0.026s	sys 0.011s
I20260709 12:12:49.085999  5316 raft_consensus.cc:359] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.086992  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:49.087677  5123 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 0.
I20260709 12:12:49.084358  5453 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:49.087632  5314 raft_consensus.cc:359] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.087818  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:49.088541  5314 raft_consensus.cc:385] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.088713  5316 raft_consensus.cc:385] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.089155  5316 raft_consensus.cc:740] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.089216  5314 raft_consensus.cc:740] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.089746  5240 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:12:49.089892  5316 consensus_queue.cc:260] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.089975  5314 consensus_queue.cc:260] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.090945  5454 raft_consensus.cc:2804] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:12:49.091006  5237 leader_election.cc:343] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:49.091358  5454 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:49.091821  5454 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.092099  5316 ts_tablet_manager.cc:1434] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 12:12:49.093010  5316 tablet_bootstrap.cc:492] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
I20260709 12:12:49.093966  5313 tablet_bootstrap.cc:492] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:49.094419  5313 ts_tablet_manager.cc:1403] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.051s	user 0.015s	sys 0.004s
I20260709 12:12:49.098857  5314 ts_tablet_manager.cc:1434] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:12:49.098894  5454 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.100111  5314 tablet_bootstrap.cc:492] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
I20260709 12:12:49.102236  5454 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:49.102975  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:12:49.106392  5314 tablet_bootstrap.cc:654] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.106921  5316 tablet_bootstrap.cc:654] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:49.107901  5237 leader_election.cc:343] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:49.109854  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:12:49.110497  5123 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.111922  5314 tablet_bootstrap.cc:492] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:49.112553  5314 ts_tablet_manager.cc:1403] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 12:12:49.117085  5123 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 1.
I20260709 12:12:49.117476  5316 tablet_bootstrap.cc:492] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
I20260709 12:12:49.117929  5316 ts_tablet_manager.cc:1403] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.025s	user 0.007s	sys 0.007s
I20260709 12:12:49.118846  5314 raft_consensus.cc:359] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.119379  5314 raft_consensus.cc:385] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.119128  5240 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:12:49.119655  5314 raft_consensus.cc:740] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.120121  5375 consensus_queue.cc:1048] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:49.120383  5454 raft_consensus.cc:2804] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:49.120955  5454 raft_consensus.cc:697] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:12:49.121933  5313 raft_consensus.cc:359] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.121858  5454 consensus_queue.cc:237] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.122632  5313 raft_consensus.cc:385] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.122918  5313 raft_consensus.cc:740] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.122656  5316 raft_consensus.cc:359] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.123805  5316 raft_consensus.cc:385] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.123596  5313 consensus_queue.cc:260] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.124091  5316 raft_consensus.cc:740] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.120605  5314 consensus_queue.cc:260] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.125923  5314 ts_tablet_manager.cc:1434] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:12:49.126080  5313 ts_tablet_manager.cc:1434] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 12:12:49.126668  5316 consensus_queue.cc:260] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.127991  5313 tablet_bootstrap.cc:492] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
I20260709 12:12:49.128410  5314 tablet_bootstrap.cc:492] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
I20260709 12:12:49.135262  5314 tablet_bootstrap.cc:654] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.138836  5316 ts_tablet_manager.cc:1434] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.019s	user 0.002s	sys 0.004s
I20260709 12:12:49.140357  5316 tablet_bootstrap.cc:492] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
I20260709 12:12:49.146142  5359 consensus_queue.cc:1048] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:49.146414  5375 consensus_queue.cc:1048] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:49.146217  5316 tablet_bootstrap.cc:654] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.157119  5314 tablet_bootstrap.cc:492] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:49.157665  5314 ts_tablet_manager.cc:1403] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.003s
I20260709 12:12:49.160387  5314 raft_consensus.cc:359] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.161095  5314 raft_consensus.cc:385] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.161352  5314 raft_consensus.cc:740] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.162007  5314 consensus_queue.cc:260] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.162792  5313 tablet_bootstrap.cc:654] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.164024  5314 ts_tablet_manager.cc:1434] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:12:49.165067  5314 tablet_bootstrap.cc:492] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
I20260709 12:12:49.171571  5314 tablet_bootstrap.cc:654] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.174716  5316 tablet_bootstrap.cc:492] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
I20260709 12:12:49.175226  5316 ts_tablet_manager.cc:1403] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.000s
I20260709 12:12:49.177811  5339 consensus_queue.cc:1048] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:12:49.182952  5359 consensus_queue.cc:1048] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:49.192297  5313 tablet_bootstrap.cc:492] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:49.227321  5316 raft_consensus.cc:359] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.228157  5316 raft_consensus.cc:385] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.228442  5316 raft_consensus.cc:740] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.234308  5377 raft_consensus.cc:493] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.233938  5316 consensus_queue.cc:260] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.234820  5377 raft_consensus.cc:515] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.236045  5316 ts_tablet_manager.cc:1434] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.061s	user 0.013s	sys 0.015s
I20260709 12:12:49.236840  5377 leader_election.cc:290] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:49.237094  5316 tablet_bootstrap.cc:492] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
I20260709 12:12:49.237627  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:49.238274  5125 raft_consensus.cc:2468] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 0.
I20260709 12:12:49.239481  5166 leader_election.cc:304] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:12:49.240283  5377 raft_consensus.cc:2804] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:49.240665  5377 raft_consensus.cc:493] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:49.240994  5377 raft_consensus.cc:3060] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.250855  5313 ts_tablet_manager.cc:1403] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.123s	user 0.015s	sys 0.001s
I20260709 12:12:49.255160  5316 tablet_bootstrap.cc:654] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.255319  5023 catalog_manager.cc:5697] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 1 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:49.261739  5313 raft_consensus.cc:359] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.262234  5316 tablet_bootstrap.cc:492] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
I20260709 12:12:49.262722  5316 ts_tablet_manager.cc:1403] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.000s
I20260709 12:12:49.265149  5377 raft_consensus.cc:515] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.265527  5316 raft_consensus.cc:359] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.266414  5316 raft_consensus.cc:385] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.266696  5316 raft_consensus.cc:740] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.267331  5316 consensus_queue.cc:260] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.268458  5313 raft_consensus.cc:385] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.268968  5313 raft_consensus.cc:740] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.269656  5313 consensus_queue.cc:260] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.270133  5316 ts_tablet_manager.cc:1434] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:12:49.272207  5316 tablet_bootstrap.cc:492] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
I20260709 12:12:49.275785  5313 ts_tablet_manager.cc:1434] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.025s	user 0.003s	sys 0.004s
I20260709 12:12:49.276801  5313 tablet_bootstrap.cc:492] T 87f29f851a0e43738cf01ef3724e5533 P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
I20260709 12:12:49.278301  5316 tablet_bootstrap.cc:654] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.280776  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:49.281456  5274 raft_consensus.cc:2468] T 00645b1f1e014de995e4a937f842d909 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 0.
I20260709 12:12:49.281625  5385 raft_consensus.cc:493] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.282177  5385 raft_consensus.cc:515] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.286031  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:49.286765  5200 raft_consensus.cc:2468] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 0.
I20260709 12:12:49.288300  5237 leader_election.cc:304] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:12:49.289026  5319 consensus_queue.cc:1048] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:49.289639  5313 tablet_bootstrap.cc:654] T 87f29f851a0e43738cf01ef3724e5533 P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.290805  5453 raft_consensus.cc:493] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.291374  5453 raft_consensus.cc:515] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.294528  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:49.295313  5121 raft_consensus.cc:2468] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 0.
I20260709 12:12:49.295469  5314 tablet_bootstrap.cc:492] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:49.296205  5314 ts_tablet_manager.cc:1403] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.131s	user 0.017s	sys 0.006s
I20260709 12:12:49.289266  5454 raft_consensus.cc:2804] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:49.296684  5454 raft_consensus.cc:493] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:49.297088  5454 raft_consensus.cc:3060] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.299546  5377 leader_election.cc:290] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:49.299243  5314 raft_consensus.cc:359] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.300612  5314 raft_consensus.cc:385] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.300889  5314 raft_consensus.cc:740] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.301687  5314 consensus_queue.cc:260] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.315114  5314 ts_tablet_manager.cc:1434] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:12:49.304430  5385 leader_election.cc:290] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:49.317483  5314 tablet_bootstrap.cc:492] T 88f51ae73df747849e2f3cd63547a1d0 P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
I20260709 12:12:49.309974  5350 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.316808  5453 leader_election.cc:290] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:49.322023  5516 raft_consensus.cc:493] T f34c97113147431584d6336e0d849164 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.328320  5313 tablet_bootstrap.cc:492] T 87f29f851a0e43738cf01ef3724e5533 P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:49.328860  5313 ts_tablet_manager.cc:1403] T 87f29f851a0e43738cf01ef3724e5533 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.052s	user 0.007s	sys 0.003s
I20260709 12:12:49.320720  5350 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.327333  5360 raft_consensus.cc:493] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.332484  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:12:49.331553  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:12:49.345832  5124 raft_consensus.cc:3060] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.346065  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:49.337014  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:49.347462  5350 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:49.350696  5316 tablet_bootstrap.cc:492] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
I20260709 12:12:49.351220  5316 ts_tablet_manager.cc:1403] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.080s	user 0.024s	sys 0.026s
I20260709 12:12:49.344451  5454 raft_consensus.cc:515] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.354580  5314 tablet_bootstrap.cc:654] T 88f51ae73df747849e2f3cd63547a1d0 P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.355226  5454 leader_election.cc:290] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:49.330371  5516 raft_consensus.cc:515] T f34c97113147431584d6336e0d849164 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.351444  5273 raft_consensus.cc:3060] T 00645b1f1e014de995e4a937f842d909 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.359671  5516 leader_election.cc:290] T f34c97113147431584d6336e0d849164 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:49.337448  5360 raft_consensus.cc:515] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.365795  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:49.367076  5360 leader_election.cc:290] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:49.365082  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:49.364943  5319 consensus_queue.cc:1048] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:49.367885  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:12:49.368381  5240 leader_election.cc:343] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:49.368422  5200 raft_consensus.cc:2468] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 0.
I20260709 12:12:49.369554  5088 leader_election.cc:304] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:12:49.369602  5454 consensus_queue.cc:1048] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:12:49.370101  5237 leader_election.cc:343] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:49.370571  5237 leader_election.cc:304] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:12:49.371647  5316 raft_consensus.cc:359] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.372268  5316 raft_consensus.cc:385] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.372505  5316 raft_consensus.cc:740] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.373088  5316 consensus_queue.cc:260] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.373497  5313 raft_consensus.cc:359] T 87f29f851a0e43738cf01ef3724e5533 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.374161  5313 raft_consensus.cc:385] T 87f29f851a0e43738cf01ef3724e5533 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.374418  5313 raft_consensus.cc:740] T 87f29f851a0e43738cf01ef3724e5533 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.375087  5273 raft_consensus.cc:2468] T 00645b1f1e014de995e4a937f842d909 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 1.
I20260709 12:12:49.377444  5454 raft_consensus.cc:2749] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:12:49.378157  5237 leader_election.cc:343] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:49.370663  5360 raft_consensus.cc:2804] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:49.380362  5360 raft_consensus.cc:493] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:49.380648  5316 ts_tablet_manager.cc:1434] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.003s
I20260709 12:12:49.379158  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:12:49.381155  5200 raft_consensus.cc:3060] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.382777  5316 tablet_bootstrap.cc:492] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
I20260709 12:12:49.375331  5313 consensus_queue.cc:260] T 87f29f851a0e43738cf01ef3724e5533 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.383148  5360 raft_consensus.cc:3060] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.384282  5313 ts_tablet_manager.cc:1434] T 87f29f851a0e43738cf01ef3724e5533 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.055s	user 0.005s	sys 0.000s
I20260709 12:12:49.385192  5313 tablet_bootstrap.cc:492] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
I20260709 12:12:49.391099  5163 leader_election.cc:304] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:12:49.392099  5319 consensus_queue.cc:1048] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:49.393488  5319 raft_consensus.cc:2804] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:49.393982  5319 raft_consensus.cc:697] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:12:49.394762  5319 consensus_queue.cc:237] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.415278  5124 raft_consensus.cc:2468] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 1.
I20260709 12:12:49.418618  5313 tablet_bootstrap.cc:654] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.420863  5454 consensus_queue.cc:1048] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:49.423966  5200 raft_consensus.cc:2468] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 1.
I20260709 12:12:49.426787  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:49.428074  5273 raft_consensus.cc:2393] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 1: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:12:49.428776  5237 leader_election.cc:304] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:12:49.429503  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:49.430058  5088 leader_election.cc:304] T f34c97113147431584d6336e0d849164 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:12:49.431315  5516 raft_consensus.cc:3060] T f34c97113147431584d6336e0d849164 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.431617  5023 catalog_manager.cc:5697] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 0 to 1, leader changed from <none> to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 1 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:49.435046  5524 raft_consensus.cc:2804] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:49.436035  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:12:49.439412  5088 leader_election.cc:343] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:49.439371  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:12:49.437992  5524 raft_consensus.cc:697] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:12:49.458333  5524 consensus_queue.cc:237] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.459146  5123 raft_consensus.cc:3060] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.466117  5319 consensus_queue.cc:1048] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:49.450202  5360 raft_consensus.cc:515] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.469275  5316 tablet_bootstrap.cc:654] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.468904  5377 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.470186  5377 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.471475  5314 tablet_bootstrap.cc:492] T 88f51ae73df747849e2f3cd63547a1d0 P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:49.471949  5314 ts_tablet_manager.cc:1403] T 88f51ae73df747849e2f3cd63547a1d0 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.156s	user 0.019s	sys 0.015s
I20260709 12:12:49.475189  5453 consensus_queue.cc:1048] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:12:49.476408  5377 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:49.485471  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:49.486362  5122 raft_consensus.cc:2393] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 1: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:12:49.495047  5332 consensus_queue.cc:1048] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:49.496451  5314 raft_consensus.cc:359] T 88f51ae73df747849e2f3cd63547a1d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.500325  5314 raft_consensus.cc:385] T 88f51ae73df747849e2f3cd63547a1d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.500639  5314 raft_consensus.cc:740] T 88f51ae73df747849e2f3cd63547a1d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.501838  5314 consensus_queue.cc:260] T 88f51ae73df747849e2f3cd63547a1d0 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.513412  5313 tablet_bootstrap.cc:492] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:49.514006  5313 ts_tablet_manager.cc:1403] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.129s	user 0.014s	sys 0.019s
W20260709 12:12:49.514915  5240 leader_election.cc:343] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:49.516667  5240 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:12:49.519060  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:49.521909  5198 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.521165  5313 raft_consensus.cc:359] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.525406  5313 raft_consensus.cc:385] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.525750  5313 raft_consensus.cc:740] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.529459  5314 ts_tablet_manager.cc:1434] T 88f51ae73df747849e2f3cd63547a1d0 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.057s	user 0.004s	sys 0.005s
I20260709 12:12:49.530405  5314 tablet_bootstrap.cc:492] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
I20260709 12:12:49.524973  5332 raft_consensus.cc:2749] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:49.533552  5313 consensus_queue.cc:260] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.527907  5516 raft_consensus.cc:2749] T f34c97113147431584d6336e0d849164 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:49.536842  5360 leader_election.cc:290] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:49.536928  5163 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:12:49.546013  5319 consensus_queue.cc:1048] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:49.550158  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:12:49.550825  5196 raft_consensus.cc:3060] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.551023  5313 ts_tablet_manager.cc:1434] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 12:12:49.552081  5313 tablet_bootstrap.cc:492] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
I20260709 12:12:49.553519  5359 raft_consensus.cc:493] T 87f29f851a0e43738cf01ef3724e5533 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.544344  5123 raft_consensus.cc:2468] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 1.
I20260709 12:12:49.554073  5359 raft_consensus.cc:515] T 87f29f851a0e43738cf01ef3724e5533 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.568796  5359 leader_election.cc:290] T 87f29f851a0e43738cf01ef3724e5533 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:49.572520  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:12:49.579800  5023 catalog_manager.cc:5697] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 1 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
W20260709 12:12:49.607035  5530 log.cc:927] Time spent T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:12:49.636080  5196 raft_consensus.cc:2468] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 1.
I20260709 12:12:49.643186  5375 raft_consensus.cc:2749] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:49.668413  5316 tablet_bootstrap.cc:492] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
I20260709 12:12:49.668857  5316 ts_tablet_manager.cc:1403] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.286s	user 0.016s	sys 0.011s
I20260709 12:12:49.672097  5314 tablet_bootstrap.cc:654] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:49.672636  5534 log.cc:927] Time spent T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 12:12:49.678949  5535 log.cc:927] Time spent T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
W20260709 12:12:49.682898  5532 log.cc:927] Time spent T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 12:12:49.673527  5088 leader_election.cc:343] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:49.710507  5313 tablet_bootstrap.cc:654] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.712031  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:49.715266  5453 raft_consensus.cc:493] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.715847  5453 raft_consensus.cc:515] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.717366  5088 leader_election.cc:304] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:12:49.677630  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:49.722208  5350 raft_consensus.cc:493] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:49.718860  5088 leader_election.cc:343] T 87f29f851a0e43738cf01ef3724e5533 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:49.735090  5316 raft_consensus.cc:359] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.735653  5316 raft_consensus.cc:385] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.735865  5316 raft_consensus.cc:740] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.725983  5359 raft_consensus.cc:2804] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:49.738381  5316 consensus_queue.cc:260] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.741969  5453 leader_election.cc:290] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:49.742651  5453 consensus_queue.cc:1048] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:49.738538  5350 raft_consensus.cc:515] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.753916  5516 raft_consensus.cc:493] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.754511  5516 raft_consensus.cc:515] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.756652  5516 leader_election.cc:290] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:49.761140  5359 raft_consensus.cc:697] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
W20260709 12:12:49.761710  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 47994.6us
I20260709 12:12:49.776657  5531 raft_consensus.cc:493] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:49.777297  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 43817.1us
I20260709 12:12:49.777202  5531 raft_consensus.cc:515] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.779142  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:49.779837  5273 raft_consensus.cc:2468] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 0.
I20260709 12:12:49.779994  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:49.780646  5199 raft_consensus.cc:2468] T 88f51ae73df747849e2f3cd63547a1d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 0.
I20260709 12:12:49.785869  5359 consensus_queue.cc:237] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.786401  5316 ts_tablet_manager.cc:1434] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.117s	user 0.015s	sys 0.001s
I20260709 12:12:49.786201  5350 leader_election.cc:290] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:49.787657  5316 tablet_bootstrap.cc:492] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
W20260709 12:12:49.789307  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 52166.2us
I20260709 12:12:49.791411  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:12:49.782665  5088 leader_election.cc:343] T 87f29f851a0e43738cf01ef3724e5533 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:49.813117  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:49.821056  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:49.825366  5313 tablet_bootstrap.cc:492] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:49.832485  5313 ts_tablet_manager.cc:1403] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.281s	user 0.013s	sys 0.004s
I20260709 12:12:49.828397  5316 tablet_bootstrap.cc:654] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.832917  5454 consensus_queue.cc:1048] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:12:49.824347  5237 leader_election.cc:304] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:12:49.836566  5332 raft_consensus.cc:2804] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:49.836947  5332 raft_consensus.cc:493] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:49.823536  5531 leader_election.cc:290] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:49.837287  5332 raft_consensus.cc:3060] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:49.831125  5071 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:49.816082  5088 leader_election.cc:304] T 87f29f851a0e43738cf01ef3724e5533 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:12:49.837311  5237 leader_election.cc:343] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:49.836453  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:49.851752  5314 tablet_bootstrap.cc:492] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:49.852262  5314 ts_tablet_manager.cc:1403] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.322s	user 0.010s	sys 0.025s
I20260709 12:12:49.846350  5122 raft_consensus.cc:2468] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 0.
I20260709 12:12:49.844702  5531 raft_consensus.cc:2749] T 87f29f851a0e43738cf01ef3724e5533 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:12:49.842626  5240 leader_election.cc:343] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:49.863102  5313 raft_consensus.cc:359] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.863842  5313 raft_consensus.cc:385] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:12:49.850135  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 76361us
I20260709 12:12:49.864121  5313 raft_consensus.cc:740] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
W20260709 12:12:49.865044  5088 leader_election.cc:343] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:49.868010  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:49.869477  5313 consensus_queue.cc:260] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.876601  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:49.877285  5273 raft_consensus.cc:2468] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 0.
I20260709 12:12:49.879417  5332 raft_consensus.cc:515] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.880947  5313 ts_tablet_manager.cc:1434] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.000s
I20260709 12:12:49.882129  5313 tablet_bootstrap.cc:492] T 20ba878da4e3492fbdf2f90c6bb202c4 P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
I20260709 12:12:49.882434  5332 leader_election.cc:290] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:49.879875  5316 tablet_bootstrap.cc:492] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
I20260709 12:12:49.884366  5316 ts_tablet_manager.cc:1403] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.097s	user 0.012s	sys 0.006s
I20260709 12:12:49.875597  5088 leader_election.cc:304] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:12:49.885692  5375 consensus_queue.cc:1048] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:49.886132  5360 raft_consensus.cc:2804] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:49.886543  5360 raft_consensus.cc:493] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:49.886626  5088 leader_election.cc:343] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:49.886948  5360 raft_consensus.cc:3060] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.887231  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:12:49.887813  5200 raft_consensus.cc:3060] T 88f51ae73df747849e2f3cd63547a1d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.888592  5240 leader_election.cc:304] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:12:49.886718  5314 raft_consensus.cc:359] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.890432  5314 raft_consensus.cc:385] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.890718  5314 raft_consensus.cc:740] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.899677  5088 leader_election.cc:304] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:12:49.908587  5314 consensus_queue.cc:260] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.916994  5313 tablet_bootstrap.cc:654] T 20ba878da4e3492fbdf2f90c6bb202c4 P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.905479  5359 raft_consensus.cc:2804] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:49.924069  5314 ts_tablet_manager.cc:1434] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.072s	user 0.004s	sys 0.003s
I20260709 12:12:49.898430  5332 raft_consensus.cc:2804] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:49.925786  5316 raft_consensus.cc:359] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:49.927634  5316 raft_consensus.cc:385] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.929538  5316 raft_consensus.cc:740] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.929953  5314 tablet_bootstrap.cc:492] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
I20260709 12:12:49.924690  5359 raft_consensus.cc:493] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:49.904577  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:12:49.927313  5332 raft_consensus.cc:493] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:49.931957  5332 raft_consensus.cc:3060] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.930941  5359 raft_consensus.cc:3060] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.020917  5377 consensus_queue.cc:1048] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:12:50.029305  5316 consensus_queue.cc:260] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.031064  5200 raft_consensus.cc:2468] T 88f51ae73df747849e2f3cd63547a1d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 1.
I20260709 12:12:50.034860  5122 raft_consensus.cc:3060] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.042789  5316 ts_tablet_manager.cc:1434] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.158s	user 0.009s	sys 0.005s
I20260709 12:12:50.044147  5316 tablet_bootstrap.cc:492] T 21832120214f4b8fb9e2e0de351565f0 P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
I20260709 12:12:50.047919  5332 raft_consensus.cc:515] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.050171  5332 leader_election.cc:290] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:50.052310  5359 raft_consensus.cc:515] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:12:50.036600  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 105649us
I20260709 12:12:50.058840  5359 leader_election.cc:290] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:50.060773  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:12:50.060897  5360 raft_consensus.cc:515] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.062424  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:12:50.068804  5274 raft_consensus.cc:3060] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.065291  5237 leader_election.cc:304] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:12:50.071686  5200 raft_consensus.cc:3060] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.074743  5274 raft_consensus.cc:2468] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 1.
I20260709 12:12:50.075997  5088 leader_election.cc:304] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:12:50.078040  5359 raft_consensus.cc:2804] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:50.078577  5359 raft_consensus.cc:697] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:12:50.072075  5313 tablet_bootstrap.cc:492] T 20ba878da4e3492fbdf2f90c6bb202c4 P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:50.080035  5313 ts_tablet_manager.cc:1403] T 20ba878da4e3492fbdf2f90c6bb202c4 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.198s	user 0.035s	sys 0.000s
I20260709 12:12:50.079428  5359 consensus_queue.cc:237] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.083894  5200 raft_consensus.cc:2468] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 1.
I20260709 12:12:50.084880  5332 raft_consensus.cc:2804] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:50.085464  5332 raft_consensus.cc:697] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:12:50.086306  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:12:50.087750  5360 leader_election.cc:290] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:50.090195  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:12:50.092260  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:12:50.093111  5272 raft_consensus.cc:2393] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 1: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:12:50.095469  5314 tablet_bootstrap.cc:654] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.086318  5332 consensus_queue.cc:237] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:12:50.092284  5237 leader_election.cc:343] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:50.110450  5313 raft_consensus.cc:359] T 20ba878da4e3492fbdf2f90c6bb202c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.111393  5313 raft_consensus.cc:385] T 20ba878da4e3492fbdf2f90c6bb202c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.111734  5313 raft_consensus.cc:740] T 20ba878da4e3492fbdf2f90c6bb202c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.112732  5313 consensus_queue.cc:260] T 20ba878da4e3492fbdf2f90c6bb202c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.110059  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:12:50.115394  5121 raft_consensus.cc:2393] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 1: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:12:50.121760  5122 raft_consensus.cc:2468] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 1.
I20260709 12:12:50.103585  5453 consensus_queue.cc:1048] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 12:12:50.126557  5385 consensus_queue.cc:1048] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:12:50.103458  5088 leader_election.cc:343] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:50.132555  5088 leader_election.cc:304] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:12:50.133340  5360 raft_consensus.cc:2749] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:12:50.133152  5516 raft_consensus.cc:493] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.128772  5316 tablet_bootstrap.cc:654] T 21832120214f4b8fb9e2e0de351565f0 P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.134891  5516 raft_consensus.cc:515] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.141798  5313 ts_tablet_manager.cc:1434] T 20ba878da4e3492fbdf2f90c6bb202c4 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.061s	user 0.011s	sys 0.000s
I20260709 12:12:50.146010  5313 tablet_bootstrap.cc:492] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
I20260709 12:12:50.138456  5240 leader_election.cc:304] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:12:50.146891  5385 raft_consensus.cc:2749] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:12:50.159679  5516 leader_election.cc:290] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:50.161514  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:50.162348  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:50.162911  5199 raft_consensus.cc:2468] T 88f51ae73df747849e2f3cd63547a1d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 1.
I20260709 12:12:50.165815  5088 leader_election.cc:304] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:12:50.168073  5516 raft_consensus.cc:2804] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:50.172638  5516 raft_consensus.cc:493] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:50.174268  5516 raft_consensus.cc:3060] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:50.178689  5314 tablet_bootstrap.cc:492] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:50.179395  5314 ts_tablet_manager.cc:1403] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.250s	user 0.028s	sys 0.023s
I20260709 12:12:50.182451  5314 raft_consensus.cc:359] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.183183  5314 raft_consensus.cc:385] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.183583  5314 raft_consensus.cc:740] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.184422  5314 consensus_queue.cc:260] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.188630  5021 catalog_manager.cc:5697] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 1 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:50.194737  5313 tablet_bootstrap.cc:654] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.195675  5314 ts_tablet_manager.cc:1434] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.007s
I20260709 12:12:50.199170  5314 tablet_bootstrap.cc:492] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
I20260709 12:12:50.215283  5316 tablet_bootstrap.cc:492] T 21832120214f4b8fb9e2e0de351565f0 P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
I20260709 12:12:50.216177  5316 ts_tablet_manager.cc:1403] T 21832120214f4b8fb9e2e0de351565f0 P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.172s	user 0.027s	sys 0.010s
I20260709 12:12:50.223006  5316 raft_consensus.cc:359] T 21832120214f4b8fb9e2e0de351565f0 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.225425  5316 raft_consensus.cc:385] T 21832120214f4b8fb9e2e0de351565f0 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.226277  5316 raft_consensus.cc:740] T 21832120214f4b8fb9e2e0de351565f0 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.227241  5316 consensus_queue.cc:260] T 21832120214f4b8fb9e2e0de351565f0 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.232335  5316 ts_tablet_manager.cc:1434] T 21832120214f4b8fb9e2e0de351565f0 P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:12:50.233428  5316 tablet_bootstrap.cc:492] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
I20260709 12:12:50.236761  5313 tablet_bootstrap.cc:492] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:50.237278  5313 ts_tablet_manager.cc:1403] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.091s	user 0.018s	sys 0.006s
I20260709 12:12:50.239950  5313 raft_consensus.cc:359] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.240610  5313 raft_consensus.cc:385] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.240857  5313 raft_consensus.cc:740] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.241513  5313 consensus_queue.cc:260] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.242493  5314 tablet_bootstrap.cc:654] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.245885  5516 raft_consensus.cc:515] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.248366  5516 leader_election.cc:290] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:50.249665  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:12:50.254171  5313 ts_tablet_manager.cc:1434] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:12:50.255141  5313 tablet_bootstrap.cc:492] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
I20260709 12:12:50.251973  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:12:50.259341  5199 raft_consensus.cc:3060] T 88f51ae73df747849e2f3cd63547a1d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:50.262605  5360 consensus_queue.cc:1048] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:50.269208  5313 tablet_bootstrap.cc:654] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.284612  5316 tablet_bootstrap.cc:654] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.292083  5314 tablet_bootstrap.cc:492] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:50.292627  5314 ts_tablet_manager.cc:1403] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.094s	user 0.015s	sys 0.007s
I20260709 12:12:50.295737  5314 raft_consensus.cc:359] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.296455  5314 raft_consensus.cc:385] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.293399  5199 raft_consensus.cc:2468] T 88f51ae73df747849e2f3cd63547a1d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 2.
I20260709 12:12:50.296769  5314 raft_consensus.cc:740] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.301877  5314 consensus_queue.cc:260] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.304337  5314 ts_tablet_manager.cc:1434] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 12:12:50.303272  5022 catalog_manager.cc:5697] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 1 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:50.305330  5524 raft_consensus.cc:493] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.305569  5314 tablet_bootstrap.cc:492] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
I20260709 12:12:50.305917  5524 raft_consensus.cc:515] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.313743  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:50.313827  5313 tablet_bootstrap.cc:492] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:50.318651  5316 tablet_bootstrap.cc:492] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
I20260709 12:12:50.318727  5313 ts_tablet_manager.cc:1403] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.064s	user 0.021s	sys 0.006s
I20260709 12:12:50.319092  5314 tablet_bootstrap.cc:654] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.319386  5316 ts_tablet_manager.cc:1403] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.086s	user 0.017s	sys 0.010s
I20260709 12:12:50.314571  5198 raft_consensus.cc:2468] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 0.
I20260709 12:12:50.322357  5316 raft_consensus.cc:359] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.323293  5316 raft_consensus.cc:385] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.323680  5316 raft_consensus.cc:740] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.324519  5316 consensus_queue.cc:260] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.325575  5237 leader_election.cc:304] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:12:50.327061  5316 ts_tablet_manager.cc:1434] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:12:50.329500  5332 raft_consensus.cc:2804] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:50.329910  5332 raft_consensus.cc:493] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:50.329753  5088 leader_election.cc:304] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:12:50.318090  5524 leader_election.cc:290] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:50.330233  5332 raft_consensus.cc:3060] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.330848  5360 raft_consensus.cc:2804] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:50.322463  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:50.331434  5360 raft_consensus.cc:697] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:12:50.332208  5314 tablet_bootstrap.cc:492] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:50.332712  5314 ts_tablet_manager.cc:1403] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.008s
I20260709 12:12:50.332257  5360 consensus_queue.cc:237] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.334575  5313 raft_consensus.cc:359] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.335425  5313 raft_consensus.cc:385] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.335700  5313 raft_consensus.cc:740] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.332261  5122 raft_consensus.cc:2468] T 87f29f851a0e43738cf01ef3724e5533 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 0.
I20260709 12:12:50.338722  5332 raft_consensus.cc:515] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.342039  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:12:50.342352  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:12:50.342757  5122 raft_consensus.cc:3060] T 87f29f851a0e43738cf01ef3724e5533 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.344830  5332 leader_election.cc:290] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:50.342981  5198 raft_consensus.cc:3060] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.344288  5313 consensus_queue.cc:260] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.347981  5022 catalog_manager.cc:5697] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 1 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:50.340734  5316 tablet_bootstrap.cc:492] T d8dc93d0992c4324872c6aab5aa9db8c P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
I20260709 12:12:50.340325  5314 raft_consensus.cc:359] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.351666  5314 raft_consensus.cc:385] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.351958  5314 raft_consensus.cc:740] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.352643  5314 consensus_queue.cc:260] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.354727  5314 ts_tablet_manager.cc:1434] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.004s
I20260709 12:12:50.348011  5313 ts_tablet_manager.cc:1434] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 12:12:50.357674  5313 tablet_bootstrap.cc:492] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
I20260709 12:12:50.359138  5314 tablet_bootstrap.cc:492] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
I20260709 12:12:50.363389  5313 tablet_bootstrap.cc:654] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.363555  5122 raft_consensus.cc:2468] T 87f29f851a0e43738cf01ef3724e5533 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 1.
W20260709 12:12:50.365546  5088 consensus_peers.cc:597] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 -> Peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Couldn't send request to peer 9e794b72ed7640219f90ec4232363929. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:50.368724  5198 raft_consensus.cc:2468] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 1.
I20260709 12:12:50.371857  5237 leader_election.cc:304] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:12:50.373051  5332 raft_consensus.cc:2804] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:50.373638  5332 raft_consensus.cc:697] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:12:50.369269  5316 tablet_bootstrap.cc:654] T d8dc93d0992c4324872c6aab5aa9db8c P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.374594  5332 consensus_queue.cc:237] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.377594  5314 tablet_bootstrap.cc:654] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.385571  5316 tablet_bootstrap.cc:492] T d8dc93d0992c4324872c6aab5aa9db8c P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
I20260709 12:12:50.386123  5316 ts_tablet_manager.cc:1403] T d8dc93d0992c4324872c6aab5aa9db8c P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.046s	user 0.012s	sys 0.003s
I20260709 12:12:50.387418  5314 tablet_bootstrap.cc:492] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:50.387887  5314 ts_tablet_manager.cc:1403] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.029s	user 0.004s	sys 0.008s
I20260709 12:12:50.391938  5316 raft_consensus.cc:359] T d8dc93d0992c4324872c6aab5aa9db8c P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.392755  5316 raft_consensus.cc:385] T d8dc93d0992c4324872c6aab5aa9db8c P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.392760  5313 tablet_bootstrap.cc:492] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:50.393206  5316 raft_consensus.cc:740] T d8dc93d0992c4324872c6aab5aa9db8c P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.393679  5313 ts_tablet_manager.cc:1403] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.036s	user 0.015s	sys 0.010s
I20260709 12:12:50.394573  5316 consensus_queue.cc:260] T d8dc93d0992c4324872c6aab5aa9db8c P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.392400  5022 catalog_manager.cc:5697] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 1 to 2, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 2 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:50.396819  5316 ts_tablet_manager.cc:1434] T d8dc93d0992c4324872c6aab5aa9db8c P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:12:50.397763  5316 tablet_bootstrap.cc:492] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
I20260709 12:12:50.401882  5314 raft_consensus.cc:359] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.402621  5314 raft_consensus.cc:385] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.402872  5314 raft_consensus.cc:740] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.403506  5314 consensus_queue.cc:260] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.405022  5314 ts_tablet_manager.cc:1434] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.017s	user 0.002s	sys 0.002s
I20260709 12:12:50.406011  5543 raft_consensus.cc:493] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.406476  5543 raft_consensus.cc:515] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.408674  5543 leader_election.cc:290] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:50.409231  5316 tablet_bootstrap.cc:654] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.408504  5023 catalog_manager.cc:5697] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 1 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:50.409691  5313 raft_consensus.cc:359] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.410391  5313 raft_consensus.cc:385] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.410699  5313 raft_consensus.cc:740] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.411273  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:50.413091  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:50.413833  5273 raft_consensus.cc:2468] T 21832120214f4b8fb9e2e0de351565f0 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 0.
I20260709 12:12:50.415298  5163 leader_election.cc:304] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:12:50.416281  5319 raft_consensus.cc:2804] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:50.416635  5319 raft_consensus.cc:493] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:50.416944  5319 raft_consensus.cc:3060] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.417196  5313 consensus_queue.cc:260] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.419783  5313 ts_tablet_manager.cc:1434] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 12:12:50.420800  5313 tablet_bootstrap.cc:492] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
I20260709 12:12:50.421586  5122 raft_consensus.cc:2468] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 0.
I20260709 12:12:50.423709  5314 tablet_bootstrap.cc:492] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
I20260709 12:12:50.426385  5316 tablet_bootstrap.cc:492] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
I20260709 12:12:50.431527  5316 ts_tablet_manager.cc:1403] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.008s
I20260709 12:12:50.434252  5316 raft_consensus.cc:359] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.435098  5316 raft_consensus.cc:385] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.435433  5316 raft_consensus.cc:740] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.436069  5314 tablet_bootstrap.cc:654] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.436455  5316 consensus_queue.cc:260] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.439392  5316 ts_tablet_manager.cc:1434] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:12:50.440045  5360 raft_consensus.cc:493] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.440555  5360 raft_consensus.cc:515] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.441604  5316 tablet_bootstrap.cc:492] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
I20260709 12:12:50.442479  5360 leader_election.cc:290] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:50.444260  5313 tablet_bootstrap.cc:654] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.445708  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:50.446390  5273 raft_consensus.cc:2468] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 0.
I20260709 12:12:50.446970  5316 tablet_bootstrap.cc:654] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.447795  5088 leader_election.cc:304] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:12:50.448698  5360 raft_consensus.cc:2804] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:50.449051  5360 raft_consensus.cc:493] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:50.449364  5360 raft_consensus.cc:3060] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.451803  5314 tablet_bootstrap.cc:492] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:50.452273  5314 ts_tablet_manager.cc:1403] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.047s	user 0.009s	sys 0.000s
I20260709 12:12:50.454334  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:50.455161  5314 raft_consensus.cc:359] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:12:50.455678  5088 leader_election.cc:343] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:50.455904  5314 raft_consensus.cc:385] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.456218  5314 raft_consensus.cc:740] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.426529  5319 raft_consensus.cc:515] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.456952  5314 consensus_queue.cc:260] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.459193  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:12:50.459802  5122 raft_consensus.cc:3060] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.459118  5314 ts_tablet_manager.cc:1434] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:12:50.461972  5314 tablet_bootstrap.cc:492] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
I20260709 12:12:50.464185  5316 tablet_bootstrap.cc:492] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
I20260709 12:12:50.464756  5316 ts_tablet_manager.cc:1403] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.000s
I20260709 12:12:50.467952  5314 tablet_bootstrap.cc:654] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.467557  5316 raft_consensus.cc:359] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.469684  5316 raft_consensus.cc:385] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.470055  5316 raft_consensus.cc:740] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.470888  5316 consensus_queue.cc:260] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.473542  5316 ts_tablet_manager.cc:1434] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:12:50.475277  5316 tablet_bootstrap.cc:492] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
I20260709 12:12:50.482043  5316 tablet_bootstrap.cc:654] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.486379  5360 raft_consensus.cc:515] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.489651  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:12:50.490342  5272 raft_consensus.cc:3060] T 21832120214f4b8fb9e2e0de351565f0 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.492784  5122 raft_consensus.cc:2468] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 1.
I20260709 12:12:50.494036  5166 leader_election.cc:304] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:12:50.494897  5543 raft_consensus.cc:2804] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:50.495525  5543 raft_consensus.cc:697] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:12:50.496374  5543 consensus_queue.cc:237] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.501343  5360 leader_election.cc:290] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:50.502511  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
W20260709 12:12:50.508635  5088 leader_election.cc:343] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:50.513854  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:12:50.514549  5273 raft_consensus.cc:3060] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.516060  5023 catalog_manager.cc:5697] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 0 to 1, leader changed from <none> to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 1 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:50.521996  5273 raft_consensus.cc:2468] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 1.
I20260709 12:12:50.523283  5088 leader_election.cc:304] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:12:50.489924  5319 leader_election.cc:290] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:50.527148  5272 raft_consensus.cc:2468] T 21832120214f4b8fb9e2e0de351565f0 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 1.
I20260709 12:12:50.528738  5360 raft_consensus.cc:2804] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:50.529860  5360 raft_consensus.cc:697] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:12:50.531262  5360 consensus_queue.cc:237] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.539608  5516 consensus_queue.cc:1048] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:50.543483  5313 tablet_bootstrap.cc:492] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:50.543483  5314 tablet_bootstrap.cc:492] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:50.544158  5314 ts_tablet_manager.cc:1403] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.082s	user 0.024s	sys 0.042s
I20260709 12:12:50.544158  5313 ts_tablet_manager.cc:1403] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.124s	user 0.013s	sys 0.041s
I20260709 12:12:50.545274  5516 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.545816  5516 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.547302  5314 raft_consensus.cc:359] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.547640  5313 raft_consensus.cc:359] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.548082  5314 raft_consensus.cc:385] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.548394  5314 raft_consensus.cc:740] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.548628  5516 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:50.548301  5313 raft_consensus.cc:385] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.549165  5319 raft_consensus.cc:493] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.549249  5313 raft_consensus.cc:740] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.549288  5314 consensus_queue.cc:260] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.550391  5313 consensus_queue.cc:260] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.550748  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:50.551313  5198 raft_consensus.cc:2468] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 0.
I20260709 12:12:50.552129  5314 ts_tablet_manager.cc:1434] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:12:50.552871  5313 ts_tablet_manager.cc:1434] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:12:50.553143  5314 tablet_bootstrap.cc:492] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
I20260709 12:12:50.553022  5319 raft_consensus.cc:515] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.554215  5313 tablet_bootstrap.cc:492] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
I20260709 12:12:50.556119  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:50.556962  5122 raft_consensus.cc:2393] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 1: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:12:50.558624  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:50.560148  5314 tablet_bootstrap.cc:654] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.560669  5313 tablet_bootstrap.cc:654] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.560679  5332 raft_consensus.cc:493] T d8dc93d0992c4324872c6aab5aa9db8c P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.562096  5332 raft_consensus.cc:515] T d8dc93d0992c4324872c6aab5aa9db8c P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.565023  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:50.569571  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:50.572456  5237 leader_election.cc:304] T d8dc93d0992c4324872c6aab5aa9db8c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:12:50.578006  5524 raft_consensus.cc:2749] T d8dc93d0992c4324872c6aab5aa9db8c P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:50.578752  5332 leader_election.cc:290] T d8dc93d0992c4324872c6aab5aa9db8c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:50.580451  5313 tablet_bootstrap.cc:492] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:50.581002  5314 tablet_bootstrap.cc:492] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:50.581058  5313 ts_tablet_manager.cc:1403] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.010s
I20260709 12:12:50.581719  5314 ts_tablet_manager.cc:1403] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.004s
I20260709 12:12:50.585047  5314 raft_consensus.cc:359] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.585891  5314 raft_consensus.cc:385] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.586200  5314 raft_consensus.cc:740] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.584185  5313 raft_consensus.cc:359] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.588402  5313 raft_consensus.cc:385] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.588775  5313 raft_consensus.cc:740] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.589731  5314 consensus_queue.cc:260] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.589725  5313 consensus_queue.cc:260] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.592675  5314 ts_tablet_manager.cc:1434] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:12:50.593430  5313 ts_tablet_manager.cc:1434] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.005s
I20260709 12:12:50.593902  5314 tablet_bootstrap.cc:492] T 9212b0f778ec4455b8054add86b66d78 P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
I20260709 12:12:50.594587  5313 tablet_bootstrap.cc:492] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
I20260709 12:12:50.595633  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:50.596467  5272 raft_consensus.cc:2393] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 1: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:12:50.598122  5163 leader_election.cc:304] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:12:50.599996  5543 raft_consensus.cc:3060] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:50.588812  5088 leader_election.cc:343] T 20ba878da4e3492fbdf2f90c6bb202c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:50.603116  5319 leader_election.cc:290] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:50.608256  5313 tablet_bootstrap.cc:654] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.610285  5543 raft_consensus.cc:2749] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:50.610926  5516 consensus_queue.cc:1048] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:50.611240  5088 leader_election.cc:304] T 20ba878da4e3492fbdf2f90c6bb202c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:12:50.613351  5314 tablet_bootstrap.cc:654] T 9212b0f778ec4455b8054add86b66d78 P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.613561  5359 raft_consensus.cc:2804] T 20ba878da4e3492fbdf2f90c6bb202c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:50.614257  5359 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:50.614722  5359 raft_consensus.cc:3060] T 20ba878da4e3492fbdf2f90c6bb202c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.620334  5553 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.620908  5553 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.622651  5359 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.623333  5553 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:50.625416  5314 tablet_bootstrap.cc:492] T 9212b0f778ec4455b8054add86b66d78 P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:50.625950  5314 ts_tablet_manager.cc:1403] T 9212b0f778ec4455b8054add86b66d78 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.005s
I20260709 12:12:50.629149  5314 raft_consensus.cc:359] T 9212b0f778ec4455b8054add86b66d78 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.629942  5314 raft_consensus.cc:385] T 9212b0f778ec4455b8054add86b66d78 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.630252  5314 raft_consensus.cc:740] T 9212b0f778ec4455b8054add86b66d78 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.631073  5314 consensus_queue.cc:260] T 9212b0f778ec4455b8054add86b66d78 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.634049  5314 ts_tablet_manager.cc:1434] T 9212b0f778ec4455b8054add86b66d78 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:12:50.635141  5314 tablet_bootstrap.cc:492] T 56627990da7d49f7a12669f23294a596 P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
I20260709 12:12:50.639488  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:12:50.640137  5198 raft_consensus.cc:3060] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.646654  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:50.647473  5273 raft_consensus.cc:2468] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 0.
I20260709 12:12:50.648957  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:50.650781  5314 tablet_bootstrap.cc:654] T 56627990da7d49f7a12669f23294a596 P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.663017  5122 raft_consensus.cc:1240] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:50.665496  5198 raft_consensus.cc:2468] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 1.
I20260709 12:12:50.669553  5454 consensus_queue.cc:1059] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:50.670358  5454 consensus_queue.cc:1243] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer ad2f9a1e2f7a45429fa69fd23d09f821 log is divergent from this leader: its last log entry 2.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260709 12:12:50.671079  5454 raft_consensus.cc:3055] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:50.671510  5454 raft_consensus.cc:740] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:12:50.672385  5454 consensus_queue.cc:260] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.689838  5454 raft_consensus.cc:3060] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:50.714469  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:12:50.715209  5088 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:12:50.716063  5553 raft_consensus.cc:2804] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:50.716444  5553 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:50.716475  5088 leader_election.cc:343] T 20ba878da4e3492fbdf2f90c6bb202c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:50.716897  5553 raft_consensus.cc:3060] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.625072  5359 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:50.733567  5543 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.734254  5543 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.739437  5319 raft_consensus.cc:493] T 9212b0f778ec4455b8054add86b66d78 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.740175  5319 raft_consensus.cc:515] T 9212b0f778ec4455b8054add86b66d78 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.742368  5319 leader_election.cc:290] T 9212b0f778ec4455b8054add86b66d78 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:50.744344  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:50.745489  5543 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:50.746541  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:50.747041  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:12:50.746264  5166 leader_election.cc:343] T 9212b0f778ec4455b8054add86b66d78 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:50.749680  5166 leader_election.cc:343] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:50.750289  5163 leader_election.cc:343] T 9212b0f778ec4455b8054add86b66d78 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:50.752630  5163 leader_election.cc:304] T 9212b0f778ec4455b8054add86b66d78 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:12:50.754069  5543 raft_consensus.cc:2749] T 9212b0f778ec4455b8054add86b66d78 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:12:50.760391  5088 leader_election.cc:343] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:50.761344  5088 leader_election.cc:304] T 20ba878da4e3492fbdf2f90c6bb202c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:12:50.762082  5360 raft_consensus.cc:2804] T 20ba878da4e3492fbdf2f90c6bb202c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:50.762568  5360 raft_consensus.cc:697] T 20ba878da4e3492fbdf2f90c6bb202c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:12:50.763288  5360 consensus_queue.cc:237] T 20ba878da4e3492fbdf2f90c6bb202c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.771091  5314 tablet_bootstrap.cc:492] T 56627990da7d49f7a12669f23294a596 P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:50.771659  5314 ts_tablet_manager.cc:1403] T 56627990da7d49f7a12669f23294a596 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.137s	user 0.049s	sys 0.029s
I20260709 12:12:50.771231  5553 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.773597  5553 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:50.783922  5313 tablet_bootstrap.cc:492] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:50.744318  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:50.784879  5316 tablet_bootstrap.cc:492] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
I20260709 12:12:50.783444  5314 raft_consensus.cc:359] T 56627990da7d49f7a12669f23294a596 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.785353  5273 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 0.
I20260709 12:12:50.785653  5313 ts_tablet_manager.cc:1403] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.191s	user 0.028s	sys 0.066s
I20260709 12:12:50.783316  5023 catalog_manager.cc:5697] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 1 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:50.787535  5314 raft_consensus.cc:385] T 56627990da7d49f7a12669f23294a596 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.787824  5314 raft_consensus.cc:740] T 56627990da7d49f7a12669f23294a596 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.788468  5314 consensus_queue.cc:260] T 56627990da7d49f7a12669f23294a596 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.791069  5314 ts_tablet_manager.cc:1434] T 56627990da7d49f7a12669f23294a596 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:12:50.791173  5313 raft_consensus.cc:359] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.791917  5313 raft_consensus.cc:385] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.792060  5314 tablet_bootstrap.cc:492] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
I20260709 12:12:50.792208  5313 raft_consensus.cc:740] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.795831  5339 raft_consensus.cc:493] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.795665  5313 consensus_queue.cc:260] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.796378  5339 raft_consensus.cc:515] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.776698  5543 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.797704  5543 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.799729  5313 ts_tablet_manager.cc:1434] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.002s
I20260709 12:12:50.799880  5543 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:50.800395  5314 tablet_bootstrap.cc:654] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.802590  5313 tablet_bootstrap.cc:492] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
I20260709 12:12:50.802400  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:50.785415  5316 ts_tablet_manager.cc:1403] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.310s	user 0.089s	sys 0.103s
I20260709 12:12:50.804443  5122 raft_consensus.cc:2468] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 0.
I20260709 12:12:50.806818  5316 raft_consensus.cc:359] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.807565  5316 raft_consensus.cc:385] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.807843  5316 raft_consensus.cc:740] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.806773  5166 leader_election.cc:304] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:12:50.803992  5339 leader_election.cc:290] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:50.810272  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:12:50.811681  5166 leader_election.cc:343] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:50.809185  5377 raft_consensus.cc:2804] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:50.812434  5377 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:50.812829  5377 raft_consensus.cc:3060] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.814728  5553 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.815224  5553 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.809281  5313 tablet_bootstrap.cc:654] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.817638  5553 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:50.819450  5540 raft_consensus.cc:493] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.819936  5540 raft_consensus.cc:515] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.820535  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:12:50.821749  5088 leader_election.cc:343] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:50.822222  5540 leader_election.cc:290] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:50.823019  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:12:50.823866  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:12:50.825143  5088 leader_election.cc:343] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:50.825510  5240 leader_election.cc:343] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:50.827751  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:50.830276  5314 tablet_bootstrap.cc:492] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:50.808446  5316 consensus_queue.cc:260] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.832592  5314 ts_tablet_manager.cc:1403] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.041s	user 0.016s	sys 0.003s
I20260709 12:12:50.834300  5163 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:12:50.835093  5319 raft_consensus.cc:2804] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:50.835415  5319 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:50.835731  5319 raft_consensus.cc:3060] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.837679  5316 ts_tablet_manager.cc:1434] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 12:12:50.838362  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:50.840193  5316 tablet_bootstrap.cc:492] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
I20260709 12:12:50.840771  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:50.843379  5332 consensus_queue.cc:1048] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:50.846884  5271 raft_consensus.cc:1275] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 12:12:50.847261  5271 pending_rounds.cc:85] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929: Aborting all ops after (but not including) 0
I20260709 12:12:50.847574  5271 pending_rounds.cc:107] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:12:50.847868  5271 raft_consensus.cc:2889] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:50.850142  5313 tablet_bootstrap.cc:492] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:50.850598  5313 ts_tablet_manager.cc:1403] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.048s	user 0.012s	sys 0.002s
I20260709 12:12:50.844713  5314 raft_consensus.cc:359] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.845885  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:12:50.851620  5314 raft_consensus.cc:385] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.851758  5273 raft_consensus.cc:3060] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.851930  5314 raft_consensus.cc:740] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.852372  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:50.853044  5270 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 0.
W20260709 12:12:50.854775  5237 leader_election.cc:343] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:50.855237  5237 leader_election.cc:304] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:12:50.856268  5332 raft_consensus.cc:2749] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:50.857504  5314 consensus_queue.cc:260] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.858603  5273 raft_consensus.cc:2468] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 1.
I20260709 12:12:50.859315  5319 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.861193  5313 raft_consensus.cc:359] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.862128  5313 raft_consensus.cc:385] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:12:50.862154  5163 leader_election.cc:343] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:50.862509  5313 raft_consensus.cc:740] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.859763  5314 ts_tablet_manager.cc:1434] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.000s
I20260709 12:12:50.863852  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:12:50.864041  5313 consensus_queue.cc:260] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.864668  5314 tablet_bootstrap.cc:492] T 9f927a751b4041e99eb5ac25ddf214ec P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
W20260709 12:12:50.865274  5166 leader_election.cc:343] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:50.866802  5359 consensus_queue.cc:1048] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:12:50.865278  5163 leader_election.cc:343] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:50.866307  5313 ts_tablet_manager.cc:1434] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:12:50.868371  5163 leader_election.cc:304] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:12:50.869041  5313 tablet_bootstrap.cc:492] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
I20260709 12:12:50.870353  5543 raft_consensus.cc:2749] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:50.864800  5377 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.876556  5319 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:50.880888  5088 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:12:50.882251  5313 tablet_bootstrap.cc:654] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.882150  5088 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:12:50.883795  5553 raft_consensus.cc:2804] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:50.883623  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:12:50.886336  5360 raft_consensus.cc:493] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.886731  5360 raft_consensus.cc:515] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.887749  5022 catalog_manager.cc:5697] T 20ba878da4e3492fbdf2f90c6bb202c4 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 1 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:50.891189  5360 leader_election.cc:290] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:50.886022  5553 raft_consensus.cc:697] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:12:50.885183  5359 raft_consensus.cc:2804] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:50.896130  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:50.896256  5553 consensus_queue.cc:237] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.896823  5273 raft_consensus.cc:2468] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 0.
I20260709 12:12:50.892560  5591 raft_consensus.cc:493] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.898900  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:50.898626  5591 raft_consensus.cc:515] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.891964  5271 raft_consensus.cc:3060] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.901135  5088 leader_election.cc:304] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:12:50.903164  5360 raft_consensus.cc:2804] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:50.903497  5360 raft_consensus.cc:493] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:50.903746  5360 raft_consensus.cc:3060] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.904791  5319 raft_consensus.cc:493] T 56627990da7d49f7a12669f23294a596 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.894373  5359 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:50.909489  5359 raft_consensus.cc:3060] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.905303  5319 raft_consensus.cc:515] T 56627990da7d49f7a12669f23294a596 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.917265  5319 leader_election.cc:290] T 56627990da7d49f7a12669f23294a596 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:12:50.917865  5088 leader_election.cc:343] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:50.904255  5377 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:50.922753  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:12:50.923101  5591 leader_election.cc:290] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:50.928117  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:50.932365  5270 raft_consensus.cc:2468] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 0.
I20260709 12:12:50.934587  5088 leader_election.cc:304] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:12:50.940693  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:50.941459  5273 raft_consensus.cc:2468] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 0.
W20260709 12:12:50.928436  5163 leader_election.cc:343] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:50.942555  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:12:50.943149  5123 raft_consensus.cc:3060] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.944260  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:50.949235  5516 raft_consensus.cc:2804] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:50.952636  5516 raft_consensus.cc:493] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:50.953008  5516 raft_consensus.cc:3060] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.955332  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:50.955981  5200 raft_consensus.cc:2468] T 56627990da7d49f7a12669f23294a596 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 0.
I20260709 12:12:50.956288  5377 consensus_queue.cc:1048] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:50.961908  5360 raft_consensus.cc:515] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.967015  5123 raft_consensus.cc:2468] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 1.
I20260709 12:12:50.967760  5360 leader_election.cc:290] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:50.969832  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:12:50.974431  5359 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.976150  5540 consensus_queue.cc:1048] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:50.976572  5359 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:50.979144  5316 tablet_bootstrap.cc:654] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:50.981637  5088 leader_election.cc:343] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:50.983902  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:12:50.984067  5270 raft_consensus.cc:3060] T d8dc93d0992c4324872c6aab5aa9db8c P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.988018  5516 raft_consensus.cc:515] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.989559  5121 raft_consensus.cc:2393] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 1: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:12:50.989857  5166 leader_election.cc:304] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:12:50.991786  5377 raft_consensus.cc:2804] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:50.992972  5377 raft_consensus.cc:697] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:12:50.993888  5377 consensus_queue.cc:237] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:50.994522  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:12:50.995138  5273 raft_consensus.cc:3060] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.990895  5271 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 1.
I20260709 12:12:50.998957  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
W20260709 12:12:50.998205  5088 leader_election.cc:343] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:51.005666  5272 raft_consensus.cc:3060] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:51.011080  5516 leader_election.cc:290] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:51.013087  5022 catalog_manager.cc:5697] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 1 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:51.044229  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:12:51.044883  5274 raft_consensus.cc:3060] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:51.005611  5163 leader_election.cc:304] T 56627990da7d49f7a12669f23294a596 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:12:51.049198  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 47686.9us
I20260709 12:12:51.049990  5273 raft_consensus.cc:2468] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 1.
I20260709 12:12:51.050359  5163 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:12:51.051134  5339 raft_consensus.cc:2804] T 56627990da7d49f7a12669f23294a596 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:51.051484  5339 raft_consensus.cc:493] T 56627990da7d49f7a12669f23294a596 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:51.051820  5339 raft_consensus.cc:3060] T 56627990da7d49f7a12669f23294a596 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:51.054162  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:12:51.057299  5319 raft_consensus.cc:2804] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:51.060216  5543 consensus_queue.cc:1048] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:51.081295  5319 raft_consensus.cc:697] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:12:51.103197  5274 raft_consensus.cc:2468] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 1.
I20260709 12:12:51.117784  5200 raft_consensus.cc:3060] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:51.118315  5272 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 1.
I20260709 12:12:51.149657  5313 tablet_bootstrap.cc:492] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:51.150015  5314 tablet_bootstrap.cc:654] T 9f927a751b4041e99eb5ac25ddf214ec P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.150148  5313 ts_tablet_manager.cc:1403] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.281s	user 0.017s	sys 0.023s
I20260709 12:12:51.088136  5319 consensus_queue.cc:237] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:12:51.150614  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 100344us
I20260709 12:12:51.174747  5316 tablet_bootstrap.cc:492] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
I20260709 12:12:51.175261  5316 ts_tablet_manager.cc:1403] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.335s	user 0.024s	sys 0.017s
I20260709 12:12:51.176280  5313 raft_consensus.cc:359] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:51.177542  5313 raft_consensus.cc:385] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.177842  5313 raft_consensus.cc:740] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.179296  5313 consensus_queue.cc:260] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:51.182207  5313 ts_tablet_manager.cc:1434] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.005s
I20260709 12:12:51.183219  5313 tablet_bootstrap.cc:492] T 89852cae0bd14fd8be73b84dc4a49b2a P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
I20260709 12:12:51.189043  5088 leader_election.cc:304] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:12:51.191944  5360 raft_consensus.cc:2804] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:51.192401  5360 raft_consensus.cc:697] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:12:51.193179  5360 consensus_queue.cc:237] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:51.177199  5339 raft_consensus.cc:515] T 56627990da7d49f7a12669f23294a596 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:51.197127  5198 raft_consensus.cc:2393] T 56627990da7d49f7a12669f23294a596 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 1: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:12:51.198796  5088 leader_election.cc:304] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:12:51.208834  5313 tablet_bootstrap.cc:654] T 89852cae0bd14fd8be73b84dc4a49b2a P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.214728  5604 raft_consensus.cc:493] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.221801  5604 raft_consensus.cc:515] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:51.213316  5339 leader_election.cc:290] T 56627990da7d49f7a12669f23294a596 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:51.216226  5553 raft_consensus.cc:2804] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:51.238478  5088 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:12:51.238466  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:12:51.242452  5270 raft_consensus.cc:2393] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 1: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:12:51.243115  5359 raft_consensus.cc:2804] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:51.243628  5359 raft_consensus.cc:697] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:12:51.246394  5359 consensus_queue.cc:237] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:51.254559  5360 consensus_queue.cc:1048] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:51.263497  5314 tablet_bootstrap.cc:492] T 9f927a751b4041e99eb5ac25ddf214ec P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:51.264092  5314 ts_tablet_manager.cc:1403] T 9f927a751b4041e99eb5ac25ddf214ec P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.400s	user 0.015s	sys 0.011s
I20260709 12:12:51.238668  5553 raft_consensus.cc:697] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:12:51.273406  5553 consensus_queue.cc:237] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:51.275821  5608 raft_consensus.cc:493] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.277247  5316 raft_consensus.cc:359] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:51.278023  5316 raft_consensus.cc:385] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.278324  5316 raft_consensus.cc:740] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.282102  5316 consensus_queue.cc:260] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:51.282663  5314 raft_consensus.cc:359] T 9f927a751b4041e99eb5ac25ddf214ec P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:51.283712  5314 raft_consensus.cc:385] T 9f927a751b4041e99eb5ac25ddf214ec P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.284176  5314 raft_consensus.cc:740] T 9f927a751b4041e99eb5ac25ddf214ec P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.284982  5314 consensus_queue.cc:260] T 9f927a751b4041e99eb5ac25ddf214ec P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:51.288314  5198 raft_consensus.cc:1275] T 88f51ae73df747849e2f3cd63547a1d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20260709 12:12:51.294844  5088 consensus_peers.cc:597] T 20ba878da4e3492fbdf2f90c6bb202c4 P ad2f9a1e2f7a45429fa69fd23d09f821 -> Peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Couldn't send request to peer 9e794b72ed7640219f90ec4232363929. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:51.299196  5316 ts_tablet_manager.cc:1434] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.124s	user 0.007s	sys 0.000s
I20260709 12:12:51.300392  5316 tablet_bootstrap.cc:492] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
I20260709 12:12:51.276381  5608 raft_consensus.cc:515] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:51.309083  5608 leader_election.cc:290] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:51.321520  5314 ts_tablet_manager.cc:1434] T 9f927a751b4041e99eb5ac25ddf214ec P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.057s	user 0.010s	sys 0.000s
I20260709 12:12:51.325903  5314 tablet_bootstrap.cc:492] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
I20260709 12:12:51.313854  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:51.325776  5608 consensus_queue.cc:1048] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:12:51.303223  5610 consensus_queue.cc:1048] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260709 12:12:51.332499  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:51.356863  5313 tablet_bootstrap.cc:492] T 89852cae0bd14fd8be73b84dc4a49b2a P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:51.357508  5313 ts_tablet_manager.cc:1403] T 89852cae0bd14fd8be73b84dc4a49b2a P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.174s	user 0.024s	sys 0.022s
I20260709 12:12:51.369453  5195 raft_consensus.cc:2468] T 9212b0f778ec4455b8054add86b66d78 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 0.
I20260709 12:12:51.371404  5604 leader_election.cc:290] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:51.437613  5313 raft_consensus.cc:359] T 89852cae0bd14fd8be73b84dc4a49b2a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:51.438159  5313 raft_consensus.cc:385] T 89852cae0bd14fd8be73b84dc4a49b2a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.438400  5313 raft_consensus.cc:740] T 89852cae0bd14fd8be73b84dc4a49b2a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.439401  5313 consensus_queue.cc:260] T 89852cae0bd14fd8be73b84dc4a49b2a P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:12:51.424837  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 43647.4us
I20260709 12:12:51.478925  5088 leader_election.cc:304] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:12:51.482343  5360 raft_consensus.cc:2804] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:12:51.482460  5088 leader_election.cc:343] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:51.482730  5360 raft_consensus.cc:493] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:51.483039  5360 raft_consensus.cc:3060] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:51.490192  5313 ts_tablet_manager.cc:1434] T 89852cae0bd14fd8be73b84dc4a49b2a P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.132s	user 0.003s	sys 0.005s
I20260709 12:12:51.494050  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:51.499840  5360 raft_consensus.cc:515] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:51.501817  5603 raft_consensus.cc:493] T 9f927a751b4041e99eb5ac25ddf214ec P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.502342  5603 raft_consensus.cc:515] T 9f927a751b4041e99eb5ac25ddf214ec P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:51.504133  5360 leader_election.cc:290] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:51.506171  5603 leader_election.cc:290] T 9f927a751b4041e99eb5ac25ddf214ec P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:12:51.509665  5163 consensus_peers.cc:597] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Couldn't send request to peer 9e794b72ed7640219f90ec4232363929. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:51.510713  5316 tablet_bootstrap.cc:654] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.509467  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:51.517529  5273 raft_consensus.cc:2393] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 1: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:12:51.526547  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:12:51.529673  5313 tablet_bootstrap.cc:492] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
I20260709 12:12:51.540532  5313 tablet_bootstrap.cc:654] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.541770  5359 consensus_queue.cc:1048] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
W20260709 12:12:51.549329  5088 consensus_peers.cc:597] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:51.548012  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:12:51.552117  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:12:51.552471  5071 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:51.557910  5316 tablet_bootstrap.cc:492] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
I20260709 12:12:51.558432  5316 ts_tablet_manager.cc:1403] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.258s	user 0.024s	sys 0.017s
I20260709 12:12:51.560895  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:51.561187  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:12:51.562085  5166 leader_election.cc:304] T 56627990da7d49f7a12669f23294a596 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:12:51.562263  5591 consensus_queue.cc:1048] T 20ba878da4e3492fbdf2f90c6bb202c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:12:51.562709  5088 leader_election.cc:343] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:51.563647  5197 raft_consensus.cc:3060] T 9212b0f778ec4455b8054add86b66d78 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:51.563692  5319 raft_consensus.cc:2749] T 56627990da7d49f7a12669f23294a596 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:12:51.565910  5023 catalog_manager.cc:5697] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 1 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:51.567365  5023 catalog_manager.cc:5697] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 1 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:51.568735  5023 catalog_manager.cc:5697] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 1 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:51.573696  5314 tablet_bootstrap.cc:654] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.576386  5166 leader_election.cc:304] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:12:51.577997  5339 raft_consensus.cc:2749] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:51.580188  5166 leader_election.cc:304] T 9f927a751b4041e99eb5ac25ddf214ec P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:12:51.581014  5339 raft_consensus.cc:3060] T 9f927a751b4041e99eb5ac25ddf214ec P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:51.589538  5316 raft_consensus.cc:359] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:51.590297  5316 raft_consensus.cc:385] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.590564  5316 raft_consensus.cc:740] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.591208  5316 consensus_queue.cc:260] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:51.593549  5316 ts_tablet_manager.cc:1434] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.002s
I20260709 12:12:51.594470  5316 tablet_bootstrap.cc:492] T 8d081e937c2741c9b646839e29e5599f P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
I20260709 12:12:51.599807  5022 catalog_manager.cc:5697] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 0 to 1, leader changed from <none> to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 1 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:51.600703  5540 raft_consensus.cc:493] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.601234  5339 raft_consensus.cc:2749] T 9f927a751b4041e99eb5ac25ddf214ec P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:12:51.607904  5628 log.cc:927] Time spent T 88f51ae73df747849e2f3cd63547a1d0 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:12:51.602324  5540 raft_consensus.cc:515] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:51.602311  5022 catalog_manager.cc:5697] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 0 to 1, leader changed from <none> to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 1 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:51.614085  5339 consensus_queue.cc:1048] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:51.614980  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:51.616977  5197 raft_consensus.cc:2468] T 9212b0f778ec4455b8054add86b66d78 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 1.
W20260709 12:12:51.617183  5237 leader_election.cc:343] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:51.616189  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:51.612398  5540 leader_election.cc:290] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:51.623003  5088 leader_election.cc:304] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:12:51.624068  5591 raft_consensus.cc:2804] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:51.624563  5591 raft_consensus.cc:697] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:12:51.625423  5591 consensus_queue.cc:237] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:12:51.629243  5240 leader_election.cc:343] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:51.629765  5240 leader_election.cc:304] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:12:51.630985  5540 raft_consensus.cc:2749] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:51.635120  5615 consensus_queue.cc:1048] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:51.638420  5314 tablet_bootstrap.cc:492] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:51.638924  5314 ts_tablet_manager.cc:1403] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.314s	user 0.005s	sys 0.010s
W20260709 12:12:51.647411  5166 consensus_peers.cc:597] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:51.651873  5316 tablet_bootstrap.cc:654] T 8d081e937c2741c9b646839e29e5599f P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.656749  5314 raft_consensus.cc:359] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:51.657557  5314 raft_consensus.cc:385] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.657833  5314 raft_consensus.cc:740] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.659698  5313 tablet_bootstrap.cc:492] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:51.660132  5313 ts_tablet_manager.cc:1403] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.131s	user 0.005s	sys 0.009s
I20260709 12:12:51.673151  5598 consensus_queue.cc:1048] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:51.673539  5314 consensus_queue.cc:260] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:51.690747  5313 raft_consensus.cc:359] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:51.693085  5314 ts_tablet_manager.cc:1434] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.054s	user 0.011s	sys 0.000s
I20260709 12:12:51.694131  5314 tablet_bootstrap.cc:492] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
I20260709 12:12:51.693742  5598 consensus_queue.cc:1048] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:12:51.700382  5313 raft_consensus.cc:385] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.700706  5313 raft_consensus.cc:740] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.701323  5313 consensus_queue.cc:260] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:51.704717  5313 ts_tablet_manager.cc:1434] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 12:12:51.706099  5313 tablet_bootstrap.cc:492] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
I20260709 12:12:51.710179  5314 tablet_bootstrap.cc:654] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.711962  5313 tablet_bootstrap.cc:654] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:51.712574  5088 consensus_peers.cc:597] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:51.721032  5543 consensus_queue.cc:1048] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:51.723891  5316 tablet_bootstrap.cc:492] T 8d081e937c2741c9b646839e29e5599f P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
I20260709 12:12:51.724370  5316 ts_tablet_manager.cc:1403] T 8d081e937c2741c9b646839e29e5599f P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.130s	user 0.012s	sys 0.003s
I20260709 12:12:51.726996  5316 raft_consensus.cc:359] T 8d081e937c2741c9b646839e29e5599f P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:51.727674  5316 raft_consensus.cc:385] T 8d081e937c2741c9b646839e29e5599f P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.727957  5316 raft_consensus.cc:740] T 8d081e937c2741c9b646839e29e5599f P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.728572  5316 consensus_queue.cc:260] T 8d081e937c2741c9b646839e29e5599f P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:51.730252  5316 ts_tablet_manager.cc:1434] T 8d081e937c2741c9b646839e29e5599f P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:12:51.731201  5316 tablet_bootstrap.cc:492] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
I20260709 12:12:51.749011  5021 catalog_manager.cc:5697] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 1 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:51.759831  5316 tablet_bootstrap.cc:654] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.762562  5314 tablet_bootstrap.cc:492] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:51.763072  5314 ts_tablet_manager.cc:1403] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.069s	user 0.012s	sys 0.004s
I20260709 12:12:51.767501  5313 tablet_bootstrap.cc:492] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:51.767616  5360 consensus_queue.cc:1048] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:51.768249  5313 ts_tablet_manager.cc:1403] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.062s	user 0.009s	sys 0.007s
I20260709 12:12:51.773515  5314 raft_consensus.cc:359] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:51.774349  5314 raft_consensus.cc:385] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.774724  5314 raft_consensus.cc:740] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.775395  5314 consensus_queue.cc:260] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:51.780009  5314 ts_tablet_manager.cc:1434] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 12:12:51.780297  5316 tablet_bootstrap.cc:492] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
I20260709 12:12:51.781116  5316 ts_tablet_manager.cc:1403] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.050s	user 0.009s	sys 0.002s
I20260709 12:12:51.781622  5314 tablet_bootstrap.cc:492] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
I20260709 12:12:51.783795  5316 raft_consensus.cc:359] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:51.784495  5316 raft_consensus.cc:385] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.784754  5316 raft_consensus.cc:740] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.785422  5316 consensus_queue.cc:260] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:51.787797  5316 ts_tablet_manager.cc:1434] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:12:51.788687  5314 tablet_bootstrap.cc:654] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.788808  5316 tablet_bootstrap.cc:492] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
I20260709 12:12:51.792213  5591 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.801867  5591 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:51.794656  5313 raft_consensus.cc:359] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:51.795058  5543 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.804119  5313 raft_consensus.cc:385] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.804262  5543 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:51.806169  5313 raft_consensus.cc:740] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.806854  5313 consensus_queue.cc:260] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:51.807853  5543 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:51.808012  5316 tablet_bootstrap.cc:654] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.805735  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:51.808893  5313 ts_tablet_manager.cc:1434] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.000s
I20260709 12:12:51.809085  5200 raft_consensus.cc:2468] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 0.
I20260709 12:12:51.809584  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:51.809867  5313 tablet_bootstrap.cc:492] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
I20260709 12:12:51.810232  5122 raft_consensus.cc:2468] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 0.
I20260709 12:12:51.810768  5088 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:12:51.811344  5166 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:12:51.811851  5610 raft_consensus.cc:2804] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:51.812240  5610 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:51.812579  5610 raft_consensus.cc:3060] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:51.813086  5319 raft_consensus.cc:2804] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:51.813493  5319 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:51.813795  5319 raft_consensus.cc:3060] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:51.814451  5591 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:51.820429  5313 tablet_bootstrap.cc:654] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.822431  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:51.823107  5270 raft_consensus.cc:2468] T 8d081e937c2741c9b646839e29e5599f P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 0.
I20260709 12:12:51.823565  5319 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:51.826428  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:12:51.828420  5610 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:51.829504  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:51.832542  5273 raft_consensus.cc:2468] T 8d081e937c2741c9b646839e29e5599f P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 0.
I20260709 12:12:51.835776  5332 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.837791  5332 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:51.839375  5610 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:51.839973  5332 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:51.836143  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:12:51.840837  5270 raft_consensus.cc:3060] T 8d081e937c2741c9b646839e29e5599f P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:51.842003  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:12:51.843847  5240 leader_election.cc:343] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:51.853991  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:51.857543  5360 consensus_queue.cc:1048] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:51.864116  5316 tablet_bootstrap.cc:492] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
I20260709 12:12:51.864648  5316 ts_tablet_manager.cc:1403] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.076s	user 0.019s	sys 0.014s
I20260709 12:12:51.864630  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:12:51.867792  5122 raft_consensus.cc:2393] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 1: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
W20260709 12:12:51.867969  5237 leader_election.cc:343] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:51.868527  5237 leader_election.cc:304] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:12:51.869750  5319 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:51.869910  5332 raft_consensus.cc:2749] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:51.859385  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:12:51.872267  5200 raft_consensus.cc:2393] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 1: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:12:51.872182  5316 raft_consensus.cc:359] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:51.872792  5332 raft_consensus.cc:493] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.872850  5316 raft_consensus.cc:385] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.873121  5270 raft_consensus.cc:2468] T 8d081e937c2741c9b646839e29e5599f P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 1.
I20260709 12:12:51.873368  5332 raft_consensus.cc:515] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:51.874338  5088 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:12:51.875777  5360 raft_consensus.cc:2804] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:51.876245  5360 raft_consensus.cc:697] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:12:51.876981  5360 consensus_queue.cc:237] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:51.877321  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:51.877815  5166 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:12:51.877979  5122 raft_consensus.cc:2468] T 89852cae0bd14fd8be73b84dc4a49b2a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 0.
I20260709 12:12:51.881274  5240 leader_election.cc:304] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:12:51.881592  5543 raft_consensus.cc:2749] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:12:51.882090  5603 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.882272  5540 raft_consensus.cc:2804] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:51.882682  5540 raft_consensus.cc:493] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:51.883004  5540 raft_consensus.cc:3060] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:51.884441  5603 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:51.886493  5314 tablet_bootstrap.cc:492] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:51.886603  5603 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:51.887080  5314 ts_tablet_manager.cc:1403] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.106s	user 0.029s	sys 0.011s
I20260709 12:12:51.873342  5316 raft_consensus.cc:740] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.888829  5316 consensus_queue.cc:260] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:51.890606  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:51.892969  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:51.893304  5314 raft_consensus.cc:359] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:51.894011  5314 raft_consensus.cc:385] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.893707  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:51.894296  5314 raft_consensus.cc:740] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.894511  5316 ts_tablet_manager.cc:1434] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.029s	user 0.003s	sys 0.003s
I20260709 12:12:51.894833  5332 leader_election.cc:290] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:51.894658  5200 raft_consensus.cc:2468] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 0.
I20260709 12:12:51.901293  5316 tablet_bootstrap.cc:492] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
I20260709 12:12:51.894966  5314 consensus_queue.cc:260] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:51.905572  5314 ts_tablet_manager.cc:1434] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.018s	user 0.012s	sys 0.000s
I20260709 12:12:51.906800  5166 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:12:51.907951  5319 raft_consensus.cc:2749] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:51.908044  5540 raft_consensus.cc:515] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:51.909024  5314 tablet_bootstrap.cc:492] T 3db164e3a1ce4a43b0a112a777118daa P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
I20260709 12:12:51.913069  5540 leader_election.cc:290] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:51.913765  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:12:51.919421  5122 raft_consensus.cc:3060] T 89852cae0bd14fd8be73b84dc4a49b2a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:51.920485  5316 tablet_bootstrap.cc:654] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:51.926153  5319 raft_consensus.cc:493] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.926256  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:12:51.926990  5200 raft_consensus.cc:3060] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:51.926709  5319 raft_consensus.cc:515] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:51.929394  5319 leader_election.cc:290] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:51.930074  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:51.930841  5270 raft_consensus.cc:2468] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 0.
I20260709 12:12:51.931927  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:51.934324  5313 tablet_bootstrap.cc:492] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:51.934641  5198 raft_consensus.cc:3060] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:51.934798  5313 ts_tablet_manager.cc:1403] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.125s	user 0.033s	sys 0.011s
I20260709 12:12:51.933704  5163 leader_election.cc:304] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:12:51.940892  5603 raft_consensus.cc:2804] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:51.941215  5603 raft_consensus.cc:493] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:51.941519  5603 raft_consensus.cc:3060] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:51.943089  5200 raft_consensus.cc:2468] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 1.
W20260709 12:12:51.947551  5166 leader_election.cc:343] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:51.944376  5237 leader_election.cc:304] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:12:51.949021  5332 raft_consensus.cc:2804] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:51.949494  5332 raft_consensus.cc:697] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:12:51.950095  5332 consensus_queue.cc:237] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:51.952728  5603 raft_consensus.cc:515] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:51.955495  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:12:51.939873  5021 catalog_manager.cc:5697] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 1 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:51.967625  5603 leader_election.cc:290] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:51.969836  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:12:51.970436  5273 raft_consensus.cc:3060] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:51.977329  5166 leader_election.cc:343] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:51.979661  5273 raft_consensus.cc:2468] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 1.
I20260709 12:12:51.980921  5122 raft_consensus.cc:2468] T 89852cae0bd14fd8be73b84dc4a49b2a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 1.
I20260709 12:12:51.982443  5163 leader_election.cc:304] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:12:51.983644  5313 raft_consensus.cc:359] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:51.986078  5603 raft_consensus.cc:2804] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:51.986800  5316 tablet_bootstrap.cc:492] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
I20260709 12:12:51.987270  5316 ts_tablet_manager.cc:1403] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.086s	user 0.007s	sys 0.006s
I20260709 12:12:51.986755  5603 raft_consensus.cc:697] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:12:51.988700  5603 consensus_queue.cc:237] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:51.989521  5313 raft_consensus.cc:385] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.995913  5313 raft_consensus.cc:740] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.996592  5313 consensus_queue.cc:260] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:51.989270  5021 catalog_manager.cc:5697] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 1 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:52.011212  5314 tablet_bootstrap.cc:654] T 3db164e3a1ce4a43b0a112a777118daa P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.013677  5313 ts_tablet_manager.cc:1434] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.079s	user 0.010s	sys 0.005s
I20260709 12:12:52.013974  5316 raft_consensus.cc:359] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:52.014734  5316 raft_consensus.cc:385] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.014822  5313 tablet_bootstrap.cc:492] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
I20260709 12:12:52.015074  5316 raft_consensus.cc:740] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.016206  5615 raft_consensus.cc:493] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.016731  5615 raft_consensus.cc:515] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:52.022178  5316 consensus_queue.cc:260] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:52.023164  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:52.023803  5197 raft_consensus.cc:2468] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 1.
I20260709 12:12:52.024392  5316 ts_tablet_manager.cc:1434] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.001s
I20260709 12:12:52.025624  5598 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.026232  5615 leader_election.cc:290] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:52.026147  5598 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:52.029987  5088 leader_election.cc:304] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:12:52.029989  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:52.025498  5316 tablet_bootstrap.cc:492] T 2a6867413d1d4b49bcd267c1e134d12e P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
I20260709 12:12:52.030692  5273 raft_consensus.cc:2468] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 1.
I20260709 12:12:52.031754  5023 catalog_manager.cc:5697] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 0 to 1, leader changed from <none> to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 1 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:52.033730  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:52.034597  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:52.036491  5088 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:12:52.030750  5598 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:52.037807  5591 raft_consensus.cc:2749] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:52.037209  5615 raft_consensus.cc:2804] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:52.042696  5615 raft_consensus.cc:493] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:52.048156  5591 consensus_queue.cc:1048] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:52.043154  5615 raft_consensus.cc:3060] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:52.061268  5313 tablet_bootstrap.cc:654] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.082157  5615 raft_consensus.cc:515] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:52.084836  5273 raft_consensus.cc:3060] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:52.087328  5316 tablet_bootstrap.cc:654] T 2a6867413d1d4b49bcd267c1e134d12e P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.090250  5615 leader_election.cc:290] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:52.091104  5270 raft_consensus.cc:3060] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:52.091917  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:12:52.092543  5274 raft_consensus.cc:3060] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:52.092954  5314 tablet_bootstrap.cc:492] T 3db164e3a1ce4a43b0a112a777118daa P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:52.093443  5314 ts_tablet_manager.cc:1403] T 3db164e3a1ce4a43b0a112a777118daa P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.185s	user 0.026s	sys 0.021s
I20260709 12:12:52.094189  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:12:52.094775  5197 raft_consensus.cc:3060] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:52.096117  5314 raft_consensus.cc:359] T 3db164e3a1ce4a43b0a112a777118daa P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:52.096781  5314 raft_consensus.cc:385] T 3db164e3a1ce4a43b0a112a777118daa P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.097102  5314 raft_consensus.cc:740] T 3db164e3a1ce4a43b0a112a777118daa P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.101863  5314 consensus_queue.cc:260] T 3db164e3a1ce4a43b0a112a777118daa P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:12:52.105491  5088 consensus_peers.cc:597] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 -> Peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Couldn't send request to peer 9e794b72ed7640219f90ec4232363929. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:52.107111  5314 ts_tablet_manager.cc:1434] T 3db164e3a1ce4a43b0a112a777118daa P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:12:52.108222  5314 tablet_bootstrap.cc:492] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
I20260709 12:12:52.109941  5274 raft_consensus.cc:2468] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 2.
I20260709 12:12:52.111124  5088 leader_election.cc:304] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:12:52.111923  5610 raft_consensus.cc:2804] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:52.112630  5610 raft_consensus.cc:697] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:12:52.113452  5610 consensus_queue.cc:237] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:52.123706  5314 tablet_bootstrap.cc:654] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.127288  5197 raft_consensus.cc:2468] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 2.
I20260709 12:12:52.139490  5314 tablet_bootstrap.cc:492] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:52.140149  5314 ts_tablet_manager.cc:1403] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.000s
I20260709 12:12:52.142237  5313 tablet_bootstrap.cc:492] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:52.142729  5313 ts_tablet_manager.cc:1403] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.128s	user 0.030s	sys 0.001s
I20260709 12:12:52.142808  5314 raft_consensus.cc:359] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:52.143527  5314 raft_consensus.cc:385] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.143816  5314 raft_consensus.cc:740] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.144448  5314 consensus_queue.cc:260] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:52.151134  5314 ts_tablet_manager.cc:1434] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 12:12:52.153496  5314 tablet_bootstrap.cc:492] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
I20260709 12:12:52.162673  5314 tablet_bootstrap.cc:654] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.162716  5316 tablet_bootstrap.cc:492] T 2a6867413d1d4b49bcd267c1e134d12e P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
I20260709 12:12:52.163275  5316 ts_tablet_manager.cc:1403] T 2a6867413d1d4b49bcd267c1e134d12e P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.138s	user 0.018s	sys 0.017s
I20260709 12:12:52.175273  5313 raft_consensus.cc:359] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:52.176083  5313 raft_consensus.cc:385] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.176374  5313 raft_consensus.cc:740] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.176986  5316 raft_consensus.cc:359] T 2a6867413d1d4b49bcd267c1e134d12e P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:52.177187  5023 catalog_manager.cc:5697] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 0 to 2, leader changed from <none> to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 2 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:52.177245  5313 consensus_queue.cc:260] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:52.182576  5313 ts_tablet_manager.cc:1434] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.025s	user 0.015s	sys 0.002s
I20260709 12:12:52.183460  5313 tablet_bootstrap.cc:492] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
I20260709 12:12:52.178318  5316 raft_consensus.cc:385] T 2a6867413d1d4b49bcd267c1e134d12e P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.184561  5316 raft_consensus.cc:740] T 2a6867413d1d4b49bcd267c1e134d12e P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.185154  5316 consensus_queue.cc:260] T 2a6867413d1d4b49bcd267c1e134d12e P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:52.186276  5122 raft_consensus.cc:3060] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:52.189432  5316 ts_tablet_manager.cc:1434] T 2a6867413d1d4b49bcd267c1e134d12e P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.002s
I20260709 12:12:52.190423  5603 raft_consensus.cc:493] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.190562  5316 tablet_bootstrap.cc:492] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
I20260709 12:12:52.190948  5603 raft_consensus.cc:515] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:52.193053  5603 leader_election.cc:290] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:52.194962  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:12:52.196440  5166 leader_election.cc:343] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.199106  5313 tablet_bootstrap.cc:654] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.201805  5316 tablet_bootstrap.cc:654] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.203099  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:12:52.204612  5163 leader_election.cc:343] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.205017  5163 leader_election.cc:304] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:12:52.205961  5603 raft_consensus.cc:2749] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:52.217731  5314 tablet_bootstrap.cc:492] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:52.218286  5314 ts_tablet_manager.cc:1403] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.065s	user 0.019s	sys 0.001s
I20260709 12:12:52.220705  5314 raft_consensus.cc:359] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:52.221354  5314 raft_consensus.cc:385] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.221665  5314 raft_consensus.cc:740] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.222712  5314 consensus_queue.cc:260] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:52.224618  5316 tablet_bootstrap.cc:492] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
I20260709 12:12:52.224758  5314 ts_tablet_manager.cc:1434] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.003s
I20260709 12:12:52.225080  5316 ts_tablet_manager.cc:1403] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.035s	user 0.006s	sys 0.016s
I20260709 12:12:52.226809  5313 tablet_bootstrap.cc:492] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:52.227334  5313 ts_tablet_manager.cc:1403] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.044s	user 0.009s	sys 0.007s
I20260709 12:12:52.227643  5316 raft_consensus.cc:359] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:52.228324  5316 raft_consensus.cc:385] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.228592  5316 raft_consensus.cc:740] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.229225  5316 consensus_queue.cc:260] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:52.229909  5313 raft_consensus.cc:359] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:52.230593  5313 raft_consensus.cc:385] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.230834  5313 raft_consensus.cc:740] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.231285  5316 ts_tablet_manager.cc:1434] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:12:52.231562  5313 consensus_queue.cc:260] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:52.233651  5313 ts_tablet_manager.cc:1434] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:12:52.234071  5314 tablet_bootstrap.cc:492] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
I20260709 12:12:52.234503  5313 tablet_bootstrap.cc:492] T 90cb6c9306054ce3b2bc1bbd21c7345f P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
I20260709 12:12:52.237005  5316 tablet_bootstrap.cc:492] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
I20260709 12:12:52.240510  5313 tablet_bootstrap.cc:654] T 90cb6c9306054ce3b2bc1bbd21c7345f P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.244400  5316 tablet_bootstrap.cc:654] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.246876  5314 tablet_bootstrap.cc:654] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.257319  5316 tablet_bootstrap.cc:492] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
I20260709 12:12:52.257848  5316 ts_tablet_manager.cc:1403] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.007s
I20260709 12:12:52.262295  5313 tablet_bootstrap.cc:492] T 90cb6c9306054ce3b2bc1bbd21c7345f P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:52.262861  5313 ts_tablet_manager.cc:1403] T 90cb6c9306054ce3b2bc1bbd21c7345f P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.029s	user 0.007s	sys 0.009s
I20260709 12:12:52.266592  5314 tablet_bootstrap.cc:492] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:52.267230  5314 ts_tablet_manager.cc:1403] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.001s
I20260709 12:12:52.270622  5314 raft_consensus.cc:359] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:52.274969  5314 raft_consensus.cc:385] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.275425  5314 raft_consensus.cc:740] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.280433  5314 consensus_queue.cc:260] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:52.271063  5316 raft_consensus.cc:359] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:52.281589  5316 raft_consensus.cc:385] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.281999  5316 raft_consensus.cc:740] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.283330  5360 consensus_queue.cc:1048] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:52.282717  5316 consensus_queue.cc:260] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:52.281705  5313 raft_consensus.cc:359] T 90cb6c9306054ce3b2bc1bbd21c7345f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:52.285792  5313 raft_consensus.cc:385] T 90cb6c9306054ce3b2bc1bbd21c7345f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.285856  5316 ts_tablet_manager.cc:1434] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.001s
I20260709 12:12:52.286164  5313 raft_consensus.cc:740] T 90cb6c9306054ce3b2bc1bbd21c7345f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.286468  5314 ts_tablet_manager.cc:1434] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:12:52.286906  5316 tablet_bootstrap.cc:492] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
I20260709 12:12:52.287176  5313 consensus_queue.cc:260] T 90cb6c9306054ce3b2bc1bbd21c7345f P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:52.289851  5314 tablet_bootstrap.cc:492] T 9f93759199ab4820a9a807a0f1c70c85 P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
I20260709 12:12:52.294118  5316 tablet_bootstrap.cc:654] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.294761  5313 ts_tablet_manager.cc:1434] T 90cb6c9306054ce3b2bc1bbd21c7345f P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.001s
I20260709 12:12:52.295792  5313 tablet_bootstrap.cc:492] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
I20260709 12:12:52.295956  5314 tablet_bootstrap.cc:654] T 9f93759199ab4820a9a807a0f1c70c85 P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.321163  5319 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.321759  5319 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:52.322188  5313 tablet_bootstrap.cc:654] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.326545  5360 raft_consensus.cc:493] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.327045  5360 raft_consensus.cc:515] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:52.328810  5360 leader_election.cc:290] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:52.329241  5319 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:52.330261  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:52.333746  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:52.340219  5316 tablet_bootstrap.cc:492] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
I20260709 12:12:52.340797  5316 ts_tablet_manager.cc:1403] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.054s	user 0.019s	sys 0.009s
I20260709 12:12:52.342239  5319 raft_consensus.cc:493] T 3db164e3a1ce4a43b0a112a777118daa P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.342698  5319 raft_consensus.cc:515] T 3db164e3a1ce4a43b0a112a777118daa P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:52.344126  5316 raft_consensus.cc:359] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:52.344925  5316 raft_consensus.cc:385] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.345233  5316 raft_consensus.cc:740] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.345973  5316 consensus_queue.cc:260] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:52.346858  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:52.347527  5319 leader_election.cc:290] T 3db164e3a1ce4a43b0a112a777118daa P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:52.348489  5313 tablet_bootstrap.cc:492] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:52.348937  5313 ts_tablet_manager.cc:1403] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.053s	user 0.009s	sys 0.001s
I20260709 12:12:52.350231  5316 ts_tablet_manager.cc:1434] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 12:12:52.347540  5124 raft_consensus.cc:2468] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 0.
I20260709 12:12:52.351285  5316 tablet_bootstrap.cc:492] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
I20260709 12:12:52.351481  5313 raft_consensus.cc:359] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:52.351930  5166 leader_election.cc:304] T 3db164e3a1ce4a43b0a112a777118daa P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:12:52.352243  5313 raft_consensus.cc:385] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.352555  5313 raft_consensus.cc:740] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.353296  5313 consensus_queue.cc:260] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:52.358268  5524 consensus_queue.cc:1048] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:52.360703  5603 raft_consensus.cc:2804] T 3db164e3a1ce4a43b0a112a777118daa P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:52.361173  5603 raft_consensus.cc:493] T 3db164e3a1ce4a43b0a112a777118daa P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:52.361582  5603 raft_consensus.cc:3060] T 3db164e3a1ce4a43b0a112a777118daa P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:52.363696  5316 tablet_bootstrap.cc:654] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.365983  5313 ts_tablet_manager.cc:1434] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:12:52.367810  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:52.368822  5273 raft_consensus.cc:2393] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 1: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:12:52.372627  5615 consensus_queue.cc:1048] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:52.381055  5313 tablet_bootstrap.cc:492] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
I20260709 12:12:52.381398  5088 leader_election.cc:304] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:12:52.382689  5615 raft_consensus.cc:3060] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:52.389225  5313 tablet_bootstrap.cc:654] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.389794  5360 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.390280  5360 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:52.392248  5360 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:52.394495  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:12:52.396162  5088 leader_election.cc:343] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.398033  5615 raft_consensus.cc:2749] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:52.403144  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:52.407610  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:52.426522  5313 tablet_bootstrap.cc:492] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:52.427120  5313 ts_tablet_manager.cc:1403] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.046s	user 0.017s	sys 0.022s
I20260709 12:12:52.430198  5313 raft_consensus.cc:359] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:52.430918  5313 raft_consensus.cc:385] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.431183  5313 raft_consensus.cc:740] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.431842  5313 consensus_queue.cc:260] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:52.449218  5540 consensus_queue.cc:1048] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:52.455716  5313 ts_tablet_manager.cc:1434] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.003s
I20260709 12:12:52.456846  5313 tablet_bootstrap.cc:492] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
I20260709 12:12:52.469573  5313 tablet_bootstrap.cc:654] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.479393  5163 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:12:52.480746  5163 leader_election.cc:343] T 3db164e3a1ce4a43b0a112a777118daa P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:52.481885  5625 raft_consensus.cc:2749] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:52.487099  5319 raft_consensus.cc:493] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.487597  5319 raft_consensus.cc:515] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:52.490749  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:52.491441  5125 raft_consensus.cc:2468] T 90cb6c9306054ce3b2bc1bbd21c7345f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 0.
I20260709 12:12:52.494052  5166 leader_election.cc:304] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:12:52.494951  5625 raft_consensus.cc:2804] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:52.495348  5625 raft_consensus.cc:493] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:52.495694  5625 raft_consensus.cc:3060] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:52.516551  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:52.517361  5273 raft_consensus.cc:2468] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 0.
I20260709 12:12:52.518410  5319 leader_election.cc:290] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:52.535491  5319 consensus_queue.cc:1048] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:52.538635  5316 tablet_bootstrap.cc:492] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
I20260709 12:12:52.539232  5316 ts_tablet_manager.cc:1403] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.188s	user 0.055s	sys 0.031s
I20260709 12:12:52.540494  5088 leader_election.cc:304] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:12:52.541874  5360 raft_consensus.cc:2804] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:52.542235  5360 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:52.542564  5360 raft_consensus.cc:3060] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:52.547372  5332 raft_consensus.cc:493] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.556298  5316 raft_consensus.cc:359] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:52.557081  5316 raft_consensus.cc:385] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.557343  5316 raft_consensus.cc:740] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.567739  5610 raft_consensus.cc:493] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.544291  5540 raft_consensus.cc:493] T 2a6867413d1d4b49bcd267c1e134d12e P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.570477  5316 consensus_queue.cc:260] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:52.570628  5332 raft_consensus.cc:515] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:52.576191  5316 ts_tablet_manager.cc:1434] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.001s
I20260709 12:12:52.579061  5314 tablet_bootstrap.cc:492] T 9f93759199ab4820a9a807a0f1c70c85 P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:52.579669  5314 ts_tablet_manager.cc:1403] T 9f93759199ab4820a9a807a0f1c70c85 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.290s	user 0.132s	sys 0.109s
I20260709 12:12:52.584666  5540 raft_consensus.cc:515] T 2a6867413d1d4b49bcd267c1e134d12e P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:52.581823  5610 raft_consensus.cc:515] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:52.570401  5603 raft_consensus.cc:515] T 3db164e3a1ce4a43b0a112a777118daa P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:52.712232  5316 tablet_bootstrap.cc:492] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
I20260709 12:12:52.715241  5360 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:52.723893  5313 tablet_bootstrap.cc:492] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:52.723265  5319 consensus_queue.cc:1048] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:12:52.736444  5313 ts_tablet_manager.cc:1403] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.280s	user 0.008s	sys 0.020s
I20260709 12:12:52.742619  5360 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:52.714361  5314 raft_consensus.cc:359] T 9f93759199ab4820a9a807a0f1c70c85 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:52.748409  5314 raft_consensus.cc:385] T 9f93759199ab4820a9a807a0f1c70c85 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.748805  5314 raft_consensus.cc:740] T 9f93759199ab4820a9a807a0f1c70c85 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.755921  5313 raft_consensus.cc:359] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:52.757906  5603 leader_election.cc:290] T 3db164e3a1ce4a43b0a112a777118daa P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:52.761188  5313 raft_consensus.cc:385] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:52.749811  5314 consensus_queue.cc:260] T 9f93759199ab4820a9a807a0f1c70c85 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:52.767333  5313 raft_consensus.cc:740] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
I20260709 12:12:52.770174  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:52.770898  5273 raft_consensus.cc:2468] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 0.
I20260709 12:12:52.776556  5313 consensus_queue.cc:260] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:52.786841  5360 raft_consensus.cc:493] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.718647  5610 leader_election.cc:290] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:52.787465  5360 raft_consensus.cc:515] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:52.809340  5313 ts_tablet_manager.cc:1434] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.073s	user 0.008s	sys 0.000s
I20260709 12:12:52.810832  5314 ts_tablet_manager.cc:1434] T 9f93759199ab4820a9a807a0f1c70c85 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.231s	user 0.010s	sys 0.004s
I20260709 12:12:52.812165  5314 tablet_bootstrap.cc:492] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
I20260709 12:12:52.710552  5625 raft_consensus.cc:515] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:52.828768  5681 raft_consensus.cc:493] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.829406  5681 raft_consensus.cc:515] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:12:52.845075  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 113667us
I20260709 12:12:52.840466  5270 raft_consensus.cc:3060] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:52.844660  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 111411us
I20260709 12:12:52.848074  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:52.864099  5273 raft_consensus.cc:2468] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 0.
I20260709 12:12:52.868240  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:12:52.869032  5273 raft_consensus.cc:3060] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:52.875849  5088 leader_election.cc:304] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:12:52.883998  5273 raft_consensus.cc:2468] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 1.
I20260709 12:12:52.889055  5088 leader_election.cc:304] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:12:52.894891  5332 leader_election.cc:290] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:52.888549  5681 leader_election.cc:290] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:52.898352  5313 tablet_bootstrap.cc:492] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
I20260709 12:12:52.904841  5332 raft_consensus.cc:493] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.905336  5332 raft_consensus.cc:515] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:52.933545  5332 leader_election.cc:290] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:52.934810  5316 tablet_bootstrap.cc:654] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.920194  5684 raft_consensus.cc:2804] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:52.908819  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:12:52.950500  5360 leader_election.cc:290] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:52.941540  5625 leader_election.cc:290] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:52.945029  5684 raft_consensus.cc:493] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:52.954638  5684 raft_consensus.cc:3060] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:52.973618  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 84645.7us
I20260709 12:12:53.147840  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:53.148470  5198 raft_consensus.cc:2468] T 9f93759199ab4820a9a807a0f1c70c85 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 0.
I20260709 12:12:52.975864  5314 tablet_bootstrap.cc:654] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:52.955752  5598 raft_consensus.cc:2804] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:12:53.123905  5071 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:53.014217  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:12:53.158233  5273 raft_consensus.cc:3060] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.172216  5360 raft_consensus.cc:493] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.172748  5360 raft_consensus.cc:515] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:53.177238  5360 leader_election.cc:290] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:52.985543  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:53.179634  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:53.147545  5540 leader_election.cc:290] T 2a6867413d1d4b49bcd267c1e134d12e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:52.985631  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:53.008610  5192 raft_consensus.cc:1275] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:12:53.020187  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:12:53.034358  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:53.186270  5198 raft_consensus.cc:3060] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.167281  5598 raft_consensus.cc:697] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:12:53.204129  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:53.209123  5265 raft_consensus.cc:1275] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:12:53.221465  5316 tablet_bootstrap.cc:492] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
W20260709 12:12:53.221613  5088 leader_election.cc:343] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.221971  5316 ts_tablet_manager.cc:1403] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.510s	user 0.022s	sys 0.017s
I20260709 12:12:53.224653  5237 leader_election.cc:304] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:12:53.225455  5332 raft_consensus.cc:2804] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:53.225790  5332 raft_consensus.cc:493] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:53.226029  5332 raft_consensus.cc:3060] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.215618  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:12:53.230396  5273 raft_consensus.cc:2468] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 1.
I20260709 12:12:53.227916  5193 raft_consensus.cc:2393] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 1: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
W20260709 12:12:53.243568  5237 leader_election.cc:343] T 2a6867413d1d4b49bcd267c1e134d12e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.219892  5684 raft_consensus.cc:515] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:53.237943  5121 raft_consensus.cc:3060] T 90cb6c9306054ce3b2bc1bbd21c7345f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.257725  5332 raft_consensus.cc:515] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:53.251916  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:53.238324  5686 consensus_queue.cc:1048] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.045s
I20260709 12:12:53.287268  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:53.288718  5265 raft_consensus.cc:2468] T 2a6867413d1d4b49bcd267c1e134d12e P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 0.
I20260709 12:12:53.292398  5332 leader_election.cc:290] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:12:53.304579  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 297383us
I20260709 12:12:53.299034  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
W20260709 12:12:53.307523  5163 leader_election.cc:343] T 3db164e3a1ce4a43b0a112a777118daa P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.305976  5316 raft_consensus.cc:359] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:53.308398  5316 raft_consensus.cc:385] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.308717  5316 raft_consensus.cc:740] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.241025  5598 consensus_queue.cc:237] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:53.310557  5314 tablet_bootstrap.cc:492] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:53.310495  5316 consensus_queue.cc:260] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:53.311190  5314 ts_tablet_manager.cc:1403] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.499s	user 0.024s	sys 0.014s
I20260709 12:12:53.312458  5316 ts_tablet_manager.cc:1434] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.090s	user 0.004s	sys 0.003s
I20260709 12:12:53.282545  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:53.315456  5163 leader_election.cc:304] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:12:53.331560  5088 leader_election.cc:304] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:12:53.339965  5683 raft_consensus.cc:2804] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:53.340482  5683 raft_consensus.cc:493] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:53.340585  5706 log.cc:927] Time spent T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 12:12:53.314019  5193 raft_consensus.cc:3060] T 9f93759199ab4820a9a807a0f1c70c85 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.331336  5192 raft_consensus.cc:2468] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 0.
I20260709 12:12:53.345012  5683 raft_consensus.cc:3060] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.373303  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:53.387391  5313 tablet_bootstrap.cc:654] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:53.387451  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 45903.9us
I20260709 12:12:53.392592  5314 raft_consensus.cc:359] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:53.388314  5524 raft_consensus.cc:493] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.393275  5314 raft_consensus.cc:385] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.395263  5314 raft_consensus.cc:740] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.396174  5524 raft_consensus.cc:515] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:53.399101  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:12:53.399753  5524 leader_election.cc:290] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:53.399796  5125 raft_consensus.cc:3060] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:53.406248  5088 leader_election.cc:343] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:53.407042  5088 leader_election.cc:343] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.396682  5314 consensus_queue.cc:260] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:53.417613  5684 leader_election.cc:290] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:53.418088  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:12:53.421211  5088 leader_election.cc:304] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:12:53.424034  5591 raft_consensus.cc:2804] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:53.424422  5591 raft_consensus.cc:493] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:53.424733  5591 raft_consensus.cc:3060] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.394321  5121 raft_consensus.cc:2468] T 90cb6c9306054ce3b2bc1bbd21c7345f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 1.
I20260709 12:12:53.471307  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:12:53.479209  5088 leader_election.cc:343] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:53.514128  5720 log.cc:927] Time spent T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 12:12:53.427923  5598 consensus_queue.cc:1048] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.066s
I20260709 12:12:53.481789  5703 raft_consensus.cc:2804] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:12:53.527921  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 174187us
I20260709 12:12:53.529469  5314 ts_tablet_manager.cc:1434] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.218s	user 0.015s	sys 0.005s
I20260709 12:12:53.535313  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:53.536238  5195 raft_consensus.cc:2393] T 3db164e3a1ce4a43b0a112a777118daa P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 1: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:12:53.557796  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:12:53.558503  5273 raft_consensus.cc:3060] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.569247  5125 raft_consensus.cc:2468] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 1.
I20260709 12:12:53.571342  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:53.583246  5240 leader_election.cc:304] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:12:53.584924  5240 leader_election.cc:304] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:12:53.585690  5695 raft_consensus.cc:2749] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:53.586488  5273 raft_consensus.cc:2468] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 1.
I20260709 12:12:53.590014  5193 raft_consensus.cc:2468] T 9f93759199ab4820a9a807a0f1c70c85 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 1.
I20260709 12:12:53.591296  5237 leader_election.cc:304] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:12:53.576745  5591 raft_consensus.cc:515] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:53.593034  5316 tablet_bootstrap.cc:492] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
I20260709 12:12:53.595213  5313 tablet_bootstrap.cc:492] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:53.595700  5313 ts_tablet_manager.cc:1403] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.698s	user 0.017s	sys 0.059s
I20260709 12:12:53.555461  5703 raft_consensus.cc:697] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:12:53.599656  5716 raft_consensus.cc:2749] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:12:53.600790  5240 leader_election.cc:343] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.569299  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:53.604468  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:12:53.608462  5316 tablet_bootstrap.cc:654] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.599647  5693 raft_consensus.cc:2804] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:53.612638  5693 raft_consensus.cc:697] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
W20260709 12:12:53.614605  5240 leader_election.cc:343] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.614497  5313 raft_consensus.cc:359] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:53.615325  5313 raft_consensus.cc:385] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.615970  5313 raft_consensus.cc:740] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.616549  5313 consensus_queue.cc:260] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:53.613070  5703 consensus_queue.cc:237] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:53.633337  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:53.637501  5117 raft_consensus.cc:2393] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 1: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:12:53.640434  5240 leader_election.cc:304] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:12:53.641284  5695 raft_consensus.cc:3060] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:53.648553  5088 leader_election.cc:343] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.653796  5313 ts_tablet_manager.cc:1434] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.057s	user 0.010s	sys 0.005s
I20260709 12:12:53.654896  5314 tablet_bootstrap.cc:492] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
I20260709 12:12:53.655383  5313 tablet_bootstrap.cc:492] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
I20260709 12:12:53.663681  5591 leader_election.cc:290] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:53.667135  5166 leader_election.cc:304] T 3db164e3a1ce4a43b0a112a777118daa P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:12:53.613559  5693 consensus_queue.cc:237] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:53.679373  5625 raft_consensus.cc:2804] T 3db164e3a1ce4a43b0a112a777118daa P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:53.681787  5625 raft_consensus.cc:697] T 3db164e3a1ce4a43b0a112a777118daa P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:12:53.682642  5625 consensus_queue.cc:237] T 3db164e3a1ce4a43b0a112a777118daa P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:53.690075  5023 catalog_manager.cc:5697] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 1 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:53.695398  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:12:53.696877  5196 raft_consensus.cc:3060] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.703663  5088 leader_election.cc:304] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:12:53.705958  5360 raft_consensus.cc:2804] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:53.708171  5360 raft_consensus.cc:697] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:12:53.689534  5695 raft_consensus.cc:2749] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:53.714661  5360 consensus_queue.cc:237] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:53.724706  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:12:53.649065  5683 raft_consensus.cc:515] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:53.748317  5118 raft_consensus.cc:2393] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 1: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
W20260709 12:12:53.751708  5088 leader_election.cc:343] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.755999  5240 leader_election.cc:304] T 2a6867413d1d4b49bcd267c1e134d12e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:12:53.756994  5683 leader_election.cc:290] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:53.777451  5524 raft_consensus.cc:3060] T 2a6867413d1d4b49bcd267c1e134d12e P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.791883  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:12:53.798904  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:12:53.851708  5524 raft_consensus.cc:2749] T 2a6867413d1d4b49bcd267c1e134d12e P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:12:53.877398  5088 leader_election.cc:343] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:53.884883  5313 tablet_bootstrap.cc:654] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.876444  5200 raft_consensus.cc:3060] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:53.890362  5316 tablet_bootstrap.cc:492] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
I20260709 12:12:53.890807  5316 ts_tablet_manager.cc:1403] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.298s	user 0.020s	sys 0.012s
I20260709 12:12:53.894006  5196 raft_consensus.cc:2468] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 1.
I20260709 12:12:53.902324  5314 tablet_bootstrap.cc:654] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.912117  5272 raft_consensus.cc:2468] T 2a6867413d1d4b49bcd267c1e134d12e P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 1.
I20260709 12:12:53.930619  5316 raft_consensus.cc:359] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:53.931351  5316 raft_consensus.cc:385] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.931629  5316 raft_consensus.cc:740] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.932296  5316 consensus_queue.cc:260] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:53.933943  5316 ts_tablet_manager.cc:1434] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.043s	user 0.004s	sys 0.003s
I20260709 12:12:53.939469  5316 tablet_bootstrap.cc:492] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
I20260709 12:12:53.953611  5697 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.954138  5697 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:53.960248  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:53.960662  5316 tablet_bootstrap.cc:654] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:53.960907  5088 leader_election.cc:304] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:12:53.961634  5610 raft_consensus.cc:2804] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:53.962091  5610 raft_consensus.cc:697] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:12:53.962858  5610 consensus_queue.cc:237] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:53.969272  5314 tablet_bootstrap.cc:492] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:53.969818  5314 ts_tablet_manager.cc:1403] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.315s	user 0.019s	sys 0.009s
I20260709 12:12:53.975937  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:53.976626  5265 raft_consensus.cc:2468] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 1.
I20260709 12:12:53.977715  5163 leader_election.cc:304] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:12:53.978570  5625 raft_consensus.cc:2804] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:53.979970  5625 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:53.979822  5689 consensus_queue.cc:1048] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:12:53.972286  5697 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:53.981268  5625 raft_consensus.cc:3060] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:53.984266  5700 consensus_queue.cc:1048] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:12:53.987172  5313 tablet_bootstrap.cc:492] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:53.977756  5019 catalog_manager.cc:5697] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 0 to 1, leader changed from <none> to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 1 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:53.985154  5314 raft_consensus.cc:359] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:53.987769  5313 ts_tablet_manager.cc:1403] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.333s	user 0.019s	sys 0.013s
I20260709 12:12:53.988319  5314 raft_consensus.cc:385] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:53.988658  5314 raft_consensus.cc:740] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
I20260709 12:12:53.989595  5314 consensus_queue.cc:260] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:53.993444  5314 ts_tablet_manager.cc:1434] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 12:12:53.994575  5314 tablet_bootstrap.cc:492] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
I20260709 12:12:53.995640  5625 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:54.011231  5200 raft_consensus.cc:1240] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:12:54.012643  5700 consensus_queue.cc:1059] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:54.014635  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:12:54.016011  5610 raft_consensus.cc:3055] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:54.016435  5610 raft_consensus.cc:740] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:12:54.028129  5314 tablet_bootstrap.cc:654] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.027700  5610 consensus_queue.cc:260] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:54.026930  5088 leader_election.cc:304] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:12:54.037329  5709 raft_consensus.cc:2804] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:54.037880  5709 raft_consensus.cc:697] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:12:54.035534  5700 raft_consensus.cc:493] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.039834  5019 catalog_manager.cc:5697] T 3db164e3a1ce4a43b0a112a777118daa P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 0 to 1, leader changed from <none> to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 1 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:54.046430  5316 tablet_bootstrap.cc:492] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
I20260709 12:12:54.046840  5316 ts_tablet_manager.cc:1403] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.112s	user 0.018s	sys 0.012s
I20260709 12:12:54.028898  5610 raft_consensus.cc:3060] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:54.050128  5313 raft_consensus.cc:359] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:54.050678  5313 raft_consensus.cc:385] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.050935  5313 raft_consensus.cc:740] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.053244  5313 consensus_queue.cc:260] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:54.052028  5625 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:54.038972  5700 raft_consensus.cc:515] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:54.038744  5709 consensus_queue.cc:237] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:54.057768  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:12:54.059322  5316 raft_consensus.cc:359] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:54.062106  5316 raft_consensus.cc:385] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.062345  5313 ts_tablet_manager.cc:1434] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.074s	user 0.006s	sys 0.000s
I20260709 12:12:54.062474  5316 raft_consensus.cc:740] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.063352  5313 tablet_bootstrap.cc:492] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
I20260709 12:12:54.063422  5316 consensus_queue.cc:260] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:54.067013  5316 ts_tablet_manager.cc:1434] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 12:12:54.068126  5316 tablet_bootstrap.cc:492] T ed974c2bf41a490ca098100bdfc63351 P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
I20260709 12:12:54.076499  5700 leader_election.cc:290] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:54.085355  5023 catalog_manager.cc:5697] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 1 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:54.082110  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:54.088017  5199 raft_consensus.cc:2393] T 9f93759199ab4820a9a807a0f1c70c85 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 1: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:12:54.088496  5701 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.100332  5163 leader_election.cc:304] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:12:54.092798  5701 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:54.105440  5679 consensus_queue.cc:1048] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:54.115208  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:54.103219  5625 raft_consensus.cc:2749] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:12:54.119867  5313 tablet_bootstrap.cc:654] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.121496  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:54.121789  5693 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.122246  5693 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:54.123157  5681 raft_consensus.cc:493] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:54.125174  5088 leader_election.cc:343] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.125912  5022 catalog_manager.cc:5697] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 1 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:54.127803  5022 catalog_manager.cc:5697] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 1 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:54.130033  5314 tablet_bootstrap.cc:492] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:54.130492  5314 ts_tablet_manager.cc:1403] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.136s	user 0.005s	sys 0.009s
I20260709 12:12:54.131278  5693 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:54.121032  5701 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:54.133419  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:54.133297  5088 leader_election.cc:304] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:12:54.123657  5681 raft_consensus.cc:515] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:54.136687  5316 tablet_bootstrap.cc:654] T ed974c2bf41a490ca098100bdfc63351 P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:54.139328  5237 leader_election.cc:343] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.136968  5700 consensus_queue.cc:1048] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:12:54.143828  5709 raft_consensus.cc:3060] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.146921  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:54.148166  5124 raft_consensus.cc:2468] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 0.
I20260709 12:12:54.156414  5240 leader_election.cc:304] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:12:54.164405  5716 raft_consensus.cc:2804] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:54.166729  5716 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:54.167062  5716 raft_consensus.cc:3060] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.167721  5681 leader_election.cc:290] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:54.170732  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:54.171442  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:54.179821  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:54.180562  5199 raft_consensus.cc:2393] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 1: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:12:54.187892  5237 leader_election.cc:304] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:12:54.187295  5716 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:54.189750  5698 raft_consensus.cc:3060] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.194060  5313 tablet_bootstrap.cc:492] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:54.194703  5313 ts_tablet_manager.cc:1403] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.132s	user 0.022s	sys 0.006s
I20260709 12:12:54.196818  5716 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:54.197857  5314 raft_consensus.cc:359] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:54.198562  5314 raft_consensus.cc:385] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.198834  5314 raft_consensus.cc:740] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.199492  5314 consensus_queue.cc:260] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:54.202883  5272 raft_consensus.cc:2393] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 1: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:12:54.204595  5088 leader_election.cc:304] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:12:54.232584  5313 raft_consensus.cc:359] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:54.233353  5313 raft_consensus.cc:385] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.233640  5313 raft_consensus.cc:740] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.234329  5313 consensus_queue.cc:260] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:54.206633  5709 raft_consensus.cc:2749] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:54.236346  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:12:54.220242  5603 consensus_queue.cc:1048] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 12:12:54.227656  5697 consensus_queue.cc:1048] T 3db164e3a1ce4a43b0a112a777118daa P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:12:54.227463  5734 raft_consensus.cc:3060] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.247499  5691 consensus_queue.cc:1048] T 3db164e3a1ce4a43b0a112a777118daa P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:12:54.254338  5313 ts_tablet_manager.cc:1434] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.059s	user 0.004s	sys 0.004s
I20260709 12:12:54.255793  5313 tablet_bootstrap.cc:492] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
W20260709 12:12:54.260589  5071 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:12:54.266136  5088 consensus_peers.cc:597] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:54.253940  5698 raft_consensus.cc:2749] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:54.279299  5734 raft_consensus.cc:2749] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:54.289747  5316 tablet_bootstrap.cc:492] T ed974c2bf41a490ca098100bdfc63351 P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
I20260709 12:12:54.291188  5316 ts_tablet_manager.cc:1403] T ed974c2bf41a490ca098100bdfc63351 P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.223s	user 0.018s	sys 0.026s
I20260709 12:12:54.304632  5314 ts_tablet_manager.cc:1434] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.174s	user 0.010s	sys 0.017s
I20260709 12:12:54.305714  5314 tablet_bootstrap.cc:492] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
I20260709 12:12:54.307593  5316 raft_consensus.cc:359] T ed974c2bf41a490ca098100bdfc63351 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:54.308286  5316 raft_consensus.cc:385] T ed974c2bf41a490ca098100bdfc63351 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.308578  5316 raft_consensus.cc:740] T ed974c2bf41a490ca098100bdfc63351 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.309201  5316 consensus_queue.cc:260] T ed974c2bf41a490ca098100bdfc63351 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:54.357933  5116 raft_consensus.cc:2468] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 1.
I20260709 12:12:54.369809  5313 tablet_bootstrap.cc:654] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.372855  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:12:54.377696  5691 raft_consensus.cc:493] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.378225  5314 tablet_bootstrap.cc:654] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.429925  5691 raft_consensus.cc:515] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:54.432735  5691 leader_election.cc:290] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:54.393898  5681 consensus_queue.cc:1048] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:54.434731  5524 consensus_queue.cc:1048] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:54.420495  5679 raft_consensus.cc:493] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.436180  5679 raft_consensus.cc:515] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:54.442683  5313 tablet_bootstrap.cc:492] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:54.443446  5313 ts_tablet_manager.cc:1403] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.188s	user 0.013s	sys 0.005s
I20260709 12:12:54.444804  5240 leader_election.cc:304] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:12:54.374972  5316 ts_tablet_manager.cc:1434] T ed974c2bf41a490ca098100bdfc63351 P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.083s	user 0.004s	sys 0.004s
I20260709 12:12:54.447579  5316 tablet_bootstrap.cc:492] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
W20260709 12:12:54.451352  5237 leader_election.cc:343] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.451836  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:54.453419  5524 raft_consensus.cc:2804] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:54.454130  5524 raft_consensus.cc:697] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:12:54.452680  5272 raft_consensus.cc:2468] T ed974c2bf41a490ca098100bdfc63351 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 0.
I20260709 12:12:54.455744  5524 consensus_queue.cc:237] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:54.456782  5598 consensus_queue.cc:1048] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:54.461647  5679 leader_election.cc:290] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:54.463317  5314 tablet_bootstrap.cc:492] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:54.463934  5314 ts_tablet_manager.cc:1403] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.158s	user 0.005s	sys 0.007s
I20260709 12:12:54.475464  5163 leader_election.cc:304] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:12:54.476100  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:54.476490  5679 raft_consensus.cc:2804] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:54.476969  5679 raft_consensus.cc:493] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:54.477416  5679 raft_consensus.cc:3060] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.490103  5272 raft_consensus.cc:2393] T 2a6867413d1d4b49bcd267c1e134d12e P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 1: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:12:54.493323  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:54.493602  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:54.512542  5314 raft_consensus.cc:359] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:54.522678  5314 raft_consensus.cc:385] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.524693  5314 raft_consensus.cc:740] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.534579  5022 catalog_manager.cc:5697] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 1 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:54.547061  5313 raft_consensus.cc:359] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:54.551039  5313 raft_consensus.cc:385] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.551334  5313 raft_consensus.cc:740] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.553630  5314 consensus_queue.cc:260] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:54.555909  5313 consensus_queue.cc:260] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:54.558305  5166 leader_election.cc:304] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:12:54.559355  5603 raft_consensus.cc:3060] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:54.560362  5166 leader_election.cc:343] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.562795  5313 ts_tablet_manager.cc:1434] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.119s	user 0.008s	sys 0.001s
I20260709 12:12:54.565745  5313 tablet_bootstrap.cc:492] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
I20260709 12:12:54.588692  5314 ts_tablet_manager.cc:1434] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.124s	user 0.010s	sys 0.001s
I20260709 12:12:54.591538  5598 consensus_queue.cc:1048] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:54.589480  5603 raft_consensus.cc:2749] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:54.610778  5023 catalog_manager.cc:5697] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 1 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:54.630705  5316 tablet_bootstrap.cc:654] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.636145  5314 tablet_bootstrap.cc:492] T 9634d2debd9f4e7ea32cf4479f9242e1 P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
I20260709 12:12:54.643507  5684 consensus_queue.cc:1048] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:54.646114  5313 tablet_bootstrap.cc:654] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.652958  5679 raft_consensus.cc:515] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:54.658779  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:12:54.659631  5314 tablet_bootstrap.cc:654] T 9634d2debd9f4e7ea32cf4479f9242e1 P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.659588  5125 raft_consensus.cc:3060] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.663288  5679 leader_election.cc:290] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:54.665333  5598 consensus_queue.cc:1048] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:54.667173  5591 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.667826  5591 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:54.667373  5313 tablet_bootstrap.cc:492] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:54.670234  5313 ts_tablet_manager.cc:1403] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.106s	user 0.007s	sys 0.006s
I20260709 12:12:54.670372  5591 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:54.670393  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:12:54.674814  5269 raft_consensus.cc:3060] T ed974c2bf41a490ca098100bdfc63351 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.683192  5125 raft_consensus.cc:2468] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 1.
I20260709 12:12:54.686149  5166 leader_election.cc:304] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:12:54.687623  5751 raft_consensus.cc:2804] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:54.672963  5313 raft_consensus.cc:359] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:54.688476  5313 raft_consensus.cc:385] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.704533  5313 raft_consensus.cc:740] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.688174  5751 raft_consensus.cc:697] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:12:54.687812  5269 raft_consensus.cc:2468] T ed974c2bf41a490ca098100bdfc63351 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 1.
I20260709 12:12:54.702135  5316 tablet_bootstrap.cc:492] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
I20260709 12:12:54.707324  5316 ts_tablet_manager.cc:1403] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.260s	user 0.014s	sys 0.006s
I20260709 12:12:54.701548  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:54.708822  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:54.704209  5314 tablet_bootstrap.cc:492] T 9634d2debd9f4e7ea32cf4479f9242e1 P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:54.713608  5314 ts_tablet_manager.cc:1403] T 9634d2debd9f4e7ea32cf4479f9242e1 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.078s	user 0.010s	sys 0.003s
W20260709 12:12:54.714238  5088 leader_election.cc:343] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.711138  5313 consensus_queue.cc:260] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:54.719383  5313 ts_tablet_manager.cc:1434] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.001s
W20260709 12:12:54.720399  5088 leader_election.cc:343] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.720883  5088 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:12:54.722877  5591 raft_consensus.cc:2749] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:54.720602  5313 tablet_bootstrap.cc:492] T 2f01a696969543e4ba24b4a07185fce8 P ad2f9a1e2f7a45429fa69fd23d09f821: Bootstrap starting.
I20260709 12:12:54.732282  5316 raft_consensus.cc:359] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:54.733100  5316 raft_consensus.cc:385] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.705781  5751 consensus_queue.cc:237] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:54.740550  5316 raft_consensus.cc:740] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.744323  5316 consensus_queue.cc:260] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:54.752938  5313 tablet_bootstrap.cc:654] T 2f01a696969543e4ba24b4a07185fce8 P ad2f9a1e2f7a45429fa69fd23d09f821: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.755951  5316 ts_tablet_manager.cc:1434] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.000s
I20260709 12:12:54.758558  5316 tablet_bootstrap.cc:492] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
I20260709 12:12:54.765807  5314 raft_consensus.cc:359] T 9634d2debd9f4e7ea32cf4479f9242e1 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:54.766769  5314 raft_consensus.cc:385] T 9634d2debd9f4e7ea32cf4479f9242e1 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.767100  5314 raft_consensus.cc:740] T 9634d2debd9f4e7ea32cf4479f9242e1 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.767917  5314 consensus_queue.cc:260] T 9634d2debd9f4e7ea32cf4479f9242e1 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:54.780630  5681 raft_consensus.cc:493] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.781575  5313 tablet_bootstrap.cc:492] T 2f01a696969543e4ba24b4a07185fce8 P ad2f9a1e2f7a45429fa69fd23d09f821: No bootstrap required, opened a new log
I20260709 12:12:54.782002  5313 ts_tablet_manager.cc:1403] T 2f01a696969543e4ba24b4a07185fce8 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent bootstrapping tablet: real 0.062s	user 0.011s	sys 0.004s
I20260709 12:12:54.784206  5314 ts_tablet_manager.cc:1434] T 9634d2debd9f4e7ea32cf4479f9242e1 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.069s	user 0.006s	sys 0.000s
I20260709 12:12:54.781190  5681 raft_consensus.cc:515] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:54.787027  5314 tablet_bootstrap.cc:492] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
I20260709 12:12:54.788810  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:54.789686  5125 raft_consensus.cc:2468] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 0.
I20260709 12:12:54.790987  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:54.791901  5240 leader_election.cc:304] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
W20260709 12:12:54.792593  5237 leader_election.cc:343] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.792968  5716 raft_consensus.cc:2804] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:54.793401  5716 raft_consensus.cc:493] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:54.793766  5716 raft_consensus.cc:3060] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.796449  5681 leader_election.cc:290] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:54.820822  5716 raft_consensus.cc:515] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:54.821799  5023 catalog_manager.cc:5697] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 0 to 1, leader changed from <none> to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 1 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:54.825994  5314 tablet_bootstrap.cc:654] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.830654  5313 raft_consensus.cc:359] T 2f01a696969543e4ba24b4a07185fce8 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:54.832448  5313 raft_consensus.cc:385] T 2f01a696969543e4ba24b4a07185fce8 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.832751  5313 raft_consensus.cc:740] T 2f01a696969543e4ba24b4a07185fce8 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.835017  5313 consensus_queue.cc:260] T 2f01a696969543e4ba24b4a07185fce8 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:54.838011  5313 ts_tablet_manager.cc:1434] T 2f01a696969543e4ba24b4a07185fce8 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent starting tablet: real 0.056s	user 0.008s	sys 0.000s
I20260709 12:12:54.841310  5316 tablet_bootstrap.cc:654] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.847728  5314 tablet_bootstrap.cc:492] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:54.848470  5314 ts_tablet_manager.cc:1403] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.062s	user 0.008s	sys 0.010s
I20260709 12:12:54.851787  5314 raft_consensus.cc:359] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:54.852485  5314 raft_consensus.cc:385] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.852753  5314 raft_consensus.cc:740] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.853469  5314 consensus_queue.cc:260] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:54.854622  5716 leader_election.cc:290] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:54.855073  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:12:54.855686  5125 raft_consensus.cc:3060] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.855760  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:12:54.860579  5314 ts_tablet_manager.cc:1434] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.003s
I20260709 12:12:54.861753  5314 tablet_bootstrap.cc:492] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
W20260709 12:12:54.862802  5237 leader_election.cc:343] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.878280  5125 raft_consensus.cc:2468] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 1.
I20260709 12:12:54.879639  5240 leader_election.cc:304] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:12:54.880785  5716 raft_consensus.cc:2804] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:54.881314  5716 raft_consensus.cc:697] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:12:54.882365  5716 consensus_queue.cc:237] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:54.899227  5679 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.899838  5679 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:54.903136  5679 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:54.903183  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:54.903548  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:54.904439  5125 raft_consensus.cc:2393] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 1: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:12:54.912423  5163 leader_election.cc:304] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:12:54.916013  5752 raft_consensus.cc:3060] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:54.918919  5316 tablet_bootstrap.cc:492] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
I20260709 12:12:54.922991  5316 ts_tablet_manager.cc:1403] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.165s	user 0.037s	sys 0.018s
I20260709 12:12:54.924466  5314 tablet_bootstrap.cc:654] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.925006  5752 raft_consensus.cc:2749] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:54.925705  5316 raft_consensus.cc:359] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:54.926429  5316 raft_consensus.cc:385] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.926739  5316 raft_consensus.cc:740] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.927384  5316 consensus_queue.cc:260] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:54.928857  5316 ts_tablet_manager.cc:1434] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:12:54.933436  5316 tablet_bootstrap.cc:492] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929: Bootstrap starting.
I20260709 12:12:54.938853  5314 tablet_bootstrap.cc:492] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:54.939289  5316 tablet_bootstrap.cc:654] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.939374  5314 ts_tablet_manager.cc:1403] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.078s	user 0.004s	sys 0.006s
I20260709 12:12:54.942229  5314 raft_consensus.cc:359] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:54.948324  5314 raft_consensus.cc:385] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.948639  5314 raft_consensus.cc:740] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.949295  5314 consensus_queue.cc:260] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:54.951622  5314 ts_tablet_manager.cc:1434] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:12:54.952648  5314 tablet_bootstrap.cc:492] T d09ac3a18bc549dabadd7ec3c3f57017 P dd62e75bd3ed4ed28f1fb5955d650808: Bootstrap starting.
I20260709 12:12:54.949342  5022 catalog_manager.cc:5697] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 1 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:54.958505  5314 tablet_bootstrap.cc:654] T d09ac3a18bc549dabadd7ec3c3f57017 P dd62e75bd3ed4ed28f1fb5955d650808: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.966109  5316 tablet_bootstrap.cc:492] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929: No bootstrap required, opened a new log
I20260709 12:12:54.966631  5316 ts_tablet_manager.cc:1403] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929: Time spent bootstrapping tablet: real 0.034s	user 0.018s	sys 0.002s
I20260709 12:12:54.967662  5314 tablet_bootstrap.cc:492] T d09ac3a18bc549dabadd7ec3c3f57017 P dd62e75bd3ed4ed28f1fb5955d650808: No bootstrap required, opened a new log
I20260709 12:12:54.968150  5314 ts_tablet_manager.cc:1403] T d09ac3a18bc549dabadd7ec3c3f57017 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.001s
I20260709 12:12:54.969514  5316 raft_consensus.cc:359] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:54.970530  5316 raft_consensus.cc:385] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.970904  5316 raft_consensus.cc:740] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.971050  5314 raft_consensus.cc:359] T d09ac3a18bc549dabadd7ec3c3f57017 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:54.971866  5314 raft_consensus.cc:385] T d09ac3a18bc549dabadd7ec3c3f57017 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.971566  5316 consensus_queue.cc:260] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:54.972159  5314 raft_consensus.cc:740] T d09ac3a18bc549dabadd7ec3c3f57017 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.972949  5314 consensus_queue.cc:260] T d09ac3a18bc549dabadd7ec3c3f57017 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:54.974033  5316 ts_tablet_manager.cc:1434] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:12:54.975121  5314 ts_tablet_manager.cc:1434] T d09ac3a18bc549dabadd7ec3c3f57017 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:12:54.976363  5679 raft_consensus.cc:493] T 9634d2debd9f4e7ea32cf4479f9242e1 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.976816  5679 raft_consensus.cc:515] T 9634d2debd9f4e7ea32cf4479f9242e1 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:54.978883  5679 leader_election.cc:290] T 9634d2debd9f4e7ea32cf4479f9242e1 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:54.980475  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:54.980552  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:54.982402  5163 leader_election.cc:304] T 9634d2debd9f4e7ea32cf4479f9242e1 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:12:54.983502  5697 raft_consensus.cc:2749] T 9634d2debd9f4e7ea32cf4479f9242e1 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:54.988878  5681 consensus_queue.cc:1048] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:55.000928  5716 consensus_queue.cc:1048] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:55.023666  5716 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.024086  5716 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:55.025875  5716 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:55.026563  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:55.027221  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:55.027279  5125 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 0.
I20260709 12:12:55.027889  5199 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 0.
I20260709 12:12:55.028407  5240 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:12:55.029139  5716 raft_consensus.cc:2804] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:55.029597  5716 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:55.029929  5716 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.035552  5716 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:55.037168  5716 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:55.038285  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:12:55.038192  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:12:55.038820  5199 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.038885  5125 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.043501  5199 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 1.
I20260709 12:12:55.044080  5125 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 1.
I20260709 12:12:55.044601  5237 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:12:55.045429  5716 raft_consensus.cc:2804] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:55.045845  5716 raft_consensus.cc:697] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:12:55.046657  5716 consensus_queue.cc:237] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:55.057116  5022 catalog_manager.cc:5697] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 1 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:55.144606  5697 raft_consensus.cc:493] T d09ac3a18bc549dabadd7ec3c3f57017 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.145147  5697 raft_consensus.cc:515] T d09ac3a18bc549dabadd7ec3c3f57017 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:55.147472  5697 leader_election.cc:290] T d09ac3a18bc549dabadd7ec3c3f57017 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:55.148154  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:55.148471  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:55.148821  5122 raft_consensus.cc:2393] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 1: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:12:55.149796  5163 leader_election.cc:304] T d09ac3a18bc549dabadd7ec3c3f57017 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:12:55.150414  5697 raft_consensus.cc:3060] T d09ac3a18bc549dabadd7ec3c3f57017 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.155514  5697 raft_consensus.cc:2749] T d09ac3a18bc549dabadd7ec3c3f57017 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:55.196918  5199 raft_consensus.cc:3060] T 9634d2debd9f4e7ea32cf4479f9242e1 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.270974  5716 raft_consensus.cc:493] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.271420  5716 raft_consensus.cc:515] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:55.274163  5716 leader_election.cc:290] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:55.274492  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:55.275043  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:55.275238  5122 raft_consensus.cc:2468] T 2f01a696969543e4ba24b4a07185fce8 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 0.
I20260709 12:12:55.275674  5199 raft_consensus.cc:2468] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 0.
I20260709 12:12:55.276535  5240 leader_election.cc:304] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:12:55.277768  5716 raft_consensus.cc:2804] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:55.278187  5716 raft_consensus.cc:493] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:55.278537  5716 raft_consensus.cc:3060] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.286291  5716 raft_consensus.cc:515] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:55.287953  5716 leader_election.cc:290] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:55.288836  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:12:55.288821  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:12:55.289628  5199 raft_consensus.cc:3060] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.289665  5122 raft_consensus.cc:3060] T 2f01a696969543e4ba24b4a07185fce8 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.296105  5199 raft_consensus.cc:2468] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 1.
I20260709 12:12:55.296602  5122 raft_consensus.cc:2468] T 2f01a696969543e4ba24b4a07185fce8 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 1.
I20260709 12:12:55.297170  5237 leader_election.cc:304] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:12:55.298111  5524 raft_consensus.cc:2804] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:55.298527  5524 raft_consensus.cc:697] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:12:55.299288  5524 consensus_queue.cc:237] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:12:55.305312  5071 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:55.309876  5022 catalog_manager.cc:5697] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 1 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:55.345988  5697 consensus_queue.cc:1048] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:55.356401  5751 consensus_queue.cc:1048] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:55.372494  5591 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.372996  5591 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:55.375993  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:55.376607  5199 raft_consensus.cc:2468] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 2.
I20260709 12:12:55.378332  5088 leader_election.cc:304] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:12:55.378880  5591 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:55.379256  5598 raft_consensus.cc:2804] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:55.379544  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:12:55.379643  5598 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:55.380020  5598 raft_consensus.cc:3060] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:55.387128  5598 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:55.388727  5598 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:55.389621  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:12:55.389861  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:12:55.390218  5199 raft_consensus.cc:3060] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:55.395956  5199 raft_consensus.cc:2468] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
I20260709 12:12:55.397095  5088 leader_election.cc:304] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:12:55.397773  5598 raft_consensus.cc:2804] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:55.398248  5598 raft_consensus.cc:697] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:12:55.398931  5598 consensus_queue.cc:237] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:55.408756  5022 catalog_manager.cc:5697] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:55.412170  5524 consensus_queue.cc:1048] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:55.422617  5788 consensus_queue.cc:1048] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:55.475159  5716 consensus_queue.cc:1048] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:55.485805  5788 consensus_queue.cc:1048] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:55.487089  5681 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:12:55.487671  5681 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:12:55.489727  5681 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:55.491044  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:12:55.491847  5197 raft_consensus.cc:2368] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 2. Current term is 3.
I20260709 12:12:55.493021  5237 leader_election.cc:400] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 pre-election: Vote denied by peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455) with higher term. Message: Invalid argument: T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 2. Current term is 3.
I20260709 12:12:55.493305  5237 leader_election.cc:403] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:55.494325  5681 raft_consensus.cc:3060] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:12:55.495131  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:12:55.502509  5681 raft_consensus.cc:2749] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455) with higher term. Message: Invalid argument: T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 2. Current term is 3.
I20260709 12:12:55.558209  3922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:55.566766  5792 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:55.576429  5793 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:55.581535  5795 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:55.581600  3922 server_base.cc:1061] running on GCE node
I20260709 12:12:55.584372  3922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:55.584656  3922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:55.584869  3922 hybrid_clock.cc:648] HybridClock initialized: now 1783599175584852 us; error 0 us; skew 500 ppm
I20260709 12:12:55.585567  3922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:55.589865  3922 webserver.cc:533] Webserver started at http://127.3.212.132:46235/ using document root <none> and password file <none>
I20260709 12:12:55.590482  3922 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:55.590757  3922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:55.591136  3922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:55.592406  3922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/ts-3-root/instance:
uuid: "bce73265e27d4b30a4dcc1e491305088"
format_stamp: "Formatted at 2026-07-09 12:12:55 on dist-test-slave-442x"
I20260709 12:12:55.622097  3922 fs_manager.cc:696] Time spent creating directory manager: real 0.029s	user 0.007s	sys 0.001s
I20260709 12:12:55.626472  5800 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:55.627837  3922 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:12:55.628212  3922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/ts-3-root
uuid: "bce73265e27d4b30a4dcc1e491305088"
format_stamp: "Formatted at 2026-07-09 12:12:55 on dist-test-slave-442x"
I20260709 12:12:55.628659  3922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:55.667490  3922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:55.669124  3922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:55.670517  3922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:55.673789  3922 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:55.674105  3922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:12:55.674422  3922 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:55.674645  3922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:55.758800  3922 rpc_server.cc:307] RPC server started. Bound to: 127.3.212.132:43539
I20260709 12:12:55.758882  5862 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.212.132:43539 every 8 connection(s)
I20260709 12:12:55.764194  3922 auto_leader_rebalancer-test.cc:439] add a tserver: bce73265e27d4b30a4dcc1e491305088
I20260709 12:12:55.784435  5863 heartbeater.cc:344] Connected to a master server at 127.3.212.190:33295
I20260709 12:12:55.784890  5863 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:55.785792  5863 heartbeater.cc:507] Master 127.3.212.190:33295 requested a full tablet report, sending...
I20260709 12:12:55.787899  5023 ts_manager.cc:194] Registered new tserver with Master: bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:12:55.789251  5023 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50918
I20260709 12:12:55.823055  5267 raft_consensus.cc:1275] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:12:55.824298  5598 consensus_queue.cc:1048] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:55.833994  5197 raft_consensus.cc:1275] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:12:55.835947  5598 consensus_queue.cc:1048] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:55.853902  5524 consensus_queue.cc:1048] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:55.874687  5681 consensus_queue.cc:1048] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:56.379346  5268 consensus_queue.cc:237] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:12:56.387197  5193 raft_consensus.cc:1275] T 84919c977be24017b74e122582f71fbe P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:12:56.387683  5122 raft_consensus.cc:1275] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:12:56.388903  5716 consensus_queue.cc:1048] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:56.389853  5524 consensus_queue.cc:1048] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:56.401665  5681 raft_consensus.cc:2955] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:12:56.403575  5122 raft_consensus.cc:2955] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
W20260709 12:12:56.404940  5238 consensus_peers.cc:597] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 -> Peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Couldn't send request to peer bce73265e27d4b30a4dcc1e491305088. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 84919c977be24017b74e122582f71fbe. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:56.411557  5193 raft_consensus.cc:2955] T 84919c977be24017b74e122582f71fbe P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:12:56.426643  5019 catalog_manager.cc:5697] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New cstate: current_term: 1 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:12:56.441872  5122 consensus_queue.cc:237] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:12:56.452586  5268 raft_consensus.cc:1275] T d8dc93d0992c4324872c6aab5aa9db8c P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:12:56.452586  5193 raft_consensus.cc:1275] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:12:56.454291  5709 consensus_queue.cc:1048] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:56.456086  5591 consensus_queue.cc:1048] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:12:56.463198  5089 consensus_peers.cc:597] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 -> Peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Couldn't send request to peer bce73265e27d4b30a4dcc1e491305088. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d8dc93d0992c4324872c6aab5aa9db8c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:56.475673  5709 raft_consensus.cc:2955] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:12:56.477423  5267 raft_consensus.cc:2955] T d8dc93d0992c4324872c6aab5aa9db8c P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:12:56.481880  5193 raft_consensus.cc:2955] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:12:56.493098  5019 catalog_manager.cc:5697] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New cstate: current_term: 1 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:56.509244  5193 consensus_queue.cc:237] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:12:56.527458  5124 raft_consensus.cc:1275] T c63fe19b7c5e4c73b49eee26ad00e88d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:12:56.529137  5751 consensus_queue.cc:1048] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:56.531126  5267 raft_consensus.cc:1275] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:12:56.532850  5751 consensus_queue.cc:1048] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:56.550967  5679 raft_consensus.cc:2955] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:12:56.559187  5267 raft_consensus.cc:2955] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:12:56.556656  5124 raft_consensus.cc:2955] T c63fe19b7c5e4c73b49eee26ad00e88d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:12:56.584261  5122 consensus_queue.cc:237] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:12:56.586856  5023 catalog_manager.cc:5697] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 reported cstate change: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New cstate: current_term: 1 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
W20260709 12:12:56.589617  5164 consensus_peers.cc:597] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Couldn't send request to peer bce73265e27d4b30a4dcc1e491305088. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c63fe19b7c5e4c73b49eee26ad00e88d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:56.606794  5197 raft_consensus.cc:1275] T 9634d2debd9f4e7ea32cf4479f9242e1 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:12:56.608559  5267 raft_consensus.cc:1275] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:12:56.609921  5894 consensus_queue.cc:1048] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:56.610679  5591 consensus_queue.cc:1048] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:12:56.611454  5089 consensus_peers.cc:597] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 -> Peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Couldn't send request to peer bce73265e27d4b30a4dcc1e491305088. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9634d2debd9f4e7ea32cf4479f9242e1. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:56.620841  5591 raft_consensus.cc:2955] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:12:56.623061  5197 raft_consensus.cc:2955] T 9634d2debd9f4e7ea32cf4479f9242e1 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:12:56.624614  5268 raft_consensus.cc:2955] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:12:56.640945  5022 catalog_manager.cc:5697] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 reported cstate change: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New cstate: current_term: 1 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:12:56.791776  5863 heartbeater.cc:499] Master 127.3.212.190:33295 was elected leader, sending a full tablet report...
I20260709 12:12:56.877215  5897 ts_tablet_manager.cc:933] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088: Initiating tablet copy from peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443)
I20260709 12:12:56.880075  5897 tablet_copy_client.cc:323] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088: tablet copy: Beginning tablet copy session from remote peer at address 127.3.212.129:34443
I20260709 12:12:56.894277  5135 tablet_copy_service.cc:140] P ad2f9a1e2f7a45429fa69fd23d09f821: Received BeginTabletCopySession request for tablet d8dc93d0992c4324872c6aab5aa9db8c from peer bce73265e27d4b30a4dcc1e491305088 ({username='slave'} at 127.0.0.1:59390)
I20260709 12:12:56.894907  5135 tablet_copy_service.cc:161] P ad2f9a1e2f7a45429fa69fd23d09f821: Beginning new tablet copy session on tablet d8dc93d0992c4324872c6aab5aa9db8c from peer bce73265e27d4b30a4dcc1e491305088 at {username='slave'} at 127.0.0.1:59390: session id = bce73265e27d4b30a4dcc1e491305088-d8dc93d0992c4324872c6aab5aa9db8c
I20260709 12:12:56.903460  5135 tablet_copy_source_session.cc:215] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:12:56.907370  5897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8dc93d0992c4324872c6aab5aa9db8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.913990  5900 ts_tablet_manager.cc:933] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088: Initiating tablet copy from peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:12:56.926355  5897 tablet_copy_client.cc:806] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 0 data blocks...
I20260709 12:12:56.927526  5897 tablet_copy_client.cc:670] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 1 WAL segments...
I20260709 12:12:56.929911  5900 tablet_copy_client.cc:323] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088: tablet copy: Beginning tablet copy session from remote peer at address 127.3.212.131:46709
I20260709 12:12:56.932001  5897 tablet_copy_client.cc:538] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:12:56.949162  5284 tablet_copy_service.cc:140] P 9e794b72ed7640219f90ec4232363929: Received BeginTabletCopySession request for tablet 84919c977be24017b74e122582f71fbe from peer bce73265e27d4b30a4dcc1e491305088 ({username='slave'} at 127.0.0.1:50932)
I20260709 12:12:56.949559  5897 tablet_bootstrap.cc:492] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088: Bootstrap starting.
I20260709 12:12:56.949856  5284 tablet_copy_service.cc:161] P 9e794b72ed7640219f90ec4232363929: Beginning new tablet copy session on tablet 84919c977be24017b74e122582f71fbe from peer bce73265e27d4b30a4dcc1e491305088 at {username='slave'} at 127.0.0.1:50932: session id = bce73265e27d4b30a4dcc1e491305088-84919c977be24017b74e122582f71fbe
I20260709 12:12:56.961321  5284 tablet_copy_source_session.cc:215] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:12:56.965896  5900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84919c977be24017b74e122582f71fbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:56.978708  5897 tablet_bootstrap.cc:492] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:56.979851  5897 tablet_bootstrap.cc:492] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088: Bootstrap complete.
I20260709 12:12:56.980600  5897 ts_tablet_manager.cc:1403] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088: Time spent bootstrapping tablet: real 0.031s	user 0.026s	sys 0.000s
I20260709 12:12:56.984081  5897 raft_consensus.cc:359] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:12:56.984615  5900 tablet_copy_client.cc:806] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 0 data blocks...
I20260709 12:12:56.984999  5897 raft_consensus.cc:740] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Initialized, Role: LEARNER
I20260709 12:12:56.985325  5900 tablet_copy_client.cc:670] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 1 WAL segments...
I20260709 12:12:56.985744  5897 consensus_queue.cc:260] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:12:56.989428  5900 tablet_copy_client.cc:538] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:12:56.990039  5897 ts_tablet_manager.cc:1434] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 12:12:56.991919  5135 tablet_copy_service.cc:342] P ad2f9a1e2f7a45429fa69fd23d09f821: Request end of tablet copy session bce73265e27d4b30a4dcc1e491305088-d8dc93d0992c4324872c6aab5aa9db8c received from {username='slave'} at 127.0.0.1:59390
I20260709 12:12:56.992426  5135 tablet_copy_service.cc:434] P ad2f9a1e2f7a45429fa69fd23d09f821: ending tablet copy session bce73265e27d4b30a4dcc1e491305088-d8dc93d0992c4324872c6aab5aa9db8c on tablet d8dc93d0992c4324872c6aab5aa9db8c with peer bce73265e27d4b30a4dcc1e491305088
I20260709 12:12:57.000260  5900 tablet_bootstrap.cc:492] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088: Bootstrap starting.
I20260709 12:12:57.013688  5897 ts_tablet_manager.cc:933] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088: Initiating tablet copy from peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:12:57.030267  5897 tablet_copy_client.cc:323] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088: tablet copy: Beginning tablet copy session from remote peer at address 127.3.212.130:44455
I20260709 12:12:57.037122  5900 tablet_bootstrap.cc:492] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:57.038259  5900 tablet_bootstrap.cc:492] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088: Bootstrap complete.
I20260709 12:12:57.038955  5900 ts_tablet_manager.cc:1403] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088: Time spent bootstrapping tablet: real 0.039s	user 0.006s	sys 0.028s
I20260709 12:12:57.041988  5900 raft_consensus.cc:359] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:12:57.042871  5900 raft_consensus.cc:740] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Initialized, Role: LEARNER
I20260709 12:12:57.043519  5900 consensus_queue.cc:260] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:12:57.046161  5900 ts_tablet_manager.cc:1434] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:12:57.047786  5284 tablet_copy_service.cc:342] P 9e794b72ed7640219f90ec4232363929: Request end of tablet copy session bce73265e27d4b30a4dcc1e491305088-84919c977be24017b74e122582f71fbe received from {username='slave'} at 127.0.0.1:50932
I20260709 12:12:57.050304  5284 tablet_copy_service.cc:434] P 9e794b72ed7640219f90ec4232363929: ending tablet copy session bce73265e27d4b30a4dcc1e491305088-84919c977be24017b74e122582f71fbe on tablet 84919c977be24017b74e122582f71fbe with peer bce73265e27d4b30a4dcc1e491305088
I20260709 12:12:57.051131  5210 tablet_copy_service.cc:140] P dd62e75bd3ed4ed28f1fb5955d650808: Received BeginTabletCopySession request for tablet c63fe19b7c5e4c73b49eee26ad00e88d from peer bce73265e27d4b30a4dcc1e491305088 ({username='slave'} at 127.0.0.1:41416)
I20260709 12:12:57.051736  5210 tablet_copy_service.cc:161] P dd62e75bd3ed4ed28f1fb5955d650808: Beginning new tablet copy session on tablet c63fe19b7c5e4c73b49eee26ad00e88d from peer bce73265e27d4b30a4dcc1e491305088 at {username='slave'} at 127.0.0.1:41416: session id = bce73265e27d4b30a4dcc1e491305088-c63fe19b7c5e4c73b49eee26ad00e88d
I20260709 12:12:57.059439  5210 tablet_copy_source_session.cc:215] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:12:57.062825  5897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c63fe19b7c5e4c73b49eee26ad00e88d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.074326  5897 tablet_copy_client.cc:806] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 0 data blocks...
I20260709 12:12:57.075037  5897 tablet_copy_client.cc:670] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 1 WAL segments...
I20260709 12:12:57.091552  5897 tablet_copy_client.cc:538] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:12:57.101343  5897 tablet_bootstrap.cc:492] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088: Bootstrap starting.
I20260709 12:12:57.118790  5897 tablet_bootstrap.cc:492] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:57.119675  5897 tablet_bootstrap.cc:492] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088: Bootstrap complete.
I20260709 12:12:57.120339  5897 ts_tablet_manager.cc:1403] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 12:12:57.122997  5897 raft_consensus.cc:359] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:12:57.123845  5897 raft_consensus.cc:740] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Initialized, Role: LEARNER
I20260709 12:12:57.124405  5897 consensus_queue.cc:260] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:12:57.126551  5897 ts_tablet_manager.cc:1434] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:12:57.128144  5210 tablet_copy_service.cc:342] P dd62e75bd3ed4ed28f1fb5955d650808: Request end of tablet copy session bce73265e27d4b30a4dcc1e491305088-c63fe19b7c5e4c73b49eee26ad00e88d received from {username='slave'} at 127.0.0.1:41416
I20260709 12:12:57.128593  5210 tablet_copy_service.cc:434] P dd62e75bd3ed4ed28f1fb5955d650808: ending tablet copy session bce73265e27d4b30a4dcc1e491305088-c63fe19b7c5e4c73b49eee26ad00e88d on tablet c63fe19b7c5e4c73b49eee26ad00e88d with peer bce73265e27d4b30a4dcc1e491305088
I20260709 12:12:57.197333  5897 ts_tablet_manager.cc:933] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088: Initiating tablet copy from peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443)
I20260709 12:12:57.198930  5897 tablet_copy_client.cc:323] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Beginning tablet copy session from remote peer at address 127.3.212.129:34443
I20260709 12:12:57.200472  5135 tablet_copy_service.cc:140] P ad2f9a1e2f7a45429fa69fd23d09f821: Received BeginTabletCopySession request for tablet 9634d2debd9f4e7ea32cf4479f9242e1 from peer bce73265e27d4b30a4dcc1e491305088 ({username='slave'} at 127.0.0.1:59390)
I20260709 12:12:57.201021  5135 tablet_copy_service.cc:161] P ad2f9a1e2f7a45429fa69fd23d09f821: Beginning new tablet copy session on tablet 9634d2debd9f4e7ea32cf4479f9242e1 from peer bce73265e27d4b30a4dcc1e491305088 at {username='slave'} at 127.0.0.1:59390: session id = bce73265e27d4b30a4dcc1e491305088-9634d2debd9f4e7ea32cf4479f9242e1
I20260709 12:12:57.208747  5135 tablet_copy_source_session.cc:215] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:12:57.214663  5897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9634d2debd9f4e7ea32cf4479f9242e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:57.229473  5897 tablet_copy_client.cc:806] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 0 data blocks...
I20260709 12:12:57.230115  5897 tablet_copy_client.cc:670] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 1 WAL segments...
I20260709 12:12:57.236331  5897 tablet_copy_client.cc:538] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:12:57.246121  5897 tablet_bootstrap.cc:492] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088: Bootstrap starting.
I20260709 12:12:57.270639  5897 tablet_bootstrap.cc:492] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:57.271605  5897 tablet_bootstrap.cc:492] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088: Bootstrap complete.
I20260709 12:12:57.272253  5897 ts_tablet_manager.cc:1403] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088: Time spent bootstrapping tablet: real 0.026s	user 0.019s	sys 0.004s
I20260709 12:12:57.275277  5897 raft_consensus.cc:359] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:12:57.277329  5897 raft_consensus.cc:740] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Initialized, Role: LEARNER
I20260709 12:12:57.279582  5897 consensus_queue.cc:260] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:12:57.284901  5897 ts_tablet_manager.cc:1434] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.004s
I20260709 12:12:57.286773  5135 tablet_copy_service.cc:342] P ad2f9a1e2f7a45429fa69fd23d09f821: Request end of tablet copy session bce73265e27d4b30a4dcc1e491305088-9634d2debd9f4e7ea32cf4479f9242e1 received from {username='slave'} at 127.0.0.1:59390
I20260709 12:12:57.287237  5135 tablet_copy_service.cc:434] P ad2f9a1e2f7a45429fa69fd23d09f821: ending tablet copy session bce73265e27d4b30a4dcc1e491305088-9634d2debd9f4e7ea32cf4479f9242e1 on tablet 9634d2debd9f4e7ea32cf4479f9242e1 with peer bce73265e27d4b30a4dcc1e491305088
I20260709 12:12:57.397789  5838 raft_consensus.cc:1217] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:12:57.436365  5838 raft_consensus.cc:1217] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:12:57.444695  5838 raft_consensus.cc:1217] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:12:57.723488  5838 raft_consensus.cc:1217] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:12:57.889966  5591 raft_consensus.cc:1064] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821: attempting to promote NON_VOTER bce73265e27d4b30a4dcc1e491305088 to VOTER
I20260709 12:12:57.892325  5591 consensus_queue.cc:237] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:12:57.914428  5838 raft_consensus.cc:1275] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:12:57.916055  5709 consensus_queue.cc:1048] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:57.921101  5268 raft_consensus.cc:1275] T d8dc93d0992c4324872c6aab5aa9db8c P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:12:57.927765  5709 consensus_queue.cc:1048] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:57.929581  5914 raft_consensus.cc:1064] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808: attempting to promote NON_VOTER bce73265e27d4b30a4dcc1e491305088 to VOTER
I20260709 12:12:57.933040  5914 consensus_queue.cc:237] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:12:57.954126  5837 raft_consensus.cc:1275] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:12:57.959196  5193 raft_consensus.cc:1275] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:12:57.959015  5751 consensus_queue.cc:1048] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:57.958788  5709 raft_consensus.cc:2955] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:12:57.964179  5266 raft_consensus.cc:1275] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:12:57.964193  5122 raft_consensus.cc:1275] T c63fe19b7c5e4c73b49eee26ad00e88d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:12:57.970633  5751 consensus_queue.cc:1048] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:57.975311  5751 consensus_queue.cc:1048] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:57.979158  5268 raft_consensus.cc:2955] T d8dc93d0992c4324872c6aab5aa9db8c P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:12:57.980111  5910 consensus_queue.cc:1048] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:57.968582  5838 raft_consensus.cc:2955] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:12:57.992653  5019 catalog_manager.cc:5697] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:57.998562  5921 raft_consensus.cc:2955] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:12:58.002240  5193 raft_consensus.cc:2955] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:12:58.010833  5838 raft_consensus.cc:2955] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:12:58.029250  5125 raft_consensus.cc:2955] T c63fe19b7c5e4c73b49eee26ad00e88d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:12:58.029727  5268 raft_consensus.cc:2955] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:12:58.043591  5681 raft_consensus.cc:1064] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929: attempting to promote NON_VOTER bce73265e27d4b30a4dcc1e491305088 to VOTER
I20260709 12:12:58.045989  5681 consensus_queue.cc:237] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:12:58.056970  5021 catalog_manager.cc:5697] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:58.065959  5838 raft_consensus.cc:1275] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:12:58.067600  5193 raft_consensus.cc:1275] T 84919c977be24017b74e122582f71fbe P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:12:58.069180  5716 consensus_queue.cc:1048] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:58.070864  5716 consensus_queue.cc:1048] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:58.072538  5125 raft_consensus.cc:1275] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:12:58.074976  5788 consensus_queue.cc:1048] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:58.091760  5193 consensus_queue.cc:237] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:12:58.101199  5788 raft_consensus.cc:2955] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:12:58.106721  5838 raft_consensus.cc:2955] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
W20260709 12:12:58.112990  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 44052.7us
I20260709 12:12:58.114835  5122 raft_consensus.cc:2955] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:12:58.117009  5837 raft_consensus.cc:1275] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:12:58.119525  5751 consensus_queue.cc:1048] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:12:58.121784  5266 raft_consensus.cc:1275] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:12:58.128937  5924 consensus_queue.cc:1048] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:12:58.129029  5921 raft_consensus.cc:2955] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:12:58.136322  5837 raft_consensus.cc:2955] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:12:58.143131  5266 raft_consensus.cc:2955] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:12:58.153764  5007 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c63fe19b7c5e4c73b49eee26ad00e88d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:12:58.152943  5193 raft_consensus.cc:2955] T 84919c977be24017b74e122582f71fbe P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:12:58.176024  5023 catalog_manager.cc:5697] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 reported cstate change: config changed from index 3 to 4, VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) evicted. New cstate: current_term: 1 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
W20260709 12:12:58.184355  5007 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet c63fe19b7c5e4c73b49eee26ad00e88d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 3 but the committed config has opid_index of 4
I20260709 12:12:58.183816  5023 catalog_manager.cc:5697] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 reported cstate change: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:12:58.198015  5108 tablet_service.cc:1558] Processing DeleteTablet for tablet c63fe19b7c5e4c73b49eee26ad00e88d with delete_type TABLET_DATA_TOMBSTONED (TS ad2f9a1e2f7a45429fa69fd23d09f821 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40378
I20260709 12:12:58.202483  5941 tablet_replica.cc:333] T c63fe19b7c5e4c73b49eee26ad00e88d P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:12:58.203398  5941 raft_consensus.cc:2243] T c63fe19b7c5e4c73b49eee26ad00e88d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:58.204659  5941 raft_consensus.cc:2272] T c63fe19b7c5e4c73b49eee26ad00e88d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:58.206450  5266 consensus_queue.cc:237] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:12:58.207960  5941 ts_tablet_manager.cc:1916] T c63fe19b7c5e4c73b49eee26ad00e88d P ad2f9a1e2f7a45429fa69fd23d09f821: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:12:58.211228  5837 raft_consensus.cc:1275] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:12:58.212044  5125 raft_consensus.cc:1275] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:12:58.213271  5937 consensus_queue.cc:1048] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:12:58.213961  5788 consensus_queue.cc:1048] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:12:58.223726  5788 raft_consensus.cc:2955] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:12:58.224632  5941 ts_tablet_manager.cc:1929] T c63fe19b7c5e4c73b49eee26ad00e88d P ad2f9a1e2f7a45429fa69fd23d09f821: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:12:58.224771  5124 raft_consensus.cc:2955] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:12:58.225978  5941 log.cc:1199] T c63fe19b7c5e4c73b49eee26ad00e88d P ad2f9a1e2f7a45429fa69fd23d09f821: Deleting WAL directory at /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/ts-0-root/wals/c63fe19b7c5e4c73b49eee26ad00e88d
I20260709 12:12:58.228123  5010 catalog_manager.cc:5028] TS ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): tablet c63fe19b7c5e4c73b49eee26ad00e88d (table test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]) successfully deleted
I20260709 12:12:58.230043  5837 raft_consensus.cc:2955] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:12:58.243233  5022 catalog_manager.cc:5697] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 reported cstate change: config changed from index 3 to 4, VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) evicted. New cstate: current_term: 1 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:12:58.247205  5007 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 84919c977be24017b74e122582f71fbe with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:12:58.267364  5186 tablet_service.cc:1558] Processing DeleteTablet for tablet 84919c977be24017b74e122582f71fbe with delete_type TABLET_DATA_TOMBSTONED (TS dd62e75bd3ed4ed28f1fb5955d650808 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47718
I20260709 12:12:58.284827  5709 raft_consensus.cc:1064] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821: attempting to promote NON_VOTER bce73265e27d4b30a4dcc1e491305088 to VOTER
I20260709 12:12:58.287032  5709 consensus_queue.cc:237] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:12:58.303211  5837 raft_consensus.cc:1275] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:12:58.299059  5942 tablet_replica.cc:333] T 84919c977be24017b74e122582f71fbe P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
I20260709 12:12:58.306816  5932 consensus_queue.cc:1048] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:12:58.307717  5942 raft_consensus.cc:2243] T 84919c977be24017b74e122582f71fbe P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:58.308413  5942 raft_consensus.cc:2272] T 84919c977be24017b74e122582f71fbe P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:58.310755  5266 raft_consensus.cc:1275] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:12:58.311832  5942 ts_tablet_manager.cc:1916] T 84919c977be24017b74e122582f71fbe P dd62e75bd3ed4ed28f1fb5955d650808: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:12:58.312650  5932 consensus_queue.cc:1048] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:58.321465  5197 raft_consensus.cc:1275] T 9634d2debd9f4e7ea32cf4479f9242e1 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:12:58.324329  5932 consensus_queue.cc:1048] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:12:58.351696  5709 raft_consensus.cc:2955] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:12:58.357981  5942 ts_tablet_manager.cc:1929] T 84919c977be24017b74e122582f71fbe P dd62e75bd3ed4ed28f1fb5955d650808: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:12:58.358423  5942 log.cc:1199] T 84919c977be24017b74e122582f71fbe P dd62e75bd3ed4ed28f1fb5955d650808: Deleting WAL directory at /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/ts-1-root/wals/84919c977be24017b74e122582f71fbe
I20260709 12:12:58.359454  5837 raft_consensus.cc:2955] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:12:58.357427  5193 raft_consensus.cc:2955] T 9634d2debd9f4e7ea32cf4479f9242e1 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:12:58.371460  5268 raft_consensus.cc:2955] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:12:58.384056  5007 catalog_manager.cc:5028] TS dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): tablet 84919c977be24017b74e122582f71fbe (table test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]) successfully deleted
I20260709 12:12:58.397576  5021 catalog_manager.cc:5697] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:12:58.415282  5125 consensus_queue.cc:237] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:12:58.420284  5837 raft_consensus.cc:1275] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:12:58.422045  5919 consensus_queue.cc:1048] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:12:58.424014  5266 raft_consensus.cc:1275] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:12:58.427357  5919 consensus_queue.cc:1048] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:12:58.431313  5932 raft_consensus.cc:2955] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:12:58.433051  5837 raft_consensus.cc:2955] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:12:58.445191  5010 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9634d2debd9f4e7ea32cf4479f9242e1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:12:58.457886  5019 catalog_manager.cc:5697] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: config changed from index 3 to 4, VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) evicted. New cstate: current_term: 1 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:58.459472  5267 raft_consensus.cc:2955] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:12:58.475407  5186 tablet_service.cc:1558] Processing DeleteTablet for tablet 9634d2debd9f4e7ea32cf4479f9242e1 with delete_type TABLET_DATA_TOMBSTONED (TS dd62e75bd3ed4ed28f1fb5955d650808 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47718
I20260709 12:12:58.476374  5942 tablet_replica.cc:333] T 9634d2debd9f4e7ea32cf4479f9242e1 P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
I20260709 12:12:58.477435  5942 raft_consensus.cc:2243] T 9634d2debd9f4e7ea32cf4479f9242e1 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:58.478245  5942 raft_consensus.cc:2272] T 9634d2debd9f4e7ea32cf4479f9242e1 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:58.481317  5942 ts_tablet_manager.cc:1916] T 9634d2debd9f4e7ea32cf4479f9242e1 P dd62e75bd3ed4ed28f1fb5955d650808: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:12:58.510365  5942 ts_tablet_manager.cc:1929] T 9634d2debd9f4e7ea32cf4479f9242e1 P dd62e75bd3ed4ed28f1fb5955d650808: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:12:58.510762  5942 log.cc:1199] T 9634d2debd9f4e7ea32cf4479f9242e1 P dd62e75bd3ed4ed28f1fb5955d650808: Deleting WAL directory at /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/ts-1-root/wals/9634d2debd9f4e7ea32cf4479f9242e1
I20260709 12:12:58.512195  5007 catalog_manager.cc:5028] TS dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): tablet 9634d2debd9f4e7ea32cf4479f9242e1 (table test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]) successfully deleted
I20260709 12:12:58.515092  5124 consensus_queue.cc:237] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:12:58.520973  5199 raft_consensus.cc:1275] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:12:58.522622  5837 raft_consensus.cc:1275] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:12:58.522843  5919 consensus_queue.cc:1048] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:12:58.524343  5709 consensus_queue.cc:1048] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:12:58.534114  5919 raft_consensus.cc:2955] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e794b72ed7640219f90ec4232363929 (127.3.212.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:12:58.553131  5199 raft_consensus.cc:2955] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e794b72ed7640219f90ec4232363929 (127.3.212.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:12:58.563853  5010 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d8dc93d0992c4324872c6aab5aa9db8c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:12:58.566568  5837 raft_consensus.cc:2955] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e794b72ed7640219f90ec4232363929 (127.3.212.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:12:58.575133  5019 catalog_manager.cc:5697] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: config changed from index 3 to 4, VOTER 9e794b72ed7640219f90ec4232363929 (127.3.212.131) evicted. New cstate: current_term: 1 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:58.593880  5263 tablet_service.cc:1558] Processing DeleteTablet for tablet d8dc93d0992c4324872c6aab5aa9db8c with delete_type TABLET_DATA_TOMBSTONED (TS 9e794b72ed7640219f90ec4232363929 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34668
I20260709 12:12:58.596053  5947 tablet_replica.cc:333] T d8dc93d0992c4324872c6aab5aa9db8c P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
I20260709 12:12:58.597303  5947 raft_consensus.cc:2243] T d8dc93d0992c4324872c6aab5aa9db8c P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:58.598181  5947 raft_consensus.cc:2272] T d8dc93d0992c4324872c6aab5aa9db8c P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:58.602051  5947 ts_tablet_manager.cc:1916] T d8dc93d0992c4324872c6aab5aa9db8c P 9e794b72ed7640219f90ec4232363929: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:12:58.613359  5947 ts_tablet_manager.cc:1929] T d8dc93d0992c4324872c6aab5aa9db8c P 9e794b72ed7640219f90ec4232363929: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:12:58.613729  5947 log.cc:1199] T d8dc93d0992c4324872c6aab5aa9db8c P 9e794b72ed7640219f90ec4232363929: Deleting WAL directory at /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/ts-2-root/wals/d8dc93d0992c4324872c6aab5aa9db8c
I20260709 12:12:58.615260  5007 catalog_manager.cc:5028] TS 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): tablet d8dc93d0992c4324872c6aab5aa9db8c (table test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]) successfully deleted
I20260709 12:12:59.662142  5193 consensus_queue.cc:237] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:12:59.668058  5125 raft_consensus.cc:1275] T 41c65b96548e49b3863d03db116fd8d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:12:59.668658  5266 raft_consensus.cc:1275] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:12:59.669533  5164 consensus_peers.cc:597] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Couldn't send request to peer bce73265e27d4b30a4dcc1e491305088. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 41c65b96548e49b3863d03db116fd8d0. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:59.670014  5921 consensus_queue.cc:1048] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:59.670926  5925 consensus_queue.cc:1048] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:59.678567  5921 raft_consensus.cc:2955] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:12:59.680194  5125 raft_consensus.cc:2955] T 41c65b96548e49b3863d03db116fd8d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:12:59.684137  5266 raft_consensus.cc:2955] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:12:59.692288  5124 consensus_queue.cc:237] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:12:59.695523  5022 catalog_manager.cc:5697] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New cstate: current_term: 1 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:59.699836  5193 raft_consensus.cc:1275] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:12:59.701934  5266 raft_consensus.cc:1275] T 8a4dd376f83a42a896a5e1aca58d3221 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:12:59.702834  5919 consensus_queue.cc:1048] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:12:59.700778  5089 consensus_peers.cc:597] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 -> Peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Couldn't send request to peer bce73265e27d4b30a4dcc1e491305088. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a4dd376f83a42a896a5e1aca58d3221. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:59.703742  5591 consensus_queue.cc:1048] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:59.716653  5919 raft_consensus.cc:2955] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:12:59.723483  5266 raft_consensus.cc:2955] T 8a4dd376f83a42a896a5e1aca58d3221 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:12:59.726227  5193 raft_consensus.cc:2955] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:12:59.743057  5023 catalog_manager.cc:5697] T 8a4dd376f83a42a896a5e1aca58d3221 P 9e794b72ed7640219f90ec4232363929 reported cstate change: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New cstate: current_term: 1 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:12:59.744251  5124 consensus_queue.cc:237] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
W20260709 12:12:59.755466  5089 consensus_peers.cc:597] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 -> Peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Couldn't send request to peer bce73265e27d4b30a4dcc1e491305088. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 88f51ae73df747849e2f3cd63547a1d0. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:59.759613  5193 raft_consensus.cc:1275] T 88f51ae73df747849e2f3cd63547a1d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:59.762869  5919 consensus_queue.cc:1048] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:59.764410  5266 raft_consensus.cc:1275] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:59.772337  5919 consensus_queue.cc:1048] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:59.779099  5958 raft_consensus.cc:2955] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:12:59.783212  5266 raft_consensus.cc:2955] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:12:59.789038  5193 raft_consensus.cc:2955] T 88f51ae73df747849e2f3cd63547a1d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:12:59.793059  5199 consensus_queue.cc:237] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:12:59.810387  5022 catalog_manager.cc:5697] T 88f51ae73df747849e2f3cd63547a1d0 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New cstate: current_term: 2 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
W20260709 12:12:59.828590  5164 consensus_peers.cc:597] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Couldn't send request to peer bce73265e27d4b30a4dcc1e491305088. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 62cb582e4337464894d9eb032a3b2cd2. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:59.830679  5125 raft_consensus.cc:1275] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:12:59.833509  5266 raft_consensus.cc:1275] T 62cb582e4337464894d9eb032a3b2cd2 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:12:59.834203  5949 consensus_queue.cc:1048] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:59.837365  5921 consensus_queue.cc:1048] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:59.847324  5921 raft_consensus.cc:2955] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:12:59.849035  5266 raft_consensus.cc:2955] T 62cb582e4337464894d9eb032a3b2cd2 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:12:59.851130  5125 raft_consensus.cc:2955] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:12:59.868324  5022 catalog_manager.cc:5697] T 62cb582e4337464894d9eb032a3b2cd2 P 9e794b72ed7640219f90ec4232363929 reported cstate change: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New cstate: current_term: 1 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:00.135437  5969 ts_tablet_manager.cc:933] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088: Initiating tablet copy from peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:00.139694  5969 tablet_copy_client.cc:323] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Beginning tablet copy session from remote peer at address 127.3.212.130:44455
I20260709 12:13:00.141260  5210 tablet_copy_service.cc:140] P dd62e75bd3ed4ed28f1fb5955d650808: Received BeginTabletCopySession request for tablet 41c65b96548e49b3863d03db116fd8d0 from peer bce73265e27d4b30a4dcc1e491305088 ({username='slave'} at 127.0.0.1:41416)
I20260709 12:13:00.141875  5210 tablet_copy_service.cc:161] P dd62e75bd3ed4ed28f1fb5955d650808: Beginning new tablet copy session on tablet 41c65b96548e49b3863d03db116fd8d0 from peer bce73265e27d4b30a4dcc1e491305088 at {username='slave'} at 127.0.0.1:41416: session id = bce73265e27d4b30a4dcc1e491305088-41c65b96548e49b3863d03db116fd8d0
I20260709 12:13:00.150377  5210 tablet_copy_source_session.cc:215] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:00.153650  5969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41c65b96548e49b3863d03db116fd8d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:00.166512  5969 tablet_copy_client.cc:806] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:00.167047  5969 tablet_copy_client.cc:670] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:00.170801  5969 tablet_copy_client.cc:538] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:00.178126  5969 tablet_bootstrap.cc:492] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088: Bootstrap starting.
I20260709 12:13:00.214084  5972 ts_tablet_manager.cc:933] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088: Initiating tablet copy from peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443)
I20260709 12:13:00.215929  5969 tablet_bootstrap.cc:492] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:00.217031  5969 tablet_bootstrap.cc:492] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088: Bootstrap complete.
I20260709 12:13:00.217916  5969 ts_tablet_manager.cc:1403] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088: Time spent bootstrapping tablet: real 0.040s	user 0.021s	sys 0.012s
I20260709 12:13:00.219749  5972 tablet_copy_client.cc:323] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Beginning tablet copy session from remote peer at address 127.3.212.129:34443
I20260709 12:13:00.221266  5969 raft_consensus.cc:359] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:00.222191  5969 raft_consensus.cc:740] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Initialized, Role: LEARNER
I20260709 12:13:00.224526  5135 tablet_copy_service.cc:140] P ad2f9a1e2f7a45429fa69fd23d09f821: Received BeginTabletCopySession request for tablet 88f51ae73df747849e2f3cd63547a1d0 from peer bce73265e27d4b30a4dcc1e491305088 ({username='slave'} at 127.0.0.1:59390)
I20260709 12:13:00.224049  5969 consensus_queue.cc:260] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:00.225106  5135 tablet_copy_service.cc:161] P ad2f9a1e2f7a45429fa69fd23d09f821: Beginning new tablet copy session on tablet 88f51ae73df747849e2f3cd63547a1d0 from peer bce73265e27d4b30a4dcc1e491305088 at {username='slave'} at 127.0.0.1:59390: session id = bce73265e27d4b30a4dcc1e491305088-88f51ae73df747849e2f3cd63547a1d0
I20260709 12:13:00.231419  5969 ts_tablet_manager.cc:1434] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 12:13:00.234453  5210 tablet_copy_service.cc:342] P dd62e75bd3ed4ed28f1fb5955d650808: Request end of tablet copy session bce73265e27d4b30a4dcc1e491305088-41c65b96548e49b3863d03db116fd8d0 received from {username='slave'} at 127.0.0.1:41416
I20260709 12:13:00.235167  5210 tablet_copy_service.cc:434] P dd62e75bd3ed4ed28f1fb5955d650808: ending tablet copy session bce73265e27d4b30a4dcc1e491305088-41c65b96548e49b3863d03db116fd8d0 on tablet 41c65b96548e49b3863d03db116fd8d0 with peer bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:00.232908  5135 tablet_copy_source_session.cc:215] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:00.239734  5972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88f51ae73df747849e2f3cd63547a1d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:00.256039  5972 tablet_copy_client.cc:806] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:00.256634  5972 tablet_copy_client.cc:670] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:00.261513  5972 tablet_copy_client.cc:538] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:00.276904  5969 ts_tablet_manager.cc:933] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088: Initiating tablet copy from peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443)
I20260709 12:13:00.278777  5972 tablet_bootstrap.cc:492] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088: Bootstrap starting.
I20260709 12:13:00.282271  5969 tablet_copy_client.cc:323] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Beginning tablet copy session from remote peer at address 127.3.212.129:34443
I20260709 12:13:00.284293  5135 tablet_copy_service.cc:140] P ad2f9a1e2f7a45429fa69fd23d09f821: Received BeginTabletCopySession request for tablet 8a4dd376f83a42a896a5e1aca58d3221 from peer bce73265e27d4b30a4dcc1e491305088 ({username='slave'} at 127.0.0.1:59390)
I20260709 12:13:00.284850  5135 tablet_copy_service.cc:161] P ad2f9a1e2f7a45429fa69fd23d09f821: Beginning new tablet copy session on tablet 8a4dd376f83a42a896a5e1aca58d3221 from peer bce73265e27d4b30a4dcc1e491305088 at {username='slave'} at 127.0.0.1:59390: session id = bce73265e27d4b30a4dcc1e491305088-8a4dd376f83a42a896a5e1aca58d3221
I20260709 12:13:00.292482  5135 tablet_copy_source_session.cc:215] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:00.296348  5969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a4dd376f83a42a896a5e1aca58d3221. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:00.306555  5972 tablet_bootstrap.cc:492] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:00.307693  5972 tablet_bootstrap.cc:492] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088: Bootstrap complete.
I20260709 12:13:00.308413  5972 ts_tablet_manager.cc:1403] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088: Time spent bootstrapping tablet: real 0.030s	user 0.018s	sys 0.005s
I20260709 12:13:00.312476  5972 raft_consensus.cc:359] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:00.313345  5972 raft_consensus.cc:740] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Initialized, Role: LEARNER
I20260709 12:13:00.314029  5972 consensus_queue.cc:260] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:00.317230  5969 tablet_copy_client.cc:806] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:00.317899  5969 tablet_copy_client.cc:670] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:00.322862  5969 tablet_copy_client.cc:538] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:00.324234  5972 ts_tablet_manager.cc:1434] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.004s
I20260709 12:13:00.326088  5135 tablet_copy_service.cc:342] P ad2f9a1e2f7a45429fa69fd23d09f821: Request end of tablet copy session bce73265e27d4b30a4dcc1e491305088-88f51ae73df747849e2f3cd63547a1d0 received from {username='slave'} at 127.0.0.1:59390
I20260709 12:13:00.326534  5135 tablet_copy_service.cc:434] P ad2f9a1e2f7a45429fa69fd23d09f821: ending tablet copy session bce73265e27d4b30a4dcc1e491305088-88f51ae73df747849e2f3cd63547a1d0 on tablet 88f51ae73df747849e2f3cd63547a1d0 with peer bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:00.339552  5969 tablet_bootstrap.cc:492] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088: Bootstrap starting.
I20260709 12:13:00.358582  5969 tablet_bootstrap.cc:492] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:00.359578  5969 tablet_bootstrap.cc:492] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088: Bootstrap complete.
I20260709 12:13:00.360337  5969 ts_tablet_manager.cc:1403] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.004s
I20260709 12:13:00.363255  5969 raft_consensus.cc:359] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:00.364179  5969 raft_consensus.cc:740] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Initialized, Role: LEARNER
I20260709 12:13:00.364861  5969 consensus_queue.cc:260] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:00.367391  5969 ts_tablet_manager.cc:1434] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:13:00.372783  5135 tablet_copy_service.cc:342] P ad2f9a1e2f7a45429fa69fd23d09f821: Request end of tablet copy session bce73265e27d4b30a4dcc1e491305088-8a4dd376f83a42a896a5e1aca58d3221 received from {username='slave'} at 127.0.0.1:59390
I20260709 12:13:00.373265  5135 tablet_copy_service.cc:434] P ad2f9a1e2f7a45429fa69fd23d09f821: ending tablet copy session bce73265e27d4b30a4dcc1e491305088-8a4dd376f83a42a896a5e1aca58d3221 on tablet 8a4dd376f83a42a896a5e1aca58d3221 with peer bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:00.425860  5969 ts_tablet_manager.cc:933] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088: Initiating tablet copy from peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:00.427951  5969 tablet_copy_client.cc:323] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Beginning tablet copy session from remote peer at address 127.3.212.130:44455
I20260709 12:13:00.429556  5210 tablet_copy_service.cc:140] P dd62e75bd3ed4ed28f1fb5955d650808: Received BeginTabletCopySession request for tablet 62cb582e4337464894d9eb032a3b2cd2 from peer bce73265e27d4b30a4dcc1e491305088 ({username='slave'} at 127.0.0.1:41416)
I20260709 12:13:00.430166  5210 tablet_copy_service.cc:161] P dd62e75bd3ed4ed28f1fb5955d650808: Beginning new tablet copy session on tablet 62cb582e4337464894d9eb032a3b2cd2 from peer bce73265e27d4b30a4dcc1e491305088 at {username='slave'} at 127.0.0.1:41416: session id = bce73265e27d4b30a4dcc1e491305088-62cb582e4337464894d9eb032a3b2cd2
I20260709 12:13:00.437765  5210 tablet_copy_source_session.cc:215] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:00.441504  5969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62cb582e4337464894d9eb032a3b2cd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:00.465173  5969 tablet_copy_client.cc:806] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:00.465879  5969 tablet_copy_client.cc:670] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:00.472450  5969 tablet_copy_client.cc:538] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:00.482560  5969 tablet_bootstrap.cc:492] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088: Bootstrap starting.
I20260709 12:13:00.497601  5969 tablet_bootstrap.cc:492] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:00.498330  5969 tablet_bootstrap.cc:492] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088: Bootstrap complete.
I20260709 12:13:00.498857  5969 ts_tablet_manager.cc:1403] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.003s
I20260709 12:13:00.500764  5969 raft_consensus.cc:359] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:00.501355  5969 raft_consensus.cc:740] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Initialized, Role: LEARNER
I20260709 12:13:00.501886  5969 consensus_queue.cc:260] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:00.503448  5969 ts_tablet_manager.cc:1434] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088: Time spent starting tablet: real 0.004s	user 0.000s	sys 0.004s
I20260709 12:13:00.505004  5210 tablet_copy_service.cc:342] P dd62e75bd3ed4ed28f1fb5955d650808: Request end of tablet copy session bce73265e27d4b30a4dcc1e491305088-62cb582e4337464894d9eb032a3b2cd2 received from {username='slave'} at 127.0.0.1:41416
I20260709 12:13:00.505493  5210 tablet_copy_service.cc:434] P dd62e75bd3ed4ed28f1fb5955d650808: ending tablet copy session bce73265e27d4b30a4dcc1e491305088-62cb582e4337464894d9eb032a3b2cd2 on tablet 62cb582e4337464894d9eb032a3b2cd2 with peer bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:00.621439  5838 raft_consensus.cc:1217] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 12:13:00.646173  5838 raft_consensus.cc:1217] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:00.680799  5838 raft_consensus.cc:1217] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:00.887138  5838 raft_consensus.cc:1217] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:01.007917  5591 raft_consensus.cc:1064] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821: attempting to promote NON_VOTER bce73265e27d4b30a4dcc1e491305088 to VOTER
I20260709 12:13:01.010313  5591 consensus_queue.cc:237] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:01.017764  5197 raft_consensus.cc:1275] T 88f51ae73df747849e2f3cd63547a1d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:01.017980  5838 raft_consensus.cc:1275] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 2 LEARNER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:01.019744  5919 consensus_queue.cc:1048] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:01.020678  5980 consensus_queue.cc:1048] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:01.020948  5272 raft_consensus.cc:1275] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:01.025035  5919 consensus_queue.cc:1048] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:01.038865  5919 raft_consensus.cc:2955] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:01.040506  5197 raft_consensus.cc:2955] T 88f51ae73df747849e2f3cd63547a1d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:01.063445  5023 catalog_manager.cc:5697] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:01.069478  5921 raft_consensus.cc:1064] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808: attempting to promote NON_VOTER bce73265e27d4b30a4dcc1e491305088 to VOTER
I20260709 12:13:01.040787  5272 raft_consensus.cc:2955] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:01.053342  5838 raft_consensus.cc:2955] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:01.072024  5921 consensus_queue.cc:237] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:01.109364  5837 raft_consensus.cc:1275] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:01.111114  5949 consensus_queue.cc:1048] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:01.117650  5980 raft_consensus.cc:1064] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821: attempting to promote NON_VOTER bce73265e27d4b30a4dcc1e491305088 to VOTER
I20260709 12:13:01.119889  5272 raft_consensus.cc:1275] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:01.124423  5124 raft_consensus.cc:1275] T 41c65b96548e49b3863d03db116fd8d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:01.122978  5980 consensus_queue.cc:237] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:01.125912  5925 consensus_queue.cc:1048] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:01.127214  5986 consensus_queue.cc:1048] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:01.139384  5124 consensus_queue.cc:237] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:01.152459  5838 raft_consensus.cc:1275] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:01.153663  5197 raft_consensus.cc:1275] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:01.153752  5272 raft_consensus.cc:1275] T 8a4dd376f83a42a896a5e1aca58d3221 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:01.156755  5982 consensus_queue.cc:1048] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:01.158634  5982 consensus_queue.cc:1048] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:01.159595  5591 consensus_queue.cc:1048] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:01.162835  5838 raft_consensus.cc:1275] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:13:01.165946  5268 raft_consensus.cc:1275] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:13:01.166378  5980 consensus_queue.cc:1048] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:13:01.171499  5919 consensus_queue.cc:1048] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:01.247521  5919 raft_consensus.cc:2955] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:01.265024  5986 raft_consensus.cc:2955] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:01.271739  5267 raft_consensus.cc:2955] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:01.284951  5837 raft_consensus.cc:2955] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:01.304494  5021 catalog_manager.cc:5697] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 reported cstate change: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
W20260709 12:13:01.310386  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 50456.1us
I20260709 12:13:01.313299  5268 raft_consensus.cc:2955] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:01.322974  5022 catalog_manager.cc:5697] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: config changed from index 3 to 4, VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) evicted. New cstate: current_term: 2 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:01.319984  5010 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 88f51ae73df747849e2f3cd63547a1d0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:01.354619  5837 raft_consensus.cc:2955] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:01.367381  5124 raft_consensus.cc:2955] T 41c65b96548e49b3863d03db116fd8d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:01.370939  5980 raft_consensus.cc:2955] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:01.379815  5197 consensus_queue.cc:237] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:01.388564  5186 tablet_service.cc:1558] Processing DeleteTablet for tablet 88f51ae73df747849e2f3cd63547a1d0 with delete_type TABLET_DATA_TOMBSTONED (TS dd62e75bd3ed4ed28f1fb5955d650808 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47718
I20260709 12:13:01.387794  5268 raft_consensus.cc:2955] T 8a4dd376f83a42a896a5e1aca58d3221 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:01.388947  5199 raft_consensus.cc:2955] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:01.413538  6002 tablet_replica.cc:333] T 88f51ae73df747849e2f3cd63547a1d0 P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
I20260709 12:13:01.416939  6002 raft_consensus.cc:2243] T 88f51ae73df747849e2f3cd63547a1d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:01.416317  5023 catalog_manager.cc:5697] T 8a4dd376f83a42a896a5e1aca58d3221 P 9e794b72ed7640219f90ec4232363929 reported cstate change: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:01.423727  5837 raft_consensus.cc:1275] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:01.435585  5925 consensus_queue.cc:1048] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:01.441581  6002 raft_consensus.cc:2272] T 88f51ae73df747849e2f3cd63547a1d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:01.445540  6002 ts_tablet_manager.cc:1916] T 88f51ae73df747849e2f3cd63547a1d0 P dd62e75bd3ed4ed28f1fb5955d650808: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:01.462819  5838 raft_consensus.cc:2955] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:01.463023  5986 raft_consensus.cc:2955] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:01.465862  5268 raft_consensus.cc:1275] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:01.471598  5949 consensus_queue.cc:1048] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:01.477295  6002 ts_tablet_manager.cc:1929] T 88f51ae73df747849e2f3cd63547a1d0 P dd62e75bd3ed4ed28f1fb5955d650808: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 12:13:01.477867  6002 log.cc:1199] T 88f51ae73df747849e2f3cd63547a1d0 P dd62e75bd3ed4ed28f1fb5955d650808: Deleting WAL directory at /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/ts-1-root/wals/88f51ae73df747849e2f3cd63547a1d0
I20260709 12:13:01.484781  5921 raft_consensus.cc:1064] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808: attempting to promote NON_VOTER bce73265e27d4b30a4dcc1e491305088 to VOTER
I20260709 12:13:01.486984  5921 consensus_queue.cc:237] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:01.484752  5007 catalog_manager.cc:5028] TS dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): tablet 88f51ae73df747849e2f3cd63547a1d0 (table test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]) successfully deleted
I20260709 12:13:01.484846  5838 raft_consensus.cc:2955] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:01.489648  5268 raft_consensus.cc:2955] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:01.508622  5117 raft_consensus.cc:1275] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:01.511443  5925 consensus_queue.cc:1048] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:01.514338  5272 raft_consensus.cc:1275] T 62cb582e4337464894d9eb032a3b2cd2 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:01.517935  5921 consensus_queue.cc:1048] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:01.514266  5023 catalog_manager.cc:5697] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: config changed from index 3 to 4, VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) evicted. New cstate: current_term: 1 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:01.537055  5108 tablet_service.cc:1558] Processing DeleteTablet for tablet 41c65b96548e49b3863d03db116fd8d0 with delete_type TABLET_DATA_TOMBSTONED (TS ad2f9a1e2f7a45429fa69fd23d09f821 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40378
I20260709 12:13:01.550293  5838 raft_consensus.cc:1275] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:01.553399  5007 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 41c65b96548e49b3863d03db116fd8d0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:01.557736  6007 tablet_replica.cc:333] T 41c65b96548e49b3863d03db116fd8d0 P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:13:01.559053  6007 raft_consensus.cc:2243] T 41c65b96548e49b3863d03db116fd8d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:01.560019  6007 raft_consensus.cc:2272] T 41c65b96548e49b3863d03db116fd8d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:01.569559  5921 consensus_queue.cc:1048] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:01.578576  5994 raft_consensus.cc:2955] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:01.594832  6007 ts_tablet_manager.cc:1916] T 41c65b96548e49b3863d03db116fd8d0 P ad2f9a1e2f7a45429fa69fd23d09f821: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:01.605278  5117 consensus_queue.cc:237] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:01.609027  5124 raft_consensus.cc:2955] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:01.611196  5837 raft_consensus.cc:1275] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:01.612833  5197 raft_consensus.cc:1275] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:01.612860  5980 consensus_queue.cc:1048] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:01.623549  5919 raft_consensus.cc:2955] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e794b72ed7640219f90ec4232363929 (127.3.212.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:01.630132  5836 raft_consensus.cc:2955] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e794b72ed7640219f90ec4232363929 (127.3.212.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:01.639532  5268 raft_consensus.cc:2955] T 62cb582e4337464894d9eb032a3b2cd2 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:01.644682  5022 catalog_manager.cc:5697] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:01.649365  6001 consensus_queue.cc:1048] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:01.667572  5010 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8a4dd376f83a42a896a5e1aca58d3221 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:01.661230  5197 raft_consensus.cc:2955] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e794b72ed7640219f90ec4232363929 (127.3.212.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:01.679026  5021 catalog_manager.cc:5697] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: config changed from index 3 to 4, VOTER 9e794b72ed7640219f90ec4232363929 (127.3.212.131) evicted. New cstate: current_term: 1 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:01.680884  6007 ts_tablet_manager.cc:1929] T 41c65b96548e49b3863d03db116fd8d0 P ad2f9a1e2f7a45429fa69fd23d09f821: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:01.681356  6007 log.cc:1199] T 41c65b96548e49b3863d03db116fd8d0 P ad2f9a1e2f7a45429fa69fd23d09f821: Deleting WAL directory at /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/ts-0-root/wals/41c65b96548e49b3863d03db116fd8d0
I20260709 12:13:01.682541  5836 raft_consensus.cc:2955] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:01.693590  5263 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a4dd376f83a42a896a5e1aca58d3221 with delete_type TABLET_DATA_TOMBSTONED (TS 9e794b72ed7640219f90ec4232363929 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34668
I20260709 12:13:01.694360  5010 catalog_manager.cc:5028] TS ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): tablet 41c65b96548e49b3863d03db116fd8d0 (table test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]) successfully deleted
I20260709 12:13:01.705951  5200 consensus_queue.cc:237] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:01.717303  5124 raft_consensus.cc:1275] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:01.718855  5994 consensus_queue.cc:1048] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:01.707406  6010 tablet_replica.cc:333] T 8a4dd376f83a42a896a5e1aca58d3221 P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
I20260709 12:13:01.721444  6010 raft_consensus.cc:2243] T 8a4dd376f83a42a896a5e1aca58d3221 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:01.722321  6010 raft_consensus.cc:2272] T 8a4dd376f83a42a896a5e1aca58d3221 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:01.726306  6008 raft_consensus.cc:2955] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e794b72ed7640219f90ec4232363929 (127.3.212.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:01.728513  6010 ts_tablet_manager.cc:1916] T 8a4dd376f83a42a896a5e1aca58d3221 P 9e794b72ed7640219f90ec4232363929: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:01.732090  5124 raft_consensus.cc:2955] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e794b72ed7640219f90ec4232363929 (127.3.212.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:01.736855  5838 raft_consensus.cc:1275] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:01.739604  5949 consensus_queue.cc:1048] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:01.742823  5007 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 62cb582e4337464894d9eb032a3b2cd2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:01.745491  5838 raft_consensus.cc:2955] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e794b72ed7640219f90ec4232363929 (127.3.212.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:01.756707  5021 catalog_manager.cc:5697] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: config changed from index 3 to 4, VOTER 9e794b72ed7640219f90ec4232363929 (127.3.212.131) evicted. New cstate: current_term: 1 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:01.760462  6010 ts_tablet_manager.cc:1929] T 8a4dd376f83a42a896a5e1aca58d3221 P 9e794b72ed7640219f90ec4232363929: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:01.763165  6010 log.cc:1199] T 8a4dd376f83a42a896a5e1aca58d3221 P 9e794b72ed7640219f90ec4232363929: Deleting WAL directory at /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/ts-2-root/wals/8a4dd376f83a42a896a5e1aca58d3221
I20260709 12:13:01.766499  5007 catalog_manager.cc:5028] TS 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): tablet 8a4dd376f83a42a896a5e1aca58d3221 (table test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]) successfully deleted
I20260709 12:13:01.773299  5263 tablet_service.cc:1558] Processing DeleteTablet for tablet 62cb582e4337464894d9eb032a3b2cd2 with delete_type TABLET_DATA_TOMBSTONED (TS 9e794b72ed7640219f90ec4232363929 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34668
I20260709 12:13:01.775111  6010 tablet_replica.cc:333] T 62cb582e4337464894d9eb032a3b2cd2 P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
I20260709 12:13:01.775969  6010 raft_consensus.cc:2243] T 62cb582e4337464894d9eb032a3b2cd2 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:01.776563  6010 raft_consensus.cc:2272] T 62cb582e4337464894d9eb032a3b2cd2 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:01.779599  6010 ts_tablet_manager.cc:1916] T 62cb582e4337464894d9eb032a3b2cd2 P 9e794b72ed7640219f90ec4232363929: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:01.796379  6010 ts_tablet_manager.cc:1929] T 62cb582e4337464894d9eb032a3b2cd2 P 9e794b72ed7640219f90ec4232363929: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:01.796805  6010 log.cc:1199] T 62cb582e4337464894d9eb032a3b2cd2 P 9e794b72ed7640219f90ec4232363929: Deleting WAL directory at /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/ts-2-root/wals/62cb582e4337464894d9eb032a3b2cd2
I20260709 12:13:01.798344  5007 catalog_manager.cc:5028] TS 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): tablet 62cb582e4337464894d9eb032a3b2cd2 (table test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]) successfully deleted
I20260709 12:13:02.838100  5199 consensus_queue.cc:237] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:02.843719  5125 raft_consensus.cc:1275] T 90cb6c9306054ce3b2bc1bbd21c7345f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:02.844098  5268 raft_consensus.cc:1275] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:13:02.845150  5164 consensus_peers.cc:597] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Couldn't send request to peer bce73265e27d4b30a4dcc1e491305088. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 90cb6c9306054ce3b2bc1bbd21c7345f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:02.845719  5925 consensus_queue.cc:1048] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:02.847653  5994 consensus_queue.cc:1048] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:02.861090  6008 raft_consensus.cc:2955] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:02.869186  5125 raft_consensus.cc:2955] T 90cb6c9306054ce3b2bc1bbd21c7345f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:02.874264  5268 raft_consensus.cc:2955] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:02.887763  5022 catalog_manager.cc:5697] T 90cb6c9306054ce3b2bc1bbd21c7345f P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New cstate: current_term: 1 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:02.893996  5199 consensus_queue.cc:237] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:02.932088  5117 raft_consensus.cc:1275] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:02.933712  5925 consensus_queue.cc:1048] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:13:02.935889  5164 consensus_peers.cc:597] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Couldn't send request to peer bce73265e27d4b30a4dcc1e491305088. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 21832120214f4b8fb9e2e0de351565f0. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:02.939584  5267 raft_consensus.cc:1275] T 21832120214f4b8fb9e2e0de351565f0 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:02.941877  6020 consensus_queue.cc:1048] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:13:02.946349  5925 raft_consensus.cc:2955] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:02.948573  5125 raft_consensus.cc:2955] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:02.964854  5125 consensus_queue.cc:237] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:02.970265  5267 raft_consensus.cc:2955] T 21832120214f4b8fb9e2e0de351565f0 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:02.977598  5268 raft_consensus.cc:1275] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:13:02.977808  5089 consensus_peers.cc:597] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 -> Peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Couldn't send request to peer bce73265e27d4b30a4dcc1e491305088. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9212b0f778ec4455b8054add86b66d78. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:02.979806  6001 consensus_queue.cc:1048] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:02.986125  5023 catalog_manager.cc:5697] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New cstate: current_term: 1 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:03.009212  5199 raft_consensus.cc:1275] T 9212b0f778ec4455b8054add86b66d78 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:03.013005  6001 consensus_queue.cc:1048] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:03.042539  6001 raft_consensus.cc:2955] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:03.054771  5272 raft_consensus.cc:2955] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:03.059840  5193 raft_consensus.cc:2955] T 9212b0f778ec4455b8054add86b66d78 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:03.061676  5266 consensus_queue.cc:237] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:03.065069  5022 catalog_manager.cc:5697] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New cstate: current_term: 1 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:03.078269  5193 raft_consensus.cc:1275] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:03.078532  5124 raft_consensus.cc:1275] T 89852cae0bd14fd8be73b84dc4a49b2a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:03.079671  5716 consensus_queue.cc:1048] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:13:03.077333  5238 consensus_peers.cc:597] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 -> Peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Couldn't send request to peer bce73265e27d4b30a4dcc1e491305088. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 89852cae0bd14fd8be73b84dc4a49b2a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:03.082496  6029 consensus_queue.cc:1048] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:03.103674  5716 raft_consensus.cc:2955] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:03.105406  5125 raft_consensus.cc:2955] T 89852cae0bd14fd8be73b84dc4a49b2a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:03.106822  5199 raft_consensus.cc:2955] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:03.127156  5021 catalog_manager.cc:5697] T 89852cae0bd14fd8be73b84dc4a49b2a P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New cstate: current_term: 1 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:03.316381  6039 ts_tablet_manager.cc:933] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088: Initiating tablet copy from peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:03.322605  6039 tablet_copy_client.cc:323] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088: tablet copy: Beginning tablet copy session from remote peer at address 127.3.212.130:44455
I20260709 12:13:03.326501  5210 tablet_copy_service.cc:140] P dd62e75bd3ed4ed28f1fb5955d650808: Received BeginTabletCopySession request for tablet 90cb6c9306054ce3b2bc1bbd21c7345f from peer bce73265e27d4b30a4dcc1e491305088 ({username='slave'} at 127.0.0.1:41416)
I20260709 12:13:03.327044  5210 tablet_copy_service.cc:161] P dd62e75bd3ed4ed28f1fb5955d650808: Beginning new tablet copy session on tablet 90cb6c9306054ce3b2bc1bbd21c7345f from peer bce73265e27d4b30a4dcc1e491305088 at {username='slave'} at 127.0.0.1:41416: session id = bce73265e27d4b30a4dcc1e491305088-90cb6c9306054ce3b2bc1bbd21c7345f
I20260709 12:13:03.334648  5210 tablet_copy_source_session.cc:215] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:03.337944  6039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90cb6c9306054ce3b2bc1bbd21c7345f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:03.357954  6039 tablet_copy_client.cc:806] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:03.358596  6039 tablet_copy_client.cc:670] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:03.362049  6039 tablet_copy_client.cc:538] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:03.371353  6039 tablet_bootstrap.cc:492] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088: Bootstrap starting.
I20260709 12:13:03.393479  6039 tablet_bootstrap.cc:492] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:03.394385  6039 tablet_bootstrap.cc:492] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088: Bootstrap complete.
I20260709 12:13:03.395082  6039 ts_tablet_manager.cc:1403] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.008s
I20260709 12:13:03.398173  6039 raft_consensus.cc:359] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:03.398994  6039 raft_consensus.cc:740] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Initialized, Role: LEARNER
I20260709 12:13:03.399637  6039 consensus_queue.cc:260] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:03.403363  6039 ts_tablet_manager.cc:1434] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:13:03.405223  5210 tablet_copy_service.cc:342] P dd62e75bd3ed4ed28f1fb5955d650808: Request end of tablet copy session bce73265e27d4b30a4dcc1e491305088-90cb6c9306054ce3b2bc1bbd21c7345f received from {username='slave'} at 127.0.0.1:41416
I20260709 12:13:03.405670  5210 tablet_copy_service.cc:434] P dd62e75bd3ed4ed28f1fb5955d650808: ending tablet copy session bce73265e27d4b30a4dcc1e491305088-90cb6c9306054ce3b2bc1bbd21c7345f on tablet 90cb6c9306054ce3b2bc1bbd21c7345f with peer bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:03.468283  6039 ts_tablet_manager.cc:933] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088: Initiating tablet copy from peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:03.469918  6039 tablet_copy_client.cc:323] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Beginning tablet copy session from remote peer at address 127.3.212.130:44455
I20260709 12:13:03.471544  5210 tablet_copy_service.cc:140] P dd62e75bd3ed4ed28f1fb5955d650808: Received BeginTabletCopySession request for tablet 21832120214f4b8fb9e2e0de351565f0 from peer bce73265e27d4b30a4dcc1e491305088 ({username='slave'} at 127.0.0.1:41416)
I20260709 12:13:03.472085  5210 tablet_copy_service.cc:161] P dd62e75bd3ed4ed28f1fb5955d650808: Beginning new tablet copy session on tablet 21832120214f4b8fb9e2e0de351565f0 from peer bce73265e27d4b30a4dcc1e491305088 at {username='slave'} at 127.0.0.1:41416: session id = bce73265e27d4b30a4dcc1e491305088-21832120214f4b8fb9e2e0de351565f0
I20260709 12:13:03.482707  5210 tablet_copy_source_session.cc:215] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:03.485981  6044 ts_tablet_manager.cc:933] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088: Initiating tablet copy from peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443)
I20260709 12:13:03.486117  6039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21832120214f4b8fb9e2e0de351565f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:03.496585  6044 tablet_copy_client.cc:323] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Beginning tablet copy session from remote peer at address 127.3.212.129:34443
I20260709 12:13:03.498898  5135 tablet_copy_service.cc:140] P ad2f9a1e2f7a45429fa69fd23d09f821: Received BeginTabletCopySession request for tablet 9212b0f778ec4455b8054add86b66d78 from peer bce73265e27d4b30a4dcc1e491305088 ({username='slave'} at 127.0.0.1:59390)
I20260709 12:13:03.499449  5135 tablet_copy_service.cc:161] P ad2f9a1e2f7a45429fa69fd23d09f821: Beginning new tablet copy session on tablet 9212b0f778ec4455b8054add86b66d78 from peer bce73265e27d4b30a4dcc1e491305088 at {username='slave'} at 127.0.0.1:59390: session id = bce73265e27d4b30a4dcc1e491305088-9212b0f778ec4455b8054add86b66d78
I20260709 12:13:03.510993  5135 tablet_copy_source_session.cc:215] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:03.513036  6039 tablet_copy_client.cc:806] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:03.514042  6039 tablet_copy_client.cc:670] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:03.516561  6044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9212b0f778ec4455b8054add86b66d78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:03.520239  6039 tablet_copy_client.cc:538] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:03.528434  6044 tablet_copy_client.cc:806] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:03.529114  6044 tablet_copy_client.cc:670] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:03.529304  6039 tablet_bootstrap.cc:492] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088: Bootstrap starting.
I20260709 12:13:03.538218  6044 tablet_copy_client.cc:538] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:03.553475  6044 tablet_bootstrap.cc:492] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088: Bootstrap starting.
I20260709 12:13:03.557853  6039 tablet_bootstrap.cc:492] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:03.559167  6039 tablet_bootstrap.cc:492] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088: Bootstrap complete.
I20260709 12:13:03.559923  6039 ts_tablet_manager.cc:1403] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.015s
I20260709 12:13:03.563138  6039 raft_consensus.cc:359] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:03.564101  6039 raft_consensus.cc:740] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Initialized, Role: LEARNER
I20260709 12:13:03.564872  6039 consensus_queue.cc:260] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:03.567278  6039 ts_tablet_manager.cc:1434] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:13:03.571131  5210 tablet_copy_service.cc:342] P dd62e75bd3ed4ed28f1fb5955d650808: Request end of tablet copy session bce73265e27d4b30a4dcc1e491305088-21832120214f4b8fb9e2e0de351565f0 received from {username='slave'} at 127.0.0.1:41416
I20260709 12:13:03.571565  5210 tablet_copy_service.cc:434] P dd62e75bd3ed4ed28f1fb5955d650808: ending tablet copy session bce73265e27d4b30a4dcc1e491305088-21832120214f4b8fb9e2e0de351565f0 on tablet 21832120214f4b8fb9e2e0de351565f0 with peer bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:03.580857  6039 ts_tablet_manager.cc:933] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088: Initiating tablet copy from peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:03.585026  6039 tablet_copy_client.cc:323] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088: tablet copy: Beginning tablet copy session from remote peer at address 127.3.212.131:46709
I20260709 12:13:03.586826  5284 tablet_copy_service.cc:140] P 9e794b72ed7640219f90ec4232363929: Received BeginTabletCopySession request for tablet 89852cae0bd14fd8be73b84dc4a49b2a from peer bce73265e27d4b30a4dcc1e491305088 ({username='slave'} at 127.0.0.1:50932)
I20260709 12:13:03.587400  5284 tablet_copy_service.cc:161] P 9e794b72ed7640219f90ec4232363929: Beginning new tablet copy session on tablet 89852cae0bd14fd8be73b84dc4a49b2a from peer bce73265e27d4b30a4dcc1e491305088 at {username='slave'} at 127.0.0.1:50932: session id = bce73265e27d4b30a4dcc1e491305088-89852cae0bd14fd8be73b84dc4a49b2a
I20260709 12:13:03.588104  6044 tablet_bootstrap.cc:492] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:03.588873  6044 tablet_bootstrap.cc:492] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088: Bootstrap complete.
I20260709 12:13:03.589527  6044 ts_tablet_manager.cc:1403] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088: Time spent bootstrapping tablet: real 0.036s	user 0.015s	sys 0.007s
I20260709 12:13:03.593948  6044 raft_consensus.cc:359] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:03.594945  6044 raft_consensus.cc:740] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Initialized, Role: LEARNER
I20260709 12:13:03.595741  6044 consensus_queue.cc:260] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:03.597824  6044 ts_tablet_manager.cc:1434] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:13:03.599468  5284 tablet_copy_source_session.cc:215] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:03.602268  5135 tablet_copy_service.cc:342] P ad2f9a1e2f7a45429fa69fd23d09f821: Request end of tablet copy session bce73265e27d4b30a4dcc1e491305088-9212b0f778ec4455b8054add86b66d78 received from {username='slave'} at 127.0.0.1:59390
I20260709 12:13:03.602700  5135 tablet_copy_service.cc:434] P ad2f9a1e2f7a45429fa69fd23d09f821: ending tablet copy session bce73265e27d4b30a4dcc1e491305088-9212b0f778ec4455b8054add86b66d78 on tablet 9212b0f778ec4455b8054add86b66d78 with peer bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:03.605327  6039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89852cae0bd14fd8be73b84dc4a49b2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:03.622908  6039 tablet_copy_client.cc:806] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:03.623574  6039 tablet_copy_client.cc:670] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:03.627140  6039 tablet_copy_client.cc:538] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:03.638367  6039 tablet_bootstrap.cc:492] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088: Bootstrap starting.
I20260709 12:13:03.655956  6039 tablet_bootstrap.cc:492] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:03.656776  6039 tablet_bootstrap.cc:492] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088: Bootstrap complete.
I20260709 12:13:03.657426  6039 ts_tablet_manager.cc:1403] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088: Time spent bootstrapping tablet: real 0.019s	user 0.019s	sys 0.000s
I20260709 12:13:03.659613  6039 raft_consensus.cc:359] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:03.660315  6039 raft_consensus.cc:740] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Initialized, Role: LEARNER
I20260709 12:13:03.660755  6039 consensus_queue.cc:260] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:03.662680  6039 ts_tablet_manager.cc:1434] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:13:03.664486  5284 tablet_copy_service.cc:342] P 9e794b72ed7640219f90ec4232363929: Request end of tablet copy session bce73265e27d4b30a4dcc1e491305088-89852cae0bd14fd8be73b84dc4a49b2a received from {username='slave'} at 127.0.0.1:50932
I20260709 12:13:03.664832  5284 tablet_copy_service.cc:434] P 9e794b72ed7640219f90ec4232363929: ending tablet copy session bce73265e27d4b30a4dcc1e491305088-89852cae0bd14fd8be73b84dc4a49b2a on tablet 89852cae0bd14fd8be73b84dc4a49b2a with peer bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:03.936296  5838 raft_consensus.cc:1217] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:03.954109  5838 raft_consensus.cc:1217] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:03.965551  5838 raft_consensus.cc:1217] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:04.028214  5838 raft_consensus.cc:1217] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:04.378597  6020 raft_consensus.cc:1064] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808: attempting to promote NON_VOTER bce73265e27d4b30a4dcc1e491305088 to VOTER
I20260709 12:13:04.381129  6020 consensus_queue.cc:237] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:04.397579  5838 raft_consensus.cc:1275] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:04.399169  6017 consensus_queue.cc:1048] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:04.408779  5272 raft_consensus.cc:1275] T 21832120214f4b8fb9e2e0de351565f0 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:04.409221  5980 raft_consensus.cc:1064] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821: attempting to promote NON_VOTER bce73265e27d4b30a4dcc1e491305088 to VOTER
I20260709 12:13:04.411785  5124 raft_consensus.cc:1275] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:04.411398  5980 consensus_queue.cc:237] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:04.413056  6020 consensus_queue.cc:1048] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:04.423056  5925 consensus_queue.cc:1048] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:04.431325  5838 raft_consensus.cc:1275] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:04.433051  5197 raft_consensus.cc:1275] T 9212b0f778ec4455b8054add86b66d78 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:04.433071  5272 raft_consensus.cc:1275] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:04.434536  6053 consensus_queue.cc:1048] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:04.440567  6058 consensus_queue.cc:1048] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:04.442310  6031 consensus_queue.cc:1048] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:04.444319  5925 raft_consensus.cc:2955] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:04.448985  5266 raft_consensus.cc:2955] T 21832120214f4b8fb9e2e0de351565f0 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:04.466936  5125 raft_consensus.cc:2955] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:04.471936  6020 raft_consensus.cc:1064] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808: attempting to promote NON_VOTER bce73265e27d4b30a4dcc1e491305088 to VOTER
I20260709 12:13:04.475725  6020 consensus_queue.cc:237] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:04.515122  5021 catalog_manager.cc:5697] T 21832120214f4b8fb9e2e0de351565f0 P 9e794b72ed7640219f90ec4232363929 reported cstate change: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:04.555210  6057 raft_consensus.cc:2955] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
W20260709 12:13:04.569756  6066 log.cc:927] Time spent T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 12:13:04.575177  5837 raft_consensus.cc:2955] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:04.575727  5838 raft_consensus.cc:2955] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:04.578936  5836 raft_consensus.cc:1275] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:04.614197  6063 consensus_queue.cc:1048] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
W20260709 12:13:04.667541  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 77356.1us
I20260709 12:13:04.695565  5268 raft_consensus.cc:2955] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:04.710364  5267 raft_consensus.cc:1275] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:04.716244  5125 raft_consensus.cc:1275] T 90cb6c9306054ce3b2bc1bbd21c7345f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:04.720584  6063 consensus_queue.cc:1048] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:13:04.750993  6020 consensus_queue.cc:1048] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:04.772352  5196 raft_consensus.cc:2955] T 9212b0f778ec4455b8054add86b66d78 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:04.791069  5117 raft_consensus.cc:2955] T 90cb6c9306054ce3b2bc1bbd21c7345f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:04.795179  6020 raft_consensus.cc:2955] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:04.843106  6073 raft_consensus.cc:1064] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929: attempting to promote NON_VOTER bce73265e27d4b30a4dcc1e491305088 to VOTER
I20260709 12:13:04.870170  5836 raft_consensus.cc:2955] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:04.875690  5022 catalog_manager.cc:5697] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:04.889322  5197 consensus_queue.cc:237] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:04.894156  5023 catalog_manager.cc:5697] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:13:04.897967  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 46789.7us
I20260709 12:13:04.898380  5837 raft_consensus.cc:1275] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:04.898602  5117 raft_consensus.cc:1275] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:04.900287  6071 consensus_queue.cc:1048] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:04.901114  6020 consensus_queue.cc:1048] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:04.847419  6073 consensus_queue.cc:237] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:04.911700  6063 raft_consensus.cc:2955] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e794b72ed7640219f90ec4232363929 (127.3.212.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:04.924651  5837 raft_consensus.cc:2955] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e794b72ed7640219f90ec4232363929 (127.3.212.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:04.924631  5125 raft_consensus.cc:2955] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e794b72ed7640219f90ec4232363929 (127.3.212.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:04.951752  5022 catalog_manager.cc:5697] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: config changed from index 3 to 4, VOTER 9e794b72ed7640219f90ec4232363929 (127.3.212.131) evicted. New cstate: current_term: 1 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:04.954315  5007 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 21832120214f4b8fb9e2e0de351565f0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:04.968933  5265 raft_consensus.cc:2955] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:04.971246  5263 tablet_service.cc:1558] Processing DeleteTablet for tablet 21832120214f4b8fb9e2e0de351565f0 with delete_type TABLET_DATA_TOMBSTONED (TS 9e794b72ed7640219f90ec4232363929 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34668
I20260709 12:13:04.976322  5125 consensus_queue.cc:237] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:04.978722  5196 raft_consensus.cc:1275] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:04.979239  6085 tablet_replica.cc:333] T 21832120214f4b8fb9e2e0de351565f0 P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
I20260709 12:13:04.980583  6085 raft_consensus.cc:2243] T 21832120214f4b8fb9e2e0de351565f0 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:04.981992  6070 consensus_queue.cc:1048] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:04.985952  5837 raft_consensus.cc:1275] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:04.991683  5272 raft_consensus.cc:1275] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:04.994962  6085 raft_consensus.cc:2272] T 21832120214f4b8fb9e2e0de351565f0 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:04.995656  6058 consensus_queue.cc:1048] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:04.992419  5836 raft_consensus.cc:1275] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:04.997063  5125 raft_consensus.cc:1275] T 89852cae0bd14fd8be73b84dc4a49b2a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:05.001269  5196 consensus_queue.cc:237] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:05.008013  6070 consensus_queue.cc:1048] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:05.008734  6058 consensus_queue.cc:1048] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:05.013983  6069 consensus_queue.cc:1048] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:05.016467  6057 raft_consensus.cc:2955] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:05.019626  6085 ts_tablet_manager.cc:1916] T 21832120214f4b8fb9e2e0de351565f0 P 9e794b72ed7640219f90ec4232363929: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:05.021539  5837 raft_consensus.cc:2955] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:05.027408  5266 raft_consensus.cc:1275] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:05.045290  6085 ts_tablet_manager.cc:1929] T 21832120214f4b8fb9e2e0de351565f0 P 9e794b72ed7640219f90ec4232363929: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:05.045944  6085 log.cc:1199] T 21832120214f4b8fb9e2e0de351565f0 P 9e794b72ed7640219f90ec4232363929: Deleting WAL directory at /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/ts-2-root/wals/21832120214f4b8fb9e2e0de351565f0
I20260709 12:13:05.044761  6075 raft_consensus.cc:2955] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:05.048029  5007 catalog_manager.cc:5028] TS 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): tablet 21832120214f4b8fb9e2e0de351565f0 (table test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]) successfully deleted
I20260709 12:13:05.045161  5836 raft_consensus.cc:1275] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:05.050769  5022 catalog_manager.cc:5697] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: config changed from index 3 to 4, VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) evicted. New cstate: current_term: 1 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:05.053539  6071 consensus_queue.cc:1048] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:05.054353  5010 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9212b0f778ec4455b8054add86b66d78 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:05.056900  5196 raft_consensus.cc:2955] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:05.076340  5186 tablet_service.cc:1558] Processing DeleteTablet for tablet 9212b0f778ec4455b8054add86b66d78 with delete_type TABLET_DATA_TOMBSTONED (TS dd62e75bd3ed4ed28f1fb5955d650808 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47718
I20260709 12:13:05.078791  6020 raft_consensus.cc:2955] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:05.091820  5117 raft_consensus.cc:2955] T 89852cae0bd14fd8be73b84dc4a49b2a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:05.099154  6072 consensus_queue.cc:1048] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:05.105847  5838 raft_consensus.cc:2955] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:05.113009  5023 catalog_manager.cc:5697] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:05.115685  5007 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 90cb6c9306054ce3b2bc1bbd21c7345f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:05.123010  5267 raft_consensus.cc:2955] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:05.218158  5837 raft_consensus.cc:2955] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:05.234920  5021 catalog_manager.cc:5697] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 reported cstate change: config changed from index 3 to 4, VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) evicted. New cstate: current_term: 1 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:05.249122  5267 raft_consensus.cc:2955] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:05.256012  6089 tablet_replica.cc:333] T 9212b0f778ec4455b8054add86b66d78 P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
I20260709 12:13:05.274228  6089 raft_consensus.cc:2243] T 9212b0f778ec4455b8054add86b66d78 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:05.287963  6089 raft_consensus.cc:2272] T 9212b0f778ec4455b8054add86b66d78 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:05.304029  6089 ts_tablet_manager.cc:1916] T 9212b0f778ec4455b8054add86b66d78 P dd62e75bd3ed4ed28f1fb5955d650808: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:05.307438  5265 consensus_queue.cc:237] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:05.316730  5196 raft_consensus.cc:1275] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:05.319415  5837 raft_consensus.cc:1275] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:05.324554  6069 consensus_queue.cc:1048] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:05.331120  6089 ts_tablet_manager.cc:1929] T 9212b0f778ec4455b8054add86b66d78 P dd62e75bd3ed4ed28f1fb5955d650808: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:05.341611  6089 log.cc:1199] T 9212b0f778ec4455b8054add86b66d78 P dd62e75bd3ed4ed28f1fb5955d650808: Deleting WAL directory at /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/ts-1-root/wals/9212b0f778ec4455b8054add86b66d78
I20260709 12:13:05.343744  5007 catalog_manager.cc:5028] TS dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): tablet 9212b0f778ec4455b8054add86b66d78 (table test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]) successfully deleted
I20260709 12:13:05.335234  6069 consensus_queue.cc:1048] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:05.346777  5108 tablet_service.cc:1558] Processing DeleteTablet for tablet 90cb6c9306054ce3b2bc1bbd21c7345f with delete_type TABLET_DATA_TOMBSTONED (TS ad2f9a1e2f7a45429fa69fd23d09f821 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40378
I20260709 12:13:05.347486  6070 raft_consensus.cc:2955] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:05.357720  5837 raft_consensus.cc:2955] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:05.374531  5007 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 89852cae0bd14fd8be73b84dc4a49b2a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:05.379192  6091 tablet_replica.cc:333] T 90cb6c9306054ce3b2bc1bbd21c7345f P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:13:05.380586  6091 raft_consensus.cc:2243] T 90cb6c9306054ce3b2bc1bbd21c7345f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:05.381484  6091 raft_consensus.cc:2272] T 90cb6c9306054ce3b2bc1bbd21c7345f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:05.385456  6091 ts_tablet_manager.cc:1916] T 90cb6c9306054ce3b2bc1bbd21c7345f P ad2f9a1e2f7a45429fa69fd23d09f821: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:05.387130  5196 raft_consensus.cc:2955] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:05.389284  5021 catalog_manager.cc:5697] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 reported cstate change: config changed from index 3 to 4, VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) evicted. New cstate: current_term: 1 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:05.406488  6091 ts_tablet_manager.cc:1929] T 90cb6c9306054ce3b2bc1bbd21c7345f P ad2f9a1e2f7a45429fa69fd23d09f821: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:05.407163  6091 log.cc:1199] T 90cb6c9306054ce3b2bc1bbd21c7345f P ad2f9a1e2f7a45429fa69fd23d09f821: Deleting WAL directory at /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/ts-0-root/wals/90cb6c9306054ce3b2bc1bbd21c7345f
I20260709 12:13:05.422099  5010 catalog_manager.cc:5028] TS ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): tablet 90cb6c9306054ce3b2bc1bbd21c7345f (table test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]) successfully deleted
I20260709 12:13:05.426584  5108 tablet_service.cc:1558] Processing DeleteTablet for tablet 89852cae0bd14fd8be73b84dc4a49b2a with delete_type TABLET_DATA_TOMBSTONED (TS ad2f9a1e2f7a45429fa69fd23d09f821 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40378
I20260709 12:13:05.427390  6091 tablet_replica.cc:333] T 89852cae0bd14fd8be73b84dc4a49b2a P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:13:05.428093  6091 raft_consensus.cc:2243] T 89852cae0bd14fd8be73b84dc4a49b2a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:05.428591  6091 raft_consensus.cc:2272] T 89852cae0bd14fd8be73b84dc4a49b2a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:05.431219  6091 ts_tablet_manager.cc:1916] T 89852cae0bd14fd8be73b84dc4a49b2a P ad2f9a1e2f7a45429fa69fd23d09f821: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:05.442375  6091 ts_tablet_manager.cc:1929] T 89852cae0bd14fd8be73b84dc4a49b2a P ad2f9a1e2f7a45429fa69fd23d09f821: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:05.442685  6091 log.cc:1199] T 89852cae0bd14fd8be73b84dc4a49b2a P ad2f9a1e2f7a45429fa69fd23d09f821: Deleting WAL directory at /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/ts-0-root/wals/89852cae0bd14fd8be73b84dc4a49b2a
I20260709 12:13:05.443907  5010 catalog_manager.cc:5028] TS ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): tablet 89852cae0bd14fd8be73b84dc4a49b2a (table test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]) successfully deleted
W20260709 12:13:06.997895  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 55216.1us
I20260709 12:13:07.050671  5197 consensus_queue.cc:237] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
W20260709 12:13:07.068857  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 138193us
I20260709 12:13:07.068789  5122 raft_consensus.cc:1275] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:07.073916  6104 consensus_queue.cc:1048] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:07.110113  5269 raft_consensus.cc:1275] T ed974c2bf41a490ca098100bdfc63351 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:07.127787  6104 consensus_queue.cc:1048] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:07.135252  6099 raft_consensus.cc:2955] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:07.141094  5122 raft_consensus.cc:2955] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:07.146489  5267 raft_consensus.cc:2955] T ed974c2bf41a490ca098100bdfc63351 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
W20260709 12:13:07.167464  5164 consensus_peers.cc:597] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Couldn't send request to peer bce73265e27d4b30a4dcc1e491305088. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ed974c2bf41a490ca098100bdfc63351. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:07.170083  5019 catalog_manager.cc:5697] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New cstate: current_term: 1 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:07.175210  5125 consensus_queue.cc:237] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:07.184932  5267 raft_consensus.cc:1275] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:07.186568  6031 consensus_queue.cc:1048] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:07.190382  5197 raft_consensus.cc:1275] T 56627990da7d49f7a12669f23294a596 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:07.191947  6103 consensus_queue.cc:1048] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:13:07.194674  5089 consensus_peers.cc:597] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 -> Peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Couldn't send request to peer bce73265e27d4b30a4dcc1e491305088. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 56627990da7d49f7a12669f23294a596. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:07.204811  6031 raft_consensus.cc:2955] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:07.210989  5267 raft_consensus.cc:2955] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:07.216351  5196 raft_consensus.cc:2955] T 56627990da7d49f7a12669f23294a596 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:07.236599  5022 catalog_manager.cc:5697] T 56627990da7d49f7a12669f23294a596 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New cstate: current_term: 1 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:07.242654  5197 consensus_queue.cc:237] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
W20260709 12:13:07.250949  5164 consensus_peers.cc:597] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Couldn't send request to peer bce73265e27d4b30a4dcc1e491305088. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a975d4f227214562b6fc39ea53081961. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:07.251650  5267 raft_consensus.cc:1275] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:07.252944  5125 raft_consensus.cc:1275] T a975d4f227214562b6fc39ea53081961 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:07.254377  6099 consensus_queue.cc:1048] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:07.255225  6104 consensus_queue.cc:1048] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:07.264997  6020 raft_consensus.cc:2955] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:07.267248  5125 raft_consensus.cc:2955] T a975d4f227214562b6fc39ea53081961 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:07.271852  5267 raft_consensus.cc:2955] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:07.291345  5125 consensus_queue.cc:237] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:07.301849  5022 catalog_manager.cc:5697] T a975d4f227214562b6fc39ea53081961 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New cstate: current_term: 1 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:07.307394  5197 raft_consensus.cc:1275] T 45e701f062f14e4e80492fc08144cca6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:13:07.307498  5089 consensus_peers.cc:597] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 -> Peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Couldn't send request to peer bce73265e27d4b30a4dcc1e491305088. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 45e701f062f14e4e80492fc08144cca6. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:07.308964  6103 consensus_queue.cc:1048] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:07.320487  5267 raft_consensus.cc:1275] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:07.322216  6103 consensus_queue.cc:1048] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:07.330433  6103 raft_consensus.cc:2955] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:07.331736  5196 raft_consensus.cc:2955] T 45e701f062f14e4e80492fc08144cca6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:07.348121  5267 raft_consensus.cc:2955] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:07.356887  5019 catalog_manager.cc:5697] T 45e701f062f14e4e80492fc08144cca6 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New cstate: current_term: 1 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:07.466194  6124 ts_tablet_manager.cc:933] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088: Initiating tablet copy from peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:07.478353  6124 tablet_copy_client.cc:323] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Beginning tablet copy session from remote peer at address 127.3.212.130:44455
I20260709 12:13:07.480545  5210 tablet_copy_service.cc:140] P dd62e75bd3ed4ed28f1fb5955d650808: Received BeginTabletCopySession request for tablet ed974c2bf41a490ca098100bdfc63351 from peer bce73265e27d4b30a4dcc1e491305088 ({username='slave'} at 127.0.0.1:41416)
I20260709 12:13:07.481125  5210 tablet_copy_service.cc:161] P dd62e75bd3ed4ed28f1fb5955d650808: Beginning new tablet copy session on tablet ed974c2bf41a490ca098100bdfc63351 from peer bce73265e27d4b30a4dcc1e491305088 at {username='slave'} at 127.0.0.1:41416: session id = bce73265e27d4b30a4dcc1e491305088-ed974c2bf41a490ca098100bdfc63351
I20260709 12:13:07.509889  5210 tablet_copy_source_session.cc:215] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:07.516976  6124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed974c2bf41a490ca098100bdfc63351. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.537190  6124 tablet_copy_client.cc:806] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:07.542997  6124 tablet_copy_client.cc:670] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:07.548659  6124 tablet_copy_client.cc:538] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:07.559851  6124 tablet_bootstrap.cc:492] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088: Bootstrap starting.
I20260709 12:13:07.594228  6124 tablet_bootstrap.cc:492] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:07.595129  6124 tablet_bootstrap.cc:492] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088: Bootstrap complete.
I20260709 12:13:07.596102  6124 ts_tablet_manager.cc:1403] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088: Time spent bootstrapping tablet: real 0.037s	user 0.019s	sys 0.011s
I20260709 12:13:07.601778  6124 raft_consensus.cc:359] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:07.602630  6124 raft_consensus.cc:740] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Initialized, Role: LEARNER
I20260709 12:13:07.603313  6124 consensus_queue.cc:260] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:07.619765  6124 ts_tablet_manager.cc:1434] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088: Time spent starting tablet: real 0.023s	user 0.016s	sys 0.004s
I20260709 12:13:07.622826  5210 tablet_copy_service.cc:342] P dd62e75bd3ed4ed28f1fb5955d650808: Request end of tablet copy session bce73265e27d4b30a4dcc1e491305088-ed974c2bf41a490ca098100bdfc63351 received from {username='slave'} at 127.0.0.1:41416
I20260709 12:13:07.623351  5210 tablet_copy_service.cc:434] P dd62e75bd3ed4ed28f1fb5955d650808: ending tablet copy session bce73265e27d4b30a4dcc1e491305088-ed974c2bf41a490ca098100bdfc63351 on tablet ed974c2bf41a490ca098100bdfc63351 with peer bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:07.679404  6124 ts_tablet_manager.cc:933] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088: Initiating tablet copy from peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443)
I20260709 12:13:07.682694  6124 tablet_copy_client.cc:323] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Beginning tablet copy session from remote peer at address 127.3.212.129:34443
I20260709 12:13:07.684489  5135 tablet_copy_service.cc:140] P ad2f9a1e2f7a45429fa69fd23d09f821: Received BeginTabletCopySession request for tablet 56627990da7d49f7a12669f23294a596 from peer bce73265e27d4b30a4dcc1e491305088 ({username='slave'} at 127.0.0.1:59390)
I20260709 12:13:07.684935  5135 tablet_copy_service.cc:161] P ad2f9a1e2f7a45429fa69fd23d09f821: Beginning new tablet copy session on tablet 56627990da7d49f7a12669f23294a596 from peer bce73265e27d4b30a4dcc1e491305088 at {username='slave'} at 127.0.0.1:59390: session id = bce73265e27d4b30a4dcc1e491305088-56627990da7d49f7a12669f23294a596
I20260709 12:13:07.690393  5135 tablet_copy_source_session.cc:215] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:07.693014  6124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56627990da7d49f7a12669f23294a596. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.706315  6124 tablet_copy_client.cc:806] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:07.706905  6124 tablet_copy_client.cc:670] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:07.710323  6124 tablet_copy_client.cc:538] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:07.721184  6124 tablet_bootstrap.cc:492] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088: Bootstrap starting.
I20260709 12:13:07.746075  6124 tablet_bootstrap.cc:492] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:07.748320  6124 tablet_bootstrap.cc:492] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088: Bootstrap complete.
I20260709 12:13:07.749017  6124 ts_tablet_manager.cc:1403] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088: Time spent bootstrapping tablet: real 0.028s	user 0.020s	sys 0.004s
I20260709 12:13:07.751989  6124 raft_consensus.cc:359] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:07.752907  6124 raft_consensus.cc:740] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Initialized, Role: LEARNER
I20260709 12:13:07.754227  6130 ts_tablet_manager.cc:933] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088: Initiating tablet copy from peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:07.753607  6124 consensus_queue.cc:260] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:07.755949  6130 tablet_copy_client.cc:323] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Beginning tablet copy session from remote peer at address 127.3.212.130:44455
I20260709 12:13:07.756321  6124 ts_tablet_manager.cc:1434] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:13:07.758015  5135 tablet_copy_service.cc:342] P ad2f9a1e2f7a45429fa69fd23d09f821: Request end of tablet copy session bce73265e27d4b30a4dcc1e491305088-56627990da7d49f7a12669f23294a596 received from {username='slave'} at 127.0.0.1:59390
I20260709 12:13:07.758402  5135 tablet_copy_service.cc:434] P ad2f9a1e2f7a45429fa69fd23d09f821: ending tablet copy session bce73265e27d4b30a4dcc1e491305088-56627990da7d49f7a12669f23294a596 on tablet 56627990da7d49f7a12669f23294a596 with peer bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:07.759438  5210 tablet_copy_service.cc:140] P dd62e75bd3ed4ed28f1fb5955d650808: Received BeginTabletCopySession request for tablet a975d4f227214562b6fc39ea53081961 from peer bce73265e27d4b30a4dcc1e491305088 ({username='slave'} at 127.0.0.1:41416)
I20260709 12:13:07.760015  5210 tablet_copy_service.cc:161] P dd62e75bd3ed4ed28f1fb5955d650808: Beginning new tablet copy session on tablet a975d4f227214562b6fc39ea53081961 from peer bce73265e27d4b30a4dcc1e491305088 at {username='slave'} at 127.0.0.1:41416: session id = bce73265e27d4b30a4dcc1e491305088-a975d4f227214562b6fc39ea53081961
I20260709 12:13:07.766340  5210 tablet_copy_source_session.cc:215] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:07.770141  6130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a975d4f227214562b6fc39ea53081961. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.787504  6130 tablet_copy_client.cc:806] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:07.788106  6130 tablet_copy_client.cc:670] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:07.792039  6130 tablet_copy_client.cc:538] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:07.798558  6130 tablet_bootstrap.cc:492] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088: Bootstrap starting.
I20260709 12:13:07.817101  6130 tablet_bootstrap.cc:492] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:07.817898  6124 ts_tablet_manager.cc:933] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088: Initiating tablet copy from peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443)
I20260709 12:13:07.818207  6130 tablet_bootstrap.cc:492] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088: Bootstrap complete.
I20260709 12:13:07.819129  6130 ts_tablet_manager.cc:1403] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.004s
I20260709 12:13:07.822566  6130 raft_consensus.cc:359] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:07.823572  6130 raft_consensus.cc:740] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Initialized, Role: LEARNER
I20260709 12:13:07.824339  6130 consensus_queue.cc:260] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:07.827049  6130 ts_tablet_manager.cc:1434] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:13:07.829800  5210 tablet_copy_service.cc:342] P dd62e75bd3ed4ed28f1fb5955d650808: Request end of tablet copy session bce73265e27d4b30a4dcc1e491305088-a975d4f227214562b6fc39ea53081961 received from {username='slave'} at 127.0.0.1:41416
I20260709 12:13:07.830333  5210 tablet_copy_service.cc:434] P dd62e75bd3ed4ed28f1fb5955d650808: ending tablet copy session bce73265e27d4b30a4dcc1e491305088-a975d4f227214562b6fc39ea53081961 on tablet a975d4f227214562b6fc39ea53081961 with peer bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:07.833074  6124 tablet_copy_client.cc:323] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Beginning tablet copy session from remote peer at address 127.3.212.129:34443
I20260709 12:13:07.836660  5135 tablet_copy_service.cc:140] P ad2f9a1e2f7a45429fa69fd23d09f821: Received BeginTabletCopySession request for tablet 45e701f062f14e4e80492fc08144cca6 from peer bce73265e27d4b30a4dcc1e491305088 ({username='slave'} at 127.0.0.1:59390)
I20260709 12:13:07.837252  5135 tablet_copy_service.cc:161] P ad2f9a1e2f7a45429fa69fd23d09f821: Beginning new tablet copy session on tablet 45e701f062f14e4e80492fc08144cca6 from peer bce73265e27d4b30a4dcc1e491305088 at {username='slave'} at 127.0.0.1:59390: session id = bce73265e27d4b30a4dcc1e491305088-45e701f062f14e4e80492fc08144cca6
I20260709 12:13:07.849277  5135 tablet_copy_source_session.cc:215] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:07.852819  6124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45e701f062f14e4e80492fc08144cca6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:07.876652  6124 tablet_copy_client.cc:806] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:07.877213  6124 tablet_copy_client.cc:670] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:07.880604  6124 tablet_copy_client.cc:538] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:07.889591  6124 tablet_bootstrap.cc:492] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088: Bootstrap starting.
I20260709 12:13:07.909241  6124 tablet_bootstrap.cc:492] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:07.910243  6124 tablet_bootstrap.cc:492] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088: Bootstrap complete.
I20260709 12:13:07.910936  6124 ts_tablet_manager.cc:1403] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088: Time spent bootstrapping tablet: real 0.022s	user 0.020s	sys 0.004s
I20260709 12:13:07.913637  6124 raft_consensus.cc:359] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:07.914453  6124 raft_consensus.cc:740] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Initialized, Role: LEARNER
I20260709 12:13:07.915050  6124 consensus_queue.cc:260] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:07.921955  6124 ts_tablet_manager.cc:1434] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:13:07.923815  5135 tablet_copy_service.cc:342] P ad2f9a1e2f7a45429fa69fd23d09f821: Request end of tablet copy session bce73265e27d4b30a4dcc1e491305088-45e701f062f14e4e80492fc08144cca6 received from {username='slave'} at 127.0.0.1:59390
I20260709 12:13:07.924259  5135 tablet_copy_service.cc:434] P ad2f9a1e2f7a45429fa69fd23d09f821: ending tablet copy session bce73265e27d4b30a4dcc1e491305088-45e701f062f14e4e80492fc08144cca6 on tablet 45e701f062f14e4e80492fc08144cca6 with peer bce73265e27d4b30a4dcc1e491305088
W20260709 12:13:08.025097  5221 debug-util.cc:398] Leaking SignalData structure 0x7b080016b300 after lost signal to thread 3925
W20260709 12:13:08.026296  5221 debug-util.cc:398] Leaking SignalData structure 0x7b080016b9e0 after lost signal to thread 5057
W20260709 12:13:08.027185  5221 debug-util.cc:398] Leaking SignalData structure 0x7b080028d020 after lost signal to thread 5149
W20260709 12:13:08.028216  5221 debug-util.cc:398] Leaking SignalData structure 0x7b0800323b40 after lost signal to thread 5224
W20260709 12:13:08.029259  5221 debug-util.cc:398] Leaking SignalData structure 0x7b080030c6c0 after lost signal to thread 5298
W20260709 12:13:08.030372  5221 debug-util.cc:398] Leaking SignalData structure 0x7b080031cfa0 after lost signal to thread 5862
I20260709 12:13:08.051172  5837 raft_consensus.cc:1217] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:08.176318  5837 raft_consensus.cc:1217] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:08.275352  5837 raft_consensus.cc:1217] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:08.377620  5837 raft_consensus.cc:1217] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:08.486696  6020 raft_consensus.cc:1064] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808: attempting to promote NON_VOTER bce73265e27d4b30a4dcc1e491305088 to VOTER
I20260709 12:13:08.489024  6020 consensus_queue.cc:237] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:08.504033  5837 raft_consensus.cc:1275] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:08.506593  6099 consensus_queue.cc:1048] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:08.509879  5125 raft_consensus.cc:1275] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:08.510386  5266 raft_consensus.cc:1275] T ed974c2bf41a490ca098100bdfc63351 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:08.512537  6098 consensus_queue.cc:1048] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:08.530333  6020 consensus_queue.cc:1048] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:08.538108  6104 raft_consensus.cc:2955] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:08.560549  5838 raft_consensus.cc:2955] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:08.561015  5266 raft_consensus.cc:2955] T ed974c2bf41a490ca098100bdfc63351 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:08.574970  5019 catalog_manager.cc:5697] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:08.583011  5125 raft_consensus.cc:2955] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:08.667454  5196 consensus_queue.cc:237] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:08.674430  5838 raft_consensus.cc:1275] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:08.676352  6098 consensus_queue.cc:1048] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:08.697139  6140 raft_consensus.cc:2955] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e794b72ed7640219f90ec4232363929 (127.3.212.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:08.701264  6093 raft_consensus.cc:1064] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821: attempting to promote NON_VOTER bce73265e27d4b30a4dcc1e491305088 to VOTER
I20260709 12:13:08.714658  5007 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ed974c2bf41a490ca098100bdfc63351 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:08.708931  5838 raft_consensus.cc:2955] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e794b72ed7640219f90ec4232363929 (127.3.212.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:08.740499  5023 catalog_manager.cc:5697] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: config changed from index 3 to 4, VOTER 9e794b72ed7640219f90ec4232363929 (127.3.212.131) evicted. New cstate: current_term: 1 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:08.744441  6093 consensus_queue.cc:237] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:08.753692  5263 tablet_service.cc:1558] Processing DeleteTablet for tablet ed974c2bf41a490ca098100bdfc63351 with delete_type TABLET_DATA_TOMBSTONED (TS 9e794b72ed7640219f90ec4232363929 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34668
W20260709 12:13:08.752656  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 56143.7us
I20260709 12:13:08.755712  6148 tablet_replica.cc:333] T ed974c2bf41a490ca098100bdfc63351 P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
I20260709 12:13:08.756861  6148 raft_consensus.cc:2243] T ed974c2bf41a490ca098100bdfc63351 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:08.757704  6148 raft_consensus.cc:2272] T ed974c2bf41a490ca098100bdfc63351 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:08.765029  5125 raft_consensus.cc:1275] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:08.766897  6148 ts_tablet_manager.cc:1916] T ed974c2bf41a490ca098100bdfc63351 P 9e794b72ed7640219f90ec4232363929: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:08.772567  6140 consensus_queue.cc:1048] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:08.811638  6140 raft_consensus.cc:1064] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808: attempting to promote NON_VOTER bce73265e27d4b30a4dcc1e491305088 to VOTER
I20260709 12:13:08.814419  5267 raft_consensus.cc:1275] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:08.814388  6140 consensus_queue.cc:237] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:08.816012  6031 consensus_queue.cc:1048] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:08.819564  5196 raft_consensus.cc:1275] T 56627990da7d49f7a12669f23294a596 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:08.820992  6031 consensus_queue.cc:1048] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:08.826936  5125 raft_consensus.cc:2955] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e794b72ed7640219f90ec4232363929 (127.3.212.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:08.845731  6148 ts_tablet_manager.cc:1929] T ed974c2bf41a490ca098100bdfc63351 P 9e794b72ed7640219f90ec4232363929: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:08.846951  6148 log.cc:1199] T ed974c2bf41a490ca098100bdfc63351 P 9e794b72ed7640219f90ec4232363929: Deleting WAL directory at /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/ts-2-root/wals/ed974c2bf41a490ca098100bdfc63351
I20260709 12:13:08.850155  5007 catalog_manager.cc:5028] TS 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): tablet ed974c2bf41a490ca098100bdfc63351 (table test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]) successfully deleted
I20260709 12:13:08.855031  6094 raft_consensus.cc:2955] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:08.867257  5267 raft_consensus.cc:2955] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:08.886255  5023 catalog_manager.cc:5697] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 reported cstate change: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:08.906059  5837 raft_consensus.cc:1275] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:08.947134  5196 raft_consensus.cc:2955] T 56627990da7d49f7a12669f23294a596 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:08.950981  6031 consensus_queue.cc:1048] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:08.957695  6093 raft_consensus.cc:1064] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821: attempting to promote NON_VOTER bce73265e27d4b30a4dcc1e491305088 to VOTER
I20260709 12:13:08.960451  6093 consensus_queue.cc:237] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:08.964758  5838 raft_consensus.cc:1275] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:08.966358  6104 consensus_queue.cc:1048] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:08.979624  5266 raft_consensus.cc:1275] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:08.982908  6140 consensus_queue.cc:1048] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:09.008999  5125 raft_consensus.cc:1275] T a975d4f227214562b6fc39ea53081961 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:09.026930  6140 consensus_queue.cc:1048] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:09.031644  5838 raft_consensus.cc:2955] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:09.044556  5267 raft_consensus.cc:1275] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:09.047834  6152 consensus_queue.cc:1048] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:13:09.050856  5836 raft_consensus.cc:1275] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:09.049263  5196 raft_consensus.cc:1275] T 45e701f062f14e4e80492fc08144cca6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:09.058451  6146 consensus_queue.cc:1048] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:09.062284  5266 raft_consensus.cc:2955] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:09.057709  6020 raft_consensus.cc:2955] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:09.069084  6158 consensus_queue.cc:1048] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:13:09.104463  5023 catalog_manager.cc:5697] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 reported cstate change: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:09.112257  5838 raft_consensus.cc:2955] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:09.116222  6158 raft_consensus.cc:2955] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:09.124215  5196 raft_consensus.cc:2955] T 45e701f062f14e4e80492fc08144cca6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:09.158280  5022 catalog_manager.cc:5697] T 45e701f062f14e4e80492fc08144cca6 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:09.176380  5838 raft_consensus.cc:2955] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:09.182561  5125 raft_consensus.cc:2955] T a975d4f227214562b6fc39ea53081961 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:09.186995  5267 raft_consensus.cc:2955] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:09.197592  5199 consensus_queue.cc:237] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:09.210110  5266 raft_consensus.cc:1275] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:09.212384  6098 consensus_queue.cc:1048] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:09.220192  5122 consensus_queue.cc:237] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:09.223541  6098 raft_consensus.cc:2955] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:09.226846  5266 raft_consensus.cc:2955] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:09.231504  5836 raft_consensus.cc:1275] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:09.239512  6093 consensus_queue.cc:1048] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:09.243839  5272 raft_consensus.cc:1275] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:09.248886  6146 raft_consensus.cc:2955] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:09.256040  5836 raft_consensus.cc:2955] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:09.257887  5007 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a975d4f227214562b6fc39ea53081961 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:09.268579  6094 consensus_queue.cc:1048] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:09.274741  5265 raft_consensus.cc:2955] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:09.214690  5838 raft_consensus.cc:1275] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:09.279348  6099 consensus_queue.cc:1048] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:09.279374  5010 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 45e701f062f14e4e80492fc08144cca6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:09.287058  5023 catalog_manager.cc:5697] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: config changed from index 3 to 4, VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) evicted. New cstate: current_term: 1 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:09.288471  5022 catalog_manager.cc:5697] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: config changed from index 3 to 4, VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) evicted. New cstate: current_term: 1 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:09.290457  5838 raft_consensus.cc:2955] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:09.302729  5186 tablet_service.cc:1558] Processing DeleteTablet for tablet 45e701f062f14e4e80492fc08144cca6 with delete_type TABLET_DATA_TOMBSTONED (TS dd62e75bd3ed4ed28f1fb5955d650808 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47718
I20260709 12:13:09.321496  5108 tablet_service.cc:1558] Processing DeleteTablet for tablet a975d4f227214562b6fc39ea53081961 with delete_type TABLET_DATA_TOMBSTONED (TS ad2f9a1e2f7a45429fa69fd23d09f821 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40378
I20260709 12:13:09.358755  6163 tablet_replica.cc:333] T 45e701f062f14e4e80492fc08144cca6 P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
I20260709 12:13:09.360157  6164 tablet_replica.cc:333] T a975d4f227214562b6fc39ea53081961 P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:13:09.366575  6164 raft_consensus.cc:2243] T a975d4f227214562b6fc39ea53081961 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:09.371299  6164 raft_consensus.cc:2272] T a975d4f227214562b6fc39ea53081961 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:09.373837  6163 raft_consensus.cc:2243] T 45e701f062f14e4e80492fc08144cca6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:09.375516  6163 raft_consensus.cc:2272] T 45e701f062f14e4e80492fc08144cca6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:09.379289  6163 ts_tablet_manager.cc:1916] T 45e701f062f14e4e80492fc08144cca6 P dd62e75bd3ed4ed28f1fb5955d650808: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:09.383098  6164 ts_tablet_manager.cc:1916] T a975d4f227214562b6fc39ea53081961 P ad2f9a1e2f7a45429fa69fd23d09f821: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:09.400111  6164 ts_tablet_manager.cc:1929] T a975d4f227214562b6fc39ea53081961 P ad2f9a1e2f7a45429fa69fd23d09f821: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:09.400534  6164 log.cc:1199] T a975d4f227214562b6fc39ea53081961 P ad2f9a1e2f7a45429fa69fd23d09f821: Deleting WAL directory at /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/ts-0-root/wals/a975d4f227214562b6fc39ea53081961
I20260709 12:13:09.402377  5010 catalog_manager.cc:5028] TS ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): tablet a975d4f227214562b6fc39ea53081961 (table test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]) successfully deleted
I20260709 12:13:09.408584  6163 ts_tablet_manager.cc:1929] T 45e701f062f14e4e80492fc08144cca6 P dd62e75bd3ed4ed28f1fb5955d650808: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:09.409058  6163 log.cc:1199] T 45e701f062f14e4e80492fc08144cca6 P dd62e75bd3ed4ed28f1fb5955d650808: Deleting WAL directory at /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/ts-1-root/wals/45e701f062f14e4e80492fc08144cca6
I20260709 12:13:09.411137  5007 catalog_manager.cc:5028] TS dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): tablet 45e701f062f14e4e80492fc08144cca6 (table test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]) successfully deleted
I20260709 12:13:09.439879  5122 consensus_queue.cc:237] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:09.444995  5838 raft_consensus.cc:1275] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:09.445017  5265 raft_consensus.cc:1275] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:09.447536  6093 consensus_queue.cc:1048] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:09.452662  6093 consensus_queue.cc:1048] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:09.459964  6146 raft_consensus.cc:2955] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:09.461612  5838 raft_consensus.cc:2955] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:09.467316  5265 raft_consensus.cc:2955] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:09.472605  5010 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 56627990da7d49f7a12669f23294a596 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:09.480037  5023 catalog_manager.cc:5697] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: config changed from index 3 to 4, VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) evicted. New cstate: current_term: 1 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:09.497193  5186 tablet_service.cc:1558] Processing DeleteTablet for tablet 56627990da7d49f7a12669f23294a596 with delete_type TABLET_DATA_TOMBSTONED (TS dd62e75bd3ed4ed28f1fb5955d650808 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47718
I20260709 12:13:09.498216  6163 tablet_replica.cc:333] T 56627990da7d49f7a12669f23294a596 P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
I20260709 12:13:09.499269  6163 raft_consensus.cc:2243] T 56627990da7d49f7a12669f23294a596 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:09.499943  6163 raft_consensus.cc:2272] T 56627990da7d49f7a12669f23294a596 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:09.507331  6163 ts_tablet_manager.cc:1916] T 56627990da7d49f7a12669f23294a596 P dd62e75bd3ed4ed28f1fb5955d650808: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:09.525425  6163 ts_tablet_manager.cc:1929] T 56627990da7d49f7a12669f23294a596 P dd62e75bd3ed4ed28f1fb5955d650808: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:09.525805  6163 log.cc:1199] T 56627990da7d49f7a12669f23294a596 P dd62e75bd3ed4ed28f1fb5955d650808: Deleting WAL directory at /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/ts-1-root/wals/56627990da7d49f7a12669f23294a596
I20260709 12:13:09.527673  5007 catalog_manager.cc:5028] TS dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): tablet 56627990da7d49f7a12669f23294a596 (table test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]) successfully deleted
I20260709 12:13:10.563920  5197 consensus_queue.cc:237] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
W20260709 12:13:10.572327  5164 consensus_peers.cc:597] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Couldn't send request to peer bce73265e27d4b30a4dcc1e491305088. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 00645b1f1e014de995e4a937f842d909. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:10.574065  5272 raft_consensus.cc:1275] T 00645b1f1e014de995e4a937f842d909 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:10.575747  5122 raft_consensus.cc:1275] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:10.576804  6104 consensus_queue.cc:1048] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:10.577958  6099 consensus_queue.cc:1048] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:10.595028  6099 raft_consensus.cc:2955] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:10.596982  5125 raft_consensus.cc:2955] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:10.603814  5272 raft_consensus.cc:2955] T 00645b1f1e014de995e4a937f842d909 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:10.662143  5272 consensus_queue.cc:237] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
W20260709 12:13:10.776999  5238 consensus_peers.cc:597] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 -> Peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Couldn't send request to peer bce73265e27d4b30a4dcc1e491305088. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e63d70b5bbd74a49be2a18fef7617e3e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:10.813601  5117 raft_consensus.cc:1275] T e63d70b5bbd74a49be2a18fef7617e3e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:10.818146  5200 raft_consensus.cc:1275] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:10.840914  6171 consensus_queue.cc:1048] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:10.835798  5019 catalog_manager.cc:5697] T 00645b1f1e014de995e4a937f842d909 P 9e794b72ed7640219f90ec4232363929 reported cstate change: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New cstate: current_term: 1 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
W20260709 12:13:10.894825  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 64554.2us
I20260709 12:13:10.895767  6172 consensus_queue.cc:1048] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:13:11.580792  5192 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.009s	sys 0.011s
W20260709 12:13:11.594038  5192 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.010s	sys 0.015s
W20260709 12:13:11.577171  5240 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.006s	sys 0.015s
W20260709 12:13:11.631078  5240 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.790s	user 0.008s	sys 0.015s
W20260709 12:13:11.631464  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 790215us
I20260709 12:13:11.639814  6178 raft_consensus.cc:2955] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
W20260709 12:13:11.728034  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 89849.6us
I20260709 12:13:11.823426  6183 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:11.824216  6183 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:11.826397  6183 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:11.830858  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:11.835680  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:11.837651  5088 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:11.838482  6182 raft_consensus.cc:2749] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:11.843575  6195 ts_tablet_manager.cc:933] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088: Initiating tablet copy from peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:13:11.847783  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 214844us
I20260709 12:13:11.849098  6195 tablet_copy_client.cc:323] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Beginning tablet copy session from remote peer at address 127.3.212.130:44455
W20260709 12:13:11.856343  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 226877us
W20260709 12:13:11.864686  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 135731us
I20260709 12:13:11.867892  6178 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:50926 (request call id 2) took 1238 ms. Trace:
I20260709 12:13:11.869401  5198 raft_consensus.cc:2955] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:11.870466  5210 tablet_copy_service.cc:140] P dd62e75bd3ed4ed28f1fb5955d650808: Received BeginTabletCopySession request for tablet 00645b1f1e014de995e4a937f842d909 from peer bce73265e27d4b30a4dcc1e491305088 ({username='slave'} at 127.0.0.1:41416)
I20260709 12:13:11.871037  5210 tablet_copy_service.cc:161] P dd62e75bd3ed4ed28f1fb5955d650808: Beginning new tablet copy session on tablet 00645b1f1e014de995e4a937f842d909 from peer bce73265e27d4b30a4dcc1e491305088 at {username='slave'} at 127.0.0.1:41416: session id = bce73265e27d4b30a4dcc1e491305088-00645b1f1e014de995e4a937f842d909
I20260709 12:13:11.904237  5210 tablet_copy_source_session.cc:215] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:11.910010  5023 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58198 (request call id 184) took 1243 ms. Trace:
I20260709 12:13:11.916141  5023 rpcz_store.cc:276] 0709 12:13:10.662568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:10.662690 (+   122us) service_pool.cc:224] Handling call
0709 12:13:11.905965 (+1243275us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":222787,"reported_tablets":4}
I20260709 12:13:11.868628  6178 rpcz_store.cc:276] 0709 12:13:10.629910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:10.638409 (+  8499us) service_pool.cc:224] Handling call
0709 12:13:10.665825 (+ 27416us) log.cc:844] Serialized 506 byte log entry
0709 12:13:11.867804 (+1201979us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":301,"raft.run_cpu_time_us":1792,"raft.run_wall_time_us":1791,"thread_start_us":107504,"threads_started":1,"wal-append.queue_time_us":107874}
I20260709 12:13:11.910894  5021 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33888 (request call id 201) took 1194 ms. Trace:
I20260709 12:13:11.918030  5021 rpcz_store.cc:276] 0709 12:13:10.716983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:10.717281 (+   298us) service_pool.cc:224] Handling call
0709 12:13:11.910833 (+1193552us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":136174,"reported_tablets":5}
I20260709 12:13:11.937135  6195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00645b1f1e014de995e4a937f842d909. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:11.945597  5021 catalog_manager.cc:5697] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New cstate: current_term: 1 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:11.963580  5192 consensus_queue.cc:237] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:11.969023  6199 ts_tablet_manager.cc:933] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088: Initiating tablet copy from peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:11.987952  6195 tablet_copy_client.cc:806] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:11.990006  6195 tablet_copy_client.cc:670] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:11.991094  5125 raft_consensus.cc:2955] T e63d70b5bbd74a49be2a18fef7617e3e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:11.991626  6199 tablet_copy_client.cc:323] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088: tablet copy: Beginning tablet copy session from remote peer at address 127.3.212.131:46709
I20260709 12:13:11.994645  6195 tablet_copy_client.cc:538] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:11.994926  5284 tablet_copy_service.cc:140] P 9e794b72ed7640219f90ec4232363929: Received BeginTabletCopySession request for tablet e63d70b5bbd74a49be2a18fef7617e3e from peer bce73265e27d4b30a4dcc1e491305088 ({username='slave'} at 127.0.0.1:50932)
I20260709 12:13:11.995442  5284 tablet_copy_service.cc:161] P 9e794b72ed7640219f90ec4232363929: Beginning new tablet copy session on tablet e63d70b5bbd74a49be2a18fef7617e3e from peer bce73265e27d4b30a4dcc1e491305088 at {username='slave'} at 127.0.0.1:50932: session id = bce73265e27d4b30a4dcc1e491305088-e63d70b5bbd74a49be2a18fef7617e3e
I20260709 12:13:12.011389  5284 tablet_copy_source_session.cc:215] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:12.013087  6195 tablet_bootstrap.cc:492] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088: Bootstrap starting.
W20260709 12:13:12.019263  3927 debug-util.cc:398] Leaking SignalData structure 0x7b080000f9a0 after lost signal to thread 5240
I20260709 12:13:12.021009  6199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e63d70b5bbd74a49be2a18fef7617e3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:12.042938  6199 tablet_copy_client.cc:806] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:12.043642  6199 tablet_copy_client.cc:670] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:12.045411  5273 raft_consensus.cc:1275] T 4d8224f2bf564e7197a33ee531527a15 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:12.047271  6170 consensus_queue.cc:1048] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:12.047775  5125 raft_consensus.cc:1275] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:12.049853  6170 consensus_queue.cc:1048] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:12.050483  6199 tablet_copy_client.cc:538] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:12.053777  6195 tablet_bootstrap.cc:492] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:12.054741  6195 tablet_bootstrap.cc:492] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088: Bootstrap complete.
I20260709 12:13:12.055456  6195 ts_tablet_manager.cc:1403] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088: Time spent bootstrapping tablet: real 0.043s	user 0.012s	sys 0.013s
W20260709 12:13:12.058708  5164 consensus_peers.cc:597] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Couldn't send request to peer bce73265e27d4b30a4dcc1e491305088. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4d8224f2bf564e7197a33ee531527a15. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:12.058642  6195 raft_consensus.cc:359] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:12.060132  6195 raft_consensus.cc:740] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Initialized, Role: LEARNER
I20260709 12:13:12.060855  6195 consensus_queue.cc:260] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
W20260709 12:13:12.072571  5146 debug-util.cc:398] Leaking SignalData structure 0x7b080011f500 after lost signal to thread 3925
W20260709 12:13:12.075111  5146 debug-util.cc:398] Leaking SignalData structure 0x7b08000c30a0 after lost signal to thread 5057
W20260709 12:13:12.076189  5146 debug-util.cc:398] Leaking SignalData structure 0x7b080019f020 after lost signal to thread 5149
W20260709 12:13:12.076452  5146 debug-util.cc:398] Leaking SignalData structure 0x7b080032d740 after lost signal to thread 5150
W20260709 12:13:12.077355  5146 debug-util.cc:398] Leaking SignalData structure 0x7b080032af40 after lost signal to thread 5224
W20260709 12:13:12.077687  5146 debug-util.cc:398] Leaking SignalData structure 0x7b0800242320 after lost signal to thread 5225
W20260709 12:13:12.078925  5146 debug-util.cc:398] Leaking SignalData structure 0x7b080018e4e0 after lost signal to thread 5298
W20260709 12:13:12.080155  5146 debug-util.cc:398] Leaking SignalData structure 0x7b080014b100 after lost signal to thread 5862
I20260709 12:13:12.083247  6195 ts_tablet_manager.cc:1434] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088: Time spent starting tablet: real 0.027s	user 0.013s	sys 0.001s
I20260709 12:13:12.065928  6199 tablet_bootstrap.cc:492] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088: Bootstrap starting.
I20260709 12:13:12.141928  5210 tablet_copy_service.cc:342] P dd62e75bd3ed4ed28f1fb5955d650808: Request end of tablet copy session bce73265e27d4b30a4dcc1e491305088-00645b1f1e014de995e4a937f842d909 received from {username='slave'} at 127.0.0.1:41416
I20260709 12:13:12.149490  5210 tablet_copy_service.cc:434] P dd62e75bd3ed4ed28f1fb5955d650808: ending tablet copy session bce73265e27d4b30a4dcc1e491305088-00645b1f1e014de995e4a937f842d909 on tablet 00645b1f1e014de995e4a937f842d909 with peer bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:12.152158  6170 raft_consensus.cc:2955] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:12.154103  5116 raft_consensus.cc:2955] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:12.177132  5273 raft_consensus.cc:2955] T 4d8224f2bf564e7197a33ee531527a15 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:12.194595  5266 consensus_queue.cc:237] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:12.207371  6199 tablet_bootstrap.cc:492] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:12.208384  6199 tablet_bootstrap.cc:492] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088: Bootstrap complete.
I20260709 12:13:12.209208  6199 ts_tablet_manager.cc:1403] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088: Time spent bootstrapping tablet: real 0.144s	user 0.005s	sys 0.020s
I20260709 12:13:12.212359  6199 raft_consensus.cc:359] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
W20260709 12:13:12.213196  5238 consensus_peers.cc:597] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 -> Peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Couldn't send request to peer bce73265e27d4b30a4dcc1e491305088. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2f01a696969543e4ba24b4a07185fce8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:12.213194  6199 raft_consensus.cc:740] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Initialized, Role: LEARNER
I20260709 12:13:12.214071  6199 consensus_queue.cc:260] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:12.215246  5116 raft_consensus.cc:1275] T 2f01a696969543e4ba24b4a07185fce8 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:12.216881  6197 consensus_queue.cc:1048] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:12.219586  5198 raft_consensus.cc:1275] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:12.219835  6199 ts_tablet_manager.cc:1434] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:13:12.223656  6186 consensus_queue.cc:1048] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:13:12.227216  5284 tablet_copy_service.cc:342] P 9e794b72ed7640219f90ec4232363929: Request end of tablet copy session bce73265e27d4b30a4dcc1e491305088-e63d70b5bbd74a49be2a18fef7617e3e received from {username='slave'} at 127.0.0.1:50932
I20260709 12:13:12.227738  5284 tablet_copy_service.cc:434] P 9e794b72ed7640219f90ec4232363929: ending tablet copy session bce73265e27d4b30a4dcc1e491305088-e63d70b5bbd74a49be2a18fef7617e3e on tablet e63d70b5bbd74a49be2a18fef7617e3e with peer bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:12.204738  5021 catalog_manager.cc:5697] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New cstate: current_term: 1 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:12.258597  6172 raft_consensus.cc:2955] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:12.268077  5116 raft_consensus.cc:2955] T 2f01a696969543e4ba24b4a07185fce8 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:12.283533  5192 raft_consensus.cc:2955] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:12.294670  5023 catalog_manager.cc:5697] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 reported cstate change: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New cstate: current_term: 1 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:12.434367  5834 raft_consensus.cc:1217] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:12.633013  5834 raft_consensus.cc:1217] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:12.655568  6199 ts_tablet_manager.cc:933] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088: Initiating tablet copy from peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:13:12.664943  5295 debug-util.cc:398] Leaking SignalData structure 0x7b080010d620 after lost signal to thread 3925
W20260709 12:13:12.665930  5295 debug-util.cc:398] Leaking SignalData structure 0x7b08001fa7c0 after lost signal to thread 5057
W20260709 12:13:12.666301  5295 debug-util.cc:398] Leaking SignalData structure 0x7b08000592e0 after lost signal to thread 5071
W20260709 12:13:12.667344  5295 debug-util.cc:398] Leaking SignalData structure 0x7b08002a8500 after lost signal to thread 5149
W20260709 12:13:12.653435  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 58594.7us
W20260709 12:13:12.668531  5295 debug-util.cc:398] Leaking SignalData structure 0x7b080024ca00 after lost signal to thread 5224
W20260709 12:13:12.669571  5295 debug-util.cc:398] Leaking SignalData structure 0x7b0800149480 after lost signal to thread 5298
W20260709 12:13:12.672888  5295 debug-util.cc:398] Leaking SignalData structure 0x7b08002939e0 after lost signal to thread 5862
I20260709 12:13:12.716572  6199 tablet_copy_client.cc:323] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Beginning tablet copy session from remote peer at address 127.3.212.130:44455
I20260709 12:13:12.720458  5210 tablet_copy_service.cc:140] P dd62e75bd3ed4ed28f1fb5955d650808: Received BeginTabletCopySession request for tablet 4d8224f2bf564e7197a33ee531527a15 from peer bce73265e27d4b30a4dcc1e491305088 ({username='slave'} at 127.0.0.1:41416)
I20260709 12:13:12.721127  5210 tablet_copy_service.cc:161] P dd62e75bd3ed4ed28f1fb5955d650808: Beginning new tablet copy session on tablet 4d8224f2bf564e7197a33ee531527a15 from peer bce73265e27d4b30a4dcc1e491305088 at {username='slave'} at 127.0.0.1:41416: session id = bce73265e27d4b30a4dcc1e491305088-4d8224f2bf564e7197a33ee531527a15
I20260709 12:13:12.730137  5210 tablet_copy_source_session.cc:215] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:12.738602  6199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d8224f2bf564e7197a33ee531527a15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:12.744505  6217 ts_tablet_manager.cc:933] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088: Initiating tablet copy from peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:12.765573  6199 tablet_copy_client.cc:806] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:12.771008  6199 tablet_copy_client.cc:670] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:12.775430  6199 tablet_copy_client.cc:538] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:12.787062  6199 tablet_bootstrap.cc:492] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088: Bootstrap starting.
I20260709 12:13:12.804644  6217 tablet_copy_client.cc:323] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Beginning tablet copy session from remote peer at address 127.3.212.131:46709
I20260709 12:13:12.808418  5284 tablet_copy_service.cc:140] P 9e794b72ed7640219f90ec4232363929: Received BeginTabletCopySession request for tablet 2f01a696969543e4ba24b4a07185fce8 from peer bce73265e27d4b30a4dcc1e491305088 ({username='slave'} at 127.0.0.1:50932)
I20260709 12:13:12.809031  5284 tablet_copy_service.cc:161] P 9e794b72ed7640219f90ec4232363929: Beginning new tablet copy session on tablet 2f01a696969543e4ba24b4a07185fce8 from peer bce73265e27d4b30a4dcc1e491305088 at {username='slave'} at 127.0.0.1:50932: session id = bce73265e27d4b30a4dcc1e491305088-2f01a696969543e4ba24b4a07185fce8
I20260709 12:13:12.823347  5284 tablet_copy_source_session.cc:215] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:12.845927  6199 tablet_bootstrap.cc:492] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:12.846923  6199 tablet_bootstrap.cc:492] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088: Bootstrap complete.
I20260709 12:13:12.847657  6199 ts_tablet_manager.cc:1403] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088: Time spent bootstrapping tablet: real 0.061s	user 0.020s	sys 0.007s
I20260709 12:13:12.847668  6217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f01a696969543e4ba24b4a07185fce8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:12.856279  6199 raft_consensus.cc:359] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:12.865442  6199 raft_consensus.cc:740] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Initialized, Role: LEARNER
I20260709 12:13:12.866207  6199 consensus_queue.cc:260] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:12.869036  6199 ts_tablet_manager.cc:1434] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:13:12.870893  5210 tablet_copy_service.cc:342] P dd62e75bd3ed4ed28f1fb5955d650808: Request end of tablet copy session bce73265e27d4b30a4dcc1e491305088-4d8224f2bf564e7197a33ee531527a15 received from {username='slave'} at 127.0.0.1:41416
I20260709 12:13:12.871366  5210 tablet_copy_service.cc:434] P dd62e75bd3ed4ed28f1fb5955d650808: ending tablet copy session bce73265e27d4b30a4dcc1e491305088-4d8224f2bf564e7197a33ee531527a15 on tablet 4d8224f2bf564e7197a33ee531527a15 with peer bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:12.899744  6217 tablet_copy_client.cc:806] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:12.900431  6217 tablet_copy_client.cc:670] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:12.911235  6217 tablet_copy_client.cc:538] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:12.924386  6217 tablet_bootstrap.cc:492] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088: Bootstrap starting.
I20260709 12:13:12.961230  6217 tablet_bootstrap.cc:492] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:12.962359  6217 tablet_bootstrap.cc:492] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088: Bootstrap complete.
I20260709 12:13:12.963112  6217 ts_tablet_manager.cc:1403] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088: Time spent bootstrapping tablet: real 0.039s	user 0.020s	sys 0.004s
I20260709 12:13:12.966370  6217 raft_consensus.cc:359] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:12.967342  6217 raft_consensus.cc:740] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Initialized, Role: LEARNER
I20260709 12:13:12.968079  6217 consensus_queue.cc:260] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:12.979810  6217 ts_tablet_manager.cc:1434] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:13:12.981743  5284 tablet_copy_service.cc:342] P 9e794b72ed7640219f90ec4232363929: Request end of tablet copy session bce73265e27d4b30a4dcc1e491305088-2f01a696969543e4ba24b4a07185fce8 received from {username='slave'} at 127.0.0.1:50932
I20260709 12:13:12.982255  5284 tablet_copy_service.cc:434] P 9e794b72ed7640219f90ec4232363929: ending tablet copy session bce73265e27d4b30a4dcc1e491305088-2f01a696969543e4ba24b4a07185fce8 on tablet 2f01a696969543e4ba24b4a07185fce8 with peer bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:12.987556  6197 raft_consensus.cc:1064] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929: attempting to promote NON_VOTER bce73265e27d4b30a4dcc1e491305088 to VOTER
I20260709 12:13:12.994856  6197 consensus_queue.cc:237] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:13.006134  5834 raft_consensus.cc:1275] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:13.006340  5192 raft_consensus.cc:1275] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:13.011178  5125 raft_consensus.cc:1275] T e63d70b5bbd74a49be2a18fef7617e3e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:13.012894  6186 consensus_queue.cc:1048] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:13.015000  6186 consensus_queue.cc:1048] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:13.017591  6222 consensus_queue.cc:1048] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:13.039875  6170 raft_consensus.cc:1064] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808: attempting to promote NON_VOTER bce73265e27d4b30a4dcc1e491305088 to VOTER
I20260709 12:13:13.047071  6170 consensus_queue.cc:237] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:13.079046  6226 raft_consensus.cc:2955] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:13.086730  5116 raft_consensus.cc:2955] T e63d70b5bbd74a49be2a18fef7617e3e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:13.091262  5834 raft_consensus.cc:2955] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:13.118144  5019 catalog_manager.cc:5697] T e63d70b5bbd74a49be2a18fef7617e3e P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:13.131276  5192 raft_consensus.cc:2955] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:13.138739  5834 raft_consensus.cc:1275] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:13.140615  6192 consensus_queue.cc:1048] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:13.146370  5273 raft_consensus.cc:1275] T 00645b1f1e014de995e4a937f842d909 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:13.156141  6192 consensus_queue.cc:1048] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:13.172184  5125 raft_consensus.cc:1275] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:13.173947  6170 consensus_queue.cc:1048] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:13.183025  6099 raft_consensus.cc:2955] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:13.184666  5834 raft_consensus.cc:2955] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:13.202140  5836 raft_consensus.cc:1217] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:13.232915  5273 raft_consensus.cc:2955] T 00645b1f1e014de995e4a937f842d909 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:13.238531  5116 raft_consensus.cc:2955] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:13.272284  5273 consensus_queue.cc:237] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:13.268321  5021 catalog_manager.cc:5697] T 00645b1f1e014de995e4a937f842d909 P 9e794b72ed7640219f90ec4232363929 reported cstate change: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:13.385810  5200 raft_consensus.cc:1275] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:13.386895  5198 consensus_queue.cc:237] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:13.404702  5125 raft_consensus.cc:1275] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:13.404816  5834 raft_consensus.cc:1275] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:13.407711  6099 consensus_queue.cc:1048] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:13.408965  5836 raft_consensus.cc:1217] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:13.420254  6238 consensus_queue.cc:1048] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:13.429548  6197 consensus_queue.cc:1048] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:13.432403  5836 raft_consensus.cc:1275] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:13.434594  6235 consensus_queue.cc:1048] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:13.436872  6230 raft_consensus.cc:2955] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e794b72ed7640219f90ec4232363929 (127.3.212.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:13.437049  6186 raft_consensus.cc:2955] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:13.454123  5125 raft_consensus.cc:2955] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e794b72ed7640219f90ec4232363929 (127.3.212.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:13.458303  5836 raft_consensus.cc:2955] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e794b72ed7640219f90ec4232363929 (127.3.212.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:13.462448  5834 raft_consensus.cc:2955] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:13.473676  5007 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e63d70b5bbd74a49be2a18fef7617e3e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:13.478554  5192 raft_consensus.cc:2955] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:13.488854  5007 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 00645b1f1e014de995e4a937f842d909 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:13.494374  5023 catalog_manager.cc:5697] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: config changed from index 3 to 4, VOTER 9e794b72ed7640219f90ec4232363929 (127.3.212.131) evicted. New cstate: current_term: 1 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:13.495435  5021 catalog_manager.cc:5697] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 reported cstate change: config changed from index 3 to 4, VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) evicted. New cstate: current_term: 1 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:13.548933  5108 tablet_service.cc:1558] Processing DeleteTablet for tablet e63d70b5bbd74a49be2a18fef7617e3e with delete_type TABLET_DATA_TOMBSTONED (TS ad2f9a1e2f7a45429fa69fd23d09f821 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40378
I20260709 12:13:13.574410  6240 tablet_replica.cc:333] T e63d70b5bbd74a49be2a18fef7617e3e P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:13:13.576532  6240 raft_consensus.cc:2243] T e63d70b5bbd74a49be2a18fef7617e3e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:13.579062  5263 tablet_service.cc:1558] Processing DeleteTablet for tablet 00645b1f1e014de995e4a937f842d909 with delete_type TABLET_DATA_TOMBSTONED (TS 9e794b72ed7640219f90ec4232363929 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34668
I20260709 12:13:13.595676  6240 raft_consensus.cc:2272] T e63d70b5bbd74a49be2a18fef7617e3e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:13.612040  6240 ts_tablet_manager.cc:1916] T e63d70b5bbd74a49be2a18fef7617e3e P ad2f9a1e2f7a45429fa69fd23d09f821: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:13.613502  6241 tablet_replica.cc:333] T 00645b1f1e014de995e4a937f842d909 P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
I20260709 12:13:13.626432  6236 raft_consensus.cc:1064] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808: attempting to promote NON_VOTER bce73265e27d4b30a4dcc1e491305088 to VOTER
I20260709 12:13:13.631428  6240 ts_tablet_manager.cc:1929] T e63d70b5bbd74a49be2a18fef7617e3e P ad2f9a1e2f7a45429fa69fd23d09f821: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:13.632047  6240 log.cc:1199] T e63d70b5bbd74a49be2a18fef7617e3e P ad2f9a1e2f7a45429fa69fd23d09f821: Deleting WAL directory at /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/ts-0-root/wals/e63d70b5bbd74a49be2a18fef7617e3e
I20260709 12:13:13.635812  5010 catalog_manager.cc:5028] TS ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): tablet e63d70b5bbd74a49be2a18fef7617e3e (table test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]) successfully deleted
I20260709 12:13:13.629278  6236 consensus_queue.cc:237] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:13.644410  6241 raft_consensus.cc:2243] T 00645b1f1e014de995e4a937f842d909 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:13.645449  6241 raft_consensus.cc:2272] T 00645b1f1e014de995e4a937f842d909 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:13.652588  6241 ts_tablet_manager.cc:1916] T 00645b1f1e014de995e4a937f842d909 P 9e794b72ed7640219f90ec4232363929: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:13.662303  5834 raft_consensus.cc:1275] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:13.666206  6170 consensus_queue.cc:1048] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:13.679064  6241 ts_tablet_manager.cc:1929] T 00645b1f1e014de995e4a937f842d909 P 9e794b72ed7640219f90ec4232363929: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:13.694193  6241 log.cc:1199] T 00645b1f1e014de995e4a937f842d909 P 9e794b72ed7640219f90ec4232363929: Deleting WAL directory at /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/ts-2-root/wals/00645b1f1e014de995e4a937f842d909
I20260709 12:13:13.695802  5007 catalog_manager.cc:5028] TS 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): tablet 00645b1f1e014de995e4a937f842d909 (table test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]) successfully deleted
I20260709 12:13:13.698910  5266 raft_consensus.cc:1275] T 4d8224f2bf564e7197a33ee531527a15 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:13.702756  6230 consensus_queue.cc:1048] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:13.720920  5124 raft_consensus.cc:1275] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:13.722775  6230 consensus_queue.cc:1048] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:13.733844  5836 raft_consensus.cc:2955] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:13.737778  6099 raft_consensus.cc:2955] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:13.794284  5023 catalog_manager.cc:5697] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:13.797611  5274 raft_consensus.cc:2955] T 4d8224f2bf564e7197a33ee531527a15 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:13.811987  5124 raft_consensus.cc:2955] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:13.882987  5198 consensus_queue.cc:237] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:13.927543  6226 raft_consensus.cc:1064] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929: attempting to promote NON_VOTER bce73265e27d4b30a4dcc1e491305088 to VOTER
I20260709 12:13:13.932613  5834 raft_consensus.cc:1275] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:13.933840  6226 consensus_queue.cc:237] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:13.962234  5124 raft_consensus.cc:1275] T 2f01a696969543e4ba24b4a07185fce8 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:13.963143  5836 raft_consensus.cc:1275] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:13.965533  5199 raft_consensus.cc:1275] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:13.967200  6186 consensus_queue.cc:1048] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:13.969031  6186 consensus_queue.cc:1048] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:13.970484  6236 consensus_queue.cc:1048] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:13.972126  6238 consensus_queue.cc:1048] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:13.975173  5124 raft_consensus.cc:1275] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:13.977074  6234 consensus_queue.cc:1048] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:13.987840  6099 raft_consensus.cc:2955] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e794b72ed7640219f90ec4232363929 (127.3.212.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:14.002892  5124 raft_consensus.cc:2955] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e794b72ed7640219f90ec4232363929 (127.3.212.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:14.013517  5834 raft_consensus.cc:2955] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e794b72ed7640219f90ec4232363929 (127.3.212.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
W20260709 12:13:14.013427  6246 log.cc:927] Time spent T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:13:14.046310  5007 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4d8224f2bf564e7197a33ee531527a15 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:14.045464  6197 raft_consensus.cc:2955] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:14.056457  5125 raft_consensus.cc:2955] T 2f01a696969543e4ba24b4a07185fce8 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:14.073041  5023 catalog_manager.cc:5697] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: config changed from index 3 to 4, VOTER 9e794b72ed7640219f90ec4232363929 (127.3.212.131) evicted. New cstate: current_term: 1 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:14.091356  5199 raft_consensus.cc:2955] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:14.089988  5836 raft_consensus.cc:2955] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:14.133284  5019 catalog_manager.cc:5697] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 reported cstate change: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:13:14.155680  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 83108us
I20260709 12:13:14.165007  5263 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d8224f2bf564e7197a33ee531527a15 with delete_type TABLET_DATA_TOMBSTONED (TS 9e794b72ed7640219f90ec4232363929 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34668
I20260709 12:13:14.165989  6241 tablet_replica.cc:333] T 4d8224f2bf564e7197a33ee531527a15 P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
I20260709 12:13:14.166976  6241 raft_consensus.cc:2243] T 4d8224f2bf564e7197a33ee531527a15 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:14.167762  6241 raft_consensus.cc:2272] T 4d8224f2bf564e7197a33ee531527a15 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:14.181097  6241 ts_tablet_manager.cc:1916] T 4d8224f2bf564e7197a33ee531527a15 P 9e794b72ed7640219f90ec4232363929: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:14.186949  5274 consensus_queue.cc:237] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:14.200241  5836 raft_consensus.cc:1275] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:14.201922  5199 raft_consensus.cc:1275] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:14.202941  6186 consensus_queue.cc:1048] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:14.207108  6226 consensus_queue.cc:1048] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:14.218546  6250 raft_consensus.cc:2955] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:14.240713  6241 ts_tablet_manager.cc:1929] T 4d8224f2bf564e7197a33ee531527a15 P 9e794b72ed7640219f90ec4232363929: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:14.242858  6241 log.cc:1199] T 4d8224f2bf564e7197a33ee531527a15 P 9e794b72ed7640219f90ec4232363929: Deleting WAL directory at /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/ts-2-root/wals/4d8224f2bf564e7197a33ee531527a15
I20260709 12:13:14.245155  5007 catalog_manager.cc:5028] TS 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): tablet 4d8224f2bf564e7197a33ee531527a15 (table test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]) successfully deleted
I20260709 12:13:14.247044  5192 raft_consensus.cc:2955] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:14.265311  5836 raft_consensus.cc:2955] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:14.285347  5007 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2f01a696969543e4ba24b4a07185fce8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:14.293488  5022 catalog_manager.cc:5697] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: config changed from index 3 to 4, VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) evicted. New cstate: current_term: 1 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:14.306406  5108 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f01a696969543e4ba24b4a07185fce8 with delete_type TABLET_DATA_TOMBSTONED (TS ad2f9a1e2f7a45429fa69fd23d09f821 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40378
I20260709 12:13:14.314859  6252 tablet_replica.cc:333] T 2f01a696969543e4ba24b4a07185fce8 P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:13:14.316007  6252 raft_consensus.cc:2243] T 2f01a696969543e4ba24b4a07185fce8 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:14.316818  6252 raft_consensus.cc:2272] T 2f01a696969543e4ba24b4a07185fce8 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:14.323817  6252 ts_tablet_manager.cc:1916] T 2f01a696969543e4ba24b4a07185fce8 P ad2f9a1e2f7a45429fa69fd23d09f821: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:14.371449  6252 ts_tablet_manager.cc:1929] T 2f01a696969543e4ba24b4a07185fce8 P ad2f9a1e2f7a45429fa69fd23d09f821: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:14.371963  6252 log.cc:1199] T 2f01a696969543e4ba24b4a07185fce8 P ad2f9a1e2f7a45429fa69fd23d09f821: Deleting WAL directory at /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/ts-0-root/wals/2f01a696969543e4ba24b4a07185fce8
I20260709 12:13:14.373706  5010 catalog_manager.cc:5028] TS ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): tablet 2f01a696969543e4ba24b4a07185fce8 (table test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]) successfully deleted
W20260709 12:13:15.673166  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 47926us
I20260709 12:13:16.011572  5273 consensus_queue.cc:237] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:16.024703  5125 raft_consensus.cc:1275] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:13:16.025208  5238 consensus_peers.cc:597] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 -> Peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Couldn't send request to peer bce73265e27d4b30a4dcc1e491305088. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d09ac3a18bc549dabadd7ec3c3f57017. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:16.026780  6262 consensus_queue.cc:1048] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:16.032884  5192 raft_consensus.cc:1275] T d09ac3a18bc549dabadd7ec3c3f57017 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:16.035949  6262 consensus_queue.cc:1048] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:16.039273  6250 raft_consensus.cc:2955] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:16.052228  5125 raft_consensus.cc:2955] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:16.093667  5273 consensus_queue.cc:237] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:16.100682  5019 catalog_manager.cc:5697] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 reported cstate change: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New cstate: current_term: 1 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:16.119382  5199 raft_consensus.cc:2955] T d09ac3a18bc549dabadd7ec3c3f57017 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
W20260709 12:13:16.157207  5238 consensus_peers.cc:597] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 -> Peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Couldn't send request to peer bce73265e27d4b30a4dcc1e491305088. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c69b050cdaeb4f1db6cd4993ad703192. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:16.160389  5192 raft_consensus.cc:1275] T c69b050cdaeb4f1db6cd4993ad703192 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:16.164292  6258 consensus_queue.cc:1048] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:16.164561  5124 raft_consensus.cc:1275] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:16.173681  6250 consensus_queue.cc:1048] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:16.192970  6250 raft_consensus.cc:2955] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:16.206107  5199 raft_consensus.cc:2955] T c69b050cdaeb4f1db6cd4993ad703192 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:16.215279  5124 raft_consensus.cc:2955] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:16.236179  5198 consensus_queue.cc:237] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:16.248955  5023 catalog_manager.cc:5697] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New cstate: current_term: 1 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
W20260709 12:13:16.269053  5164 consensus_peers.cc:597] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Couldn't send request to peer bce73265e27d4b30a4dcc1e491305088. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e3beaf3ce31042719868401157039ee9. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:16.269822  5273 raft_consensus.cc:1275] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:16.273069  5122 raft_consensus.cc:1275] T e3beaf3ce31042719868401157039ee9 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:16.275357  6264 consensus_queue.cc:1048] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:16.277575  6261 consensus_queue.cc:1048] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:16.302284  6261 raft_consensus.cc:2955] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:16.304003  5122 raft_consensus.cc:2955] T e3beaf3ce31042719868401157039ee9 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:16.307045  5273 raft_consensus.cc:2955] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:16.325623  5198 consensus_queue.cc:237] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:16.332371  5022 catalog_manager.cc:5697] T e3beaf3ce31042719868401157039ee9 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New cstate: current_term: 1 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:16.368486  5122 raft_consensus.cc:1275] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:16.375309  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:16.377508  5273 raft_consensus.cc:1275] T a6b2fb64d40642259e41424cef193db0 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:16.391489  6236 consensus_queue.cc:1048] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:16.392581  6265 consensus_queue.cc:1048] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:13:16.398550  5164 consensus_peers.cc:597] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Couldn't send request to peer bce73265e27d4b30a4dcc1e491305088. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a6b2fb64d40642259e41424cef193db0. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:16.433923  5122 raft_consensus.cc:2955] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:16.432272  6265 raft_consensus.cc:2955] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:16.461486  5023 catalog_manager.cc:5697] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New cstate: current_term: 1 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:16.461936  5273 raft_consensus.cc:2955] T a6b2fb64d40642259e41424cef193db0 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:16.463372  6282 ts_tablet_manager.cc:933] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088: Initiating tablet copy from peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:16.545620  6282 tablet_copy_client.cc:323] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Beginning tablet copy session from remote peer at address 127.3.212.131:46709
I20260709 12:13:16.549181  5284 tablet_copy_service.cc:140] P 9e794b72ed7640219f90ec4232363929: Received BeginTabletCopySession request for tablet d09ac3a18bc549dabadd7ec3c3f57017 from peer bce73265e27d4b30a4dcc1e491305088 ({username='slave'} at 127.0.0.1:50932)
I20260709 12:13:16.549876  5284 tablet_copy_service.cc:161] P 9e794b72ed7640219f90ec4232363929: Beginning new tablet copy session on tablet d09ac3a18bc549dabadd7ec3c3f57017 from peer bce73265e27d4b30a4dcc1e491305088 at {username='slave'} at 127.0.0.1:50932: session id = bce73265e27d4b30a4dcc1e491305088-d09ac3a18bc549dabadd7ec3c3f57017
I20260709 12:13:16.556623  5284 tablet_copy_source_session.cc:215] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:16.562662  6282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d09ac3a18bc549dabadd7ec3c3f57017. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:16.568146  6287 ts_tablet_manager.cc:933] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088: Initiating tablet copy from peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:16.575763  5199 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa"
dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
mode: GRACEFUL
new_leader_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:53902
I20260709 12:13:16.576596  5199 raft_consensus.cc:606] T 3db164e3a1ce4a43b0a112a777118daa P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Received request to transfer leadership to TS 9e794b72ed7640219f90ec4232363929
I20260709 12:13:16.592394  6282 tablet_copy_client.cc:806] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:16.593235  6282 tablet_copy_client.cc:670] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:16.608119  6282 tablet_copy_client.cc:538] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:16.613762  6287 tablet_copy_client.cc:323] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Beginning tablet copy session from remote peer at address 127.3.212.131:46709
I20260709 12:13:16.617120  5284 tablet_copy_service.cc:140] P 9e794b72ed7640219f90ec4232363929: Received BeginTabletCopySession request for tablet c69b050cdaeb4f1db6cd4993ad703192 from peer bce73265e27d4b30a4dcc1e491305088 ({username='slave'} at 127.0.0.1:50932)
I20260709 12:13:16.617697  5284 tablet_copy_service.cc:161] P 9e794b72ed7640219f90ec4232363929: Beginning new tablet copy session on tablet c69b050cdaeb4f1db6cd4993ad703192 from peer bce73265e27d4b30a4dcc1e491305088 at {username='slave'} at 127.0.0.1:50932: session id = bce73265e27d4b30a4dcc1e491305088-c69b050cdaeb4f1db6cd4993ad703192
I20260709 12:13:16.632272  5284 tablet_copy_source_session.cc:215] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:16.635382  6287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c69b050cdaeb4f1db6cd4993ad703192. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:16.635568  6282 tablet_bootstrap.cc:492] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088: Bootstrap starting.
I20260709 12:13:16.640633  6265 raft_consensus.cc:993] T 3db164e3a1ce4a43b0a112a777118daa P dd62e75bd3ed4ed28f1fb5955d650808: : Instructing follower 9e794b72ed7640219f90ec4232363929 to start an election
I20260709 12:13:16.641199  6236 raft_consensus.cc:1081] T 3db164e3a1ce4a43b0a112a777118daa P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Signalling peer 9e794b72ed7640219f90ec4232363929 to start an election
I20260709 12:13:16.645730  5124 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "56627990da7d49f7a12669f23294a596"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
new_leader_uuid: "bce73265e27d4b30a4dcc1e491305088"
 from {username='slave'} at 127.0.0.1:45628
I20260709 12:13:16.645730  5273 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:34672
I20260709 12:13:16.646947  5273 raft_consensus.cc:493] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:16.647327  5273 raft_consensus.cc:3060] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:16.646358  5124 raft_consensus.cc:606] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Received request to transfer leadership to TS bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:16.659148  5273 raft_consensus.cc:515] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:16.661777  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:16.662467  5124 raft_consensus.cc:3060] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:16.684293  5124 raft_consensus.cc:2468] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 2.
I20260709 12:13:16.685853  5240 leader_election.cc:304] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:13:16.685470  6282 tablet_bootstrap.cc:492] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:16.692935  6250 raft_consensus.cc:2804] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:16.693249  5122 raft_consensus.cc:1240] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:16.693857  6282 tablet_bootstrap.cc:492] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088: Bootstrap complete.
I20260709 12:13:16.694766  6282 ts_tablet_manager.cc:1403] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088: Time spent bootstrapping tablet: real 0.059s	user 0.026s	sys 0.006s
I20260709 12:13:16.694993  6261 consensus_queue.cc:1059] T 3db164e3a1ce4a43b0a112a777118daa P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:16.696015  6261 raft_consensus.cc:3055] T 3db164e3a1ce4a43b0a112a777118daa P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:16.696331  6261 raft_consensus.cc:740] T 3db164e3a1ce4a43b0a112a777118daa P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:16.697165  6261 consensus_queue.cc:260] T 3db164e3a1ce4a43b0a112a777118daa P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:16.698400  6261 raft_consensus.cc:3060] T 3db164e3a1ce4a43b0a112a777118daa P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:16.698599  6282 raft_consensus.cc:359] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:16.699448  6282 raft_consensus.cc:740] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Initialized, Role: LEARNER
I20260709 12:13:16.700119  6282 consensus_queue.cc:260] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:16.693435  6250 raft_consensus.cc:697] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 2 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:16.705842  6250 consensus_queue.cc:237] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:16.712147  5273 leader_election.cc:290] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:16.713867  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:16.723229  5023 catalog_manager.cc:5697] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 1 to 2, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 2 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:16.730538  5198 raft_consensus.cc:2468] T 3db164e3a1ce4a43b0a112a777118daa P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 2.
I20260709 12:13:16.750247  6292 ts_tablet_manager.cc:933] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088: Initiating tablet copy from peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:16.787818  6282 ts_tablet_manager.cc:1434] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088: Time spent starting tablet: real 0.093s	user 0.029s	sys 0.052s
I20260709 12:13:16.790042  5284 tablet_copy_service.cc:342] P 9e794b72ed7640219f90ec4232363929: Request end of tablet copy session bce73265e27d4b30a4dcc1e491305088-d09ac3a18bc549dabadd7ec3c3f57017 received from {username='slave'} at 127.0.0.1:50932
I20260709 12:13:16.790545  5284 tablet_copy_service.cc:434] P 9e794b72ed7640219f90ec4232363929: ending tablet copy session bce73265e27d4b30a4dcc1e491305088-d09ac3a18bc549dabadd7ec3c3f57017 on tablet d09ac3a18bc549dabadd7ec3c3f57017 with peer bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:16.802361  6292 tablet_copy_client.cc:323] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Beginning tablet copy session from remote peer at address 127.3.212.130:44455
I20260709 12:13:16.804366  5210 tablet_copy_service.cc:140] P dd62e75bd3ed4ed28f1fb5955d650808: Received BeginTabletCopySession request for tablet e3beaf3ce31042719868401157039ee9 from peer bce73265e27d4b30a4dcc1e491305088 ({username='slave'} at 127.0.0.1:41416)
I20260709 12:13:16.804986  5210 tablet_copy_service.cc:161] P dd62e75bd3ed4ed28f1fb5955d650808: Beginning new tablet copy session on tablet e3beaf3ce31042719868401157039ee9 from peer bce73265e27d4b30a4dcc1e491305088 at {username='slave'} at 127.0.0.1:41416: session id = bce73265e27d4b30a4dcc1e491305088-e3beaf3ce31042719868401157039ee9
I20260709 12:13:16.809139  5273 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84919c977be24017b74e122582f71fbe"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
mode: GRACEFUL
new_leader_uuid: "bce73265e27d4b30a4dcc1e491305088"
 from {username='slave'} at 127.0.0.1:42506
I20260709 12:13:16.813885  5210 tablet_copy_source_session.cc:215] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:16.817906  6292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3beaf3ce31042719868401157039ee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:16.822731  5273 raft_consensus.cc:606] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Received request to transfer leadership to TS bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:16.828811  5267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
mode: GRACEFUL
new_leader_uuid: "bce73265e27d4b30a4dcc1e491305088"
 from {username='slave'} at 127.0.0.1:42506
I20260709 12:13:16.829476  5267 raft_consensus.cc:606] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Received request to transfer leadership to TS bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:16.834149  6287 tablet_copy_client.cc:806] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:16.836724  6287 tablet_copy_client.cc:670] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:16.861351  6292 tablet_copy_client.cc:806] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:16.862092  6292 tablet_copy_client.cc:670] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:16.872095  6292 tablet_copy_client.cc:538] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:16.888500  5267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
mode: GRACEFUL
new_leader_uuid: "bce73265e27d4b30a4dcc1e491305088"
 from {username='slave'} at 127.0.0.1:42506
I20260709 12:13:16.889170  5267 raft_consensus.cc:606] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Received request to transfer leadership to TS bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:16.893304  6292 tablet_bootstrap.cc:492] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088: Bootstrap starting.
I20260709 12:13:16.915498  6282 ts_tablet_manager.cc:933] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088: Initiating tablet copy from peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:16.925122  6287 tablet_copy_client.cc:538] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:16.938921  6263 raft_consensus.cc:993] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821: : Instructing follower bce73265e27d4b30a4dcc1e491305088 to start an election
I20260709 12:13:16.939620  6216 raft_consensus.cc:1081] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Signalling peer bce73265e27d4b30a4dcc1e491305088 to start an election
I20260709 12:13:16.941039  5273 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
mode: GRACEFUL
new_leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
 from {username='slave'} at 127.0.0.1:42506
I20260709 12:13:16.941659  5273 raft_consensus.cc:606] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Received request to transfer leadership to TS dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:16.942878  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:13:16.943192  5834 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "56627990da7d49f7a12669f23294a596"
dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
 from {username='slave'} at 127.0.0.1:46094
I20260709 12:13:16.943732  5834 raft_consensus.cc:493] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:16.944219  5834 raft_consensus.cc:3060] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:16.944473  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:16.948510  5836 raft_consensus.cc:1217] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:16.954797  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:16.960987  5834 raft_consensus.cc:515] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:16.973896  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:16.974702  5124 raft_consensus.cc:3055] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:16.975538  5124 raft_consensus.cc:740] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:16.976567  5124 consensus_queue.cc:260] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:16.987620  5124 raft_consensus.cc:3060] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:16.986318  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:16.992637  5267 raft_consensus.cc:3060] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:16.977016  5834 leader_election.cc:290] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:17.003509  6282 tablet_copy_client.cc:323] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Beginning tablet copy session from remote peer at address 127.3.212.130:44455
I20260709 12:13:17.005204  5210 tablet_copy_service.cc:140] P dd62e75bd3ed4ed28f1fb5955d650808: Received BeginTabletCopySession request for tablet a6b2fb64d40642259e41424cef193db0 from peer bce73265e27d4b30a4dcc1e491305088 ({username='slave'} at 127.0.0.1:41416)
I20260709 12:13:17.005755  5210 tablet_copy_service.cc:161] P dd62e75bd3ed4ed28f1fb5955d650808: Beginning new tablet copy session on tablet a6b2fb64d40642259e41424cef193db0 from peer bce73265e27d4b30a4dcc1e491305088 at {username='slave'} at 127.0.0.1:41416: session id = bce73265e27d4b30a4dcc1e491305088-a6b2fb64d40642259e41424cef193db0
I20260709 12:13:17.012723  5210 tablet_copy_source_session.cc:215] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:17.019707  6250 raft_consensus.cc:993] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929: : Instructing follower dd62e75bd3ed4ed28f1fb5955d650808 to start an election
I20260709 12:13:17.019995  6282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6b2fb64d40642259e41424cef193db0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:17.020352  6250 raft_consensus.cc:1081] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Signalling peer dd62e75bd3ed4ed28f1fb5955d650808 to start an election
I20260709 12:13:17.026983  5192 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e"
dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
 from {username='slave'} at 127.0.0.1:47728
I20260709 12:13:17.027634  5192 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:17.028138  5192 raft_consensus.cc:3060] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:17.057345  5267 raft_consensus.cc:2468] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 2.
I20260709 12:13:17.059338  5801 leader_election.cc:304] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:13:17.060405  6293 raft_consensus.cc:2804] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:17.065907  5192 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:17.068523  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:17.069113  5122 raft_consensus.cc:3060] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:17.071213  5192 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:17.012697  6287 tablet_bootstrap.cc:492] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088: Bootstrap starting.
I20260709 12:13:17.062280  5124 raft_consensus.cc:2468] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 2.
I20260709 12:13:17.081748  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:17.082366  5273 raft_consensus.cc:3055] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:17.082664  5273 raft_consensus.cc:740] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:17.083410  5273 consensus_queue.cc:260] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:17.092983  5122 raft_consensus.cc:2468] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 2.
I20260709 12:13:17.096642  5273 raft_consensus.cc:3060] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:17.096122  5166 leader_election.cc:304] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:17.101575  6099 raft_consensus.cc:2804] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:17.107275  6292 tablet_bootstrap.cc:492] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:17.115818  6293 raft_consensus.cc:697] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 2 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:13:17.116360  5273 raft_consensus.cc:2468] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 2.
I20260709 12:13:17.116955  6293 consensus_queue.cc:237] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:17.108258  6292 tablet_bootstrap.cc:492] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088: Bootstrap complete.
I20260709 12:13:17.120457  6292 ts_tablet_manager.cc:1403] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088: Time spent bootstrapping tablet: real 0.227s	user 0.026s	sys 0.012s
I20260709 12:13:17.120851  6099 raft_consensus.cc:697] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:17.124291  5198 raft_consensus.cc:1275] T 3db164e3a1ce4a43b0a112a777118daa P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:17.124591  6099 consensus_queue.cc:237] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:17.126034  6250 consensus_queue.cc:1048] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:17.142637  6282 tablet_copy_client.cc:806] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:17.143364  6282 tablet_copy_client.cc:670] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:17.144383  6197 raft_consensus.cc:993] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929: : Instructing follower bce73265e27d4b30a4dcc1e491305088 to start an election
I20260709 12:13:17.144845  6197 raft_consensus.cc:1081] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Signalling peer bce73265e27d4b30a4dcc1e491305088 to start an election
I20260709 12:13:17.147676  5834 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e"
dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
 from {username='slave'} at 127.0.0.1:46088
I20260709 12:13:17.148209  5834 raft_consensus.cc:493] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:17.148581  5834 raft_consensus.cc:3060] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:17.151021  6292 raft_consensus.cc:359] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:17.155153  6292 raft_consensus.cc:740] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Initialized, Role: LEARNER
I20260709 12:13:17.155988  6282 tablet_copy_client.cc:538] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:17.155897  6292 consensus_queue.cc:260] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:17.155912  5834 raft_consensus.cc:515] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:17.165659  6292 ts_tablet_manager.cc:1434] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.002s
I20260709 12:13:17.166184  5023 catalog_manager.cc:5697] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 1 to 2, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 2 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:17.174515  5210 tablet_copy_service.cc:342] P dd62e75bd3ed4ed28f1fb5955d650808: Request end of tablet copy session bce73265e27d4b30a4dcc1e491305088-e3beaf3ce31042719868401157039ee9 received from {username='slave'} at 127.0.0.1:41416
I20260709 12:13:17.177083  5835 raft_consensus.cc:1217] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:17.177222  5210 tablet_copy_service.cc:434] P dd62e75bd3ed4ed28f1fb5955d650808: ending tablet copy session bce73265e27d4b30a4dcc1e491305088-e3beaf3ce31042719868401157039ee9 on tablet e3beaf3ce31042719868401157039ee9 with peer bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:17.181461  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:17.182060  5198 raft_consensus.cc:3060] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:17.188726  5834 leader_election.cc:290] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:17.193627  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:17.194262  5273 raft_consensus.cc:3055] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:17.194288  5198 raft_consensus.cc:2468] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 2.
I20260709 12:13:17.196516  5273 raft_consensus.cc:740] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:17.199569  5273 consensus_queue.cc:260] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:17.201144  5273 raft_consensus.cc:3060] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:17.206493  5801 leader_election.cc:304] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:17.209949  6293 raft_consensus.cc:2804] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:17.211089  6293 raft_consensus.cc:697] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 2 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:13:17.212059  6293 consensus_queue.cc:237] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:17.215937  5124 raft_consensus.cc:1275] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:17.217559  6250 consensus_queue.cc:1048] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:17.219314  6287 tablet_bootstrap.cc:492] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:17.225945  6282 tablet_bootstrap.cc:492] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088: Bootstrap starting.
I20260709 12:13:17.227171  6287 tablet_bootstrap.cc:492] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088: Bootstrap complete.
I20260709 12:13:17.227880  5273 raft_consensus.cc:2468] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 2.
I20260709 12:13:17.248104  6287 ts_tablet_manager.cc:1403] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088: Time spent bootstrapping tablet: real 0.236s	user 0.025s	sys 0.016s
I20260709 12:13:17.276657  5023 catalog_manager.cc:5697] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 1 to 2, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 2 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:17.318208  6287 raft_consensus.cc:359] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:17.319284  6287 raft_consensus.cc:740] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Initialized, Role: LEARNER
I20260709 12:13:17.372008  6258 raft_consensus.cc:993] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929: : Instructing follower bce73265e27d4b30a4dcc1e491305088 to start an election
I20260709 12:13:17.372548  6258 raft_consensus.cc:1081] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Signalling peer bce73265e27d4b30a4dcc1e491305088 to start an election
I20260709 12:13:17.378348  6287 consensus_queue.cc:260] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:17.397485  5834 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a"
dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
 from {username='slave'} at 127.0.0.1:46088
I20260709 12:13:17.398126  5834 raft_consensus.cc:493] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:17.398504  5834 raft_consensus.cc:3060] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:17.474651  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 64746.4us
I20260709 12:13:17.476951  6287 ts_tablet_manager.cc:1434] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088: Time spent starting tablet: real 0.199s	user 0.005s	sys 0.005s
I20260709 12:13:17.481719  5023 catalog_manager.cc:5697] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 1 to 2, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 2 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:17.489362  5284 tablet_copy_service.cc:342] P 9e794b72ed7640219f90ec4232363929: Request end of tablet copy session bce73265e27d4b30a4dcc1e491305088-c69b050cdaeb4f1db6cd4993ad703192 received from {username='slave'} at 127.0.0.1:50932
I20260709 12:13:17.489916  5284 tablet_copy_service.cc:434] P 9e794b72ed7640219f90ec4232363929: ending tablet copy session bce73265e27d4b30a4dcc1e491305088-c69b050cdaeb4f1db6cd4993ad703192 on tablet c69b050cdaeb4f1db6cd4993ad703192 with peer bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:17.490458  5834 raft_consensus.cc:515] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:17.493096  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:17.493711  5199 raft_consensus.cc:3060] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:17.499382  6250 raft_consensus.cc:993] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929: : Instructing follower bce73265e27d4b30a4dcc1e491305088 to start an election
I20260709 12:13:17.499933  6250 raft_consensus.cc:1081] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Signalling peer bce73265e27d4b30a4dcc1e491305088 to start an election
I20260709 12:13:17.500746  5199 raft_consensus.cc:2468] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 2.
I20260709 12:13:17.501878  5834 leader_election.cc:290] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:17.502250  5801 leader_election.cc:304] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:17.503141  6293 raft_consensus.cc:2804] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:17.503599  6293 raft_consensus.cc:697] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 2 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:13:17.504465  6293 consensus_queue.cc:237] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:17.512295  6258 raft_consensus.cc:1064] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929: attempting to promote NON_VOTER bce73265e27d4b30a4dcc1e491305088 to VOTER
I20260709 12:13:17.515190  5832 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "84919c977be24017b74e122582f71fbe"
dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
 from {username='slave'} at 127.0.0.1:46088
I20260709 12:13:17.514925  6258 consensus_queue.cc:237] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:17.515815  5832 raft_consensus.cc:493] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:17.516213  5832 raft_consensus.cc:3060] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:17.529083  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:17.529850  5273 raft_consensus.cc:3055] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:17.530252  5273 raft_consensus.cc:740] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:17.531141  5273 consensus_queue.cc:260] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:17.532104  5832 raft_consensus.cc:515] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:17.532545  5273 raft_consensus.cc:3060] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:17.544432  5022 catalog_manager.cc:5697] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 1 to 2, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 2 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:17.551966  5835 raft_consensus.cc:1217] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:17.553793  5122 raft_consensus.cc:1275] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:17.554175  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:17.554765  5266 raft_consensus.cc:3055] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:17.555064  5266 raft_consensus.cc:740] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:17.555796  5266 consensus_queue.cc:260] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:17.556852  5266 raft_consensus.cc:3060] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:17.552594  5832 leader_election.cc:290] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:17.561507  5267 raft_consensus.cc:1275] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:17.562903  5273 raft_consensus.cc:2468] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 2.
I20260709 12:13:17.562862  6261 consensus_queue.cc:1048] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:17.569142  5267 raft_consensus.cc:1275] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:17.570497  6293 consensus_queue.cc:1048] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:17.578719  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:17.579340  5124 raft_consensus.cc:3060] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:17.592878  5122 raft_consensus.cc:1275] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:17.596467  5266 raft_consensus.cc:2468] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 2.
I20260709 12:13:17.594760  6293 consensus_queue.cc:1048] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:17.599157  6250 consensus_queue.cc:1048] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:17.602784  5835 raft_consensus.cc:1275] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:17.585197  6282 tablet_bootstrap.cc:492] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:17.605120  6282 tablet_bootstrap.cc:492] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088: Bootstrap complete.
I20260709 12:13:17.609436  5124 raft_consensus.cc:2468] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 2.
I20260709 12:13:17.609354  6250 consensus_queue.cc:1048] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:13:17.617743  6282 ts_tablet_manager.cc:1403] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088: Time spent bootstrapping tablet: real 0.392s	user 0.019s	sys 0.009s
I20260709 12:13:17.621269  5804 leader_election.cc:304] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:13:17.627735  6293 raft_consensus.cc:2804] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:17.628296  6293 raft_consensus.cc:697] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 2 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:13:17.629185  6293 consensus_queue.cc:237] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:17.639062  6282 raft_consensus.cc:359] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:17.639981  6282 raft_consensus.cc:740] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Initialized, Role: LEARNER
W20260709 12:13:17.638324  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 59628.6us
I20260709 12:13:17.643847  5199 raft_consensus.cc:1275] T d09ac3a18bc549dabadd7ec3c3f57017 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:17.640643  6282 consensus_queue.cc:260] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:17.660416  6306 consensus_queue.cc:1048] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:13:17.674963  5124 raft_consensus.cc:1275] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:17.677661  6236 consensus_queue.cc:1048] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:17.716312  6099 raft_consensus.cc:1064] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808: attempting to promote NON_VOTER bce73265e27d4b30a4dcc1e491305088 to VOTER
I20260709 12:13:17.727325  6099 consensus_queue.cc:237] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:17.830783  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 137058us
I20260709 12:13:17.880612  6282 ts_tablet_manager.cc:1434] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088: Time spent starting tablet: real 0.262s	user 0.009s	sys 0.020s
I20260709 12:13:17.879465  6315 raft_consensus.cc:2955] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:17.886363  5210 tablet_copy_service.cc:342] P dd62e75bd3ed4ed28f1fb5955d650808: Request end of tablet copy session bce73265e27d4b30a4dcc1e491305088-a6b2fb64d40642259e41424cef193db0 received from {username='slave'} at 127.0.0.1:41416
I20260709 12:13:17.886955  5210 tablet_copy_service.cc:434] P dd62e75bd3ed4ed28f1fb5955d650808: ending tablet copy session bce73265e27d4b30a4dcc1e491305088-a6b2fb64d40642259e41424cef193db0 on tablet a6b2fb64d40642259e41424cef193db0 with peer bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:17.889935  5832 raft_consensus.cc:2955] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
W20260709 12:13:17.976895  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 131695us
I20260709 12:13:17.996253  5023 catalog_manager.cc:5697] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 1 to 2, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 2 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:18.015084  5019 catalog_manager.cc:5697] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 reported cstate change: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:18.021512  5199 raft_consensus.cc:1275] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:13:18.091281  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 247972us
I20260709 12:13:18.138489  5119 raft_consensus.cc:2955] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:18.144994  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:13:18.147805  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 87143.8us
I20260709 12:13:18.148474  6293 consensus_queue.cc:1048] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:13:18.150310  5199 raft_consensus.cc:1275] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:18.159456  6323 consensus_queue.cc:1048] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:18.218629  5267 raft_consensus.cc:1275] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:18.241788  5274 raft_consensus.cc:1275] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:18.244364  5268 raft_consensus.cc:1275] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:13:18.240301  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 459965us
I20260709 12:13:18.251164  6293 consensus_queue.cc:1048] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:18.254356  5265 raft_consensus.cc:1275] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:18.239260  6261 consensus_queue.cc:1048] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
W20260709 12:13:18.287854  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 274946us
I20260709 12:13:18.299050  5834 raft_consensus.cc:1217] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:18.302852  5832 raft_consensus.cc:1275] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:18.288508  6293 consensus_queue.cc:1048] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:13:18.313072  5118 raft_consensus.cc:1275] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:18.319466  6099 consensus_queue.cc:1048] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:18.330211  6324 consensus_queue.cc:1048] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:13:18.349779  6324 consensus_queue.cc:1048] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
W20260709 12:13:18.401428  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 106463us
W20260709 12:13:18.531602  6314 log.cc:927] Time spent T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
W20260709 12:13:18.536986  6271 log.cc:927] Time spent T 00000000000000000000000000000000 P 221aa011207d421b9725197ff8bed389: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 12:13:18.551555  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 229741us
W20260709 12:13:18.570428  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 242284us
W20260709 12:13:18.601321  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 174771us
I20260709 12:13:18.602867  6352 raft_consensus.cc:1064] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929: attempting to promote NON_VOTER bce73265e27d4b30a4dcc1e491305088 to VOTER
I20260709 12:13:18.606530  5193 raft_consensus.cc:2955] T d09ac3a18bc549dabadd7ec3c3f57017 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:18.616781  6352 consensus_queue.cc:237] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:18.663072  5119 raft_consensus.cc:1275] T e3beaf3ce31042719868401157039ee9 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:18.678901  6338 consensus_queue.cc:1048] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:18.749450  5273 consensus_queue.cc:237] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:18.765769  6261 raft_consensus.cc:2955] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:18.777336  6339 raft_consensus.cc:1064] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808: attempting to promote NON_VOTER bce73265e27d4b30a4dcc1e491305088 to VOTER
I20260709 12:13:18.778702  5834 raft_consensus.cc:2955] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:18.780754  6339 consensus_queue.cc:237] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:18.807053  5022 catalog_manager.cc:5697] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
W20260709 12:13:18.827355  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 116639us
I20260709 12:13:18.842533  5120 raft_consensus.cc:2955] T e3beaf3ce31042719868401157039ee9 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:18.850889  5122 raft_consensus.cc:1275] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:18.851958  5193 raft_consensus.cc:1275] T c69b050cdaeb4f1db6cd4993ad703192 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:18.853820  6352 consensus_queue.cc:1048] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:13:18.860649  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 150650us
I20260709 12:13:18.873929  5834 raft_consensus.cc:1275] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:18.875576  6261 consensus_queue.cc:1048] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:18.879456  6258 consensus_queue.cc:1048] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:18.881839  5125 raft_consensus.cc:1275] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:18.884999  5125 raft_consensus.cc:1275] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:18.888190  6352 consensus_queue.cc:1048] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:18.889591  6261 consensus_queue.cc:1048] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:18.895864  5266 raft_consensus.cc:2955] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:18.902971  6258 raft_consensus.cc:2955] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:18.912810  5007 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d09ac3a18bc549dabadd7ec3c3f57017 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:18.920516  5273 raft_consensus.cc:1275] T a6b2fb64d40642259e41424cef193db0 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:18.926616  5835 raft_consensus.cc:1275] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:18.940709  5835 raft_consensus.cc:1275] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:18.967381  6258 consensus_queue.cc:1048] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:18.974496  6099 consensus_queue.cc:1048] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:18.979575  6258 consensus_queue.cc:1048] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:18.940701  5120 raft_consensus.cc:2955] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
W20260709 12:13:19.060752  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 67676.4us
I20260709 12:13:19.072418  5197 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0"
dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
mode: GRACEFUL
new_leader_uuid: "bce73265e27d4b30a4dcc1e491305088"
 from {username='slave'} at 127.0.0.1:53902
I20260709 12:13:19.073112  5197 raft_consensus.cc:606] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Received request to transfer leadership to TS bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:19.085772  5834 raft_consensus.cc:2955] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
W20260709 12:13:19.090272  6377 log.cc:927] Time spent T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.086s	user 0.004s	sys 0.000s
I20260709 12:13:19.091645  5273 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
mode: GRACEFUL
new_leader_uuid: "bce73265e27d4b30a4dcc1e491305088"
 from {username='slave'} at 127.0.0.1:42506
I20260709 12:13:19.092352  5273 raft_consensus.cc:606] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Received request to transfer leadership to TS bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:19.107297  5832 raft_consensus.cc:2955] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:19.116263  5125 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a9971183fee4e958cff325230a31b26"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
new_leader_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:45628
I20260709 12:13:19.116932  5125 raft_consensus.cc:606] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Received request to transfer leadership to TS 9e794b72ed7640219f90ec4232363929
I20260709 12:13:19.097556  6334 raft_consensus.cc:2955] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:19.137471  6315 raft_consensus.cc:2955] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:19.138980  5266 raft_consensus.cc:2955] T a6b2fb64d40642259e41424cef193db0 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:19.145063  5125 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
new_leader_uuid: "bce73265e27d4b30a4dcc1e491305088"
 from {username='slave'} at 127.0.0.1:45628
I20260709 12:13:19.145678  5125 raft_consensus.cc:606] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Received request to transfer leadership to TS bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:19.149739  5193 consensus_queue.cc:237] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:19.149153  5023 catalog_manager.cc:5697] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:19.164687  5022 catalog_manager.cc:5697] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 reported cstate change: config changed from index 3 to 4, VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) evicted. New cstate: current_term: 1 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:19.168025  6197 raft_consensus.cc:993] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929: : Instructing follower bce73265e27d4b30a4dcc1e491305088 to start an election
I20260709 12:13:19.189576  6197 raft_consensus.cc:1081] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Signalling peer bce73265e27d4b30a4dcc1e491305088 to start an election
I20260709 12:13:19.281718  5122 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
new_leader_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:45628
I20260709 12:13:19.282339  5122 raft_consensus.cc:606] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Received request to transfer leadership to TS 9e794b72ed7640219f90ec4232363929
W20260709 12:13:19.285068  6380 log.cc:927] Time spent T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 12:13:19.285535  5272 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
mode: GRACEFUL
new_leader_uuid: "bce73265e27d4b30a4dcc1e491305088"
 from {username='slave'} at 127.0.0.1:42506
I20260709 12:13:19.286132  5272 raft_consensus.cc:606] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Received request to transfer leadership to TS bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:19.288096  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:13:19.178658  5117 raft_consensus.cc:2955] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:19.309918  5186 tablet_service.cc:1558] Processing DeleteTablet for tablet d09ac3a18bc549dabadd7ec3c3f57017 with delete_type TABLET_DATA_TOMBSTONED (TS dd62e75bd3ed4ed28f1fb5955d650808 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47718
I20260709 12:13:19.321856  5124 raft_consensus.cc:2955] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:19.332299  5265 raft_consensus.cc:1275] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:19.344413  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:19.345651  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:19.356297  6338 consensus_queue.cc:1048] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 12:13:19.434063  5835 raft_consensus.cc:1275] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 12:13:19.441355  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 203570us
I20260709 12:13:19.447777  5835 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8"
dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
 from {username='slave'} at 127.0.0.1:46088
I20260709 12:13:19.449162  5832 raft_consensus.cc:2955] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:19.457402  5191 raft_consensus.cc:2955] T c69b050cdaeb4f1db6cd4993ad703192 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:19.453032  5835 raft_consensus.cc:493] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:19.460310  5835 raft_consensus.cc:3060] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.469553  6306 raft_consensus.cc:993] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929: : Instructing follower bce73265e27d4b30a4dcc1e491305088 to start an election
I20260709 12:13:19.470760  6339 raft_consensus.cc:993] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808: : Instructing follower bce73265e27d4b30a4dcc1e491305088 to start an election
I20260709 12:13:19.471311  6339 raft_consensus.cc:1081] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Signalling peer bce73265e27d4b30a4dcc1e491305088 to start an election
I20260709 12:13:19.473846  5837 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0"
dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
 from {username='slave'} at 127.0.0.1:46100
I20260709 12:13:19.474452  5837 raft_consensus.cc:493] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:19.474779  5837 raft_consensus.cc:3060] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.475284  6306 raft_consensus.cc:1081] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Signalling peer bce73265e27d4b30a4dcc1e491305088 to start an election
I20260709 12:13:19.499382  6384 tablet_replica.cc:333] T d09ac3a18bc549dabadd7ec3c3f57017 P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
I20260709 12:13:19.500949  6256 raft_consensus.cc:993] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821: : Instructing follower 9e794b72ed7640219f90ec4232363929 to start an election
I20260709 12:13:19.501534  6256 raft_consensus.cc:1081] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Signalling peer 9e794b72ed7640219f90ec4232363929 to start an election
I20260709 12:13:19.501792  6384 raft_consensus.cc:2243] T d09ac3a18bc549dabadd7ec3c3f57017 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:19.503225  6384 raft_consensus.cc:2272] T d09ac3a18bc549dabadd7ec3c3f57017 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:19.508037  6384 ts_tablet_manager.cc:1916] T d09ac3a18bc549dabadd7ec3c3f57017 P dd62e75bd3ed4ed28f1fb5955d650808: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:19.514137  5265 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:34674
I20260709 12:13:19.514750  5265 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:19.515130  5265 raft_consensus.cc:3060] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.522892  5834 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017"
dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
 from {username='slave'} at 127.0.0.1:46088
I20260709 12:13:19.523834  5834 raft_consensus.cc:493] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:19.524330  5834 raft_consensus.cc:3060] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.531119  5837 raft_consensus.cc:515] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:19.540194  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:19.540795  5122 raft_consensus.cc:3060] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.541819  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:19.542408  5196 raft_consensus.cc:3055] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:19.542699  5196 raft_consensus.cc:740] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:19.543396  5196 consensus_queue.cc:260] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:19.544528  5196 raft_consensus.cc:3060] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.546769  5837 leader_election.cc:290] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:19.532315  5265 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:19.533509  5834 raft_consensus.cc:515] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:19.548411  6354 consensus_queue.cc:1048] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:13:19.549343  5834 leader_election.cc:290] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:19.551092  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:19.551645  5124 raft_consensus.cc:3060] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.551973  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:19.552668  5266 raft_consensus.cc:3055] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:19.552943  5266 raft_consensus.cc:740] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:19.553711  5266 consensus_queue.cc:260] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:19.556130  5266 raft_consensus.cc:3060] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.558331  5122 raft_consensus.cc:2468] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 2.
I20260709 12:13:19.564877  5266 raft_consensus.cc:2468] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 2.
I20260709 12:13:19.567636  5124 raft_consensus.cc:2468] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 2.
I20260709 12:13:19.573583  5801 leader_election.cc:304] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:13:19.574568  6324 raft_consensus.cc:2804] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:19.575042  6324 raft_consensus.cc:697] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 2 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:13:19.575845  6324 consensus_queue.cc:237] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:19.575701  5021 catalog_manager.cc:5697] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:19.587960  5022 catalog_manager.cc:5697] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 1 to 2, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 2 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:19.559988  5804 leader_election.cc:304] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:13:19.591655  6256 raft_consensus.cc:993] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821: : Instructing follower 9e794b72ed7640219f90ec4232363929 to start an election
I20260709 12:13:19.592182  6256 raft_consensus.cc:1081] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Signalling peer 9e794b72ed7640219f90ec4232363929 to start an election
I20260709 12:13:19.592202  6324 raft_consensus.cc:2804] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:19.593684  6324 raft_consensus.cc:697] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 2 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:13:19.594573  6324 consensus_queue.cc:237] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:19.594640  5266 consensus_queue.cc:237] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:19.606156  5124 raft_consensus.cc:1275] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:19.611450  6258 consensus_queue.cc:1048] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:19.614444  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:19.615083  5117 raft_consensus.cc:3055] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:19.615362  5265 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:19.615417  5117 raft_consensus.cc:740] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:19.620644  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:19.621306  5200 raft_consensus.cc:3060] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.627758  5193 consensus_queue.cc:237] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:19.635476  5124 raft_consensus.cc:2955] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:19.632114  6343 raft_consensus.cc:2955] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:19.642493  5273 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7a9971183fee4e958cff325230a31b26"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:34674
I20260709 12:13:19.643267  5273 raft_consensus.cc:493] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:19.643615  5273 raft_consensus.cc:3060] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.645848  6250 raft_consensus.cc:2955] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:19.652873  5200 raft_consensus.cc:2468] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 2.
I20260709 12:13:19.652195  5837 raft_consensus.cc:2955] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:19.617102  5117 consensus_queue.cc:260] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:19.661718  5237 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:19.665588  6258 raft_consensus.cc:2804] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:19.666114  6258 raft_consensus.cc:697] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 2 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:19.675585  5273 raft_consensus.cc:515] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:19.675320  6258 consensus_queue.cc:237] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:19.683220  5117 raft_consensus.cc:3060] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.691365  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:19.692030  5120 raft_consensus.cc:3055] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:19.692364  5120 raft_consensus.cc:740] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:19.693135  5120 consensus_queue.cc:260] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:19.694090  5120 raft_consensus.cc:3060] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.696408  6283 raft_consensus.cc:993] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821: : Instructing follower bce73265e27d4b30a4dcc1e491305088 to start an election
I20260709 12:13:19.691208  5022 catalog_manager.cc:5697] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 1 to 2, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 2 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:19.697235  5117 raft_consensus.cc:2468] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 2.
I20260709 12:13:19.706720  6283 raft_consensus.cc:1081] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Signalling peer bce73265e27d4b30a4dcc1e491305088 to start an election
I20260709 12:13:19.708770  5117 raft_consensus.cc:1275] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:19.717495  6236 consensus_queue.cc:1048] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:19.719972  5836 raft_consensus.cc:1275] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:19.722541  5023 catalog_manager.cc:5697] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: config changed from index 3 to 4, VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) evicted. New cstate: current_term: 1 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:19.726001  6339 consensus_queue.cc:1048] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:19.725922  5834 raft_consensus.cc:1275] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:19.736478  5186 tablet_service.cc:1558] Processing DeleteTablet for tablet c69b050cdaeb4f1db6cd4993ad703192 with delete_type TABLET_DATA_TOMBSTONED (TS dd62e75bd3ed4ed28f1fb5955d650808 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47718
I20260709 12:13:19.741506  5007 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c69b050cdaeb4f1db6cd4993ad703192 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:19.751641  5837 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78"
dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
 from {username='slave'} at 127.0.0.1:46094
I20260709 12:13:19.752226  5837 raft_consensus.cc:493] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:19.752645  5837 raft_consensus.cc:3060] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.752178  5120 raft_consensus.cc:2468] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 2.
I20260709 12:13:19.751128  6315 consensus_queue.cc:1048] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 12:13:19.766314  5240 leader_election.cc:304] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:13:19.769675  5834 raft_consensus.cc:2955] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:19.781025  5273 leader_election.cc:290] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:19.783207  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:19.785097  5193 raft_consensus.cc:3060] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.785975  5837 raft_consensus.cc:515] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:19.788318  5088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:19.783506  6099 raft_consensus.cc:2955] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e794b72ed7640219f90ec4232363929 (127.3.212.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:19.800778  5837 leader_election.cc:290] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:19.785624  6315 raft_consensus.cc:2804] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:19.812202  5832 raft_consensus.cc:2955] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e794b72ed7640219f90ec4232363929 (127.3.212.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:19.813628  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:19.814421  5120 raft_consensus.cc:3055] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:19.814817  5120 raft_consensus.cc:740] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:19.815646  5196 raft_consensus.cc:2468] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 2.
I20260709 12:13:19.819206  5193 raft_consensus.cc:2468] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 2.
I20260709 12:13:19.823009  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:19.816725  5120 consensus_queue.cc:260] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:19.824436  5273 raft_consensus.cc:3060] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.825234  5120 raft_consensus.cc:3060] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.819788  6315 raft_consensus.cc:697] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [term 2 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:19.833985  6315 consensus_queue.cc:237] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:19.829591  5124 raft_consensus.cc:2955] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e794b72ed7640219f90ec4232363929 (127.3.212.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:19.834801  5022 catalog_manager.cc:5697] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 1 to 2, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 2 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:19.844313  5023 catalog_manager.cc:5697] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: config changed from index 3 to 4, VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) evicted. New cstate: current_term: 1 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
W20260709 12:13:19.845930  6385 log.cc:927] Time spent T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 12:13:19.853333  5273 raft_consensus.cc:2468] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 2.
I20260709 12:13:19.854884  5801 leader_election.cc:304] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:13:19.855881  6293 raft_consensus.cc:2804] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:19.859349  6293 raft_consensus.cc:697] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 2 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:13:19.860271  6293 consensus_queue.cc:237] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:19.862244  5108 tablet_service.cc:1558] Processing DeleteTablet for tablet e3beaf3ce31042719868401157039ee9 with delete_type TABLET_DATA_TOMBSTONED (TS ad2f9a1e2f7a45429fa69fd23d09f821 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40378
I20260709 12:13:19.867324  5272 raft_consensus.cc:2955] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:19.888911  5007 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a6b2fb64d40642259e41424cef193db0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:19.889909  5007 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e3beaf3ce31042719868401157039ee9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:19.889137  5835 raft_consensus.cc:515] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:19.952957  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 58151.3us
I20260709 12:13:19.970081  5835 leader_election.cc:290] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:19.970345  5836 raft_consensus.cc:1240] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:19.972937  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:19.997027  5266 raft_consensus.cc:3055] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:19.997357  5266 raft_consensus.cc:740] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:19.998082  5266 consensus_queue.cc:260] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:19.999123  5266 raft_consensus.cc:3060] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.974750  5120 raft_consensus.cc:2468] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 2.
I20260709 12:13:19.978343  6384 ts_tablet_manager.cc:1929] T d09ac3a18bc549dabadd7ec3c3f57017 P dd62e75bd3ed4ed28f1fb5955d650808: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:19.991621  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:20.008193  5193 raft_consensus.cc:3060] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:19.993762  5022 catalog_manager.cc:5697] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 1 to 2, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 2 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:20.012420  5022 catalog_manager.cc:5697] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: config changed from index 3 to 4, VOTER 9e794b72ed7640219f90ec4232363929 (127.3.212.131) evicted. New cstate: current_term: 1 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:20.019464  5266 raft_consensus.cc:2468] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 2.
I20260709 12:13:20.003345  6388 tablet_replica.cc:333] T e3beaf3ce31042719868401157039ee9 P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:13:20.004995  6384 log.cc:1199] T d09ac3a18bc549dabadd7ec3c3f57017 P dd62e75bd3ed4ed28f1fb5955d650808: Deleting WAL directory at /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/ts-1-root/wals/d09ac3a18bc549dabadd7ec3c3f57017
W20260709 12:13:20.050745  6387 log.cc:927] Time spent T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:13:20.051756  5801 leader_election.cc:304] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:13:20.053123  6324 raft_consensus.cc:2804] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:20.067284  6324 raft_consensus.cc:697] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 2 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:13:20.065502  6384 tablet_replica.cc:333] T c69b050cdaeb4f1db6cd4993ad703192 P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
I20260709 12:13:20.066387  5193 raft_consensus.cc:2468] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 2.
I20260709 12:13:20.067925  5196 raft_consensus.cc:1275] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:20.083366  5007 catalog_manager.cc:5028] TS dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): tablet d09ac3a18bc549dabadd7ec3c3f57017 (table test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]) successfully deleted
W20260709 12:13:20.089192  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 73981us
I20260709 12:13:20.097329  6384 raft_consensus.cc:2243] T c69b050cdaeb4f1db6cd4993ad703192 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:20.098287  6384 raft_consensus.cc:2272] T c69b050cdaeb4f1db6cd4993ad703192 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:20.098443  6293 consensus_queue.cc:1048] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:20.104617  5263 tablet_service.cc:1558] Processing DeleteTablet for tablet a6b2fb64d40642259e41424cef193db0 with delete_type TABLET_DATA_TOMBSTONED (TS 9e794b72ed7640219f90ec4232363929 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34668
I20260709 12:13:20.107143  5021 catalog_manager.cc:5697] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 1 to 2, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 2 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:20.068281  6324 consensus_queue.cc:237] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:20.123847  6384 ts_tablet_manager.cc:1916] T c69b050cdaeb4f1db6cd4993ad703192 P dd62e75bd3ed4ed28f1fb5955d650808: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:20.138456  6388 raft_consensus.cc:2243] T e3beaf3ce31042719868401157039ee9 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:20.139523  6388 raft_consensus.cc:2272] T e3beaf3ce31042719868401157039ee9 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:20.144892  6388 ts_tablet_manager.cc:1916] T e3beaf3ce31042719868401157039ee9 P ad2f9a1e2f7a45429fa69fd23d09f821: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:20.145220  5124 raft_consensus.cc:1275] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:20.148679  5122 raft_consensus.cc:1275] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:20.151495  5270 raft_consensus.cc:1275] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:20.152367  6392 consensus_queue.cc:1048] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:20.159730  6293 consensus_queue.cc:1048] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:20.161183  6391 consensus_queue.cc:1048] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:20.205091  5019 catalog_manager.cc:5697] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 1 to 2, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 2 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:20.217917  5200 raft_consensus.cc:1275] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:20.221247  6352 consensus_queue.cc:1048] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:13:20.234458  5117 raft_consensus.cc:1275] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:20.237402  6250 consensus_queue.cc:1048] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:20.262486  6384 ts_tablet_manager.cc:1929] T c69b050cdaeb4f1db6cd4993ad703192 P dd62e75bd3ed4ed28f1fb5955d650808: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:20.263049  6384 log.cc:1199] T c69b050cdaeb4f1db6cd4993ad703192 P dd62e75bd3ed4ed28f1fb5955d650808: Deleting WAL directory at /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/ts-1-root/wals/c69b050cdaeb4f1db6cd4993ad703192
I20260709 12:13:20.265308  5007 catalog_manager.cc:5028] TS dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): tablet c69b050cdaeb4f1db6cd4993ad703192 (table test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]) successfully deleted
I20260709 12:13:20.273587  6393 tablet_replica.cc:333] T a6b2fb64d40642259e41424cef193db0 P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
I20260709 12:13:20.278131  5117 raft_consensus.cc:1275] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:20.278106  6393 raft_consensus.cc:2243] T a6b2fb64d40642259e41424cef193db0 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:20.299022  6390 consensus_queue.cc:1048] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:13:20.316370  6388 ts_tablet_manager.cc:1929] T e3beaf3ce31042719868401157039ee9 P ad2f9a1e2f7a45429fa69fd23d09f821: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:20.322685  6388 log.cc:1199] T e3beaf3ce31042719868401157039ee9 P ad2f9a1e2f7a45429fa69fd23d09f821: Deleting WAL directory at /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/ts-0-root/wals/e3beaf3ce31042719868401157039ee9
I20260709 12:13:20.315135  6393 raft_consensus.cc:2272] T a6b2fb64d40642259e41424cef193db0 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:20.334606  5010 catalog_manager.cc:5028] TS ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): tablet e3beaf3ce31042719868401157039ee9 (table test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]) successfully deleted
W20260709 12:13:20.325687  6394 log.cc:927] Time spent T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:13:20.353710  5125 raft_consensus.cc:1275] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:20.357937  6293 consensus_queue.cc:1048] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:20.386027  5200 raft_consensus.cc:1275] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:20.456907  6393 ts_tablet_manager.cc:1916] T a6b2fb64d40642259e41424cef193db0 P 9e794b72ed7640219f90ec4232363929: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:20.462857  6352 consensus_queue.cc:1048] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:13:20.465308  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 73464.7us
I20260709 12:13:20.504648  5270 raft_consensus.cc:1275] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:13:20.517511  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 60834.5us
I20260709 12:13:20.510048  6411 consensus_queue.cc:1048] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:13:20.541733  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 51621.1us
I20260709 12:13:20.562644  6393 ts_tablet_manager.cc:1929] T a6b2fb64d40642259e41424cef193db0 P 9e794b72ed7640219f90ec4232363929: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:20.563135  6393 log.cc:1199] T a6b2fb64d40642259e41424cef193db0 P 9e794b72ed7640219f90ec4232363929: Deleting WAL directory at /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/ts-2-root/wals/a6b2fb64d40642259e41424cef193db0
I20260709 12:13:20.571560  5007 catalog_manager.cc:5028] TS 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): tablet a6b2fb64d40642259e41424cef193db0 (table test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]) successfully deleted
I20260709 12:13:20.628909  5266 raft_consensus.cc:1275] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:20.632230  6412 consensus_queue.cc:1048] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:20.635951  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:20.666515  5199 raft_consensus.cc:1275] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:20.668823  6391 consensus_queue.cc:1048] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:20.718555  5199 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2"
dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
mode: GRACEFUL
new_leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
 from {username='slave'} at 127.0.0.1:53902
I20260709 12:13:20.719172  5199 raft_consensus.cc:606] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Received request to transfer leadership to TS ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:20.722780  5193 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b"
dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
mode: GRACEFUL
new_leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
 from {username='slave'} at 127.0.0.1:53902
I20260709 12:13:20.723448  5193 raft_consensus.cc:606] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Received request to transfer leadership to TS ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:20.727021  5117 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
new_leader_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:45628
I20260709 12:13:20.727633  5117 raft_consensus.cc:606] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Received request to transfer leadership to TS 9e794b72ed7640219f90ec4232363929
I20260709 12:13:20.739425  5117 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
new_leader_uuid: "bce73265e27d4b30a4dcc1e491305088"
 from {username='slave'} at 127.0.0.1:45628
I20260709 12:13:20.740039  5117 raft_consensus.cc:606] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Received request to transfer leadership to TS bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:20.741307  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:13:20.742973  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:20.743734  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:20.823199  6378 raft_consensus.cc:993] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821: : Instructing follower bce73265e27d4b30a4dcc1e491305088 to start an election
I20260709 12:13:20.823706  6216 raft_consensus.cc:1081] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Signalling peer bce73265e27d4b30a4dcc1e491305088 to start an election
I20260709 12:13:20.825489  5835 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c"
dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
 from {username='slave'} at 127.0.0.1:46094
I20260709 12:13:20.826114  5835 raft_consensus.cc:493] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:20.826535  5835 raft_consensus.cc:3060] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.834158  5835 raft_consensus.cc:515] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:20.839854  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:20.840474  5117 raft_consensus.cc:3055] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:20.840770  5117 raft_consensus.cc:740] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:20.841543  5117 consensus_queue.cc:260] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:20.842638  5117 raft_consensus.cc:3060] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.863287  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:20.863951  5197 raft_consensus.cc:3060] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.863022  5835 leader_election.cc:290] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:20.871649  5197 raft_consensus.cc:2468] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 2.
I20260709 12:13:20.863401  5117 raft_consensus.cc:2468] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 2.
I20260709 12:13:20.874622  5801 leader_election.cc:304] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:20.875687  6412 raft_consensus.cc:2804] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:20.876184  6412 raft_consensus.cc:697] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 2 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:13:20.876900  6412 consensus_queue.cc:237] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:20.898589  5020 catalog_manager.cc:5697] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 1 to 2, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 2 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:20.902060  6216 raft_consensus.cc:993] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821: : Instructing follower 9e794b72ed7640219f90ec4232363929 to start an election
I20260709 12:13:20.902660  6378 raft_consensus.cc:1081] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Signalling peer 9e794b72ed7640219f90ec4232363929 to start an election
I20260709 12:13:20.906185  5270 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:34674
I20260709 12:13:20.906819  5270 raft_consensus.cc:493] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:20.907205  5270 raft_consensus.cc:3060] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.914423  5270 raft_consensus.cc:515] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:20.919998  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:20.920660  5193 raft_consensus.cc:3060] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.923521  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:20.924175  5125 raft_consensus.cc:3055] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:20.924459  5125 raft_consensus.cc:740] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:20.925194  5125 consensus_queue.cc:260] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:20.926216  5125 raft_consensus.cc:3060] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:20.934710  5125 raft_consensus.cc:2468] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 2.
I20260709 12:13:20.936061  5193 raft_consensus.cc:2468] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 2.
I20260709 12:13:20.937333  5237 leader_election.cc:304] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:20.938217  5270 leader_election.cc:290] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:20.939893  6197 raft_consensus.cc:2804] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:20.940362  6197 raft_consensus.cc:697] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 2 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:20.941164  6197 consensus_queue.cc:237] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:20.988544  5019 catalog_manager.cc:5697] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 1 to 2, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 2 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:21.044256  6338 raft_consensus.cc:993] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808: : Instructing follower ad2f9a1e2f7a45429fa69fd23d09f821 to start an election
I20260709 12:13:21.044761  6338 raft_consensus.cc:1081] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Signalling peer ad2f9a1e2f7a45429fa69fd23d09f821 to start an election
I20260709 12:13:21.047552  5125 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
 from {username='slave'} at 127.0.0.1:40386
I20260709 12:13:21.048163  5125 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:21.048591  5125 raft_consensus.cc:3060] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:21.079777  5125 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:21.085355  5125 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:21.087810  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:21.088533  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:21.089176  5835 raft_consensus.cc:3060] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:21.088487  5193 raft_consensus.cc:3055] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:21.091199  5193 raft_consensus.cc:740] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:21.091953  5193 consensus_queue.cc:260] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:21.093555  5193 raft_consensus.cc:3060] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:21.103863  5193 raft_consensus.cc:2468] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 2.
I20260709 12:13:21.115487  5088 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:21.116503  6332 raft_consensus.cc:2804] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:21.117022  6332 raft_consensus.cc:697] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:21.117906  6332 consensus_queue.cc:237] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:21.123320  6338 raft_consensus.cc:993] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808: : Instructing follower ad2f9a1e2f7a45429fa69fd23d09f821 to start an election
I20260709 12:13:21.124117  6339 raft_consensus.cc:1081] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Signalling peer ad2f9a1e2f7a45429fa69fd23d09f821 to start an election
I20260709 12:13:21.126432  5125 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
 from {username='slave'} at 127.0.0.1:40386
I20260709 12:13:21.127059  5125 raft_consensus.cc:493] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:21.127445  5125 raft_consensus.cc:3060] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:21.134549  5125 raft_consensus.cc:515] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:21.136693  5125 leader_election.cc:290] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:21.138370  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:21.138980  5266 raft_consensus.cc:3060] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:21.140162  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:21.140836  5193 raft_consensus.cc:3055] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:21.141135  5193 raft_consensus.cc:740] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:21.142128  5193 consensus_queue.cc:260] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:21.143455  5193 raft_consensus.cc:3060] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:21.146483  5266 raft_consensus.cc:2468] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 2.
I20260709 12:13:21.148160  5088 leader_election.cc:304] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:13:21.148947  6216 raft_consensus.cc:2804] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:21.149590  6216 raft_consensus.cc:697] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:21.150547  6216 consensus_queue.cc:237] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:21.174175  5835 raft_consensus.cc:2468] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 2.
I20260709 12:13:21.176577  5193 raft_consensus.cc:2468] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 2.
I20260709 12:13:21.191591  5019 catalog_manager.cc:5697] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 1 to 2, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 2 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:21.210048  5019 catalog_manager.cc:5697] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 1 to 2, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 2 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:21.237890  5266 consensus_queue.cc:237] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
W20260709 12:13:21.248708  5238 consensus_peers.cc:597] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 -> Peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Couldn't send request to peer bce73265e27d4b30a4dcc1e491305088. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9f93759199ab4820a9a807a0f1c70c85. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:21.251886  5193 raft_consensus.cc:1275] T 9f93759199ab4820a9a807a0f1c70c85 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:21.254076  6197 consensus_queue.cc:1048] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:21.271773  6352 raft_consensus.cc:2955] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:21.274049  5125 raft_consensus.cc:1275] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:21.275864  6390 consensus_queue.cc:1048] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:21.290959  5120 consensus_queue.cc:237] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:21.289942  5193 raft_consensus.cc:2955] T 9f93759199ab4820a9a807a0f1c70c85 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:21.290721  5125 raft_consensus.cc:2955] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:21.303448  5117 raft_consensus.cc:1275] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:21.304806  6412 consensus_queue.cc:1048] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:13:21.318652  5089 consensus_peers.cc:597] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 -> Peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Couldn't send request to peer bce73265e27d4b30a4dcc1e491305088. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 62577fc91bb44d3a882109dc63f74008. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:21.322175  5193 raft_consensus.cc:1275] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:21.323652  6332 consensus_queue.cc:1048] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:21.352183  5020 catalog_manager.cc:5697] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 reported cstate change: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New cstate: current_term: 1 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:21.372471  5193 raft_consensus.cc:1275] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:21.376297  6411 consensus_queue.cc:1048] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:21.391642  5117 raft_consensus.cc:1275] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:21.418399  6390 consensus_queue.cc:1048] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:21.432097  5266 raft_consensus.cc:1275] T 62577fc91bb44d3a882109dc63f74008 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:21.433827  6216 consensus_queue.cc:1048] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:21.446097  5197 raft_consensus.cc:1275] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:21.455536  6432 consensus_queue.cc:1048] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:21.463294  6216 raft_consensus.cc:2955] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:21.464491  5268 raft_consensus.cc:2955] T 62577fc91bb44d3a882109dc63f74008 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:21.508152  5197 consensus_queue.cc:237] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:21.578205  5196 raft_consensus.cc:1275] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:21.579919  6332 consensus_queue.cc:1048] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:21.586505  5191 raft_consensus.cc:1275] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:21.591346  6216 consensus_queue.cc:1048] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:21.602169  5266 raft_consensus.cc:1275] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:13:21.603598  5164 consensus_peers.cc:597] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Couldn't send request to peer bce73265e27d4b30a4dcc1e491305088. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f34c97113147431584d6336e0d849164. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:21.603940  6378 consensus_queue.cc:1048] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:21.612272  5270 raft_consensus.cc:1275] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:21.615885  5199 raft_consensus.cc:2955] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:21.618191  6415 consensus_queue.cc:1048] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:21.619448  5122 raft_consensus.cc:1275] T f34c97113147431584d6336e0d849164 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:21.608683  5019 catalog_manager.cc:5697] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New cstate: current_term: 1 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:21.624754  6338 consensus_queue.cc:1048] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:21.628360  5835 raft_consensus.cc:1275] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:21.642041  6378 consensus_queue.cc:1048] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:21.682277  6451 raft_consensus.cc:2955] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:21.747246  5270 raft_consensus.cc:2955] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:21.779295  6456 ts_tablet_manager.cc:933] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088: Initiating tablet copy from peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:21.795143  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:21.779822  5117 raft_consensus.cc:2955] T f34c97113147431584d6336e0d849164 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:21.819804  5021 catalog_manager.cc:5697] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 reported cstate change: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New cstate: current_term: 1 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:21.845706  5266 consensus_queue.cc:237] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:21.870170  6456 tablet_copy_client.cc:323] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Beginning tablet copy session from remote peer at address 127.3.212.131:46709
I20260709 12:13:21.872117  5284 tablet_copy_service.cc:140] P 9e794b72ed7640219f90ec4232363929: Received BeginTabletCopySession request for tablet 9f93759199ab4820a9a807a0f1c70c85 from peer bce73265e27d4b30a4dcc1e491305088 ({username='slave'} at 127.0.0.1:50932)
I20260709 12:13:21.872678  5284 tablet_copy_service.cc:161] P 9e794b72ed7640219f90ec4232363929: Beginning new tablet copy session on tablet 9f93759199ab4820a9a807a0f1c70c85 from peer bce73265e27d4b30a4dcc1e491305088 at {username='slave'} at 127.0.0.1:50932: session id = bce73265e27d4b30a4dcc1e491305088-9f93759199ab4820a9a807a0f1c70c85
I20260709 12:13:21.882439  5284 tablet_copy_source_session.cc:215] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:21.887831  6456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f93759199ab4820a9a807a0f1c70c85. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:13:21.894304  5238 consensus_peers.cc:597] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 -> Peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Couldn't send request to peer bce73265e27d4b30a4dcc1e491305088. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b4b265799c1c447794c6126f3ae47e5d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:21.884553  6460 ts_tablet_manager.cc:933] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088: Initiating tablet copy from peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443)
I20260709 12:13:21.899138  5199 raft_consensus.cc:1275] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:21.900266  5125 raft_consensus.cc:1275] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:21.900748  6390 consensus_queue.cc:1048] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:21.904451  6432 consensus_queue.cc:1048] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:21.910790  6456 tablet_copy_client.cc:806] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:21.911526  6456 tablet_copy_client.cc:670] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:21.926642  6460 tablet_copy_client.cc:323] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Beginning tablet copy session from remote peer at address 127.3.212.129:34443
I20260709 12:13:21.926103  6352 raft_consensus.cc:2955] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:21.928925  5135 tablet_copy_service.cc:140] P ad2f9a1e2f7a45429fa69fd23d09f821: Received BeginTabletCopySession request for tablet 62577fc91bb44d3a882109dc63f74008 from peer bce73265e27d4b30a4dcc1e491305088 ({username='slave'} at 127.0.0.1:59390)
I20260709 12:13:21.929575  5135 tablet_copy_service.cc:161] P ad2f9a1e2f7a45429fa69fd23d09f821: Beginning new tablet copy session on tablet 62577fc91bb44d3a882109dc63f74008 from peer bce73265e27d4b30a4dcc1e491305088 at {username='slave'} at 127.0.0.1:59390: session id = bce73265e27d4b30a4dcc1e491305088-62577fc91bb44d3a882109dc63f74008
I20260709 12:13:21.936764  5125 raft_consensus.cc:2955] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:21.942476  5197 raft_consensus.cc:2955] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:21.946974  6456 tablet_copy_client.cc:538] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:21.941591  5135 tablet_copy_source_session.cc:215] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:21.952296  6460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62577fc91bb44d3a882109dc63f74008. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:21.954340  5117 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
new_leader_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:45628
I20260709 12:13:21.955063  5117 raft_consensus.cc:606] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Received request to transfer leadership to TS 9e794b72ed7640219f90ec4232363929
I20260709 12:13:21.971813  6456 tablet_bootstrap.cc:492] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088: Bootstrap starting.
I20260709 12:13:21.978431  5193 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a975d4f227214562b6fc39ea53081961"
dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
mode: GRACEFUL
new_leader_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:53902
I20260709 12:13:21.979161  5193 raft_consensus.cc:606] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Received request to transfer leadership to TS 9e794b72ed7640219f90ec4232363929
I20260709 12:13:21.983197  5268 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
mode: GRACEFUL
new_leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
 from {username='slave'} at 127.0.0.1:42506
I20260709 12:13:21.983788  5268 raft_consensus.cc:606] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Received request to transfer leadership to TS dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:21.985301  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:13:21.986850  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:21.987591  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:21.987912  5021 catalog_manager.cc:5697] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: config changed from index -1 to 3, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New cstate: current_term: 2 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:22.039680  6460 tablet_copy_client.cc:806] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:22.049750  6460 tablet_copy_client.cc:670] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:22.055636  6460 tablet_copy_client.cc:538] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:22.070390  6456 tablet_bootstrap.cc:492] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:22.071467  6456 tablet_bootstrap.cc:492] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088: Bootstrap complete.
I20260709 12:13:22.072305  6456 ts_tablet_manager.cc:1403] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088: Time spent bootstrapping tablet: real 0.103s	user 0.021s	sys 0.002s
I20260709 12:13:22.072579  6460 tablet_bootstrap.cc:492] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088: Bootstrap starting.
I20260709 12:13:22.075629  6456 raft_consensus.cc:359] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:22.076629  6456 raft_consensus.cc:740] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Initialized, Role: LEARNER
I20260709 12:13:22.077342  6456 consensus_queue.cc:260] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:22.119269  6456 ts_tablet_manager.cc:1434] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088: Time spent starting tablet: real 0.047s	user 0.005s	sys 0.000s
I20260709 12:13:22.156819  6415 raft_consensus.cc:993] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808: : Instructing follower 9e794b72ed7640219f90ec4232363929 to start an election
I20260709 12:13:22.157400  6338 raft_consensus.cc:1081] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Signalling peer 9e794b72ed7640219f90ec4232363929 to start an election
I20260709 12:13:22.162108  5268 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a975d4f227214562b6fc39ea53081961"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:34672
I20260709 12:13:22.162684  5268 raft_consensus.cc:493] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:22.163050  5268 raft_consensus.cc:3060] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:22.166491  5836 raft_consensus.cc:1217] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:22.170202  5268 raft_consensus.cc:515] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:22.172334  5268 leader_election.cc:290] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:22.195894  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:22.196650  5197 raft_consensus.cc:3055] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:22.196954  5197 raft_consensus.cc:740] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:22.197798  5197 consensus_queue.cc:260] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:22.212297  5197 raft_consensus.cc:3060] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:22.228415  6466 ts_tablet_manager.cc:933] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088: Initiating tablet copy from peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:22.232111  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:22.232787  5835 raft_consensus.cc:3060] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:22.232957  5197 raft_consensus.cc:2468] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 2.
I20260709 12:13:22.252692  5237 leader_election.cc:304] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:22.274772  6197 raft_consensus.cc:2804] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:22.280812  6466 tablet_copy_client.cc:323] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Beginning tablet copy session from remote peer at address 127.3.212.130:44455
I20260709 12:13:22.281774  6332 raft_consensus.cc:993] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821: : Instructing follower 9e794b72ed7640219f90ec4232363929 to start an election
I20260709 12:13:22.282500  5210 tablet_copy_service.cc:140] P dd62e75bd3ed4ed28f1fb5955d650808: Received BeginTabletCopySession request for tablet f34c97113147431584d6336e0d849164 from peer bce73265e27d4b30a4dcc1e491305088 ({username='slave'} at 127.0.0.1:41416)
I20260709 12:13:22.283051  5210 tablet_copy_service.cc:161] P dd62e75bd3ed4ed28f1fb5955d650808: Beginning new tablet copy session on tablet f34c97113147431584d6336e0d849164 from peer bce73265e27d4b30a4dcc1e491305088 at {username='slave'} at 127.0.0.1:41416: session id = bce73265e27d4b30a4dcc1e491305088-f34c97113147431584d6336e0d849164
I20260709 12:13:22.283317  6378 raft_consensus.cc:1081] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Signalling peer 9e794b72ed7640219f90ec4232363929 to start an election
I20260709 12:13:22.286798  5270 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:34674
I20260709 12:13:22.287395  5270 raft_consensus.cc:493] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:22.287796  5270 raft_consensus.cc:3060] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:22.295696  5284 tablet_copy_service.cc:342] P 9e794b72ed7640219f90ec4232363929: Request end of tablet copy session bce73265e27d4b30a4dcc1e491305088-9f93759199ab4820a9a807a0f1c70c85 received from {username='slave'} at 127.0.0.1:50932
I20260709 12:13:22.296195  5284 tablet_copy_service.cc:434] P 9e794b72ed7640219f90ec4232363929: ending tablet copy session bce73265e27d4b30a4dcc1e491305088-9f93759199ab4820a9a807a0f1c70c85 on tablet 9f93759199ab4820a9a807a0f1c70c85 with peer bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:22.300654  5270 raft_consensus.cc:515] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:22.308774  5270 leader_election.cc:290] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:22.309777  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:22.310391  5199 raft_consensus.cc:3060] T 9f927a751b4041e99eb5ac25ddf214ec P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:22.315757  5210 tablet_copy_source_session.cc:215] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:22.317293  5199 raft_consensus.cc:2468] T 9f927a751b4041e99eb5ac25ddf214ec P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 2.
I20260709 12:13:22.323153  5237 leader_election.cc:304] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:22.323391  6197 raft_consensus.cc:697] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 2 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:22.324532  6197 consensus_queue.cc:237] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:22.328325  6468 raft_consensus.cc:2804] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:22.352018  6468 raft_consensus.cc:697] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 2 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:22.331615  5835 raft_consensus.cc:2468] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 2.
I20260709 12:13:22.331511  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:22.355700  5117 raft_consensus.cc:3055] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:22.356043  5117 raft_consensus.cc:740] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:22.347764  6466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f34c97113147431584d6336e0d849164. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:22.352977  6468 consensus_queue.cc:237] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:22.358858  5117 consensus_queue.cc:260] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:22.364554  5117 raft_consensus.cc:3060] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:22.373548  6460 tablet_bootstrap.cc:492] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:22.374037  6456 ts_tablet_manager.cc:933] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088: Initiating tablet copy from peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:22.374555  6460 tablet_bootstrap.cc:492] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088: Bootstrap complete.
I20260709 12:13:22.375288  6460 ts_tablet_manager.cc:1403] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088: Time spent bootstrapping tablet: real 0.303s	user 0.060s	sys 0.054s
I20260709 12:13:22.381317  5117 raft_consensus.cc:2468] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 2.
I20260709 12:13:22.403759  6460 raft_consensus.cc:359] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:22.405063  6460 raft_consensus.cc:740] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Initialized, Role: LEARNER
I20260709 12:13:22.405813  6460 consensus_queue.cc:260] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:22.408478  6460 ts_tablet_manager.cc:1434] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.002s
I20260709 12:13:22.410301  5135 tablet_copy_service.cc:342] P ad2f9a1e2f7a45429fa69fd23d09f821: Request end of tablet copy session bce73265e27d4b30a4dcc1e491305088-62577fc91bb44d3a882109dc63f74008 received from {username='slave'} at 127.0.0.1:59390
I20260709 12:13:22.410738  5135 tablet_copy_service.cc:434] P ad2f9a1e2f7a45429fa69fd23d09f821: ending tablet copy session bce73265e27d4b30a4dcc1e491305088-62577fc91bb44d3a882109dc63f74008 on tablet 62577fc91bb44d3a882109dc63f74008 with peer bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:22.433195  6390 raft_consensus.cc:993] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929: : Instructing follower dd62e75bd3ed4ed28f1fb5955d650808 to start an election
I20260709 12:13:22.433728  6390 raft_consensus.cc:1081] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Signalling peer dd62e75bd3ed4ed28f1fb5955d650808 to start an election
I20260709 12:13:22.435468  5197 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61"
dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
 from {username='slave'} at 127.0.0.1:47728
I20260709 12:13:22.435988  5197 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:22.436343  5197 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:22.437117  6456 tablet_copy_client.cc:323] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088: tablet copy: Beginning tablet copy session from remote peer at address 127.3.212.131:46709
I20260709 12:13:22.445782  5197 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:22.447001  5284 tablet_copy_service.cc:140] P 9e794b72ed7640219f90ec4232363929: Received BeginTabletCopySession request for tablet b4b265799c1c447794c6126f3ae47e5d from peer bce73265e27d4b30a4dcc1e491305088 ({username='slave'} at 127.0.0.1:50932)
I20260709 12:13:22.447732  5284 tablet_copy_service.cc:161] P 9e794b72ed7640219f90ec4232363929: Beginning new tablet copy session on tablet b4b265799c1c447794c6126f3ae47e5d from peer bce73265e27d4b30a4dcc1e491305088 at {username='slave'} at 127.0.0.1:50932: session id = bce73265e27d4b30a4dcc1e491305088-b4b265799c1c447794c6126f3ae47e5d
I20260709 12:13:22.452145  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:22.452788  5117 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:22.452994  5197 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:22.453172  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:22.453754  5270 raft_consensus.cc:3055] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:22.454051  5270 raft_consensus.cc:740] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:22.454905  5270 consensus_queue.cc:260] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:22.462532  5022 catalog_manager.cc:5697] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 1 to 2, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 2 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:22.465152  5270 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:22.474522  5284 tablet_copy_source_session.cc:215] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:22.475026  5270 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 2.
I20260709 12:13:22.478080  5117 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 2.
I20260709 12:13:22.476320  5163 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:22.483678  6451 raft_consensus.cc:2804] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:22.488428  6451 raft_consensus.cc:697] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:22.492097  6451 consensus_queue.cc:237] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:22.489233  5022 catalog_manager.cc:5697] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 1 to 2, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 2 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:22.504629  6466 tablet_copy_client.cc:806] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:22.505280  6466 tablet_copy_client.cc:670] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:22.509294  6466 tablet_copy_client.cc:538] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:22.513167  6456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4b265799c1c447794c6126f3ae47e5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:22.534451  5019 catalog_manager.cc:5697] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 1 to 2, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 2 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:22.573290  6466 tablet_bootstrap.cc:492] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088: Bootstrap starting.
I20260709 12:13:22.574916  6456 tablet_copy_client.cc:806] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:22.580063  6456 tablet_copy_client.cc:670] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:22.584161  6456 tablet_copy_client.cc:538] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:22.616097  6456 tablet_bootstrap.cc:492] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088: Bootstrap starting.
I20260709 12:13:22.660609  6466 tablet_bootstrap.cc:492] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:22.661567  6466 tablet_bootstrap.cc:492] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088: Bootstrap complete.
I20260709 12:13:22.662242  6466 ts_tablet_manager.cc:1403] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088: Time spent bootstrapping tablet: real 0.089s	user 0.021s	sys 0.003s
I20260709 12:13:22.662843  6197 raft_consensus.cc:1064] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929: attempting to promote NON_VOTER bce73265e27d4b30a4dcc1e491305088 to VOTER
I20260709 12:13:22.665202  6197 consensus_queue.cc:237] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:22.669749  6466 raft_consensus.cc:359] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:22.670661  6466 raft_consensus.cc:740] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Initialized, Role: LEARNER
I20260709 12:13:22.671334  6466 consensus_queue.cc:260] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:22.680303  6466 ts_tablet_manager.cc:1434] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
I20260709 12:13:22.713658  5122 raft_consensus.cc:1275] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:22.716286  6352 consensus_queue.cc:1048] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:22.718961  5193 raft_consensus.cc:1275] T 9f93759199ab4820a9a807a0f1c70c85 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:22.724406  6468 consensus_queue.cc:1048] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:22.727986  5210 tablet_copy_service.cc:342] P dd62e75bd3ed4ed28f1fb5955d650808: Request end of tablet copy session bce73265e27d4b30a4dcc1e491305088-f34c97113147431584d6336e0d849164 received from {username='slave'} at 127.0.0.1:41416
I20260709 12:13:22.728533  5210 tablet_copy_service.cc:434] P dd62e75bd3ed4ed28f1fb5955d650808: ending tablet copy session bce73265e27d4b30a4dcc1e491305088-f34c97113147431584d6336e0d849164 on tablet f34c97113147431584d6336e0d849164 with peer bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:22.731913  5835 raft_consensus.cc:1275] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:22.733920  6468 consensus_queue.cc:1048] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:22.768507  5836 raft_consensus.cc:1217] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:22.777530  6456 tablet_bootstrap.cc:492] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:22.790328  6456 tablet_bootstrap.cc:492] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088: Bootstrap complete.
I20260709 12:13:22.791116  6456 ts_tablet_manager.cc:1403] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088: Time spent bootstrapping tablet: real 0.175s	user 0.019s	sys 0.010s
I20260709 12:13:22.776775  6468 raft_consensus.cc:2955] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:22.794243  6456 raft_consensus.cc:359] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:22.795171  6456 raft_consensus.cc:740] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Initialized, Role: LEARNER
I20260709 12:13:22.795867  6456 consensus_queue.cc:260] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:22.795948  5835 raft_consensus.cc:2955] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:22.800546  5193 raft_consensus.cc:2955] T 9f93759199ab4820a9a807a0f1c70c85 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:22.810308  6456 ts_tablet_manager.cc:1434] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 12:13:22.827109  5284 tablet_copy_service.cc:342] P 9e794b72ed7640219f90ec4232363929: Request end of tablet copy session bce73265e27d4b30a4dcc1e491305088-b4b265799c1c447794c6126f3ae47e5d received from {username='slave'} at 127.0.0.1:50932
I20260709 12:13:22.826422  5122 raft_consensus.cc:2955] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:22.827581  5284 tablet_copy_service.cc:434] P 9e794b72ed7640219f90ec4232363929: ending tablet copy session bce73265e27d4b30a4dcc1e491305088-b4b265799c1c447794c6126f3ae47e5d on tablet b4b265799c1c447794c6126f3ae47e5d with peer bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:22.833932  5193 raft_consensus.cc:1275] T 9f927a751b4041e99eb5ac25ddf214ec P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:22.835268  6352 consensus_queue.cc:1048] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:22.836573  5019 catalog_manager.cc:5697] T 9f93759199ab4820a9a807a0f1c70c85 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:22.862203  5266 consensus_queue.cc:237] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:22.868664  5122 raft_consensus.cc:1275] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:22.870302  6470 consensus_queue.cc:1048] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:22.872411  5836 raft_consensus.cc:1275] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:22.873849  6197 consensus_queue.cc:1048] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:22.880492  5835 raft_consensus.cc:1217] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:13:22.886147  6470 raft_consensus.cc:2955] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:22.894629  5196 raft_consensus.cc:1275] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:22.898976  5836 raft_consensus.cc:1275] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:22.902480  5836 raft_consensus.cc:1217] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:22.904906  6197 consensus_queue.cc:1048] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:22.905084  5122 raft_consensus.cc:2955] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:22.907615  6468 consensus_queue.cc:1048] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:22.920823  5836 raft_consensus.cc:2955] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:22.927320  5021 catalog_manager.cc:5697] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: config changed from index 3 to 4, VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) evicted. New cstate: current_term: 1 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:22.943234  5007 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9f93759199ab4820a9a807a0f1c70c85 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:22.952800  5186 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f93759199ab4820a9a807a0f1c70c85 with delete_type TABLET_DATA_TOMBSTONED (TS dd62e75bd3ed4ed28f1fb5955d650808 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47718
I20260709 12:13:22.965553  5266 raft_consensus.cc:1275] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:22.973409  6338 consensus_queue.cc:1048] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:22.977701  5122 raft_consensus.cc:1275] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:22.981393  6468 consensus_queue.cc:1048] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:23.098869  6484 tablet_replica.cc:333] T 9f93759199ab4820a9a807a0f1c70c85 P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
I20260709 12:13:23.100003  6484 raft_consensus.cc:2243] T 9f93759199ab4820a9a807a0f1c70c85 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.100688  6484 raft_consensus.cc:2272] T 9f93759199ab4820a9a807a0f1c70c85 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:23.133649  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 71373.9us
I20260709 12:13:23.144553  6484 ts_tablet_manager.cc:1916] T 9f93759199ab4820a9a807a0f1c70c85 P dd62e75bd3ed4ed28f1fb5955d650808: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:23.184980  5125 raft_consensus.cc:1275] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:23.205065  6495 consensus_queue.cc:1048] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:23.219378  6484 ts_tablet_manager.cc:1929] T 9f93759199ab4820a9a807a0f1c70c85 P dd62e75bd3ed4ed28f1fb5955d650808: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:23.219936  6484 log.cc:1199] T 9f93759199ab4820a9a807a0f1c70c85 P dd62e75bd3ed4ed28f1fb5955d650808: Deleting WAL directory at /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/ts-1-root/wals/9f93759199ab4820a9a807a0f1c70c85
I20260709 12:13:23.227367  5007 catalog_manager.cc:5028] TS dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): tablet 9f93759199ab4820a9a807a0f1c70c85 (table test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]) successfully deleted
I20260709 12:13:23.238547  6454 raft_consensus.cc:1064] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808: attempting to promote NON_VOTER bce73265e27d4b30a4dcc1e491305088 to VOTER
I20260709 12:13:23.241125  6454 consensus_queue.cc:237] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:23.246006  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:23.287012  6470 raft_consensus.cc:1064] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929: attempting to promote NON_VOTER bce73265e27d4b30a4dcc1e491305088 to VOTER
I20260709 12:13:23.290289  6470 consensus_queue.cc:237] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:23.372267  5835 raft_consensus.cc:1275] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 2 LEARNER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:13:23.373030  5117 raft_consensus.cc:1275] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:13:23.374537  6468 consensus_queue.cc:1048] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:23.376708  6468 consensus_queue.cc:1048] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:23.384117  5197 raft_consensus.cc:1275] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:13:23.386885  6352 consensus_queue.cc:1048] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:23.392819  5125 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
new_leader_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:45628
I20260709 12:13:23.393540  5125 raft_consensus.cc:606] T 20ba878da4e3492fbdf2f90c6bb202c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Received request to transfer leadership to TS 9e794b72ed7640219f90ec4232363929
I20260709 12:13:23.397995  5268 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
mode: GRACEFUL
new_leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
 from {username='slave'} at 127.0.0.1:42506
I20260709 12:13:23.398603  5268 raft_consensus.cc:606] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Received request to transfer leadership to TS dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:23.409852  6470 raft_consensus.cc:993] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929: : Instructing follower dd62e75bd3ed4ed28f1fb5955d650808 to start an election
I20260709 12:13:23.410326  6470 raft_consensus.cc:1081] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Signalling peer dd62e75bd3ed4ed28f1fb5955d650808 to start an election
I20260709 12:13:23.410334  5268 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
mode: GRACEFUL
new_leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
 from {username='slave'} at 127.0.0.1:42506
I20260709 12:13:23.411005  5268 raft_consensus.cc:606] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 2 LEADER]: Received request to transfer leadership to TS ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:23.411973  5193 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533"
dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
 from {username='slave'} at 127.0.0.1:47728
I20260709 12:13:23.412583  5193 raft_consensus.cc:493] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:23.413018  5193 raft_consensus.cc:3060] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:23.419272  5196 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf"
dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
mode: GRACEFUL
new_leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
 from {username='slave'} at 127.0.0.1:53902
I20260709 12:13:23.419899  5196 raft_consensus.cc:606] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Received request to transfer leadership to TS ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:23.421171  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:13:23.422955  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:23.423791  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:23.423935  6468 raft_consensus.cc:2955] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:23.431660  5197 raft_consensus.cc:2955] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:23.434358  5193 raft_consensus.cc:515] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:23.438804  5117 raft_consensus.cc:2955] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:23.441416  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:23.441696  5193 leader_election.cc:290] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:23.442044  5125 raft_consensus.cc:3060] T 87f29f851a0e43738cf01ef3724e5533 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:23.448921  5125 raft_consensus.cc:2468] T 87f29f851a0e43738cf01ef3724e5533 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 2.
I20260709 12:13:23.450004  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:23.450677  5268 raft_consensus.cc:3055] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:23.451169  5268 raft_consensus.cc:740] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:23.452013  5268 consensus_queue.cc:260] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:23.453307  5268 raft_consensus.cc:3060] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:23.463888  6491 raft_consensus.cc:993] T 20ba878da4e3492fbdf2f90c6bb202c4 P ad2f9a1e2f7a45429fa69fd23d09f821: : Instructing follower 9e794b72ed7640219f90ec4232363929 to start an election
I20260709 12:13:23.464440  6216 raft_consensus.cc:1081] T 20ba878da4e3492fbdf2f90c6bb202c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Signalling peer 9e794b72ed7640219f90ec4232363929 to start an election
I20260709 12:13:23.464675  6450 raft_consensus.cc:1064] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821: attempting to promote NON_VOTER bce73265e27d4b30a4dcc1e491305088 to VOTER
I20260709 12:13:23.467303  6450 consensus_queue.cc:237] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:23.472925  5266 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:34674
I20260709 12:13:23.473488  5266 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:23.473803  5266 raft_consensus.cc:3060] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:23.480736  5266 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:23.480834  5835 raft_consensus.cc:2955] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:23.483299  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:23.484313  5120 raft_consensus.cc:3055] T 20ba878da4e3492fbdf2f90c6bb202c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:23.484697  5120 raft_consensus.cc:740] T 20ba878da4e3492fbdf2f90c6bb202c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:23.485512  5120 consensus_queue.cc:260] T 20ba878da4e3492fbdf2f90c6bb202c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:23.486716  5120 raft_consensus.cc:3060] T 20ba878da4e3492fbdf2f90c6bb202c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:23.495383  5120 raft_consensus.cc:2468] T 20ba878da4e3492fbdf2f90c6bb202c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 2.
I20260709 12:13:23.497434  5266 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:23.497514  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:23.500494  5193 raft_consensus.cc:3060] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:23.511374  5018 catalog_manager.cc:5697] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 reported cstate change: config changed from index 3 to 4, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:23.515877  5193 raft_consensus.cc:2468] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 2.
I20260709 12:13:23.517517  5237 leader_election.cc:304] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:23.528384  5120 raft_consensus.cc:1275] T f34c97113147431584d6336e0d849164 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:23.529093  6468 raft_consensus.cc:993] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929: : Instructing follower ad2f9a1e2f7a45429fa69fd23d09f821 to start an election
I20260709 12:13:23.530184  6197 raft_consensus.cc:1081] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 2 LEADER]: Signalling peer ad2f9a1e2f7a45429fa69fd23d09f821 to start an election
I20260709 12:13:23.529999  6495 consensus_queue.cc:1048] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:23.532217  6470 raft_consensus.cc:2804] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:23.532730  5266 raft_consensus.cc:1275] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:23.533993  5835 raft_consensus.cc:1275] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:23.535588  6495 consensus_queue.cc:1048] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:23.537626  5117 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
 from {username='slave'} at 127.0.0.1:40402
I20260709 12:13:23.538189  5117 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:23.538545  5117 raft_consensus.cc:3060] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:23.545691  6495 consensus_queue.cc:1048] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:23.552233  5837 raft_consensus.cc:1275] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:23.555176  5166 leader_election.cc:304] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:23.555186  5117 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:23.560941  5117 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:23.561065  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:23.561774  5837 raft_consensus.cc:3060] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:23.562839  5193 raft_consensus.cc:1275] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:23.568475  5268 raft_consensus.cc:2468] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 2.
I20260709 12:13:23.532682  6470 raft_consensus.cc:697] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 2 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:23.573810  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:23.574522  5193 raft_consensus.cc:3060] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:23.583303  6470 consensus_queue.cc:237] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:23.566705  6494 consensus_queue.cc:1048] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:13:23.580983  6454 raft_consensus.cc:2804] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:23.625622  6454 raft_consensus.cc:697] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:23.626569  6454 consensus_queue.cc:237] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:13:23.637398  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 76938.2us
I20260709 12:13:23.639282  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:23.639887  5268 raft_consensus.cc:3055] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:23.640161  5268 raft_consensus.cc:740] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:23.640880  5268 consensus_queue.cc:260] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:23.670920  5268 raft_consensus.cc:3060] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:23.673045  5837 raft_consensus.cc:2468] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
I20260709 12:13:23.681414  5266 raft_consensus.cc:1275] T 62577fc91bb44d3a882109dc63f74008 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:23.686777  5268 raft_consensus.cc:2468] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
I20260709 12:13:23.677224  5193 raft_consensus.cc:2468] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
I20260709 12:13:23.654673  6457 consensus_queue.cc:1048] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 12:13:23.722666  6507 consensus_queue.cc:1048] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:23.725395  5088 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:13:23.730414  6450 raft_consensus.cc:2804] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:23.730948  6450 raft_consensus.cc:697] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:23.731789  6450 consensus_queue.cc:237] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:23.778354  6494 raft_consensus.cc:2955] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:23.780874  6451 raft_consensus.cc:2955] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:23.797874  5268 raft_consensus.cc:2955] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
W20260709 12:13:23.810880  5007 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet b4b265799c1c447794c6126f3ae47e5d with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 9e794b72ed7640219f90ec4232363929 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:23.818464  5020 catalog_manager.cc:5697] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 2 to 3, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 3 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:23.833366  6513 raft_consensus.cc:993] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808: : Instructing follower ad2f9a1e2f7a45429fa69fd23d09f821 to start an election
I20260709 12:13:23.834219  6495 raft_consensus.cc:1081] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Signalling peer ad2f9a1e2f7a45429fa69fd23d09f821 to start an election
I20260709 12:13:23.833815  5196 raft_consensus.cc:2955] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:23.839740  5832 raft_consensus.cc:2955] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:23.841784  5023 catalog_manager.cc:5697] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 1 to 2, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 2 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:23.842329  5836 raft_consensus.cc:2955] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:23.843457  5023 catalog_manager.cc:5697] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:23.847576  5266 raft_consensus.cc:2955] T 62577fc91bb44d3a882109dc63f74008 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:23.852756  5019 catalog_manager.cc:5697] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 1 to 2, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 2 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:23.863547  5117 raft_consensus.cc:2955] T f34c97113147431584d6336e0d849164 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:23.865238  5120 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
 from {username='slave'} at 127.0.0.1:40386
I20260709 12:13:23.866220  5120 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:23.866587  5120 raft_consensus.cc:3060] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:23.872794  5019 catalog_manager.cc:5697] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:23.888204  5120 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:23.896929  5120 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:23.897666  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:23.898303  5196 raft_consensus.cc:3055] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:23.898603  5196 raft_consensus.cc:740] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:23.899307  5196 consensus_queue.cc:260] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:23.900314  5196 raft_consensus.cc:3060] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:23.901571  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:23.902204  5268 raft_consensus.cc:3060] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:23.912665  5268 raft_consensus.cc:2468] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 2.
I20260709 12:13:23.914872  5196 raft_consensus.cc:2468] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 2.
I20260709 12:13:23.916071  5088 leader_election.cc:304] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:23.917899  6450 raft_consensus.cc:2804] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:23.918586  6450 raft_consensus.cc:697] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:23.920323  6450 consensus_queue.cc:237] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:23.923643  5120 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:40378
I20260709 12:13:23.924295  5120 raft_consensus.cc:606] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 LEADER]: Received request to transfer leadership
I20260709 12:13:23.964165  5120 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:40378
I20260709 12:13:23.965009  5120 raft_consensus.cc:606] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 LEADER]: Received request to transfer leadership
W20260709 12:13:23.966228  5010 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for b4b265799c1c447794c6126f3ae47e5d already in progress [suppressed 3 similar messages]
I20260709 12:13:23.978741  5117 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:40378
I20260709 12:13:23.979344  5117 raft_consensus.cc:606] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 LEADER]: Received request to transfer leadership
I20260709 12:13:23.980722  5122 consensus_queue.cc:237] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:23.983589  5196 consensus_queue.cc:237] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:23.986873  5836 raft_consensus.cc:1275] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:23.990267  5193 raft_consensus.cc:1275] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:23.990461  6507 consensus_queue.cc:1048] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:23.997861  5266 raft_consensus.cc:1275] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:23.998119  5836 raft_consensus.cc:1275] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:23.998713  6216 raft_consensus.cc:2955] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e794b72ed7640219f90ec4232363929 (127.3.212.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:23.999507  6509 consensus_queue.cc:1048] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:24.000430  6510 consensus_queue.cc:1048] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:24.002491  5836 raft_consensus.cc:2955] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e794b72ed7640219f90ec4232363929 (127.3.212.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
W20260709 12:13:24.008831  5071 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
I20260709 12:13:24.005430  6507 consensus_queue.cc:1048] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:13:24.010915  6493 raft_consensus.cc:2955] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
W20260709 12:13:24.013805  5071 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for b4b265799c1c447794c6126f3ae47e5d already in progress
W20260709 12:13:24.014209  5071 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for b4b265799c1c447794c6126f3ae47e5d already in progress
I20260709 12:13:24.016710  5023 catalog_manager.cc:5697] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 1 to 2, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 2 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:24.017066  5193 raft_consensus.cc:2955] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e794b72ed7640219f90ec4232363929 (127.3.212.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:24.019696  5122 raft_consensus.cc:1275] T 20ba878da4e3492fbdf2f90c6bb202c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:24.021243  6470 consensus_queue.cc:1048] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:24.020599  5832 raft_consensus.cc:2955] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:24.027480  5010 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 62577fc91bb44d3a882109dc63f74008 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:24.020579  5266 raft_consensus.cc:2955] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
W20260709 12:13:24.035820  5010 catalog_manager.cc:4755] TS ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): ChangeConfig:REMOVE_PEER RPC failed for tablet b4b265799c1c447794c6126f3ae47e5d: Remote error: Service unavailable: leader transfer in progress
I20260709 12:13:24.036612  5019 catalog_manager.cc:5697] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: config changed from index 3 to 4, VOTER 9e794b72ed7640219f90ec4232363929 (127.3.212.131) evicted. New cstate: current_term: 1 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:24.043041  5007 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f34c97113147431584d6336e0d849164 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:24.049917  5268 raft_consensus.cc:1275] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:24.052042  6454 consensus_queue.cc:1048] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:24.067513  5023 catalog_manager.cc:5697] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: config changed from index 3 to 4, VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) evicted. New cstate: current_term: 1 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:24.067795  5263 tablet_service.cc:1558] Processing DeleteTablet for tablet 62577fc91bb44d3a882109dc63f74008 with delete_type TABLET_DATA_TOMBSTONED (TS 9e794b72ed7640219f90ec4232363929 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34668
I20260709 12:13:24.109233  6527 tablet_replica.cc:333] T 62577fc91bb44d3a882109dc63f74008 P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
I20260709 12:13:24.110306  6527 raft_consensus.cc:2243] T 62577fc91bb44d3a882109dc63f74008 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.110950  5108 tablet_service.cc:1558] Processing DeleteTablet for tablet f34c97113147431584d6336e0d849164 with delete_type TABLET_DATA_TOMBSTONED (TS ad2f9a1e2f7a45429fa69fd23d09f821 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40378
I20260709 12:13:24.116323  5117 raft_consensus.cc:1275] T 87f29f851a0e43738cf01ef3724e5533 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:24.118180  6510 consensus_queue.cc:1048] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:24.120420  6527 raft_consensus.cc:2272] T 62577fc91bb44d3a882109dc63f74008 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.128113  6527 ts_tablet_manager.cc:1916] T 62577fc91bb44d3a882109dc63f74008 P 9e794b72ed7640219f90ec4232363929: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:24.149480  5193 raft_consensus.cc:1275] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:24.152480  6197 consensus_queue.cc:1048] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:24.173310  5197 raft_consensus.cc:1275] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:24.175209  6216 consensus_queue.cc:1048] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:24.193923  6216 raft_consensus.cc:993] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821: : Instructing follower dd62e75bd3ed4ed28f1fb5955d650808 to start an election
I20260709 12:13:24.194403  6507 raft_consensus.cc:1081] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 LEADER]: Signalling peer dd62e75bd3ed4ed28f1fb5955d650808 to start an election
I20260709 12:13:24.204530  5193 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d"
dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
 from {username='slave'} at 127.0.0.1:47744
I20260709 12:13:24.205143  5193 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:24.205531  5193 raft_consensus.cc:3060] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:24.246619  6527 ts_tablet_manager.cc:1929] T 62577fc91bb44d3a882109dc63f74008 P 9e794b72ed7640219f90ec4232363929: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:24.247210  6527 log.cc:1199] T 62577fc91bb44d3a882109dc63f74008 P 9e794b72ed7640219f90ec4232363929: Deleting WAL directory at /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/ts-2-root/wals/62577fc91bb44d3a882109dc63f74008
I20260709 12:13:24.248883  5007 catalog_manager.cc:5028] TS 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): tablet 62577fc91bb44d3a882109dc63f74008 (table test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]) successfully deleted
I20260709 12:13:24.259241  6530 tablet_replica.cc:333] T f34c97113147431584d6336e0d849164 P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:13:24.292919  6530 raft_consensus.cc:2243] T f34c97113147431584d6336e0d849164 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:24.293617  5193 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:24.296025  5193 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:24.297690  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:24.298363  5266 raft_consensus.cc:3060] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:24.293744  6530 raft_consensus.cc:2272] T f34c97113147431584d6336e0d849164 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:24.300246  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:24.300815  5117 raft_consensus.cc:3055] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:24.301142  5117 raft_consensus.cc:740] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:24.302587  5117 consensus_queue.cc:260] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:24.303555  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:24.303900  5117 raft_consensus.cc:3060] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:24.304107  5836 raft_consensus.cc:3060] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:24.311291  5836 raft_consensus.cc:2468] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 4.
I20260709 12:13:24.314009  5197 raft_consensus.cc:1275] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:24.316377  6450 consensus_queue.cc:1048] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:24.318542  6530 ts_tablet_manager.cc:1916] T f34c97113147431584d6336e0d849164 P ad2f9a1e2f7a45429fa69fd23d09f821: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:24.319937  5117 raft_consensus.cc:2468] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 4.
I20260709 12:13:24.342164  6530 ts_tablet_manager.cc:1929] T f34c97113147431584d6336e0d849164 P ad2f9a1e2f7a45429fa69fd23d09f821: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:24.348831  6530 log.cc:1199] T f34c97113147431584d6336e0d849164 P ad2f9a1e2f7a45429fa69fd23d09f821: Deleting WAL directory at /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/ts-0-root/wals/f34c97113147431584d6336e0d849164
I20260709 12:13:24.352154  5010 catalog_manager.cc:5028] TS ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): tablet f34c97113147431584d6336e0d849164 (table test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]) successfully deleted
I20260709 12:13:24.356537  5266 raft_consensus.cc:2468] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 4.
I20260709 12:13:24.362959  5163 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:24.369943  6510 raft_consensus.cc:2804] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:24.370507  6510 raft_consensus.cc:697] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:24.371423  6510 consensus_queue.cc:237] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:24.380424  5268 raft_consensus.cc:1275] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:24.389302  6216 consensus_queue.cc:1048] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:24.407886  5020 catalog_manager.cc:5697] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 3 to 4, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 4 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:24.796536  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:24.900940  5125 raft_consensus.cc:1275] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:24.905309  6454 consensus_queue.cc:1048] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:25.000151  5835 raft_consensus.cc:1275] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:25.015640  5266 raft_consensus.cc:1275] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:25.032301  6493 consensus_queue.cc:1048] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.002s
W20260709 12:13:25.052228  5007 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet b4b265799c1c447794c6126f3ae47e5d with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
W20260709 12:13:25.082445  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 47611.7us
I20260709 12:13:25.093628  6543 consensus_queue.cc:1048] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:25.160710  5266 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
mode: GRACEFUL
new_leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
 from {username='slave'} at 127.0.0.1:42506
I20260709 12:13:25.163866  5266 raft_consensus.cc:606] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Received request to transfer leadership to TS ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:25.168852  5196 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45"
dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
mode: GRACEFUL
new_leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
 from {username='slave'} at 127.0.0.1:53902
I20260709 12:13:25.169709  5196 raft_consensus.cc:606] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Received request to transfer leadership to TS ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:25.173593  5117 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
new_leader_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:45628
I20260709 12:13:25.174281  5117 raft_consensus.cc:606] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Received request to transfer leadership to TS 9e794b72ed7640219f90ec4232363929
I20260709 12:13:25.176146  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:13:25.177731  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:25.181175  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:25.198027  6197 raft_consensus.cc:993] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929: : Instructing follower ad2f9a1e2f7a45429fa69fd23d09f821 to start an election
I20260709 12:13:25.198521  6197 raft_consensus.cc:1081] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Signalling peer ad2f9a1e2f7a45429fa69fd23d09f821 to start an election
I20260709 12:13:25.200191  5125 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
 from {username='slave'} at 127.0.0.1:40402
I20260709 12:13:25.200824  5125 raft_consensus.cc:493] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:25.201247  5125 raft_consensus.cc:3060] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:25.242377  5125 raft_consensus.cc:515] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:25.245522  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:25.246196  5196 raft_consensus.cc:3060] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:25.263113  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:25.263777  5272 raft_consensus.cc:3055] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:25.264082  5272 raft_consensus.cc:740] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:25.264983  5272 consensus_queue.cc:260] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:25.266917  5272 raft_consensus.cc:3060] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:25.282666  5125 leader_election.cc:290] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:25.285415  5272 raft_consensus.cc:2468] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 2.
I20260709 12:13:25.293347  5088 leader_election.cc:304] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:13:25.294422  6540 raft_consensus.cc:2804] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:25.294932  6540 raft_consensus.cc:697] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:25.295070  5196 raft_consensus.cc:2468] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 2.
I20260709 12:13:25.295867  6540 consensus_queue.cc:237] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:25.338558  6538 raft_consensus.cc:993] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821: : Instructing follower 9e794b72ed7640219f90ec4232363929 to start an election
I20260709 12:13:25.339082  6538 raft_consensus.cc:1081] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Signalling peer 9e794b72ed7640219f90ec4232363929 to start an election
I20260709 12:13:25.343060  5023 catalog_manager.cc:5697] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 1 to 2, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 2 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:25.346702  5272 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:34674
I20260709 12:13:25.347388  5272 raft_consensus.cc:493] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:25.347786  5272 raft_consensus.cc:3060] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:25.355271  5272 raft_consensus.cc:515] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:25.369346  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:25.369963  5120 raft_consensus.cc:3055] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:25.370234  5120 raft_consensus.cc:740] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:25.371102  5120 consensus_queue.cc:260] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:25.372179  5120 raft_consensus.cc:3060] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:25.380739  5125 consensus_queue.cc:237] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:25.381973  5272 leader_election.cc:290] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:25.384876  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:25.385564  5836 raft_consensus.cc:3060] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:25.386610  5120 raft_consensus.cc:2468] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 3.
I20260709 12:13:25.388334  5240 leader_election.cc:304] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:13:25.389433  6544 raft_consensus.cc:2804] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:25.389961  6544 raft_consensus.cc:697] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 3 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:25.390983  6544 consensus_queue.cc:237] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:25.403571  5089 consensus_peers.cc:597] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 -> Peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Couldn't send request to peer bce73265e27d4b30a4dcc1e491305088. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2a6867413d1d4b49bcd267c1e134d12e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:25.405416  5836 raft_consensus.cc:2468] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 3.
I20260709 12:13:25.415277  5272 raft_consensus.cc:1275] T 2a6867413d1d4b49bcd267c1e134d12e P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:25.424034  5020 catalog_manager.cc:5697] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 2 to 3, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 3 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:25.433636  6450 consensus_queue.cc:1048] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:25.436443  5193 raft_consensus.cc:1275] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:25.442612  6450 consensus_queue.cc:1048] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:25.463668  6543 raft_consensus.cc:993] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808: : Instructing follower ad2f9a1e2f7a45429fa69fd23d09f821 to start an election
I20260709 12:13:25.464188  6543 raft_consensus.cc:1081] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Signalling peer ad2f9a1e2f7a45429fa69fd23d09f821 to start an election
I20260709 12:13:25.466711  5120 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
 from {username='slave'} at 127.0.0.1:40386
I20260709 12:13:25.476066  5120 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:25.476518  5120 raft_consensus.cc:3060] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:25.465655  6538 raft_consensus.cc:2955] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:25.471400  5268 raft_consensus.cc:2955] T 2a6867413d1d4b49bcd267c1e134d12e P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:25.483667  5193 raft_consensus.cc:2955] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:25.504243  5120 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:25.503654  5020 catalog_manager.cc:5697] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New cstate: current_term: 1 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:25.516546  5120 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:25.520042  5125 consensus_queue.cc:237] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:25.523087  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:25.523706  5193 raft_consensus.cc:3055] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:25.523967  5193 raft_consensus.cc:740] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:25.524794  5193 consensus_queue.cc:260] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:25.526044  5193 raft_consensus.cc:3060] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:25.530401  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:25.530922  5268 raft_consensus.cc:3060] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:25.545258  5196 raft_consensus.cc:1275] T 271b0c7d258142798f30accd6aaba829 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:13:25.546375  5089 consensus_peers.cc:597] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 -> Peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Couldn't send request to peer bce73265e27d4b30a4dcc1e491305088. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 271b0c7d258142798f30accd6aaba829. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:25.546902  6540 consensus_queue.cc:1048] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:25.550750  5268 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 2.
I20260709 12:13:25.552770  5193 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 2.
I20260709 12:13:25.554800  5088 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:25.555631  6538 raft_consensus.cc:2804] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:25.556139  6538 raft_consensus.cc:697] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:25.557085  6538 consensus_queue.cc:237] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:25.594029  5268 raft_consensus.cc:1275] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:25.598765  6450 consensus_queue.cc:1048] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:25.619254  6450 raft_consensus.cc:2955] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:25.621328  5020 catalog_manager.cc:5697] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 1 to 2, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 2 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:25.630724  5193 raft_consensus.cc:2955] T 271b0c7d258142798f30accd6aaba829 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:25.661504  5196 consensus_queue.cc:237] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:25.690232  5266 raft_consensus.cc:2955] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:25.694186  5023 catalog_manager.cc:5697] T 271b0c7d258142798f30accd6aaba829 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New cstate: current_term: 1 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
W20260709 12:13:25.733670  5164 consensus_peers.cc:597] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Couldn't send request to peer bce73265e27d4b30a4dcc1e491305088. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 87f29f851a0e43738cf01ef3724e5533. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:25.736761  5266 raft_consensus.cc:1275] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:25.736919  5120 raft_consensus.cc:1275] T 87f29f851a0e43738cf01ef3724e5533 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:25.738351  6493 consensus_queue.cc:1048] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:25.740300  6493 consensus_queue.cc:1048] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:25.762357  6493 raft_consensus.cc:2955] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:25.770949  5125 raft_consensus.cc:2955] T 87f29f851a0e43738cf01ef3724e5533 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:25.798307  5266 raft_consensus.cc:2955] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:25.805882  5023 catalog_manager.cc:5697] T 87f29f851a0e43738cf01ef3724e5533 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: config changed from index -1 to 3, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New cstate: current_term: 2 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:25.829259  5196 raft_consensus.cc:1275] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:25.835193  6450 consensus_queue.cc:1048] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:25.842139  5125 consensus_queue.cc:237] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:25.859694  5266 raft_consensus.cc:1275] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:25.865263  6538 consensus_queue.cc:1048] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:13:25.880049  5089 consensus_peers.cc:597] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 -> Peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Couldn't send request to peer bce73265e27d4b30a4dcc1e491305088. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8d081e937c2741c9b646839e29e5599f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:25.890671  5268 raft_consensus.cc:1275] T 8d081e937c2741c9b646839e29e5599f P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:25.900491  5199 raft_consensus.cc:1275] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:25.903434  6540 consensus_queue.cc:1048] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:25.906219  6450 consensus_queue.cc:1048] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:25.927484  6574 ts_tablet_manager.cc:933] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088: Initiating tablet copy from peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443)
I20260709 12:13:25.936146  5270 raft_consensus.cc:2955] T 8d081e937c2741c9b646839e29e5599f P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:25.929562  6507 raft_consensus.cc:2955] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:25.956761  5199 raft_consensus.cc:2955] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:25.998672  5835 raft_consensus.cc:1275] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:26.000362  5120 raft_consensus.cc:1275] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:26.001732  5270 raft_consensus.cc:1275] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:26.002247  6352 consensus_queue.cc:1048] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:26.005195  6352 consensus_queue.cc:1048] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:26.005889  6540 consensus_queue.cc:1048] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:26.039906  5023 catalog_manager.cc:5697] T 8d081e937c2741c9b646839e29e5599f P 9e794b72ed7640219f90ec4232363929 reported cstate change: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New cstate: current_term: 1 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:26.058058  5199 raft_consensus.cc:1275] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:26.059454  6574 tablet_copy_client.cc:323] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088: tablet copy: Beginning tablet copy session from remote peer at address 127.3.212.129:34443
I20260709 12:13:26.059654  6539 consensus_queue.cc:1048] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:26.061512  5135 tablet_copy_service.cc:140] P ad2f9a1e2f7a45429fa69fd23d09f821: Received BeginTabletCopySession request for tablet 2a6867413d1d4b49bcd267c1e134d12e from peer bce73265e27d4b30a4dcc1e491305088 ({username='slave'} at 127.0.0.1:59390)
I20260709 12:13:26.062077  5135 tablet_copy_service.cc:161] P ad2f9a1e2f7a45429fa69fd23d09f821: Beginning new tablet copy session on tablet 2a6867413d1d4b49bcd267c1e134d12e from peer bce73265e27d4b30a4dcc1e491305088 at {username='slave'} at 127.0.0.1:59390: session id = bce73265e27d4b30a4dcc1e491305088-2a6867413d1d4b49bcd267c1e134d12e
I20260709 12:13:26.070853  5135 tablet_copy_source_session.cc:215] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:26.074877  6574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a6867413d1d4b49bcd267c1e134d12e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:26.150601  5196 consensus_queue.cc:237] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:26.195374  6584 ts_tablet_manager.cc:933] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088: Initiating tablet copy from peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443)
W20260709 12:13:26.201048  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 103221us
I20260709 12:13:26.244444  6574 tablet_copy_client.cc:806] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 0 data blocks...
W20260709 12:13:26.245712  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 129786us
I20260709 12:13:26.245256  6574 tablet_copy_client.cc:670] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 1 WAL segments...
W20260709 12:13:26.256774  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 57887.3us
I20260709 12:13:26.289765  6574 tablet_copy_client.cc:538] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:26.304175  6584 tablet_copy_client.cc:323] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Beginning tablet copy session from remote peer at address 127.3.212.129:34443
I20260709 12:13:26.316309  6574 tablet_bootstrap.cc:492] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088: Bootstrap starting.
I20260709 12:13:26.328936  6595 ts_tablet_manager.cc:933] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088: Initiating tablet copy from peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:26.332399  5135 tablet_copy_service.cc:140] P ad2f9a1e2f7a45429fa69fd23d09f821: Received BeginTabletCopySession request for tablet 271b0c7d258142798f30accd6aaba829 from peer bce73265e27d4b30a4dcc1e491305088 ({username='slave'} at 127.0.0.1:59390)
I20260709 12:13:26.333016  5135 tablet_copy_service.cc:161] P ad2f9a1e2f7a45429fa69fd23d09f821: Beginning new tablet copy session on tablet 271b0c7d258142798f30accd6aaba829 from peer bce73265e27d4b30a4dcc1e491305088 at {username='slave'} at 127.0.0.1:59390: session id = bce73265e27d4b30a4dcc1e491305088-271b0c7d258142798f30accd6aaba829
I20260709 12:13:26.363668  6595 tablet_copy_client.cc:323] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Beginning tablet copy session from remote peer at address 127.3.212.130:44455
I20260709 12:13:26.366056  5135 tablet_copy_source_session.cc:215] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:26.368464  5210 tablet_copy_service.cc:140] P dd62e75bd3ed4ed28f1fb5955d650808: Received BeginTabletCopySession request for tablet 87f29f851a0e43738cf01ef3724e5533 from peer bce73265e27d4b30a4dcc1e491305088 ({username='slave'} at 127.0.0.1:41416)
I20260709 12:13:26.369786  5210 tablet_copy_service.cc:161] P dd62e75bd3ed4ed28f1fb5955d650808: Beginning new tablet copy session on tablet 87f29f851a0e43738cf01ef3724e5533 from peer bce73265e27d4b30a4dcc1e491305088 at {username='slave'} at 127.0.0.1:41416: session id = bce73265e27d4b30a4dcc1e491305088-87f29f851a0e43738cf01ef3724e5533
I20260709 12:13:26.371104  6584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 271b0c7d258142798f30accd6aaba829. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:26.374185  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:26.390827  5210 tablet_copy_source_session.cc:215] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:26.394945  6595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87f29f851a0e43738cf01ef3724e5533. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:13:26.404381  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 115522us
I20260709 12:13:26.406829  5832 raft_consensus.cc:1275] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:13:26.412443  6597 consensus_queue.cc:1048] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:13:26.438731  6595 tablet_copy_client.cc:806] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:26.439311  6595 tablet_copy_client.cc:670] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:26.441299  5270 raft_consensus.cc:1275] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:13:26.446599  6595 tablet_copy_client.cc:538] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:26.450948  6601 ts_tablet_manager.cc:933] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088: Initiating tablet copy from peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443)
I20260709 12:13:26.460662  6574 tablet_bootstrap.cc:492] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:26.469954  6574 tablet_bootstrap.cc:492] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088: Bootstrap complete.
I20260709 12:13:26.470778  6574 ts_tablet_manager.cc:1403] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088: Time spent bootstrapping tablet: real 0.155s	user 0.019s	sys 0.008s
I20260709 12:13:26.474234  6543 consensus_queue.cc:1048] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:13:26.479975  6595 tablet_bootstrap.cc:492] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088: Bootstrap starting.
I20260709 12:13:26.482219  6574 raft_consensus.cc:359] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:26.485755  6574 raft_consensus.cc:740] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Initialized, Role: LEARNER
I20260709 12:13:26.486464  6574 consensus_queue.cc:260] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:26.492674  6574 ts_tablet_manager.cc:1434] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 12:13:26.494657  5135 tablet_copy_service.cc:342] P ad2f9a1e2f7a45429fa69fd23d09f821: Request end of tablet copy session bce73265e27d4b30a4dcc1e491305088-2a6867413d1d4b49bcd267c1e134d12e received from {username='slave'} at 127.0.0.1:59390
I20260709 12:13:26.495189  5135 tablet_copy_service.cc:434] P ad2f9a1e2f7a45429fa69fd23d09f821: ending tablet copy session bce73265e27d4b30a4dcc1e491305088-2a6867413d1d4b49bcd267c1e134d12e on tablet 2a6867413d1d4b49bcd267c1e134d12e with peer bce73265e27d4b30a4dcc1e491305088
W20260709 12:13:26.565469  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 69042us
W20260709 12:13:26.626847  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 121104us
W20260709 12:13:26.634234  6600 log.cc:927] Time spent T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 12:13:26.660157  6610 raft_consensus.cc:2955] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 LEADER]: Committing config change with OpId 4.7: config changed from index 4 to 7, VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:26.662580  5836 raft_consensus.cc:2955] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 4 to 7, VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:26.681279  5018 catalog_manager.cc:5697] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 reported cstate change: config changed from index 4 to 7, VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) evicted. New cstate: current_term: 4 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
W20260709 12:13:26.685470  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 117287us
I20260709 12:13:26.705839  6601 tablet_copy_client.cc:323] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088: tablet copy: Beginning tablet copy session from remote peer at address 127.3.212.129:34443
I20260709 12:13:26.707667  5135 tablet_copy_service.cc:140] P ad2f9a1e2f7a45429fa69fd23d09f821: Received BeginTabletCopySession request for tablet 8d081e937c2741c9b646839e29e5599f from peer bce73265e27d4b30a4dcc1e491305088 ({username='slave'} at 127.0.0.1:59390)
I20260709 12:13:26.708312  5135 tablet_copy_service.cc:161] P ad2f9a1e2f7a45429fa69fd23d09f821: Beginning new tablet copy session on tablet 8d081e937c2741c9b646839e29e5599f from peer bce73265e27d4b30a4dcc1e491305088 at {username='slave'} at 127.0.0.1:59390: session id = bce73265e27d4b30a4dcc1e491305088-8d081e937c2741c9b646839e29e5599f
I20260709 12:13:26.709656  6584 tablet_copy_client.cc:806] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:26.710294  6584 tablet_copy_client.cc:670] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 1 WAL segments...
W20260709 12:13:26.710810  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 83105.7us
I20260709 12:13:26.717114  5135 tablet_copy_source_session.cc:215] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:26.717664  5196 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15"
dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
mode: GRACEFUL
new_leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
 from {username='slave'} at 127.0.0.1:53902
I20260709 12:13:26.721530  5196 raft_consensus.cc:606] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Received request to transfer leadership to TS ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:26.739735  6601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d081e937c2741c9b646839e29e5599f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:13:26.762005  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 70128.8us
I20260709 12:13:26.763865  5007 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b4b265799c1c447794c6126f3ae47e5d with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 8)
I20260709 12:13:26.772925  5266 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
mode: GRACEFUL
new_leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
 from {username='slave'} at 127.0.0.1:42506
I20260709 12:13:26.773700  5266 raft_consensus.cc:606] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Received request to transfer leadership to TS dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:26.781428  6595 tablet_bootstrap.cc:492] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:26.782963  6595 tablet_bootstrap.cc:492] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088: Bootstrap complete.
I20260709 12:13:26.783954  6595 ts_tablet_manager.cc:1403] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088: Time spent bootstrapping tablet: real 0.304s	user 0.026s	sys 0.002s
I20260709 12:13:26.786629  5120 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
new_leader_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:45628
I20260709 12:13:26.787302  5120 raft_consensus.cc:606] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 LEADER]: Received request to transfer leadership to TS 9e794b72ed7640219f90ec4232363929
I20260709 12:13:26.792685  6616 raft_consensus.cc:993] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808: : Instructing follower ad2f9a1e2f7a45429fa69fd23d09f821 to start an election
I20260709 12:13:26.793263  6616 raft_consensus.cc:1081] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Signalling peer ad2f9a1e2f7a45429fa69fd23d09f821 to start an election
I20260709 12:13:26.793063  6595 raft_consensus.cc:359] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:26.794548  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:13:26.795627  5120 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
 from {username='slave'} at 127.0.0.1:40386
I20260709 12:13:26.796171  5120 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:26.796315  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:26.796556  5120 raft_consensus.cc:3060] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:26.793820  5273 raft_consensus.cc:2955] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 4 to 7, VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:26.803946  5836 raft_consensus.cc:1217] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:26.814741  6612 raft_consensus.cc:993] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821: : Instructing follower 9e794b72ed7640219f90ec4232363929 to start an election
I20260709 12:13:26.815286  6612 raft_consensus.cc:1081] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 LEADER]: Signalling peer 9e794b72ed7640219f90ec4232363929 to start an election
I20260709 12:13:26.817613  6595 raft_consensus.cc:740] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Initialized, Role: LEARNER
I20260709 12:13:26.825189  6595 consensus_queue.cc:260] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:26.825873  6584 tablet_copy_client.cc:538] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:26.828490  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:26.841084  6595 ts_tablet_manager.cc:1434] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088: Time spent starting tablet: real 0.057s	user 0.005s	sys 0.001s
I20260709 12:13:26.842993  5210 tablet_copy_service.cc:342] P dd62e75bd3ed4ed28f1fb5955d650808: Request end of tablet copy session bce73265e27d4b30a4dcc1e491305088-87f29f851a0e43738cf01ef3724e5533 received from {username='slave'} at 127.0.0.1:41416
I20260709 12:13:26.843446  5210 tablet_copy_service.cc:434] P dd62e75bd3ed4ed28f1fb5955d650808: ending tablet copy session bce73265e27d4b30a4dcc1e491305088-87f29f851a0e43738cf01ef3724e5533 on tablet 87f29f851a0e43738cf01ef3724e5533 with peer bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:26.846820  5120 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:26.849598  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:26.850222  5191 raft_consensus.cc:3055] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:26.850555  5191 raft_consensus.cc:740] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:26.851470  5191 consensus_queue.cc:260] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:26.852829  5191 raft_consensus.cc:3060] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:26.861759  5108 tablet_service.cc:1558] Processing DeleteTablet for tablet b4b265799c1c447794c6126f3ae47e5d with delete_type TABLET_DATA_TOMBSTONED (TS ad2f9a1e2f7a45429fa69fd23d09f821 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:40378
I20260709 12:13:26.872437  5191 raft_consensus.cc:2468] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 2.
I20260709 12:13:26.873955  5088 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:26.875383  6507 raft_consensus.cc:2804] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:26.876104  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:26.876720  5836 raft_consensus.cc:3060] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:26.877286  5120 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:26.878218  6507 raft_consensus.cc:697] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:26.879179  6601 tablet_copy_client.cc:806] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:26.879771  6601 tablet_copy_client.cc:670] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:26.879398  6507 consensus_queue.cc:237] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:26.885342  6601 tablet_copy_client.cc:538] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:26.899832  6601 tablet_bootstrap.cc:492] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088: Bootstrap starting.
I20260709 12:13:26.914021  5268 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:34674
I20260709 12:13:26.914659  5268 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:26.915001  5268 raft_consensus.cc:3060] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:26.923370  6623 tablet_replica.cc:333] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:13:26.893142  5836 raft_consensus.cc:2468] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 2.
I20260709 12:13:26.924326  5268 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:26.936254  5268 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:26.936579  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:26.937417  5125 raft_consensus.cc:3055] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:26.937765  5125 raft_consensus.cc:740] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:26.937837  6623 raft_consensus.cc:2243] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:26.938896  6623 raft_consensus.cc:2272] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:26.938592  5125 consensus_queue.cc:260] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:26.942692  5125 raft_consensus.cc:3060] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:26.943244  6623 ts_tablet_manager.cc:1916] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:26.954413  5125 raft_consensus.cc:2468] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 4.
I20260709 12:13:26.955664  5240 leader_election.cc:304] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:13:26.956657  6590 raft_consensus.cc:2804] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:26.957147  6590 raft_consensus.cc:697] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 4 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:26.958248  6590 consensus_queue.cc:237] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:13:26.958268  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 45830.3us
I20260709 12:13:26.970589  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:26.971239  5191 raft_consensus.cc:3060] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:26.981151  5191 raft_consensus.cc:2468] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 4.
I20260709 12:13:26.985894  5018 catalog_manager.cc:5697] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 1 to 2, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 2 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:27.018334  6601 tablet_bootstrap.cc:492] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:27.020105  6601 tablet_bootstrap.cc:492] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088: Bootstrap complete.
I20260709 12:13:27.021014  6601 ts_tablet_manager.cc:1403] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088: Time spent bootstrapping tablet: real 0.121s	user 0.021s	sys 0.028s
I20260709 12:13:27.024567  6601 raft_consensus.cc:359] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:27.025583  6601 raft_consensus.cc:740] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Initialized, Role: LEARNER
I20260709 12:13:27.026374  6601 consensus_queue.cc:260] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:27.029508  6601 ts_tablet_manager.cc:1434] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.001s
I20260709 12:13:27.036059  5836 raft_consensus.cc:1217] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:27.038403  5135 tablet_copy_service.cc:342] P ad2f9a1e2f7a45429fa69fd23d09f821: Request end of tablet copy session bce73265e27d4b30a4dcc1e491305088-8d081e937c2741c9b646839e29e5599f received from {username='slave'} at 127.0.0.1:59390
I20260709 12:13:27.038931  5135 tablet_copy_service.cc:434] P ad2f9a1e2f7a45429fa69fd23d09f821: ending tablet copy session bce73265e27d4b30a4dcc1e491305088-8d081e937c2741c9b646839e29e5599f on tablet 8d081e937c2741c9b646839e29e5599f with peer bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:27.046782  6584 tablet_bootstrap.cc:492] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088: Bootstrap starting.
I20260709 12:13:27.017032  6623 ts_tablet_manager.cc:1929] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.6
I20260709 12:13:27.054867  6623 log.cc:1199] T b4b265799c1c447794c6126f3ae47e5d P ad2f9a1e2f7a45429fa69fd23d09f821: Deleting WAL directory at /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/ts-0-root/wals/b4b265799c1c447794c6126f3ae47e5d
I20260709 12:13:27.065279  5010 catalog_manager.cc:5028] TS ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): tablet b4b265799c1c447794c6126f3ae47e5d (table test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]) successfully deleted
I20260709 12:13:27.096390  6608 raft_consensus.cc:993] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929: : Instructing follower dd62e75bd3ed4ed28f1fb5955d650808 to start an election
I20260709 12:13:27.096889  6608 raft_consensus.cc:1081] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Signalling peer dd62e75bd3ed4ed28f1fb5955d650808 to start an election
I20260709 12:13:27.102742  5191 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d"
dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
 from {username='slave'} at 127.0.0.1:47728
I20260709 12:13:27.103363  5191 raft_consensus.cc:493] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:27.103729  5191 raft_consensus.cc:3060] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:27.119033  5191 raft_consensus.cc:515] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:27.125583  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:27.126190  5191 leader_election.cc:290] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:27.126199  5125 raft_consensus.cc:3060] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:27.148362  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:27.148664  5125 raft_consensus.cc:2468] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 2.
I20260709 12:13:27.149008  5273 raft_consensus.cc:3055] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:27.149392  5273 raft_consensus.cc:740] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:27.150020  5166 leader_election.cc:304] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:27.150173  5273 consensus_queue.cc:260] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:27.150861  6610 raft_consensus.cc:2804] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:27.151333  6610 raft_consensus.cc:697] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:27.150404  5018 catalog_manager.cc:5697] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 3 to 4, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 4 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:27.152233  6610 consensus_queue.cc:237] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:27.155934  5836 raft_consensus.cc:1217] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:13:27.159052  5273 raft_consensus.cc:3060] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:27.176007  5273 raft_consensus.cc:2468] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 2.
I20260709 12:13:27.215222  5023 catalog_manager.cc:5697] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 1 to 2, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 2 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:27.244765  6538 raft_consensus.cc:1064] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821: attempting to promote NON_VOTER bce73265e27d4b30a4dcc1e491305088 to VOTER
I20260709 12:13:27.248243  6538 consensus_queue.cc:237] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:27.261585  6584 tablet_bootstrap.cc:492] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:27.262703  6584 tablet_bootstrap.cc:492] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088: Bootstrap complete.
I20260709 12:13:27.263438  6584 ts_tablet_manager.cc:1403] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088: Time spent bootstrapping tablet: real 0.217s	user 0.021s	sys 0.002s
I20260709 12:13:27.276662  6584 raft_consensus.cc:359] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:27.277593  6584 raft_consensus.cc:740] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Initialized, Role: LEARNER
I20260709 12:13:27.278347  6584 consensus_queue.cc:260] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:27.300668  6584 ts_tablet_manager.cc:1434] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.001s
I20260709 12:13:27.315639  5135 tablet_copy_service.cc:342] P ad2f9a1e2f7a45429fa69fd23d09f821: Request end of tablet copy session bce73265e27d4b30a4dcc1e491305088-271b0c7d258142798f30accd6aaba829 received from {username='slave'} at 127.0.0.1:59390
I20260709 12:13:27.316125  5135 tablet_copy_service.cc:434] P ad2f9a1e2f7a45429fa69fd23d09f821: ending tablet copy session bce73265e27d4b30a4dcc1e491305088-271b0c7d258142798f30accd6aaba829 on tablet 271b0c7d258142798f30accd6aaba829 with peer bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:27.348040  5191 raft_consensus.cc:1275] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:27.349972  6608 consensus_queue.cc:1048] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:13:27.414479  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 76872us
I20260709 12:13:27.457931  5125 raft_consensus.cc:1275] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:27.459829  6590 consensus_queue.cc:1048] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:13:27.470928  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 53223us
I20260709 12:13:27.491094  5836 raft_consensus.cc:1275] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:27.502154  6609 consensus_queue.cc:1048] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:13:27.509582  5268 raft_consensus.cc:1275] T 2a6867413d1d4b49bcd267c1e134d12e P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:27.513149  5191 raft_consensus.cc:1275] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:27.526104  5191 raft_consensus.cc:1275] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:27.532605  5832 raft_consensus.cc:1275] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:27.541448  5125 raft_consensus.cc:1275] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:27.547008  6610 consensus_queue.cc:1048] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:27.553161  6612 consensus_queue.cc:1048] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:27.554271  6538 consensus_queue.cc:1048] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:27.555153  6616 raft_consensus.cc:1064] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808: attempting to promote NON_VOTER bce73265e27d4b30a4dcc1e491305088 to VOTER
I20260709 12:13:27.558019  6616 consensus_queue.cc:237] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:27.562633  6507 consensus_queue.cc:1048] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:27.577821  6539 consensus_queue.cc:1048] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:27.607796  5837 raft_consensus.cc:1275] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 2 LEARNER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:13:27.611340  5270 raft_consensus.cc:1275] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:27.628612  6543 consensus_queue.cc:1048] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:27.632243  5832 raft_consensus.cc:1217] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:27.632628  6539 raft_consensus.cc:1064] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821: attempting to promote NON_VOTER bce73265e27d4b30a4dcc1e491305088 to VOTER
I20260709 12:13:27.638437  6539 consensus_queue.cc:237] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:27.662259  5270 raft_consensus.cc:1275] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:13:27.650563  6507 raft_consensus.cc:2955] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:27.666170  6616 consensus_queue.cc:1048] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 12:13:27.674149  5120 raft_consensus.cc:1275] T 87f29f851a0e43738cf01ef3724e5533 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:13:27.660404  6610 consensus_queue.cc:1048] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:13:27.677094  6616 consensus_queue.cc:1048] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 12:13:27.694048  5273 raft_consensus.cc:2955] T 2a6867413d1d4b49bcd267c1e134d12e P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:27.765323  5837 raft_consensus.cc:1275] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:27.782739  6609 consensus_queue.cc:1048] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:13:27.771179  5191 raft_consensus.cc:2955] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
W20260709 12:13:27.821552  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 104830us
I20260709 12:13:27.827981  5023 catalog_manager.cc:5697] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:27.828676  5832 raft_consensus.cc:2955] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
W20260709 12:13:27.882027  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 155853us
I20260709 12:13:27.885538  5193 raft_consensus.cc:1275] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:27.886425  5273 raft_consensus.cc:1275] T 8d081e937c2741c9b646839e29e5599f P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:27.912107  6543 raft_consensus.cc:2955] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:27.925532  5268 raft_consensus.cc:2955] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
W20260709 12:13:27.944865  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 46598.2us
I20260709 12:13:27.968005  6609 consensus_queue.cc:1048] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:27.994831  5120 raft_consensus.cc:2955] T 87f29f851a0e43738cf01ef3724e5533 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:28.022084  5834 raft_consensus.cc:2955] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:28.031132  6538 consensus_queue.cc:1048] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:28.031473  5021 catalog_manager.cc:5697] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 reported cstate change: config changed from index 3 to 4, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:28.058202  5125 consensus_queue.cc:237] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:28.068694  5197 raft_consensus.cc:1275] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:28.072422  5836 raft_consensus.cc:1275] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:28.072888  6609 consensus_queue.cc:1048] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:28.074434  6652 consensus_queue.cc:1048] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:28.090121  6538 raft_consensus.cc:2955] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e794b72ed7640219f90ec4232363929 (127.3.212.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:28.095485  5197 consensus_queue.cc:237] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:28.106062  5836 raft_consensus.cc:2955] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e794b72ed7640219f90ec4232363929 (127.3.212.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:28.119853  5834 raft_consensus.cc:1275] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:28.128569  5019 catalog_manager.cc:5697] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 reported cstate change: config changed from index 3 to 4, VOTER 9e794b72ed7640219f90ec4232363929 (127.3.212.131) evicted. New cstate: current_term: 1 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:28.141040  6543 consensus_queue.cc:1048] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:28.145643  6652 raft_consensus.cc:2955] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:28.159009  5010 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2a6867413d1d4b49bcd267c1e134d12e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:28.159574  5263 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a6867413d1d4b49bcd267c1e134d12e with delete_type TABLET_DATA_TOMBSTONED (TS 9e794b72ed7640219f90ec4232363929 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34668
I20260709 12:13:28.163674  5191 raft_consensus.cc:2955] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e794b72ed7640219f90ec4232363929 (127.3.212.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:28.162384  5197 raft_consensus.cc:2955] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:28.172703  5273 raft_consensus.cc:1275] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:28.183429  6543 consensus_queue.cc:1048] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:28.187332  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:28.191520  6660 raft_consensus.cc:2955] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:28.194073  5834 raft_consensus.cc:2955] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:28.197139  5273 raft_consensus.cc:2955] T 8d081e937c2741c9b646839e29e5599f P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:28.215065  6672 tablet_replica.cc:333] T 2a6867413d1d4b49bcd267c1e134d12e P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
I20260709 12:13:28.216135  6672 raft_consensus.cc:2243] T 2a6867413d1d4b49bcd267c1e134d12e P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:28.216900  6672 raft_consensus.cc:2272] T 2a6867413d1d4b49bcd267c1e134d12e P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:28.216493  5270 raft_consensus.cc:2955] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:28.223155  5019 catalog_manager.cc:5697] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:28.231845  6672 ts_tablet_manager.cc:1916] T 2a6867413d1d4b49bcd267c1e134d12e P 9e794b72ed7640219f90ec4232363929: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:28.239959  5021 catalog_manager.cc:5697] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: config changed from index 4 to 5, VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) evicted. New cstate: current_term: 2 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:28.249210  6507 raft_consensus.cc:1064] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821: attempting to promote NON_VOTER bce73265e27d4b30a4dcc1e491305088 to VOTER
I20260709 12:13:28.252427  6507 consensus_queue.cc:237] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:28.281714  5007 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 87f29f851a0e43738cf01ef3724e5533 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:28.289512  5108 tablet_service.cc:1558] Processing DeleteTablet for tablet 87f29f851a0e43738cf01ef3724e5533 with delete_type TABLET_DATA_TOMBSTONED (TS ad2f9a1e2f7a45429fa69fd23d09f821 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:40378
I20260709 12:13:28.292078  5834 raft_consensus.cc:2955] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:28.294685  5273 raft_consensus.cc:1275] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:28.296510  5837 raft_consensus.cc:1275] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:28.298009  5191 raft_consensus.cc:1275] T 271b0c7d258142798f30accd6aaba829 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:28.304069  6507 consensus_queue.cc:1048] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:28.306823  6538 consensus_queue.cc:1048] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:28.314849  6507 consensus_queue.cc:1048] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:28.331851  6672 ts_tablet_manager.cc:1929] T 2a6867413d1d4b49bcd267c1e134d12e P 9e794b72ed7640219f90ec4232363929: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:28.331585  5125 consensus_queue.cc:237] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:28.332329  6672 log.cc:1199] T 2a6867413d1d4b49bcd267c1e134d12e P 9e794b72ed7640219f90ec4232363929: Deleting WAL directory at /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/ts-2-root/wals/2a6867413d1d4b49bcd267c1e134d12e
I20260709 12:13:28.341351  5007 catalog_manager.cc:5028] TS 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): tablet 2a6867413d1d4b49bcd267c1e134d12e (table test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]) successfully deleted
I20260709 12:13:28.344581  5191 raft_consensus.cc:1275] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:28.346563  6652 consensus_queue.cc:1048] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:28.361892  5836 raft_consensus.cc:1275] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:28.364161  6538 raft_consensus.cc:2955] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e794b72ed7640219f90ec4232363929 (127.3.212.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:28.370112  6663 consensus_queue.cc:1048] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:28.376327  5836 raft_consensus.cc:2955] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e794b72ed7640219f90ec4232363929 (127.3.212.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:28.381596  5010 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8d081e937c2741c9b646839e29e5599f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:28.380824  5197 raft_consensus.cc:2955] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e794b72ed7640219f90ec4232363929 (127.3.212.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:28.462597  5125 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
new_leader_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:45628
I20260709 12:13:28.463265  5125 raft_consensus.cc:606] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Received request to transfer leadership to TS 9e794b72ed7640219f90ec4232363929
I20260709 12:13:28.510624  5125 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
new_leader_uuid: "bce73265e27d4b30a4dcc1e491305088"
 from {username='slave'} at 127.0.0.1:45628
I20260709 12:13:28.511324  5125 raft_consensus.cc:606] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Received request to transfer leadership to TS bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:28.535804  6674 tablet_replica.cc:333] T 87f29f851a0e43738cf01ef3724e5533 P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:13:28.537065  6674 raft_consensus.cc:2243] T 87f29f851a0e43738cf01ef3724e5533 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:28.538055  6674 raft_consensus.cc:2272] T 87f29f851a0e43738cf01ef3724e5533 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:28.555491  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 54347.3us
I20260709 12:13:28.558125  5266 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
mode: GRACEFUL
new_leader_uuid: "bce73265e27d4b30a4dcc1e491305088"
 from {username='slave'} at 127.0.0.1:42506
I20260709 12:13:28.558822  5266 raft_consensus.cc:606] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Received request to transfer leadership to TS bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:28.569932  5021 catalog_manager.cc:5697] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: config changed from index 3 to 4, VOTER 9e794b72ed7640219f90ec4232363929 (127.3.212.131) evicted. New cstate: current_term: 1 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:28.634397  6674 ts_tablet_manager.cc:1916] T 87f29f851a0e43738cf01ef3724e5533 P ad2f9a1e2f7a45429fa69fd23d09f821: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:28.638127  5266 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
mode: GRACEFUL
new_leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
 from {username='slave'} at 127.0.0.1:42506
I20260709 12:13:28.638880  5266 raft_consensus.cc:606] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 4 LEADER]: Received request to transfer leadership to TS dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:13:28.646953  6675 log.cc:927] Time spent T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 12:13:28.651373  5197 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e"
dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
mode: GRACEFUL
new_leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
 from {username='slave'} at 127.0.0.1:53902
I20260709 12:13:28.651973  5197 raft_consensus.cc:606] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 LEADER]: Received request to transfer leadership to TS ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:28.655668  6653 raft_consensus.cc:993] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929: : Instructing follower bce73265e27d4b30a4dcc1e491305088 to start an election
I20260709 12:13:28.654750  6612 raft_consensus.cc:2955] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:28.656122  6653 raft_consensus.cc:1081] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Signalling peer bce73265e27d4b30a4dcc1e491305088 to start an election
I20260709 12:13:28.664371  5836 raft_consensus.cc:2955] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:28.675590  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:13:28.677345  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:28.682020  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:28.680738  5837 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85"
dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
 from {username='slave'} at 127.0.0.1:46088
I20260709 12:13:28.688755  5837 raft_consensus.cc:493] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:28.689162  5837 raft_consensus.cc:3060] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:28.692761  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 82588.3us
I20260709 12:13:28.700258  5837 raft_consensus.cc:515] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:28.702977  6662 raft_consensus.cc:993] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808: : Instructing follower ad2f9a1e2f7a45429fa69fd23d09f821 to start an election
I20260709 12:13:28.705896  6660 raft_consensus.cc:1081] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 LEADER]: Signalling peer ad2f9a1e2f7a45429fa69fd23d09f821 to start an election
I20260709 12:13:28.707163  5837 leader_election.cc:290] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:28.708847  5117 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
 from {username='slave'} at 127.0.0.1:40386
I20260709 12:13:28.709486  5117 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:28.709836  5117 raft_consensus.cc:3060] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:28.713860  5193 raft_consensus.cc:2955] T 271b0c7d258142798f30accd6aaba829 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:28.718226  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:28.718914  5120 raft_consensus.cc:3060] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:28.720185  5117 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:28.721246  5263 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d081e937c2741c9b646839e29e5599f with delete_type TABLET_DATA_TOMBSTONED (TS 9e794b72ed7640219f90ec4232363929 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34668
I20260709 12:13:28.729274  6672 tablet_replica.cc:333] T 8d081e937c2741c9b646839e29e5599f P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
I20260709 12:13:28.730568  6672 raft_consensus.cc:2243] T 8d081e937c2741c9b646839e29e5599f P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:28.738798  5266 raft_consensus.cc:2955] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:28.742818  5023 catalog_manager.cc:5697] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
W20260709 12:13:28.751506  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 108594us
I20260709 12:13:28.755815  6672 raft_consensus.cc:2272] T 8d081e937c2741c9b646839e29e5599f P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:28.758836  5117 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:28.759171  6672 ts_tablet_manager.cc:1916] T 8d081e937c2741c9b646839e29e5599f P 9e794b72ed7640219f90ec4232363929: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:28.763059  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:28.768708  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:28.773696  5268 raft_consensus.cc:3055] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:28.774077  5268 raft_consensus.cc:740] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:28.773798  5191 raft_consensus.cc:3055] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:28.774605  5191 raft_consensus.cc:740] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:28.774834  5268 consensus_queue.cc:260] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:28.775310  5191 consensus_queue.cc:260] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:28.776160  5268 raft_consensus.cc:3060] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:28.781692  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:28.782326  5273 raft_consensus.cc:3060] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:28.783012  5191 raft_consensus.cc:3060] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:28.774952  5122 consensus_queue.cc:237] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:28.788166  5268 raft_consensus.cc:2468] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 2.
I20260709 12:13:28.789485  5801 leader_election.cc:304] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:13:28.790233  6656 raft_consensus.cc:2804] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:28.790756  6656 raft_consensus.cc:697] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 2 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:13:28.791616  6656 consensus_queue.cc:237] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:28.795706  5837 raft_consensus.cc:1275] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:28.790208  5273 raft_consensus.cc:2468] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
I20260709 12:13:28.798312  6663 consensus_queue.cc:1048] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:28.800509  6672 ts_tablet_manager.cc:1929] T 8d081e937c2741c9b646839e29e5599f P 9e794b72ed7640219f90ec4232363929: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:28.800998  6672 log.cc:1199] T 8d081e937c2741c9b646839e29e5599f P 9e794b72ed7640219f90ec4232363929: Deleting WAL directory at /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/ts-2-root/wals/8d081e937c2741c9b646839e29e5599f
I20260709 12:13:28.787194  6674 ts_tablet_manager.cc:1929] T 87f29f851a0e43738cf01ef3724e5533 P ad2f9a1e2f7a45429fa69fd23d09f821: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:13:28.801653  6674 log.cc:1199] T 87f29f851a0e43738cf01ef3724e5533 P ad2f9a1e2f7a45429fa69fd23d09f821: Deleting WAL directory at /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/ts-0-root/wals/87f29f851a0e43738cf01ef3724e5533
I20260709 12:13:28.946372  5007 catalog_manager.cc:5028] TS 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): tablet 8d081e937c2741c9b646839e29e5599f (table test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]) successfully deleted
I20260709 12:13:28.738897  5120 raft_consensus.cc:2468] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 2.
I20260709 12:13:28.962247  5022 catalog_manager.cc:5697] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 1 to 2, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 2 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:28.968267  5191 raft_consensus.cc:2468] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
I20260709 12:13:28.981768  5273 raft_consensus.cc:1275] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:13:29.034773  5010 catalog_manager.cc:5028] TS ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): tablet 87f29f851a0e43738cf01ef3724e5533 (table test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]) successfully deleted
I20260709 12:13:29.037616  6683 raft_consensus.cc:993] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929: : Instructing follower dd62e75bd3ed4ed28f1fb5955d650808 to start an election
I20260709 12:13:29.038218  6683 raft_consensus.cc:1081] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 4 LEADER]: Signalling peer dd62e75bd3ed4ed28f1fb5955d650808 to start an election
I20260709 12:13:29.039394  5088 leader_election.cc:304] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:13:29.040184  6663 raft_consensus.cc:2804] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:29.040668  6663 raft_consensus.cc:697] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:29.041662  6663 consensus_queue.cc:237] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:29.051819  6507 consensus_queue.cc:1048] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:29.055636  6609 raft_consensus.cc:993] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821: : Instructing follower bce73265e27d4b30a4dcc1e491305088 to start an election
I20260709 12:13:29.056142  6609 raft_consensus.cc:1081] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Signalling peer bce73265e27d4b30a4dcc1e491305088 to start an election
I20260709 12:13:29.058358  6612 raft_consensus.cc:2955] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:29.074466  5836 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008"
dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
 from {username='slave'} at 127.0.0.1:46094
I20260709 12:13:29.075270  5836 raft_consensus.cc:493] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:29.075698  5836 raft_consensus.cc:3060] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:29.077986  5023 catalog_manager.cc:5697] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 2 to 3, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 3 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:29.081591  5191 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513"
dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
 from {username='slave'} at 127.0.0.1:47728
I20260709 12:13:29.083037  5834 raft_consensus.cc:2955] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:29.091145  5010 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 271b0c7d258142798f30accd6aaba829 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:29.084079  5191 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:29.095386  5191 raft_consensus.cc:3060] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:29.109079  6609 raft_consensus.cc:993] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821: : Instructing follower 9e794b72ed7640219f90ec4232363929 to start an election
I20260709 12:13:29.109846  6692 raft_consensus.cc:1081] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Signalling peer 9e794b72ed7640219f90ec4232363929 to start an election
I20260709 12:13:29.104055  5023 catalog_manager.cc:5697] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: config changed from index 3 to 4, VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) evicted. New cstate: current_term: 1 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:29.113943  5836 raft_consensus.cc:515] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:29.125983  5191 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:29.129926  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:29.130574  5122 raft_consensus.cc:3055] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:29.130863  5122 raft_consensus.cc:740] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:29.131798  5186 tablet_service.cc:1558] Processing DeleteTablet for tablet 271b0c7d258142798f30accd6aaba829 with delete_type TABLET_DATA_TOMBSTONED (TS dd62e75bd3ed4ed28f1fb5955d650808 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:47718
I20260709 12:13:29.131672  5122 consensus_queue.cc:260] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:29.132858  5122 raft_consensus.cc:3060] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:29.133425  5836 leader_election.cc:290] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:29.135733  5191 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:29.136543  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:29.137297  5125 raft_consensus.cc:3060] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:29.145452  5125 raft_consensus.cc:2468] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 5.
I20260709 12:13:29.145663  5122 raft_consensus.cc:2468] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 2.
I20260709 12:13:29.152199  5266 raft_consensus.cc:2955] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:29.153963  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:29.155857  5273 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:34674
I20260709 12:13:29.159097  5273 raft_consensus.cc:493] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:29.159556  5273 raft_consensus.cc:3060] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:29.160070  6695 tablet_replica.cc:333] T 271b0c7d258142798f30accd6aaba829 P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
I20260709 12:13:29.161262  6695 raft_consensus.cc:2243] T 271b0c7d258142798f30accd6aaba829 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:29.162403  6695 raft_consensus.cc:2272] T 271b0c7d258142798f30accd6aaba829 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:29.163726  5191 raft_consensus.cc:3060] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:29.164161  5166 leader_election.cc:304] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:29.166014  6662 raft_consensus.cc:2804] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:29.166505  6662 raft_consensus.cc:697] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:29.166574  6695 ts_tablet_manager.cc:1916] T 271b0c7d258142798f30accd6aaba829 P dd62e75bd3ed4ed28f1fb5955d650808: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:29.167375  6662 consensus_queue.cc:237] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:29.167392  5273 raft_consensus.cc:515] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:29.174055  5804 leader_election.cc:304] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:13:29.176622  6682 raft_consensus.cc:2804] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:29.177106  6682 raft_consensus.cc:697] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 2 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:13:29.177757  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:29.179432  5191 raft_consensus.cc:2468] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 2.
I20260709 12:13:29.179587  6682 consensus_queue.cc:237] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:29.182682  5273 leader_election.cc:290] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:29.184191  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:29.184892  5120 raft_consensus.cc:3055] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:29.185212  5120 raft_consensus.cc:740] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:29.185305  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:29.186008  5120 consensus_queue.cc:260] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:29.198889  5191 raft_consensus.cc:3060] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:29.199678  5120 raft_consensus.cc:3060] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:29.199945  5022 catalog_manager.cc:5697] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 4 to 5, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 5 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:29.179616  5270 raft_consensus.cc:3055] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:29.202158  5270 raft_consensus.cc:740] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:29.202957  5270 consensus_queue.cc:260] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:29.205159  5270 raft_consensus.cc:3060] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:29.219378  5191 raft_consensus.cc:2468] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 3.
I20260709 12:13:29.222715  5237 leader_election.cc:304] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:29.223975  6687 raft_consensus.cc:2804] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:29.224450  6687 raft_consensus.cc:697] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 3 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:29.225903  5270 raft_consensus.cc:2468] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 5.
I20260709 12:13:29.227173  6695 ts_tablet_manager.cc:1929] T 271b0c7d258142798f30accd6aaba829 P dd62e75bd3ed4ed28f1fb5955d650808: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:13:29.228556  6695 log.cc:1199] T 271b0c7d258142798f30accd6aaba829 P dd62e75bd3ed4ed28f1fb5955d650808: Deleting WAL directory at /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/ts-1-root/wals/271b0c7d258142798f30accd6aaba829
I20260709 12:13:29.225203  6687 consensus_queue.cc:237] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:29.230643  5007 catalog_manager.cc:5028] TS dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): tablet 271b0c7d258142798f30accd6aaba829 (table test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]) successfully deleted
I20260709 12:13:29.230918  5022 catalog_manager.cc:5697] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 1 to 2, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 2 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:29.239349  5120 raft_consensus.cc:2468] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 3.
I20260709 12:13:29.245561  5023 catalog_manager.cc:5697] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 2 to 3, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 3 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:29.269846  5273 raft_consensus.cc:1275] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:29.271036  6682 consensus_queue.cc:1048] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:29.288574  5120 raft_consensus.cc:1275] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:29.290021  6656 consensus_queue.cc:1048] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:29.559826  5270 raft_consensus.cc:1275] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:29.561234  6663 consensus_queue.cc:1048] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:29.572212  5196 raft_consensus.cc:1275] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:29.574641  6663 consensus_queue.cc:1048] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:29.694478  5196 raft_consensus.cc:1275] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:29.696003  6682 consensus_queue.cc:1048] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:29.696242  5120 raft_consensus.cc:1275] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:13:29.698650  6655 consensus_queue.cc:1048] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:29.725759  5273 raft_consensus.cc:1275] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:13:29.729590  5120 raft_consensus.cc:1275] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:29.731065  6709 consensus_queue.cc:1048] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:29.739707  6683 consensus_queue.cc:1048] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:29.769254  5120 raft_consensus.cc:1275] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:29.770990  6656 consensus_queue.cc:1048] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:29.786190  5196 raft_consensus.cc:1275] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:29.789569  6683 consensus_queue.cc:1048] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:30.163681  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:30.225131  5191 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e275c844ff54adea37252a082eae526"
dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
mode: GRACEFUL
new_leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
 from {username='slave'} at 127.0.0.1:53902
I20260709 12:13:30.225678  5191 raft_consensus.cc:606] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Received request to transfer leadership to TS ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:30.228366  5270 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
mode: GRACEFUL
new_leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
 from {username='slave'} at 127.0.0.1:42506
I20260709 12:13:30.229025  5270 raft_consensus.cc:606] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Received request to transfer leadership to TS dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:30.231985  5120 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
new_leader_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:45628
I20260709 12:13:30.231763  5273 consensus_queue.cc:237] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:30.232566  5120 raft_consensus.cc:606] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Received request to transfer leadership to TS 9e794b72ed7640219f90ec4232363929
I20260709 12:13:30.234227  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:13:30.235965  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:30.236773  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:13:30.246949  5238 consensus_peers.cc:597] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 -> Peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Couldn't send request to peer bce73265e27d4b30a4dcc1e491305088. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3db164e3a1ce4a43b0a112a777118daa. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:30.249560  5120 raft_consensus.cc:1275] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:30.250538  5191 raft_consensus.cc:1275] T 3db164e3a1ce4a43b0a112a777118daa P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:30.251744  6715 consensus_queue.cc:1048] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:30.252841  6687 consensus_queue.cc:1048] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:30.269447  6710 raft_consensus.cc:993] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808: : Instructing follower ad2f9a1e2f7a45429fa69fd23d09f821 to start an election
I20260709 12:13:30.270001  6709 raft_consensus.cc:1081] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Signalling peer ad2f9a1e2f7a45429fa69fd23d09f821 to start an election
I20260709 12:13:30.268934  6715 raft_consensus.cc:2955] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:30.271790  5120 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e275c844ff54adea37252a082eae526"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
 from {username='slave'} at 127.0.0.1:40386
I20260709 12:13:30.271514  5122 raft_consensus.cc:2955] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:30.289696  5120 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:30.290126  5120 raft_consensus.cc:3060] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:30.306901  5120 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:30.309023  5120 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:30.310194  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:30.310856  5199 raft_consensus.cc:3055] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:30.310799  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:30.311333  5199 raft_consensus.cc:740] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:30.311551  5273 raft_consensus.cc:3060] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:30.311607  5022 catalog_manager.cc:5697] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: config changed from index -1 to 3, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New cstate: current_term: 2 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:30.312438  5199 consensus_queue.cc:260] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:30.313632  5199 raft_consensus.cc:3060] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:30.320016  5270 consensus_queue.cc:237] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:30.347132  5199 raft_consensus.cc:2468] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 2.
I20260709 12:13:30.340466  5194 raft_consensus.cc:2955] T 3db164e3a1ce4a43b0a112a777118daa P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:30.350600  5273 raft_consensus.cc:2468] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 2.
I20260709 12:13:30.370802  5088 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:13:30.371773  6663 raft_consensus.cc:2804] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:30.372278  6663 raft_consensus.cc:697] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:30.373204  6663 consensus_queue.cc:237] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:13:30.380923  5238 consensus_peers.cc:597] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 -> Peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Couldn't send request to peer bce73265e27d4b30a4dcc1e491305088. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9f927a751b4041e99eb5ac25ddf214ec. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:30.382259  6683 raft_consensus.cc:993] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929: : Instructing follower dd62e75bd3ed4ed28f1fb5955d650808 to start an election
I20260709 12:13:30.382763  6683 raft_consensus.cc:1081] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Signalling peer dd62e75bd3ed4ed28f1fb5955d650808 to start an election
I20260709 12:13:30.385509  5192 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958"
dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
 from {username='slave'} at 127.0.0.1:47728
I20260709 12:13:30.386206  5192 raft_consensus.cc:493] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:30.386584  5192 raft_consensus.cc:3060] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:30.390713  5198 raft_consensus.cc:1275] T 9f927a751b4041e99eb5ac25ddf214ec P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:30.392107  5125 raft_consensus.cc:1275] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:30.397347  6683 consensus_queue.cc:1048] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:30.399334  6683 consensus_queue.cc:1048] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:30.400316  5192 raft_consensus.cc:515] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:30.412981  5192 leader_election.cc:290] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:30.416265  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:30.417033  5270 raft_consensus.cc:3055] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:30.417786  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:30.418494  5122 raft_consensus.cc:3060] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:30.421432  5270 raft_consensus.cc:740] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:30.422674  5270 consensus_queue.cc:260] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:30.424424  5270 raft_consensus.cc:3060] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:30.452943  5122 raft_consensus.cc:2468] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 2.
I20260709 12:13:30.456849  5166 leader_election.cc:304] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:30.457676  6709 raft_consensus.cc:2804] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:30.458259  6709 raft_consensus.cc:697] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:30.459224  6709 consensus_queue.cc:237] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:30.457266  5270 raft_consensus.cc:2468] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 2.
I20260709 12:13:30.467105  6687 raft_consensus.cc:2955] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:30.471027  5192 raft_consensus.cc:2955] T 9f927a751b4041e99eb5ac25ddf214ec P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:30.471136  5125 raft_consensus.cc:2955] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:30.491264  6663 raft_consensus.cc:993] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821: : Instructing follower 9e794b72ed7640219f90ec4232363929 to start an election
I20260709 12:13:30.491792  6663 raft_consensus.cc:1081] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Signalling peer 9e794b72ed7640219f90ec4232363929 to start an election
I20260709 12:13:30.493610  5273 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:34674
I20260709 12:13:30.494197  5273 raft_consensus.cc:493] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:30.494558  5273 raft_consensus.cc:3060] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:30.491729  5270 consensus_queue.cc:237] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:30.500382  5021 catalog_manager.cc:5697] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 1 to 2, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 2 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:30.506389  5022 catalog_manager.cc:5697] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 1 to 2, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 2 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:30.508090  5022 catalog_manager.cc:5697] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: config changed from index -1 to 3, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New cstate: current_term: 2 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:30.518638  5273 raft_consensus.cc:515] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:13:30.519889  5238 consensus_peers.cc:597] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 -> Peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Couldn't send request to peer bce73265e27d4b30a4dcc1e491305088. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 20ba878da4e3492fbdf2f90c6bb202c4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:30.520978  5273 leader_election.cc:290] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:30.521081  5192 raft_consensus.cc:1275] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:30.522025  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:30.522686  5194 raft_consensus.cc:3060] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:30.524451  5122 raft_consensus.cc:1275] T 20ba878da4e3492fbdf2f90c6bb202c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:30.526104  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:30.527007  5125 raft_consensus.cc:3055] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:30.527411  5125 raft_consensus.cc:740] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:30.527045  6715 consensus_queue.cc:1048] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:13:30.528208  5125 consensus_queue.cc:260] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:30.530524  5125 raft_consensus.cc:3060] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:30.538044  5194 raft_consensus.cc:2468] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 3.
I20260709 12:13:30.539186  6687 consensus_queue.cc:1048] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:30.540572  5237 leader_election.cc:304] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:30.541539  6715 raft_consensus.cc:2804] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:30.542326  6715 raft_consensus.cc:697] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 3 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:30.543311  6715 consensus_queue.cc:237] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:30.547016  5125 raft_consensus.cc:2468] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 3.
I20260709 12:13:30.558983  6687 raft_consensus.cc:2955] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:30.565090  5194 raft_consensus.cc:2955] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:30.569518  5022 catalog_manager.cc:5697] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 2 to 3, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 3 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:30.569438  5122 raft_consensus.cc:2955] T 20ba878da4e3492fbdf2f90c6bb202c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
W20260709 12:13:30.577868  5071 auto_rebalancer.cc:629] Failed to schedule move for tablet 4e275c844ff54adea37252a082eae526: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:13:30.598932  5021 catalog_manager.cc:5697] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: config changed from index -1 to 3, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New cstate: current_term: 2 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:30.725848  6734 ts_tablet_manager.cc:933] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088: Initiating tablet copy from peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:30.728324  6734 tablet_copy_client.cc:323] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088: tablet copy: Beginning tablet copy session from remote peer at address 127.3.212.131:46709
I20260709 12:13:30.730423  5284 tablet_copy_service.cc:140] P 9e794b72ed7640219f90ec4232363929: Received BeginTabletCopySession request for tablet 3db164e3a1ce4a43b0a112a777118daa from peer bce73265e27d4b30a4dcc1e491305088 ({username='slave'} at 127.0.0.1:50932)
I20260709 12:13:30.731020  5284 tablet_copy_service.cc:161] P 9e794b72ed7640219f90ec4232363929: Beginning new tablet copy session on tablet 3db164e3a1ce4a43b0a112a777118daa from peer bce73265e27d4b30a4dcc1e491305088 at {username='slave'} at 127.0.0.1:50932: session id = bce73265e27d4b30a4dcc1e491305088-3db164e3a1ce4a43b0a112a777118daa
I20260709 12:13:30.739675  5284 tablet_copy_source_session.cc:215] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:30.743234  6734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3db164e3a1ce4a43b0a112a777118daa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:30.765700  6734 tablet_copy_client.cc:806] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:30.766309  6734 tablet_copy_client.cc:670] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:30.770860  6734 tablet_copy_client.cc:538] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:30.779055  6734 tablet_bootstrap.cc:492] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088: Bootstrap starting.
I20260709 12:13:30.799778  6734 tablet_bootstrap.cc:492] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:30.800552  6734 tablet_bootstrap.cc:492] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088: Bootstrap complete.
I20260709 12:13:30.801102  6734 ts_tablet_manager.cc:1403] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.001s
I20260709 12:13:30.803644  6734 raft_consensus.cc:359] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:30.804469  6734 raft_consensus.cc:740] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Initialized, Role: LEARNER
I20260709 12:13:30.805145  6734 consensus_queue.cc:260] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:30.807958  6734 ts_tablet_manager.cc:1434] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 12:13:30.814553  5284 tablet_copy_service.cc:342] P 9e794b72ed7640219f90ec4232363929: Request end of tablet copy session bce73265e27d4b30a4dcc1e491305088-3db164e3a1ce4a43b0a112a777118daa received from {username='slave'} at 127.0.0.1:50932
I20260709 12:13:30.815022  5284 tablet_copy_service.cc:434] P 9e794b72ed7640219f90ec4232363929: ending tablet copy session bce73265e27d4b30a4dcc1e491305088-3db164e3a1ce4a43b0a112a777118daa on tablet 3db164e3a1ce4a43b0a112a777118daa with peer bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:30.827879  5192 raft_consensus.cc:1275] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:30.829341  6663 consensus_queue.cc:1048] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:30.845762  5273 raft_consensus.cc:1275] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:30.847600  6663 consensus_queue.cc:1048] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:30.852602  5270 raft_consensus.cc:1275] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:30.855731  6709 consensus_queue.cc:1048] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:30.879184  5125 raft_consensus.cc:1275] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:30.881265  6710 consensus_queue.cc:1048] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:30.979472  6734 ts_tablet_manager.cc:933] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088: Initiating tablet copy from peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:30.981516  6734 tablet_copy_client.cc:323] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088: tablet copy: Beginning tablet copy session from remote peer at address 127.3.212.131:46709
I20260709 12:13:30.983269  5284 tablet_copy_service.cc:140] P 9e794b72ed7640219f90ec4232363929: Received BeginTabletCopySession request for tablet 9f927a751b4041e99eb5ac25ddf214ec from peer bce73265e27d4b30a4dcc1e491305088 ({username='slave'} at 127.0.0.1:50932)
I20260709 12:13:30.983951  5284 tablet_copy_service.cc:161] P 9e794b72ed7640219f90ec4232363929: Beginning new tablet copy session on tablet 9f927a751b4041e99eb5ac25ddf214ec from peer bce73265e27d4b30a4dcc1e491305088 at {username='slave'} at 127.0.0.1:50932: session id = bce73265e27d4b30a4dcc1e491305088-9f927a751b4041e99eb5ac25ddf214ec
I20260709 12:13:30.986398  5192 raft_consensus.cc:1275] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:30.988256  6687 consensus_queue.cc:1048] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:30.991495  5284 tablet_copy_source_session.cc:215] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:30.995757  6734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f927a751b4041e99eb5ac25ddf214ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:31.006007  5120 raft_consensus.cc:1275] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:31.009577  6687 consensus_queue.cc:1048] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:31.015640  6734 tablet_copy_client.cc:806] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:31.016450  6734 tablet_copy_client.cc:670] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:31.032198  6734 tablet_copy_client.cc:538] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:31.058818  6734 tablet_bootstrap.cc:492] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088: Bootstrap starting.
I20260709 12:13:31.083411  6734 tablet_bootstrap.cc:492] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:31.084394  6734 tablet_bootstrap.cc:492] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088: Bootstrap complete.
I20260709 12:13:31.085093  6734 ts_tablet_manager.cc:1403] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.007s
I20260709 12:13:31.088011  6734 raft_consensus.cc:359] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:31.088927  6734 raft_consensus.cc:740] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Initialized, Role: LEARNER
I20260709 12:13:31.089632  6734 consensus_queue.cc:260] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:31.092608  6734 ts_tablet_manager.cc:1434] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:13:31.095064  5284 tablet_copy_service.cc:342] P 9e794b72ed7640219f90ec4232363929: Request end of tablet copy session bce73265e27d4b30a4dcc1e491305088-9f927a751b4041e99eb5ac25ddf214ec received from {username='slave'} at 127.0.0.1:50932
I20260709 12:13:31.095553  5284 tablet_copy_service.cc:434] P 9e794b72ed7640219f90ec4232363929: ending tablet copy session bce73265e27d4b30a4dcc1e491305088-9f927a751b4041e99eb5ac25ddf214ec on tablet 9f927a751b4041e99eb5ac25ddf214ec with peer bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:31.101487  6734 ts_tablet_manager.cc:933] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088: Initiating tablet copy from peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:31.127679  6734 tablet_copy_client.cc:323] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Beginning tablet copy session from remote peer at address 127.3.212.131:46709
I20260709 12:13:31.129350  5284 tablet_copy_service.cc:140] P 9e794b72ed7640219f90ec4232363929: Received BeginTabletCopySession request for tablet 20ba878da4e3492fbdf2f90c6bb202c4 from peer bce73265e27d4b30a4dcc1e491305088 ({username='slave'} at 127.0.0.1:50932)
I20260709 12:13:31.129931  5284 tablet_copy_service.cc:161] P 9e794b72ed7640219f90ec4232363929: Beginning new tablet copy session on tablet 20ba878da4e3492fbdf2f90c6bb202c4 from peer bce73265e27d4b30a4dcc1e491305088 at {username='slave'} at 127.0.0.1:50932: session id = bce73265e27d4b30a4dcc1e491305088-20ba878da4e3492fbdf2f90c6bb202c4
I20260709 12:13:31.144409  5284 tablet_copy_source_session.cc:215] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:31.149457  6734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20ba878da4e3492fbdf2f90c6bb202c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:31.164793  6734 tablet_copy_client.cc:806] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:31.165320  6734 tablet_copy_client.cc:670] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:31.168798  6734 tablet_copy_client.cc:538] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:31.185048  6734 tablet_bootstrap.cc:492] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088: Bootstrap starting.
I20260709 12:13:31.203763  6734 tablet_bootstrap.cc:492] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:31.204435  6734 tablet_bootstrap.cc:492] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088: Bootstrap complete.
I20260709 12:13:31.204906  6734 ts_tablet_manager.cc:1403] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088: Time spent bootstrapping tablet: real 0.020s	user 0.019s	sys 0.000s
I20260709 12:13:31.207296  6734 raft_consensus.cc:359] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:31.208091  6734 raft_consensus.cc:740] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Initialized, Role: LEARNER
I20260709 12:13:31.208688  6734 consensus_queue.cc:260] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:31.210798  6734 ts_tablet_manager.cc:1434] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.007s
I20260709 12:13:31.225504  5284 tablet_copy_service.cc:342] P 9e794b72ed7640219f90ec4232363929: Request end of tablet copy session bce73265e27d4b30a4dcc1e491305088-20ba878da4e3492fbdf2f90c6bb202c4 received from {username='slave'} at 127.0.0.1:50932
I20260709 12:13:31.225994  5284 tablet_copy_service.cc:434] P 9e794b72ed7640219f90ec4232363929: ending tablet copy session bce73265e27d4b30a4dcc1e491305088-20ba878da4e3492fbdf2f90c6bb202c4 on tablet 20ba878da4e3492fbdf2f90c6bb202c4 with peer bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:31.264382  5836 raft_consensus.cc:1217] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:13:31.295522  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:31.357146  5194 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c"
dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
mode: GRACEFUL
new_leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
 from {username='slave'} at 127.0.0.1:53902
I20260709 12:13:31.357827  5194 raft_consensus.cc:606] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Received request to transfer leadership to TS ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:31.361594  5270 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
mode: GRACEFUL
new_leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
 from {username='slave'} at 127.0.0.1:42506
I20260709 12:13:31.362223  5270 raft_consensus.cc:606] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Received request to transfer leadership to TS dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:31.365168  5125 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
new_leader_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:45628
I20260709 12:13:31.365795  5125 raft_consensus.cc:606] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Received request to transfer leadership to TS 9e794b72ed7640219f90ec4232363929
I20260709 12:13:31.367219  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:13:31.368781  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:31.369932  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:31.474485  5836 raft_consensus.cc:1217] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:13:31.486639  6663 raft_consensus.cc:993] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821: : Instructing follower 9e794b72ed7640219f90ec4232363929 to start an election
I20260709 12:13:31.487174  6663 raft_consensus.cc:1081] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Signalling peer 9e794b72ed7640219f90ec4232363929 to start an election
I20260709 12:13:31.494259  5273 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:34674
I20260709 12:13:31.494853  5273 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:31.495232  5273 raft_consensus.cc:3060] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:31.509780  5273 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:31.512449  5273 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:31.513196  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:31.513824  5194 raft_consensus.cc:3060] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:31.513890  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:31.514665  5120 raft_consensus.cc:3055] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:31.515929  5120 raft_consensus.cc:740] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:31.517692  5120 consensus_queue.cc:260] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:31.518878  5120 raft_consensus.cc:3060] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:31.521912  5194 raft_consensus.cc:2468] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 3.
I20260709 12:13:31.523617  5237 leader_election.cc:304] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:31.524495  6687 raft_consensus.cc:2804] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:31.525050  6687 raft_consensus.cc:697] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 3 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:31.525051  5120 raft_consensus.cc:2468] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 3.
I20260709 12:13:31.526206  6687 consensus_queue.cc:237] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:31.537470  5023 catalog_manager.cc:5697] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 2 to 3, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 3 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:31.562908  5836 raft_consensus.cc:1217] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:13:31.609973  6687 raft_consensus.cc:993] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929: : Instructing follower dd62e75bd3ed4ed28f1fb5955d650808 to start an election
I20260709 12:13:31.610481  6724 raft_consensus.cc:1081] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Signalling peer dd62e75bd3ed4ed28f1fb5955d650808 to start an election
I20260709 12:13:31.611910  5192 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387"
dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
 from {username='slave'} at 127.0.0.1:47728
I20260709 12:13:31.612380  5192 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:31.612780  5192 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:31.618216  5192 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:31.620039  5192 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:31.620918  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:31.621125  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:31.621770  5273 raft_consensus.cc:3055] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:31.621491  5120 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:31.622085  5273 raft_consensus.cc:740] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:31.622896  5273 consensus_queue.cc:260] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:31.624048  5273 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:31.626705  5120 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 2.
I20260709 12:13:31.628032  5166 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:31.628837  6709 raft_consensus.cc:2804] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:31.629248  6709 raft_consensus.cc:697] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:31.630091  6709 consensus_queue.cc:237] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:31.630822  5273 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 2.
I20260709 12:13:31.640643  5022 catalog_manager.cc:5697] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 1 to 2, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 2 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:31.708561  6745 raft_consensus.cc:993] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808: : Instructing follower ad2f9a1e2f7a45429fa69fd23d09f821 to start an election
I20260709 12:13:31.709242  6745 raft_consensus.cc:1081] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Signalling peer ad2f9a1e2f7a45429fa69fd23d09f821 to start an election
I20260709 12:13:31.710902  5125 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
 from {username='slave'} at 127.0.0.1:40386
I20260709 12:13:31.711472  5125 raft_consensus.cc:493] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:31.711849  5125 raft_consensus.cc:3060] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:31.718600  5125 raft_consensus.cc:515] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:31.720294  5125 leader_election.cc:290] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:31.721288  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:31.721649  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:31.721964  5273 raft_consensus.cc:3060] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:31.722195  5192 raft_consensus.cc:3055] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:31.722494  5192 raft_consensus.cc:740] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:31.723218  5192 consensus_queue.cc:260] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:31.724454  5192 raft_consensus.cc:3060] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:31.731248  5192 raft_consensus.cc:2468] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 2.
I20260709 12:13:31.732583  5088 leader_election.cc:304] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:31.733351  6721 raft_consensus.cc:2804] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:31.733871  6721 raft_consensus.cc:697] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:31.734300  5273 raft_consensus.cc:2468] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 2.
I20260709 12:13:31.734709  6721 consensus_queue.cc:237] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:31.750118  5022 catalog_manager.cc:5697] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 1 to 2, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 2 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:31.756829  6683 raft_consensus.cc:1064] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929: attempting to promote NON_VOTER bce73265e27d4b30a4dcc1e491305088 to VOTER
I20260709 12:13:31.762601  6683 consensus_queue.cc:237] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:31.799409  5832 raft_consensus.cc:1275] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 2 LEARNER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:13:31.801337  6683 consensus_queue.cc:1048] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:31.802944  5194 raft_consensus.cc:1275] T 3db164e3a1ce4a43b0a112a777118daa P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:13:31.804798  6683 consensus_queue.cc:1048] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:31.810305  5125 raft_consensus.cc:1275] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:13:31.812101  6683 consensus_queue.cc:1048] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:31.822940  6683 raft_consensus.cc:2955] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:31.828276  5122 raft_consensus.cc:2955] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:31.830488  5192 raft_consensus.cc:2955] T 3db164e3a1ce4a43b0a112a777118daa P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:31.836011  5832 raft_consensus.cc:2955] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:31.847342  5022 catalog_manager.cc:5697] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 reported cstate change: config changed from index 3 to 4, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:31.869464  5273 consensus_queue.cc:237] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:31.887176  5832 raft_consensus.cc:1275] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:31.889410  6687 consensus_queue.cc:1048] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:31.895857  5122 raft_consensus.cc:1275] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:31.897495  6687 consensus_queue.cc:1048] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:31.900972  6759 raft_consensus.cc:2955] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:31.904429  5832 raft_consensus.cc:2955] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:31.920799  5125 raft_consensus.cc:2955] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:31.924811  5007 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3db164e3a1ce4a43b0a112a777118daa with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:31.926924  5021 catalog_manager.cc:5697] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 reported cstate change: config changed from index 4 to 5, VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) evicted. New cstate: current_term: 2 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:31.941414  5186 tablet_service.cc:1558] Processing DeleteTablet for tablet 3db164e3a1ce4a43b0a112a777118daa with delete_type TABLET_DATA_TOMBSTONED (TS dd62e75bd3ed4ed28f1fb5955d650808 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:47718
I20260709 12:13:31.943622  6765 tablet_replica.cc:333] T 3db164e3a1ce4a43b0a112a777118daa P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
I20260709 12:13:31.944638  6765 raft_consensus.cc:2243] T 3db164e3a1ce4a43b0a112a777118daa P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:31.950168  6765 raft_consensus.cc:2272] T 3db164e3a1ce4a43b0a112a777118daa P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:31.958254  6765 ts_tablet_manager.cc:1916] T 3db164e3a1ce4a43b0a112a777118daa P dd62e75bd3ed4ed28f1fb5955d650808: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:31.973636  6765 ts_tablet_manager.cc:1929] T 3db164e3a1ce4a43b0a112a777118daa P dd62e75bd3ed4ed28f1fb5955d650808: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:13:31.974045  6765 log.cc:1199] T 3db164e3a1ce4a43b0a112a777118daa P dd62e75bd3ed4ed28f1fb5955d650808: Deleting WAL directory at /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/ts-1-root/wals/3db164e3a1ce4a43b0a112a777118daa
I20260709 12:13:31.975644  5007 catalog_manager.cc:5028] TS dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): tablet 3db164e3a1ce4a43b0a112a777118daa (table test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]) successfully deleted
I20260709 12:13:32.030089  5125 raft_consensus.cc:1275] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:32.031790  6683 consensus_queue.cc:1048] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:32.045472  5194 raft_consensus.cc:1275] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:32.057643  6724 consensus_queue.cc:1048] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:32.081533  6724 raft_consensus.cc:1064] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929: attempting to promote NON_VOTER bce73265e27d4b30a4dcc1e491305088 to VOTER
I20260709 12:13:32.082091  6759 raft_consensus.cc:1064] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929: attempting to promote NON_VOTER bce73265e27d4b30a4dcc1e491305088 to VOTER
I20260709 12:13:32.085256  6724 consensus_queue.cc:237] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:32.085568  6759 consensus_queue.cc:237] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:32.102258  5836 raft_consensus.cc:1275] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 2 LEARNER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:13:32.104645  6770 consensus_queue.cc:1048] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:32.108057  5194 raft_consensus.cc:1275] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:13:32.108465  5120 raft_consensus.cc:1275] T 20ba878da4e3492fbdf2f90c6bb202c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:13:32.109728  6683 consensus_queue.cc:1048] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:32.121029  5120 raft_consensus.cc:1275] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:13:32.121758  5194 raft_consensus.cc:1275] T 9f927a751b4041e99eb5ac25ddf214ec P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:13:32.124785  6774 consensus_queue.cc:1048] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:32.127156  5836 raft_consensus.cc:1275] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 2 LEARNER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:13:32.139199  5273 raft_consensus.cc:1275] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:32.140985  6709 consensus_queue.cc:1048] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:13:32.145721  6724 consensus_queue.cc:1048] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:32.148516  6768 consensus_queue.cc:1048] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:32.192836  6768 consensus_queue.cc:1048] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:32.198287  5125 raft_consensus.cc:1275] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:32.199908  6709 consensus_queue.cc:1048] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:32.217202  6724 raft_consensus.cc:2955] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:32.226109  5120 raft_consensus.cc:2955] T 20ba878da4e3492fbdf2f90c6bb202c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:32.252358  5019 catalog_manager.cc:5697] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 reported cstate change: config changed from index 3 to 4, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:32.254017  6683 raft_consensus.cc:2955] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:32.261215  5199 raft_consensus.cc:2955] T 9f927a751b4041e99eb5ac25ddf214ec P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:32.271608  5122 raft_consensus.cc:2955] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:32.240795  5192 raft_consensus.cc:2955] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:32.288101  5199 raft_consensus.cc:1275] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:32.294724  6538 consensus_queue.cc:1048] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:32.324270  5021 catalog_manager.cc:5697] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 reported cstate change: config changed from index 3 to 4, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:32.326603  5270 raft_consensus.cc:1275] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:32.328670  5836 raft_consensus.cc:2955] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:32.330277  6721 consensus_queue.cc:1048] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:32.342518  5836 raft_consensus.cc:2955] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:32.364261  5273 consensus_queue.cc:237] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:32.371680  5836 raft_consensus.cc:1275] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:32.372226  5125 raft_consensus.cc:1275] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:32.374017  6683 consensus_queue.cc:1048] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:32.375226  6768 consensus_queue.cc:1048] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:32.381978  6768 raft_consensus.cc:2955] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:32.394238  5836 raft_consensus.cc:2955] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:32.396643  5273 consensus_queue.cc:237] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:32.388540  5125 raft_consensus.cc:2955] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:32.409178  5007 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9f927a751b4041e99eb5ac25ddf214ec with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:32.420140  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:32.419832  5021 catalog_manager.cc:5697] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 reported cstate change: config changed from index 4 to 5, VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) evicted. New cstate: current_term: 2 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:32.424155  5199 raft_consensus.cc:1275] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:32.426029  6683 consensus_queue.cc:1048] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:32.431630  5834 raft_consensus.cc:1275] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:32.433259  6768 consensus_queue.cc:1048] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:32.442111  5186 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f927a751b4041e99eb5ac25ddf214ec with delete_type TABLET_DATA_TOMBSTONED (TS dd62e75bd3ed4ed28f1fb5955d650808 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:47718
I20260709 12:13:32.443092  6765 tablet_replica.cc:333] T 9f927a751b4041e99eb5ac25ddf214ec P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
I20260709 12:13:32.444135  6765 raft_consensus.cc:2243] T 9f927a751b4041e99eb5ac25ddf214ec P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:32.445003  6765 raft_consensus.cc:2272] T 9f927a751b4041e99eb5ac25ddf214ec P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:32.444730  6724 raft_consensus.cc:2955] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:32.446640  5836 raft_consensus.cc:2955] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:32.460745  5007 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 20ba878da4e3492fbdf2f90c6bb202c4 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:32.461194  6765 ts_tablet_manager.cc:1916] T 9f927a751b4041e99eb5ac25ddf214ec P dd62e75bd3ed4ed28f1fb5955d650808: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:32.465437  5023 catalog_manager.cc:5697] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: config changed from index 4 to 5, VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) evicted. New cstate: current_term: 2 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:32.472046  5192 raft_consensus.cc:2955] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:32.478571  6765 ts_tablet_manager.cc:1929] T 9f927a751b4041e99eb5ac25ddf214ec P dd62e75bd3ed4ed28f1fb5955d650808: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:13:32.479136  6765 log.cc:1199] T 9f927a751b4041e99eb5ac25ddf214ec P dd62e75bd3ed4ed28f1fb5955d650808: Deleting WAL directory at /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/ts-1-root/wals/9f927a751b4041e99eb5ac25ddf214ec
I20260709 12:13:32.480765  5007 catalog_manager.cc:5028] TS dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): tablet 9f927a751b4041e99eb5ac25ddf214ec (table test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]) successfully deleted
I20260709 12:13:32.486979  5108 tablet_service.cc:1558] Processing DeleteTablet for tablet 20ba878da4e3492fbdf2f90c6bb202c4 with delete_type TABLET_DATA_TOMBSTONED (TS ad2f9a1e2f7a45429fa69fd23d09f821 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:40378
I20260709 12:13:32.488835  6789 tablet_replica.cc:333] T 20ba878da4e3492fbdf2f90c6bb202c4 P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:13:32.490940  6789 raft_consensus.cc:2243] T 20ba878da4e3492fbdf2f90c6bb202c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:32.491871  6789 raft_consensus.cc:2272] T 20ba878da4e3492fbdf2f90c6bb202c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:32.495934  6789 ts_tablet_manager.cc:1916] T 20ba878da4e3492fbdf2f90c6bb202c4 P ad2f9a1e2f7a45429fa69fd23d09f821: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:32.514012  6789 ts_tablet_manager.cc:1929] T 20ba878da4e3492fbdf2f90c6bb202c4 P ad2f9a1e2f7a45429fa69fd23d09f821: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:13:32.514407  6789 log.cc:1199] T 20ba878da4e3492fbdf2f90c6bb202c4 P ad2f9a1e2f7a45429fa69fd23d09f821: Deleting WAL directory at /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/ts-0-root/wals/20ba878da4e3492fbdf2f90c6bb202c4
I20260709 12:13:32.516247  5010 catalog_manager.cc:5028] TS ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): tablet 20ba878da4e3492fbdf2f90c6bb202c4 (table test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]) successfully deleted
I20260709 12:13:32.518916  5125 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
new_leader_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:45628
I20260709 12:13:32.519645  5125 raft_consensus.cc:606] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Received request to transfer leadership to TS 9e794b72ed7640219f90ec4232363929
I20260709 12:13:32.522524  5273 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
mode: GRACEFUL
new_leader_uuid: "bce73265e27d4b30a4dcc1e491305088"
 from {username='slave'} at 127.0.0.1:42506
I20260709 12:13:32.523002  5273 raft_consensus.cc:606] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 2 LEADER]: Received request to transfer leadership to TS bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:32.525719  5192 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f34c97113147431584d6336e0d849164"
dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
mode: GRACEFUL
new_leader_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:53902
I20260709 12:13:32.526279  5192 raft_consensus.cc:606] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Received request to transfer leadership to TS 9e794b72ed7640219f90ec4232363929
I20260709 12:13:32.527570  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:13:32.528928  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:32.529560  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:32.733106  6538 raft_consensus.cc:993] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821: : Instructing follower 9e794b72ed7640219f90ec4232363929 to start an election
I20260709 12:13:32.733590  6776 raft_consensus.cc:1081] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Signalling peer 9e794b72ed7640219f90ec4232363929 to start an election
I20260709 12:13:32.735147  5270 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:34674
I20260709 12:13:32.735719  5270 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:32.735988  5270 raft_consensus.cc:3060] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:32.741212  5270 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:32.742873  5270 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:32.743695  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:32.743898  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:32.744325  5124 raft_consensus.cc:3055] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:32.744441  5192 raft_consensus.cc:3060] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:32.744603  5124 raft_consensus.cc:740] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:32.745406  5124 consensus_queue.cc:260] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:32.746376  5124 raft_consensus.cc:3060] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:32.750550  5192 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 3.
I20260709 12:13:32.751678  5237 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:32.751704  5124 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 3.
I20260709 12:13:32.752450  6774 raft_consensus.cc:2804] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:32.752913  6774 raft_consensus.cc:697] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 3 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:32.753862  6774 consensus_queue.cc:237] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:32.776024  5023 catalog_manager.cc:5697] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 2 to 3, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 3 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:32.801287  6768 raft_consensus.cc:993] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929: : Instructing follower bce73265e27d4b30a4dcc1e491305088 to start an election
I20260709 12:13:32.801754  6774 raft_consensus.cc:1081] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 2 LEADER]: Signalling peer bce73265e27d4b30a4dcc1e491305088 to start an election
I20260709 12:13:32.803279  5836 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec"
dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
 from {username='slave'} at 127.0.0.1:46088
I20260709 12:13:32.803776  5836 raft_consensus.cc:493] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:32.804126  5836 raft_consensus.cc:3060] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:32.811085  5836 raft_consensus.cc:515] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:32.813530  5836 leader_election.cc:290] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:32.814532  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:32.815130  5273 raft_consensus.cc:3055] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:32.815604  5273 raft_consensus.cc:740] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:32.816136  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:32.816735  5125 raft_consensus.cc:3060] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:32.816401  5273 consensus_queue.cc:260] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:32.817620  5273 raft_consensus.cc:3060] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:32.823992  5125 raft_consensus.cc:2468] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 3.
I20260709 12:13:32.824498  5273 raft_consensus.cc:2468] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 3.
I20260709 12:13:32.825088  5804 leader_election.cc:304] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:13:32.825549  6709 raft_consensus.cc:993] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808: : Instructing follower 9e794b72ed7640219f90ec4232363929 to start an election
I20260709 12:13:32.825961  6780 raft_consensus.cc:2804] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:32.825992  6788 raft_consensus.cc:1081] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Signalling peer 9e794b72ed7640219f90ec4232363929 to start an election
I20260709 12:13:32.826534  6780 raft_consensus.cc:697] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 3 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:13:32.827421  6780 consensus_queue.cc:237] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:32.827839  5273 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f34c97113147431584d6336e0d849164"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:34672
I20260709 12:13:32.828387  5273 raft_consensus.cc:493] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:32.828713  5273 raft_consensus.cc:3060] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:32.834892  5273 raft_consensus.cc:515] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:32.836582  5023 catalog_manager.cc:5697] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 2 to 3, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 3 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:32.837332  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:32.837615  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:32.838037  5192 raft_consensus.cc:3055] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:32.838466  5192 raft_consensus.cc:740] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:32.838119  5836 raft_consensus.cc:3060] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:32.839043  5192 consensus_queue.cc:260] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:32.840106  5192 raft_consensus.cc:3060] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:32.845068  5836 raft_consensus.cc:2468] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 2.
I20260709 12:13:32.846005  5273 leader_election.cc:290] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:32.846480  5238 leader_election.cc:304] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:13:32.847496  6774 raft_consensus.cc:2804] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:32.848002  6774 raft_consensus.cc:697] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 2 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:32.848289  5192 raft_consensus.cc:2468] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 2.
I20260709 12:13:32.849056  6774 consensus_queue.cc:237] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:32.858129  5023 catalog_manager.cc:5697] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 1 to 2, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 2 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:33.225080  5125 raft_consensus.cc:1275] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:33.226140  6780 consensus_queue.cc:1048] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:33.249935  5273 raft_consensus.cc:1275] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:33.251631  6780 consensus_queue.cc:1048] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:33.254262  5834 raft_consensus.cc:1275] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:33.257232  6768 consensus_queue.cc:1048] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:33.259992  5124 raft_consensus.cc:1275] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:33.270001  6724 consensus_queue.cc:1048] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:33.306569  5192 raft_consensus.cc:1275] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:33.308085  5199 raft_consensus.cc:1275] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:33.318194  6774 consensus_queue.cc:1048] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:33.319854  6774 consensus_queue.cc:1048] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:13:33.562078  5199 consensus_queue.cc:237] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:33.562453  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:13:33.568907  5164 consensus_peers.cc:597] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Couldn't send request to peer bce73265e27d4b30a4dcc1e491305088. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ecdd526dba8b4d84859ef5f6ee618387. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:33.569028  5270 raft_consensus.cc:1275] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:33.570120  5125 raft_consensus.cc:1275] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:13:33.570294  6745 consensus_queue.cc:1048] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:33.571467  6709 consensus_queue.cc:1048] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:33.578573  6745 raft_consensus.cc:2955] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:33.580334  5125 raft_consensus.cc:2955] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:33.601174  5122 consensus_queue.cc:237] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:33.603469  5023 catalog_manager.cc:5697] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: config changed from index -1 to 3, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New cstate: current_term: 2 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:33.602638  5268 raft_consensus.cc:2955] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
W20260709 12:13:33.614991  5089 consensus_peers.cc:597] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 -> Peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Couldn't send request to peer bce73265e27d4b30a4dcc1e491305088. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ddd16ccf58f24f6db29e5fc39a06e5c4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:33.616104  5270 raft_consensus.cc:1275] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:33.618432  5199 raft_consensus.cc:1275] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:33.620254  6790 consensus_queue.cc:1048] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:33.622649  6790 consensus_queue.cc:1048] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:13:33.637467  6811 raft_consensus.cc:2955] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:33.653595  5270 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
mode: GRACEFUL
new_leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
 from {username='slave'} at 127.0.0.1:42506
I20260709 12:13:33.655985  5270 raft_consensus.cc:606] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 2 LEADER]: Received request to transfer leadership to TS dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:33.659297  5199 raft_consensus.cc:2955] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:33.662223  5270 consensus_queue.cc:237] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:33.664631  5273 raft_consensus.cc:2955] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:33.667891  5021 catalog_manager.cc:5697] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New cstate: current_term: 1 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:33.682893  5268 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
mode: GRACEFUL
new_leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
 from {username='slave'} at 127.0.0.1:42506
I20260709 12:13:33.685777  5268 raft_consensus.cc:606] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Received request to transfer leadership to TS ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:33.688117  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:13:33.689930  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:33.690687  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:13:33.706041  5238 consensus_peers.cc:597] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 -> Peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Couldn't send request to peer bce73265e27d4b30a4dcc1e491305088. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c7bb7b814fea4a2488cc39d06fc90483. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:33.707597  5199 raft_consensus.cc:1275] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:33.708977  6801 consensus_queue.cc:1048] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:33.709887  5122 raft_consensus.cc:1275] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:13:33.715206  6801 consensus_queue.cc:1048] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:33.728344  6774 raft_consensus.cc:2955] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:33.729909  5122 raft_consensus.cc:2955] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:33.749261  5021 catalog_manager.cc:5697] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New cstate: current_term: 1 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:33.755620  5270 consensus_queue.cc:237] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:33.756548  5199 raft_consensus.cc:2955] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:33.762043  5192 raft_consensus.cc:1275] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 12:13:33.767026  5238 consensus_peers.cc:597] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 -> Peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Couldn't send request to peer bce73265e27d4b30a4dcc1e491305088. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 756d32b8c4d642a6955517f66ac5bb45. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:33.770584  5122 raft_consensus.cc:1275] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:13:33.774181  6801 consensus_queue.cc:1048] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:33.776895  6801 consensus_queue.cc:1048] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:13:33.795403  5122 raft_consensus.cc:2955] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:33.801913  6802 raft_consensus.cc:2955] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:33.818511  5019 catalog_manager.cc:5697] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: config changed from index -1 to 4, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New cstate: current_term: 3 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:33.827219  6724 raft_consensus.cc:993] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929: : Instructing follower ad2f9a1e2f7a45429fa69fd23d09f821 to start an election
I20260709 12:13:33.827796  6801 raft_consensus.cc:1081] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Signalling peer ad2f9a1e2f7a45429fa69fd23d09f821 to start an election
I20260709 12:13:33.829980  5124 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
 from {username='slave'} at 127.0.0.1:40402
I20260709 12:13:33.830518  5124 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:33.830868  5124 raft_consensus.cc:3060] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:33.842533  5124 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:33.845439  5124 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:33.846211  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:33.846243  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:33.846836  5834 raft_consensus.cc:3060] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:33.847044  5270 raft_consensus.cc:3055] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:33.850497  5270 raft_consensus.cc:740] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:33.851630  5270 consensus_queue.cc:260] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:33.856072  5199 raft_consensus.cc:2955] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:33.854401  5270 raft_consensus.cc:3060] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:33.865401  5834 raft_consensus.cc:2468] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 2.
I20260709 12:13:33.866986  5089 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:13:33.868301  6811 raft_consensus.cc:2804] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:33.869022  6811 raft_consensus.cc:697] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:33.869958  6811 consensus_queue.cc:237] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:33.872031  5270 raft_consensus.cc:2468] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 2.
I20260709 12:13:33.890746  5019 catalog_manager.cc:5697] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 1 to 2, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 2 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:33.910805  6774 raft_consensus.cc:993] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929: : Instructing follower dd62e75bd3ed4ed28f1fb5955d650808 to start an election
I20260709 12:13:33.911273  6802 raft_consensus.cc:1081] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 2 LEADER]: Signalling peer dd62e75bd3ed4ed28f1fb5955d650808 to start an election
I20260709 12:13:33.912737  5199 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4"
dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
 from {username='slave'} at 127.0.0.1:47728
I20260709 12:13:33.913282  5199 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:33.913657  5199 raft_consensus.cc:3060] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:33.920348  5199 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:33.922554  5199 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:33.923274  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:33.923873  5270 raft_consensus.cc:3055] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:33.924188  5270 raft_consensus.cc:740] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:33.924204  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:33.924861  5836 raft_consensus.cc:3060] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:33.924885  5270 consensus_queue.cc:260] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:33.926011  5270 raft_consensus.cc:3060] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:33.930609  5270 raft_consensus.cc:2468] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 3.
I20260709 12:13:33.931665  5163 leader_election.cc:304] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:33.931939  5836 raft_consensus.cc:2468] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 3.
I20260709 12:13:33.932417  6745 raft_consensus.cc:2804] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:33.932822  6745 raft_consensus.cc:697] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:33.933673  6745 consensus_queue.cc:237] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:33.956475  5019 catalog_manager.cc:5697] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 2 to 3, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 3 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:34.080302  6824 ts_tablet_manager.cc:933] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088: Initiating tablet copy from peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443)
I20260709 12:13:34.103525  6826 ts_tablet_manager.cc:933] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088: Initiating tablet copy from peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:34.106169  6824 tablet_copy_client.cc:323] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Beginning tablet copy session from remote peer at address 127.3.212.129:34443
I20260709 12:13:34.108750  5135 tablet_copy_service.cc:140] P ad2f9a1e2f7a45429fa69fd23d09f821: Received BeginTabletCopySession request for tablet ddd16ccf58f24f6db29e5fc39a06e5c4 from peer bce73265e27d4b30a4dcc1e491305088 ({username='slave'} at 127.0.0.1:59390)
I20260709 12:13:34.109330  5135 tablet_copy_service.cc:161] P ad2f9a1e2f7a45429fa69fd23d09f821: Beginning new tablet copy session on tablet ddd16ccf58f24f6db29e5fc39a06e5c4 from peer bce73265e27d4b30a4dcc1e491305088 at {username='slave'} at 127.0.0.1:59390: session id = bce73265e27d4b30a4dcc1e491305088-ddd16ccf58f24f6db29e5fc39a06e5c4
I20260709 12:13:34.120164  5135 tablet_copy_source_session.cc:215] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:34.123699  6828 ts_tablet_manager.cc:933] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088: Initiating tablet copy from peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:34.123965  6824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddd16ccf58f24f6db29e5fc39a06e5c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:34.124084  6826 tablet_copy_client.cc:323] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Beginning tablet copy session from remote peer at address 127.3.212.130:44455
I20260709 12:13:34.125993  5210 tablet_copy_service.cc:140] P dd62e75bd3ed4ed28f1fb5955d650808: Received BeginTabletCopySession request for tablet ecdd526dba8b4d84859ef5f6ee618387 from peer bce73265e27d4b30a4dcc1e491305088 ({username='slave'} at 127.0.0.1:41416)
I20260709 12:13:34.126564  5210 tablet_copy_service.cc:161] P dd62e75bd3ed4ed28f1fb5955d650808: Beginning new tablet copy session on tablet ecdd526dba8b4d84859ef5f6ee618387 from peer bce73265e27d4b30a4dcc1e491305088 at {username='slave'} at 127.0.0.1:41416: session id = bce73265e27d4b30a4dcc1e491305088-ecdd526dba8b4d84859ef5f6ee618387
I20260709 12:13:34.127151  6828 tablet_copy_client.cc:323] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Beginning tablet copy session from remote peer at address 127.3.212.131:46709
I20260709 12:13:34.131300  5284 tablet_copy_service.cc:140] P 9e794b72ed7640219f90ec4232363929: Received BeginTabletCopySession request for tablet c7bb7b814fea4a2488cc39d06fc90483 from peer bce73265e27d4b30a4dcc1e491305088 ({username='slave'} at 127.0.0.1:50932)
I20260709 12:13:34.131868  5284 tablet_copy_service.cc:161] P 9e794b72ed7640219f90ec4232363929: Beginning new tablet copy session on tablet c7bb7b814fea4a2488cc39d06fc90483 from peer bce73265e27d4b30a4dcc1e491305088 at {username='slave'} at 127.0.0.1:50932: session id = bce73265e27d4b30a4dcc1e491305088-c7bb7b814fea4a2488cc39d06fc90483
I20260709 12:13:34.142630  6824 tablet_copy_client.cc:806] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:34.143380  6824 tablet_copy_client.cc:670] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:34.147586  6824 tablet_copy_client.cc:538] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:34.147648  5284 tablet_copy_source_session.cc:215] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:34.148018  5210 tablet_copy_source_session.cc:215] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:34.153546  6828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7bb7b814fea4a2488cc39d06fc90483. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:34.160900  6826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecdd526dba8b4d84859ef5f6ee618387. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:34.170908  6824 tablet_bootstrap.cc:492] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088: Bootstrap starting.
I20260709 12:13:34.182780  6826 tablet_copy_client.cc:806] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:34.183596  6826 tablet_copy_client.cc:670] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:34.183518  6830 ts_tablet_manager.cc:933] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088: Initiating tablet copy from peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:34.201357  6828 tablet_copy_client.cc:806] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:34.202068  6828 tablet_copy_client.cc:670] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:34.209453  6828 tablet_copy_client.cc:538] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:34.220790  6828 tablet_bootstrap.cc:492] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088: Bootstrap starting.
I20260709 12:13:34.222105  6826 tablet_copy_client.cc:538] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:34.242170  6826 tablet_bootstrap.cc:492] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088: Bootstrap starting.
I20260709 12:13:34.246008  6830 tablet_copy_client.cc:323] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Beginning tablet copy session from remote peer at address 127.3.212.131:46709
I20260709 12:13:34.248099  5284 tablet_copy_service.cc:140] P 9e794b72ed7640219f90ec4232363929: Received BeginTabletCopySession request for tablet 756d32b8c4d642a6955517f66ac5bb45 from peer bce73265e27d4b30a4dcc1e491305088 ({username='slave'} at 127.0.0.1:50932)
I20260709 12:13:34.248663  5284 tablet_copy_service.cc:161] P 9e794b72ed7640219f90ec4232363929: Beginning new tablet copy session on tablet 756d32b8c4d642a6955517f66ac5bb45 from peer bce73265e27d4b30a4dcc1e491305088 at {username='slave'} at 127.0.0.1:50932: session id = bce73265e27d4b30a4dcc1e491305088-756d32b8c4d642a6955517f66ac5bb45
I20260709 12:13:34.266886  5284 tablet_copy_source_session.cc:215] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:34.278358  6824 tablet_bootstrap.cc:492] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:34.280412  6824 tablet_bootstrap.cc:492] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088: Bootstrap complete.
I20260709 12:13:34.282219  6824 ts_tablet_manager.cc:1403] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088: Time spent bootstrapping tablet: real 0.112s	user 0.025s	sys 0.030s
I20260709 12:13:34.286592  6824 raft_consensus.cc:359] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:34.296082  6824 raft_consensus.cc:740] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Initialized, Role: LEARNER
I20260709 12:13:34.295698  6828 tablet_bootstrap.cc:492] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:34.298241  6828 tablet_bootstrap.cc:492] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088: Bootstrap complete.
I20260709 12:13:34.299089  6828 ts_tablet_manager.cc:1403] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088: Time spent bootstrapping tablet: real 0.079s	user 0.027s	sys 0.003s
I20260709 12:13:34.302701  6828 raft_consensus.cc:359] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:34.296904  6824 consensus_queue.cc:260] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:34.310173  6824 ts_tablet_manager.cc:1434] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088: Time spent starting tablet: real 0.027s	user 0.003s	sys 0.004s
I20260709 12:13:34.310779  6828 raft_consensus.cc:740] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Initialized, Role: LEARNER
I20260709 12:13:34.311607  6828 consensus_queue.cc:260] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:34.314630  6828 ts_tablet_manager.cc:1434] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:13:34.316216  5135 tablet_copy_service.cc:342] P ad2f9a1e2f7a45429fa69fd23d09f821: Request end of tablet copy session bce73265e27d4b30a4dcc1e491305088-ddd16ccf58f24f6db29e5fc39a06e5c4 received from {username='slave'} at 127.0.0.1:59390
I20260709 12:13:34.316731  5135 tablet_copy_service.cc:434] P ad2f9a1e2f7a45429fa69fd23d09f821: ending tablet copy session bce73265e27d4b30a4dcc1e491305088-ddd16ccf58f24f6db29e5fc39a06e5c4 on tablet ddd16ccf58f24f6db29e5fc39a06e5c4 with peer bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:34.324482  6830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 756d32b8c4d642a6955517f66ac5bb45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:34.325793  5284 tablet_copy_service.cc:342] P 9e794b72ed7640219f90ec4232363929: Request end of tablet copy session bce73265e27d4b30a4dcc1e491305088-c7bb7b814fea4a2488cc39d06fc90483 received from {username='slave'} at 127.0.0.1:50932
I20260709 12:13:34.326308  5284 tablet_copy_service.cc:434] P 9e794b72ed7640219f90ec4232363929: ending tablet copy session bce73265e27d4b30a4dcc1e491305088-c7bb7b814fea4a2488cc39d06fc90483 on tablet c7bb7b814fea4a2488cc39d06fc90483 with peer bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:34.430780  5836 raft_consensus.cc:1275] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:34.447364  5836 raft_consensus.cc:1275] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:34.449239  6818 consensus_queue.cc:1048] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:34.458865  6745 consensus_queue.cc:1048] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:34.506865  5268 raft_consensus.cc:1275] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:34.509805  6818 consensus_queue.cc:1048] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:13:34.525847  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 65139.7us
I20260709 12:13:34.528112  5836 raft_consensus.cc:1217] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:34.533048  5268 raft_consensus.cc:1275] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:34.550666  6709 consensus_queue.cc:1048] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:34.741302  5836 raft_consensus.cc:1217] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:13:34.750108  6826 tablet_bootstrap.cc:492] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:13:34.787453  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 237045us
W20260709 12:13:34.827193  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 271043us
W20260709 12:13:34.858146  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 66804.3us
W20260709 12:13:34.876930  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 330421us
I20260709 12:13:34.909031  6826 tablet_bootstrap.cc:492] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088: Bootstrap complete.
I20260709 12:13:35.835350  6826 ts_tablet_manager.cc:1403] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088: Time spent bootstrapping tablet: real 1.593s	user 0.141s	sys 0.244s
W20260709 12:13:35.751106  5088 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.002s	sys 0.000s
W20260709 12:13:35.756999  5089 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.002s	sys 0.000s
I20260709 12:13:35.849846  6877 raft_consensus.cc:493] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:35.857013  6880 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:35.857730  6811 raft_consensus.cc:493] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:35.858124  6878 raft_consensus.cc:493] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:35.858645  5273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34672 (request call id 1521) took 1002 ms. Trace:
I20260709 12:13:35.859890  6879 raft_consensus.cc:493] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:35.853125  6863 raft_consensus.cc:493] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:35.878396  5194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47728 (request call id 1615) took 1050 ms. Trace:
I20260709 12:13:35.878969  5194 rpcz_store.cc:276] 0709 12:13:34.827612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:34.832768 (+  5156us) service_pool.cc:224] Handling call
0709 12:13:35.856200 (+1023432us) spinlock_profiling.cc:243] Waited 3.44 ms on lock 0x7b58000b3d98. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb9cfc0 00007f84ebb87929 00007f84ebb873d2 00007f84e50febd4
0709 12:13:35.856683 (+   483us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:35.857227 (+   544us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:35.857258 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:35.857316 (+    58us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:13:35.861210 (+  3894us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:35.868928 (+  7718us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:35.878168 (+  9240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7907712}
I20260709 12:13:35.137218  6830 tablet_copy_client.cc:806] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:35.848497  6862 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:35.880412  6877 raft_consensus.cc:515] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:35.881757  6830 tablet_copy_client.cc:670] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:35.881542  6862 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:35.882438  5198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41416 (request call id 211) took 1003 ms. Trace:
I20260709 12:13:35.882930  5198 rpcz_store.cc:276] 0709 12:13:34.879071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:34.879259 (+   188us) service_pool.cc:224] Handling call
0709 12:13:35.881000 (+1001741us) spinlock_profiling.cc:243] Waited 4.96 ms on lock 0x7b58000b3d98. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb9cfc0 00007f84ebb87929 00007f84ebb873d2 00007f84e50febd4
0709 12:13:35.881468 (+   468us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:35.881857 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:35.881885 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:35.881951 (+    66us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:35.881979 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:35.882036 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:35.882208 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11406592}
I20260709 12:13:35.884575  6877 leader_election.cc:290] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:35.884878  6862 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:13:35.870529  5089 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.784s	user 0.002s	sys 0.013s
W20260709 12:13:35.870776  5088 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.004s	sys 0.011s
I20260709 12:13:35.868252  5273 rpcz_store.cc:276] 0709 12:13:34.855737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:34.856541 (+   804us) service_pool.cc:224] Handling call
0709 12:13:34.856858 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:34.857040 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:34.857067 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:34.857107 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:13:34.857135 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:34.857202 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:35.858371 (+1001169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:35.858283  6870 raft_consensus.cc:493] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:35.885358  6877 raft_consensus.cc:493] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:35.885821  6811 raft_consensus.cc:515] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:35.937991  6882 raft_consensus.cc:493] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:35.878763  6863 raft_consensus.cc:515] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:35.939479  6874 raft_consensus.cc:493] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:35.939498  6870 raft_consensus.cc:515] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:35.940392  6879 raft_consensus.cc:515] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:35.941097  6881 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:35.886180  6880 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:35.978250  6780 raft_consensus.cc:493] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:35.978899  6861 raft_consensus.cc:493] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:35.982568  6818 raft_consensus.cc:493] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:35.886476  6878 raft_consensus.cc:515] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:35.979302  6780 raft_consensus.cc:515] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:35.983711  6818 raft_consensus.cc:515] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:35.990799  6863 leader_election.cc:290] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:35.990159  6874 raft_consensus.cc:515] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:35.997884  6882 raft_consensus.cc:515] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:36.012753  6874 leader_election.cc:290] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:36.013065  6882 leader_election.cc:290] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:13:36.014509  6840 log.cc:927] Time spent T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 1.377s	user 0.008s	sys 0.005s
I20260709 12:13:36.016227  6868 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:36.016286  6818 leader_election.cc:290] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:35.997154  6877 raft_consensus.cc:515] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:35.998194  6893 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:36.028506  6852 raft_consensus.cc:493] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:36.026110  6880 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:35.980046  6861 raft_consensus.cc:515] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:36.028518  6892 raft_consensus.cc:493] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:36.054227  6883 raft_consensus.cc:493] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:36.060065  6901 raft_consensus.cc:493] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:35.998189  6881 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:36.051856  6887 raft_consensus.cc:493] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:36.065151  6876 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:36.065613  6893 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:36.063126  6780 leader_election.cc:290] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:36.043967  6852 raft_consensus.cc:515] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:36.057437  6874 raft_consensus.cc:493] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:36.055173  6883 raft_consensus.cc:515] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:36.055689  6884 raft_consensus.cc:493] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:36.060917  6901 raft_consensus.cc:515] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:36.077936  6900 raft_consensus.cc:493] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:36.085842  6838 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:36.086179  6835 raft_consensus.cc:493] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:36.086575  6838 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:36.065187  6891 raft_consensus.cc:493] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:36.085537  6780 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:36.105720  6838 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:36.105836  6883 leader_election.cc:290] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:36.077791  6872 raft_consensus.cc:493] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:36.091425  6878 leader_election.cc:290] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:36.124379  6893 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:36.089532  6884 raft_consensus.cc:515] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:36.088232  6874 raft_consensus.cc:515] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:36.083104  6892 raft_consensus.cc:515] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:36.147491  6780 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:36.128134  6887 raft_consensus.cc:515] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:36.148828  6878 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:36.149478  6870 leader_election.cc:290] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:36.084897  6900 raft_consensus.cc:515] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:36.168290  6874 leader_election.cc:290] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:36.168200  6839 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:36.168562  6894 raft_consensus.cc:493] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:36.155125  6811 leader_election.cc:290] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:36.078380  6868 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:36.174034  5199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47728 (request call id 1616) took 1245 ms. Trace:
I20260709 12:13:36.119869  6876 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:36.164907  6862 raft_consensus.cc:493] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:36.176193  5199 rpcz_store.cc:276] 0709 12:13:34.849009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:34.849127 (+   118us) service_pool.cc:224] Handling call
0709 12:13:36.066852 (+1217725us) spinlock_profiling.cc:243] Waited 4.67 ms on lock 0x7b58000b3d98. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb9cfc0 00007f84ebb87929 00007f84ebb873d2 00007f84e50febd4
0709 12:13:36.075290 (+  8438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:36.090646 (+ 15356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:36.090678 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:36.092814 (+  2136us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:13:36.092854 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:36.092915 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:36.094454 (+  1539us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10745088}
I20260709 12:13:36.177599  6780 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:36.184656  6852 leader_election.cc:290] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:36.185186  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:36.186481  6836 raft_consensus.cc:493] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:36.169720  6879 leader_election.cc:290] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:36.149581  6891 raft_consensus.cc:515] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:36.088225  6835 raft_consensus.cc:515] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:36.183606  6893 raft_consensus.cc:493] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:36.166019  6865 raft_consensus.cc:493] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:36.179623  6839 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:36.178730  6870 raft_consensus.cc:493] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:36.203584  6873 raft_consensus.cc:493] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:36.182276  6864 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:36.190837  6852 raft_consensus.cc:493] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:36.202426  6839 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:36.188921  6836 raft_consensus.cc:515] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:36.210318  6876 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:36.211231  6861 leader_election.cc:290] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:36.195904  6881 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:13:36.252002  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 141353us
I20260709 12:13:36.252810  6887 leader_election.cc:290] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:36.253408  6887 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:36.254076  6887 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:36.256259  6887 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:36.205922  6873 raft_consensus.cc:515] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:36.211611  6907 raft_consensus.cc:493] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:36.247166  6881 raft_consensus.cc:493] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:36.269842  6900 leader_election.cc:290] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:36.271119  6868 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:36.248162  6864 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:13:36.272706  6850 log.cc:927] Time spent T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 1.416s	user 0.008s	sys 0.027s
I20260709 12:13:36.247406  6878 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:36.236296  6862 raft_consensus.cc:515] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:36.192493  6872 raft_consensus.cc:515] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:36.249907  6893 raft_consensus.cc:515] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:36.248816  6894 raft_consensus.cc:515] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:36.458874  6883 raft_consensus.cc:493] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:36.281431  6892 leader_election.cc:290] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:36.321830  6835 leader_election.cc:290] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:36.460310  6883 raft_consensus.cc:515] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:36.288013  6852 raft_consensus.cc:515] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:36.266403  6870 raft_consensus.cc:515] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:36.323071  6884 leader_election.cc:290] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:36.447710  6876 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:36.318063  6897 raft_consensus.cc:493] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:36.320160  6881 raft_consensus.cc:515] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:36.457858  6861 raft_consensus.cc:493] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:36.467530  6900 raft_consensus.cc:493] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:36.465720  6873 leader_election.cc:290] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:36.466957  6839 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:36.467101  6868 raft_consensus.cc:493] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:36.498076  6891 leader_election.cc:290] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:13:36.498277  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 285205us
I20260709 12:13:36.493824  6836 leader_election.cc:290] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:36.498390  6873 raft_consensus.cc:493] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:36.498261  6896 raft_consensus.cc:493] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:36.485177  6887 raft_consensus.cc:493] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:36.273557  6826 raft_consensus.cc:359] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:36.276919  6865 raft_consensus.cc:515] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:36.318902  6907 raft_consensus.cc:515] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:36.502751  6892 raft_consensus.cc:493] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:36.520098  6908 raft_consensus.cc:493] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:36.520285  6911 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:36.522079  6891 raft_consensus.cc:493] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:36.514645  6826 raft_consensus.cc:740] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Initialized, Role: LEARNER
I20260709 12:13:36.520973  6908 raft_consensus.cc:515] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:36.519032  6839 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:36.521133  6911 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:36.517284  6897 raft_consensus.cc:515] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:36.621205  6870 leader_election.cc:290] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:36.544392  6872 leader_election.cc:290] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:36.598961  6910 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
W20260709 12:13:36.531257  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 405787us
I20260709 12:13:36.519454  6868 raft_consensus.cc:515] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:36.696539  6893 leader_election.cc:290] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:36.691915  6818 raft_consensus.cc:493] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:36.600392  6878 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:36.630517  6862 leader_election.cc:290] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:36.656576  6881 leader_election.cc:290] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:36.640403  6883 leader_election.cc:290] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:36.528781  6873 raft_consensus.cc:515] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:36.567898  6880 raft_consensus.cc:493] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:36.530102  6861 raft_consensus.cc:515] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:36.708014  6910 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:36.547156  6887 raft_consensus.cc:515] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:36.522282  6876 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:36.728998  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 289589us
I20260709 12:13:36.594095  6851 raft_consensus.cc:493] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:36.526551  6899 raft_consensus.cc:493] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:36.546563  6900 raft_consensus.cc:515] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:36.656432  6852 leader_election.cc:290] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:36.791832  6837 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:36.792564  6839 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:36.793265  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:36.630440  6907 leader_election.cc:290] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:36.794409  6861 leader_election.cc:290] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:36.619513  6864 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:36.593909  6892 raft_consensus.cc:515] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:36.739981  6865 leader_election.cc:290] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:36.761224  6835 raft_consensus.cc:493] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:36.710830  6894 leader_election.cc:290] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:36.810319  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:36.812340  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:36.813707  6862 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
W20260709 12:13:36.809314  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 46616.9us
I20260709 12:13:36.817564  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:36.817728  6838 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:36.820456  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:36.820613  6914 raft_consensus.cc:493] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:36.823055  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:36.796695  6818 raft_consensus.cc:515] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:36.794569  6891 raft_consensus.cc:515] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:36.798096  6878 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:36.800784  6851 raft_consensus.cc:515] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:36.833755  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:36.803654  6918 raft_consensus.cc:493] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:36.810846  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:36.785266  6920 raft_consensus.cc:493] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:36.838788  5197 raft_consensus.cc:2468] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 1.
I20260709 12:13:36.825304  6908 leader_election.cc:290] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:36.817966  6836 raft_consensus.cc:493] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:36.819578  6907 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:36.849237  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:36.762399  6826 consensus_queue.cc:260] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:36.867188  6914 raft_consensus.cc:515] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:36.803778  6837 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:36.546875  6896 raft_consensus.cc:515] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:36.839344  6880 raft_consensus.cc:515] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:37.006671  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:36.868273  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:36.898896  5125 raft_consensus.cc:2468] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 1.
I20260709 12:13:36.867240  6838 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:37.009004  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:13:37.015240  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 123123us
I20260709 12:13:37.006079  6818 leader_election.cc:290] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:37.007057  6892 leader_election.cc:290] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:36.944199  6862 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:37.045773  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:37.004786  6897 leader_election.cc:290] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:37.014726  6802 raft_consensus.cc:493] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:36.879058  6835 raft_consensus.cc:515] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:36.966889  6836 raft_consensus.cc:515] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:36.966167  6878 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:37.011242  6907 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:36.966640  6918 raft_consensus.cc:515] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:36.899784  6920 raft_consensus.cc:515] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:36.893730  6899 raft_consensus.cc:515] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:37.272367  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:37.109122  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:37.256930  6880 leader_election.cc:290] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:37.249019  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:37.224674  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:13:37.157874  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 100208us
I20260709 12:13:37.202137  6916 raft_consensus.cc:493] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:37.281755  5199 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
I20260709 12:13:37.288662  6862 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:37.110992  6768 raft_consensus.cc:493] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:37.281967  6848 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:37.290650  6851 leader_election.cc:290] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:37.290727  5191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47728 (request call id 1617) took 2400 ms. Trace:
I20260709 12:13:37.245654  5193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 1567) took 2275 ms. Trace:
I20260709 12:13:37.147975  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:37.291647  6802 raft_consensus.cc:515] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:37.098315  6898 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:37.293644  5117 raft_consensus.cc:2468] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 3.
I20260709 12:13:37.225912  6914 leader_election.cc:290] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:37.272312  6826 ts_tablet_manager.cc:1434] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088: Time spent starting tablet: real 1.436s	user 0.015s	sys 0.027s
I20260709 12:13:37.320773  5193 rpcz_store.cc:276] 0709 12:13:34.964637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:34.965178 (+   541us) service_pool.cc:224] Handling call
0709 12:13:37.239365 (+2274187us) spinlock_profiling.cc:243] Waited 4.98 ms on lock 0x7b58000b3d98. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb9cfc0 00007f84ebb87929 00007f84ebb873d2 00007f84e50febd4
0709 12:13:37.239711 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:37.239948 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:37.239972 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:37.240015 (+    43us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:13:37.240043 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:37.240097 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:37.240224 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11451136}
I20260709 12:13:37.271854  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:37.320518  5191 rpcz_store.cc:276] 0709 12:13:34.890291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:35.790856 (+900565us) service_pool.cc:224] Handling call
0709 12:13:37.289840 (+1498984us) spinlock_profiling.cc:243] Waited 5.11 ms on lock 0x7b58000b3d98. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb9cfc0 00007f84ebb87929 00007f84ebb873d2 00007f84e50febd4
0709 12:13:37.290083 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:37.290286 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:37.290313 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:37.290371 (+    58us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:13:37.290399 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:37.290449 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:37.290569 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11761920}
I20260709 12:13:37.134419  6870 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:37.294584  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:37.111852  6873 leader_election.cc:290] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:37.048069  6868 leader_election.cc:290] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:37.251682  6896 leader_election.cc:290] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:37.252156  6910 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:37.112068  6876 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:37.142246  6891 leader_election.cc:290] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:37.081873  6887 leader_election.cc:290] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:37.251682  6838 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:37.057636  6908 raft_consensus.cc:493] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:37.081846  6852 raft_consensus.cc:493] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:37.257599  6877 leader_election.cc:290] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:13:37.416463  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 93808.8us
I20260709 12:13:37.202401  6922 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:37.381207  5837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46100 (request call id 638) took 1531 ms. Trace:
I20260709 12:13:37.226174  6837 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:37.249713  6911 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:37.413141  6870 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:37.423488  6868 raft_consensus.cc:493] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:37.434710  6868 raft_consensus.cc:515] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:37.435559  6870 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:37.411805  6896 raft_consensus.cc:493] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:37.423033  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:37.436619  6896 raft_consensus.cc:515] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:37.437067  6868 leader_election.cc:290] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:37.424445  5837 rpcz_store.cc:276] 0709 12:13:35.849653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:35.857552 (+  7899us) service_pool.cc:224] Handling call
0709 12:13:37.380694 (+1523142us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b540043ed28. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ebaecaa1 00007f84ebb67ebc 00007f84ebb9d08c 00007f84ebb8793b 00007f84ebb873d2 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c
0709 12:13:37.381024 (+   330us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":409318144}
I20260709 12:13:37.320060  6839 raft_consensus.cc:493] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:37.369527  5198 raft_consensus.cc:2468] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
I20260709 12:13:37.418305  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:13:37.408147  6826 ts_tablet_manager.cc:1467] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088: Tablet startup took 1572ms
I20260709 12:13:37.421209  6851 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:37.423601  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:37.411981  5194 raft_consensus.cc:2468] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
I20260709 12:13:37.377852  6802 leader_election.cc:290] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:37.442476  6862 raft_consensus.cc:493] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:37.456490  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:37.456734  6862 raft_consensus.cc:515] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:37.457937  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:37.375953  6848 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:37.447597  6911 raft_consensus.cc:493] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:37.448045  6894 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:37.423444  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:37.421519  6924 raft_consensus.cc:493] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:37.449519  6922 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:37.450672  6839 raft_consensus.cc:515] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:37.457243  5018 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58198 (request call id 323) took 2630 ms. Trace:
I20260709 12:13:37.437469  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:37.465951  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:37.465672  6911 raft_consensus.cc:515] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:37.460772  6851 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:37.378886  6768 raft_consensus.cc:515] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:37.461862  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:37.423004  6852 raft_consensus.cc:515] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:37.466668  6905 raft_consensus.cc:493] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:37.466280  6906 raft_consensus.cc:493] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:37.376262  6898 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:37.465778  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:37.494951  6906 raft_consensus.cc:515] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:37.528986  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:37.530015  5123 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 2.
I20260709 12:13:37.428822  6900 leader_election.cc:290] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:37.542958  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:37.543426  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:37.469900  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:37.477656  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:37.702479  5273 raft_consensus.cc:2468] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 2.
I20260709 12:13:37.476902  5018 rpcz_store.cc:276] 0709 12:13:34.826502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:34.826664 (+   162us) service_pool.cc:224] Handling call
0709 12:13:36.285851 (+1459187us) spinlock_profiling.cc:243] Waited 30.5 ms on lock 0x7b540026ff54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2d090 00007f84e6bcbf3a 00007f84ec981e9c 00007f84eca8004e 00007f84eaf412a4 00007f84eaf41232 00007f84eaf41161 00007f84eaf410dc 00007f84eaf40392 00007f84e4efe48c 00007f84e4efd8c6
0709 12:13:37.457000 (+1171149us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":70056320}
I20260709 12:13:37.479097  5119 raft_consensus.cc:2468] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 1.
I20260709 12:13:37.442204  6908 raft_consensus.cc:515] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:37.486548  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 182518us
I20260709 12:13:37.415225  6916 raft_consensus.cc:515] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:37.720845  5833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46100 (request call id 645) took 1028 ms. Trace:
I20260709 12:13:37.473290  6848 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:37.771579  5832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46100 (request call id 640) took 1147 ms. Trace:
I20260709 12:13:37.772111  5832 rpcz_store.cc:276] 0709 12:13:36.587024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:36.598780 (+ 11756us) service_pool.cc:224] Handling call
0709 12:13:36.639326 (+ 40546us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:36.710465 (+ 71139us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:36.710499 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:36.710561 (+    62us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:13:36.710595 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:37.722903 (+1012308us) spinlock_profiling.cc:243] Waited 65 ms on lock 0x7b54003d2f54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:13:37.722943 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:37.734707 (+ 11764us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":149594496}
I20260709 12:13:37.495961  6901 leader_election.cc:290] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:37.476066  6894 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:37.774909  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:37.735692  5833 rpcz_store.cc:276] 0709 12:13:36.699243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:36.728625 (+ 29382us) service_pool.cc:224] Handling call
0709 12:13:37.469903 (+741278us) spinlock_profiling.cc:243] Waited 7.92 ms on lock 0x7b58000b0498. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb890a0 00007f84ebb88984 00007f84e51036d4 00007f84e5103662
0709 12:13:37.720740 (+250837us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18225920}
I20260709 12:13:37.842859  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:37.845026  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:37.845580  6768 leader_election.cc:290] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:37.846654  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:37.846823  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:37.845165  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:37.848320  5124 raft_consensus.cc:2468] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 1.
I20260709 12:13:37.861867  6836 leader_election.cc:290] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:37.863481  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:37.863649  6878 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:37.773401  6774 raft_consensus.cc:493] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:37.791554  6907 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:37.787009  6905 raft_consensus.cc:515] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:37.875901  6774 raft_consensus.cc:515] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:37.876468  6905 leader_election.cc:290] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:37.877096  5834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46100 (request call id 641) took 1157 ms. Trace:
I20260709 12:13:37.849306  6896 leader_election.cc:290] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:37.815634  6920 leader_election.cc:290] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:37.877513  5834 rpcz_store.cc:276] 0709 12:13:36.635493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:36.639018 (+  3525us) service_pool.cc:224] Handling call
0709 12:13:36.639375 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:37.005853 (+366478us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:37.005886 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:37.005938 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:37.005965 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:37.786873 (+780908us) spinlock_profiling.cc:243] Waited 366 ms on lock 0x7b5400775bd4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:13:37.786921 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:37.787029 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":842197760}
I20260709 12:13:37.868089  6848 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:37.881054  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:37.885110  5832 raft_consensus.cc:2468] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 2.
I20260709 12:13:37.882920  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:37.891993  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:37.894017  6922 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:37.883564  6852 leader_election.cc:290] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:37.895769  6839 leader_election.cc:290] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:37.880039  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:37.898809  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:37.896557  5200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47728 (request call id 1618) took 2100 ms. Trace:
I20260709 12:13:37.899966  5200 rpcz_store.cc:276] 0709 12:13:35.785566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:35.791624 (+  6058us) service_pool.cc:224] Handling call
0709 12:13:37.868175 (+2076551us) spinlock_profiling.cc:243] Waited 4.59 ms on lock 0x7b58000b3d98. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb9cfc0 00007f84ebb87929 00007f84ebb873d2 00007f84e50febd4
0709 12:13:37.878173 (+  9998us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:37.881946 (+  3773us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:37.881977 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:37.885691 (+  3714us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:13:37.885730 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:37.885798 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:37.885900 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10547584}
I20260709 12:13:37.725214  6924 raft_consensus.cc:515] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:37.890652  5240 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:13:37.906929  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:37.907184  5195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 1566) took 2942 ms. Trace:
I20260709 12:13:37.907599  5195 rpcz_store.cc:276] 0709 12:13:34.964285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:34.970667 (+  6382us) service_pool.cc:224] Handling call
0709 12:13:37.868141 (+2897474us) spinlock_profiling.cc:243] Waited 3.16 ms on lock 0x7b58000b3d98. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb9cfc0 00007f84ebb87929 00007f84ebb873d2 00007f84e50febd4
0709 12:13:37.901872 (+ 33731us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:37.906722 (+  4850us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:37.906759 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:37.906801 (+    42us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:13:37.906831 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:37.906892 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:37.907029 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7271680}
I20260709 12:13:37.881618  6899 leader_election.cc:290] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:37.937688  6851 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:37.938246  5240 leader_election.cc:304] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:13:37.939057  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:37.889716  6918 leader_election.cc:290] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:37.887718  6916 leader_election.cc:290] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:37.884064  6848 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:37.904685  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:13:38.122251  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 99974.6us
I20260709 12:13:38.199681  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:38.271894  5194 raft_consensus.cc:2468] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 2.
I20260709 12:13:38.272620  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:38.272845  5804 leader_election.cc:304] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:13:38.198992  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:38.198303  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:38.273718  6900 raft_consensus.cc:2804] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:38.201856  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:38.275076  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:38.140995  6835 leader_election.cc:290] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:38.275972  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:38.277032  5198 raft_consensus.cc:2468] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 1.
I20260709 12:13:37.994794  6911 leader_election.cc:290] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:37.941563  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:37.902738  6774 leader_election.cc:290] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:38.283509  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:38.271006  5837 raft_consensus.cc:2468] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 1.
I20260709 12:13:38.283505  5267 raft_consensus.cc:2468] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 2.
I20260709 12:13:38.274245  6862 leader_election.cc:290] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:38.235124  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:38.274077  5195 raft_consensus.cc:2468] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 1.
I20260709 12:13:38.285763  6920 raft_consensus.cc:493] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:38.287530  6920 raft_consensus.cc:515] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:38.288342  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:38.288801  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:38.289677  6920 leader_election.cc:290] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:38.035274  6905 raft_consensus.cc:2804] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:38.290325  6906 leader_election.cc:290] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:38.291013  6905 raft_consensus.cc:493] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:38.291589  6905 raft_consensus.cc:3060] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:37.993535  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:38.202965  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:38.282033  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:38.283051  6898 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:38.309820  5196 raft_consensus.cc:2468] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 2.
I20260709 12:13:38.309957  6908 leader_election.cc:290] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:38.310113  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:38.310839  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:38.310761  5125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40386 (request call id 1434) took 1029 ms. Trace:
I20260709 12:13:38.288968  5267 raft_consensus.cc:2468] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 1.
I20260709 12:13:38.294384  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:37.993628  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:38.276008  5273 raft_consensus.cc:2468] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 2.
I20260709 12:13:38.312386  5266 raft_consensus.cc:2468] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 2.
I20260709 12:13:38.285660  6848 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:38.296125  5831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46100 (request call id 647) took 1264 ms. Trace:
I20260709 12:13:38.293197  5122 raft_consensus.cc:2468] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 2.
I20260709 12:13:38.312865  5804 leader_election.cc:304] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:13:37.942440  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:38.299845  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:38.311566  5125 rpcz_store.cc:276] 0709 12:13:37.281434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:37.281598 (+   164us) service_pool.cc:224] Handling call
0709 12:13:37.293109 (+ 11511us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:37.338532 (+ 45423us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:37.338562 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:37.375371 (+ 36809us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:13:37.375448 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:38.310526 (+935078us) spinlock_profiling.cc:243] Waited 25.6 ms on lock 0x7b540024a254. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:13:38.310573 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:38.310686 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58923776}
I20260709 12:13:37.945974  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:13:37.443821  6826 ts_tablet_manager.cc:1469] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088: Trace:
0709 12:13:34.082604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:34.091068 (+  8464us) service_pool.cc:224] Handling call
0709 12:13:34.104220 (+ 13152us) ts_tablet_manager.cc:934] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088: Initiating tablet copy from peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
0709 12:13:34.159637 (+ 55417us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:13:34.171471 (+ 11834us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:34.171839 (+   368us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:13:34.181597 (+  9758us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:13:34.181902 (+   305us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:34.182207 (+   305us) ts_tablet_manager.cc:989] Replica registered.
0709 12:13:34.182283 (+    76us) inbound_call.cc:177] Queueing success response
0709 12:13:34.241787 (+ 59504us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:13:35.836266 (+1594479us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:13:35.866116 (+ 29850us) tablet_replica.cc:261] Starting instrumentation
0709 12:13:36.034313 (+168197us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":281,"mutex_wait_us":38759,"raft.queue_time_us":37352,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":37373,"tablet-copy.queue_time_us":11888,"tablet-download-pool.queue_time_us":168,"tablet-download-pool.run_cpu_time_us":1240,"tablet-download-pool.run_wall_time_us":12905,"thread_start_us":30517,"threads_started":2}
I20260709 12:13:37.916256  6856 raft_consensus.cc:2804] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:38.282716  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:38.283356  5833 raft_consensus.cc:2468] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 1.
I20260709 12:13:38.219664  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:38.273825  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:38.271914  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:38.305579  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:38.199396  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:37.945608  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:38.308068  5019 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50918 (request call id 221) took 3504 ms. Trace:
I20260709 12:13:38.274241  6900 raft_consensus.cc:493] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:38.314713  5831 rpcz_store.cc:276] 0709 12:13:37.031849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:37.035007 (+  3158us) service_pool.cc:224] Handling call
0709 12:13:37.082316 (+ 47309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:37.788920 (+706604us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:37.790614 (+  1694us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:37.843634 (+ 53020us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:13:37.848345 (+  4711us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:38.295843 (+447498us) spinlock_profiling.cc:243] Waited 642 ms on lock 0x7b5400655ed4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:13:38.295892 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:38.296059 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1475851648}
I20260709 12:13:38.326010  6898 raft_consensus.cc:493] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:38.326946  6898 raft_consensus.cc:515] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:38.327271  6908 raft_consensus.cc:2804] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:38.327697  6908 raft_consensus.cc:493] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:38.327847  6900 raft_consensus.cc:3060] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.328109  6908 raft_consensus.cc:3060] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:38.326152  5019 rpcz_store.cc:276] 0709 12:13:34.788325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:34.788452 (+   127us) service_pool.cc:224] Handling call
0709 12:13:36.733553 (+1945101us) spinlock_profiling.cc:243] Waited 1.07 ms on lock 0x7b540026ff54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2d090 00007f84e6bcbf3a 00007f84ec981e9c 00007f84eca8004e 00007f84eaf412a4 00007f84eaf41232 00007f84eaf41161 00007f84eaf410dc 00007f84eaf40392 00007f84e4efe48c 00007f84e4efd8c6
0709 12:13:38.292858 (+1559305us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":166888,"reported_tablets":1,"spinlock_wait_cycles":2459008}
I20260709 12:13:38.333129  5166 leader_election.cc:304] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:38.308813  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:38.325986  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:38.334614  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:38.335146  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:38.335506  6898 leader_election.cc:290] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:38.335835  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:38.336581  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:38.337715  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:38.309046  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:38.336915  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:38.294274  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:37.981137  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:38.339866  5834 raft_consensus.cc:2468] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 2.
W20260709 12:13:37.994212  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 56041.1us
I20260709 12:13:38.341048  6836 raft_consensus.cc:2804] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:38.341476  6836 raft_consensus.cc:493] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:38.341837  6836 raft_consensus.cc:3060] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.314674  5836 raft_consensus.cc:2468] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 1.
I20260709 12:13:37.944056  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:38.317976  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:38.318588  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:38.319162  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:38.282126  6894 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:38.320658  5832 raft_consensus.cc:2468] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 2.
I20260709 12:13:38.323448  5193 raft_consensus.cc:2468] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 2.
I20260709 12:13:38.324361  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:38.337836  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:38.222012  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:38.337707  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:38.320313  6856 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:38.346570  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:38.345738  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:38.299904  6924 leader_election.cc:290] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:38.339211  5199 raft_consensus.cc:2468] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 2.
I20260709 12:13:38.346125  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:38.351292  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:38.351086  5266 raft_consensus.cc:2468] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 1.
I20260709 12:13:38.352191  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:38.350334  5274 raft_consensus.cc:2468] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 2.
I20260709 12:13:38.349959  5270 raft_consensus.cc:2468] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 3.
I20260709 12:13:38.346253  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:13:38.356454  5121 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59390 (request call id 267) took 1654 ms (client timeout 1698 ms). Trace:
I20260709 12:13:38.357641  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:38.357784  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:13:38.356876  5121 rpcz_store.cc:269] 0709 12:13:36.705127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:37.377623 (+672496us) service_pool.cc:224] Handling call
0709 12:13:38.345924 (+968301us) spinlock_profiling.cc:243] Waited 3.89 ms on lock 0x7b5800002a98. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb890a0 00007f84ebb88984 00007f84e51036d4 00007f84e5103662
0709 12:13:38.356371 (+ 10447us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9092480}
I20260709 12:13:38.366046  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:38.368821  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:38.371928  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:38.352448  6856 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.350178  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:38.376071  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:38.377033  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:38.378531  5270 raft_consensus.cc:2468] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 4.
I20260709 12:13:38.380653  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:38.381907  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:38.382578  5119 raft_consensus.cc:2468] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 2.
I20260709 12:13:38.387987  5192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47728 (request call id 1613) took 3561 ms. Trace:
I20260709 12:13:38.388444  5192 rpcz_store.cc:276] 0709 12:13:34.826957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:34.827956 (+   999us) service_pool.cc:224] Handling call
0709 12:13:36.789527 (+1961571us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b58000b3d98. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9ee9c 00007f84e3a9ea5b 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb9cfc0 00007f84ebb87929 00007f84ebb873d2 00007f84e50febd4
0709 12:13:36.789859 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:37.378426 (+588567us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:37.378460 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:37.378506 (+    46us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:13:37.378533 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:38.387630 (+1009097us) spinlock_profiling.cc:243] Waited 528 ms on lock 0x7b5400038ed4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:13:38.387712 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:38.387832 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1238427392}
I20260709 12:13:38.391642  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:38.388520  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:38.373860  6890 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:38.395900  6890 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:38.397234  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:38.398510  6890 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:38.405285  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:38.408386  6848 raft_consensus.cc:493] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:38.406046  5240 leader_election.cc:304] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:13:38.439872  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:38.440927  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:38.441628  5266 raft_consensus.cc:2468] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 1.
I20260709 12:13:38.442507  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:38.445542  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:38.446688  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:38.383276  6919 raft_consensus.cc:493] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:38.403585  5272 raft_consensus.cc:2468] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 2.
I20260709 12:13:38.408064  6862 raft_consensus.cc:493] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:38.449931  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:38.450485  5123 raft_consensus.cc:2468] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 1.
I20260709 12:13:38.452697  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:38.457304  5166 leader_election.cc:304] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:38.456698  6879 raft_consensus.cc:493] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:38.467376  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:38.468792  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:38.466580  6879 raft_consensus.cc:515] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:38.451067  6885 raft_consensus.cc:2804] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:38.480863  6885 raft_consensus.cc:493] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:38.480990  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:38.481649  5193 raft_consensus.cc:2468] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 1.
I20260709 12:13:38.509599  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:38.471057  5088 leader_election.cc:304] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:38.511955  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:38.512243  6907 raft_consensus.cc:2749] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:38.458504  6848 raft_consensus.cc:515] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:38.513777  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:38.521730  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:38.522044  6911 raft_consensus.cc:2804] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:38.522327  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:38.464790  6919 raft_consensus.cc:515] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:38.524178  6908 raft_consensus.cc:515] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:38.529511  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 64423.3us
I20260709 12:13:38.529932  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:38.530575  6879 leader_election.cc:290] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:38.531832  6905 raft_consensus.cc:515] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:13:38.532564  5801 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.212.130:44455 timed out after 1.509s (SENT) [suppressed 2 similar messages]
I20260709 12:13:38.533125  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:38.542884  6911 raft_consensus.cc:493] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:38.590695  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:38.591174  6911 raft_consensus.cc:3060] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.591631  6836 raft_consensus.cc:515] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:38.592307  5210 tablet_copy_service.cc:342] P dd62e75bd3ed4ed28f1fb5955d650808: Request end of tablet copy session bce73265e27d4b30a4dcc1e491305088-ecdd526dba8b4d84859ef5f6ee618387 received from {username='slave'} at 127.0.0.1:41416
I20260709 12:13:38.592914  5210 tablet_copy_service.cc:434] P dd62e75bd3ed4ed28f1fb5955d650808: ending tablet copy session bce73265e27d4b30a4dcc1e491305088-ecdd526dba8b4d84859ef5f6ee618387 on tablet ecdd526dba8b4d84859ef5f6ee618387 with peer bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:38.533835  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:38.532902  6900 raft_consensus.cc:515] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:38.481330  6885 raft_consensus.cc:3060] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.465767  6862 raft_consensus.cc:515] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:38.600610  6862 leader_election.cc:290] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:38.563894  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:38.522063  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:38.584968  5088 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:38.586118  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:38.601598  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:38.567903  5164 leader_election.cc:304] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:38.587090  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:38.589365  6856 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:38.596971  5198 raft_consensus.cc:2393] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 2: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:38.609524  5164 leader_election.cc:304] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:38.602217  5838 raft_consensus.cc:2468] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 1.
I20260709 12:13:38.610648  5164 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
W20260709 12:13:38.620097  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 162863us
I20260709 12:13:38.621223  5166 leader_election.cc:304] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:38.623489  5164 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:38.622931  5166 leader_election.cc:304] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:38.612860  6894 raft_consensus.cc:2804] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:38.638989  5088 leader_election.cc:304] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:38.647010  5088 leader_election.cc:304] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:38.648963  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:38.621593  6920 raft_consensus.cc:2804] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:38.621831  6915 raft_consensus.cc:2804] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:38.654362  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:38.631914  6862 raft_consensus.cc:2804] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:38.658774  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:38.660710  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:38.662652  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:38.663651  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:38.664255  5835 raft_consensus.cc:2468] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 1.
I20260709 12:13:38.664475  6856 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:38.666054  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:38.667999  5266 raft_consensus.cc:2468] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 3.
I20260709 12:13:38.668129  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:38.648377  6894 raft_consensus.cc:493] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:38.653687  6866 raft_consensus.cc:2804] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:38.652926  6920 raft_consensus.cc:493] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:38.675218  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:38.656612  6915 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:38.661609  6918 raft_consensus.cc:2804] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:38.676600  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:38.664692  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:38.665815  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:38.677191  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:38.659904  6862 raft_consensus.cc:493] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:38.671545  6835 raft_consensus.cc:2804] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:38.682255  5832 raft_consensus.cc:2468] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 2.
W20260709 12:13:38.676182  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 162987us
I20260709 12:13:38.673799  6894 raft_consensus.cc:3060] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.673092  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:38.673972  6866 raft_consensus.cc:493] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:38.672655  6848 leader_election.cc:290] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:38.678246  6920 raft_consensus.cc:3060] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.674481  6907 raft_consensus.cc:2804] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:38.693125  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:13:38.685539  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 62129.4us
I20260709 12:13:38.685539  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:38.724064  5164 leader_election.cc:304] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:38.676744  6915 raft_consensus.cc:3060] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:38.722821  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:38.727311  5164 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:38.678720  6918 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:38.729358  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:38.730060  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:38.730319  6919 leader_election.cc:290] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:38.731328  6900 leader_election.cc:290] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:38.756198  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:38.731914  6908 leader_election.cc:290] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:38.756548  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:38.757296  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:38.732697  6911 raft_consensus.cc:515] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:38.736596  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:38.737679  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:38.737238  6890 raft_consensus.cc:2804] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:38.763965  6890 raft_consensus.cc:493] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:38.764555  6890 raft_consensus.cc:3060] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.739595  6935 raft_consensus.cc:2804] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:38.765993  6935 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:38.766574  6935 raft_consensus.cc:3060] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.767072  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:38.767650  5122 raft_consensus.cc:1240] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:38.744058  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:38.744335  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:38.747172  6907 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:38.773270  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:38.683959  6836 leader_election.cc:290] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:38.685755  6862 raft_consensus.cc:3060] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.758268  6918 raft_consensus.cc:3060] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:38.726349  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:38.799155  5196 raft_consensus.cc:1240] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:38.753669  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:38.716460  6930 raft_consensus.cc:2749] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:38.732507  6905 leader_election.cc:290] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:38.761682  5830 raft_consensus.cc:1240] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:38.766073  6911 leader_election.cc:290] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:38.782078  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:38.722054  6866 raft_consensus.cc:3060] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:38.788231  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:38.685141  6835 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:38.789081  5801 leader_election.cc:304] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:38.796231  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:38.796438  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:38.736871  6885 raft_consensus.cc:515] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:38.791551  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 126571us
I20260709 12:13:38.805266  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:38.805269  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:38.778468  6907 raft_consensus.cc:3060] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.808911  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:38.822311  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:38.822986  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
W20260709 12:13:38.824132  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 160364us
I20260709 12:13:38.824407  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:38.824147  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:38.807392  5835 raft_consensus.cc:1217] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:13:38.806864  6872 consensus_queue.cc:1059] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:13:38.825973  5194 raft_consensus.cc:2468] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 2.
I20260709 12:13:38.815958  5125 raft_consensus.cc:2468] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 1.
I20260709 12:13:38.819579  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:38.825145  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:38.818711  5237 leader_election.cc:304] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:38.821762  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:38.806505  5804 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:13:38.843739  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:38.829133  5197 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 1.
I20260709 12:13:38.821456  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:38.847353  6935 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:38.829162  5089 leader_election.cc:304] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:13:38.850363  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 44032.7us
I20260709 12:13:38.852733  5237 leader_election.cc:304] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:38.818720  6900 raft_consensus.cc:2804] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:38.854456  5237 leader_election.cc:304] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:38.854775  6881 raft_consensus.cc:2749] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:38.855414  6924 raft_consensus.cc:2749] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:38.852916  6852 raft_consensus.cc:2804] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:38.858497  6852 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:38.858852  6852 raft_consensus.cc:3060] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.849503  5801 leader_election.cc:304] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:38.817512  6835 raft_consensus.cc:3060] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.861187  5089 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:38.870529  5801 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:38.873450  6936 raft_consensus.cc:2804] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:38.874007  6936 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:38.874425  6936 raft_consensus.cc:3060] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.873320  6909 raft_consensus.cc:2804] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:38.876596  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:38.875527  5197 raft_consensus.cc:1240] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:38.877179  5198 raft_consensus.cc:3060] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.878655  5089 leader_election.cc:304] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:13:38.878165  5804 leader_election.cc:304] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:38.854866  6905 raft_consensus.cc:2804] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:38.885826  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:38.887250  6938 raft_consensus.cc:2804] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:38.887813  6938 raft_consensus.cc:493] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:38.888211  6938 raft_consensus.cc:3060] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.855903  6900 raft_consensus.cc:493] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:38.876417  6908 raft_consensus.cc:2749] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:38.876502  6909 raft_consensus.cc:493] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:38.913902  6909 raft_consensus.cc:3060] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:38.923237  5089 leader_election.cc:304] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:38.912353  6900 raft_consensus.cc:3060] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:38.926026  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 68514.2us
I20260709 12:13:38.927356  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:38.860496  6911 raft_consensus.cc:2804] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:38.952286  5088 leader_election.cc:304] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:38.891392  6905 raft_consensus.cc:493] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:38.933282  6911 raft_consensus.cc:493] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
W20260709 12:13:38.961571  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 105375us
I20260709 12:13:38.942829  6896 raft_consensus.cc:2804] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:38.943264  6903 raft_consensus.cc:2749] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:38.966590  5237 leader_election.cc:304] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:38.958694  5088 leader_election.cc:304] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:13:38.974239  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 96139.2us
I20260709 12:13:38.957279  6905 raft_consensus.cc:3060] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:38.981742  5801 leader_election.cc:304] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:38.964807  6911 raft_consensus.cc:3060] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:38.987291  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 138710us
I20260709 12:13:38.987217  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:38.988420  5801 leader_election.cc:304] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:38.967646  6896 raft_consensus.cc:493] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:39.001586  5801 leader_election.cc:304] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:39.003669  6898 raft_consensus.cc:2749] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:39.004441  6830 tablet_copy_client.cc:538] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:39.004784  6945 raft_consensus.cc:3060] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.007160  5801 leader_election.cc:304] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:39.009150  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:39.012023  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:39.007040  6943 raft_consensus.cc:2749] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:38.986959  6942 raft_consensus.cc:2804] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:13:39.067860  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 109222us
I20260709 12:13:39.007241  6896 raft_consensus.cc:3060] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.072463  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:39.071983  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:39.013648  6908 raft_consensus.cc:2749] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:39.005635  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:39.068966  5088 leader_election.cc:304] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:39.015316  6898 raft_consensus.cc:2804] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:39.069859  6924 raft_consensus.cc:2804] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:39.017827  6942 raft_consensus.cc:493] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:38.997757  6890 raft_consensus.cc:515] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:39.113482  6935 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:39.158718  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:39.163662  5835 raft_consensus.cc:2468] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 1.
I20260709 12:13:39.141948  6898 raft_consensus.cc:493] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:39.151769  6942 raft_consensus.cc:3060] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:39.148095  6924 raft_consensus.cc:493] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
W20260709 12:13:39.179216  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 167965us
W20260709 12:13:39.191479  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 122559us
I20260709 12:13:39.181056  6898 raft_consensus.cc:3060] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.204774  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:39.190927  6924 raft_consensus.cc:3060] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.180275  6946 raft_consensus.cc:2749] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:39.211570  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:39.211761  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:39.194480  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:39.211692  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:39.217839  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:39.218007  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:39.221715  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:39.224676  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:39.200985  6890 leader_election.cc:290] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:39.228435  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:39.222985  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:13:39.233575  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 222764us
I20260709 12:13:39.235070  5801 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:39.239132  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:39.239791  5838 raft_consensus.cc:2468] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 2.
I20260709 12:13:39.242403  5801 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:39.247939  5801 leader_election.cc:304] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:39.239022  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:39.236521  6944 raft_consensus.cc:2804] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:39.276315  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:13:39.282424  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 80425.9us
I20260709 12:13:39.284173  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:39.260807  6944 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:39.284834  5832 raft_consensus.cc:2468] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 2.
I20260709 12:13:39.285769  5088 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:39.290159  6862 raft_consensus.cc:515] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:39.251106  6894 raft_consensus.cc:515] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:39.301492  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 113757us
W20260709 12:13:39.281788  6920 consensus_meta.cc:287] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.511s	user 0.011s	sys 0.005s
W20260709 12:13:39.303896  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 56042.7us
I20260709 12:13:39.304895  5801 leader_election.cc:304] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:13:39.305969  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 328898us
I20260709 12:13:39.308600  5199 raft_consensus.cc:1240] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:39.309988  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:39.295428  6944 raft_consensus.cc:3060] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:39.298818  6929 raft_consensus.cc:2804] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:39.311667  5237 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:39.312191  5801 leader_election.cc:304] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:39.321979  5237 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:39.323238  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:39.293937  6950 raft_consensus.cc:2749] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:39.325304  5237 leader_election.cc:304] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:13:39.306722  6915 consensus_meta.cc:287] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.555s	user 0.003s	sys 0.011s
I20260709 12:13:39.309289  6920 raft_consensus.cc:515] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:39.312608  6918 consensus_meta.cc:287] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.507s	user 0.000s	sys 0.017s
I20260709 12:13:39.303406  6879 raft_consensus.cc:2749] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:39.310899  6848 raft_consensus.cc:2749] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:39.349218  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:39.349949  5837 raft_consensus.cc:2468] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 1.
I20260709 12:13:39.352178  6950 raft_consensus.cc:2804] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:39.352604  6950 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:39.352950  6950 raft_consensus.cc:3060] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:39.325078  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:39.326746  6929 raft_consensus.cc:493] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:39.314486  6872 consensus_queue.cc:1059] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:13:39.355342  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:39.358681  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:39.359629  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:13:39.359936  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 72899.1us
I20260709 12:13:39.367583  5836 raft_consensus.cc:1240] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:39.316561  6900 raft_consensus.cc:515] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:39.357486  6881 raft_consensus.cc:2804] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:39.357743  6889 raft_consensus.cc:2749] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:39.367035  6929 raft_consensus.cc:3060] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.347743  6918 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:39.392168  5834 raft_consensus.cc:1240] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:39.393172  5088 leader_election.cc:304] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:39.379766  6881 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
W20260709 12:13:39.397146  5198 consensus_meta.cc:287] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.512s	user 0.005s	sys 0.019s
I20260709 12:13:39.345847  6915 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:39.397528  5198 raft_consensus.cc:2468] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 2.
I20260709 12:13:39.356916  6951 raft_consensus.cc:2749] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:39.375675  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:39.373360  6942 raft_consensus.cc:515] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:39.401309  5088 leader_election.cc:304] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:39.394659  6881 raft_consensus.cc:3060] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:39.410385  5088 leader_election.cc:304] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:39.411728  5089 leader_election.cc:304] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
W20260709 12:13:39.423275  6938 consensus_meta.cc:287] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.535s	user 0.017s	sys 0.008s
I20260709 12:13:39.404275  6818 raft_consensus.cc:2804] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:39.426318  5088 leader_election.cc:304] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:39.424229  6894 leader_election.cc:290] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:39.407644  6947 raft_consensus.cc:2749] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:39.404971  6956 raft_consensus.cc:3055] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:39.435415  5193 raft_consensus.cc:1240] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:39.428342  6818 raft_consensus.cc:493] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:39.446681  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:39.447256  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
W20260709 12:13:39.450625  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 125391us
I20260709 12:13:39.465852  5237 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:39.428247  6879 raft_consensus.cc:2749] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:39.475135  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:39.461905  6818 raft_consensus.cc:3060] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:39.464285  6942 leader_election.cc:290] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:39.451287  6956 raft_consensus.cc:740] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:39.480307  5238 leader_election.cc:304] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:39.429169  6938 raft_consensus.cc:515] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:39.495432  6958 raft_consensus.cc:2749] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:13:39.428994  6965 consensus_queue.cc:1059] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
W20260709 12:13:39.496408  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 84175.3us
I20260709 12:13:39.472131  6951 raft_consensus.cc:2804] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:39.431195  6961 raft_consensus.cc:2749] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:39.502230  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:39.502537  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:39.502977  5274 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 2.
I20260709 12:13:39.503074  5238 leader_election.cc:304] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:39.506604  5238 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:13:39.499949  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 155499us
I20260709 12:13:39.498066  6872 raft_consensus.cc:2749] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:39.540321  6872 raft_consensus.cc:2749] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:39.531277  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:39.542100  5238 leader_election.cc:304] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:39.496045  6888 raft_consensus.cc:3055] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:13:39.513859  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 102181us
I20260709 12:13:39.545825  5163 leader_election.cc:304] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:39.523005  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:39.553577  5270 raft_consensus.cc:2393] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 2: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
W20260709 12:13:39.514015  6909 consensus_meta.cc:287] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.600s	user 0.011s	sys 0.000s
I20260709 12:13:39.556509  5163 leader_election.cc:304] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:39.546921  6888 raft_consensus.cc:740] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:39.531940  6900 leader_election.cc:290] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:39.511871  6889 raft_consensus.cc:2749] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:39.502120  6951 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:39.546227  6918 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:39.554728  6894 raft_consensus.cc:2804] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:39.568344  5088 leader_election.cc:304] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:39.562273  6915 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:39.559665  6875 raft_consensus.cc:493] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:39.581200  5801 leader_election.cc:304] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:39.582580  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:39.585825  6856 raft_consensus.cc:2749] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:39.586058  6898 raft_consensus.cc:515] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:39.587211  5124 raft_consensus.cc:1240] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:39.589757  6938 leader_election.cc:290] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:39.593483  5120 raft_consensus.cc:1240] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:39.574476  6894 raft_consensus.cc:493] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:39.603632  6894 raft_consensus.cc:3060] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:39.603957  6898 leader_election.cc:290] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:39.604630  5836 raft_consensus.cc:1240] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:39.572765  6951 raft_consensus.cc:3060] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.601715  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:39.596992  6875 raft_consensus.cc:515] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:39.607365  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:39.582731  6965 raft_consensus.cc:2749] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:39.599493  5122 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
new_leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
 from {username='slave'} at 127.0.0.1:45628
W20260709 12:13:39.610458  6866 consensus_meta.cc:287] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.792s	user 0.010s	sys 0.010s
I20260709 12:13:39.616189  5122 raft_consensus.cc:606] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Received request to transfer leadership to TS dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:39.595041  6918 raft_consensus.cc:2749] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:39.562758  6909 raft_consensus.cc:515] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:39.608143  6888 consensus_queue.cc:260] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:39.608253  5801 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:39.629061  6888 raft_consensus.cc:3060] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:39.629212  6936 consensus_meta.cc:287] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.754s	user 0.017s	sys 0.000s
I20260709 12:13:39.628648  5088 leader_election.cc:304] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:39.629707  6936 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:39.633764  6830 tablet_bootstrap.cc:492] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088: Bootstrap starting.
I20260709 12:13:39.607043  6963 raft_consensus.cc:2749] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:39.646216  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:13:39.655571  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 54649.1us
I20260709 12:13:39.670189  5801 leader_election.cc:304] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:39.672526  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:39.676239  5801 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:13:39.676649  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 134625us
I20260709 12:13:39.677551  5238 leader_election.cc:304] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:39.623191  6866 raft_consensus.cc:515] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:39.680681  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:39.667567  6918 raft_consensus.cc:2804] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:39.578280  6956 consensus_queue.cc:260] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:39.668992  6963 raft_consensus.cc:2749] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:39.698227  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:39.700326  6973 raft_consensus.cc:2749] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:39.703931  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:39.715899  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
W20260709 12:13:39.681785  6852 consensus_meta.cc:287] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.823s	user 0.013s	sys 0.008s
I20260709 12:13:39.681543  6936 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:39.680601  6908 raft_consensus.cc:2749] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:39.649719  6938 consensus_queue.cc:1059] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:13:39.766431  5164 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:39.700842  5238 leader_election.cc:304] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:39.674908  6952 raft_consensus.cc:2749] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:39.768081  5801 leader_election.cc:304] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:39.768349  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
W20260709 12:13:39.769837  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 213402us
I20260709 12:13:39.769972  5195 raft_consensus.cc:1240] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:39.674749  6957 consensus_queue.cc:1059] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 12:13:39.774768  5269 raft_consensus.cc:1240] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:39.850323  5124 raft_consensus.cc:1240] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 3. Current term is 4. Ops: []
W20260709 12:13:39.850946  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 150168us
I20260709 12:13:39.644622  6944 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:39.779084  5837 raft_consensus.cc:1240] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:39.779932  6885 leader_election.cc:290] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:13:39.782099  6905 consensus_meta.cc:287] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.782s	user 0.006s	sys 0.009s
W20260709 12:13:39.786473  6924 consensus_meta.cc:287] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.567s	user 0.009s	sys 0.000s
I20260709 12:13:39.703752  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:39.788663  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:39.789705  5118 raft_consensus.cc:1240] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 3. Current term is 4. Ops: []
W20260709 12:13:39.823079  6907 consensus_meta.cc:287] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.973s	user 0.016s	sys 0.012s
W20260709 12:13:39.844973  5237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:39.829787  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 63549us
I20260709 12:13:39.851940  5238 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:13:39.788463  6835 consensus_meta.cc:287] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.911s	user 0.005s	sys 0.014s
W20260709 12:13:39.852906  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 84914.4us
I20260709 12:13:39.866294  5801 leader_election.cc:304] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:13:39.788162  6896 consensus_meta.cc:287] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.663s	user 0.009s	sys 0.002s
I20260709 12:13:39.856678  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:39.768736  6918 raft_consensus.cc:697] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:39.873812  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:39.874135  6972 raft_consensus.cc:2749] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:39.862303  6924 raft_consensus.cc:515] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:39.853336  6852 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:39.876421  6924 leader_election.cc:290] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:39.876955  6852 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:39.877755  6957 consensus_queue.cc:1059] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:39.880236  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:39.881023  5837 raft_consensus.cc:2393] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 2: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:13:39.881285  6958 raft_consensus.cc:3055] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:39.881685  6958 raft_consensus.cc:740] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:39.856591  6905 raft_consensus.cc:515] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:39.847926  6971 raft_consensus.cc:2749] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:39.867980  5196 raft_consensus.cc:1240] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:39.868788  5838 raft_consensus.cc:1240] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:39.868750  5164 leader_election.cc:304] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:39.889986  6890 raft_consensus.cc:2749] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:39.886970  6956 raft_consensus.cc:3060] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:39.870816  5238 leader_election.cc:304] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:39.883872  5124 raft_consensus.cc:1240] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:39.892136  5237 leader_election.cc:304] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:39.892848  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:39.893702  6856 raft_consensus.cc:2749] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:39.868525  6907 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:39.894783  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:39.854514  6964 raft_consensus.cc:2749] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:39.870332  5801 leader_election.cc:304] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:39.896116  5198 raft_consensus.cc:1240] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:39.868022  5163 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:39.899078  5163 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:39.899449  5238 leader_election.cc:304] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:39.845255  6975 consensus_queue.cc:1059] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 12:13:39.872618  6973 raft_consensus.cc:2804] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:39.902529  5238 leader_election.cc:304] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:13:39.889024  6945 consensus_meta.cc:287] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.884s	user 0.008s	sys 0.003s
I20260709 12:13:39.906473  5801 leader_election.cc:304] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:39.894345  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:39.897538  6974 consensus_queue.cc:1059] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.074s
I20260709 12:13:39.910218  6907 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:39.910658  6905 leader_election.cc:290] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:39.911090  6939 consensus_queue.cc:1059] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:13:39.885542  6900 raft_consensus.cc:2749] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:39.914283  6920 leader_election.cc:290] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:39.923903  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:39.923156  6940 raft_consensus.cc:2749] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:39.923902  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:39.887320  6896 raft_consensus.cc:515] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:39.923151  6976 raft_consensus.cc:2749] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:39.923338  6969 raft_consensus.cc:3055] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:39.926420  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:39.928323  5801 leader_election.cc:304] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:13:39.901638  6911 consensus_meta.cc:287] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.891s	user 0.005s	sys 0.010s
I20260709 12:13:39.931265  5163 leader_election.cc:304] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:13:39.932379  6950 consensus_meta.cc:287] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.574s	user 0.010s	sys 0.000s
I20260709 12:13:39.932531  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:39.934769  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:39.935017  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:39.935268  6907 raft_consensus.cc:2749] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:39.936189  6950 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:39.928354  6945 raft_consensus.cc:2749] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:39.872092  6835 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:39.937680  5832 raft_consensus.cc:1240] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:39.916301  6951 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:39.941030  6950 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:39.934975  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:39.948698  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:39.939273  6898 raft_consensus.cc:2749] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:39.922027  6973 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:39.949749  6973 raft_consensus.cc:3060] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:39.950151  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:39.940838  6958 consensus_queue.cc:260] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:39.942793  5118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40402 (request call id 1690) took 1183 ms. Trace:
I20260709 12:13:39.955080  6907 raft_consensus.cc:2749] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:39.943770  6896 leader_election.cc:290] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:39.932255  6963 consensus_queue.cc:1059] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:39.905268  6889 raft_consensus.cc:2749] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:39.946647  5164 leader_election.cc:304] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:39.972344  6963 raft_consensus.cc:3055] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:39.972857  6963 raft_consensus.cc:740] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:13:39.948071  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:39.973982  6862 leader_election.cc:290] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:39.938071  6911 raft_consensus.cc:515] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:39.973711  6963 consensus_queue.cc:260] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:39.972450  6924 raft_consensus.cc:2804] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:39.953167  5268 raft_consensus.cc:1240] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:39.975404  6924 raft_consensus.cc:493] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:39.975889  6924 raft_consensus.cc:3060] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:39.977118  6963 raft_consensus.cc:3060] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:39.937899  6969 raft_consensus.cc:740] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:39.921026  6909 leader_election.cc:290] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:39.953904  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:39.955214  5118 rpcz_store.cc:276] 0709 12:13:38.759263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:38.766975 (+  7712us) service_pool.cc:224] Handling call
0709 12:13:38.767308 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:39.865580 (+1098272us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:39.942520 (+ 76940us) spinlock_profiling.cc:243] Waited 967 ms on lock 0x7b54003edd54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:13:39.942708 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2224640256}
I20260709 12:13:39.984596  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:39.984809  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:39.957351  6939 raft_consensus.cc:3055] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:39.985941  6939 raft_consensus.cc:740] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:39.986032  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:39.986799  6862 raft_consensus.cc:2749] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:39.987258  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:39.987076  6939 consensus_queue.cc:260] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
W20260709 12:13:39.988780  6881 consensus_meta.cc:287] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.565s	user 0.002s	sys 0.009s
I20260709 12:13:39.989240  6881 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:39.990087  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:39.991431  6881 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:39.993510  6980 consensus_queue.cc:1059] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.092s
I20260709 12:13:39.960958  6920 raft_consensus.cc:1064] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808: attempting to promote NON_VOTER bce73265e27d4b30a4dcc1e491305088 to VOTER
I20260709 12:13:39.994570  6935 raft_consensus.cc:3055] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:13:39.994918  6929 consensus_meta.cc:287] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.594s	user 0.010s	sys 0.000s
I20260709 12:13:39.994994  6935 raft_consensus.cc:740] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:39.995441  6929 raft_consensus.cc:515] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:39.996270  6935 consensus_queue.cc:260] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:39.874197  6918 consensus_queue.cc:237] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:39.964746  6866 leader_election.cc:290] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:39.974345  6835 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:40.000777  6980 consensus_queue.cc:1059] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:13:39.929579  6943 raft_consensus.cc:2749] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:39.975893  6911 leader_election.cc:290] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:39.974913  5125 raft_consensus.cc:1240] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:39.975349  5200 raft_consensus.cc:1240] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:40.003191  6920 consensus_queue.cc:237] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:40.004333  6835 raft_consensus.cc:3055] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:40.004722  6835 raft_consensus.cc:740] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:39.979453  6969 consensus_queue.cc:260] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:40.005980  6835 consensus_queue.cc:260] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:40.006286  6969 raft_consensus.cc:3060] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:40.006860  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
W20260709 12:13:39.971261  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 68883.4us
I20260709 12:13:40.007833  5164 leader_election.cc:304] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:40.008378  5238 leader_election.cc:304] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:39.983495  5237 leader_election.cc:304] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:39.996955  5833 raft_consensus.cc:2393] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 2: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:13:39.962580  6944 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:40.014840  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
W20260709 12:13:40.011526  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 338530us
I20260709 12:13:39.997509  6958 raft_consensus.cc:3060] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:40.001943  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:39.966678  6818 raft_consensus.cc:515] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:40.018267  6951 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:40.016026  5196 raft_consensus.cc:3060] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:40.020406  5122 raft_consensus.cc:1240] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:39.971182  5163 leader_election.cc:304] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:40.012754  5238 leader_election.cc:304] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:39.920027  6852 raft_consensus.cc:2749] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:40.015213  6974 raft_consensus.cc:2749] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:40.035550  5834 raft_consensus.cc:1240] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:40.036672  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:40.030159  6862 raft_consensus.cc:2749] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:40.018471  5166 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:40.028595  6975 raft_consensus.cc:2804] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:40.042244  6975 raft_consensus.cc:493] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:40.042485  5166 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:40.007059  6889 consensus_queue.cc:1059] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:40.044265  6889 raft_consensus.cc:3055] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:40.044669  6889 raft_consensus.cc:740] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:40.045696  6889 consensus_queue.cc:260] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:40.047189  6889 raft_consensus.cc:3060] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:40.018980  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:40.048527  5198 raft_consensus.cc:3060] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:40.021670  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:40.022855  5238 leader_election.cc:304] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:40.016808  6835 raft_consensus.cc:3060] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:40.023526  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 52452us
I20260709 12:13:40.055495  5238 leader_election.cc:304] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:40.055688  5163 leader_election.cc:304] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:39.977856  6894 raft_consensus.cc:515] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:40.024966  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:40.027526  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:40.042562  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:40.042244  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:40.057474  5163 leader_election.cc:304] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:40.016981  6939 raft_consensus.cc:3060] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:40.059418  5163 leader_election.cc:304] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:40.059744  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:40.060038  5238 leader_election.cc:304] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:40.015340  6881 raft_consensus.cc:2749] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:40.061846  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:40.075657  5199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47728 (request call id 1639) took 1287 ms. Trace:
I20260709 12:13:40.063511  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:40.063692  6894 leader_election.cc:290] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:40.064930  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:40.059289  6976 raft_consensus.cc:2749] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:40.065529  6971 raft_consensus.cc:2749] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:40.034322  6932 raft_consensus.cc:2749] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:40.066205  6956 raft_consensus.cc:2749] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:40.066814  6905 raft_consensus.cc:3055] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:40.067822  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:40.081017  6953 raft_consensus.cc:493] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:40.080896  6959 consensus_queue.cc:1059] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:13:40.082289  6953 raft_consensus.cc:515] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:40.059010  6974 raft_consensus.cc:2749] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:40.059435  6862 raft_consensus.cc:2749] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:40.020107  6818 leader_election.cc:290] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:40.080956  6937 raft_consensus.cc:2749] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:40.071244  5163 leader_election.cc:304] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:40.075778  5237 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:40.076172  5199 rpcz_store.cc:276] 0709 12:13:38.789725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:38.800231 (+ 10506us) service_pool.cc:224] Handling call
0709 12:13:38.808786 (+  8555us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:39.311704 (+502918us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:40.075436 (+763732us) spinlock_profiling.cc:243] Waited 500 ms on lock 0x7b54001388d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:13:40.075602 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1148999424}
I20260709 12:13:40.042642  6975 raft_consensus.cc:3060] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:40.077180  5238 leader_election.cc:304] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:40.078639  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:40.079732  5120 raft_consensus.cc:1240] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:40.032472  6951 consensus_queue.cc:1059] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:13:40.082634  6959 raft_consensus.cc:3055] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:40.068099  6942 raft_consensus.cc:3055] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:40.083439  5192 raft_consensus.cc:1240] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:40.079017  6872 raft_consensus.cc:2749] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:40.093359  5237 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:40.094772  5163 leader_election.cc:304] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:40.096992  5163 leader_election.cc:304] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:40.095723  6835 raft_consensus.cc:2749] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:40.096160  6940 raft_consensus.cc:2749] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:40.097846  6862 raft_consensus.cc:2749] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:40.098973  5163 leader_election.cc:304] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:40.083668  6905 raft_consensus.cc:740] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:40.105628  5199 raft_consensus.cc:1240] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:40.097630  6894 raft_consensus.cc:2749] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:40.090884  6929 leader_election.cc:290] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:40.103714  6856 raft_consensus.cc:2749] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:40.092252  6959 raft_consensus.cc:740] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:40.109717  5830 raft_consensus.cc:1240] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:40.093868  6942 raft_consensus.cc:740] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:40.101941  6862 raft_consensus.cc:2749] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:40.120501  5198 raft_consensus.cc:2468] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 4.
I20260709 12:13:40.124584  6872 raft_consensus.cc:1064] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929: attempting to promote NON_VOTER bce73265e27d4b30a4dcc1e491305088 to VOTER
I20260709 12:13:40.128528  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:40.104872  6953 leader_election.cc:290] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:40.127779  5199 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61"
dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
mode: GRACEFUL
new_leader_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:53902
I20260709 12:13:40.131230  5199 raft_consensus.cc:606] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 LEADER]: Received request to transfer leadership to TS 9e794b72ed7640219f90ec4232363929
I20260709 12:13:40.132160  5191 raft_consensus.cc:2393] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 3: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:40.096626  6976 consensus_queue.cc:1059] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
W20260709 12:13:40.142062  5240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:40.119513  6956 raft_consensus.cc:2749] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:40.148877  6875 leader_election.cc:290] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:40.149253  6942 consensus_queue.cc:260] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:40.150804  6942 raft_consensus.cc:3060] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:40.153604  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:40.155503  6964 raft_consensus.cc:3055] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:40.156013  6964 raft_consensus.cc:740] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:40.163568  5801 leader_election.cc:304] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:40.160836  5088 leader_election.cc:304] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:40.167614  5801 leader_election.cc:304] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:13:40.174856  6888 consensus_meta.cc:287] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.545s	user 0.007s	sys 0.003s
I20260709 12:13:40.177616  5801 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:40.176348  5265 raft_consensus.cc:2468] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 2.
I20260709 12:13:40.180151  5801 leader_election.cc:304] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:40.180043  6968 consensus_queue.cc:1059] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:13:40.181159  6944 raft_consensus.cc:2749] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:40.181531  5801 leader_election.cc:304] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:40.182080  6968 raft_consensus.cc:3055] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:40.182392  6944 raft_consensus.cc:2749] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:40.182484  6968 raft_consensus.cc:740] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:13:40.182577  5801 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:40.183467  6944 raft_consensus.cc:2749] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:40.183841  6968 consensus_queue.cc:260] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:40.177356  5125 raft_consensus.cc:1275] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 12:13:40.190054  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 96770.5us
I20260709 12:13:40.190537  5088 leader_election.cc:304] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:40.192787  5196 raft_consensus.cc:2468] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 3.
I20260709 12:13:40.193825  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:40.194449  5274 raft_consensus.cc:3060] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:40.172602  6848 raft_consensus.cc:2749] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:40.127182  6872 consensus_queue.cc:237] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:40.172096  6818 raft_consensus.cc:2749] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:40.197113  5200 raft_consensus.cc:1240] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:40.195433  6907 raft_consensus.cc:2749] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:40.185344  6968 raft_consensus.cc:3060] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:40.203274  6966 raft_consensus.cc:1064] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821: attempting to promote NON_VOTER bce73265e27d4b30a4dcc1e491305088 to VOTER
I20260709 12:13:40.185648  6896 raft_consensus.cc:2749] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:40.179162  6909 raft_consensus.cc:2749] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:40.206110  5197 raft_consensus.cc:2468] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 2.
I20260709 12:13:40.203954  5195 raft_consensus.cc:1240] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:40.199795  6953 raft_consensus.cc:2804] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:40.166260  6875 consensus_queue.cc:1059] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:13:40.199586  6911 consensus_queue.cc:1059] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:13:40.164268  6964 consensus_queue.cc:260] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:40.211637  6964 raft_consensus.cc:3060] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:40.140395  6905 consensus_queue.cc:260] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:40.209100  6967 raft_consensus.cc:3055] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:40.213858  6977 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:40.214417  6977 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:40.215314  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:40.205849  6938 consensus_queue.cc:1059] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 12:13:40.215184  6966 consensus_queue.cc:237] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:40.215832  5266 raft_consensus.cc:3060] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:40.216566  6953 raft_consensus.cc:697] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:40.218387  6953 consensus_queue.cc:237] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:40.220968  6875 raft_consensus.cc:3055] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:40.221406  6875 raft_consensus.cc:740] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:40.222255  6875 consensus_queue.cc:260] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:40.223024  6967 raft_consensus.cc:740] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:40.223265  5266 raft_consensus.cc:2468] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 2.
I20260709 12:13:40.223595  6875 raft_consensus.cc:3060] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:40.224905  6924 raft_consensus.cc:515] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:40.227077  6924 leader_election.cc:290] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:40.194105  6920 consensus_queue.cc:1048] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 12:13:40.229975  6938 raft_consensus.cc:3055] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:40.140199  6959 consensus_queue.cc:260] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:40.230389  6938 raft_consensus.cc:740] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:40.231035  6862 raft_consensus.cc:3055] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:40.235859  5836 raft_consensus.cc:1240] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 1. Current term is 2. Ops: []
W20260709 12:13:40.242274  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 165138us
I20260709 12:13:40.246555  5119 raft_consensus.cc:1240] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:40.247085  5833 raft_consensus.cc:1275] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 2 LEARNER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:13:40.247646  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:40.239542  6862 raft_consensus.cc:740] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:40.248761  6862 consensus_queue.cc:260] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:40.239159  6818 consensus_queue.cc:1059] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 12:13:40.250699  6947 raft_consensus.cc:3055] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:40.251055  6947 raft_consensus.cc:740] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
W20260709 12:13:40.285498  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:40.243245  6959 raft_consensus.cc:3060] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:40.211488  6973 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:40.293035  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 48374.1us
I20260709 12:13:40.252784  6905 raft_consensus.cc:3060] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:40.311954  5238 leader_election.cc:304] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:13:40.317507  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 75250.8us
I20260709 12:13:40.318545  5237 leader_election.cc:304] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:40.322439  5238 leader_election.cc:304] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:40.290545  6969 consensus_queue.cc:1048] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
W20260709 12:13:40.325531  6982 log.cc:927] Time spent T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 12:13:40.326251  6935 raft_consensus.cc:3060] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:40.327049  5833 raft_consensus.cc:1240] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:40.251875  6947 consensus_queue.cc:260] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:40.328903  6947 raft_consensus.cc:3060] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:40.332347  5274 raft_consensus.cc:2468] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 2.
I20260709 12:13:40.332681  5088 leader_election.cc:304] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:40.335502  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:40.337707  5088 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:40.343061  5088 leader_election.cc:304] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:40.351994  5088 leader_election.cc:304] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:40.345250  5801 leader_election.cc:304] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:40.231244  6938 consensus_queue.cc:260] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:40.355517  5088 leader_election.cc:304] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:40.354045  5801 leader_election.cc:304] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:40.356240  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:40.350881  6866 raft_consensus.cc:2749] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:40.337149  6884 raft_consensus.cc:2804] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:40.350975  6911 raft_consensus.cc:2804] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:40.366240  6911 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:40.366696  6911 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:40.368405  6957 raft_consensus.cc:3060] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:40.337530  6956 raft_consensus.cc:2804] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:40.336495  6918 raft_consensus.cc:2749] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:40.347289  6924 raft_consensus.cc:2749] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:40.329687  6900 consensus_queue.cc:1059] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:13:40.359091  6962 raft_consensus.cc:2804] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:40.378547  6884 raft_consensus.cc:697] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 3 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:40.375788  6960 raft_consensus.cc:2804] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:40.356607  6818 raft_consensus.cc:2749] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:40.376286  6956 raft_consensus.cc:493] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:40.310915  6943 consensus_queue.cc:1059] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 12:13:40.398275  5163 leader_election.cc:304] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:40.392239  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:40.393571  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:40.399513  5163 leader_election.cc:304] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:40.399780  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
W20260709 12:13:40.405160  5166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:40.407665  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:40.408228  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:40.408857  5265 raft_consensus.cc:2393] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 3: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:13:40.409191  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:40.408915  5270 raft_consensus.cc:1240] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:40.408478  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:13:40.408284  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:40.387164  6984 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:40.412451  5272 raft_consensus.cc:2468] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 2.
I20260709 12:13:40.416167  5266 raft_consensus.cc:1240] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:40.413583  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:40.407586  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:40.344236  6986 consensus_queue.cc:1059] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 12:13:40.419045  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:40.419986  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:40.422639  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:40.406109  6930 raft_consensus.cc:2749] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:40.404359  6956 raft_consensus.cc:3060] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:40.396413  6885 raft_consensus.cc:493] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:40.409891  6890 raft_consensus.cc:2749] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:40.430663  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:40.431999  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:40.428326  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:40.416404  6938 raft_consensus.cc:3060] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:40.434201  5265 raft_consensus.cc:1240] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:40.445662  5265 raft_consensus.cc:1240] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:40.435794  6940 consensus_queue.cc:1059] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:13:40.408068  6918 consensus_queue.cc:1059] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:13:40.429240  6962 raft_consensus.cc:697] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 2 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:13:40.448925  6862 raft_consensus.cc:3060] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:40.421170  6960 raft_consensus.cc:697] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 2 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:13:40.420857  6984 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:40.436332  5270 raft_consensus.cc:1240] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:40.497818  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
W20260709 12:13:40.473547  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 55258.1us
I20260709 12:13:40.498332  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:40.514353  5120 raft_consensus.cc:1275] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:40.498924  6898 raft_consensus.cc:3055] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:40.516250  6898 raft_consensus.cc:740] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:13:40.516899  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:40.517756  5195 raft_consensus.cc:1240] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:40.477849  6866 raft_consensus.cc:3055] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:40.519405  6866 raft_consensus.cc:740] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:40.519306  6956 raft_consensus.cc:515] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:40.520296  6866 consensus_queue.cc:260] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:13:40.527493  5164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:40.459416  6973 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:40.529851  6856 consensus_queue.cc:1048] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:40.530521  5832 raft_consensus.cc:2468] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
I20260709 12:13:40.437491  5088 leader_election.cc:304] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:40.451251  5273 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 4.
I20260709 12:13:40.426524  6977 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:40.456950  5163 leader_election.cc:304] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:40.474268  5266 raft_consensus.cc:1240] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:40.536546  5237 leader_election.cc:304] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:40.436136  6986 raft_consensus.cc:3055] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:40.540616  5269 raft_consensus.cc:2468] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 3.
I20260709 12:13:40.538151  6958 raft_consensus.cc:2804] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:40.542650  6958 raft_consensus.cc:493] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:40.543015  6958 raft_consensus.cc:3060] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:40.517951  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:40.547390  6975 raft_consensus.cc:515] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:40.541293  5195 raft_consensus.cc:1275] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:40.449330  6962 consensus_queue.cc:237] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:40.467935  6884 consensus_queue.cc:237] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:40.550547  5240 leader_election.cc:304] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:13:40.537633  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 97395.9us
W20260709 12:13:40.539359  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 82493.5us
I20260709 12:13:40.495219  6881 raft_consensus.cc:3055] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:40.521162  6991 consensus_queue.cc:1059] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:40.558607  5163 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:40.555770  6939 raft_consensus.cc:2749] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:13:40.517208  6898 consensus_queue.cc:260] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:40.531576  6866 raft_consensus.cc:3060] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:40.575587  5829 raft_consensus.cc:2468] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 3.
I20260709 12:13:40.550815  6980 raft_consensus.cc:2749] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:40.581766  6978 raft_consensus.cc:2749] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:40.582125  5163 leader_election.cc:304] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:40.550683  6919 consensus_queue.cc:1059] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:13:40.583037  5270 raft_consensus.cc:1240] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:40.583967  5163 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:40.584561  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:40.561213  5197 raft_consensus.cc:1275] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:40.583037  6978 raft_consensus.cc:2749] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:40.561970  6911 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:40.553359  6872 raft_consensus.cc:2749] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:40.552029  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:40.587926  6971 raft_consensus.cc:3060] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:40.563149  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:40.564278  5088 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:40.564961  6973 consensus_queue.cc:1048] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:40.567113  6958 raft_consensus.cc:515] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:40.570412  6967 consensus_queue.cc:260] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:40.561012  5274 raft_consensus.cc:2468] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 4.
I20260709 12:13:40.446082  6885 raft_consensus.cc:515] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:40.590437  5088 leader_election.cc:304] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
W20260709 12:13:40.591006  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:40.571305  6881 raft_consensus.cc:740] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:40.605057  6881 consensus_queue.cc:260] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:40.593139  5238 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:40.590657  6980 raft_consensus.cc:993] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808: : Instructing follower 9e794b72ed7640219f90ec4232363929 to start an election
I20260709 12:13:40.609083  6980 raft_consensus.cc:1081] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 LEADER]: Signalling peer 9e794b72ed7640219f90ec4232363929 to start an election
I20260709 12:13:40.611858  6852 raft_consensus.cc:3055] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:40.612277  6852 raft_consensus.cc:740] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:13:40.614766  6901 raft_consensus.cc:2749] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:40.615461  6901 consensus_queue.cc:1059] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:40.551167  6986 raft_consensus.cc:740] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:40.592963  6947 raft_consensus.cc:2749] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:40.596810  6958 leader_election.cc:290] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:40.583279  6919 raft_consensus.cc:3055] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:40.636230  5274 raft_consensus.cc:1240] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:40.637140  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:40.639590  5266 raft_consensus.cc:1240] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:40.640208  5836 raft_consensus.cc:1275] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:40.627272  5163 leader_election.cc:304] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:40.601677  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:40.603338  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:40.647452  5238 leader_election.cc:304] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:40.621532  5194 raft_consensus.cc:2468] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 2.
I20260709 12:13:40.625196  5120 raft_consensus.cc:1240] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:40.629295  5272 raft_consensus.cc:2468] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 4.
I20260709 12:13:40.603257  6967 raft_consensus.cc:3060] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:40.616019  6879 consensus_queue.cc:1059] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 12:13:40.663208  5835 raft_consensus.cc:1240] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:40.616981  6956 leader_election.cc:290] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:40.665918  5163 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:40.671200  5274 raft_consensus.cc:1240] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:40.642781  6872 raft_consensus.cc:2749] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:40.641765  6919 raft_consensus.cc:740] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:40.613085  6852 consensus_queue.cc:260] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:40.659650  6905 raft_consensus.cc:2749] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:40.656859  6930 raft_consensus.cc:2749] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:40.665831  6980 consensus_queue.cc:1059] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 12:13:40.641876  6935 consensus_queue.cc:1059] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:13:40.668475  5266 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:34672
I20260709 12:13:40.626204  6918 consensus_queue.cc:1059] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 12:13:40.695528  5266 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:40.696002  5266 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:40.670188  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:40.660223  6939 consensus_queue.cc:1048] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:13:40.676198  6978 raft_consensus.cc:2804] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:40.684271  5833 raft_consensus.cc:2393] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 2: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:13:40.734822  5271 raft_consensus.cc:1240] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 3 LEADER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:40.736513  5238 leader_election.cc:304] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:13:40.737537  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 121896us
I20260709 12:13:40.746892  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:40.747777  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:40.748890  5088 leader_election.cc:304] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:40.745503  5266 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:40.683300  6907 consensus_queue.cc:1059] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 12:13:40.683028  6890 consensus_queue.cc:1059] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 12:13:40.756065  5274 raft_consensus.cc:1240] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:40.760300  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:40.734074  6978 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:40.762416  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:40.763254  7000 consensus_queue.cc:1048] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:40.763865  5089 leader_election.cc:304] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:40.765161  7000 raft_consensus.cc:2804] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:40.765753  7000 raft_consensus.cc:697] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:40.766760  7000 consensus_queue.cc:237] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:40.774098  5266 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:40.743427  6889 raft_consensus.cc:2749] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:40.682340  6960 consensus_queue.cc:237] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:40.785542  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:40.786439  5191 raft_consensus.cc:3055] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:40.786788  5191 raft_consensus.cc:740] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:40.774641  6978 raft_consensus.cc:3060] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:40.783378  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:40.746405  6986 consensus_queue.cc:260] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:40.794723  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:40.794902  6986 raft_consensus.cc:3060] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:40.796365  5266 raft_consensus.cc:1275] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:40.797520  5237 leader_election.cc:304] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:40.803227  5267 raft_consensus.cc:2468] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
I20260709 12:13:40.797793  6911 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:40.801769  6885 leader_election.cc:290] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:40.802459  5191 consensus_queue.cc:260] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:40.808717  5191 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:40.809924  5238 leader_election.cc:304] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:40.812448  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:40.818995  6889 raft_consensus.cc:2804] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:40.819554  6889 raft_consensus.cc:697] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 3 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:40.819916  6963 raft_consensus.cc:3055] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:40.820339  6963 raft_consensus.cc:740] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:13:40.820425  6889 consensus_queue.cc:237] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:40.821236  6963 consensus_queue.cc:260] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:40.829802  5197 raft_consensus.cc:2468] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 2.
I20260709 12:13:40.814751  6884 raft_consensus.cc:2749] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:40.833448  6957 raft_consensus.cc:2749] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:40.788084  6984 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:40.798202  6996 raft_consensus.cc:2804] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:13:40.875986  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:40.880460  6993 log.cc:927] Time spent T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.123s	user 0.002s	sys 0.000s
I20260709 12:13:40.879097  6996 raft_consensus.cc:493] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:40.902644  6996 raft_consensus.cc:3060] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:40.912724  6830 tablet_bootstrap.cc:492] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:40.959690  6830 tablet_bootstrap.cc:492] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088: Bootstrap complete.
I20260709 12:13:40.959954  6971 raft_consensus.cc:2749] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:40.960448  6830 ts_tablet_manager.cc:1403] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088: Time spent bootstrapping tablet: real 1.364s	user 0.025s	sys 0.015s
I20260709 12:13:40.962802  5191 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 3.
I20260709 12:13:40.963650  6830 raft_consensus.cc:359] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:40.964294  5237 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:40.964637  6830 raft_consensus.cc:740] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Initialized, Role: LEARNER
I20260709 12:13:40.965335  6830 consensus_queue.cc:260] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:40.972131  6963 raft_consensus.cc:3060] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:40.973524  6830 ts_tablet_manager.cc:1434] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:13:40.973995  6920 raft_consensus.cc:3055] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:40.974308  6996 raft_consensus.cc:515] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:40.965615  6978 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:40.978597  6948 raft_consensus.cc:3055] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:40.979131  6948 raft_consensus.cc:740] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
W20260709 12:13:40.980986  7006 log.cc:927] Time spent T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
W20260709 12:13:40.981463  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 203289us
I20260709 12:13:40.974421  6920 raft_consensus.cc:740] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:40.985980  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:40.986829  5119 raft_consensus.cc:2393] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 4: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:13:40.986531  6920 consensus_queue.cc:260] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:40.988140  6920 raft_consensus.cc:3060] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:40.989300  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:40.992064  5267 raft_consensus.cc:1275] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:40.993201  5118 raft_consensus.cc:1275] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:40.993906  6947 raft_consensus.cc:3055] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:40.994321  6947 raft_consensus.cc:740] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:40.995954  5088 leader_election.cc:304] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:40.994980  6947 consensus_queue.cc:260] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:40.996716  6866 raft_consensus.cc:2804] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:40.997964  5088 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:40.997241  6866 raft_consensus.cc:697] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:40.999498  7002 raft_consensus.cc:2804] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:41.000037  7002 raft_consensus.cc:697] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:41.000106  6866 consensus_queue.cc:237] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:40.996873  6986 raft_consensus.cc:2804] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:41.003994  6986 raft_consensus.cc:697] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 3 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:41.004853  6986 consensus_queue.cc:237] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:41.000130  6881 raft_consensus.cc:3060] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:41.009016  6978 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:41.001005  7002 consensus_queue.cc:237] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:41.012315  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:41.018900  5273 raft_consensus.cc:1240] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:41.021215  5267 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 4.
I20260709 12:13:41.022370  6898 raft_consensus.cc:3060] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:41.025949  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:40.980120  6948 consensus_queue.cc:260] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:41.028787  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:41.030265  6996 leader_election.cc:290] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:41.034210  5273 raft_consensus.cc:1240] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:41.034489  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:41.036427  6970 raft_consensus.cc:1027] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: attempt to promote peer bce73265e27d4b30a4dcc1e491305088: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 12:13:41.038980  5240 leader_election.cc:304] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:41.039479  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:41.042111  5199 raft_consensus.cc:2393] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 3: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
W20260709 12:13:41.033406  6907 consensus_queue.cc:1175] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "bce73265e27d4b30a4dcc1e491305088" responder_term: 2 status { last_received { term: 2 index: 4 } last_committed_idx: 3 last_received_current_leader { term: 2 index: 4 } }
I20260709 12:13:41.024564  6947 raft_consensus.cc:3060] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:41.052431  6939 consensus_queue.cc:1048] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:13:41.042088  6885 raft_consensus.cc:2749] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:41.062325  5120 raft_consensus.cc:2955] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:41.058188  6940 raft_consensus.cc:2955] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
W20260709 12:13:41.064217  5165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:41.071108  5834 raft_consensus.cc:2468] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
I20260709 12:13:41.072386  5089 leader_election.cc:304] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:41.077693  5834 raft_consensus.cc:1240] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:41.082739  5088 leader_election.cc:304] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:41.094515  5163 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:41.100302  6976 raft_consensus.cc:3055] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:41.101125  5122 raft_consensus.cc:1240] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:41.076122  6901 raft_consensus.cc:2804] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:41.083904  6818 consensus_queue.cc:1048] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:13:41.119429  6852 raft_consensus.cc:3060] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:41.123682  6879 raft_consensus.cc:3055] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:41.124341  6879 raft_consensus.cc:740] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:41.127275  6949 raft_consensus.cc:2804] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:41.127871  6949 raft_consensus.cc:697] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:41.131036  5163 leader_election.cc:304] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:41.087786  7000 raft_consensus.cc:2804] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:41.143939  7000 raft_consensus.cc:697] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:41.087220  6971 consensus_queue.cc:1059] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:13:41.127403  5829 raft_consensus.cc:1240] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 2 LEADER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:41.106715  6976 raft_consensus.cc:740] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:41.107539  6975 leader_election.cc:290] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:41.128814  6949 consensus_queue.cc:237] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:41.125504  6879 consensus_queue.cc:260] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:41.145313  6920 raft_consensus.cc:2804] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:41.158390  5284 tablet_copy_service.cc:342] P 9e794b72ed7640219f90ec4232363929: Request end of tablet copy session bce73265e27d4b30a4dcc1e491305088-756d32b8c4d642a6955517f66ac5bb45 received from {username='slave'} at 127.0.0.1:50932
I20260709 12:13:41.146214  6894 consensus_queue.cc:1059] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:13:41.158978  5284 tablet_copy_service.cc:434] P 9e794b72ed7640219f90ec4232363929: ending tablet copy session bce73265e27d4b30a4dcc1e491305088-756d32b8c4d642a6955517f66ac5bb45 on tablet 756d32b8c4d642a6955517f66ac5bb45 with peer bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:41.141014  6935 consensus_queue.cc:1059] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:13:41.150136  6901 raft_consensus.cc:697] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:41.163815  6901 consensus_queue.cc:237] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:41.157829  6920 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:41.166743  6920 raft_consensus.cc:3060] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:41.173753  6965 consensus_queue.cc:1059] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:41.174605  6965 consensus_queue.cc:1243] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer bce73265e27d4b30a4dcc1e491305088 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:13:41.182168  6970 raft_consensus.cc:493] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.187776  6970 raft_consensus.cc:515] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:41.190016  5271 raft_consensus.cc:1240] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:41.190196  6970 leader_election.cc:290] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:41.190429  6948 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:41.191948  6971 consensus_queue.cc:1059] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:41.193080  6971 raft_consensus.cc:3055] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:41.193430  6971 raft_consensus.cc:740] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:41.202235  6975 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.205523  6975 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:41.205935  5195 raft_consensus.cc:2955] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:41.211052  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:41.145071  7000 consensus_queue.cc:237] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:41.213928  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 131224us
I20260709 12:13:41.214900  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:41.217087  5088 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:41.208827  6975 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:41.212447  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:41.194276  6971 consensus_queue.cc:260] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:41.222463  6957 raft_consensus.cc:2749] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:41.227097  5833 raft_consensus.cc:2468] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 2.
I20260709 12:13:41.227120  6947 consensus_queue.cc:1059] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:13:41.227294  5271 raft_consensus.cc:1275] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:41.228658  5089 leader_election.cc:304] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:13:41.231997  5197 raft_consensus.cc:1275] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:41.232594  6967 raft_consensus.cc:2804] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:41.233067  6967 raft_consensus.cc:493] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:41.233474  6967 raft_consensus.cc:3060] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:41.234045  5269 raft_consensus.cc:1240] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:41.236960  5194 raft_consensus.cc:1275] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:41.237123  5268 raft_consensus.cc:1240] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:41.239436  6971 raft_consensus.cc:3060] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:41.243883  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:41.244637  5196 raft_consensus.cc:2468] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 2.
I20260709 12:13:41.245810  6999 raft_consensus.cc:3055] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:41.245268  6967 raft_consensus.cc:515] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:41.239748  6919 consensus_queue.cc:260] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:41.246965  6919 raft_consensus.cc:3060] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:41.246222  6999 raft_consensus.cc:740] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:41.251091  6999 consensus_queue.cc:260] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:41.226562  6970 consensus_queue.cc:1048] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 12:13:41.252323  5268 raft_consensus.cc:1240] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:41.257558  6959 consensus_queue.cc:1059] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:41.258047  6970 consensus_queue.cc:1048] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:41.259101  5834 raft_consensus.cc:2955] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:41.260870  6981 consensus_queue.cc:1059] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:41.266009  5193 raft_consensus.cc:2410] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 4 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 12:13:41.268823  6957 raft_consensus.cc:3055] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:41.269153  6948 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.269307  6957 raft_consensus.cc:740] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:41.269692  6948 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:41.289542  6975 consensus_queue.cc:1048] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:41.291345  6929 consensus_queue.cc:1048] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:41.291689  6920 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:41.292392  6967 leader_election.cc:290] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:41.292793  5199 raft_consensus.cc:1240] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:41.292979  6967 raft_consensus.cc:493] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:41.293548  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:41.294163  5833 raft_consensus.cc:3060] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:41.295866  6920 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:41.303294  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:41.304507  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:41.303365  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:41.305970  5191 raft_consensus.cc:3060] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:41.315824  5237 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:41.325326  5191 raft_consensus.cc:2468] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
I20260709 12:13:41.328542  5166 leader_election.cc:304] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:41.326864  5088 leader_election.cc:304] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:41.322714  6986 raft_consensus.cc:2749] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:41.339963  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:41.351804  5269 raft_consensus.cc:2468] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 4.
I20260709 12:13:41.353174  5163 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:41.354076  6971 raft_consensus.cc:2804] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:41.354446  6971 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:41.354768  6971 raft_consensus.cc:3060] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:41.357007  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:41.357743  5834 raft_consensus.cc:2468] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 5.
I20260709 12:13:41.350446  6879 raft_consensus.cc:3060] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:41.360651  5193 raft_consensus.cc:3060] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:41.334282  7000 raft_consensus.cc:2804] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:41.343824  6999 raft_consensus.cc:3060] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:41.367897  7000 raft_consensus.cc:697] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:41.368856  7000 consensus_queue.cc:237] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:41.331010  6980 raft_consensus.cc:2749] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:41.274528  6957 consensus_queue.cc:260] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:41.370927  6957 raft_consensus.cc:3060] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:41.372282  6875 raft_consensus.cc:3055] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:41.372742  6875 raft_consensus.cc:740] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:41.350397  6948 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:41.302098  6967 raft_consensus.cc:515] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:41.373613  6875 consensus_queue.cc:260] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:41.375555  6967 leader_election.cc:290] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:41.377676  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:41.374974  6875 raft_consensus.cc:3060] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:41.345443  6976 consensus_queue.cc:260] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:41.380249  6976 raft_consensus.cc:3060] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:41.382284  5829 raft_consensus.cc:1275] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:13:41.386142  5195 raft_consensus.cc:1275] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:41.386677  6962 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:41.387187  6962 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:41.387619  6848 consensus_queue.cc:1048] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:41.389101  5829 raft_consensus.cc:1275] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:41.391289  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:41.392198  5834 raft_consensus.cc:2393] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 3: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:13:41.404084  5089 leader_election.cc:304] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:41.404369  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:41.405275  5199 raft_consensus.cc:2393] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 3: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:41.407907  5018 catalog_manager.cc:5697] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 reported cstate change: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:41.402853  5193 raft_consensus.cc:1275] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:41.415251  6940 consensus_queue.cc:1048] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:13:41.409477  6962 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:41.421497  5018 catalog_manager.cc:5697] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 2 to 3, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 3 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:41.431783  6971 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:41.415251  7007 consensus_queue.cc:1059] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:13:41.415293  6967 raft_consensus.cc:3060] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:41.437777  5021 catalog_manager.cc:5697] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 1 to 2, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 2 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:41.439620  5021 catalog_manager.cc:5697] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 1 to 2, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 2 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:41.441890  7001 raft_consensus.cc:3055] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:41.442314  7001 raft_consensus.cc:740] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:41.443146  7001 consensus_queue.cc:260] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:41.444540  7001 raft_consensus.cc:3060] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:41.449093  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:41.449939  5118 raft_consensus.cc:2468] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 3.
I20260709 12:13:41.419647  6970 consensus_queue.cc:1048] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:13:41.451578  5804 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:41.452646  6950 raft_consensus.cc:2804] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:41.453161  6950 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:41.453600  6950 raft_consensus.cc:3060] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:41.455526  5833 raft_consensus.cc:2468] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
I20260709 12:13:41.456147  7004 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:41.457293  7004 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:41.459734  6862 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.460529  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:41.461330  5199 raft_consensus.cc:2393] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 2: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:41.461990  7004 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:41.460314  6862 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:41.469393  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:41.469616  6862 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:41.427724  5018 catalog_manager.cc:5697] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 2 to 3, leader changed from bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 3 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:41.470103  5119 raft_consensus.cc:2468] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 3.
I20260709 12:13:41.471038  5018 catalog_manager.cc:5697] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 2 to 3, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 3 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:41.473832  5166 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:41.479776  6999 raft_consensus.cc:2804] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:41.502684  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:41.503438  5268 raft_consensus.cc:3060] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:13:41.486152  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:41.486699  6929 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:41.493818  6999 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:41.504462  6967 raft_consensus.cc:2749] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:41.511147  6929 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:41.513751  5118 raft_consensus.cc:1275] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:41.514066  6999 raft_consensus.cc:3060] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:41.514881  5200 raft_consensus.cc:1275] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:41.506583  6968 raft_consensus.cc:493] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.530730  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:41.533509  5194 raft_consensus.cc:2393] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 3: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:41.571249  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:41.571933  5120 raft_consensus.cc:2468] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 2.
I20260709 12:13:41.513314  6929 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:41.575129  5122 raft_consensus.cc:1275] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:41.578331  5265 raft_consensus.cc:1275] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:41.534107  6866 raft_consensus.cc:493] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.584221  5804 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:13:41.576889  7022 log.cc:927] Time spent T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:13:41.526598  6977 consensus_queue.cc:1048] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 12:13:41.580811  6971 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:41.536818  6968 raft_consensus.cc:515] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:41.585654  7000 raft_consensus.cc:493] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.591415  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:41.582029  6929 consensus_queue.cc:1048] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:13:41.616812  5119 raft_consensus.cc:2468] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 3.
I20260709 12:13:41.618294  5804 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
W20260709 12:13:41.618494  7023 log.cc:927] Time spent T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
W20260709 12:13:41.623339  7024 log.cc:927] Time spent T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:13:41.585093  6866 raft_consensus.cc:515] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:13:41.653081  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:41.605399  6962 raft_consensus.cc:2804] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:41.674477  5265 raft_consensus.cc:1275] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:41.679461  6950 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:41.681790  6950 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:41.681692  6901 consensus_queue.cc:1048] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:13:41.682585  5829 raft_consensus.cc:2468] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 3.
W20260709 12:13:41.674417  7027 log.cc:927] Time spent T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.096s	user 0.000s	sys 0.002s
I20260709 12:13:41.665521  6852 raft_consensus.cc:2804] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:13:41.678359  7030 log.cc:927] Time spent T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.109s	user 0.000s	sys 0.002s
I20260709 12:13:41.674296  6862 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.676446  6962 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:41.699842  5268 raft_consensus.cc:2468] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 6.
I20260709 12:13:41.705005  5163 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:41.609272  7000 raft_consensus.cc:515] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:41.705792  6962 raft_consensus.cc:3060] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:41.700327  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:41.676918  6848 consensus_queue.cc:1048] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:13:41.695093  6852 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:41.718175  5268 raft_consensus.cc:1275] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:13:41.710230  6971 raft_consensus.cc:2804] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:13:41.721447  5268 raft_consensus.cc:1275] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:41.712035  7004 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:41.714746  6852 raft_consensus.cc:3060] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:41.706516  6862 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:41.746652  6940 consensus_queue.cc:1048] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:41.748135  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:41.748725  6894 raft_consensus.cc:493] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.735675  6970 consensus_queue.cc:1048] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:41.729632  6976 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.761528  5197 raft_consensus.cc:1275] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:41.762365  5194 raft_consensus.cc:1275] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:13:41.743826  7026 log.cc:927] Time spent T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.212s	user 0.001s	sys 0.003s
I20260709 12:13:41.761124  5193 raft_consensus.cc:1275] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:41.761890  6894 raft_consensus.cc:515] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:41.775743  6967 consensus_queue.cc:1048] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:41.768784  5116 raft_consensus.cc:1275] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:41.736802  6971 raft_consensus.cc:697] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
W20260709 12:13:41.772140  7025 log.cc:927] Time spent T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.281s	user 0.003s	sys 0.008s
I20260709 12:13:41.772485  6896 raft_consensus.cc:493] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.775537  6938 consensus_queue.cc:1048] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:41.756003  6965 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.731562  6920 consensus_queue.cc:1048] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:13:41.790716  5122 raft_consensus.cc:2468] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 3.
I20260709 12:13:41.768344  5830 raft_consensus.cc:1275] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:41.763195  5833 raft_consensus.cc:3060] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:41.768833  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:41.769014  6949 raft_consensus.cc:493] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:41.753472  7004 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:41.848932  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 94415us
I20260709 12:13:41.859119  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:41.859843  5267 raft_consensus.cc:2468] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 2.
I20260709 12:13:41.778644  6976 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:41.870458  6852 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:41.840274  6975 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:41.800103  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:41.879352  6975 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:41.850472  6968 leader_election.cc:290] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:41.849225  6894 leader_election.cc:290] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:41.889782  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:41.799213  6896 raft_consensus.cc:515] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:41.839190  6965 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:41.882184  6960 raft_consensus.cc:493] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:41.882788  6866 leader_election.cc:290] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:41.934775  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:41.953991  5119 raft_consensus.cc:2468] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 2.
I20260709 12:13:41.953253  6862 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:41.958504  7004 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:41.966028  6896 leader_election.cc:290] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:13:41.941213  7031 log.cc:927] Time spent T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.246s	user 0.000s	sys 0.001s
I20260709 12:13:41.976316  7000 leader_election.cc:290] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:41.982636  6975 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:41.985437  6976 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:41.989573  6866 consensus_queue.cc:1048] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:41.992322  6960 raft_consensus.cc:515] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:41.994649  6960 leader_election.cc:290] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:41.858359  6949 raft_consensus.cc:515] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:41.888749  6971 consensus_queue.cc:237] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:42.000679  7043 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.001293  7043 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:42.003826  7043 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:42.015153  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:42.015914  5191 raft_consensus.cc:2468] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 4.
I20260709 12:13:42.043563  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:42.044382  5267 raft_consensus.cc:2468] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 3.
I20260709 12:13:42.044534  6885 raft_consensus.cc:493] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.045799  5163 leader_election.cc:304] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:42.057943  5163 leader_election.cc:304] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
W20260709 12:13:42.059552  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:42.071702  5237 leader_election.cc:304] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:41.980677  6999 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:41.914170  6894 raft_consensus.cc:493] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.087103  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:13:42.087630  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 292796us
W20260709 12:13:42.088171  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 193899us
I20260709 12:13:42.087946  5267 raft_consensus.cc:2393] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 3: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:13:42.069077  5804 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:13:41.989158  6965 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:42.091078  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:42.094416  5273 raft_consensus.cc:2468] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 2.
I20260709 12:13:42.094949  5122 raft_consensus.cc:1275] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:13:42.095757  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:41.941859  7037 raft_consensus.cc:493] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.082913  6948 raft_consensus.cc:2804] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:42.081935  6980 raft_consensus.cc:2804] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:42.102543  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:42.107688  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:42.085213  6940 raft_consensus.cc:2804] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:42.110230  5198 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 3.
I20260709 12:13:42.110770  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:42.090312  7038 raft_consensus.cc:493] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.045264  6885 raft_consensus.cc:515] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:42.116658  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:42.093942  6852 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:42.098500  6950 raft_consensus.cc:493] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.121965  5088 leader_election.cc:304] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:13:42.118466  5192 raft_consensus.cc:2468] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 3.
I20260709 12:13:42.085683  6901 consensus_queue.cc:1048] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:13:42.098405  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:42.124502  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:42.100922  6896 raft_consensus.cc:493] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.103341  6965 raft_consensus.cc:493] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:42.109104  6948 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:42.109807  6980 raft_consensus.cc:493] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:42.111076  6940 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:42.093706  6894 raft_consensus.cc:515] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:42.149889  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:42.125694  5195 raft_consensus.cc:2368] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 3. Current term is 4.
I20260709 12:13:42.122074  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:42.126376  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:42.121753  7007 raft_consensus.cc:493] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:42.167920  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:42.168140  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:42.169662  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:42.173635  5125 raft_consensus.cc:2468] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 2.
I20260709 12:13:42.177953  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:42.153926  6948 raft_consensus.cc:3060] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:42.154770  6957 raft_consensus.cc:2804] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:42.154994  6879 raft_consensus.cc:493] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.160351  6980 raft_consensus.cc:3060] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:42.160599  6940 raft_consensus.cc:3060] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:42.112632  7037 raft_consensus.cc:515] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:42.199061  5191 raft_consensus.cc:2468] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 2.
W20260709 12:13:42.200296  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 104320us
I20260709 12:13:42.142745  6986 consensus_queue.cc:1048] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 12:13:42.119328  7038 raft_consensus.cc:515] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:42.160179  6898 raft_consensus.cc:2804] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:42.126963  6950 raft_consensus.cc:515] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:42.153311  5271 raft_consensus.cc:2468] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 3.
I20260709 12:13:42.179075  6967 raft_consensus.cc:493] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.213572  5801 leader_election.cc:304] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:42.198002  7043 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.200955  6957 raft_consensus.cc:493] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:42.197829  5119 raft_consensus.cc:2468] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 3.
I20260709 12:13:42.155903  6965 raft_consensus.cc:515] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:42.267338  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:42.268123  5199 raft_consensus.cc:2468] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 1.
I20260709 12:13:42.150050  7047 consensus_queue.cc:1048] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 12:13:42.150475  6896 raft_consensus.cc:515] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:42.271544  5237 leader_election.cc:304] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:42.271950  6896 leader_election.cc:290] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:42.223968  5197 raft_consensus.cc:1275] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:42.203055  7039 raft_consensus.cc:493] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.273222  7039 raft_consensus.cc:515] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:42.275470  7039 leader_election.cc:290] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:42.201428  5118 raft_consensus.cc:2468] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 2.
I20260709 12:13:42.210491  6879 raft_consensus.cc:515] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:42.281124  6879 leader_election.cc:290] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:42.234932  6957 raft_consensus.cc:3060] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:42.243599  6885 leader_election.cc:290] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:42.263002  6862 raft_consensus.cc:493] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.220839  7049 raft_consensus.cc:493] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.288249  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:42.235491  7043 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:42.197775  7007 raft_consensus.cc:515] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:42.287757  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:42.302201  5199 raft_consensus.cc:2393] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 3: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:42.254524  6968 raft_consensus.cc:2804] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:42.299762  5088 leader_election.cc:304] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:42.269098  6965 leader_election.cc:290] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:42.253829  6999 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:13:42.241731  7042 log.cc:927] Time spent T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:13:42.302138  5197 raft_consensus.cc:2468] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 2.
W20260709 12:13:42.306059  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 272678us
I20260709 12:13:42.239370  6894 leader_election.cc:290] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:13:42.240847  6962 consensus_meta.cc:287] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.527s	user 0.009s	sys 0.000s
I20260709 12:13:42.231623  6898 raft_consensus.cc:697] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 3 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:13:42.257982  6949 leader_election.cc:290] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:42.312888  5804 leader_election.cc:304] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:42.313300  5237 leader_election.cc:304] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:42.313912  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:42.257517  6975 raft_consensus.cc:493] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:42.310482  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:42.325855  5804 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:42.333273  5804 leader_election.cc:304] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:42.334556  5804 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:42.286283  5833 raft_consensus.cc:2468] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 6.
I20260709 12:13:42.308878  6885 raft_consensus.cc:2804] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:42.303313  6862 raft_consensus.cc:515] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:42.308883  6968 raft_consensus.cc:493] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:42.310029  6970 raft_consensus.cc:2804] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:42.231467  6967 raft_consensus.cc:515] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:42.310585  6896 raft_consensus.cc:493] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:42.338795  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:42.297361  7046 consensus_queue.cc:1048] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:13:42.343056  6885 raft_consensus.cc:493] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:42.357534  5199 raft_consensus.cc:2468] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 3.
I20260709 12:13:42.343022  6950 leader_election.cc:290] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:42.360320  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:42.345961  6968 raft_consensus.cc:3060] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:42.375660  5267 raft_consensus.cc:2468] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 2.
I20260709 12:13:42.337656  7041 raft_consensus.cc:2749] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:42.361913  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:42.347777  6970 raft_consensus.cc:493] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:42.378217  5088 leader_election.cc:304] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:13:42.335631  7054 raft_consensus.cc:2749] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:42.332435  6962 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:42.352684  6848 raft_consensus.cc:2749] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:42.379849  6888 raft_consensus.cc:2804] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:42.311849  7049 raft_consensus.cc:515] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:42.357191  6885 raft_consensus.cc:3060] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:42.352597  7057 raft_consensus.cc:2804] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:42.350286  6975 raft_consensus.cc:515] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:42.383293  6970 raft_consensus.cc:3060] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:42.391835  6888 raft_consensus.cc:493] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:42.352948  6896 raft_consensus.cc:515] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:42.388347  7060 raft_consensus.cc:493] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.352559  6898 consensus_queue.cc:237] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:42.410228  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:42.411026  5267 raft_consensus.cc:2468] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 4.
I20260709 12:13:42.398365  7038 leader_election.cc:290] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:42.401297  7057 raft_consensus.cc:493] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:42.407752  6888 raft_consensus.cc:3060] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:42.436491  6962 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:42.406808  7037 leader_election.cc:290] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:13:42.442018  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 86699.1us
I20260709 12:13:42.434239  7057 raft_consensus.cc:3060] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:42.461239  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:42.462030  5198 raft_consensus.cc:2468] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 2.
W20260709 12:13:42.454571  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 120093us
W20260709 12:13:42.476001  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 387426us
I20260709 12:13:42.451540  6901 raft_consensus.cc:2804] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:42.454257  7064 raft_consensus.cc:493] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.481757  5801 leader_election.cc:304] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:42.482259  6962 raft_consensus.cc:493] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
W20260709 12:13:42.484908  7059 log.cc:927] Time spent T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 12:13:42.484251  7061 log.cc:927] Time spent T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:13:42.488329  5804 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:42.514365  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:42.469085  7007 leader_election.cc:290] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:42.508879  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:42.422953  7060 raft_consensus.cc:515] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:42.515208  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:42.535955  5198 raft_consensus.cc:2393] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 2: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:42.515033  5116 raft_consensus.cc:2468] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 2.
I20260709 12:13:42.503927  6929 raft_consensus.cc:493] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:42.547201  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:42.515540  7004 raft_consensus.cc:2804] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:42.521853  6950 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:42.547993  5124 raft_consensus.cc:2468] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 2.
I20260709 12:13:42.551887  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:42.535157  7062 raft_consensus.cc:493] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.557245  5122 raft_consensus.cc:2468] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 2.
W20260709 12:13:42.564034  7070 log.cc:927] Time spent T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:13:42.564983  7077 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.565615  7077 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:13:42.567303  7063 log.cc:927] Time spent T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 12:13:42.567912  7077 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:42.568598  7067 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.569110  7067 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:42.571238  7067 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:42.516235  6962 raft_consensus.cc:515] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:42.546355  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:42.552011  7004 raft_consensus.cc:493] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:42.583225  5125 raft_consensus.cc:2468] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 2.
I20260709 12:13:42.561012  6862 leader_election.cc:290] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:42.585134  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:42.509546  7064 raft_consensus.cc:515] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:42.596869  7064 leader_election.cc:290] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:42.596866  6957 raft_consensus.cc:515] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:42.594375  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:42.603976  7049 leader_election.cc:290] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:42.606217  6957 leader_election.cc:290] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:42.555626  6929 raft_consensus.cc:515] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:42.588925  7004 raft_consensus.cc:3060] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:42.606761  5119 raft_consensus.cc:2393] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 3: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:13:42.589234  6975 leader_election.cc:290] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:42.591848  6896 leader_election.cc:290] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:42.593219  5118 raft_consensus.cc:2468] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 3.
I20260709 12:13:42.579988  7062 raft_consensus.cc:515] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:42.627420  6848 raft_consensus.cc:493] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:42.639873  6848 raft_consensus.cc:515] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:42.643494  6848 leader_election.cc:290] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:42.643178  6885 raft_consensus.cc:515] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:42.644110  6848 raft_consensus.cc:493] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.644562  6848 raft_consensus.cc:515] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:42.628805  6975 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:42.648497  5265 raft_consensus.cc:2368] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 2. Current term is 3.
I20260709 12:13:42.621456  6980 raft_consensus.cc:515] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:42.645694  7038 raft_consensus.cc:493] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.653709  7074 raft_consensus.cc:493] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:42.660265  7060 leader_election.cc:290] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:13:42.660553  7068 log.cc:927] Time spent T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:13:42.668686  5200 raft_consensus.cc:2393] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 3: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:42.663080  7064 raft_consensus.cc:493] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:42.660265  7074 raft_consensus.cc:515] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:42.666153  6848 leader_election.cc:290] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:42.668570  6885 leader_election.cc:290] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:42.652699  6975 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:42.655007  6940 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:42.662621  7038 raft_consensus.cc:515] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:42.683454  6901 raft_consensus.cc:493] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:42.671761  6968 raft_consensus.cc:515] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:42.709578  6948 consensus_meta.cc:287] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.502s	user 0.006s	sys 0.005s
I20260709 12:13:42.693709  6885 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.724748  6929 leader_election.cc:290] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:42.698401  6962 leader_election.cc:290] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:42.686893  7064 raft_consensus.cc:515] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:42.718218  6901 raft_consensus.cc:3060] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:42.729981  6885 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:42.731475  7064 leader_election.cc:290] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:42.733254  6968 leader_election.cc:290] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:42.733254  6885 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:42.737280  5088 leader_election.cc:304] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
W20260709 12:13:42.739153  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 326698us
I20260709 12:13:42.745422  7001 raft_consensus.cc:493] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.750604  7001 raft_consensus.cc:515] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:42.762729  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:42.763002  5834 raft_consensus.cc:3060] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 3 LEARNER]: Advancing to term 4
I20260709 12:13:42.763301  5836 raft_consensus.cc:2468] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 4.
I20260709 12:13:42.754678  6940 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:42.771920  6980 leader_election.cc:290] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:42.728987  6948 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:42.723785  6888 raft_consensus.cc:515] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:42.745651  6866 raft_consensus.cc:2804] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:42.737280  7074 leader_election.cc:290] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:42.753172  7001 leader_election.cc:290] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:42.773783  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:42.758136  7038 leader_election.cc:290] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:42.770949  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:42.781834  5834 raft_consensus.cc:1275] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 4 LEARNER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:13:42.782539  5198 raft_consensus.cc:2393] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 5: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:42.781147  5836 raft_consensus.cc:2468] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 2.
I20260709 12:13:42.776212  6975 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:42.754805  6970 raft_consensus.cc:515] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:42.784891  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:42.773090  7090 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:42.784298  7062 leader_election.cc:290] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:42.779273  6866 raft_consensus.cc:493] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:42.787531  6866 raft_consensus.cc:3060] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:42.788136  6888 leader_election.cc:290] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:42.788347  6948 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:42.790243  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:42.790858  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:42.791571  5834 raft_consensus.cc:2468] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 3.
I20260709 12:13:42.793635  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:42.795799  5834 raft_consensus.cc:3060] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:42.796551  7071 log.cc:927] Time spent T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260709 12:13:42.798455  6970 leader_election.cc:290] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:42.800414  6967 leader_election.cc:290] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:42.791582  6950 raft_consensus.cc:2749] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:42.801281  5833 raft_consensus.cc:2393] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 4: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:13:42.801851  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:42.804001  6888 raft_consensus.cc:493] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:42.804639  6888 raft_consensus.cc:515] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:42.806753  6888 leader_election.cc:290] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:42.807767  6866 raft_consensus.cc:515] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:42.811311  5838 raft_consensus.cc:1275] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:42.790243  7090 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:42.813920  7090 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:42.815016  6866 leader_election.cc:290] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:42.815868  5804 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:13:42.816804  7038 raft_consensus.cc:2804] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:42.817308  7038 raft_consensus.cc:697] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 2 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
W20260709 12:13:42.818812  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 382837us
I20260709 12:13:42.818279  7038 consensus_queue.cc:237] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:42.822810  6999 raft_consensus.cc:493] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.823213  5164 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:42.823360  6999 raft_consensus.cc:515] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:42.824378  5164 leader_election.cc:304] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:42.826128  6965 raft_consensus.cc:2804] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:42.826531  6965 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:42.826853  6965 raft_consensus.cc:3060] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:42.829445  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:42.829782  7036 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.830247  7036 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:42.830608  7048 raft_consensus.cc:2804] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:42.831185  7048 raft_consensus.cc:493] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:42.831838  7048 raft_consensus.cc:3060] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:42.832252  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:42.832865  5196 raft_consensus.cc:2468] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 3.
I20260709 12:13:42.833875  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:42.825361  6980 raft_consensus.cc:493] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:42.834148  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:42.834705  6980 raft_consensus.cc:515] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:42.835163  7043 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:42.834849  5196 raft_consensus.cc:2468] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 2.
I20260709 12:13:42.829552  6971 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:42.837868  6971 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:42.839862  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:42.840553  5837 raft_consensus.cc:2468] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 3.
I20260709 12:13:42.841748  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:42.843014  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:42.843859  5831 raft_consensus.cc:2393] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 4: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:13:42.844193  5833 raft_consensus.cc:1275] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:13:42.845669  5194 raft_consensus.cc:2468] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 3.
I20260709 12:13:42.825882  6894 consensus_queue.cc:1048] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:42.834676  5195 raft_consensus.cc:2468] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 2.
I20260709 12:13:42.848186  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:42.848873  5837 raft_consensus.cc:2468] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 3.
I20260709 12:13:42.825685  6919 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:42.849767  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:42.850381  5837 raft_consensus.cc:2468] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 1.
I20260709 12:13:42.850186  6919 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:42.844703  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:42.851608  5831 raft_consensus.cc:2468] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 3.
I20260709 12:13:42.818204  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:42.869704  5835 raft_consensus.cc:2468] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 3.
I20260709 12:13:42.875607  5834 raft_consensus.cc:1275] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:42.853269  6919 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:42.851989  5021 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50918 (request call id 224) took 1603 ms. Trace:
I20260709 12:13:42.883697  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:42.884599  6866 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.884292  5801 leader_election.cc:400] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 election: Vote denied by peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455) with higher term. Message: Invalid argument: T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 3. Current term is 4.
I20260709 12:13:42.884914  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:42.928323  5265 raft_consensus.cc:3060] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:42.928325  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 53304.9us
I20260709 12:13:42.924261  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:42.854848  7002 raft_consensus.cc:493] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:42.854640  7072 raft_consensus.cc:493] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:42.814930  6879 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.883652  5163 leader_election.cc:400] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709) with higher term. Message: Invalid argument: T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 2. Current term is 3.
I20260709 12:13:42.937320  5163 leader_election.cc:403] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:42.922930  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:42.942127  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:42.891726  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:42.940656  5088 leader_election.cc:304] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:42.954195  5196 raft_consensus.cc:2468] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 2.
I20260709 12:13:42.954311  5838 raft_consensus.cc:3060] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:42.943436  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:42.955174  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:42.955423  5801 leader_election.cc:304] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:42.955818  5193 raft_consensus.cc:2468] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 2.
I20260709 12:13:42.955983  5835 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 1.
I20260709 12:13:42.887084  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:42.845292  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:42.892156  5267 raft_consensus.cc:1275] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:13:42.901656  5238 leader_election.cc:304] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:42.930823  5191 raft_consensus.cc:2393] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 3: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:42.922139  6866 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:42.925719  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:42.883091  6949 consensus_queue.cc:1048] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:13:42.883380  7056 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.933789  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:42.966231  5200 raft_consensus.cc:3060] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:42.966427  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:13:42.938665  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 76877.6us
I20260709 12:13:42.957154  5273 raft_consensus.cc:2468] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 2.
I20260709 12:13:42.887552  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:42.959466  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:42.967986  5191 raft_consensus.cc:3060] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:42.970464  5270 raft_consensus.cc:2393] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 2: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:13:42.957261  5801 leader_election.cc:304] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
W20260709 12:13:42.963770  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 62227us
I20260709 12:13:42.972186  5238 leader_election.cc:304] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:13:42.885182  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:42.973062  5268 raft_consensus.cc:3060] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:42.981735  5191 raft_consensus.cc:2468] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 4.
I20260709 12:13:42.931941  7090 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:42.930276  7002 raft_consensus.cc:515] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:42.986323  5238 leader_election.cc:304] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:13:42.989023  5801 leader_election.cc:304] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:43.000630  5268 raft_consensus.cc:2468] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 5.
I20260709 12:13:42.962003  7049 raft_consensus.cc:2804] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:42.904536  7057 raft_consensus.cc:515] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:43.128543  7057 leader_election.cc:290] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:42.889012  7004 raft_consensus.cc:515] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:43.129714  5836 raft_consensus.cc:2393] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 3: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:13:43.130193  6965 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:42.983884  7038 raft_consensus.cc:2804] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:42.966264  5829 raft_consensus.cc:2468] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 3.
I20260709 12:13:43.131093  7038 raft_consensus.cc:493] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:43.131527  7038 raft_consensus.cc:3060] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:43.131726  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:43.132588  5829 raft_consensus.cc:2393] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 4: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:13:42.956707  6879 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:43.133630  5832 raft_consensus.cc:2468] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 2.
I20260709 12:13:43.134460  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:43.134963  6879 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:42.938024  7072 raft_consensus.cc:515] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:43.155738  7026 log.cc:927] Time spent T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.152s	user 0.002s	sys 0.003s
I20260709 12:13:43.156620  7072 leader_election.cc:290] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:42.986670  7056 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:43.112178  5838 raft_consensus.cc:2468] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 5.
I20260709 12:13:42.953661  6894 raft_consensus.cc:3060] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:13:42.962150  7041 raft_consensus.cc:2804] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:43.162448  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:42.975103  7067 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:42.974972  7062 raft_consensus.cc:2804] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:42.999687  5166 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:43.116065  5265 raft_consensus.cc:2468] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 3.
W20260709 12:13:43.183020  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 183403us
I20260709 12:13:43.183946  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:43.118249  6866 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:43.119753  7046 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:43.120414  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:43.123382  5837 raft_consensus.cc:1275] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:43.125114  7002 leader_election.cc:290] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:43.123960  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:42.975492  7045 raft_consensus.cc:493] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:43.130611  7004 leader_election.cc:290] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:43.134596  7036 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:43.195737  5838 raft_consensus.cc:1275] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:43.186107  7067 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:43.003568  6975 raft_consensus.cc:2804] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:43.196341  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:43.135612  7049 raft_consensus.cc:493] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.196672  6975 raft_consensus.cc:493] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:43.196497  7045 raft_consensus.cc:515] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:43.196946  7049 raft_consensus.cc:3060] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:43.197099  6975 raft_consensus.cc:3060] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:43.197599  7067 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:43.135604  6999 leader_election.cc:290] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:43.137162  6980 leader_election.cc:290] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:43.139102  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:43.135854  6971 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:43.142627  5200 raft_consensus.cc:2468] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
I20260709 12:13:43.142081  5019 catalog_manager.cc:5697] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 1 to 2, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 2 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:43.204980  5019 catalog_manager.cc:5697] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 3 to 4, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 4 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:43.144364  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:43.206748  5836 raft_consensus.cc:2393] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 3: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:13:43.135143  5829 raft_consensus.cc:2468] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
I20260709 12:13:43.145496  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:43.207737  5834 raft_consensus.cc:2468] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
W20260709 12:13:43.207790  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 96322.3us
I20260709 12:13:43.203460  5832 raft_consensus.cc:3060] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:43.145174  7048 raft_consensus.cc:515] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:43.145689  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 156731us
I20260709 12:13:43.211753  5801 leader_election.cc:304] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:13:43.146812  6898 raft_consensus.cc:2804] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:42.884727  5021 rpcz_store.cc:276] 0709 12:13:41.248687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.248928 (+   241us) service_pool.cc:224] Handling call
0709 12:13:42.851883 (+1602955us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:41.689986 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:41.841991 (+152005us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:41.851119 (+  9128us) write_op.cc:435] Acquired schema lock
0709 12:13:41.864731 (+ 13612us) tablet.cc:662] Decoding operations
0709 12:13:41.973836 (+109105us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:41.973923 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:41.973953 (+    30us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:13:41.974390 (+   437us) tablet.cc:701] Row locks acquired
0709 12:13:41.974428 (+    38us) write_op.cc:260] PREPARE: finished
0709 12:13:41.974645 (+   217us) write_op.cc:270] Start()
0709 12:13:41.974801 (+   156us) write_op.cc:276] Timestamp: P: 1783599221974574 usec, L: 0
0709 12:13:41.974839 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 12:13:41.975677 (+   838us) log.cc:844] Serialized 919 byte log entry
0709 12:13:42.588418 (+612741us) op_driver.cc:464] REPLICATION: finished
0709 12:13:42.771718 (+183300us) write_op.cc:301] APPLY: starting
0709 12:13:42.771867 (+   149us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:42.772036 (+   169us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:42.772200 (+   164us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:42.787257 (+ 15057us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:42.787626 (+   369us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:13:42.787668 (+    42us) write_op.cc:312] APPLY: finished
0709 12:13:42.787965 (+   297us) log.cc:844] Serialized 29 byte log entry
0709 12:13:42.788166 (+   201us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:42.788255 (+    89us) write_op.cc:454] Released schema lock
0709 12:13:42.788316 (+    61us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":120396,"reported_tablets":2,"spinlock_wait_cycles":3328,"child_traces":[["op",{"apply.queue_time_us":163357,"apply.run_cpu_time_us":2992,"apply.run_wall_time_us":18432,"num_ops":2,"prepare.queue_time_us":156701,"prepare.run_cpu_time_us":14787,"prepare.run_wall_time_us":539021,"raft.queue_time_us":359222,"raft.run_cpu_time_us":40580,"raft.run_wall_time_us":240518,"replication_time_us":573326,"spinlock_wait_cycles":2053888,"thread_start_us":350478,"threads_started":4,"wal-append.queue_time_us":335821}]]}
I20260709 12:13:43.149703  5804 leader_election.cc:304] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:13:43.150511  6970 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.152444  5018 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33896 (request call id 317) took 1970 ms. Trace:
I20260709 12:13:43.182529  7062 raft_consensus.cc:493] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:43.163672  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:43.195601  7066 raft_consensus.cc:2804] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:43.167486  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:43.223423  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:43.169823  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:43.164904  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:43.184932  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
W20260709 12:13:43.185294  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 199007us
I20260709 12:13:43.195379  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:43.192023  5193 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 1.
I20260709 12:13:43.123746  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:43.235757  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:43.236634  5191 raft_consensus.cc:2368] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 2. Current term is 3.
I20260709 12:13:43.194866  5835 raft_consensus.cc:2393] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 4: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:13:43.195218  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:43.024125  7090 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:43.198794  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 49959.8us
I20260709 12:13:43.192320  5833 raft_consensus.cc:2468] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 1.
I20260709 12:13:43.163139  5116 raft_consensus.cc:2468] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 3.
I20260709 12:13:43.192158  6940 raft_consensus.cc:2804] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:43.246666  5192 raft_consensus.cc:1240] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 3. Current term is 4. Ops: []
W20260709 12:13:43.219944  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 70351.4us
I20260709 12:13:43.220679  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:43.224095  5194 raft_consensus.cc:3060] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:43.186569  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:43.250743  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:43.223662  5268 raft_consensus.cc:2393] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 5: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:43.224838  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:43.253005  5265 raft_consensus.cc:3060] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:43.225244  5270 raft_consensus.cc:2393] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 2: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:13:43.224673  5125 raft_consensus.cc:2368] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 2. Current term is 3.
I20260709 12:13:43.224805  5238 leader_election.cc:304] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:13:43.227679  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:43.255851  5199 raft_consensus.cc:2468] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 3.
I20260709 12:13:43.228008  5019 catalog_manager.cc:5697] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 3 to 4, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 4 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:43.246482  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:43.258630  7002 raft_consensus.cc:493] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:43.258148  5019 catalog_manager.cc:5697] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 1 to 2, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 2 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:43.259207  7002 raft_consensus.cc:515] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:43.260053  6898 raft_consensus.cc:697] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 4 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:13:43.126870  6901 raft_consensus.cc:515] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:43.238942  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:43.216362  5018 rpcz_store.cc:276] 0709 12:13:41.181971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.183285 (+  1314us) service_pool.cc:224] Handling call
0709 12:13:43.152377 (+1969092us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:42.220736 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:42.270002 (+ 49266us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:42.270046 (+    44us) write_op.cc:435] Acquired schema lock
0709 12:13:42.270062 (+    16us) tablet.cc:662] Decoding operations
0709 12:13:42.270626 (+   564us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:42.270671 (+    45us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:42.270699 (+    28us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:13:42.271079 (+   380us) tablet.cc:701] Row locks acquired
0709 12:13:42.271100 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:13:42.271236 (+   136us) write_op.cc:270] Start()
0709 12:13:42.271339 (+   103us) write_op.cc:276] Timestamp: P: 1783599222271192 usec, L: 0
0709 12:13:42.271360 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:13:42.271984 (+   624us) log.cc:844] Serialized 1759 byte log entry
0709 12:13:42.726682 (+454698us) op_driver.cc:464] REPLICATION: finished
0709 12:13:42.809819 (+ 83137us) write_op.cc:301] APPLY: starting
0709 12:13:42.809934 (+   115us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:42.810152 (+   218us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:42.810289 (+   137us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:42.810978 (+   689us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:42.811194 (+   216us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:13:42.811246 (+    52us) write_op.cc:312] APPLY: finished
0709 12:13:42.811522 (+   276us) log.cc:844] Serialized 41 byte log entry
0709 12:13:42.811699 (+   177us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:42.811809 (+   110us) write_op.cc:454] Released schema lock
0709 12:13:42.811852 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:42.812242 (+   390us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:42.812272 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":235177,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":79420,"apply.run_cpu_time_us":2397,"apply.run_wall_time_us":2397,"num_ops":4,"prepare.queue_time_us":699579,"prepare.run_cpu_time_us":2872,"prepare.run_wall_time_us":62968,"replication_time_us":449023,"thread_start_us":49584,"threads_started":1}]]}
I20260709 12:13:43.248045  5124 raft_consensus.cc:2468] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 3.
I20260709 12:13:43.242528  5801 leader_election.cc:400] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 election: Vote denied by peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455) with higher term. Message: Invalid argument: T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 2. Current term is 3.
I20260709 12:13:43.262854  5801 leader_election.cc:403] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:13:43.215121  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:43.239723  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:43.200109  7045 leader_election.cc:290] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:43.263767  5266 raft_consensus.cc:2393] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 3: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:13:43.229820  7004 raft_consensus.cc:2804] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:43.263500  5274 raft_consensus.cc:2468] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 4.
I20260709 12:13:43.223475  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:43.259863  5019 catalog_manager.cc:5697] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 1 to 2, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 2 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:43.231832  7062 raft_consensus.cc:3060] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:43.269337  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:43.286336  5199 raft_consensus.cc:2393] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 3: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:43.232134  7066 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.215718  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:13:43.273797  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 49070.9us
I20260709 12:13:43.201081  7046 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:43.229651  7040 raft_consensus.cc:2804] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:43.279268  5801 leader_election.cc:304] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:43.283941  7086 raft_consensus.cc:2804] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:43.326812  7086 raft_consensus.cc:493] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:43.261101  6898 consensus_queue.cc:237] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:43.327266  7086 raft_consensus.cc:3060] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:43.218343  5121 raft_consensus.cc:2468] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 4.
W20260709 12:13:43.330740  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 51561.6us
I20260709 12:13:43.336513  7046 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:43.262267  7056 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:43.295200  5194 raft_consensus.cc:2468] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 3.
I20260709 12:13:43.279896  5265 raft_consensus.cc:2468] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 4.
I20260709 12:13:43.292660  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:43.293771  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:43.294098  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:43.345661  5268 raft_consensus.cc:2393] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 3: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:43.346490  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:43.275801  5273 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
mode: GRACEFUL
new_leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
 from {username='slave'} at 127.0.0.1:42506
I20260709 12:13:43.288301  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:43.245119  7041 raft_consensus.cc:493] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:43.263913  6940 raft_consensus.cc:493] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.359139  5832 raft_consensus.cc:2468] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
I20260709 12:13:43.360351  5199 raft_consensus.cc:2410] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:13:43.344954  5266 raft_consensus.cc:2468] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
I20260709 12:13:43.361533  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:43.362725  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:43.363888  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:43.353610  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:43.364988  5834 raft_consensus.cc:2468] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 2.
I20260709 12:13:43.350692  5163 leader_election.cc:304] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:43.366971  5163 leader_election.cc:304] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:43.367854  5163 leader_election.cc:304] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:43.370231  5238 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:13:43.230594  6970 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:43.374603  6888 raft_consensus.cc:2804] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:43.410512  6888 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:43.410748  7092 log.cc:927] Time spent T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
I20260709 12:13:43.410920  6888 raft_consensus.cc:3060] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:43.411192  6999 raft_consensus.cc:2804] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:43.374778  7037 raft_consensus.cc:2804] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:43.394563  5268 raft_consensus.cc:2468] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 4.
I20260709 12:13:43.413782  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:43.409830  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:43.277033  7004 raft_consensus.cc:493] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.415042  5266 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 2.
I20260709 12:13:43.292421  7066 raft_consensus.cc:3060] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:43.415609  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 165426us
W20260709 12:13:43.415992  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 297303us
I20260709 12:13:43.434348  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:43.435148  5199 raft_consensus.cc:2468] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 2.
I20260709 12:13:43.391888  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:43.440266  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:43.440905  5197 raft_consensus.cc:2468] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 4.
I20260709 12:13:43.420768  5268 raft_consensus.cc:2468] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 3.
W20260709 12:13:43.400022  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 281286us
I20260709 12:13:43.284377  7001 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:43.449945  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:43.350590  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:43.450747  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:43.451122  5237 leader_election.cc:304] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:43.358100  7040 raft_consensus.cc:493] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.373024  7002 leader_election.cc:290] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:43.411774  6999 raft_consensus.cc:697] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:43.450170  5163 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:43.452167  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:43.359899  7043 raft_consensus.cc:2804] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:43.464972  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:43.373674  6940 raft_consensus.cc:3060] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:43.359618  7041 raft_consensus.cc:3060] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:43.375340  6949 raft_consensus.cc:2804] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:43.461362  5089 leader_election.cc:304] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:13:43.474072  5089 leader_election.cc:304] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:13:43.475611  5089 leader_election.cc:304] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:13:43.372354  7080 raft_consensus.cc:2749] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455) with higher term. Message: Invalid argument: T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 2. Current term is 3.
W20260709 12:13:43.484985  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 143397us
I20260709 12:13:43.465762  5199 raft_consensus.cc:2393] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 4: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:43.463948  5192 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
I20260709 12:13:43.456382  7037 raft_consensus.cc:697] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:43.489526  7037 consensus_queue.cc:237] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:43.491870  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:43.492565  5125 raft_consensus.cc:3060] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:43.445899  7004 raft_consensus.cc:3060] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:43.373229  6980 consensus_queue.cc:1048] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.093s
I20260709 12:13:43.499548  5125 raft_consensus.cc:2468] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 4.
W20260709 12:13:43.500376  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 49340.5us
I20260709 12:13:43.452791  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:43.475330  5238 leader_election.cc:304] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:13:43.461187  7040 raft_consensus.cc:3060] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:43.509451  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:43.510569  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:43.511538  5268 raft_consensus.cc:2468] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
I20260709 12:13:43.512483  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:43.503417  5088 leader_election.cc:304] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:43.461645  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:43.504487  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:43.462985  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:43.464944  7043 raft_consensus.cc:493] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:43.472633  6949 raft_consensus.cc:493] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.515008  5088 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:43.515918  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:43.506011  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:43.508145  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:43.502035  6965 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:43.485733  6862 raft_consensus.cc:2804] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:43.535162  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:43.558099  6901 leader_election.cc:290] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:43.558662  5119 raft_consensus.cc:2468] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 4.
I20260709 12:13:43.558848  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:43.486037  6879 raft_consensus.cc:2804] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:43.560148  6879 raft_consensus.cc:493] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.560540  6879 raft_consensus.cc:3060] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:43.519304  6875 raft_consensus.cc:2749] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:43.536756  7043 raft_consensus.cc:3060] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:43.536118  5118 raft_consensus.cc:3060] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:43.487843  7002 raft_consensus.cc:2804] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:43.458926  7001 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:43.542130  5199 raft_consensus.cc:3060] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:43.542649  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:43.574294  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:43.575052  5834 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
I20260709 12:13:43.559962  6965 raft_consensus.cc:1064] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808: attempting to promote NON_VOTER bce73265e27d4b30a4dcc1e491305088 to VOTER
I20260709 12:13:43.486373  7103 consensus_queue.cc:1048] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 12:13:43.546190  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:43.464222  7067 consensus_queue.cc:1048] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 12:13:43.569020  7015 raft_consensus.cc:2804] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:43.582036  5124 raft_consensus.cc:3060] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:43.582342  7015 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.549592  7109 raft_consensus.cc:2804] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:43.582772  7015 raft_consensus.cc:3060] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:43.583622  7109 raft_consensus.cc:493] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.551872  6894 raft_consensus.cc:2749] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709) with higher term. Message: Invalid argument: T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 2. Current term is 3.
I20260709 12:13:43.485544  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:43.585014  5121 raft_consensus.cc:2410] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:13:43.586154  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:43.586861  5121 raft_consensus.cc:2468] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 3.
I20260709 12:13:43.587982  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:43.504666  6938 raft_consensus.cc:493] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:43.506814  7081 raft_consensus.cc:2804] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:43.589788  7081 raft_consensus.cc:697] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:43.589669  6938 raft_consensus.cc:515] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:43.590732  7081 consensus_queue.cc:237] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:43.591826  6938 leader_election.cc:290] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:43.557870  7090 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:43.557757  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:43.524021  5801 leader_election.cc:304] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:43.592670  5124 raft_consensus.cc:2468] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 3.
I20260709 12:13:43.594318  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:43.595088  5123 raft_consensus.cc:2393] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 3: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:13:43.594849  6965 consensus_queue.cc:237] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:43.536325  5191 raft_consensus.cc:1240] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:43.541086  6949 raft_consensus.cc:3060] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:43.560464  5240 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:13:43.597260  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:13:43.562835  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 47920.1us
I20260709 12:13:43.598805  5088 leader_election.cc:304] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:43.541942  5164 leader_election.cc:304] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:43.469129  7045 consensus_queue.cc:1048] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 12:13:43.468705  7046 consensus_queue.cc:1048] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:13:43.603503  5272 raft_consensus.cc:2393] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 3: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:13:43.584154  7109 raft_consensus.cc:3060] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:43.581274  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 112918us
I20260709 12:13:43.594964  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:13:43.600099  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 58221.4us
I20260709 12:13:43.609819  5804 leader_election.cc:304] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
W20260709 12:13:43.612321  5164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:43.559720  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:43.565615  7007 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:43.615049  5804 leader_election.cc:400] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 election: Vote denied by peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443) with higher term. Message: Invalid argument: T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 2. Current term is 3.
I20260709 12:13:43.569867  7002 raft_consensus.cc:493] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.621268  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:43.621989  5123 raft_consensus.cc:2468] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 3.
W20260709 12:13:43.614068  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 96896.8us
I20260709 12:13:43.574918  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:43.562798  6862 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.616011  5804 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:43.614341  5088 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:43.628132  6862 raft_consensus.cc:3060] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:43.637718  5804 leader_election.cc:304] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:13:43.589365  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:13:43.639377  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 164116us
I20260709 12:13:43.638916  5804 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
W20260709 12:13:43.637181  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 113243us
I20260709 12:13:43.606715  7037 raft_consensus.cc:2764] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:13:43.605979  7067 raft_consensus.cc:2804] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:43.610224  7048 leader_election.cc:290] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:43.636498  7002 raft_consensus.cc:3060] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:43.644402  6950 raft_consensus.cc:2804] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:43.667850  6950 raft_consensus.cc:697] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 3 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:13:43.668217  7104 consensus_queue.cc:1059] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:43.669940  7004 raft_consensus.cc:515] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:43.671030  7045 raft_consensus.cc:3055] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:43.671422  7045 raft_consensus.cc:740] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:43.672123  7004 leader_election.cc:290] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:43.640419  6975 raft_consensus.cc:515] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:43.674461  7056 raft_consensus.cc:2804] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:43.674912  7056 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.675249  7056 raft_consensus.cc:3060] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:43.622133  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:43.639467  7090 raft_consensus.cc:2804] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:43.635783  5119 raft_consensus.cc:2468] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 1.
I20260709 12:13:43.680289  5833 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 1.
I20260709 12:13:43.655006  7128 raft_consensus.cc:2804] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:43.657783  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:43.644256  6898 raft_consensus.cc:2749] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:43.651201  7072 raft_consensus.cc:2804] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:43.675985  6975 leader_election.cc:290] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:43.650642  5121 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 2.
I20260709 12:13:43.636298  7007 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:43.668824  6950 consensus_queue.cc:237] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:43.658439  7116 raft_consensus.cc:2804] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:43.703630  7072 raft_consensus.cc:493] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.749282  7072 raft_consensus.cc:3060] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:43.715787  6901 raft_consensus.cc:2804] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:43.703902  7128 raft_consensus.cc:493] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.705471  6970 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:43.727597  7001 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:13:43.728161  7038 consensus_meta.cc:287] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.596s	user 0.010s	sys 0.000s
W20260709 12:13:43.731362  7049 consensus_meta.cc:287] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.534s	user 0.008s	sys 0.001s
W20260709 12:13:43.796190  5163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:43.682150  7090 raft_consensus.cc:493] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.744705  5193 raft_consensus.cc:2468] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 3.
I20260709 12:13:43.636437  6999 consensus_queue.cc:237] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:43.661726  7054 consensus_queue.cc:1059] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.085s
I20260709 12:13:43.672215  7045 consensus_queue.cc:260] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:43.660971  7066 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:43.713768  6940 raft_consensus.cc:515] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:43.747624  7116 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:43.772234  7128 raft_consensus.cc:3060] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:43.802454  6862 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:43.772811  7086 raft_consensus.cc:515] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:43.835922  7121 log.cc:927] Time spent T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:13:43.804839  7090 raft_consensus.cc:3060] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:43.779973  7038 raft_consensus.cc:515] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:43.847667  6888 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:43.873649  7038 leader_election.cc:290] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:43.874229  6888 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:43.850399  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:43.874919  5274 raft_consensus.cc:2468] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
I20260709 12:13:43.875123  5268 raft_consensus.cc:2393] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 4: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:13:43.852581  7056 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:43.854799  6940 leader_election.cc:290] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:43.839152  7116 raft_consensus.cc:3060] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:43.832002  6949 raft_consensus.cc:515] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:43.881928  6949 leader_election.cc:290] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:43.862654  5267 raft_consensus.cc:2368] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 2. Current term is 3.
I20260709 12:13:43.860448  5166 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:43.884406  5166 leader_election.cc:304] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:43.885316  5199 raft_consensus.cc:2468] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 3.
I20260709 12:13:43.869516  6862 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:43.871513  7086 leader_election.cc:290] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:43.891723  6949 raft_consensus.cc:2749] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:43.886292  6901 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:43.893314  6901 raft_consensus.cc:3060] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:43.806505  7049 raft_consensus.cc:515] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:43.878252  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:43.879803  5121 raft_consensus.cc:1240] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:43.847509  7007 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:43.902206  7002 raft_consensus.cc:515] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:43.903594  7049 leader_election.cc:290] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:43.904402  5122 raft_consensus.cc:2393] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 3: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:13:43.887756  7066 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:43.892642  5118 raft_consensus.cc:2468] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 3.
I20260709 12:13:43.863824  7036 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:43.906960  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:43.907135  7036 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:43.879252  5829 raft_consensus.cc:2468] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 2.
I20260709 12:13:43.909758  7056 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:43.815704  7062 raft_consensus.cc:515] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:43.920878  7041 raft_consensus.cc:515] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:43.892799  6879 raft_consensus.cc:515] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:43.923288  7062 leader_election.cc:290] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:43.838510  7119 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:43.925228  6879 leader_election.cc:290] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:43.924975  7119 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:43.926076  5120 raft_consensus.cc:2368] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 3. Current term is 4.
I20260709 12:13:43.890801  5166 leader_election.cc:304] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:43.892506  7037 raft_consensus.cc:2804] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:43.927592  5166 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:13:43.928159  7037 raft_consensus.cc:697] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:43.928817  5166 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:13:43.915189  7036 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:43.929759  7036 raft_consensus.cc:2749] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:43.913024  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:43.911796  5272 raft_consensus.cc:2393] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 4: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:13:43.914639  7002 leader_election.cc:290] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:43.922417  5269 raft_consensus.cc:2468] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 3.
I20260709 12:13:43.936000  7048 raft_consensus.cc:2804] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:43.936517  7048 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:43.936870  7048 raft_consensus.cc:3060] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:43.929082  7037 consensus_queue.cc:237] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:43.942292  6862 raft_consensus.cc:2804] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:43.942824  6862 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:43.943192  6862 raft_consensus.cc:3060] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:43.918864  5117 raft_consensus.cc:1275] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:43.930047  7119 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:43.947855  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:43.950598  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:43.955638  6968 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:43.957899  6968 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:43.959092  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:43.960023  6968 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:43.960345  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:43.961001  5121 raft_consensus.cc:3060] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:43.963443  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:43.964852  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:43.968657  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:43.969424  5269 raft_consensus.cc:3060] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:43.974514  5163 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:43.974747  7080 raft_consensus.cc:3055] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:43.976233  7080 raft_consensus.cc:740] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:13:43.971802  5166 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:43.989656  7119 raft_consensus.cc:2749] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:43.982981  7080 consensus_queue.cc:260] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:43.982507  7128 raft_consensus.cc:515] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:43.993542  7128 leader_election.cc:290] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:43.999115  5166 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:13:44.001155  5165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:44.016075  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 455642us
I20260709 12:13:43.852581  7040 raft_consensus.cc:515] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:44.018229  7119 raft_consensus.cc:2749] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:44.020236  7120 raft_consensus.cc:2749] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:44.026218  7043 raft_consensus.cc:515] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:43.890321  7109 raft_consensus.cc:515] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:44.020809  7048 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:44.055838  5018 catalog_manager.cc:5697] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 3 to 4, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 4 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:13:44.058254  5018 catalog_manager.cc:5697] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 2 to 3, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 3 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:13:44.066154  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 438605us
I20260709 12:13:44.067529  5267 raft_consensus.cc:1275] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:13:44.022282  7015 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:44.047878  7072 raft_consensus.cc:515] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:44.082963  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 439553us
I20260709 12:13:44.103219  5240 leader_election.cc:304] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:13:44.120901  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:44.122205  5193 raft_consensus.cc:2393] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 4: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:44.102965  6898 raft_consensus.cc:493] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.067705  5269 raft_consensus.cc:2468] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 4.
I20260709 12:13:44.113152  5018 catalog_manager.cc:5697] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 2 to 3, leader changed from bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 3 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
W20260709 12:13:44.073055  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 444281us
I20260709 12:13:44.136571  5088 leader_election.cc:304] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:44.122697  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:44.120901  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:44.123721  5194 raft_consensus.cc:1240] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:44.124727  5191 raft_consensus.cc:1275] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:44.139853  5124 raft_consensus.cc:2393] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 4: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:13:44.128054  6898 raft_consensus.cc:515] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:44.142789  5266 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.009s	sys 0.009s
W20260709 12:13:44.143139  5266 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.009s	sys 0.009s
I20260709 12:13:44.145733  5018 catalog_manager.cc:5697] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 1 to 2, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 2 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:44.109622  7116 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:44.156324  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:44.159348  5237 leader_election.cc:304] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:13:44.100557  5270 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.013s	sys 0.013s
I20260709 12:13:44.162568  5163 leader_election.cc:304] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:44.164764  5237 leader_election.cc:304] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:13:44.165601  5270 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.014s	sys 0.013s
I20260709 12:13:44.166342  5273 raft_consensus.cc:606] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Received request to transfer leadership to TS dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:44.166769  5273 raft_consensus.cc:614] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:44.142658  7038 raft_consensus.cc:493] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:44.174966  5274 raft_consensus.cc:1275] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:44.116806  6949 consensus_queue.cc:1048] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:13:44.159171  7103 raft_consensus.cc:2804] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:44.178273  5197 raft_consensus.cc:2468] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 2.
I20260709 12:13:44.180398  5237 leader_election.cc:304] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
W20260709 12:13:44.182367  5265 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.071s	sys 0.088s
W20260709 12:13:44.183079  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 79952.2us
W20260709 12:13:44.184481  5265 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.071s	sys 0.089s
W20260709 12:13:44.183995  5123 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.025s	sys 0.019s
W20260709 12:13:44.185055  5123 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.025s	sys 0.019s
W20260709 12:13:44.185304  5164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:44.184041  5237 leader_election.cc:304] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:44.170979  7128 raft_consensus.cc:2749] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:44.170341  7119 raft_consensus.cc:2804] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:13:44.201190  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 45759.6us
I20260709 12:13:44.189981  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:44.186739  5240 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:44.191942  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:44.198767  5198 raft_consensus.cc:2468] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 2.
I20260709 12:13:44.194411  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:44.196041  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:44.196599  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:44.211117  5191 raft_consensus.cc:2393] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 4: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:44.147513  5018 catalog_manager.cc:5697] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 2 to 4, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 4 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:44.197105  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:44.172986  7041 leader_election.cc:290] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:44.211215  5266 raft_consensus.cc:2393] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 4: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:44.211238  5265 raft_consensus.cc:2368] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 3. Current term is 4.
I20260709 12:13:44.211732  5194 raft_consensus.cc:3060] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:44.178164  7109 leader_election.cc:290] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:44.142052  6901 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:44.181182  7080 raft_consensus.cc:3060] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:44.179895  7045 raft_consensus.cc:3060] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:44.181501  7103 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:44.240543  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:44.197616  7118 raft_consensus.cc:2804] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:44.197613  7056 raft_consensus.cc:2804] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:44.226154  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:44.183372  6975 raft_consensus.cc:2749] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:44.247975  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:44.234977  5194 raft_consensus.cc:2468] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 3.
I20260709 12:13:44.236657  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:44.208261  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:44.181770  5830 raft_consensus.cc:2468] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
I20260709 12:13:44.198539  5801 leader_election.cc:304] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:44.238996  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:44.197763  7086 raft_consensus.cc:2804] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:44.238334  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:44.255911  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:44.251845  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:44.253265  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:44.267028  5265 raft_consensus.cc:3060] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:44.267695  5200 raft_consensus.cc:2393] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 3: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:13:44.258201  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:44.248878  5193 raft_consensus.cc:3060] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:44.250504  5240 leader_election.cc:400] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Vote denied by peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443) with higher term. Message: Invalid argument: T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 3. Current term is 4.
I20260709 12:13:44.220055  7043 leader_election.cc:290] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:44.261106  5237 leader_election.cc:304] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:44.212502  7078 raft_consensus.cc:2749] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:44.222280  7119 raft_consensus.cc:697] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:44.258803  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:44.282124  5267 raft_consensus.cc:3060] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:44.278343  5088 leader_election.cc:304] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:44.273252  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:44.284513  5120 raft_consensus.cc:3060] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:44.272317  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
W20260709 12:13:44.266961  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 68484us
I20260709 12:13:44.286055  5122 raft_consensus.cc:2368] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 3. Current term is 4.
I20260709 12:13:44.286968  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:44.228509  7040 leader_election.cc:290] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:44.265014  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:44.274326  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:44.207635  6968 consensus_queue.cc:1059] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 12:13:44.180368  7038 raft_consensus.cc:515] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:44.294081  5117 raft_consensus.cc:2393] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 4: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:13:44.287679  5122 raft_consensus.cc:2368] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 3. Current term is 4.
I20260709 12:13:44.247520  7103 raft_consensus.cc:3060] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:44.246011  7126 raft_consensus.cc:493] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:44.213181  7057 consensus_queue.cc:1048] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 12:13:44.299345  5265 raft_consensus.cc:2468] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 4.
I20260709 12:13:44.300046  5273 raft_consensus.cc:2393] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 2: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:13:44.278226  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:44.253851  7056 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:44.302112  5088 leader_election.cc:304] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:44.291990  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
W20260709 12:13:44.273052  7067 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.024s	sys 0.016s
I20260709 12:13:44.311599  5088 leader_election.cc:304] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:44.274290  7054 raft_consensus.cc:2804] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:44.311635  7056 raft_consensus.cc:3060] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:44.330389  5804 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.017s	sys 0.053s
I20260709 12:13:44.288736  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:44.275970  7118 raft_consensus.cc:697] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 3 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
W20260709 12:13:44.331348  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 43731us
I20260709 12:13:44.332592  5267 raft_consensus.cc:2468] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 4.
W20260709 12:13:44.331609  5804 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.017s	sys 0.054s
I20260709 12:13:44.312862  7048 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:13:44.335502  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 696572us
I20260709 12:13:44.335389  5193 raft_consensus.cc:2468] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 4.
I20260709 12:13:44.305298  5119 raft_consensus.cc:2368] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 2. Current term is 3.
I20260709 12:13:44.340338  7043 raft_consensus.cc:3055] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:44.340847  5269 raft_consensus.cc:2368] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 2. Current term is 3.
I20260709 12:13:44.341094  7054 raft_consensus.cc:697] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 2 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:13:44.342319  5801 leader_election.cc:304] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:13:44.430886  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 88637.5us
I20260709 12:13:44.432303  5801 leader_election.cc:304] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:44.320873  7105 raft_consensus.cc:2749] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:44.346653  7118 consensus_queue.cc:237] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:44.347926  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:44.349588  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:44.436861  5117 raft_consensus.cc:2393] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 4: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:13:44.438220  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:44.337839  6879 raft_consensus.cc:2749] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:44.344805  6862 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:44.352222  7090 raft_consensus.cc:515] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:44.352617  5265 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
mode: GRACEFUL
new_leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
 from {username='slave'} at 127.0.0.1:42506
I20260709 12:13:44.452919  5265 raft_consensus.cc:606] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Received request to transfer leadership to TS ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:44.453284  5265 raft_consensus.cc:614] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:44.321614  6885 raft_consensus.cc:2804] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:44.279084  7036 consensus_queue.cc:1048] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
W20260709 12:13:44.353245  7067 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.030s	sys 0.016s
I20260709 12:13:44.352165  5120 raft_consensus.cc:2468] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 4.
W20260709 12:13:44.450466  7081 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.010s	sys 0.036s
I20260709 12:13:44.361320  7041 raft_consensus.cc:493] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
W20260709 12:13:44.362190  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:44.462200  5089 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:13:44.464238  5089 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:13:44.364228  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:44.366026  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:44.465448  5836 raft_consensus.cc:2368] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 3. Current term is 4.
I20260709 12:13:44.366693  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:44.466043  5834 raft_consensus.cc:3060] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:44.369275  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:44.371974  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:44.374001  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:44.374379  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:44.370772  5088 leader_election.cc:304] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:13:44.388415  5124 raft_consensus.cc:1240] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:44.393031  7119 consensus_queue.cc:237] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:44.397535  7015 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:44.400565  6901 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:44.407625  7069 consensus_queue.cc:1048] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:44.409565  7072 leader_election.cc:290] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:44.410851  6975 raft_consensus.cc:493] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:44.412611  6898 leader_election.cc:290] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:44.413815  7109 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:44.421691  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 80726.7us
W20260709 12:13:44.470238  7081 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.010s	sys 0.036s
I20260709 12:13:44.303716  7007 raft_consensus.cc:2749] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:44.433828  5801 leader_election.cc:304] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:44.440203  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:44.444744  5804 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:13:44.432230  6938 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.008s	sys 0.031s
I20260709 12:13:44.423698  7043 raft_consensus.cc:740] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:13:44.568686  7043 consensus_queue.cc:260] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:44.359920  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:44.422912  7048 raft_consensus.cc:493] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:44.434062  6960 raft_consensus.cc:2749] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:44.570951  7048 raft_consensus.cc:515] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:44.435671  7132 raft_consensus.cc:2749] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:44.330686  7126 raft_consensus.cc:515] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:44.571836  5123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40386 (request call id 1512) took 1017 ms. Trace:
I20260709 12:13:44.572367  5125 raft_consensus.cc:1275] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:44.573011  5274 raft_consensus.cc:3060] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:44.573572  7126 leader_election.cc:290] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:13:44.480039  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 109321us
I20260709 12:13:44.479804  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:44.479188  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:13:44.574532  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:44.484108  5838 raft_consensus.cc:2368] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 3. Current term is 4.
I20260709 12:13:44.483944  7104 raft_consensus.cc:2804] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:44.486892  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
W20260709 12:13:44.561196  6950 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.773s	user 0.048s	sys 0.065s
I20260709 12:13:44.485368  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:44.491227  5834 raft_consensus.cc:2468] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 4.
I20260709 12:13:44.481019  7041 raft_consensus.cc:515] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:44.450956  6894 raft_consensus.cc:493] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
W20260709 12:13:44.592547  6950 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.048s	sys 0.065s
I20260709 12:13:44.603729  6894 raft_consensus.cc:515] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:44.606586  7090 leader_election.cc:290] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:44.500082  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
W20260709 12:13:44.501560  5165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:44.488646  5831 raft_consensus.cc:3060] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:44.503225  7038 leader_election.cc:290] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:44.470717  6885 raft_consensus.cc:697] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 3 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:44.481307  7105 raft_consensus.cc:2764] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:13:44.460883  7067 raft_consensus.cc:697] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:44.474097  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:44.489745  6879 raft_consensus.cc:2804] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:13:44.567386  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 133616us
I20260709 12:13:44.571262  6960 raft_consensus.cc:2749] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:44.467926  5835 raft_consensus.cc:3060] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:44.560580  5829 raft_consensus.cc:2368] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 3. Current term is 4.
W20260709 12:13:44.453625  7037 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.003s	sys 0.036s
I20260709 12:13:44.490557  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:44.488214  7116 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:44.430837  7054 consensus_queue.cc:237] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:44.576493  5123 rpcz_store.cc:276] 0709 12:13:43.554517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:43.674604 (+120087us) service_pool.cc:224] Handling call
0709 12:13:43.674957 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:43.675307 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:43.675336 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:43.675848 (+   512us) log.cc:844] Serialized 26 byte log entry
0709 12:13:44.185461 (+509613us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:13:44.185497 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:44.185555 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:44.571604 (+386049us) raft_consensus.cc:1685] finished
0709 12:13:44.571637 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:44.571776 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7022,"raft.queue_time_us":2560,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":18274,"thread_start_us":509204,"threads_started":1,"wal-append.queue_time_us":775294}
I20260709 12:13:44.482193  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:44.581938  5088 leader_election.cc:304] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:13:44.631981  5122 raft_consensus.cc:2368] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 3. Current term is 4.
W20260709 12:13:44.583066  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 138512us
I20260709 12:13:44.593602  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:44.600039  5836 raft_consensus.cc:2393] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 4: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:13:44.585628  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:44.586014  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:13:44.611109  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 350056us
I20260709 12:13:44.581422  5832 raft_consensus.cc:3060] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:44.632611  5164 leader_election.cc:304] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:13:44.633816  5834 raft_consensus.cc:2393] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 4: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
W20260709 12:13:44.632306  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 50477.9us
I20260709 12:13:44.591506  5274 raft_consensus.cc:2468] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
I20260709 12:13:44.509466  6975 raft_consensus.cc:515] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:13:44.617885  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 340470us
I20260709 12:13:44.585237  6898 raft_consensus.cc:2749] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:44.560508  7109 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:44.585839  7104 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
W20260709 12:13:44.581153  6938 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.009s	sys 0.031s
I20260709 12:13:44.660356  5237 leader_election.cc:304] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
W20260709 12:13:44.622471  7037 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.003s	sys 0.036s
I20260709 12:13:44.625566  5801 leader_election.cc:400] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709) with higher term. Message: Invalid argument: T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 2. Current term is 3.
I20260709 12:13:44.630234  5116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40386 (request call id 1509) took 1121 ms. Trace:
I20260709 12:13:44.661744  5088 leader_election.cc:304] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:44.662200  5801 leader_election.cc:400] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709) with higher term. Message: Invalid argument: T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 3. Current term is 4.
I20260709 12:13:44.648618  5240 leader_election.cc:400] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Vote denied by peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443) with higher term. Message: Invalid argument: T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 3. Current term is 4.
I20260709 12:13:44.662616  5240 leader_election.cc:403] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:13:44.663336  5088 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:44.663578  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:44.664290  5832 raft_consensus.cc:2468] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 4.
I20260709 12:13:44.663647  5238 leader_election.cc:400] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Vote denied by peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539) with higher term. Message: Invalid argument: T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 3. Current term is 4.
I20260709 12:13:44.667243  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:44.654376  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:44.665144  5801 leader_election.cc:304] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:44.670168  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:44.623167  6879 raft_consensus.cc:697] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:44.661708  5116 rpcz_store.cc:276] 0709 12:13:43.502867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:43.504221 (+  1354us) service_pool.cc:224] Handling call
0709 12:13:44.622949 (+1118728us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540038e5d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:13:44.624178 (+  1229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2413222272}
I20260709 12:13:44.686904  5240 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:44.687494  5088 leader_election.cc:304] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:44.631022  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:44.624702  5833 raft_consensus.cc:3060] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 1 LEARNER]: Advancing to term 2
I20260709 12:13:44.690800  7138 raft_consensus.cc:2749] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:44.687153  6967 raft_consensus.cc:2749] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:44.695585  6879 consensus_queue.cc:237] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:44.662199  7049 raft_consensus.cc:2804] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:44.693358  5088 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:44.665594  7104 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:44.666795  7115 raft_consensus.cc:493] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
W20260709 12:13:44.718250  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 53191.5us
I20260709 12:13:44.672732  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:44.687568  6862 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:44.727993  5801 leader_election.cc:400] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 election: Vote denied by peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709) with higher term. Message: Invalid argument: T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 2. Current term is 3.
I20260709 12:13:44.690620  7078 raft_consensus.cc:2804] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:44.690433  7062 raft_consensus.cc:2749] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443) with higher term. Message: Invalid argument: T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 3. Current term is 4.
I20260709 12:13:44.694041  7037 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:44.700743  7007 raft_consensus.cc:2749] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:13:44.732802  5801 leader_election.cc:403] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:13:44.686282  7072 consensus_queue.cc:1059] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:13:44.689554  7103 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:44.728042  6894 leader_election.cc:290] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:44.727654  7132 raft_consensus.cc:2749] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:44.728018  7086 raft_consensus.cc:697] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 3 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:44.730542  6999 raft_consensus.cc:2804] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:44.672022  7067 consensus_queue.cc:237] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:44.728235  7133 raft_consensus.cc:493] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
W20260709 12:13:44.800047  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 72640.4us
I20260709 12:13:44.804215  5166 leader_election.cc:400] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 election: Vote denied by peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443) with higher term. Message: Invalid argument: T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 2. Current term is 3.
I20260709 12:13:44.847857  5166 leader_election.cc:403] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 12:13:44.848407  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 44373.2us
I20260709 12:13:44.855464  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:44.856366  5266 raft_consensus.cc:2393] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 4: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:13:44.857978  5198 raft_consensus.cc:1240] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:44.796083  7062 raft_consensus.cc:493] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:44.866390  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:44.866621  7062 raft_consensus.cc:515] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:44.867201  5268 raft_consensus.cc:2368] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 3. Current term is 4.
I20260709 12:13:44.868014  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:44.868556  5268 raft_consensus.cc:3060] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:44.742695  5269 raft_consensus.cc:3060] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:44.712764  6885 consensus_queue.cc:237] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:44.791348  7049 raft_consensus.cc:697] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:44.923085  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:44.935454  5266 raft_consensus.cc:2393] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 4: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:13:44.937285  5801 leader_election.cc:400] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 election: Vote denied by peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709) with higher term. Message: Invalid argument: T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 3. Current term is 4.
I20260709 12:13:44.937758  5801 leader_election.cc:403] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 12:13:44.928148  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 241986us
I20260709 12:13:44.766045  7002 raft_consensus.cc:2749] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:44.743839  7115 raft_consensus.cc:515] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:44.857511  6967 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:44.944471  5164 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:44.767287  7037 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:44.962092  5116 raft_consensus.cc:1275] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:44.854761  6999 raft_consensus.cc:493] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:44.880904  7072 raft_consensus.cc:493] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:44.968439  5089 leader_election.cc:304] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:44.939610  7129 raft_consensus.cc:493] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:44.952826  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:44.954243  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:44.955286  5125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40386 (request call id 1524) took 1008 ms. Trace:
I20260709 12:13:44.855377  7148 raft_consensus.cc:2749] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:44.878602  7130 raft_consensus.cc:493] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:44.943878  5240 leader_election.cc:400] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Vote denied by peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443) with higher term. Message: Invalid argument: T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 3. Current term is 4.
I20260709 12:13:44.980926  5240 leader_election.cc:403] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:13:44.925321  7119 raft_consensus.cc:493] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:44.964324  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:44.949684  5268 raft_consensus.cc:2468] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 5.
I20260709 12:13:44.938838  7048 leader_election.cc:290] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:44.978556  5200 raft_consensus.cc:2393] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 4: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:44.979844  5125 rpcz_store.cc:276] 0709 12:13:43.946885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:43.971183 (+ 24298us) service_pool.cc:224] Handling call
0709 12:13:44.572058 (+600875us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:44.572707 (+   649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:44.955030 (+382323us) spinlock_profiling.cc:243] Waited 600 ms on lock 0x7b540024bb50. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc28ad 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:13:44.955202 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1381124352}
W20260709 12:13:44.999832  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 56088.7us
I20260709 12:13:45.000332  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:45.000634  5240 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:13:44.950991  7155 raft_consensus.cc:493] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:44.880048  7133 raft_consensus.cc:515] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:44.967010  7041 leader_election.cc:290] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:44.959118  7118 raft_consensus.cc:493] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
W20260709 12:13:45.011674  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 74490us
W20260709 12:13:45.024217  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:45.038197  5801 leader_election.cc:304] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:44.963050  7045 raft_consensus.cc:493] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:45.038975  7045 raft_consensus.cc:515] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:44.972680  6999 raft_consensus.cc:3060] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:45.045905  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 44429.3us
W20260709 12:13:45.015661  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 71237us
I20260709 12:13:44.963518  7078 raft_consensus.cc:697] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 4 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
W20260709 12:13:45.005630  7140 log.cc:927] Time spent T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.345s	user 0.000s	sys 0.001s
I20260709 12:13:44.974844  7149 raft_consensus.cc:493] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:44.984974  7152 raft_consensus.cc:3060] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:44.973304  6967 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:44.985699  7072 raft_consensus.cc:515] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:45.018011  5119 raft_consensus.cc:1275] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:13:45.036108  7141 log.cc:927] Time spent T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.378s	user 0.001s	sys 0.001s
I20260709 12:13:45.016690  7048 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:45.034391  7147 raft_consensus.cc:2749] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443) with higher term. Message: Invalid argument: T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 3. Current term is 4.
I20260709 12:13:45.050168  7148 raft_consensus.cc:2804] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:45.113687  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:45.071697  7004 raft_consensus.cc:2749] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709) with higher term. Message: Invalid argument: T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 3. Current term is 4.
W20260709 12:13:45.122018  5835 consensus_meta.cc:287] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.504s	user 0.008s	sys 0.001s
I20260709 12:13:45.140807  5835 raft_consensus.cc:2468] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 3.
I20260709 12:13:45.142025  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:45.142669  5835 raft_consensus.cc:2468] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 2.
I20260709 12:13:45.006331  7086 consensus_queue.cc:237] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:45.093954  7170 raft_consensus.cc:2804] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:45.004618  7129 raft_consensus.cc:515] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:45.017735  7119 raft_consensus.cc:515] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:45.074301  7015 raft_consensus.cc:493] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
W20260709 12:13:45.136947  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 68006.3us
I20260709 12:13:45.137169  5265 raft_consensus.cc:2393] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 4: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:13:45.076838  6888 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:45.086206  6968 raft_consensus.cc:493] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
W20260709 12:13:45.116559  7145 log.cc:927] Time spent T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.415s	user 0.000s	sys 0.001s
I20260709 12:13:45.049520  7049 consensus_queue.cc:237] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:45.069017  5801 leader_election.cc:304] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:13:45.161758  7165 log.cc:927] Time spent T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:13:45.153760  7004 raft_consensus.cc:2749] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:13:45.152758  7143 log.cc:927] Time spent T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.424s	user 0.002s	sys 0.000s
I20260709 12:13:45.031008  7155 raft_consensus.cc:515] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:45.064028  7118 raft_consensus.cc:515] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:45.136554  7002 raft_consensus.cc:2749] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:45.153012  7172 consensus_queue.cc:1048] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 12:13:45.143191  6950 raft_consensus.cc:2749] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709) with higher term. Message: Invalid argument: T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 2. Current term is 3.
I20260709 12:13:45.143553  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:13:45.129357  5165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:45.138252  7048 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:45.213577  7163 consensus_queue.cc:1059] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 12:13:45.017760  7130 raft_consensus.cc:515] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:45.146847  7166 raft_consensus.cc:493] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
W20260709 12:13:45.222678  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 153724us
I20260709 12:13:45.214704  7081 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:45.172087  6971 raft_consensus.cc:493] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:45.091054  7149 raft_consensus.cc:515] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:45.169092  7170 raft_consensus.cc:697] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:45.167686  6968 raft_consensus.cc:515] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:45.170034  7015 raft_consensus.cc:515] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:13:45.231815  7056 consensus_meta.cc:287] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.902s	user 0.010s	sys 0.000s
I20260709 12:13:45.230370  7173 consensus_queue.cc:1048] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.095s
I20260709 12:13:45.166991  6888 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:45.273100  7169 raft_consensus.cc:2804] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:45.290563  7037 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:45.289579  7062 leader_election.cc:290] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:13:45.320878  5121 consensus_meta.cc:287] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 1.359s	user 0.006s	sys 0.008s
I20260709 12:13:45.244392  6999 raft_consensus.cc:515] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:45.397606  7178 raft_consensus.cc:493] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:45.382788  7159 raft_consensus.cc:493] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:45.400640  7178 raft_consensus.cc:515] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:45.275822  6971 raft_consensus.cc:515] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:45.381543  7163 raft_consensus.cc:493] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.341403  7115 leader_election.cc:290] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:45.416368  7169 raft_consensus.cc:697] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 5 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:13:45.321549  7056 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:45.381794  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:45.169060  7078 consensus_queue.cc:237] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:45.277256  7081 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:45.430840  7157 log.cc:927] Time spent T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.306s	user 0.001s	sys 0.001s
I20260709 12:13:45.264360  7166 raft_consensus.cc:515] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:45.399758  5121 raft_consensus.cc:2468] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 4.
I20260709 12:13:45.374348  7160 raft_consensus.cc:493] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
W20260709 12:13:45.448341  7162 log.cc:927] Time spent T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.218s	user 0.000s	sys 0.000s
I20260709 12:13:45.425948  7171 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:45.429443  5831 consensus_meta.cc:287] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.815s	user 0.011s	sys 0.000s
I20260709 12:13:45.431854  7072 leader_election.cc:290] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:45.428856  7159 raft_consensus.cc:515] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:45.529444  7159 leader_election.cc:290] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:45.457402  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:45.454645  5121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40386 (request call id 1523) took 1507 ms. Trace:
I20260709 12:13:45.533224  5121 rpcz_store.cc:276] 0709 12:13:43.946370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:43.960092 (+ 13722us) service_pool.cc:224] Handling call
0709 12:13:45.453285 (+1493193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:45.478724  7160 raft_consensus.cc:515] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:45.536603  7160 leader_election.cc:290] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:45.473766  7181 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:45.537621  7181 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:45.540766  7181 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:45.500962  7103 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:45.542187  7149 leader_election.cc:290] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:45.543270  6999 leader_election.cc:290] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:45.521107  5271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34672 (request call id 1629) took 1104 ms. Trace:
I20260709 12:13:45.486785  7048 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:13:45.485837  5833 consensus_meta.cc:287] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.765s	user 0.005s	sys 0.006s
W20260709 12:13:45.550665  5834 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.038s	sys 0.038s
W20260709 12:13:45.558739  5834 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.043s	sys 0.038s
I20260709 12:13:45.559656  5834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46100 (request call id 717) took 1185 ms. Trace:
I20260709 12:13:45.563230  5834 rpcz_store.cc:276] 0709 12:13:44.378464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:44.634417 (+255953us) service_pool.cc:224] Handling call
0709 12:13:44.634694 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:44.634889 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:13:44.844722 (+209833us) log.cc:844] Serialized 14 byte log entry
0709 12:13:45.559236 (+714514us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:45.559297 (+    61us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:45.559352 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:45.559420 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:45.559567 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1205,"prepare.queue_time_us":624293,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":94281,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":8493,"thread_start_us":915160,"threads_started":3,"wal-append.queue_time_us":154227}
W20260709 12:13:45.562307  5239 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.027s	sys 0.057s
I20260709 12:13:45.453773  7133 leader_election.cc:290] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:45.427868  7163 raft_consensus.cc:515] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:45.525152  7115 raft_consensus.cc:493] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.575361  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:45.456689  5831 raft_consensus.cc:2468] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 4.
W20260709 12:13:45.580330  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:45.526158  7119 leader_election.cc:290] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:45.545955  7173 raft_consensus.cc:493] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.542213  7056 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:45.456465  7155 leader_election.cc:290] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:45.592307  5831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46088 (request call id 354) took 1218 ms. Trace:
I20260709 12:13:45.562214  7153 raft_consensus.cc:493] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.549348  7081 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:45.562147  7148 raft_consensus.cc:697] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 4 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:45.561826  5833 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 2 LEARNER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 2.
I20260709 12:13:45.570742  7149 raft_consensus.cc:493] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:45.559082  7175 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.607295  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:45.608069  5834 raft_consensus.cc:2468] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 2.
I20260709 12:13:45.597700  5831 rpcz_store.cc:276] 0709 12:13:44.373969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:44.374103 (+   134us) service_pool.cc:224] Handling call
0709 12:13:45.590520 (+1216417us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:45.590090  7118 leader_election.cc:290] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:45.604176  5829 raft_consensus.cc:1275] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 4 LEARNER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:45.449800  7170 consensus_queue.cc:237] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:45.624572  7156 log.cc:927] Time spent T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.263s	user 0.000s	sys 0.000s
I20260709 12:13:45.625564  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:45.634526  5834 raft_consensus.cc:2393] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 3: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
W20260709 12:13:45.615947  7168 log.cc:927] Time spent T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
W20260709 12:13:45.610698  5833 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46100 (request call id 724) took 1230 ms (client timeout 1516 ms). Trace:
I20260709 12:13:45.637145  7118 raft_consensus.cc:493] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:45.593513  7115 raft_consensus.cc:515] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:45.613978  6968 leader_election.cc:290] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:13:45.641175  7080 consensus_meta.cc:287] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 1.399s	user 0.007s	sys 0.006s
I20260709 12:13:45.625070  7176 raft_consensus.cc:493] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.651870  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:45.625126  7166 leader_election.cc:290] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:45.632422  7015 leader_election.cc:290] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:45.606601  7149 raft_consensus.cc:515] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:13:45.639374  5833 rpcz_store.cc:269] 0709 12:13:44.380386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:44.437414 (+ 57028us) service_pool.cc:224] Handling call
0709 12:13:45.606371 (+1168957us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:45.634160  7130 leader_election.cc:290] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:45.594746  7173 raft_consensus.cc:515] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:45.465770  7171 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:45.616430  7153 raft_consensus.cc:515] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:45.682770  7153 leader_election.cc:290] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:45.659375  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:45.639595  7118 raft_consensus.cc:515] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:45.691948  5832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46094 (request call id 591) took 1311 ms. Trace:
I20260709 12:13:45.591118  7169 consensus_queue.cc:237] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:45.692452  5832 rpcz_store.cc:276] 0709 12:13:44.380910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:44.725284 (+344374us) service_pool.cc:224] Handling call
0709 12:13:44.725695 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:44.738982 (+ 13287us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:44.739019 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:44.747471 (+  8452us) log.cc:844] Serialized 26 byte log entry
0709 12:13:45.026642 (+279171us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:13:45.026687 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:45.026763 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:45.691744 (+664981us) raft_consensus.cc:1685] finished
0709 12:13:45.691763 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:45.691886 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13143,"raft.queue_time_us":17129,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":18180,"thread_start_us":105334,"threads_started":1,"wal-append.queue_time_us":361711}
I20260709 12:13:45.698625  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:45.699295  7173 leader_election.cc:290] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:13:45.695047  5237 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.014s	sys 0.027s
W20260709 12:13:45.700639  5237 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.014s	sys 0.027s
I20260709 12:13:45.549743  5271 rpcz_store.cc:276] 0709 12:13:44.416815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:44.422277 (+  5462us) service_pool.cc:224] Handling call
0709 12:13:44.459251 (+ 36974us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:44.507230 (+ 47979us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:44.565683 (+ 58453us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:44.622290 (+ 56607us) log.cc:844] Serialized 26 byte log entry
0709 12:13:44.958061 (+335771us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:13:44.965051 (+  6990us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:44.979001 (+ 13950us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:45.496703 (+517702us) raft_consensus.cc:1685] finished
0709 12:13:45.500804 (+  4101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:45.520992 (+ 20188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25885,"raft.queue_time_us":10061,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":54617,"thread_start_us":233297,"threads_started":1,"wal-append.queue_time_us":506314}
W20260709 12:13:45.695292  7177 log.cc:927] Time spent T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.376s	user 0.000s	sys 0.006s
W20260709 12:13:45.712471  5090 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.021s	sys 0.020s
W20260709 12:13:45.701527  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 619573us
I20260709 12:13:45.723003  7163 leader_election.cc:290] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:13:45.722884  5090 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.022s	sys 0.020s
W20260709 12:13:45.688727  7104 consensus_meta.cc:287] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.938s	user 0.006s	sys 0.006s
I20260709 12:13:45.730481  5835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46094 (request call id 594) took 1337 ms. Trace:
I20260709 12:13:45.685081  7148 consensus_queue.cc:237] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:45.700562  5118 consensus_meta.cc:287] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 1.005s	user 0.007s	sys 0.004s
I20260709 12:13:45.733255  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:45.614909  7175 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:45.720396  7173 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:45.734602  5835 rpcz_store.cc:276] 0709 12:13:44.392806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:45.163044 (+770238us) service_pool.cc:224] Handling call
0709 12:13:45.216469 (+ 53425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:45.216696 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:13:45.651019 (+434323us) log.cc:844] Serialized 14 byte log entry
0709 12:13:45.730106 (+ 79087us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:45.730162 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:13:45.730209 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:45.730280 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:45.730420 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5924,"prepare.queue_time_us":200434,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":2195,"raft.queue_time_us":9460,"thread_start_us":477403,"threads_started":2}
I20260709 12:13:45.677541  7176 raft_consensus.cc:515] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:13:45.751415  5165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:45.752257  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:45.755539  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:45.756062  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:45.756332  5804 leader_election.cc:400] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 election: Vote denied by peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443) with higher term. Message: Invalid argument: T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 3. Current term is 4.
I20260709 12:13:45.756717  5120 raft_consensus.cc:2468] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 3.
I20260709 12:13:45.757136  5122 raft_consensus.cc:2393] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 3: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:13:45.754432  5832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46088 (request call id 355) took 1120 ms. Trace:
I20260709 12:13:45.757647  5832 rpcz_store.cc:276] 0709 12:13:44.633918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:45.753053 (+1119135us) service_pool.cc:224] Handling call
0709 12:13:45.753333 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:45.754130 (+   797us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:45.754156 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:45.754196 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:45.754231 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:45.754281 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:45.754378 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:13:45.735507  5269 consensus_meta.cc:287] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.800s	user 0.008s	sys 0.004s
I20260709 12:13:45.732698  5833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46094 (request call id 599) took 1338 ms. Trace:
I20260709 12:13:45.720110  7178 leader_election.cc:290] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:45.736012  7104 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:45.802788  5832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46100 (request call id 726) took 1148 ms. Trace:
I20260709 12:13:45.820940  5832 rpcz_store.cc:276] 0709 12:13:44.654320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:45.758677 (+1104357us) service_pool.cc:224] Handling call
0709 12:13:45.758969 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:45.759521 (+   552us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:13:45.759550 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:45.759592 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:45.759623 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:45.759685 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:45.802675 (+ 42990us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":103,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":16968}
I20260709 12:13:45.817338  5835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46100 (request call id 725) took 1164 ms. Trace:
I20260709 12:13:45.822598  5835 rpcz_store.cc:276] 0709 12:13:44.653935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:45.756715 (+1102780us) service_pool.cc:224] Handling call
0709 12:13:45.816787 (+ 60072us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:45.816996 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:45.817023 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:45.817064 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:13:45.817099 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:45.817149 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:45.817270 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:45.822913  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:13:45.825663  5164 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.212.132:43539 timed out after 1.516s (SENT) [suppressed 19 similar messages]
I20260709 12:13:45.748178  5118 raft_consensus.cc:2468] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 4.
W20260709 12:13:45.753257  5803 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.001s	sys 0.033s
I20260709 12:13:45.749436  7086 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
W20260709 12:13:45.774050  7152 consensus_meta.cc:287] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.672s	user 0.009s	sys 0.001s
I20260709 12:13:45.897835  5240 leader_election.cc:304] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:13:45.748498  6885 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:45.761301  5269 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
I20260709 12:13:45.803606  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:45.775569  7153 raft_consensus.cc:493] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:45.776288  6894 raft_consensus.cc:493] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:45.801762  7115 leader_election.cc:290] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:13:45.898831  5803 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.932s	user 0.001s	sys 0.042s
I20260709 12:13:45.894080  7049 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.896328  7046 raft_consensus.cc:493] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:45.801344  7072 consensus_queue.cc:1048] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.113s
W20260709 12:13:45.993541  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 97941.4us
I20260709 12:13:45.957557  5125 raft_consensus.cc:1240] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:45.895776  7067 raft_consensus.cc:493] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
W20260709 12:13:46.000761  5269 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34674 (request call id 1729) took 1354 ms (client timeout 1526 ms). Trace:
I20260709 12:13:45.775171  5833 rpcz_store.cc:276] 0709 12:13:44.394120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:45.678930 (+1284810us) service_pool.cc:224] Handling call
0709 12:13:45.700398 (+ 21468us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:45.732306 (+ 31908us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:45.732339 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:45.732386 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:13:45.732424 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:45.732498 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:45.732623 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10308,"raft.queue_time_us":14653,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":15493}
I20260709 12:13:46.001287  7067 raft_consensus.cc:515] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:46.002234  7175 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:46.002427  7046 raft_consensus.cc:515] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:45.998490  5116 raft_consensus.cc:2410] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 4 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 12:13:45.994398  7015 raft_consensus.cc:493] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:45.904088  7007 raft_consensus.cc:493] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:45.907285  7152 raft_consensus.cc:2749] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443) with higher term. Message: Invalid argument: T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 2. Current term is 3.
W20260709 12:13:46.007064  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 181434us
I20260709 12:13:45.906695  7163 raft_consensus.cc:2804] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:45.760968  7173 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:45.896148  7086 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:45.994170  7056 raft_consensus.cc:493] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
W20260709 12:13:46.001271  5269 rpcz_store.cc:269] 0709 12:13:44.639447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:44.647573 (+  8126us) service_pool.cc:224] Handling call
0709 12:13:45.993951 (+1346378us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:46.008850  7015 raft_consensus.cc:515] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:46.002147  7049 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:46.011736  7163 raft_consensus.cc:493] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:46.010314  7149 leader_election.cc:290] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:13:46.013161  7183 log.cc:927] Time spent T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.327s	user 0.000s	sys 0.001s
I20260709 12:13:46.005558  7153 raft_consensus.cc:515] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:46.084761  7118 leader_election.cc:290] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:46.010821  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:46.101070  5191 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
I20260709 12:13:46.011083  7182 raft_consensus.cc:493] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:45.999687  6894 raft_consensus.cc:515] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:45.957235  6885 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:46.011173  7154 log.cc:927] Time spent T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
W20260709 12:13:46.160482  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:46.103179  7163 raft_consensus.cc:3060] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:46.011093  7007 raft_consensus.cc:515] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:46.182950  5832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46100 (request call id 728) took 1001 ms. Trace:
W20260709 12:13:46.186585  5165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:46.105095  7169 consensus_queue.cc:1059] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.085s
I20260709 12:13:46.094609  7056 raft_consensus.cc:515] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:46.158844  7067 leader_election.cc:290] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:46.165580  7078 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:46.177049  7118 raft_consensus.cc:493] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:46.184813  7184 raft_consensus.cc:493] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
W20260709 12:13:46.228915  7198 log.cc:927] Time spent T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 12:13:46.229890  7104 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:13:46.230437  7195 log.cc:927] Time spent T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 12:13:46.213817  7184 raft_consensus.cc:515] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:46.220876  7197 log.cc:927] Time spent T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 12:13:46.235085  7153 leader_election.cc:290] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:46.235946  7086 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:46.237143  7056 leader_election.cc:290] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:46.237633  7176 leader_election.cc:290] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:46.243162  7163 raft_consensus.cc:515] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:46.241602  7191 log.cc:927] Time spent T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260709 12:13:46.244086  7173 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:46.212842  7118 raft_consensus.cc:515] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:46.176474  7182 raft_consensus.cc:515] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:46.245718  7163 leader_election.cc:290] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:46.217891  7171 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:46.246803  7118 leader_election.cc:290] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:46.247087  7182 leader_election.cc:290] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:46.243034  7184 leader_election.cc:290] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:46.312887  5838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46094 (request call id 590) took 1932 ms. Trace:
I20260709 12:13:46.314145  6885 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:46.211127  7078 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:46.319900  7015 leader_election.cc:290] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:46.321331  7104 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.321195  7067 raft_consensus.cc:493] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
W20260709 12:13:46.242018  7200 log.cc:927] Time spent T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 12:13:46.306862  5271 raft_consensus.cc:1240] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:46.313732  5838 rpcz_store.cc:276] 0709 12:13:44.380664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:44.696478 (+315814us) service_pool.cc:224] Handling call
0709 12:13:45.111877 (+415399us) spinlock_profiling.cc:243] Waited 1.44 ms on lock 0x7b58000b0498. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb9cfc0 00007f84ebb87929 00007f84ebb873d2 00007f84e50febd4
0709 12:13:45.112120 (+   243us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:45.112549 (+   429us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:45.112580 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:45.134510 (+ 21930us) log.cc:844] Serialized 26 byte log entry
0709 12:13:45.213579 (+ 79069us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:45.631041 (+417462us) log.cc:844] Serialized 14 byte log entry
0709 12:13:45.642095 (+ 11054us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:45.642165 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:46.309638 (+667473us) raft_consensus.cc:1685] finished
0709 12:13:46.312216 (+  2578us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:46.312607 (+   391us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10771,"prepare.queue_time_us":123814,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":65,"raft.queue_time_us":120699,"raft.run_cpu_time_us":347,"raft.run_wall_time_us":30076,"spinlock_wait_cycles":3301632,"thread_start_us":468182,"threads_started":2,"wal-append.queue_time_us":504086}
I20260709 12:13:46.326610  6894 leader_election.cc:290] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:46.344164  7078 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:46.341298  7049 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:46.328076  7182 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.353022  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:46.353498  7182 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:46.353744  7104 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:46.354646  5838 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 1.
I20260709 12:13:46.356065  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:46.358304  7067 raft_consensus.cc:515] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:46.369899  5834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46094 (request call id 596) took 1974 ms. Trace:
I20260709 12:13:46.357139  7104 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:46.353025  7046 leader_election.cc:290] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:46.365090  7171 raft_consensus.cc:493] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:46.362185  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:46.370625  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
W20260709 12:13:46.374930  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 1.71806e+06us
W20260709 12:13:46.380142  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 202406us
I20260709 12:13:46.382725  5238 leader_election.cc:400] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Vote denied by peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539) with higher term. Message: Invalid argument: T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 3. Current term is 4.
I20260709 12:13:46.363966  7209 raft_consensus.cc:493] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.384917  7209 raft_consensus.cc:515] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:46.378252  5833 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 3.
W20260709 12:13:46.359752  5191 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47744 (request call id 1688) took 1405 ms (client timeout 1526 ms). Trace:
I20260709 12:13:46.385704  7182 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:46.386998  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:46.388072  5267 raft_consensus.cc:1275] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:46.388918  5267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50932 (request call id 381) took 1728 ms. Trace:
I20260709 12:13:46.390889  5268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50932 (request call id 387) took 1526 ms. Trace:
I20260709 12:13:46.391418  5268 rpcz_store.cc:276] 0709 12:13:44.864412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:44.985041 (+120629us) service_pool.cc:224] Handling call
0709 12:13:44.985353 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:45.297601 (+312248us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:45.297631 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:45.297673 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:45.297706 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:46.390269 (+1092563us) spinlock_profiling.cc:243] Waited 312 ms on lock 0x7b54000d3254. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:13:46.390356 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:46.390640 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":717548288}
W20260709 12:13:46.387432  5191 rpcz_store.cc:269] 0709 12:13:44.953776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:44.953948 (+   172us) service_pool.cc:224] Handling call
0709 12:13:46.359213 (+1405265us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54002af654. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:13:46.359495 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2534276480}
I20260709 12:13:46.385701  5266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50932 (request call id 384) took 1521 ms. Trace:
I20260709 12:13:46.394313  5266 rpcz_store.cc:276] 0709 12:13:44.863692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:44.941436 (+ 77744us) service_pool.cc:224] Handling call
0709 12:13:44.941772 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:45.073412 (+131640us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:45.073447 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:45.073494 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:45.073543 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:46.385081 (+1311538us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b5400172854. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:13:46.385155 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:46.385456 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":302200576}
I20260709 12:13:46.386518  7067 leader_election.cc:290] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:46.378605  5835 raft_consensus.cc:2376] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 2 LEARNER]: Leader election vote request: Already granted yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 2. Re-sending same reply.
I20260709 12:13:46.389281  5267 rpcz_store.cc:276] 0709 12:13:44.660062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:44.660234 (+   172us) service_pool.cc:224] Handling call
0709 12:13:46.386926 (+1726692us) spinlock_profiling.cc:243] Waited 3.43 ms on lock 0x7b5800190b98. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb9cfc0 00007f84ebb87929 00007f84ebb873d2 00007f84e50febd4
0709 12:13:46.387398 (+   472us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:46.388610 (+  1212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:46.388855 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7885056}
I20260709 12:13:46.387626  7209 leader_election.cc:290] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:46.376720  7171 raft_consensus.cc:515] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:46.370460  5834 rpcz_store.cc:276] 0709 12:13:44.393307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:45.661685 (+1268378us) service_pool.cc:224] Handling call
0709 12:13:45.679754 (+ 18069us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:45.680090 (+   336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:45.680115 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:45.687381 (+  7266us) log.cc:844] Serialized 26 byte log entry
0709 12:13:45.723960 (+ 36579us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:45.753105 (+ 29145us) log.cc:844] Serialized 14 byte log entry
0709 12:13:45.753795 (+   690us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:45.753878 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:46.329205 (+575327us) raft_consensus.cc:1685] finished
0709 12:13:46.330734 (+  1529us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:46.367888 (+ 37154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":457,"prepare.queue_time_us":28874,"raft.queue_time_us":1210,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":9900,"spinlock_wait_cycles":7808896,"thread_start_us":14236,"threads_started":1,"wal-append.queue_time_us":164335}
I20260709 12:13:46.397318  5238 leader_election.cc:400] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Vote denied by peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539) with higher term. Message: Invalid argument: T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 3. Current term is 4.
I20260709 12:13:46.396078  5191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41416 (request call id 316) took 1328 ms. Trace:
I20260709 12:13:46.403353  5191 rpcz_store.cc:276] 0709 12:13:45.067579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:46.394418 (+1326839us) service_pool.cc:224] Handling call
0709 12:13:46.395181 (+   763us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:46.395651 (+   470us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:46.395677 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:46.395749 (+    72us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:46.395785 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:46.395844 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:46.395973 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:46.402617  5238 leader_election.cc:403] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:13:46.410248  5801 leader_election.cc:304] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:46.410427  7207 raft_consensus.cc:2749] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539) with higher term. Message: Invalid argument: T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 3. Current term is 4.
I20260709 12:13:46.411945  7171 leader_election.cc:290] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:46.414980  5238 leader_election.cc:304] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:46.423126  7207 raft_consensus.cc:2749] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:46.421653  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:46.441103  6975 leader_election.cc:290] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:46.417999  7182 raft_consensus.cc:2749] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:46.448078  5830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46094 (request call id 592) took 2066 ms. Trace:
I20260709 12:13:46.453734  5801 leader_election.cc:304] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:46.455060  7182 raft_consensus.cc:2749] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:46.559975  7109 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:46.562000  7135 raft_consensus.cc:3055] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:46.562553  7135 raft_consensus.cc:740] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:13:46.563761  7135 consensus_queue.cc:260] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:46.564571  7135 raft_consensus.cc:3060] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:46.566526  7161 raft_consensus.cc:3055] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:46.567063  7161 raft_consensus.cc:740] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:46.568558  7161 consensus_queue.cc:260] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:46.613890  7138 raft_consensus.cc:493] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:46.614657  7138 raft_consensus.cc:515] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:46.616230  6888 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:46.616757  7138 leader_election.cc:290] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:46.438124  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:46.666077  5191 raft_consensus.cc:2393] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 4: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:46.667706  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:46.668938  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:46.670372  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:46.671212  5191 raft_consensus.cc:2468] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 3.
I20260709 12:13:46.673218  5191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41416 (request call id 319) took 1596 ms. Trace:
I20260709 12:13:46.673631  5191 rpcz_store.cc:276] 0709 12:13:45.076970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:46.672115 (+1595145us) service_pool.cc:224] Handling call
0709 12:13:46.672521 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:46.672904 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:46.672927 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:46.672981 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:46.673012 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:46.673061 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:46.673168 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:46.675539  5191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41416 (request call id 320) took 1581 ms. Trace:
I20260709 12:13:46.675899  5191 rpcz_store.cc:276] 0709 12:13:45.094484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:46.674479 (+1579995us) service_pool.cc:224] Handling call
0709 12:13:46.674838 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:46.675194 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:46.675217 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:46.675275 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:46.675309 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:46.675360 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:46.675475 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:46.678069  5191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41416 (request call id 321) took 1567 ms. Trace:
I20260709 12:13:46.678347  5191 rpcz_store.cc:276] 0709 12:13:45.110502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:46.676872 (+1566370us) service_pool.cc:224] Handling call
0709 12:13:46.677408 (+   536us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:46.677828 (+   420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:46.677843 (+    15us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:46.677883 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:46.677902 (+    19us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:46.677935 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:46.678026 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:46.691219  5836 raft_consensus.cc:1275] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:13:46.692350  5836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46100 (request call id 723) took 2312 ms. Trace:
I20260709 12:13:46.692735  5836 rpcz_store.cc:276] 0709 12:13:44.380119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:44.663164 (+283045us) service_pool.cc:224] Handling call
0709 12:13:46.690125 (+2026961us) spinlock_profiling.cc:243] Waited 4.25 ms on lock 0x7b58000b0498. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb9cfc0 00007f84ebb87929 00007f84ebb873d2 00007f84e50febd4
0709 12:13:46.690479 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:46.691936 (+  1457us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:46.692252 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9769216}
I20260709 12:13:46.703606  5194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 1693) took 1738 ms. Trace:
I20260709 12:13:46.703976  5194 rpcz_store.cc:276] 0709 12:13:44.964727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:44.964823 (+    96us) service_pool.cc:224] Handling call
0709 12:13:44.965097 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:45.255357 (+290260us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:45.255388 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:45.255431 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:45.255466 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:46.703210 (+1447744us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b5400037ad4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:13:46.703259 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:46.703462 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":667040512}
I20260709 12:13:46.718317  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
W20260709 12:13:46.719331  5270 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50932 (request call id 379) took 2059 ms (client timeout 1973 ms). Trace:
W20260709 12:13:46.719687  5270 rpcz_store.cc:269] 0709 12:13:44.659509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:44.659619 (+   110us) service_pool.cc:224] Handling call
0709 12:13:46.718006 (+2058387us) spinlock_profiling.cc:243] Waited 3.39 ms on lock 0x7b5800190b98. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb890a0 00007f84ebb88984 00007f84e51036d4 00007f84e5103662
0709 12:13:46.719244 (+  1238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7797120}
I20260709 12:13:46.723734  5273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34672 (request call id 1630) took 2306 ms. Trace:
I20260709 12:13:46.724191  5273 rpcz_store.cc:276] 0709 12:13:44.417148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:44.417626 (+   478us) service_pool.cc:224] Handling call
0709 12:13:44.417950 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:44.688027 (+270077us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:44.688058 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:44.688099 (+    41us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:13:44.688142 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:46.723314 (+2035172us) spinlock_profiling.cc:243] Waited 270 ms on lock 0x7b5400111054. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:13:46.723365 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:46.723542 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":620662144}
W20260709 12:13:46.777482  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:46.792958  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:46.803267  5836 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
W20260709 12:13:46.828069  5118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40386 (request call id 1521) took 2939 ms (client timeout 1830 ms). Trace:
W20260709 12:13:46.828568  5118 rpcz_store.cc:269] 0709 12:13:43.888735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:43.906644 (+ 17909us) service_pool.cc:224] Handling call
0709 12:13:46.827609 (+2920965us) spinlock_profiling.cc:243] Waited 758 ms on lock 0x7b54003449d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:13:46.827804 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1743259520}
I20260709 12:13:46.831832  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:46.448652  5830 rpcz_store.cc:276] 0709 12:13:44.390087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:44.803126 (+413039us) service_pool.cc:224] Handling call
0709 12:13:44.933231 (+130105us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:46.409853 (+1476622us) spinlock_profiling.cc:243] Waited 7.31 ms on lock 0x7b1800402a00. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e676b4bc 00007f84e3ab948b 00007f84ec9139a9 00007f84e3ad569b 00007f84e3ad393f 00007f84e3ad3455 00007f84e6bbb060 00007f84e6bbbbfb 00007f84e6bc664b
0709 12:13:46.410193 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:46.410229 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:46.411143 (+   914us) log.cc:844] Serialized 26 byte log entry
0709 12:13:46.419376 (+  8233us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:13:46.446898 (+ 27522us) log.cc:844] Serialized 14 byte log entry
0709 12:13:46.447289 (+   391us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:46.447458 (+   169us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:46.447511 (+    53us) raft_consensus.cc:1685] finished
0709 12:13:46.447640 (+   129us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:46.447886 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":9957,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":77,"raft.queue_time_us":126232,"raft.run_cpu_time_us":459,"raft.run_wall_time_us":22301,"spinlock_wait_cycles":16815360,"thread_start_us":126764,"threads_started":2,"wal-append.queue_time_us":27326}
W20260709 12:13:46.890264  5165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:46.892319  5196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47728 (request call id 1740) took 1949 ms. Trace:
I20260709 12:13:46.892817  5196 rpcz_store.cc:276] 0709 12:13:44.942569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:44.942936 (+   367us) service_pool.cc:224] Handling call
0709 12:13:46.890971 (+1948035us) spinlock_profiling.cc:243] Waited 1.95 ms on lock 0x7b58000b3d98. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb9cfc0 00007f84ebb87929 00007f84ebb873d2 00007f84e50febd4
0709 12:13:46.891337 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:46.891767 (+   430us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:46.891792 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:46.891848 (+    56us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:13:46.891912 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:46.891966 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:46.892110 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4485888}
I20260709 12:13:46.899999  5191 raft_consensus.cc:1240] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:46.903363  5801 leader_election.cc:304] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:46.904690  7116 raft_consensus.cc:2804] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:46.905189  7116 raft_consensus.cc:493] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:46.905618  7116 raft_consensus.cc:3060] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:46.907171  6948 raft_consensus.cc:493] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:46.907913  6948 raft_consensus.cc:515] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:13:46.910079  5091 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.022s	sys 0.011s
W20260709 12:13:46.910494  5091 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.022s	sys 0.011s
I20260709 12:13:46.913334  6948 leader_election.cc:290] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:46.915561  6948 raft_consensus.cc:493] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:46.914887  5196 raft_consensus.cc:1240] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:13:46.914000  6866 raft_consensus.cc:493] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:46.917912  6866 raft_consensus.cc:515] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:46.920166  6967 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:46.903246  6885 raft_consensus.cc:493] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:46.924458  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:46.920321  6866 leader_election.cc:290] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:46.926802  6885 raft_consensus.cc:515] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:46.929450  6885 leader_election.cc:290] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:46.916723  6948 raft_consensus.cc:515] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:46.925423  7116 raft_consensus.cc:515] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:46.930811  7038 consensus_queue.cc:1059] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
W20260709 12:13:46.935808  5117 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59390 (request call id 373) took 2281 ms (client timeout 1768 ms). Trace:
W20260709 12:13:46.936262  5117 rpcz_store.cc:269] 0709 12:13:44.653955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:44.654106 (+   151us) service_pool.cc:224] Handling call
0709 12:13:46.934718 (+2280612us) spinlock_profiling.cc:243] Waited 2.18 s on lock 0x7b54003efb54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:13:46.935634 (+   916us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5015578880}
I20260709 12:13:46.936829  7116 leader_election.cc:290] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:46.937057  7038 raft_consensus.cc:3055] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:46.937629  7038 raft_consensus.cc:740] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:13:46.940725  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:46.934365  6948 leader_election.cc:290] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:46.938934  7038 consensus_queue.cc:260] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:46.942623  7038 raft_consensus.cc:3060] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:46.964315  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:46.964668  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:46.965104  5125 raft_consensus.cc:2468] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 3.
I20260709 12:13:46.966641  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:46.967290  5196 raft_consensus.cc:3060] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:46.988852  5803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:46.989516  5803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:46.991557  7038 raft_consensus.cc:493] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:46.992326  7038 raft_consensus.cc:515] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:46.993323  5196 raft_consensus.cc:2468] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 4.
I20260709 12:13:47.007711  5117 raft_consensus.cc:1275] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:47.009763  7038 leader_election.cc:290] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:47.019236  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:47.019402  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:47.011726  5801 leader_election.cc:304] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:47.025156  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:47.025949  5117 raft_consensus.cc:2468] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 2.
I20260709 12:13:47.026512  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:47.031850  7116 raft_consensus.cc:2804] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:47.032480  7116 raft_consensus.cc:697] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 4 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:13:47.033679  7116 consensus_queue.cc:237] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:47.040179  5193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47728 (request call id 1737) took 2181 ms. Trace:
I20260709 12:13:47.043812  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:47.044840  5123 raft_consensus.cc:2468] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 3.
I20260709 12:13:47.048342  5192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47728 (request call id 1739) took 2189 ms. Trace:
I20260709 12:13:47.048517  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:13:47.052289  5274 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34674 (request call id 1720) took 2816 ms (client timeout 1969 ms). Trace:
W20260709 12:13:47.052775  5274 rpcz_store.cc:269] 0709 12:13:44.236224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:44.236374 (+   150us) service_pool.cc:224] Handling call
0709 12:13:47.051885 (+2815511us) spinlock_profiling.cc:243] Waited 319 ms on lock 0x7b54002eefd4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:13:47.052081 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":733470976}
I20260709 12:13:47.055576  5829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46100 (request call id 721) took 2675 ms. Trace:
I20260709 12:13:47.048821  5192 rpcz_store.cc:276] 0709 12:13:44.859082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:44.859334 (+   252us) service_pool.cc:224] Handling call
0709 12:13:47.046888 (+2187554us) spinlock_profiling.cc:243] Waited 6.83 ms on lock 0x7b58000b3d98. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb9cfc0 00007f84ebb87929 00007f84ebb873d2 00007f84e50febd4
0709 12:13:47.047261 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:47.047635 (+   374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:47.047660 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:47.047856 (+   196us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:13:47.047904 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:47.047970 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:47.048150 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15707904}
I20260709 12:13:47.040690  5193 rpcz_store.cc:276] 0709 12:13:44.858442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:44.858552 (+   110us) service_pool.cc:224] Handling call
0709 12:13:47.038836 (+2180284us) spinlock_profiling.cc:243] Waited 6.98 ms on lock 0x7b58000b3d98. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb9cfc0 00007f84ebb87929 00007f84ebb873d2 00007f84e50febd4
0709 12:13:47.039263 (+   427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:47.039617 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:47.039644 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:47.039720 (+    76us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:13:47.039755 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:47.039809 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:47.039957 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16044800}
I20260709 12:13:47.056034  5829 rpcz_store.cc:276] 0709 12:13:44.379636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:44.663740 (+284104us) service_pool.cc:224] Handling call
0709 12:13:45.569662 (+905922us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:45.633411 (+ 63749us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:47.055170 (+1421759us) spinlock_profiling.cc:243] Waited 848 ms on lock 0x7b54007404d0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc28ad 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:13:47.055393 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1949876608}
I20260709 12:13:47.071208  5272 raft_consensus.cc:1240] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:47.071274  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:47.079453  7148 raft_consensus.cc:493] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.080250  7148 raft_consensus.cc:515] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:47.082136  5197 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47728 (request call id 1726) took 2892 ms (client timeout 1578 ms). Trace:
I20260709 12:13:47.082722  7129 leader_election.cc:290] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:13:47.082630  5197 rpcz_store.cc:269] 0709 12:13:44.189591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:44.189746 (+   155us) service_pool.cc:224] Handling call
0709 12:13:47.081655 (+2891909us) spinlock_profiling.cc:243] Waited 660 ms on lock 0x7b54002ae254. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:13:47.081908 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1518609792}
I20260709 12:13:47.091470  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:47.092449  5122 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 1.
I20260709 12:13:47.098609  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:47.141144  5198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47728 (request call id 1738) took 2282 ms. Trace:
I20260709 12:13:47.141688  5198 rpcz_store.cc:276] 0709 12:13:44.858818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:44.859394 (+   576us) service_pool.cc:224] Handling call
0709 12:13:47.139884 (+2280490us) spinlock_profiling.cc:243] Waited 4.75 ms on lock 0x7b58000b3d98. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb9cfc0 00007f84ebb87929 00007f84ebb873d2 00007f84e50febd4
0709 12:13:47.140261 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:47.140636 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:47.140665 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:47.140726 (+    61us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:13:47.140759 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:47.140813 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:47.140955 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10915584}
I20260709 12:13:47.145092  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:47.157860  5122 raft_consensus.cc:2468] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 3.
I20260709 12:13:47.158627  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:47.159049  7178 raft_consensus.cc:493] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:47.159224  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:47.158520  5199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 1682) took 2909 ms. Trace:
I20260709 12:13:47.168081  5125 raft_consensus.cc:2468] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 2.
I20260709 12:13:47.171339  7186 raft_consensus.cc:493] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.172072  7186 raft_consensus.cc:515] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:47.162091  5199 rpcz_store.cc:276] 0709 12:13:44.249107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:44.249256 (+   149us) service_pool.cc:224] Handling call
0709 12:13:44.249601 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:44.249809 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:13:44.624365 (+374556us) log.cc:844] Serialized 14 byte log entry
0709 12:13:47.144534 (+2520169us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b18000d0ae0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e676b4bc 00007f84e3ab948b 00007f84ec9139a9 00007f84e3ad569b 00007f84e3ad393f 00007f84e3ad3455 00007f84e6bbb060 00007f84e6bcd716 00007f84e6bde287
0709 12:13:47.144845 (+   311us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:47.144947 (+   102us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:47.145074 (+   127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:47.145254 (+   180us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:47.158335 (+ 13081us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31667,"prepare.queue_time_us":677146,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":108205,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":21543,"spinlock_wait_cycles":37405056,"thread_start_us":804838,"threads_started":3,"wal-append.queue_time_us":410992,"wal-append.run_cpu_time_us":9236,"wal-append.run_wall_time_us":1384901}
I20260709 12:13:47.176045  7186 leader_election.cc:290] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:13:47.177848  5801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:47.179319  6862 raft_consensus.cc:493] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.185554  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:47.187549  6971 leader_election.cc:290] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:47.180174  6862 raft_consensus.cc:515] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:47.159772  7178 raft_consensus.cc:515] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:47.189428  5164 leader_election.cc:304] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:47.192842  6862 leader_election.cc:290] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:47.193981  7148 leader_election.cc:290] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:13:47.194952  5240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:47.201776  7161 raft_consensus.cc:3060] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:47.202318  6862 raft_consensus.cc:2804] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:47.202756  6862 raft_consensus.cc:493] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:47.203131  6862 raft_consensus.cc:3060] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:47.207755  5116 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40402 (request call id 1772) took 1452 ms (client timeout 1596 ms). Trace:
W20260709 12:13:47.208196  5116 rpcz_store.cc:269] 0709 12:13:45.755147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:45.755286 (+   139us) service_pool.cc:224] Handling call
0709 12:13:47.207305 (+1452019us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b540038d1d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:13:47.207568 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":414709120}
W20260709 12:13:47.215487  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 806376us
I20260709 12:13:47.219271  5121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40402 (request call id 1766) took 1483 ms. Trace:
I20260709 12:13:47.219761  5121 rpcz_store.cc:276] 0709 12:13:45.735588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:45.736052 (+   464us) service_pool.cc:224] Handling call
0709 12:13:47.218287 (+1482235us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b5800002a98. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb9cfc0 00007f84ebb87929 00007f84ebb873d2 00007f84e50febd4
0709 12:13:47.218574 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:47.218783 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:47.218809 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:47.218867 (+    58us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:13:47.218900 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:47.218955 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:47.219092 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36716800}
I20260709 12:13:47.226707  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:47.230330  7043 raft_consensus.cc:3060] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:47.236433  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:47.237241  5838 raft_consensus.cc:2468] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 4.
I20260709 12:13:47.239830  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:47.240797  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:47.247146  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:47.248759  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:47.251192  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:47.254814  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:47.260680  5271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50932 (request call id 390) took 1512 ms. Trace:
I20260709 12:13:47.286700  5271 rpcz_store.cc:276] 0709 12:13:45.748296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:46.094274 (+345978us) service_pool.cc:224] Handling call
0709 12:13:46.158522 (+ 64248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:46.364288 (+205766us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:47.260270 (+895982us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b54000a7154. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:13:47.260600 (+   330us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":318727040}
I20260709 12:13:47.260871  6960 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:47.288240  6960 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:47.290781  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:47.291107  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:47.291755  5197 raft_consensus.cc:3060] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:47.292410  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:47.294032  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:47.294288  6960 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:47.294891  5269 raft_consensus.cc:2468] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 1.
I20260709 12:13:47.298164  5837 raft_consensus.cc:2410] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:13:47.300720  5837 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46100 (request call id 716) took 2926 ms (client timeout 2656 ms). Trace:
I20260709 12:13:47.300990  5801 leader_election.cc:304] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:47.301258  7080 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.301805  7080 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:47.302790  5837 rpcz_store.cc:269] 0709 12:13:44.374251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:44.585334 (+211083us) service_pool.cc:224] Handling call
0709 12:13:47.300441 (+2715107us) spinlock_profiling.cc:243] Waited 2.65 s on lock 0x7b540064bed4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:13:47.300622 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6095970048}
I20260709 12:13:47.305632  6960 raft_consensus.cc:2749] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:47.309369  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:47.263567  5200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 1694) took 2297 ms. Trace:
I20260709 12:13:47.310896  5200 rpcz_store.cc:276] 0709 12:13:44.966456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:44.984571 (+ 18115us) service_pool.cc:224] Handling call
0709 12:13:44.984892 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:45.006189 (+ 21297us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:45.006223 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:45.006268 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:45.006303 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:47.263090 (+2256787us) spinlock_profiling.cc:243] Waited 21.1 ms on lock 0x7b540032d554. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:13:47.263154 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:47.263384 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":48417152}
I20260709 12:13:47.271940  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:47.312528  5267 raft_consensus.cc:2468] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 1.
I20260709 12:13:47.273861  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:47.313958  5265 raft_consensus.cc:2468] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 6.
I20260709 12:13:47.274628  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:47.314989  5274 raft_consensus.cc:2468] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 1.
I20260709 12:13:47.276791  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:47.278066  5266 raft_consensus.cc:1275] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:13:47.280431  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:47.318076  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:47.319568  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:47.282948  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:47.339257  7045 leader_election.cc:290] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:47.340015  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:47.340725  5834 raft_consensus.cc:2468] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 4.
I20260709 12:13:47.341724  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:47.342554  7080 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:47.343154  5834 raft_consensus.cc:1275] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:47.284579  5838 raft_consensus.cc:1275] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:47.285421  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:47.344476  5836 raft_consensus.cc:2468] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 1.
I20260709 12:13:47.323576  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:47.345522  5831 raft_consensus.cc:2468] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 5.
W20260709 12:13:47.324452  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 57318.6us
I20260709 12:13:47.325762  6971 raft_consensus.cc:493] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.326589  6948 raft_consensus.cc:493] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.347236  7209 raft_consensus.cc:493] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.347864  6948 raft_consensus.cc:515] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:47.348023  7209 raft_consensus.cc:515] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:47.349643  7189 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:47.350153  6948 leader_election.cc:290] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:47.350304  7189 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:47.350847  6971 raft_consensus.cc:515] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:47.352582  7189 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:47.353003  6971 leader_election.cc:290] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:47.355129  7209 leader_election.cc:290] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:13:47.356065  5802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:47.355954  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:13:47.327091  5166 connection.cc:256] RPC call timeout handler was delayed by -1.6901150820001476s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18300000000000002s for a response
I20260709 12:13:47.357440  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:13:47.358547  5166 connection.cc:256] RPC call timeout handler was delayed by -1.3303288090000933s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2146s for a response
I20260709 12:13:47.359252  6948 raft_consensus.cc:493] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:47.359863  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:47.360121  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:47.360580  5122 raft_consensus.cc:2468] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 2.
I20260709 12:13:47.309881  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:47.361109  5166 leader_election.cc:304] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:47.359875  6948 raft_consensus.cc:515] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:13:47.327728  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 117965us
I20260709 12:13:46.191900  5832 rpcz_store.cc:276] 0709 12:13:45.181612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:45.893755 (+712143us) service_pool.cc:224] Handling call
0709 12:13:45.895027 (+  1272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:45.895261 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:13:45.904200 (+  8939us) log.cc:844] Serialized 14 byte log entry
0709 12:13:46.182607 (+278407us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:46.182659 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:13:46.182704 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:46.182766 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:46.182890 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":18508,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":3067,"raft.queue_time_us":76550,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":16416,"spinlock_wait_cycles":18176,"thread_start_us":277683,"threads_started":2}
I20260709 12:13:47.336501  5089 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:13:47.363423  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:47.364269  6948 leader_election.cc:290] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:47.364662  7175 raft_consensus.cc:2804] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:47.365087  7175 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:47.338158  7134 raft_consensus.cc:493] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:47.365459  6948 raft_consensus.cc:2804] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:47.366098  6948 raft_consensus.cc:697] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:47.366329  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:47.365756  7134 raft_consensus.cc:515] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:47.367168  6948 consensus_queue.cc:237] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:47.369961  7134 leader_election.cc:290] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:47.371294  5164 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:47.371883  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:47.374135  5019 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58198 (request call id 324) took 5492 ms. Trace:
I20260709 12:13:47.380223  6862 raft_consensus.cc:515] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:47.381557  7134 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:47.281600  5829 raft_consensus.cc:1275] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:13:47.382393  7134 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:47.365451  7175 raft_consensus.cc:3060] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:47.386986  7134 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:47.389864  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:47.392493  5271 raft_consensus.cc:2468] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 4.
I20260709 12:13:47.391808  7128 raft_consensus.cc:493] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:47.365826  5272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50932 (request call id 382) took 2502 ms. Trace:
I20260709 12:13:47.374641  5019 rpcz_store.cc:276] 0709 12:13:41.890616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:41.898612 (+  7996us) service_pool.cc:224] Handling call
0709 12:13:47.373913 (+5475301us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:43.554878 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:43.555436 (+   558us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:43.555470 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:13:43.555487 (+    17us) tablet.cc:662] Decoding operations
0709 12:13:43.556134 (+   647us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:43.556211 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:43.556237 (+    26us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:13:43.556730 (+   493us) tablet.cc:701] Row locks acquired
0709 12:13:43.556747 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:13:43.556877 (+   130us) write_op.cc:270] Start()
0709 12:13:43.556993 (+   116us) write_op.cc:276] Timestamp: P: 1783599223556833 usec, L: 0
0709 12:13:43.557014 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:13:43.645341 (+ 88327us) log.cc:844] Serialized 2084 byte log entry
0709 12:13:44.337674 (+692333us) op_driver.cc:464] REPLICATION: finished
0709 12:13:47.265548 (+2927874us) spinlock_profiling.cc:243] Waited 2.12 ms on lock 0x7b54002a2528. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ecf7f9e1 00007f84ecf7e64c 00007f84ea5fa845 00007f84ea5fed61 00007f84ea5fed19 00007f84ea5feca9 00007f84ea5fec71 00007f84ea5fde9d 0000000000388634 0000000000388479 00007f84e3ad6475
0709 12:13:47.265775 (+   227us) write_op.cc:301] APPLY: starting
0709 12:13:47.265933 (+   158us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:47.266182 (+   249us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:47.266217 (+    35us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:47.267244 (+  1027us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:47.267471 (+   227us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:13:47.267518 (+    47us) write_op.cc:312] APPLY: finished
0709 12:13:47.267911 (+   393us) log.cc:844] Serialized 47 byte log entry
0709 12:13:47.268107 (+   196us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:47.268267 (+   160us) write_op.cc:454] Released schema lock
0709 12:13:47.268312 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:47.276377 (+  8065us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:47.276406 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":874,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":597589,"apply.run_cpu_time_us":50321,"apply.run_wall_time_us":2313506,"num_ops":5,"prepare.queue_time_us":192186,"prepare.run_cpu_time_us":3958,"prepare.run_wall_time_us":128803,"replication_time_us":751104,"spinlock_wait_cycles":4887296,"thread_start_us":471911,"threads_started":2}]]}
I20260709 12:13:47.405778  5197 raft_consensus.cc:2468] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
I20260709 12:13:47.384610  5829 pending_rounds.cc:85] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088: Aborting all ops after (but not including) 4
I20260709 12:13:47.411659  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:47.415678  5192 raft_consensus.cc:1240] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:13:47.416061  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:47.416810  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:47.417289  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:47.417733  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:47.418043  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:47.414916  5837 raft_consensus.cc:1275] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:47.418495  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:47.431069  5199 raft_consensus.cc:2468] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 1.
I20260709 12:13:47.419390  7007 leader_election.cc:290] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:47.438524  5196 raft_consensus.cc:2393] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 3: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:47.423098  7178 leader_election.cc:290] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:47.439563  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:47.439802  5193 raft_consensus.cc:2468] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
I20260709 12:13:47.440527  5121 raft_consensus.cc:2368] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 4. Current term is 5.
I20260709 12:13:47.435443  5829 pending_rounds.cc:107] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:13:47.441627  5829 raft_consensus.cc:2889] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:47.443603  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:47.447110  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:47.450330  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:47.450640  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:47.451156  5122 raft_consensus.cc:3060] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:47.422219  5272 rpcz_store.cc:276] 0709 12:13:44.863100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:44.864595 (+  1495us) service_pool.cc:224] Handling call
0709 12:13:47.070734 (+2206139us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:47.078727 (+  7993us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:47.365619 (+286892us) spinlock_profiling.cc:243] Waited 2.19 s on lock 0x7b54002eefd0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc28ad 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:13:47.365769 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5040796928}
W20260709 12:13:47.390403  5238 connection.cc:256] RPC call timeout handler was delayed by -1.0117879470001299s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.26070000000000004s for a response
I20260709 12:13:47.500710  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:47.517529  5122 raft_consensus.cc:2468] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 4.
W20260709 12:13:47.742491  5240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:47.605458  5801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:47.670388  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:47.744508  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:47.518826  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:13:47.519186  5803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:47.625615  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:47.740506  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:47.502072  5191 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
W20260709 12:13:47.733978  5859 debug-util.cc:398] Leaking SignalData structure 0x7b08002fa020 after lost signal to thread 3925
I20260709 12:13:47.517992  7007 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:47.759763  5859 debug-util.cc:398] Leaking SignalData structure 0x7b08002fa700 after lost signal to thread 5057
I20260709 12:13:47.760071  7007 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:47.761546  5859 debug-util.cc:398] Leaking SignalData structure 0x7b080039baa0 after lost signal to thread 5149
W20260709 12:13:47.762848  5859 debug-util.cc:398] Leaking SignalData structure 0x7b080037ede0 after lost signal to thread 5224
I20260709 12:13:47.762784  7080 consensus_queue.cc:1048] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:13:47.763441  5859 debug-util.cc:398] Leaking SignalData structure 0x7b080037eda0 after lost signal to thread 5225
W20260709 12:13:47.764539  5859 debug-util.cc:398] Leaking SignalData structure 0x7b08001340c0 after lost signal to thread 5298
I20260709 12:13:47.721038  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:13:47.765736  5859 debug-util.cc:398] Leaking SignalData structure 0x7b08003aa460 after lost signal to thread 5862
W20260709 12:13:47.766031  5859 debug-util.cc:398] Leaking SignalData structure 0x7b0800226300 after lost signal to thread 5863
I20260709 12:13:47.518404  7120 raft_consensus.cc:2804] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:47.767409  7120 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:47.767768  7120 raft_consensus.cc:3060] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:47.530458  5833 raft_consensus.cc:1275] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:47.771337  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:47.772342  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:47.762681  7007 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:47.759773  5274 raft_consensus.cc:3060] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:47.530825  6862 leader_election.cc:290] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:47.782743  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:47.784786  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:47.787346  5117 raft_consensus.cc:1275] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:47.788395  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:47.783743  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:47.789528  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:47.790302  5267 raft_consensus.cc:2468] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 2.
I20260709 12:13:47.790665  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:47.791287  7175 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:47.791911  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:47.792539  5273 raft_consensus.cc:2468] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 2.
I20260709 12:13:47.793448  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:47.756659  7045 consensus_queue.cc:1048] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:13:47.797935  5266 raft_consensus.cc:2393] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 3: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
W20260709 12:13:47.798698  7151 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.271s	user 0.018s	sys 0.017s
W20260709 12:13:47.799153  7151 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.351s	user 0.018s	sys 0.017s
I20260709 12:13:47.798823  7007 consensus_queue.cc:1048] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:47.802037  5118 raft_consensus.cc:2410] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 4 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 12:13:47.789407  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:47.791318  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:47.804602  5267 raft_consensus.cc:2376] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3. Re-sending same reply.
I20260709 12:13:47.807256  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
W20260709 12:13:47.785468  7116 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.034s	sys 0.098s
I20260709 12:13:47.525466  7128 raft_consensus.cc:515] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:47.821720  5118 raft_consensus.cc:1240] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:47.825630  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:13:47.826965  5802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:47.817476  5116 raft_consensus.cc:2468] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 2.
W20260709 12:13:47.811836  7116 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.035s	sys 0.098s
I20260709 12:13:47.828398  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:47.830933  5200 raft_consensus.cc:2468] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
I20260709 12:13:47.831832  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:47.833526  5272 raft_consensus.cc:2376] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3. Re-sending same reply.
W20260709 12:13:47.840149  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 468908us
I20260709 12:13:47.841591  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:47.842423  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:47.842571  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:47.843101  5199 raft_consensus.cc:2468] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
I20260709 12:13:47.844823  5801 leader_election.cc:304] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:13:47.843109  5197 raft_consensus.cc:2376] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3. Re-sending same reply.
I20260709 12:13:47.844244  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:47.849586  5835 raft_consensus.cc:1240] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 4 LEADER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:13:47.854996  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:47.854967  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:47.857838  5200 raft_consensus.cc:2468] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
I20260709 12:13:47.838426  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:47.856561  5268 raft_consensus.cc:2468] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
I20260709 12:13:47.863875  5118 raft_consensus.cc:1240] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:47.864986  7175 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:47.865433  7069 raft_consensus.cc:493] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:47.861763  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 500726us
I20260709 12:13:47.854862  7038 consensus_queue.cc:1059] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
W20260709 12:13:47.872351  5195 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.999s	user 0.067s	sys 0.084s
I20260709 12:13:47.855953  7080 raft_consensus.cc:2804] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:47.877272  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:47.879346  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:47.880089  5193 raft_consensus.cc:2393] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 2: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:47.882859  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:13:47.883814  5237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:47.875201  5833 raft_consensus.cc:2468] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 4.
W20260709 12:13:47.878585  5195 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.121s	user 0.068s	sys 0.085s
I20260709 12:13:47.899022  5122 raft_consensus.cc:2393] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 4: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:47.878548  7080 raft_consensus.cc:493] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:47.873006  7045 consensus_queue.cc:1059] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:13:47.887413  7128 leader_election.cc:290] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:47.907857  7045 consensus_queue.cc:1243] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer bce73265e27d4b30a4dcc1e491305088 log is divergent from this leader: its last log entry 4.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:13:47.908437  7045 raft_consensus.cc:3055] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:47.911201  5088 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:47.904080  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:13:47.916769  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 428132us
I20260709 12:13:47.913519  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:47.894466  7161 raft_consensus.cc:493] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:47.908753  7045 raft_consensus.cc:740] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:47.905435  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:47.910316  7080 raft_consensus.cc:3060] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:47.924141  6971 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.918553  7038 raft_consensus.cc:493] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.909229  7148 raft_consensus.cc:493] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:47.940027  5270 raft_consensus.cc:1275] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:47.897969  7069 raft_consensus.cc:515] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:47.945108  5166 leader_election.cc:304] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:47.955942  6948 raft_consensus.cc:2804] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:47.956453  6948 raft_consensus.cc:493] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:47.956869  6948 raft_consensus.cc:3060] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:47.937218  7209 raft_consensus.cc:2749] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:47.939529  5830 raft_consensus.cc:3060] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:47.960865  5166 leader_election.cc:304] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:47.933270  6971 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:47.965040  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:47.947647  7038 raft_consensus.cc:515] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:47.939558  7161 raft_consensus.cc:515] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:47.976666  5270 raft_consensus.cc:2393] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 4: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:13:47.979188  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:47.981846  5267 raft_consensus.cc:2468] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 2.
I20260709 12:13:47.987159  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:47.988755  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:47.983170  5088 leader_election.cc:304] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:47.974069  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:48.000427  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:48.003129  5088 leader_election.cc:304] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:48.005699  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:47.992726  7045 consensus_queue.cc:260] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:48.007468  7045 raft_consensus.cc:3060] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:48.005625  5166 leader_election.cc:304] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:47.975281  7148 raft_consensus.cc:515] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:47.995110  6862 raft_consensus.cc:2749] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:48.004325  5116 raft_consensus.cc:3055] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:48.014317  5116 raft_consensus.cc:740] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:48.008764  7209 raft_consensus.cc:2804] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:48.019179  7036 consensus_queue.cc:1048] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:13:48.008070  5195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41416 (request call id 315) took 2940 ms. Trace:
I20260709 12:13:48.024019  5270 raft_consensus.cc:1275] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:48.028003  5088 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:48.021121  7007 raft_consensus.cc:2804] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:48.021682  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:48.020666  7209 raft_consensus.cc:697] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
W20260709 12:13:48.037528  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 196135us
I20260709 12:13:48.040421  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:48.029712  6862 raft_consensus.cc:2804] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:48.045644  5166 leader_election.cc:304] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:48.048707  5088 leader_election.cc:304] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:48.035359  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:48.043728  6862 raft_consensus.cc:493] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:48.052897  7069 leader_election.cc:290] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:48.036240  7007 raft_consensus.cc:493] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:48.062512  5166 leader_election.cc:304] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:48.055400  7209 consensus_queue.cc:237] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:48.057044  5118 raft_consensus.cc:1240] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:48.057662  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:48.060914  5089 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:13:48.055420  7138 raft_consensus.cc:2804] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:48.063244  5166 leader_election.cc:304] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:48.058959  5116 consensus_queue.cc:260] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:48.078145  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 80455.8us
I20260709 12:13:48.078334  7069 raft_consensus.cc:493] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.079036  7069 raft_consensus.cc:515] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:48.081436  7069 leader_election.cc:290] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:48.079030  5164 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:48.061230  6862 raft_consensus.cc:3060] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:48.066395  7036 raft_consensus.cc:2804] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:48.064731  7007 raft_consensus.cc:3060] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:48.103412  7036 raft_consensus.cc:493] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:48.104017  7036 raft_consensus.cc:3060] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:48.105639  7161 leader_election.cc:290] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:48.106501  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:48.107945  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:48.064397  5119 raft_consensus.cc:2468] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 4.
I20260709 12:13:48.071463  7138 raft_consensus.cc:493] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:48.087512  7189 raft_consensus.cc:3060] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:48.142215  7148 leader_election.cc:290] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:48.142423  5164 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:48.173700  7238 raft_consensus.cc:2804] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:48.174335  7238 raft_consensus.cc:493] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:48.174719  7238 raft_consensus.cc:3060] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:48.177852  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
W20260709 12:13:48.179795  7227 log.cc:927] Time spent T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 12:13:48.184377  7120 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:48.185634  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 73090us
I20260709 12:13:48.189863  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:13:48.191341  5803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:48.120440  5240 leader_election.cc:304] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:13:48.089712  7038 leader_election.cc:290] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:48.121527  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:48.122422  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:48.192826  5125 raft_consensus.cc:2468] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 4.
I20260709 12:13:48.123034  6901 raft_consensus.cc:2804] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:48.123427  7090 raft_consensus.cc:3055] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:48.125511  7229 raft_consensus.cc:2804] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:48.129853  7228 raft_consensus.cc:2804] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:48.130383  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:13:48.130681  7225 log.cc:927] Time spent T 00000000000000000000000000000000 P 221aa011207d421b9725197ff8bed389: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:13:48.133747  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:48.021903  5195 rpcz_store.cc:276] 0709 12:13:45.067333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:45.532301 (+464968us) service_pool.cc:224] Handling call
0709 12:13:45.532647 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:45.689254 (+156607us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:45.690992 (+  1738us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:45.729530 (+ 38538us) log.cc:844] Serialized 26 byte log entry
0709 12:13:47.224322 (+1494792us) spinlock_profiling.cc:243] Waited 26.3 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e3ab90ac 00007f84ec9139a9 00007f84e3ad569b 00007f84e3ad393f 00007f84e3ad5c02 00007f84e675d20b
0709 12:13:47.906494 (+682172us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:47.906554 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:47.907329 (+   775us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b54001388d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:13:47.907375 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:48.007799 (+100424us) raft_consensus.cc:1685] finished
0709 12:13:48.007830 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:48.007995 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10758,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":893,"spinlock_wait_cycles":409767552,"thread_start_us":2149289,"threads_started":1,"wal-append.queue_time_us":2174748}
I20260709 12:13:48.134752  7036 raft_consensus.cc:515] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:48.196425  5274 raft_consensus.cc:2468] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
I20260709 12:13:48.119146  7138 raft_consensus.cc:3060] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:48.188419  5804 leader_election.cc:304] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:13:48.217935  5163 leader_election.cc:336] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 1.527s (SENT)
W20260709 12:13:48.226058  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 179344us
W20260709 12:13:48.227780  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 166918us
W20260709 12:13:48.226889  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 143794us
W20260709 12:13:48.228500  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 125034us
I20260709 12:13:48.229727  5117 raft_consensus.cc:2468] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 3.
I20260709 12:13:48.234007  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:13:48.239934  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 119592us
I20260709 12:13:48.243124  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:13:48.244505  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 97575.4us
I20260709 12:13:48.237886  5163 leader_election.cc:304] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:48.247704  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:48.229436  7229 raft_consensus.cc:493] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:48.212949  7090 raft_consensus.cc:740] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:13:48.249157  5088 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:48.235577  6971 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:48.228936  7228 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:48.271270  7228 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:48.246330  7148 raft_consensus.cc:2804] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:13:48.279451  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 91083.6us
I20260709 12:13:48.258098  7229 raft_consensus.cc:3060] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:48.281612  5240 leader_election.cc:400] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 election: Vote denied by peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443) with higher term. Message: Invalid argument: T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 4. Current term is 5.
I20260709 12:13:48.285416  5240 leader_election.cc:403] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:13:48.285588  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:48.294490  6901 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:48.295059  6901 raft_consensus.cc:3060] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:48.295324  6862 raft_consensus.cc:515] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:48.296320  5269 raft_consensus.cc:2468] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 2.
I20260709 12:13:48.297217  7240 raft_consensus.cc:2749] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:48.266566  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:48.294215  7080 raft_consensus.cc:515] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:48.319932  5804 leader_election.cc:304] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:48.322507  5116 raft_consensus.cc:3060] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:48.327244  5274 raft_consensus.cc:2393] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 3: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:13:48.279129  7148 raft_consensus.cc:493] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
W20260709 12:13:48.330194  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 62512.7us
I20260709 12:13:48.331219  6862 leader_election.cc:290] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:48.332059  5240 leader_election.cc:304] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:13:48.332980  7128 raft_consensus.cc:2749] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443) with higher term. Message: Invalid argument: T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 4. Current term is 5.
W20260709 12:13:48.329553  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 91546us
I20260709 12:13:48.340020  5835 raft_consensus.cc:1240] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 1. Current term is 2. Ops: []
W20260709 12:13:48.344727  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 106104us
W20260709 12:13:48.346390  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 93790.6us
I20260709 12:13:48.349834  5116 raft_consensus.cc:1275] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:13:48.342139  6862 raft_consensus.cc:2749] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:48.323549  7240 consensus_queue.cc:1048] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:13:48.336629  7148 raft_consensus.cc:3060] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:48.297271  7232 consensus_queue.cc:1059] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.151s
I20260709 12:13:48.355067  7243 raft_consensus.cc:3060] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:48.383745  5088 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:48.351157  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:48.343084  7134 raft_consensus.cc:2804] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:48.378643  5116 pending_rounds.cc:85] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting all ops after (but not including) 5
I20260709 12:13:48.352442  7120 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:48.398468  5116 pending_rounds.cc:107] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:13:48.398985  5116 raft_consensus.cc:2889] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:48.401597  7246 raft_consensus.cc:2804] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:13:48.402829  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 163873us
W20260709 12:13:48.404307  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 186491us
I20260709 12:13:48.379496  7036 leader_election.cc:290] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:13:48.428233  5163 leader_election.cc:336] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 1.628s (SENT)
I20260709 12:13:48.432156  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:48.429571  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:48.432955  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:48.433158  5274 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 3.
I20260709 12:13:48.402267  7242 consensus_queue.cc:1048] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 12:13:48.439600  5163 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:48.439509  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:13:48.445245  5802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:48.446786  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:48.450091  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:48.425994  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:48.454049  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:48.456542  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:48.429438  7252 raft_consensus.cc:493] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.459465  7261 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.434888  7134 raft_consensus.cc:697] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 4 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:48.457185  5123 raft_consensus.cc:2468] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 4.
W20260709 12:13:48.463419  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 117938us
I20260709 12:13:48.467160  5088 leader_election.cc:304] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:48.471789  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:48.451265  7116 raft_consensus.cc:2749] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:48.470992  7261 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:48.476867  7175 raft_consensus.cc:2749] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:13:48.477501  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 49442.9us
I20260709 12:13:48.474943  7252 raft_consensus.cc:515] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:48.475437  6948 consensus_meta.cc:287] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.517s	user 0.010s	sys 0.000s
I20260709 12:13:48.472502  5268 raft_consensus.cc:2376] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 2. Re-sending same reply.
I20260709 12:13:48.478929  7147 consensus_queue.cc:1048] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
W20260709 12:13:48.480473  7237 log.cc:927] Time spent T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
W20260709 12:13:48.481092  7234 log.cc:927] Time spent T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 12:13:48.482296  5088 leader_election.cc:304] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:48.521551  5088 leader_election.cc:304] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:48.482945  7250 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:48.483426  7209 raft_consensus.cc:2804] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:13:48.503398  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 121215us
W20260709 12:13:48.504097  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 246633us
I20260709 12:13:48.525110  5240 leader_election.cc:304] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:13:48.511195  7036 raft_consensus.cc:2749] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:13:48.527487  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 146879us
I20260709 12:13:48.510751  7189 raft_consensus.cc:2749] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:48.528959  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:48.516211  7080 leader_election.cc:290] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:48.523043  6948 raft_consensus.cc:515] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:48.531530  5117 raft_consensus.cc:1275] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 12:13:48.525995  7045 consensus_meta.cc:287] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.518s	user 0.011s	sys 0.000s
W20260709 12:13:48.553871  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 235245us
I20260709 12:13:48.525800  7209 raft_consensus.cc:493] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
W20260709 12:13:48.557545  5830 consensus_meta.cc:287] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.575s	user 0.010s	sys 0.000s
W20260709 12:13:48.548821  7241 log.cc:927] Time spent T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
I20260709 12:13:48.571904  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:48.573164  5801 leader_election.cc:304] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:48.571154  7209 raft_consensus.cc:3060] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:48.574724  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 53257.6us
I20260709 12:13:48.576177  5088 leader_election.cc:304] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:48.576810  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:48.532989  7246 raft_consensus.cc:697] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:48.552409  7175 raft_consensus.cc:2749] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:48.579246  5804 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:48.551852  6948 leader_election.cc:290] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:48.605809  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:48.606832  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
W20260709 12:13:48.619097  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 46041.9us
I20260709 12:13:48.549296  7007 raft_consensus.cc:515] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:48.528251  7250 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:48.557950  7228 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:48.609043  7232 raft_consensus.cc:2804] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:48.612787  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:48.569581  7260 raft_consensus.cc:2804] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:48.614321  5804 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:48.637477  7255 raft_consensus.cc:2804] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:48.553716  7264 consensus_queue.cc:1059] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 12:13:48.604935  7248 raft_consensus.cc:2804] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:48.637974  7255 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:48.637735  5804 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:48.638316  7248 raft_consensus.cc:493] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:48.638556  7255 raft_consensus.cc:3060] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:48.636010  7232 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:48.639350  5804 leader_election.cc:304] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:13:48.603830  7134 consensus_queue.cc:237] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:48.619889  5801 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:48.622437  7256 raft_consensus.cc:493] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:48.622913  7235 log.cc:927] Time spent T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.176s	user 0.001s	sys 0.001s
I20260709 12:13:48.622625  7246 consensus_queue.cc:237] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:48.623703  7258 log.cc:927] Time spent T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:13:48.625928  7261 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:48.625850  7245 raft_consensus.cc:2804] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:48.609231  7263 raft_consensus.cc:2804] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:48.652295  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:48.573050  5830 raft_consensus.cc:2468] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
I20260709 12:13:48.638801  7248 raft_consensus.cc:3060] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:48.669008  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 49219.7us
I20260709 12:13:48.671356  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:48.671377  5801 leader_election.cc:304] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:48.639374  7232 raft_consensus.cc:3060] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:48.666388  7263 raft_consensus.cc:493] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:48.637985  7069 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.658047  7116 raft_consensus.cc:2749] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:48.640336  7260 raft_consensus.cc:493] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:48.654398  7007 leader_election.cc:290] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:48.668501  7269 raft_consensus.cc:2804] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:48.665803  7090 consensus_queue.cc:260] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:48.651912  7148 raft_consensus.cc:515] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:48.665759  7256 raft_consensus.cc:515] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:48.664242  7245 raft_consensus.cc:493] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:48.716167  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:48.716741  7245 raft_consensus.cc:3060] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:48.698753  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:48.716185  7253 raft_consensus.cc:2804] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:13:48.697863  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:48.698278  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:48.697402  5270 raft_consensus.cc:1275] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:48.716229  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:48.710295  5166 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:48.716747  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:48.714155  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:13:48.712142  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 135199us
I20260709 12:13:48.698305  7243 raft_consensus.cc:2749] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:48.698233  7080 raft_consensus.cc:2804] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:48.724628  7080 raft_consensus.cc:493] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:48.725154  7080 raft_consensus.cc:3060] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:48.709975  7269 raft_consensus.cc:493] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:48.725654  7269 raft_consensus.cc:3060] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:48.711843  7069 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:48.729480  6862 raft_consensus.cc:2804] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:48.729924  6862 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:48.730341  6862 raft_consensus.cc:3060] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:48.730564  7090 raft_consensus.cc:3060] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:48.732177  7254 consensus_queue.cc:1048] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:13:48.721082  7253 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:48.733837  7253 raft_consensus.cc:3060] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:13:48.734946  7138 raft_consensus.cc:515] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:48.669180  7238 raft_consensus.cc:515] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:48.739364  7238 leader_election.cc:290] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:48.708071  7260 raft_consensus.cc:3060] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:48.744966  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:48.745345  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
W20260709 12:13:48.714224  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 135496us
I20260709 12:13:48.652920  7250 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:48.656483  7229 raft_consensus.cc:515] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:48.723308  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:48.697613  7228 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:48.754853  7229 leader_election.cc:290] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:48.750465  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:48.757400  5199 raft_consensus.cc:3060] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:48.758814  7256 leader_election.cc:290] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:48.699582  7271 raft_consensus.cc:493] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:48.759747  7261 raft_consensus.cc:3055] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:48.760108  7261 raft_consensus.cc:740] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:48.758111  7252 leader_election.cc:290] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:48.729264  7069 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:48.762738  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:48.761065  7261 consensus_queue.cc:260] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:48.678884  6901 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:48.763708  7261 raft_consensus.cc:3060] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:48.764237  5125 raft_consensus.cc:1240] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:48.764990  6901 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:48.765978  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:48.768520  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:48.769335  5117 raft_consensus.cc:2393] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 4: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:13:48.737123  7138 leader_election.cc:290] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:48.763351  5266 raft_consensus.cc:2468] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 4.
I20260709 12:13:48.680088  7263 raft_consensus.cc:3060] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:48.786006  5803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:48.824100  7209 raft_consensus.cc:515] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:48.830250  7080 raft_consensus.cc:515] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:48.831773  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:13:48.832235  5240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:48.832422  5124 raft_consensus.cc:2468] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 4.
I20260709 12:13:48.833480  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:48.827929  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:13:48.835500  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 195745us
I20260709 12:13:48.836509  5199 raft_consensus.cc:2468] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 2.
I20260709 12:13:48.839821  5197 raft_consensus.cc:1240] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 1. Current term is 2. Ops: []
W20260709 12:13:48.841529  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 170223us
I20260709 12:13:48.843544  5801 leader_election.cc:304] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:48.845130  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:48.854259  5193 raft_consensus.cc:2410] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 4 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 12:13:48.856325  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:48.858425  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:48.859592  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:48.860457  5199 raft_consensus.cc:2393] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 4: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:48.863336  5240 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:13:48.865908  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:48.866930  5088 leader_election.cc:304] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:48.873493  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:48.759588  7271 raft_consensus.cc:515] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:48.877565  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:48.882571  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:48.882802  5191 raft_consensus.cc:1275] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:13:48.884186  5088 leader_election.cc:336] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 1.526s (SENT)
I20260709 12:13:48.881744  5801 leader_election.cc:304] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:48.884816  5088 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:48.883270  5089 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:13:48.888427  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:48.889094  5835 raft_consensus.cc:2468] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 3.
I20260709 12:13:48.847052  7080 leader_election.cc:290] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:48.890232  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:48.853960  7268 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:48.894378  5831 raft_consensus.cc:1275] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:48.895079  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:48.895977  5191 raft_consensus.cc:2368] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 4. Current term is 5.
I20260709 12:13:48.884385  7246 raft_consensus.cc:2804] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:48.897368  7246 raft_consensus.cc:697] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:48.897506  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:48.898209  5832 raft_consensus.cc:2468] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 3.
I20260709 12:13:48.898402  7246 consensus_queue.cc:237] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:48.848376  7243 consensus_queue.cc:1048] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:13:48.878700  7147 raft_consensus.cc:2804] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:48.842785  7245 raft_consensus.cc:515] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:13:48.926295  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 44617.8us
W20260709 12:13:48.929333  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 46123.4us
I20260709 12:13:48.929935  7285 raft_consensus.cc:2749] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:48.930691  7249 raft_consensus.cc:2749] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:48.930073  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:48.896937  7007 consensus_queue.cc:1059] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:13:48.931571  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:48.934283  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:48.937623  5832 raft_consensus.cc:3060] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:48.938900  5831 raft_consensus.cc:1275] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:13:48.940348  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:48.941725  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:48.942068  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:48.942318  7038 consensus_queue.cc:1048] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 12:13:48.942770  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:48.875761  7228 consensus_queue.cc:1059] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:13:48.900008  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:48.962744  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:48.942523  5238 leader_election.cc:304] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:48.900882  7148 leader_election.cc:290] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:48.941744  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:48.944700  5268 raft_consensus.cc:2393] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 3: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:13:48.947732  5801 leader_election.cc:304] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:48.943212  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:48.962478  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:48.977891  5836 raft_consensus.cc:2468] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 4.
I20260709 12:13:48.962713  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:48.979290  5267 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 3.
W20260709 12:13:48.977119  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 92927.3us
I20260709 12:13:48.962965  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:48.963613  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:48.923843  7147 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:48.941627  7280 raft_consensus.cc:2749] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:48.986380  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:49.000339  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
W20260709 12:13:48.984555  7225 log.cc:927] Time spent T 00000000000000000000000000000000 P 221aa011207d421b9725197ff8bed389: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:13:48.908378  7268 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:48.983107  5830 raft_consensus.cc:2468] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 4.
I20260709 12:13:49.010838  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:49.010970  5118 raft_consensus.cc:2393] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 4: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:13:48.982453  7147 raft_consensus.cc:3060] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:49.022318  5832 raft_consensus.cc:2468] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 3.
I20260709 12:13:49.011559  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:49.041152  5837 raft_consensus.cc:1240] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 5 LEADER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:49.083659  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:13:49.086658  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 274195us
I20260709 12:13:48.986837  7080 raft_consensus.cc:2804] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:13:49.083272  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 204522us
I20260709 12:13:49.001682  7264 raft_consensus.cc:2804] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:13:49.014757  7278 log.cc:927] Time spent T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
W20260709 12:13:49.094281  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 151876us
I20260709 12:13:49.091202  5089 leader_election.cc:304] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:49.025144  5018 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50918 (request call id 225) took 4983 ms. Trace:
I20260709 12:13:49.096979  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:49.019300  7244 raft_consensus.cc:2804] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:49.019074  7249 raft_consensus.cc:3055] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:49.108188  5124 raft_consensus.cc:1240] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:49.042232  7262 raft_consensus.cc:3055] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:13:49.110193  5237 leader_election.cc:336] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Timed out: RequestConsensusVote RPC to 127.3.212.130:44455 timed out after 1.578s (SENT)
I20260709 12:13:49.051891  7209 leader_election.cc:290] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:49.115933  5123 raft_consensus.cc:1240] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:49.027941  7271 leader_election.cc:290] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:13:49.117483  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 115828us
I20260709 12:13:49.122460  5191 raft_consensus.cc:1275] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:49.096253  7080 raft_consensus.cc:493] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:49.109807  6901 raft_consensus.cc:2804] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:49.129012  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:49.032429  6862 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:49.109705  7264 raft_consensus.cc:697] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 3 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:49.017522  7263 raft_consensus.cc:515] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:49.131158  5197 raft_consensus.cc:1240] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:49.109443  7249 raft_consensus.cc:740] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:49.037343  7269 raft_consensus.cc:515] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:49.053241  7255 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:49.123974  5195 raft_consensus.cc:2410] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:13:49.115437  7262 raft_consensus.cc:740] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:49.042747  7260 raft_consensus.cc:515] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:49.128695  6901 raft_consensus.cc:493] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:49.172703  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
W20260709 12:13:49.184918  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 70013.6us
I20260709 12:13:49.173329  5191 raft_consensus.cc:1240] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 2. Current term is 3. Ops: []
W20260709 12:13:49.173326  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 63157.6us
I20260709 12:13:49.191079  5834 raft_consensus.cc:1240] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:49.118817  7244 raft_consensus.cc:697] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:49.196489  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:49.178035  7253 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:49.197428  5270 raft_consensus.cc:2468] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 3.
I20260709 12:13:49.197702  7244 consensus_queue.cc:237] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:49.198446  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:49.201612  7268 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:49.202204  7289 consensus_queue.cc:1059] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.081s
I20260709 12:13:49.126550  7080 raft_consensus.cc:3060] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:49.172297  5198 raft_consensus.cc:2468] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 3.
I20260709 12:13:49.191763  6901 raft_consensus.cc:3060] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:49.205680  7260 leader_election.cc:290] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:49.206233  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:49.207373  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:49.208035  5272 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 3.
I20260709 12:13:49.188874  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:49.185657  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:49.210001  5196 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 3.
I20260709 12:13:49.178857  5123 pending_rounds.cc:85] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting all ops after (but not including) 4
I20260709 12:13:49.210878  5123 pending_rounds.cc:107] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:13:49.051398  7232 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:49.191854  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 82802.7us
I20260709 12:13:49.194216  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:49.194720  7161 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.195127  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:49.195693  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:49.201990  7262 consensus_queue.cc:260] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:49.206511  5122 raft_consensus.cc:1240] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:13:49.125780  7248 raft_consensus.cc:515] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:49.266125  7262 raft_consensus.cc:3060] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:49.268092  7248 leader_election.cc:290] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:49.269023  5116 raft_consensus.cc:1240] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:49.207469  7269 leader_election.cc:290] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:49.212029  5123 raft_consensus.cc:2889] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:49.229657  5838 raft_consensus.cc:1240] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:13:49.230803  7232 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:13:49.231288  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 251095us
I20260709 12:13:49.286113  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:49.236011  5238 leader_election.cc:304] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:49.248417  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:49.248754  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:49.287961  5117 raft_consensus.cc:3060] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:49.249073  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:49.249768  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:49.251700  7161 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
W20260709 12:13:49.253806  7291 log.cc:927] Time spent T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:13:49.257689  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:49.294226  5274 raft_consensus.cc:3060] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:49.261220  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:49.262187  7249 consensus_queue.cc:260] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:49.263751  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:49.264514  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:49.311758  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:49.312412  5120 raft_consensus.cc:3060] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:49.096697  5018 rpcz_store.cc:276] 0709 12:13:44.041851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:44.042073 (+   222us) service_pool.cc:224] Handling call
0709 12:13:49.024926 (+4982853us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:44.976980 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:45.148140 (+171160us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:45.151733 (+  3593us) write_op.cc:435] Acquired schema lock
0709 12:13:45.151753 (+    20us) tablet.cc:662] Decoding operations
0709 12:13:45.242066 (+ 90313us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:45.242443 (+   377us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:45.242477 (+    34us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:13:45.382140 (+139663us) tablet.cc:701] Row locks acquired
0709 12:13:45.382186 (+    46us) write_op.cc:260] PREPARE: finished
0709 12:13:45.410355 (+ 28169us) write_op.cc:270] Start()
0709 12:13:45.426963 (+ 16608us) write_op.cc:276] Timestamp: P: 1783599225402097 usec, L: 0
0709 12:13:45.427012 (+    49us) op_driver.cc:348] REPLICATION: starting
0709 12:13:45.448182 (+ 21170us) log.cc:844] Serialized 2132 byte log entry
0709 12:13:47.254824 (+1806642us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e3ab90ac 00007f84ec9139a9 00007f84e3ad569b 00007f84e3ad393f 00007f84e3ad5c02 00007f84e675d20b
0709 12:13:48.668291 (+1413467us) op_driver.cc:464] REPLICATION: finished
0709 12:13:48.897652 (+229361us) write_op.cc:301] APPLY: starting
0709 12:13:48.897733 (+    81us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:48.897934 (+   201us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:48.897954 (+    20us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:48.898741 (+   787us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:48.898931 (+   190us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:13:48.898979 (+    48us) write_op.cc:312] APPLY: finished
0709 12:13:48.899212 (+   233us) log.cc:844] Serialized 47 byte log entry
0709 12:13:48.899379 (+   167us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:48.904087 (+  4708us) write_op.cc:454] Released schema lock
0709 12:13:48.904157 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:48.904538 (+   381us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:48.904578 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":229123,"apply.run_cpu_time_us":2316,"apply.run_wall_time_us":6869,"num_ops":5,"prepare.queue_time_us":655990,"prepare.run_cpu_time_us":43050,"prepare.run_wall_time_us":2838951,"raft.queue_time_us":268307,"raft.run_cpu_time_us":13555,"raft.run_wall_time_us":194866,"replication_time_us":3239827,"spinlock_wait_cycles":34568576,"thread_start_us":3111403,"threads_started":4,"wal-append.queue_time_us":2581773}]]}
I20260709 12:13:49.265388  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:49.270358  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:49.249251  5833 raft_consensus.cc:1240] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:49.271803  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:49.250617  5801 leader_election.cc:304] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:49.290998  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:49.291628  5023 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33888 (request call id 333) took 7235 ms. Trace:
I20260709 12:13:49.285442  5271 raft_consensus.cc:2468] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 4.
W20260709 12:13:49.292407  7261 consensus_meta.cc:287] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.528s	user 0.011s	sys 0.002s
I20260709 12:13:49.292974  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:49.314708  5837 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 4 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 4.
I20260709 12:13:49.250253  7274 consensus_queue.cc:1059] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 12:13:49.272647  7245 leader_election.cc:290] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:49.196609  7264 consensus_queue.cc:237] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:49.318035  7265 raft_consensus.cc:3055] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:49.247411  7238 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.250350  7090 consensus_queue.cc:1059] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.098s
W20260709 12:13:49.391425  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 155511us
W20260709 12:13:49.360865  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 110348us
I20260709 12:13:49.320379  5023 rpcz_store.cc:276] 0709 12:13:42.013473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:42.018860 (+  5387us) service_pool.cc:224] Handling call
0709 12:13:42.662416 (+643556us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b540026ff54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2d090 00007f84e6bcbf3a 00007f84ec981e9c 00007f84eca8004e 00007f84eaf412a4 00007f84eaf41232 00007f84eaf41161 00007f84eaf410dc 00007f84eaf40392 00007f84e4efe48c 00007f84e4efd8c6
0709 12:13:49.234608 (+6572192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":167480,"reported_tablets":5,"spinlock_wait_cycles":281241984}
W20260709 12:13:49.335630  5166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:49.415959  5124 raft_consensus.cc:1240] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 3. Current term is 4. Ops: []
W20260709 12:13:49.398288  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:49.437744  5198 raft_consensus.cc:1240] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:49.389808  5274 raft_consensus.cc:2468] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 4.
I20260709 12:13:49.295908  7175 raft_consensus.cc:493] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.441749  5801 leader_election.cc:304] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:49.436226  7238 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:49.422641  5830 raft_consensus.cc:1275] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:13:49.447399  5240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:49.378335  7232 raft_consensus.cc:2804] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:49.447779  5801 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:49.430809  7249 raft_consensus.cc:3060] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:13:49.456148  5088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:49.391070  7229 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.457283  5200 raft_consensus.cc:1240] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:49.435336  7265 raft_consensus.cc:740] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:49.465807  5192 raft_consensus.cc:1240] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:49.350044  7128 raft_consensus.cc:2749] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:49.377507  6862 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:49.464607  7229 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:49.418357  7148 consensus_queue.cc:1059] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:13:49.450192  7280 raft_consensus.cc:2749] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:49.473109  7148 raft_consensus.cc:3055] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:49.473541  7148 raft_consensus.cc:740] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
W20260709 12:13:49.469477  5088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:49.472311  7298 log.cc:927] Time spent T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.195s	user 0.000s	sys 0.000s
I20260709 12:13:49.474336  7148 consensus_queue.cc:260] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:49.474890  5088 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:49.475528  7148 raft_consensus.cc:3060] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:49.475714  7007 raft_consensus.cc:2749] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:49.476552  7253 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:49.476727  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:49.450474  7175 raft_consensus.cc:515] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:49.478238  5238 leader_election.cc:304] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:49.479736  5238 leader_election.cc:304] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:49.422255  7260 consensus_queue.cc:1059] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 12:13:49.360729  7080 raft_consensus.cc:515] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:49.456022  7232 raft_consensus.cc:493] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:49.489483  7255 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:49.465827  7243 raft_consensus.cc:2804] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:49.482393  7175 leader_election.cc:290] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:49.466339  7256 consensus_queue.cc:1059] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:13:49.502724  5119 raft_consensus.cc:1275] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:13:49.501345  7134 raft_consensus.cc:2749] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:49.513181  5238 leader_election.cc:304] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:49.517329  5117 raft_consensus.cc:2468] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 4.
I20260709 12:13:49.523792  5120 raft_consensus.cc:2468] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 5.
I20260709 12:13:49.529206  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:49.541313  5122 raft_consensus.cc:2393] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 5: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:13:49.534222  5198 raft_consensus.cc:1240] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 3. Current term is 4. Ops: []
W20260709 12:13:49.523698  5088 leader_election.cc:336] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 1.969s (SENT)
I20260709 12:13:49.535519  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:49.542765  5088 leader_election.cc:304] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:49.546590  7261 raft_consensus.cc:3055] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:49.547040  7261 raft_consensus.cc:740] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:49.547865  7261 consensus_queue.cc:260] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:49.549039  7261 raft_consensus.cc:3060] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:49.549556  7263 leader_election.cc:290] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:49.549674  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:49.550382  7244 raft_consensus.cc:2749] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:49.551225  6901 raft_consensus.cc:515] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:49.553303  7256 raft_consensus.cc:3055] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:49.553700  7256 raft_consensus.cc:740] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:13:49.531184  7232 raft_consensus.cc:3060] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:49.558760  7229 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:49.560431  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:49.560632  7147 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:49.562285  5125 raft_consensus.cc:1240] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:49.562343  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:49.558792  5192 raft_consensus.cc:1240] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:49.565791  5197 raft_consensus.cc:2393] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 4: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:49.533114  7243 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:49.567207  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 110611us
I20260709 12:13:49.567492  5238 leader_election.cc:304] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:49.571405  5194 raft_consensus.cc:1240] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:49.579491  7232 raft_consensus.cc:515] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:49.593369  7080 leader_election.cc:290] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:49.597699  7134 raft_consensus.cc:2749] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:13:49.598071  7285 raft_consensus.cc:3055] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:49.509694  7265 consensus_queue.cc:260] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:49.598639  7285 raft_consensus.cc:740] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:13:49.566187  7260 raft_consensus.cc:2804] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:49.599486  7260 raft_consensus.cc:493] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:49.599951  7260 raft_consensus.cc:3060] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:49.599640  7285 consensus_queue.cc:260] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:49.604118  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:49.604875  5833 raft_consensus.cc:2468] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 4.
I20260709 12:13:49.605195  5166 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:49.604125  5125 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
new_leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
 from {username='slave'} at 127.0.0.1:45628
I20260709 12:13:49.606390  5125 raft_consensus.cc:606] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Received request to transfer leadership to TS dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:49.606531  7265 raft_consensus.cc:3060] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:49.606760  5125 raft_consensus.cc:614] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:49.572007  7243 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:49.610846  6862 raft_consensus.cc:2804] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:49.611466  6862 raft_consensus.cc:697] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:49.612408  6862 consensus_queue.cc:237] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:49.613615  7242 consensus_queue.cc:1059] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:49.614698  7242 raft_consensus.cc:3055] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:49.615087  7242 raft_consensus.cc:740] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
W20260709 12:13:49.616060  5803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:49.617270  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:49.617991  7147 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:49.618238  5116 raft_consensus.cc:2410] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 4 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
W20260709 12:13:49.618543  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 51138.5us
I20260709 12:13:49.619324  5238 leader_election.cc:304] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:13:49.622568  5804 leader_election.cc:304] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
W20260709 12:13:49.624418  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 52375.4us
I20260709 12:13:49.629065  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:49.630211  5193 raft_consensus.cc:2468] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 2.
I20260709 12:13:49.630331  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:49.633714  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:49.636785  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:49.637702  5197 raft_consensus.cc:2410] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:13:49.639266  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:49.640445  5801 leader_election.cc:304] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:49.614821  7134 raft_consensus.cc:2804] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:49.642212  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:49.643463  5116 raft_consensus.cc:2393] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 5: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:49.644091  5801 leader_election.cc:304] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:49.572801  7229 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:49.643152  5089 leader_election.cc:304] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:13:49.652743  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:49.645041  7308 raft_consensus.cc:2749] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:49.647739  7255 raft_consensus.cc:2749] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:49.653402  7175 raft_consensus.cc:2804] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:49.653851  7175 raft_consensus.cc:493] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:49.654202  7175 raft_consensus.cc:3060] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:49.634943  7246 consensus_queue.cc:1059] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:13:49.655166  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:49.656177  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:49.630962  7238 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:49.657809  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:49.658492  5125 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 3.
I20260709 12:13:49.648161  7259 raft_consensus.cc:2804] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:49.645157  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:49.659134  7259 raft_consensus.cc:697] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 4 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:13:49.634925  7138 consensus_queue.cc:1048] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:13:49.660045  7259 consensus_queue.cc:237] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:49.655320  7246 raft_consensus.cc:3055] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:49.661557  7246 raft_consensus.cc:740] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:49.662895  6901 leader_election.cc:290] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:49.662492  7246 consensus_queue.cc:260] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:49.640326  7128 raft_consensus.cc:2804] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:49.664021  7128 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:49.664520  7128 raft_consensus.cc:3060] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:49.664283  7229 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:49.665743  7175 raft_consensus.cc:515] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:49.666563  7229 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:49.667975  7175 leader_election.cc:290] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:49.643983  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:49.670578  5195 raft_consensus.cc:3060] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:49.674396  7161 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:49.677713  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:49.678960  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:49.678714  7161 consensus_queue.cc:1048] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:49.679229  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:49.680805  5196 raft_consensus.cc:2393] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 4: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:49.681666  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:49.682430  5196 raft_consensus.cc:2410] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 4 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 12:13:49.683334  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:49.641628  7274 consensus_queue.cc:1243] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer ad2f9a1e2f7a45429fa69fd23d09f821 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:13:49.686496  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:49.647207  5801 leader_election.cc:304] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:49.690826  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
W20260709 12:13:49.691715  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 44573.7us
I20260709 12:13:49.691717  5193 raft_consensus.cc:3060] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:49.693871  5801 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:49.695499  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:49.696107  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:49.697633  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:49.698624  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:49.698947  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:49.699015  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:49.699466  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:49.700043  5834 raft_consensus.cc:3060] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:49.700110  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:49.700392  5200 raft_consensus.cc:1275] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:49.701475  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:49.664611  7285 raft_consensus.cc:3060] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:49.702584  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:49.703336  5196 raft_consensus.cc:2410] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 4 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:13:49.704401  5196 raft_consensus.cc:1240] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:49.705982  5838 raft_consensus.cc:1240] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:49.706955  5196 raft_consensus.cc:1275] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:13:49.707165  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:49.709548  5269 raft_consensus.cc:1240] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:49.707942  7267 raft_consensus.cc:2804] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:49.710798  7267 raft_consensus.cc:493] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:49.711253  7267 raft_consensus.cc:3060] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:49.713200  5088 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:49.713102  7248 consensus_queue.cc:1048] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:13:49.714140  7175 raft_consensus.cc:2749] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:49.715811  7243 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:49.701237  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:49.747432  5834 raft_consensus.cc:2468] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
I20260709 12:13:49.734326  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:49.730038  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:49.699101  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:49.749881  5836 raft_consensus.cc:3060] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:49.749998  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:49.725862  5801 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:49.757855  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:13:49.743448  5237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:49.760897  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:49.554613  7256 consensus_queue.cc:260] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:49.710582  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:49.646489  7134 raft_consensus.cc:493] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:49.763900  5270 raft_consensus.cc:1240] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:49.764714  5196 raft_consensus.cc:1275] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:49.751385  5089 leader_election.cc:304] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:13:49.664057  7246 raft_consensus.cc:3060] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:49.785466  5192 raft_consensus.cc:2368] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 4. Current term is 5.
I20260709 12:13:49.790628  5801 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:49.768102  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:49.786064  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:49.792644  5838 raft_consensus.cc:1275] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:13:49.786216  5273 raft_consensus.cc:1275] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:49.785668  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:49.795038  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:49.799811  5125 raft_consensus.cc:1240] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:49.800262  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:49.768033  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:49.811322  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:49.811969  5163 leader_election.cc:304] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:49.813644  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:49.814628  5269 raft_consensus.cc:2410] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:13:49.815522  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:49.816280  5269 raft_consensus.cc:2393] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 2: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:49.816558  7128 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:49.817400  5166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:49.817552  7310 consensus_queue.cc:1059] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:49.781895  5829 raft_consensus.cc:1240] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:49.819489  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:49.819659  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:49.820277  5829 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 2 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 2.
I20260709 12:13:49.820667  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:49.821256  5267 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 4.
I20260709 12:13:49.818461  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:49.806597  7161 consensus_queue.cc:1059] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 12:13:49.822109  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:49.823225  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:49.823935  5267 raft_consensus.cc:2468] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 2.
I20260709 12:13:49.824800  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:49.810765  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:49.696666  7311 consensus_queue.cc:1048] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.140s
I20260709 12:13:49.812438  5266 raft_consensus.cc:2468] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
I20260709 12:13:49.829326  5267 raft_consensus.cc:2410] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:13:49.822436  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:49.764550  5830 raft_consensus.cc:1240] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:13:49.829892  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:49.765695  7069 raft_consensus.cc:2749] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:49.832419  5836 raft_consensus.cc:2468] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
I20260709 12:13:49.753931  7080 raft_consensus.cc:2749] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:49.833969  5193 raft_consensus.cc:2468] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 4.
I20260709 12:13:49.832130  5164 leader_election.cc:304] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:49.826503  5833 raft_consensus.cc:1240] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:49.765565  7232 leader_election.cc:290] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:49.791054  7134 raft_consensus.cc:3060] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:49.828733  7116 raft_consensus.cc:2749] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:13:49.843639  5835 raft_consensus.cc:1240] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:49.843798  5116 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
new_leader_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:45628
I20260709 12:13:49.836388  5266 raft_consensus.cc:2376] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5. Re-sending same reply.
I20260709 12:13:49.788173  7268 consensus_queue.cc:1048] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.089s
I20260709 12:13:49.846832  5237 leader_election.cc:304] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:49.847189  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:49.788723  7244 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:49.817155  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:49.875316  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:49.878846  5200 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45"
dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:47718
I20260709 12:13:49.993187  5200 raft_consensus.cc:606] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 LEADER]: Received request to transfer leadership
I20260709 12:13:49.878490  7257 raft_consensus.cc:2804] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:49.765439  7274 consensus_queue.cc:1048] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.086s
I20260709 12:13:49.788410  7249 consensus_queue.cc:1048] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 12:13:49.960253  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
W20260709 12:13:49.846328  5803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:50.000695  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 248217us
I20260709 12:13:49.790510  7248 consensus_queue.cc:1059] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.111s
I20260709 12:13:49.961194  5116 raft_consensus.cc:606] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 LEADER]: Received request to transfer leadership to TS 9e794b72ed7640219f90ec4232363929
I20260709 12:13:49.785141  7138 consensus_queue.cc:1059] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.091s
I20260709 12:13:49.845896  7265 consensus_queue.cc:1048] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.147s
I20260709 12:13:49.874990  7228 raft_consensus.cc:2749] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:49.842664  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:49.766330  7239 consensus_queue.cc:1048] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.113s
I20260709 12:13:49.831015  7295 consensus_queue.cc:1059] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.135s
W20260709 12:13:50.001981  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 194602us
W20260709 12:13:50.003841  5240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:50.003774  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:49.986392  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:49.965874  7175 raft_consensus.cc:2804] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:13:50.031188  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 195605us
W20260709 12:13:49.996344  7297 log.cc:927] Time spent T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 12:13:50.045166  5270 raft_consensus.cc:2393] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 5: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:13:50.000203  7161 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.998971  7257 raft_consensus.cc:493] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:50.000039  7264 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.044454  5273 raft_consensus.cc:2468] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 2.
I20260709 12:13:49.989147  7238 consensus_queue.cc:1048] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:13:50.112107  5237 leader_election.cc:304] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:50.054946  7161 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:50.115890  7161 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:50.118062  7128 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:50.118878  7243 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:50.106442  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:50.120132  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:50.122028  5200 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:50.035310  7147 raft_consensus.cc:2749] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:50.122887  6862 consensus_queue.cc:1048] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:13:50.056165  7257 raft_consensus.cc:3060] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:50.128544  7261 consensus_meta.cc:287] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.558s	user 0.009s	sys 0.000s
W20260709 12:13:50.108209  5075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 50873.5us
I20260709 12:13:49.997975  7244 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:50.133121  7289 raft_consensus.cc:3055] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:50.133391  5270 raft_consensus.cc:2410] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:13:50.135937  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:50.136242  5195 raft_consensus.cc:2468] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 4.
I20260709 12:13:50.139643  7309 raft_consensus.cc:3055] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:50.140168  7309 raft_consensus.cc:740] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:50.120085  7007 consensus_queue.cc:1048] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
W20260709 12:13:50.142294  7312 log.cc:927] Time spent T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
W20260709 12:13:50.148140  7260 consensus_meta.cc:287] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.548s	user 0.007s	sys 0.000s
I20260709 12:13:50.149919  7228 raft_consensus.cc:2955] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 4 to 6, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:50.151482  7310 consensus_queue.cc:1059] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:50.154932  7161 raft_consensus.cc:3055] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:50.155371  7161 raft_consensus.cc:740] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:50.156253  7161 consensus_queue.cc:260] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:50.157487  5237 leader_election.cc:304] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:50.137137  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:50.165798  5268 raft_consensus.cc:2468] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 4.
I20260709 12:13:50.173063  5200 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 4.
I20260709 12:13:50.148648  7260 raft_consensus.cc:515] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:50.136307  5267 raft_consensus.cc:2468] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 4.
I20260709 12:13:50.183882  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:50.133661  7289 raft_consensus.cc:740] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:50.166935  7161 raft_consensus.cc:3060] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:50.196758  5237 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:50.184613  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:50.166761  7128 raft_consensus.cc:2749] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:50.204267  5267 raft_consensus.cc:2468] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
I20260709 12:13:50.211548  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:50.212337  5268 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 3.
I20260709 12:13:50.213449  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:50.214293  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:50.151276  7264 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:50.217185  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:50.141157  7309 consensus_queue.cc:260] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:50.219501  5266 raft_consensus.cc:2468] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 2.
W20260709 12:13:50.244585  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 47908us
W20260709 12:13:50.254380  5802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:50.238881  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 198566us
I20260709 12:13:50.239696  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:50.184291  7261 consensus_queue.cc:1059] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:13:50.282464  5267 raft_consensus.cc:2468] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 2.
I20260709 12:13:50.268615  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:50.242035  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:50.285665  5268 raft_consensus.cc:2393] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 3: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:13:50.284654  5266 raft_consensus.cc:2468] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 1.
I20260709 12:13:50.216425  7320 raft_consensus.cc:2749] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:50.268420  7147 consensus_queue.cc:1059] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 12:13:50.290681  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:50.239060  7265 raft_consensus.cc:2749] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:50.292376  7260 leader_election.cc:290] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:50.298358  7244 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:50.299283  7249 consensus_queue.cc:1048] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:50.301976  5089 leader_election.cc:304] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
W20260709 12:13:50.270740  7316 log.cc:927] Time spent T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 12:13:50.271909  5271 raft_consensus.cc:2393] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 5: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:13:50.306353  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:50.312552  5266 raft_consensus.cc:2410] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:13:50.307679  5088 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:50.285096  5237 leader_election.cc:304] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:50.316236  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:13:50.311353  7267 consensus_meta.cc:287] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.600s	user 0.007s	sys 0.004s
W20260709 12:13:50.316718  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 475814us
I20260709 12:13:50.326177  5164 leader_election.cc:304] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:13:50.319010  5091 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.006s	sys 0.011s
I20260709 12:13:50.315775  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:50.313081  7249 raft_consensus.cc:2804] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:50.336499  5164 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:50.333932  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:50.337756  5266 raft_consensus.cc:2468] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 5.
I20260709 12:13:50.323886  7175 raft_consensus.cc:697] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:50.345468  7265 raft_consensus.cc:3055] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:50.346082  5266 raft_consensus.cc:1275] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:13:50.350381  5266 raft_consensus.cc:1275] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:50.351702  5164 leader_election.cc:304] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
W20260709 12:13:50.356725  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 71736.2us
I20260709 12:13:50.314340  7244 consensus_queue.cc:1059] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:13:50.328151  7242 consensus_queue.cc:260] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:50.339848  7239 raft_consensus.cc:2804] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:50.358544  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:50.357816  5237 leader_election.cc:304] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:13:50.415776  5163 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.014s	sys 0.028s
I20260709 12:13:50.464912  6971 raft_consensus.cc:2749] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:50.346040  7265 raft_consensus.cc:740] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
W20260709 12:13:50.468132  5163 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.020s	sys 0.030s
I20260709 12:13:50.375698  5801 leader_election.cc:304] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:50.358217  5123 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
new_leader_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:45628
I20260709 12:13:50.357906  5270 raft_consensus.cc:2468] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 3.
W20260709 12:13:50.360173  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 52573.7us
W20260709 12:13:50.469564  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 93976.4us
I20260709 12:13:50.470175  5123 raft_consensus.cc:606] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Received request to transfer leadership to TS 9e794b72ed7640219f90ec4232363929
W20260709 12:13:50.470268  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 629664us
I20260709 12:13:50.470490  5088 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:50.389366  5272 raft_consensus.cc:1240] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 4. Current term is 5. Ops: []
W20260709 12:13:50.361198  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 315310us
I20260709 12:13:50.414016  5837 raft_consensus.cc:1240] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:50.398252  7318 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.472258  7326 raft_consensus.cc:493] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.465426  5119 raft_consensus.cc:1275] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:50.472858  7326 raft_consensus.cc:515] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:50.476210  7326 leader_election.cc:290] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:50.476863  7318 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:50.478940  7326 raft_consensus.cc:2804] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:50.479372  7326 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:50.479734  7326 raft_consensus.cc:3060] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:13:50.479974  7134 consensus_meta.cc:287] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.517s	user 0.009s	sys 0.000s
I20260709 12:13:50.480417  7134 raft_consensus.cc:515] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:50.481599  5274 raft_consensus.cc:2393] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 2: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:13:50.482153  7285 raft_consensus.cc:2804] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:50.482707  7285 raft_consensus.cc:697] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 4 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
W20260709 12:13:50.467392  7322 log.cc:927] Time spent T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 12:13:50.483863  7259 raft_consensus.cc:3055] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:50.483583  7285 consensus_queue.cc:237] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:50.484265  7259 raft_consensus.cc:740] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:13:50.486397  5088 leader_election.cc:304] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:50.487624  7045 raft_consensus.cc:2749] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:50.487993  5088 leader_election.cc:304] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:50.485997  7090 consensus_queue.cc:1048] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:50.485141  7259 consensus_queue.cc:260] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:50.489145  5088 leader_election.cc:304] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:13:50.424930  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 73341.3us
I20260709 12:13:50.491083  5164 leader_election.cc:304] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:50.353525  7261 raft_consensus.cc:2749] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:50.400368  7319 raft_consensus.cc:3060] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:50.497656  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:50.492269  5164 leader_election.cc:304] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:50.516113  5267 raft_consensus.cc:1275] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:13:50.517150  5267 pending_rounds.cc:85] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929: Aborting all ops after (but not including) 5
I20260709 12:13:50.517436  5267 pending_rounds.cc:107] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:13:50.517715  5267 raft_consensus.cc:2889] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:50.331636  7267 raft_consensus.cc:515] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:50.519151  5803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:50.512665  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:50.514297  5088 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:50.470628  5123 raft_consensus.cc:614] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:50.389672  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:50.537177  7256 raft_consensus.cc:3060] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:50.529351  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:50.513720  7264 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:50.546123  5265 raft_consensus.cc:1240] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:13:50.363003  7175 consensus_queue.cc:237] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:50.545871  5838 raft_consensus.cc:2468] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 2.
I20260709 12:13:50.548812  7289 consensus_queue.cc:260] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:13:50.562248  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 70076.9us
W20260709 12:13:50.594959  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 237221us
I20260709 12:13:50.595625  5164 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:50.574386  7332 raft_consensus.cc:2804] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:50.547564  7267 leader_election.cc:290] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:50.516224  7242 raft_consensus.cc:3060] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:50.516458  6862 raft_consensus.cc:2804] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:50.358634  7331 raft_consensus.cc:2749] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:50.468572  7239 raft_consensus.cc:493] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:50.544890  7318 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:50.538040  5832 raft_consensus.cc:1240] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 6. Current term is 7. Ops: []
I20260709 12:13:50.543462  7326 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:50.382728  7257 raft_consensus.cc:515] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:50.535064  7138 consensus_queue.cc:1059] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:13:50.574261  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:50.617877  5837 raft_consensus.cc:2468] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
I20260709 12:13:50.513190  7045 raft_consensus.cc:2804] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:13:50.593319  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 79103.4us
I20260709 12:13:50.593245  5163 leader_election.cc:304] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:50.594027  5089 leader_election.cc:304] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:13:50.612775  5831 raft_consensus.cc:2393] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 5: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:13:50.623059  5089 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:13:50.543643  7309 raft_consensus.cc:3060] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:50.596992  7189 raft_consensus.cc:2749] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:50.600126  7332 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:50.601723  7330 raft_consensus.cc:2804] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:50.605998  5237 leader_election.cc:304] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:50.608196  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:50.612015  5238 leader_election.cc:304] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:50.629917  5163 leader_election.cc:304] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:50.630412  5238 leader_election.cc:304] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:50.590126  7261 raft_consensus.cc:2749] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:50.586789  7249 raft_consensus.cc:697] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:50.598250  7265 consensus_queue.cc:260] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:50.628290  7246 consensus_meta.cc:287] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.799s	user 0.009s	sys 0.003s
I20260709 12:13:50.631601  5088 leader_election.cc:304] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
W20260709 12:13:50.670342  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 64446.3us
I20260709 12:13:50.675349  5237 leader_election.cc:304] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:13:50.675438  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 43876us
I20260709 12:13:50.613168  7239 raft_consensus.cc:3060] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:50.654155  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:50.628763  7332 raft_consensus.cc:3060] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:50.610940  7289 raft_consensus.cc:3060] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:50.601890  6971 consensus_queue.cc:1059] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:13:50.616539  7267 raft_consensus.cc:493] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.670670  5238 leader_election.cc:304] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
W20260709 12:13:50.676272  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 46413.6us
I20260709 12:13:50.687861  5163 leader_election.cc:304] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:50.688102  5237 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:50.669665  7318 raft_consensus.cc:2804] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:50.676285  5088 leader_election.cc:304] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:50.620636  7045 raft_consensus.cc:493] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:50.634106  7329 raft_consensus.cc:2804] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:50.671589  7260 raft_consensus.cc:2749] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:50.682711  7262 raft_consensus.cc:2749] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:50.633116  7161 raft_consensus.cc:2749] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:13:50.684576  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 89033.6us
I20260709 12:13:50.682271  7335 raft_consensus.cc:2804] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:50.633133  7330 raft_consensus.cc:493] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:50.689153  5237 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:50.683646  6862 raft_consensus.cc:697] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:50.610805  7228 raft_consensus.cc:2804] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:50.673521  7333 raft_consensus.cc:2749] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:50.677687  7320 raft_consensus.cc:2749] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:50.696882  5164 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:50.698921  5088 leader_election.cc:304] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:50.691061  7274 raft_consensus.cc:2749] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:50.690191  6971 consensus_queue.cc:1243] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer bce73265e27d4b30a4dcc1e491305088 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:13:50.698022  7228 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:50.700703  6971 raft_consensus.cc:2749] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:50.700642  7228 raft_consensus.cc:3060] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:50.705732  7260 consensus_queue.cc:1059] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:13:50.689622  7261 raft_consensus.cc:2749] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:50.690609  7318 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:50.691073  7045 raft_consensus.cc:3060] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:50.691793  7128 raft_consensus.cc:2749] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:13:50.691164  7329 raft_consensus.cc:493] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:50.710251  5163 leader_election.cc:304] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:50.717442  7246 raft_consensus.cc:2804] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:50.720377  7246 raft_consensus.cc:697] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:50.716092  7147 raft_consensus.cc:2749] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:50.721279  7246 consensus_queue.cc:237] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:50.709146  5088 leader_election.cc:304] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:50.693104  6901 raft_consensus.cc:2749] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:50.716984  5237 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:50.726202  5088 leader_election.cc:304] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:50.699800  7330 raft_consensus.cc:3060] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:50.699680  7335 raft_consensus.cc:493] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:50.715260  6971 raft_consensus.cc:2749] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:50.733958  7189 raft_consensus.cc:2804] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:50.732924  7335 raft_consensus.cc:3060] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:50.691087  7267 raft_consensus.cc:515] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:50.741950  5088 leader_election.cc:304] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:50.714088  7318 raft_consensus.cc:3060] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:50.746475  7189 raft_consensus.cc:697] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:50.751180  7128 raft_consensus.cc:2749] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:50.752046  7189 consensus_queue.cc:237] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:50.756228  5801 leader_election.cc:304] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:50.718458  7329 raft_consensus.cc:3060] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:50.758371  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:50.758898  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
W20260709 12:13:50.759253  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 49046us
I20260709 12:13:50.759723  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:50.760140  5163 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:50.760372  5197 raft_consensus.cc:2468] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 2.
I20260709 12:13:50.761989  5197 raft_consensus.cc:1240] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:50.760372  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:50.764950  5088 leader_election.cc:304] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:50.772421  5123 raft_consensus.cc:1240] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:50.747531  7268 raft_consensus.cc:2749] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:50.803372  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:50.804226  5193 raft_consensus.cc:2393] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 2: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:50.803346  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:13:50.769888  7311 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.017s	sys 0.008s
I20260709 12:13:50.806653  5195 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45"
dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:47718
I20260709 12:13:50.768414  6901 raft_consensus.cc:2804] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:50.788590  6971 raft_consensus.cc:2764] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:13:50.723022  7333 consensus_queue.cc:1059] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 12:13:50.775951  7080 raft_consensus.cc:2749] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:50.821717  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:50.826256  5191 raft_consensus.cc:2468] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
I20260709 12:13:50.827018  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:50.827683  5267 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:50.765112  7090 consensus_queue.cc:1059] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:13:50.755978  7228 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:50.736692  7249 consensus_queue.cc:237] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:50.823058  7311 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.017s	sys 0.009s
W20260709 12:13:50.482075  7229 consensus_queue.cc:1175] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "bce73265e27d4b30a4dcc1e491305088" responder_term: 4 status { last_received { term: 3 index: 6 } last_committed_idx: 6 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:13:50.836896  5195 raft_consensus.cc:606] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 LEADER]: Received request to transfer leadership
I20260709 12:13:50.799842  7175 consensus_queue.cc:1048] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:13:50.799067  7138 consensus_queue.cc:1048] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:13:50.799376  7244 consensus_queue.cc:1048] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:13:50.822716  7257 leader_election.cc:290] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:50.849618  5267 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 4.
I20260709 12:13:50.860769  5198 raft_consensus.cc:1240] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260709 12:13:50.850437  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 90393.4us
I20260709 12:13:50.823575  6901 raft_consensus.cc:493] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:50.862852  5163 leader_election.cc:304] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:50.857540  7325 raft_consensus.cc:3060] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:50.852234  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:50.865787  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:13:50.867231  7343 log.cc:927] Time spent T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
W20260709 12:13:50.869199  7339 log.cc:927] Time spent T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 12:13:50.799654  6862 consensus_queue.cc:237] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:50.870357  5266 raft_consensus.cc:1275] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:50.871265  5267 raft_consensus.cc:2468] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 1.
I20260709 12:13:50.878252  5163 leader_election.cc:304] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:50.840687  7045 raft_consensus.cc:515] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:50.865341  6901 raft_consensus.cc:3060] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:50.870266  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
W20260709 12:13:50.875715  7346 log.cc:927] Time spent T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
W20260709 12:13:50.873731  7338 log.cc:927] Time spent T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
I20260709 12:13:50.883453  5163 leader_election.cc:304] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:50.884024  5237 leader_election.cc:304] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:50.884825  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:50.881067  6971 raft_consensus.cc:2749] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:50.888922  7242 raft_consensus.cc:2749] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:50.869235  7244 raft_consensus.cc:493] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:50.891040  7248 raft_consensus.cc:3055] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:13:50.891808  5007 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 756d32b8c4d642a6955517f66ac5bb45 already in progress [suppressed 60 similar messages]
I20260709 12:13:50.874564  7319 raft_consensus.cc:2749] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:50.897255  5834 raft_consensus.cc:2468] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 3.
I20260709 12:13:50.898932  5267 raft_consensus.cc:3060] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:50.904491  5116 raft_consensus.cc:1240] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:50.909685  5237 leader_election.cc:304] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:50.910351  5163 leader_election.cc:304] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:50.910797  5237 leader_election.cc:304] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:50.883273  7349 raft_consensus.cc:2749] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:13:50.908185  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 139135us
I20260709 12:13:50.896227  7326 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:50.921586  5267 raft_consensus.cc:2468] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 5.
I20260709 12:13:50.923136  5200 raft_consensus.cc:1240] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:50.924266  5237 leader_election.cc:304] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:50.906621  7248 raft_consensus.cc:740] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:50.912012  7267 leader_election.cc:290] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:50.912217  7257 raft_consensus.cc:2749] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:13:50.928930  5829 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.801s	user 0.016s	sys 0.010s
I20260709 12:13:50.938153  5237 leader_election.cc:304] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:50.920485  7244 raft_consensus.cc:515] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:50.943205  7345 raft_consensus.cc:2749] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:13:50.926710  7311 raft_consensus.cc:2749] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:50.944428  7244 leader_election.cc:290] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:13:50.951128  5829 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.812s	user 0.016s	sys 0.010s
I20260709 12:13:50.908290  7175 consensus_queue.cc:1048] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:13:50.927841  7349 raft_consensus.cc:2749] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:50.963487  5237 leader_election.cc:400] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 election: Vote denied by peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455) with higher term. Message: Invalid argument: T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 4. Current term is 5.
I20260709 12:13:50.965466  7045 leader_election.cc:290] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:50.966365  7348 raft_consensus.cc:2749] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:50.967645  7245 raft_consensus.cc:3055] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:50.968108  7245 raft_consensus.cc:740] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:50.935401  7261 raft_consensus.cc:2749] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:50.965113  7248 consensus_queue.cc:260] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:50.974946  7251 raft_consensus.cc:3055] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:50.975522  7251 raft_consensus.cc:740] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:50.941741  7333 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.976490  7251 consensus_queue.cc:260] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:50.958849  5267 raft_consensus.cc:1275] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:50.983363  5237 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:50.985850  5237 leader_election.cc:304] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:50.943120  7321 raft_consensus.cc:2749] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:50.969096  7245 consensus_queue.cc:260] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:50.986183  7261 raft_consensus.cc:2749] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:51.001461  7289 raft_consensus.cc:2749] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:51.016958  7228 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:51.017889  7251 raft_consensus.cc:3060] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:51.022323  5237 leader_election.cc:304] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:51.022706  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:13:51.024650  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 112985us
I20260709 12:13:51.026634  5237 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:51.030333  5163 leader_election.cc:304] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:50.993667  5829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46100 (request call id 751) took 1223 ms. Trace:
W20260709 12:13:51.031361  5007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 145656us
I20260709 12:13:51.024156  7248 raft_consensus.cc:3060] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:51.034674  5237 leader_election.cc:304] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:50.977795  7333 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:51.039054  5801 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:51.035318  5163 leader_election.cc:304] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:51.031695  7321 raft_consensus.cc:2749] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:13:51.041137  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:51.042028  5163 leader_election.cc:304] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:51.042508  5267 raft_consensus.cc:2468] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 3.
I20260709 12:13:51.043041  5801 leader_election.cc:304] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:51.043107  5163 leader_election.cc:304] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:51.042101  5192 raft_consensus.cc:1240] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:13:51.033591  7245 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:51.045867  5832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46100 (request call id 755) took 1256 ms. Trace:
I20260709 12:13:51.046177  5832 rpcz_store.cc:276] 0709 12:13:49.789829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:49.828454 (+ 38625us) service_pool.cc:224] Handling call
0709 12:13:50.464846 (+636392us) spinlock_profiling.cc:243] Waited 2.38 ms on lock 0x7b58000b0498. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb9cfc0 00007f84ebb87929 00007f84ebb873d2 00007f84e50febd4
0709 12:13:50.465072 (+   226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:50.613592 (+148520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:51.045677 (+432085us) spinlock_profiling.cc:243] Waited 72.6 ms on lock 0x7b540064d054. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:13:51.045824 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":172454016}
I20260709 12:13:51.047858  7228 raft_consensus.cc:2804] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:51.048105  7351 raft_consensus.cc:2804] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:51.048637  7351 raft_consensus.cc:493] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:51.048997  7351 raft_consensus.cc:3060] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:51.050798  5163 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:51.053655  7228 raft_consensus.cc:493] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:51.054191  7228 raft_consensus.cc:3060] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:51.055701  7257 raft_consensus.cc:493] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:51.056267  7257 raft_consensus.cc:515] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:51.050437  7256 raft_consensus.cc:2804] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:51.058384  7257 leader_election.cc:290] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:51.050004  6901 raft_consensus.cc:515] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:51.034865  7348 raft_consensus.cc:2804] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:51.058317  7256 raft_consensus.cc:697] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 4 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:13:51.067937  5268 raft_consensus.cc:2410] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:13:51.068941  5268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34672 (request call id 1680) took 1227 ms. Trace:
I20260709 12:13:51.069269  5268 rpcz_store.cc:276] 0709 12:13:49.841642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:50.288071 (+446429us) service_pool.cc:224] Handling call
0709 12:13:51.068764 (+780693us) spinlock_profiling.cc:243] Waited 776 ms on lock 0x7b540040bd54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:13:51.068887 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1785080064}
I20260709 12:13:51.070062  7342 raft_consensus.cc:2804] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:51.070634  7342 raft_consensus.cc:697] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 5 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:13:51.071583  7342 consensus_queue.cc:237] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:51.040445  7261 raft_consensus.cc:2749] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:51.021307  7239 raft_consensus.cc:515] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:51.074182  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:13:51.035189  6862 raft_consensus.cc:2749] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:51.060388  5163 leader_election.cc:304] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:13:51.073361  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:51.088341  5802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:51.088708  5163 leader_election.cc:304] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:51.074522  5196 raft_consensus.cc:1240] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:51.090060  7080 raft_consensus.cc:3055] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:51.090551  7080 raft_consensus.cc:740] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
W20260709 12:13:51.091693  7355 log.cc:927] Time spent T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:13:51.091543  7080 consensus_queue.cc:260] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:51.049885  7311 consensus_queue.cc:1059] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:13:51.063501  7348 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:51.095839  7348 raft_consensus.cc:3060] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:51.096400  6901 leader_election.cc:290] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:51.050987  7349 raft_consensus.cc:2804] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:13:51.093726  5803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:51.085492  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:51.074800  7335 raft_consensus.cc:515] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:51.095770  5801 leader_election.cc:304] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:51.093135  7080 raft_consensus.cc:3060] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:51.103389  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:51.107893  5116 raft_consensus.cc:2468] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 2.
I20260709 12:13:51.106834  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:13:51.103871  5163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:51.063398  7257 raft_consensus.cc:2749] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:51.105418  5125 raft_consensus.cc:1240] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:51.105902  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:51.106361  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:51.101533  7238 raft_consensus.cc:2749] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:51.107149  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:51.090201  7358 raft_consensus.cc:493] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:51.117143  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
W20260709 12:13:51.116633  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 205316us
I20260709 12:13:51.119220  5117 raft_consensus.cc:1240] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:51.119668  5088 leader_election.cc:304] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:13:51.112200  7308 raft_consensus.cc:2804] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:51.102035  7349 raft_consensus.cc:493] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:51.121181  5088 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:51.123929  5120 raft_consensus.cc:2468] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 2.
I20260709 12:13:51.134075  5121 raft_consensus.cc:1240] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 LEADER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:13:51.135308  7363 raft_consensus.cc:2804] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:51.129648  5240 leader_election.cc:304] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:13:51.094044  7309 consensus_queue.cc:1059] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:13:51.142699  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:51.144333  5270 raft_consensus.cc:3060] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:51.126744  7308 raft_consensus.cc:493] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:51.146152  7308 raft_consensus.cc:3060] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:51.146457  7261 raft_consensus.cc:2804] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:51.118052  7333 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:51.096652  7329 raft_consensus.cc:515] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:51.153805  7324 raft_consensus.cc:2804] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:51.139526  7007 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:51.154234  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:51.151721  7359 consensus_queue.cc:1048] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:13:51.157994  7238 raft_consensus.cc:493] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.159572  7351 raft_consensus.cc:515] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:13:51.162915  7313 log.cc:927] Time spent T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 1.018s	user 0.004s	sys 0.000s
I20260709 12:13:51.131110  7349 raft_consensus.cc:3060] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:51.149034  7360 log.cc:927] Time spent T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:13:51.165390  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:51.171020  5270 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 4.
I20260709 12:13:51.177450  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:51.177752  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:51.178792  7351 leader_election.cc:290] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:51.182323  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:51.183332  5200 raft_consensus.cc:2393] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 3: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:51.146953  7363 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:51.179870  7134 leader_election.cc:290] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:51.185920  5270 raft_consensus.cc:1240] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:13:51.175156  7324 raft_consensus.cc:697] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:51.193212  7329 leader_election.cc:290] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:13:51.194882  7366 log.cc:927] Time spent T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:13:51.219743  7324 consensus_queue.cc:237] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:51.196748  7318 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:51.182055  7238 raft_consensus.cc:515] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:51.120780  7358 raft_consensus.cc:515] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:51.034149  5829 rpcz_store.cc:276] 0709 12:13:49.764273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:49.820933 (+ 56660us) service_pool.cc:224] Handling call
0709 12:13:49.833226 (+ 12293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:50.000025 (+166799us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:50.002669 (+  2644us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:50.127185 (+124516us) log.cc:844] Serialized 564 byte log entry
0709 12:13:50.864980 (+737795us) spinlock_profiling.cc:243] Waited 39.6 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e3ab90ac 00007f84ec9139a9 00007f84e3ad569b 00007f84e3ad393f 00007f84e3ad5c02 00007f84e675d20b
0709 12:13:50.951703 (+ 86723us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:50.951761 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:50.951831 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:50.951874 (+    43us) raft_consensus.cc:1685] finished
0709 12:13:50.951889 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:50.987867 (+ 35978us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":91054464,"thread_start_us":824126,"threads_started":1,"wal-append.queue_time_us":821698}
I20260709 12:13:51.155746  7261 raft_consensus.cc:697] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 2 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
W20260709 12:13:51.206777  7361 log.cc:927] Time spent T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:13:51.208567  5193 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45"
dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:47718
I20260709 12:13:51.139297  7256 consensus_queue.cc:237] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:51.234396  5193 raft_consensus.cc:606] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 LEADER]: Received request to transfer leadership
I20260709 12:13:51.233199  5274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50932 (request call id 419) took 1591 ms. Trace:
I20260709 12:13:51.235450  5274 rpcz_store.cc:276] 0709 12:13:49.641790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:49.641955 (+   165us) service_pool.cc:224] Handling call
0709 12:13:51.232994 (+1591039us) spinlock_profiling.cc:243] Waited 838 ms on lock 0x7b54002562d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:13:51.233136 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1926591360}
I20260709 12:13:51.204228  7363 raft_consensus.cc:3060] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:51.177515  7228 raft_consensus.cc:515] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:51.244935  5270 raft_consensus.cc:1275] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:13:51.185985  7309 consensus_queue.cc:1059] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:13:51.250438  5801 leader_election.cc:304] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:51.242641  5266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34674 (request call id 1789) took 1417 ms. Trace:
I20260709 12:13:51.251930  5266 rpcz_store.cc:276] 0709 12:13:49.824938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:50.352845 (+527907us) service_pool.cc:224] Handling call
0709 12:13:50.353720 (+   875us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:50.870765 (+517045us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:51.242360 (+371595us) spinlock_profiling.cc:243] Waited 516 ms on lock 0x7b540040b354. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:13:51.242559 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1187288448}
I20260709 12:13:51.253811  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:51.254457  5274 raft_consensus.cc:3060] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:51.260875  7259 raft_consensus.cc:3060] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:51.266264  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:51.266589  5274 raft_consensus.cc:2468] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 4.
I20260709 12:13:51.269995  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:51.253719  7260 raft_consensus.cc:493] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.254909  7354 raft_consensus.cc:2749] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:51.256215  7325 raft_consensus.cc:2749] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:51.280499  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:51.279497  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:51.268500  7309 consensus_queue.cc:1243] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer ad2f9a1e2f7a45429fa69fd23d09f821 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:13:51.282382  5270 raft_consensus.cc:3060] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:51.282588  5837 raft_consensus.cc:3060] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 2 LEARNER]: Advancing to term 4
I20260709 12:13:51.274323  7335 leader_election.cc:290] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:51.292615  5838 raft_consensus.cc:1240] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 5 LEADER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:13:51.268716  7362 consensus_queue.cc:1059] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:13:51.304569  7348 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:51.282492  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:51.276645  7080 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:51.306823  7080 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:51.281409  7260 raft_consensus.cc:515] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:51.310937  7344 raft_consensus.cc:3055] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:51.311427  7344 raft_consensus.cc:740] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:51.312289  7344 consensus_queue.cc:260] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:51.309868  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:51.313803  5265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34674 (request call id 1790) took 1475 ms. Trace:
I20260709 12:13:51.314169  5265 rpcz_store.cc:276] 0709 12:13:49.838209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:50.386456 (+548247us) service_pool.cc:224] Handling call
0709 12:13:50.545864 (+159408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:50.590278 (+ 44414us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:51.313606 (+723328us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b5400110b50. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc28ad 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:13:51.313746 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":301606272}
I20260709 12:13:51.315371  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:51.315949  5265 raft_consensus.cc:3060] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:51.297073  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:51.316810  5835 raft_consensus.cc:2468] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 5.
I20260709 12:13:51.315836  5832 raft_consensus.cc:2393] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 2: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:13:51.318465  5238 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:51.319042  5164 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:51.320966  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:51.330303  5121 raft_consensus.cc:1240] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:51.314402  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:51.331274  5269 raft_consensus.cc:3060] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:13:51.333520  7309 raft_consensus.cc:2749] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:13:51.336288  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:51.338805  7333 raft_consensus.cc:2804] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:51.339236  7333 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:51.339565  7333 raft_consensus.cc:3060] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:51.295457  7295 raft_consensus.cc:493] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.333979  7362 raft_consensus.cc:3055] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:13:51.313305  7344 raft_consensus.cc:3060] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:51.364789  5837 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 4 LEARNER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 4.
W20260709 12:13:51.356010  7330 consensus_meta.cc:287] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.588s	user 0.006s	sys 0.004s
I20260709 12:13:51.368214  7330 raft_consensus.cc:515] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:51.370509  7330 leader_election.cc:290] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:51.370512  5272 raft_consensus.cc:1240] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:13:51.356666  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:51.371456  5123 raft_consensus.cc:3060] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:51.353089  5270 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
I20260709 12:13:51.340646  7007 raft_consensus.cc:2749] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:51.378647  5194 raft_consensus.cc:1240] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:13:51.357532  7295 raft_consensus.cc:515] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:51.358687  7080 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:51.360005  5124 raft_consensus.cc:2410] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:13:51.361195  7148 raft_consensus.cc:3055] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:51.388068  7148 raft_consensus.cc:740] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
W20260709 12:13:51.361339  5834 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46100 (request call id 753) took 1583 ms (client timeout 1856 ms). Trace:
W20260709 12:13:51.391798  5834 rpcz_store.cc:269] 0709 12:13:49.764777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:49.811076 (+ 46299us) service_pool.cc:224] Handling call
0709 12:13:51.348320 (+1537244us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54004529d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:13:51.348450 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2434870016}
I20260709 12:13:51.311440  7260 leader_election.cc:290] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:13:51.338342  7332 consensus_meta.cc:287] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.648s	user 0.007s	sys 0.004s
I20260709 12:13:51.372051  5272 raft_consensus.cc:3055] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:51.357106  7348 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:51.393254  5272 raft_consensus.cc:740] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:51.381646  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:51.384971  5829 raft_consensus.cc:1240] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 4 LEADER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:13:51.385533  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:51.396163  5272 consensus_queue.cc:260] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:51.385838  7238 leader_election.cc:290] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:51.386582  7228 leader_election.cc:290] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:51.382900  7331 raft_consensus.cc:493] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:51.315615  7261 consensus_queue.cc:237] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:51.393246  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:51.363446  7362 raft_consensus.cc:740] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:51.398218  5164 leader_election.cc:304] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:51.400601  5272 raft_consensus.cc:3060] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:51.388952  7148 consensus_queue.cc:260] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:51.405077  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:51.405303  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:51.406308  5835 raft_consensus.cc:2393] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 3: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:51.408443  7007 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.411111  7362 consensus_queue.cc:260] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:51.414218  5837 raft_consensus.cc:3060] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:51.414880  5237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:51.416076  7331 raft_consensus.cc:515] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:51.408802  5121 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 2.
I20260709 12:13:51.409053  7335 raft_consensus.cc:493] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:51.419152  7007 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:51.450630  5269 raft_consensus.cc:2468] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
I20260709 12:13:51.392990  7332 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:51.423012  7175 raft_consensus.cc:993] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821: : Instructing follower 9e794b72ed7640219f90ec4232363929 to start an election
I20260709 12:13:51.399837  7330 consensus_queue.cc:1059] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:13:51.424121  7295 leader_election.cc:290] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:51.399009  7318 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:51.435264  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:51.466616  5117 raft_consensus.cc:3060] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:51.437361  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
W20260709 12:13:51.439538  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 56533.4us
I20260709 12:13:51.439628  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:51.467396  5836 raft_consensus.cc:3060] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:51.467633  5120 raft_consensus.cc:2468] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 5.
I20260709 12:13:51.467914  5163 leader_election.cc:304] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:51.443619  7148 raft_consensus.cc:3060] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:51.443945  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:13:51.444577  5091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:51.469123  5163 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:51.445559  5267 raft_consensus.cc:1240] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 3. Current term is 4. Ops: [2.4-3.5]
I20260709 12:13:51.446882  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:51.448258  7347 raft_consensus.cc:3055] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:51.451341  7007 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:51.385564  7356 consensus_queue.cc:1059] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 12:13:51.453004  5830 raft_consensus.cc:1240] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:13:51.454807  5837 raft_consensus.cc:2468] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
I20260709 12:13:51.456166  5088 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:51.482857  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:51.443850  7362 raft_consensus.cc:3060] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:13:51.458195  5197 raft_consensus.cc:1275] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:13:51.446192  7331 leader_election.cc:290] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:51.419996  7238 raft_consensus.cc:2804] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:51.398259  7375 consensus_queue.cc:1059] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.080s
I20260709 12:13:51.510252  5125 raft_consensus.cc:1275] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:13:51.511376  5192 raft_consensus.cc:1240] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:51.462241  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:51.464211  5265 raft_consensus.cc:2468] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
I20260709 12:13:51.464937  7175 raft_consensus.cc:1081] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 LEADER]: Signalling peer 9e794b72ed7640219f90ec4232363929 to start an election
I20260709 12:13:51.459930  5195 raft_consensus.cc:1275] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:51.479167  5122 raft_consensus.cc:1240] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:51.470983  6862 raft_consensus.cc:2804] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:51.479439  5119 raft_consensus.cc:1240] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 5. Current term is 6. Ops: []
I20260709 12:13:51.459370  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:51.488335  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:51.491979  7308 raft_consensus.cc:515] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:51.492311  7318 consensus_queue.cc:1059] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:51.477120  7228 consensus_queue.cc:1059] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:13:51.465929  7363 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:51.487421  7007 raft_consensus.cc:2749] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:51.591348  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:51.471491  7262 raft_consensus.cc:2749] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:13:51.501871  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:51.506958  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:51.513856  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:51.515199  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:51.516230  5272 raft_consensus.cc:1275] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:13:51.597095  5272 pending_rounds.cc:85] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929: Aborting all ops after (but not including) 4
I20260709 12:13:51.597440  5272 pending_rounds.cc:107] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:13:51.471105  7347 raft_consensus.cc:740] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:51.543229  5117 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 4.
I20260709 12:13:51.550709  5836 raft_consensus.cc:2468] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 4.
W20260709 12:13:51.555754  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 50815.5us
I20260709 12:13:51.554445  5197 raft_consensus.cc:3060] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:51.597682  5272 raft_consensus.cc:2889] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:13:51.585001  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 68327.5us
I20260709 12:13:51.463500  7335 raft_consensus.cc:515] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:51.516666  7359 raft_consensus.cc:493] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.522588  7348 raft_consensus.cc:493] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.603677  7359 raft_consensus.cc:515] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:51.592454  7361 log.cc:927] Time spent T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:13:51.624656  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:51.626562  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:51.627290  5836 raft_consensus.cc:2468] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
I20260709 12:13:51.628719  5838 raft_consensus.cc:1275] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:13:51.629280  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:51.610540  5197 raft_consensus.cc:2468] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 4.
I20260709 12:13:51.619495  7356 raft_consensus.cc:3055] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:51.622617  5193 raft_consensus.cc:1240] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 5. Current term is 6. Ops: []
I20260709 12:13:51.635615  5089 leader_election.cc:304] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:51.553575  7310 consensus_queue.cc:1059] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 12:13:51.579795  7295 consensus_queue.cc:1048] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 12:13:51.678597  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:51.682786  5197 raft_consensus.cc:2393] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 2: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:51.540567  7349 raft_consensus.cc:515] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:51.690573  5265 raft_consensus.cc:1240] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 2. Current term is 3. Ops: []
W20260709 12:13:51.695562  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 56998.5us
I20260709 12:13:51.696262  7324 raft_consensus.cc:3060] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:51.696696  7384 consensus_queue.cc:1059] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:51.697544  7384 consensus_queue.cc:1243] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer bce73265e27d4b30a4dcc1e491305088 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:13:51.699139  7228 raft_consensus.cc:3055] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:51.699556  7228 raft_consensus.cc:740] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:51.700538  7335 leader_election.cc:290] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:51.700476  7228 consensus_queue.cc:260] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:51.680421  5089 leader_election.cc:304] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:13:51.584331  7376 consensus_queue.cc:1048] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.085s
I20260709 12:13:51.634639  7356 raft_consensus.cc:740] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
W20260709 12:13:51.682451  7372 log.cc:927] Time spent T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.315s	user 0.001s	sys 0.000s
I20260709 12:13:51.637578  6862 raft_consensus.cc:697] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:51.710343  5089 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:13:51.620656  7007 consensus_queue.cc:1059] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 12:13:51.701951  7228 raft_consensus.cc:3060] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:51.623674  7348 raft_consensus.cc:515] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:51.680867  7267 raft_consensus.cc:493] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:51.721303  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:51.725690  7007 raft_consensus.cc:2804] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:51.731313  7007 raft_consensus.cc:697] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
W20260709 12:13:51.731768  7374 log.cc:927] Time spent T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 12:13:51.709211  6901 consensus_queue.cc:1048] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 12:13:51.720171  7326 raft_consensus.cc:2804] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:13:51.756129  5163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:51.765758  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:51.756072  5123 raft_consensus.cc:2468] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 3.
I20260709 12:13:51.798818  5240 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:13:51.726898  7256 raft_consensus.cc:493] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
W20260709 12:13:51.825412  5240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:51.729048  7332 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:51.732214  7007 consensus_queue.cc:237] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:51.758028  7175 raft_consensus.cc:3055] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:51.720883  7333 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:51.886639  5166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:51.893536  5123 raft_consensus.cc:1240] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 LEADER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:13:51.732033  6862 consensus_queue.cc:237] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:51.727582  7267 raft_consensus.cc:515] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:51.926335  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:51.994040  5265 raft_consensus.cc:1240] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 5. Current term is 6. Ops: []
I20260709 12:13:51.997573  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:52.013911  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:52.041198  5120 raft_consensus.cc:2468] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 2.
I20260709 12:13:52.042433  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:52.018959  5023 catalog_manager.cc:5697] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 2 to 3, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 3 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:52.020821  5271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34674 (request call id 1799) took 1214 ms. Trace:
I20260709 12:13:52.027519  5163 leader_election.cc:304] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:52.028438  7248 raft_consensus.cc:3055] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:13:52.044221  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:52.043272  5192 raft_consensus.cc:2468] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 4.
I20260709 12:13:52.040175  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:51.849282  7326 raft_consensus.cc:697] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:51.849753  7260 raft_consensus.cc:2804] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:52.053069  5193 raft_consensus.cc:3060] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:51.722651  7347 consensus_queue.cc:260] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:52.066486  5192 raft_consensus.cc:1240] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260709 12:13:51.976383  7380 log.cc:927] Time spent T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.283s	user 0.001s	sys 0.000s
I20260709 12:13:51.989508  7333 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:51.851433  7256 raft_consensus.cc:515] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:51.924383  7389 consensus_queue.cc:1059] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.234s
I20260709 12:13:52.049821  7309 raft_consensus.cc:493] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.995966  7259 raft_consensus.cc:493] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.064764  5804 leader_election.cc:304] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:13:51.893661  7175 raft_consensus.cc:740] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:51.974272  7324 raft_consensus.cc:2749] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:51.964718  5269 raft_consensus.cc:1275] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:52.067584  5265 raft_consensus.cc:1275] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:13:51.892897  6901 raft_consensus.cc:493] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:52.089563  7175 consensus_queue.cc:260] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:52.090723  7351 raft_consensus.cc:993] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808: : Instructing follower bce73265e27d4b30a4dcc1e491305088 to start an election
I20260709 12:13:51.826444  7356 consensus_queue.cc:260] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:52.091241  7175 raft_consensus.cc:3060] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:52.080832  7392 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:52.092203  7392 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:52.080534  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 53066.4us
I20260709 12:13:52.077366  7260 raft_consensus.cc:697] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 3 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:52.094086  5163 leader_election.cc:304] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:52.094278  7260 consensus_queue.cc:237] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:52.051349  7248 raft_consensus.cc:740] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:52.095747  7309 raft_consensus.cc:515] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:52.096087  7248 consensus_queue.cc:260] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:52.121294  5194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47728 (request call id 1795) took 1360 ms. Trace:
W20260709 12:13:52.062315  7382 log.cc:927] Time spent T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:13:52.073882  7261 consensus_queue.cc:1059] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
W20260709 12:13:52.064314  7344 consensus_meta.cc:287] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.690s	user 0.008s	sys 0.000s
I20260709 12:13:52.047410  5271 rpcz_store.cc:276] 0709 12:13:50.805977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:50.932540 (+126563us) service_pool.cc:224] Handling call
0709 12:13:50.942296 (+  9756us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:51.031426 (+ 89130us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:51.033334 (+  1908us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:51.035774 (+  2440us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:13:51.036755 (+   981us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:52.020537 (+983782us) spinlock_profiling.cc:243] Waited 78 ms on lock 0x7b54000a5d54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:13:52.020587 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:52.020749 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":179458432}
I20260709 12:13:52.090332  6901 raft_consensus.cc:515] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:52.065692  7359 leader_election.cc:290] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:52.091616  7356 raft_consensus.cc:3060] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:52.057715  7308 leader_election.cc:290] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:52.082284  5801 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:13:52.137586  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 55454.4us
I20260709 12:13:52.057276  7238 raft_consensus.cc:697] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:52.102878  5193 raft_consensus.cc:2468] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 3.
I20260709 12:13:52.121803  5194 rpcz_store.cc:276] 0709 12:13:50.760650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:50.760755 (+   105us) service_pool.cc:224] Handling call
0709 12:13:50.761033 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:51.379127 (+618094us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:52.120936 (+741809us) spinlock_profiling.cc:243] Waited 611 ms on lock 0x7b540032df54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:13:52.121221 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1405564160}
I20260709 12:13:51.974350  7385 consensus_queue.cc:1048] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.380s
I20260709 12:13:52.064270  7239 leader_election.cc:290] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:52.114709  5118 raft_consensus.cc:2468] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 2.
I20260709 12:13:52.132309  7326 consensus_queue.cc:237] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:52.143532  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 49567.6us
I20260709 12:13:52.134594  7375 raft_consensus.cc:2749] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:52.137435  7261 consensus_queue.cc:1243] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer ad2f9a1e2f7a45429fa69fd23d09f821 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 12:13:52.147701  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 437463us
I20260709 12:13:52.158660  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:52.162381  5120 raft_consensus.cc:2468] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 4.
I20260709 12:13:52.139753  7264 raft_consensus.cc:493] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.139889  7363 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:52.147284  7354 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:52.164194  5089 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:13:52.124038  7259 raft_consensus.cc:515] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:52.150815  7248 raft_consensus.cc:3060] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:52.168440  7386 raft_consensus.cc:2749] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:52.169708  7388 consensus_queue.cc:1048] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:13:52.170763  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:52.169860  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:52.156788  7399 raft_consensus.cc:1081] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 LEADER]: Signalling peer bce73265e27d4b30a4dcc1e491305088 to start an election
I20260709 12:13:52.187554  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:52.158026  7161 raft_consensus.cc:3055] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:52.178125  7250 raft_consensus.cc:2804] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:13:52.178472  7378 log.cc:927] Time spent T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.350s	user 0.001s	sys 0.000s
I20260709 12:13:52.163237  7349 leader_election.cc:290] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:52.184623  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:52.185417  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:52.152828  7359 consensus_queue.cc:1048] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:13:52.190570  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:52.191725  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:52.192021  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:52.197315  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:52.197729  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:52.159482  7351 consensus_queue.cc:1059] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
W20260709 12:13:52.202303  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:52.179206  7348 leader_election.cc:290] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:52.205868  5193 raft_consensus.cc:2393] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 5: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:52.205860  5200 raft_consensus.cc:2393] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 4: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:52.213227  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:52.174432  7375 consensus_queue.cc:1059] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:13:52.195735  7363 raft_consensus.cc:493] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.200783  7308 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.217285  5837 raft_consensus.cc:1240] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:13:52.174383  7264 raft_consensus.cc:515] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:13:52.241063  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:52.202455  7309 leader_election.cc:290] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:52.244542  7400 raft_consensus.cc:493] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.194563  7161 raft_consensus.cc:740] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:52.199769  7250 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:52.250799  7401 log.cc:927] Time spent T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 12:13:52.251116  6901 leader_election.cc:290] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:52.188024  7268 consensus_queue.cc:1048] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:13:52.213953  5125 raft_consensus.cc:2468] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 3.
I20260709 12:13:52.254139  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:52.276280  5834 raft_consensus.cc:3060] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:52.260425  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:52.277107  5837 raft_consensus.cc:2468] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 5.
W20260709 12:13:52.261777  5164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:52.204070  7295 consensus_queue.cc:1048] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 12:13:52.258456  7263 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:52.280380  5837 raft_consensus.cc:1240] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:52.248544  7239 raft_consensus.cc:3055] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:52.269296  7392 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:52.273279  7250 raft_consensus.cc:3060] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:52.287928  7407 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.209061  7238 consensus_queue.cc:237] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:52.266822  7308 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:52.290194  7259 leader_election.cc:290] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:52.267645  7395 raft_consensus.cc:2804] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:52.293032  5834 raft_consensus.cc:2410] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:13:52.286000  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:52.294065  7263 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:52.262902  7363 raft_consensus.cc:515] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:52.307943  5164 leader_election.cc:304] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
W20260709 12:13:52.285228  7362 consensus_meta.cc:287] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.796s	user 0.009s	sys 0.002s
I20260709 12:13:52.284976  7239 raft_consensus.cc:740] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:52.317416  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:52.319590  5272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50932 (request call id 436) took 1088 ms. Trace:
I20260709 12:13:52.323343  5164 leader_election.cc:304] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:52.320055  5272 rpcz_store.cc:276] 0709 12:13:51.230737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.599963 (+369226us) service_pool.cc:224] Handling call
0709 12:13:51.600338 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:51.600768 (+   430us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:13:51.601059 (+   291us) log.cc:844] Serialized 14 byte log entry
0709 12:13:51.637571 (+ 36512us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:51.676945 (+ 39374us) log.cc:844] Serialized 26 byte log entry
0709 12:13:51.677967 (+  1022us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:51.678007 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:51.678086 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:52.293254 (+615168us) spinlock_profiling.cc:243] Waited 5.6 ms on lock 0x7b1800026440. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3ad63f3 00007f84e3ad87c1 00007f84e3ad8779 00007f84e3ad8709 00007f84e3ad86d1 00007f84e3ad79cd 0000000000388634 0000000000388479 00007f84e3ab983a
0709 12:13:52.316158 (+ 22904us) raft_consensus.cc:1685] finished
0709 12:13:52.319338 (+  3180us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:52.319515 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7903,"prepare.queue_time_us":874,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":80,"raft.queue_time_us":1123,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":42249,"spinlock_wait_cycles":12882688,"thread_start_us":35689,"threads_started":1,"wal-append.queue_time_us":101381}
I20260709 12:13:52.317466  5804 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:13:52.302261  7161 consensus_queue.cc:260] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:52.316103  7242 raft_consensus.cc:2749] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:52.329831  5191 raft_consensus.cc:2468] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 3.
I20260709 12:13:52.304436  7395 raft_consensus.cc:493] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:52.329913  5835 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45"
dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
 from {username='slave'} at 127.0.0.1:46100
I20260709 12:13:52.337661  5835 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:52.314304  7259 raft_consensus.cc:493] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.338048  5835 raft_consensus.cc:3060] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:52.336935  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:52.338842  5164 leader_election.cc:304] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:52.339830  7405 raft_consensus.cc:2804] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:52.340636  7344 raft_consensus.cc:3055] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:52.324601  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:52.344521  7242 consensus_queue.cc:1059] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:52.345451  5124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40402 (request call id 1827) took 1239 ms. Trace:
W20260709 12:13:52.345983  7311 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 12:13:52.395491  7358 leader_election.cc:290] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:52.336735  7395 raft_consensus.cc:3060] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:52.365607  5164 leader_election.cc:304] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:52.343189  5192 raft_consensus.cc:1240] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:13:52.369812  7406 raft_consensus.cc:2804] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:52.370543  7405 raft_consensus.cc:493] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:52.279546  7400 raft_consensus.cc:515] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:52.376855  7239 consensus_queue.cc:260] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:52.338498  7248 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:52.313056  7407 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:52.385807  5268 raft_consensus.cc:1240] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:52.389425  5834 raft_consensus.cc:1240] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:13:52.391368  5163 leader_election.cc:304] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:52.392419  5124 rpcz_store.cc:276] 0709 12:13:51.105961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.106088 (+   127us) service_pool.cc:224] Handling call
0709 12:13:52.345228 (+1239140us) spinlock_profiling.cc:243] Waited 248 ms on lock 0x7b540008dc54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:13:52.345368 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":570402176}
I20260709 12:13:52.449172  5268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34672 (request call id 1693) took 1352 ms. Trace:
W20260709 12:13:52.398849  5238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:52.401582  5835 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:52.409567  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 211480us
I20260709 12:13:52.379540  7351 raft_consensus.cc:2749] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:52.367611  7344 raft_consensus.cc:740] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:52.452253  5124 raft_consensus.cc:1240] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:52.449611  5268 rpcz_store.cc:276] 0709 12:13:51.097169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.097302 (+   133us) service_pool.cc:224] Handling call
0709 12:13:52.385369 (+1288067us) spinlock_profiling.cc:243] Waited 1.16 ms on lock 0x7b5800190b98. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb9cfc0 00007f84ebb87929 00007f84ebb873d2 00007f84e50febd4
0709 12:13:52.385608 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:52.448907 (+ 63299us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:52.449108 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2670976}
W20260709 12:13:52.454967  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 89453.1us
I20260709 12:13:52.445688  7406 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
W20260709 12:13:52.462405  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 71138.9us
I20260709 12:13:52.471042  5163 leader_election.cc:304] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:52.463171  5835 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:52.456696  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:52.402801  5830 raft_consensus.cc:3060] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:52.366690  7259 raft_consensus.cc:515] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:52.448418  7265 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:52.443264  7405 raft_consensus.cc:3060] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:13:52.479581  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:52.468389  7242 raft_consensus.cc:2749] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:52.505795  7175 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.518246  7175 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:52.508868  7311 raft_consensus.cc:493] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:52.473755  7249 raft_consensus.cc:493] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.521571  7311 raft_consensus.cc:515] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:52.522251  7249 raft_consensus.cc:515] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:52.523715  7311 leader_election.cc:290] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:52.448372  7384 consensus_queue.cc:1059] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 12:13:52.539645  7384 raft_consensus.cc:3055] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:13:52.540053  7228 consensus_meta.cc:287] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.817s	user 0.007s	sys 0.003s
I20260709 12:13:52.541599  7344 consensus_queue.cc:260] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:52.475405  7362 raft_consensus.cc:2749] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:52.548882  5197 raft_consensus.cc:1275] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:13:52.548923  7264 leader_election.cc:290] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:52.476286  7406 raft_consensus.cc:3060] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:52.510855  7257 raft_consensus.cc:2749] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:13:52.549365  5197 pending_rounds.cc:85] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808: Aborting all ops after (but not including) 5
I20260709 12:13:52.456205  7248 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:52.524327  7249 leader_election.cc:290] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:52.565327  5197 pending_rounds.cc:107] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:13:52.568249  5197 raft_consensus.cc:2889] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:52.475651  7394 raft_consensus.cc:3055] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:52.510984  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:52.537518  7175 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:52.540107  7384 raft_consensus.cc:740] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:52.564777  7264 raft_consensus.cc:493] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.606478  5270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34674 (request call id 1805) took 1393 ms. Trace:
I20260709 12:13:52.542625  7242 consensus_queue.cc:1059] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:13:52.546264  7351 consensus_queue.cc:1059] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:13:52.608266  5270 rpcz_store.cc:276] 0709 12:13:51.213044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.596915 (+383871us) service_pool.cc:224] Handling call
0709 12:13:51.619700 (+ 22785us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:51.620124 (+   424us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:51.620154 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:51.620635 (+   481us) log.cc:844] Serialized 26 byte log entry
0709 12:13:52.131205 (+510570us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:13:52.600051 (+468846us) log.cc:844] Serialized 14 byte log entry
0709 12:13:52.604299 (+  4248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:52.604382 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:52.604425 (+    43us) raft_consensus.cc:1685] finished
0709 12:13:52.604435 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:52.606414 (+  1979us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3744,"raft.queue_time_us":8573,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":8681,"thread_start_us":833119,"threads_started":2,"wal-append.queue_time_us":533955}
I20260709 12:13:52.574455  7394 raft_consensus.cc:740] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
W20260709 12:13:52.621169  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 161007us
I20260709 12:13:52.623078  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:52.624377  5199 raft_consensus.cc:2393] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 3: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:52.607517  7308 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:52.615516  7363 leader_election.cc:290] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:52.615275  7148 raft_consensus.cc:493] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:52.627813  5119 raft_consensus.cc:2393] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 5: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:13:52.632994  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:52.635205  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:52.635854  5125 raft_consensus.cc:2468] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 3.
I20260709 12:13:52.641426  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:52.642238  5200 raft_consensus.cc:2468] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 7.
I20260709 12:13:52.615064  7264 raft_consensus.cc:515] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:52.645112  5804 leader_election.cc:304] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:13:52.646499  5834 raft_consensus.cc:1240] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:13:52.648993  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
W20260709 12:13:52.636337  7319 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.943s	user 0.014s	sys 0.015s
W20260709 12:13:52.636161  7260 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.040s	sys 0.061s
I20260709 12:13:52.656548  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:52.659595  5832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46088 (request call id 390) took 1393 ms. Trace:
I20260709 12:13:52.664281  5832 rpcz_store.cc:276] 0709 12:13:51.265883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.265994 (+   111us) service_pool.cc:224] Handling call
0709 12:13:52.659370 (+1393376us) spinlock_profiling.cc:243] Waited 48.6 ms on lock 0x7b5400491454. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:13:52.659535 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":111713536}
I20260709 12:13:52.660666  5836 raft_consensus.cc:1275] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:52.643630  7289 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.683416  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:52.633514  7148 raft_consensus.cc:515] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:52.635722  7384 consensus_queue.cc:260] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:13:52.719799  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:52.702675  5164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:52.721769  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:52.693346  5198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47728 (request call id 1801) took 1470 ms. Trace:
I20260709 12:13:52.738689  5198 rpcz_store.cc:276] 0709 12:13:51.223311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.223438 (+   127us) service_pool.cc:224] Handling call
0709 12:13:51.237818 (+ 14380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:52.216821 (+979003us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:52.216850 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:52.216888 (+    38us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:13:52.216915 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:52.693100 (+476185us) spinlock_profiling.cc:243] Waited 979 ms on lock 0x7b54001c93d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:13:52.693160 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:52.693283 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2250991360}
W20260709 12:13:52.665307  7319 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.971s	user 0.014s	sys 0.015s
I20260709 12:13:52.661825  7400 leader_election.cc:290] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:13:52.742802  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:52.663717  7260 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.040s	sys 0.061s
W20260709 12:13:52.741943  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 101490us
I20260709 12:13:52.743090  5833 raft_consensus.cc:1240] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:52.743145  5830 raft_consensus.cc:2468] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 6.
I20260709 12:13:52.746832  5833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46088 (request call id 391) took 1480 ms. Trace:
I20260709 12:13:52.747752  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:52.747246  5833 rpcz_store.cc:276] 0709 12:13:51.266143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.267939 (+  1796us) service_pool.cc:224] Handling call
0709 12:13:51.502164 (+234225us) spinlock_profiling.cc:243] Waited 1.95 ms on lock 0x7b58000b0498. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb9cfc0 00007f84ebb87929 00007f84ebb873d2 00007f84e50febd4
0709 12:13:52.719219 (+1217055us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b58000b0498. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9ee9c 00007f84e3a9ea5b 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb9cfc0 00007f84ebb87929 00007f84ebb873d2 00007f84e50febd4
0709 12:13:52.726646 (+  7427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:52.746525 (+ 19879us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:52.746751 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29099264}
I20260709 12:13:52.649686  7394 consensus_queue.cc:260] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:52.657286  7263 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:52.668035  7259 leader_election.cc:290] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:52.688462  7310 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.735168  7248 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:13:52.755985  5802 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.008s	sys 0.034s
I20260709 12:13:52.707684  7421 raft_consensus.cc:493] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:52.758383  5165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:52.685043  7402 raft_consensus.cc:493] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:52.707612  7257 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.698680  7289 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:52.763448  5802 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.008s	sys 0.035s
I20260709 12:13:52.762816  7384 raft_consensus.cc:3060] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:13:52.764567  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 63407.2us
I20260709 12:13:52.767066  7394 raft_consensus.cc:3060] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:52.766700  7428 raft_consensus.cc:2804] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:52.788595  7148 leader_election.cc:290] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:52.789052  7264 leader_election.cc:290] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:52.792192  5270 raft_consensus.cc:1275] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:52.794116  7228 consensus_queue.cc:1048] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:52.768180  7421 raft_consensus.cc:515] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:52.804216  7356 consensus_meta.cc:287] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.663s	user 0.011s	sys 0.000s
I20260709 12:13:52.804225  7421 leader_election.cc:290] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:52.772006  7402 raft_consensus.cc:515] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:52.811439  7321 raft_consensus.cc:493] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.812043  7321 raft_consensus.cc:515] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:52.815732  7426 log.cc:927] Time spent T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.071s	user 0.001s	sys 0.001s
I20260709 12:13:52.766737  7310 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:52.820430  5273 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 2.
W20260709 12:13:52.822480  5273 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34674 (request call id 1795) took 2019 ms (client timeout 1583 ms). Trace:
I20260709 12:13:52.784970  7428 raft_consensus.cc:493] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:52.825703  7428 raft_consensus.cc:3060] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:52.825929  7321 leader_election.cc:290] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:52.804658  7405 raft_consensus.cc:515] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:52.827284  6971 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.827837  6971 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:52.830392  7402 leader_election.cc:290] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:52.831990  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:52.840250  5123 raft_consensus.cc:2468] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 2.
I20260709 12:13:52.842743  7381 raft_consensus.cc:3055] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:52.843219  7381 raft_consensus.cc:740] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
W20260709 12:13:52.843700  7354 consensus_meta.cc:287] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.665s	user 0.011s	sys 0.000s
I20260709 12:13:52.844998  7395 raft_consensus.cc:515] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:52.846374  5838 raft_consensus.cc:2368] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 3. Current term is 4.
I20260709 12:13:52.848201  7395 leader_election.cc:290] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:52.775261  7257 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:52.848767  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:52.849532  5270 raft_consensus.cc:2468] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 2.
I20260709 12:13:52.833863  6971 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:52.834014  5834 raft_consensus.cc:2468] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
I20260709 12:13:52.834321  7376 raft_consensus.cc:493] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.852473  7376 raft_consensus.cc:515] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:13:52.849424  7250 consensus_meta.cc:287] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.517s	user 0.004s	sys 0.006s
I20260709 12:13:52.837072  5119 raft_consensus.cc:1275] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:13:52.822916  5273 rpcz_store.cc:269] 0709 12:13:50.802918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:50.803041 (+   123us) service_pool.cc:224] Handling call
0709 12:13:52.822251 (+2019210us) spinlock_profiling.cc:243] Waited 2.01 s on lock 0x7b54000d4154. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:13:52.822394 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4633222528}
I20260709 12:13:52.839148  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:52.844169  7354 raft_consensus.cc:2749] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:52.873335  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:52.862006  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:52.874326  5124 raft_consensus.cc:2468] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 4.
I20260709 12:13:52.874680  7386 raft_consensus.cc:3055] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:13:52.875106  7386 raft_consensus.cc:740] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:52.875304  5273 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 2.
I20260709 12:13:52.865083  5166 leader_election.cc:304] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:52.866559  7376 leader_election.cc:290] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:52.844153  7381 consensus_queue.cc:260] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:52.876099  7386 consensus_queue.cc:260] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:52.832015  5121 raft_consensus.cc:1240] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:52.871706  7405 leader_election.cc:290] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:52.873570  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:13:52.878636  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 133741us
W20260709 12:13:52.869808  5118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40386 (request call id 1590) took 1433 ms (client timeout 1550 ms). Trace:
I20260709 12:13:52.879163  5270 raft_consensus.cc:2468] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 4.
I20260709 12:13:52.877419  7381 raft_consensus.cc:3060] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:52.882727  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:52.881084  5801 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:52.881119  5163 leader_election.cc:304] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:52.880771  5273 raft_consensus.cc:1275] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:52.884342  5125 raft_consensus.cc:1240] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 LEADER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:13:52.886318  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:52.887084  5120 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 2.
I20260709 12:13:52.888353  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:52.889839  5124 raft_consensus.cc:1275] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:13:52.885681  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:52.892455  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:52.877705  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:52.893453  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:52.894115  5266 raft_consensus.cc:2468] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
I20260709 12:13:52.894083  5268 raft_consensus.cc:2468] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
W20260709 12:13:52.894935  5240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:52.884357  5166 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:52.896389  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:52.897075  5274 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 4.
I20260709 12:13:52.898053  5163 leader_election.cc:304] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:52.897128  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:52.898365  5166 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:52.899348  5801 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:52.900779  5192 raft_consensus.cc:1275] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:52.900900  5270 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:34674
I20260709 12:13:52.901453  5270 raft_consensus.cc:493] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:52.902030  5270 raft_consensus.cc:3060] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:52.902699  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:52.904374  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:52.905961  7424 raft_consensus.cc:2749] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:52.900398  7333 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.907066  7333 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:52.889523  7385 raft_consensus.cc:493] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.908416  7388 raft_consensus.cc:2804] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:52.908215  7385 raft_consensus.cc:515] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:52.908828  7388 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:52.900604  7189 raft_consensus.cc:493] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:52.896276  7402 consensus_queue.cc:1048] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:13:52.909134  7333 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:13:52.880225  5118 rpcz_store.cc:269] 0709 12:13:51.436216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.436823 (+   607us) service_pool.cc:224] Handling call
0709 12:13:52.857324 (+1420501us) spinlock_profiling.cc:243] Waited 597 ms on lock 0x7b54002dcb54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:13:52.869743 (+ 12419us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1372056960}
I20260709 12:13:52.909976  7189 raft_consensus.cc:515] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:52.912374  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:52.889773  7376 raft_consensus.cc:2804] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:52.914001  7376 raft_consensus.cc:493] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:52.914363  7376 raft_consensus.cc:3060] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:52.915536  5238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:52.916384  5198 raft_consensus.cc:1240] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 5. Current term is 6. Ops: []
I20260709 12:13:52.904337  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:52.917655  5125 raft_consensus.cc:2393] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 3: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:13:52.916302  5166 leader_election.cc:304] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:13:52.922060  5192 raft_consensus.cc:2393] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 6: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:52.914629  7189 leader_election.cc:290] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:52.924507  5088 leader_election.cc:304] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:52.931908  5088 leader_election.cc:304] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:52.877657  7406 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:52.926712  7402 raft_consensus.cc:2804] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:52.909046  5269 raft_consensus.cc:1275] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:52.940061  7402 raft_consensus.cc:493] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:52.920606  7424 raft_consensus.cc:493] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:52.943457  7402 raft_consensus.cc:3060] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:52.943993  7424 raft_consensus.cc:515] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:52.915202  7264 raft_consensus.cc:493] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.945976  5198 raft_consensus.cc:1240] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:52.938506  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:52.914945  7385 leader_election.cc:290] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:52.942168  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:52.904491  7405 raft_consensus.cc:2804] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:52.909235  7388 raft_consensus.cc:3060] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:52.953351  5088 leader_election.cc:304] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:52.930374  7326 consensus_queue.cc:1059] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 12:13:52.939775  7321 raft_consensus.cc:493] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:52.927171  6971 raft_consensus.cc:2804] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:52.937505  7189 raft_consensus.cc:2804] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:52.941828  7238 raft_consensus.cc:2804] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:52.926927  7323 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:52.971388  7238 raft_consensus.cc:493] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:52.945689  7264 raft_consensus.cc:515] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:52.971866  7238 raft_consensus.cc:3060] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:52.960577  6971 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:52.973686  7264 leader_election.cc:290] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:52.971596  7323 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:52.976277  7323 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:52.937916  5240 leader_election.cc:304] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:13:52.878423  7250 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:52.977515  5240 leader_election.cc:304] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:52.942305  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:52.936868  7325 consensus_queue.cc:1048] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:13:52.961556  5198 raft_consensus.cc:1275] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:13:52.939770  7318 raft_consensus.cc:2749] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:52.940100  7148 raft_consensus.cc:493] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:52.990517  7400 consensus_queue.cc:1059] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:13:52.990688  7148 raft_consensus.cc:515] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:52.991549  7400 consensus_queue.cc:1243] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Peer ad2f9a1e2f7a45429fa69fd23d09f821 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:13:52.969065  7249 raft_consensus.cc:3055] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:13:52.988615  7189 raft_consensus.cc:697] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:52.992048  7249 raft_consensus.cc:740] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
W20260709 12:13:52.966054  5165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:52.992903  7189 consensus_queue.cc:237] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:52.993095  7249 consensus_queue.cc:260] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:52.994232  7249 raft_consensus.cc:3060] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:52.958858  7007 raft_consensus.cc:2804] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:52.994441  7264 raft_consensus.cc:2749] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:52.994886  7007 raft_consensus.cc:697] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:52.988384  7323 raft_consensus.cc:2804] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:52.995442  7323 raft_consensus.cc:493] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:52.995792  7007 consensus_queue.cc:237] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:52.991464  5271 raft_consensus.cc:2468] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 5.
I20260709 12:13:52.968500  5121 raft_consensus.cc:1275] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:52.936185  5270 raft_consensus.cc:515] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:52.973755  6971 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:52.953703  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:52.998390  5125 raft_consensus.cc:2468] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 3.
I20260709 12:13:52.921176  7243 raft_consensus.cc:2804] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:13:52.955274  7405 raft_consensus.cc:493] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:52.958751  7295 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:52.999253  7405 raft_consensus.cc:3060] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:52.999630  7295 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:53.001076  7243 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:52.959834  7257 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:53.001506  7243 raft_consensus.cc:3060] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:13:53.001863  7295 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:53.002743  5166 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:53.003086  5117 raft_consensus.cc:2393] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 6: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:13:52.992718  7345 consensus_queue.cc:1048] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:53.003830  7250 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:53.004383  7400 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.004520  7265 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:53.004901  7400 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:53.005059  7265 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:52.995805  7323 raft_consensus.cc:3060] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:52.998023  7424 leader_election.cc:290] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:53.013931  7345 raft_consensus.cc:493] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:53.014528  7345 raft_consensus.cc:515] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:53.017293  7345 leader_election.cc:290] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:53.018038  7289 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:53.020553  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:53.021260  5191 raft_consensus.cc:2468] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 7.
I20260709 12:13:53.022284  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:53.023733  7310 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:52.958225  7321 raft_consensus.cc:515] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:52.948571  7341 raft_consensus.cc:493] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.014071  5197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41416 (request call id 384) took 1125 ms. Trace:
I20260709 12:13:52.999007  5270 leader_election.cc:290] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:53.033658  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:53.033952  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:53.034406  5122 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 5.
W20260709 12:13:53.013182  5237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.024329  7428 raft_consensus.cc:515] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:53.030012  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:53.030364  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:53.030735  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:53.035537  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:53.040957  5122 raft_consensus.cc:2468] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 3.
I20260709 12:13:53.033499  5197 rpcz_store.cc:276] 0709 12:13:51.888672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.888826 (+   154us) service_pool.cc:224] Handling call
0709 12:13:51.889157 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:52.568798 (+679641us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:53.013821 (+445023us) spinlock_profiling.cc:243] Waited 654 ms on lock 0x7b54002ae254. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:13:53.014008 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1504496000}
I20260709 12:13:53.041945  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:53.043040  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:53.044100  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:13:53.035344  5237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.039291  5267 raft_consensus.cc:1240] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 5. Current term is 6. Ops: []
I20260709 12:13:53.042662  7402 raft_consensus.cc:515] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:53.052546  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:53.036170  5125 raft_consensus.cc:2468] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 2.
I20260709 12:13:53.047151  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:53.053900  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:53.054523  5197 raft_consensus.cc:2468] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 4.
I20260709 12:13:53.055692  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:53.032734  7406 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:53.035187  7257 raft_consensus.cc:2804] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:53.023443  7243 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:53.074268  7431 raft_consensus.cc:493] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.082003  5197 raft_consensus.cc:2393] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 5: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:53.076759  5237 leader_election.cc:304] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:53.043516  7428 leader_election.cc:290] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:53.044297  7349 raft_consensus.cc:493] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.076170  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:13:53.064934  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 103771us
I20260709 12:13:53.039844  7330 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:53.052634  5121 raft_consensus.cc:3055] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:13:53.094473  5165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.062609  7394 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.093154  5120 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 2.
I20260709 12:13:53.033602  7381 consensus_queue.cc:1048] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:13:53.101456  5088 leader_election.cc:304] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:13:53.112151  7189 consensus_queue.cc:1048] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:53.078873  7295 consensus_queue.cc:1048] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:13:53.105340  7330 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:53.123268  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:53.124099  5272 raft_consensus.cc:3060] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:53.116006  5088 leader_election.cc:304] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:53.116643  7439 raft_consensus.cc:2804] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:53.118669  7402 leader_election.cc:290] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:53.119831  5194 raft_consensus.cc:2468] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:13:53.080590  7257 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:53.112437  7243 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:53.040383  7341 raft_consensus.cc:515] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:13:53.140411  5165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.142472  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:53.080862  7264 raft_consensus.cc:493] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:53.116818  7388 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:53.260571  5164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.285753  5272 raft_consensus.cc:2468] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 5.
W20260709 12:13:53.372838  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 256960us
I20260709 12:13:53.369884  5116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40402 (request call id 1831) took 2257 ms. Trace:
W20260709 12:13:53.372730  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 296054us
I20260709 12:13:53.143428  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:53.375639  5116 rpcz_store.cc:276] 0709 12:13:51.107080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.108632 (+  1552us) service_pool.cc:224] Handling call
0709 12:13:52.116921 (+1008289us) spinlock_profiling.cc:243] Waited 6.62 ms on lock 0x7b5800002a98. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9eeee 000000000036eb39 00007f84ebb121e0 00007f84ebbdb0c4 00007f84ebbdb131 00007f84ebb9cfc0 00007f84ebb87929 00007f84ebb873d2 00007f84e50febd4
0709 12:13:52.868127 (+751206us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:52.868301 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:52.868325 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:52.868365 (+    40us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:13:52.868392 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:52.868444 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:53.364582 (+496138us) spinlock_profiling.cc:243] Waited 751 ms on lock 0x7b54002dcb50. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc28ad 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:13:53.364711 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1742412416}
I20260709 12:13:53.374958  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:53.378787  5194 raft_consensus.cc:3060] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:13:53.380168  5272 raft_consensus.cc:1275] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:53.381079  5268 raft_consensus.cc:1240] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:13:53.381035  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:53.100575  5121 raft_consensus.cc:740] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:53.387789  5270 raft_consensus.cc:2393] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 3: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
W20260709 12:13:53.216213  7412 log.cc:927] Time spent T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.449s	user 0.003s	sys 0.000s
I20260709 12:13:53.142323  7249 raft_consensus.cc:2804] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:53.138103  7439 raft_consensus.cc:493] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:53.396309  5199 raft_consensus.cc:2368] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 5. Current term is 6.
I20260709 12:13:53.137115  7260 raft_consensus.cc:2804] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:53.401105  5194 raft_consensus.cc:2468] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 8.
I20260709 12:13:53.402436  5801 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:53.380381  7257 raft_consensus.cc:3060] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:53.372160  7420 raft_consensus.cc:493] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:53.166882  7289 raft_consensus.cc:493] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:53.377002  7330 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:53.377482  7356 raft_consensus.cc:493] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:53.101173  7349 raft_consensus.cc:515] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:53.411759  7405 raft_consensus.cc:515] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:13:53.413985  7437 log.cc:927] Time spent T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.303s	user 0.000s	sys 0.001s
I20260709 12:13:53.414069  7243 raft_consensus.cc:2804] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:13:53.429848  7356 raft_consensus.cc:515] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:53.438583  7445 raft_consensus.cc:493] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:53.439327  7243 raft_consensus.cc:697] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 8 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:13:53.439214  7445 raft_consensus.cc:515] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:53.216673  7376 raft_consensus.cc:515] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:53.430742  7289 raft_consensus.cc:515] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:53.441668  7405 leader_election.cc:290] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:53.441956  7445 leader_election.cc:290] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:53.442832  7289 leader_election.cc:290] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:53.416633  7341 leader_election.cc:290] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:53.401142  7249 raft_consensus.cc:493] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:53.381590  7310 raft_consensus.cc:493] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:53.421619  5121 consensus_queue.cc:260] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:53.095453  7431 raft_consensus.cc:515] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:53.400472  7267 leader_election.cc:290] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:53.405081  7260 raft_consensus.cc:493] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:53.422955  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:53.381341  7345 raft_consensus.cc:493] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
W20260709 12:13:53.430462  5838 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46094 (request call id 670) took 1243 ms (client timeout 1522 ms). Trace:
I20260709 12:13:53.432420  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:53.403740  7439 raft_consensus.cc:3060] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:53.440383  5192 raft_consensus.cc:1240] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:53.215557  6971 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:53.383036  7264 raft_consensus.cc:515] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:53.136438  7394 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:53.503316  5165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.444784  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:53.549399  5270 raft_consensus.cc:2468] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 4.
I20260709 12:13:53.550359  5194 raft_consensus.cc:2393] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 6: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:53.543922  7249 raft_consensus.cc:3060] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:13:53.468596  5164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:53.549187  5838 rpcz_store.cc:269] 0709 12:13:52.187160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:52.187314 (+   154us) service_pool.cc:224] Handling call
0709 12:13:53.430218 (+1242904us) spinlock_profiling.cc:243] Waited 658 ms on lock 0x7b54007d0d54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:13:53.430398 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1513351040}
I20260709 12:13:53.436242  7256 leader_election.cc:290] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:53.485728  7321 leader_election.cc:290] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:53.545914  7324 raft_consensus.cc:493] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.443535  7376 leader_election.cc:290] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:53.423857  7238 raft_consensus.cc:515] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:53.581756  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:53.586417  5194 raft_consensus.cc:2468] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 2.
I20260709 12:13:53.587440  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:53.588080  5194 raft_consensus.cc:2468] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 5.
I20260709 12:13:53.431370  7420 raft_consensus.cc:515] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:53.583665  5198 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 4.
I20260709 12:13:53.589007  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:13:53.594592  5165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.555361  7260 raft_consensus.cc:3060] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:53.589246  5801 leader_election.cc:304] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
W20260709 12:13:53.591240  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.592270  5240 leader_election.cc:304] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:13:53.569840  7445 raft_consensus.cc:493] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:53.596630  5240 leader_election.cc:304] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:13:53.485321  7007 consensus_queue.cc:1048] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.099s
I20260709 12:13:53.437922  7323 raft_consensus.cc:515] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:53.605274  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:53.574915  7405 raft_consensus.cc:493] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:53.605777  5125 raft_consensus.cc:1275] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:53.440433  7243 consensus_queue.cc:237] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:53.630849  7431 leader_election.cc:290] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:53.619391  6971 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:53.603276  7256 raft_consensus.cc:2804] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:53.566359  7345 raft_consensus.cc:515] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:53.622123  7447 raft_consensus.cc:2804] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:53.672914  7256 raft_consensus.cc:493] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:53.622429  7257 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:53.623502  7394 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:53.624078  7349 leader_election.cc:290] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:53.625054  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:53.626633  7264 leader_election.cc:290] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:53.587910  7324 raft_consensus.cc:515] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:53.626570  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:13:53.608064  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 229450us
I20260709 12:13:53.631819  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:53.567998  7310 raft_consensus.cc:515] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:53.648682  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:13:53.619273  7440 log.cc:927] Time spent T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:13:53.632453  7445 raft_consensus.cc:515] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:53.700021  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 98115.6us
W20260709 12:13:53.709950  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 272252us
I20260709 12:13:53.696259  5270 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 4.
I20260709 12:13:53.805451  5268 raft_consensus.cc:2468] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 3.
I20260709 12:13:53.805805  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:53.696261  5272 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:53.807607  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:53.695288  7321 raft_consensus.cc:2804] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:53.684522  7447 raft_consensus.cc:493] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:53.812234  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:53.814582  5124 raft_consensus.cc:3060] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:13:53.815253  5237 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:53.684625  7256 raft_consensus.cc:3060] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:53.695645  7341 raft_consensus.cc:493] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.820482  5272 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 3.
I20260709 12:13:53.819692  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
W20260709 12:13:53.848881  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 53642.8us
I20260709 12:13:53.797076  7388 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:13:53.850389  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 227233us
I20260709 12:13:53.852957  5237 leader_election.cc:304] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:53.730247  7330 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:53.694527  7229 raft_consensus.cc:493] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:53.694864  7381 raft_consensus.cc:493] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:53.699429  7394 raft_consensus.cc:493] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:53.808490  7267 raft_consensus.cc:493] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.632783  7405 raft_consensus.cc:515] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:53.693048  7376 raft_consensus.cc:493] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:53.870723  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:53.872776  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:53.812768  7321 raft_consensus.cc:493] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:53.882964  5122 raft_consensus.cc:3060] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:13:53.885639  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:53.886627  5125 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:53.849735  7406 raft_consensus.cc:493] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
W20260709 12:13:53.897743  5165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:53.913044  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 60149.9us
W20260709 12:13:53.909111  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 97457.7us
I20260709 12:13:53.914733  5237 leader_election.cc:304] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:53.810878  7325 consensus_queue.cc:1059] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 12:13:53.818183  7447 raft_consensus.cc:3060] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:53.853762  7424 raft_consensus.cc:493] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:53.889628  7321 raft_consensus.cc:3060] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:53.859828  7341 raft_consensus.cc:515] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:53.915047  5124 raft_consensus.cc:2468] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 4.
I20260709 12:13:53.912528  5125 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 3.
I20260709 12:13:53.918135  5194 raft_consensus.cc:2468] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 4.
I20260709 12:13:53.917541  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:53.855180  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:53.923970  5122 raft_consensus.cc:2468] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 6.
I20260709 12:13:53.941820  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:53.771157  7260 raft_consensus.cc:515] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:53.918707  5088 leader_election.cc:304] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:53.933214  5237 leader_election.cc:304] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:53.888142  7345 leader_election.cc:290] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:53.904633  7459 raft_consensus.cc:2804] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:13:53.944993  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 91877.8us
I20260709 12:13:53.945794  5120 raft_consensus.cc:2410] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:13:53.946521  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:53.958035  5272 raft_consensus.cc:3060] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:53.947327  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:53.959338  5266 raft_consensus.cc:2468] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 4.
I20260709 12:13:53.960422  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:53.961231  5266 raft_consensus.cc:2393] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 5: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:13:53.948670  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:53.895373  7388 raft_consensus.cc:493] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.894642  7356 leader_election.cc:290] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:53.908947  7310 leader_election.cc:290] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:53.881755  7330 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:13:53.981326  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.884850  7394 raft_consensus.cc:515] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:53.885022  7381 raft_consensus.cc:515] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:53.881515  7229 raft_consensus.cc:515] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:53.985833  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:53.885286  7267 raft_consensus.cc:515] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:53.989187  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:53.909282  7007 consensus_queue.cc:1059] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 12:13:54.010730  5270 raft_consensus.cc:2393] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 5: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:13:53.919471  7406 raft_consensus.cc:515] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:54.003396  5272 raft_consensus.cc:2410] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:13:53.894276  7450 consensus_queue.cc:1059] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.100s
I20260709 12:13:53.944470  7238 leader_election.cc:290] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:53.955691  7325 raft_consensus.cc:2804] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:13:54.008924  5165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:53.957650  7459 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:54.012149  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:53.888629  7376 raft_consensus.cc:515] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:54.010718  7420 leader_election.cc:290] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:53.986500  7326 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.939203  7451 consensus_queue.cc:1048] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.080s
I20260709 12:13:53.987946  7323 leader_election.cc:290] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:53.985143  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:53.946174  7424 raft_consensus.cc:515] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:54.028828  5270 raft_consensus.cc:2468] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 3.
I20260709 12:13:54.031705  7445 leader_election.cc:290] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:54.013671  7345 raft_consensus.cc:493] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.990578  7388 raft_consensus.cc:515] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:54.033093  7459 raft_consensus.cc:3060] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:13:54.047395  7324 leader_election.cc:290] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:54.047614  7463 consensus_queue.cc:1048] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:54.049993  7400 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:54.052464  5200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 1776) took 1100 ms. Trace:
I20260709 12:13:54.053195  7265 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:54.041589  7330 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:54.024365  7310 raft_consensus.cc:2749] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:54.041442  7326 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:54.437788  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:54.454872  5192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 1772) took 1526 ms. Trace:
I20260709 12:13:54.463140  7445 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:54.463814  7445 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:54.024657  7460 raft_consensus.cc:2804] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:54.465662  7460 raft_consensus.cc:493] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:54.466080  7460 raft_consensus.cc:3060] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:54.466339  5268 raft_consensus.cc:1275] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:54.462909  5192 rpcz_store.cc:276] 0709 12:13:52.928634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:52.928914 (+   280us) service_pool.cc:224] Handling call
0709 12:13:52.929277 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:53.565677 (+636400us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:54.454547 (+888870us) spinlock_profiling.cc:243] Waited 511 ms on lock 0x7b54002ae754. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:13:54.454790 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1174997376}
I20260709 12:13:54.470851  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:54.471484  5192 raft_consensus.cc:3060] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:54.344986  7175 raft_consensus.cc:493] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:54.037453  7349 raft_consensus.cc:493] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:54.133584  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:54.070919  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 107275us
I20260709 12:13:54.063714  5118 raft_consensus.cc:2468] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 3.
I20260709 12:13:54.060428  5270 raft_consensus.cc:1240] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:54.125401  7461 raft_consensus.cc:3055] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:54.308429  7260 leader_election.cc:290] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:54.469633  7345 raft_consensus.cc:515] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:54.308708  7405 leader_election.cc:290] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:13:54.148166  5165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:54.067462  5198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47744 (request call id 1780) took 1103 ms. Trace:
I20260709 12:13:54.473354  5166 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:54.478657  5268 raft_consensus.cc:1275] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:13:54.514120  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:54.481693  5273 raft_consensus.cc:2468] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 5.
I20260709 12:13:54.514712  5120 raft_consensus.cc:3060] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:54.515331  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:54.483054  5192 raft_consensus.cc:2468] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 5.
I20260709 12:13:54.516757  5192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47728 (request call id 1818) took 1499 ms. Trace:
I20260709 12:13:54.517053  5192 rpcz_store.cc:276] 0709 12:13:53.016952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:54.470590 (+1453638us) service_pool.cc:224] Handling call
0709 12:13:54.516690 (+ 46100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:54.518178  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:54.518975  5192 raft_consensus.cc:2393] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 4: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:54.519361  5192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41416 (request call id 402) took 1482 ms. Trace:
I20260709 12:13:54.519649  5192 rpcz_store.cc:276] 0709 12:13:53.036442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:54.517909 (+1481467us) service_pool.cc:224] Handling call
0709 12:13:54.519307 (+  1398us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:54.520576  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:54.521270  5192 raft_consensus.cc:2368] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 3. Current term is 4.
I20260709 12:13:54.522326  5192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41416 (request call id 405) took 1460 ms. Trace:
I20260709 12:13:54.522701  5192 rpcz_store.cc:276] 0709 12:13:53.062294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:54.520314 (+1458020us) service_pool.cc:224] Handling call
0709 12:13:54.522262 (+  1948us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:54.523717  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:54.524381  5192 raft_consensus.cc:2468] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 3.
I20260709 12:13:54.524909  5192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47728 (request call id 1810) took 1509 ms. Trace:
I20260709 12:13:54.525264  5192 rpcz_store.cc:276] 0709 12:13:53.015143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:54.523432 (+1508289us) service_pool.cc:224] Handling call
0709 12:13:54.524858 (+  1426us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:13:54.159124  7249 consensus_meta.cc:287] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.573s	user 0.004s	sys 0.005s
I20260709 12:13:54.528535  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:54.530313  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:54.531008  5273 raft_consensus.cc:3060] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:54.484376  5270 raft_consensus.cc:1275] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:54.064441  7257 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:13:54.491422  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 459070us
W20260709 12:13:54.539086  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 65793.9us
I20260709 12:13:54.539880  5166 leader_election.cc:304] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
W20260709 12:13:54.495923  5165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:54.541843  5165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:54.499635  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:54.500267  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:54.548544  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:13:54.550856  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:54.547982  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:54.468715  5200 rpcz_store.cc:276] 0709 12:13:52.952179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:52.952314 (+   135us) service_pool.cc:224] Handling call
0709 12:13:52.978713 (+ 26399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:53.397955 (+419242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:53.397983 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:53.398462 (+   479us) log.cc:844] Serialized 26 byte log entry
0709 12:13:53.533959 (+135497us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:13:53.534004 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:54.051953 (+517949us) spinlock_profiling.cc:243] Waited 419 ms on lock 0x7b54003908d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:13:54.052015 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:54.052070 (+    55us) raft_consensus.cc:1685] finished
0709 12:13:54.052085 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:54.052387 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2368,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":10947,"spinlock_wait_cycles":963197184,"thread_start_us":121078,"threads_started":1,"wal-append.queue_time_us":190983}
W20260709 12:13:54.564610  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 62986.8us
I20260709 12:13:54.475117  7475 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.565532  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:54.502009  5198 rpcz_store.cc:276] 0709 12:13:52.963874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:53.091769 (+127895us) service_pool.cc:224] Handling call
0709 12:13:54.067211 (+975442us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b5400364a54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:13:54.067387 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":471498496}
I20260709 12:13:54.474117  7175 raft_consensus.cc:515] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:54.490612  7341 leader_election.cc:290] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:54.559293  7465 raft_consensus.cc:2804] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:13:54.554674  5801 leader_election.cc:400] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 election: Vote denied by peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455) with higher term. Message: Invalid argument: T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 3. Current term is 4.
I20260709 12:13:54.574540  5801 leader_election.cc:403] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:13:54.610695  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:54.074783  7439 raft_consensus.cc:515] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:54.531509  7260 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:54.490471  7424 leader_election.cc:290] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:54.485185  7461 raft_consensus.cc:740] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:54.494087  7326 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:54.538170  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:54.636327  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:54.497675  7325 raft_consensus.cc:697] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:54.484297  7472 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:54.649641  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:54.511132  7400 raft_consensus.cc:493] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:54.475538  7349 raft_consensus.cc:515] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:54.563622  7381 leader_election.cc:290] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:54.643697  5120 raft_consensus.cc:2468] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 5.
I20260709 12:13:54.696409  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:54.536463  7249 raft_consensus.cc:515] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:54.509531  7324 consensus_queue.cc:1048] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.168s
I20260709 12:13:54.652663  5192 raft_consensus.cc:2468] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 4.
I20260709 12:13:54.625083  7330 raft_consensus.cc:493] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.636512  7465 raft_consensus.cc:697] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
W20260709 12:13:54.695261  7462 log.cc:927] Time spent T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.661s	user 0.001s	sys 0.000s
I20260709 12:13:54.678937  7325 consensus_queue.cc:237] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:54.511065  7248 consensus_queue.cc:1059] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.125s
I20260709 12:13:54.685104  5125 raft_consensus.cc:2393] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 6: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:13:54.653690  7376 leader_election.cc:290] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:54.631726  7471 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.609035  7405 raft_consensus.cc:2804] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:54.661839  7452 raft_consensus.cc:493] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
W20260709 12:13:54.685173  5165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:54.565939  7456 consensus_queue.cc:1048] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.121s
I20260709 12:13:54.512898  7469 consensus_queue.cc:1059] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.181s
W20260709 12:13:54.688637  7457 log.cc:927] Time spent T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.642s	user 0.001s	sys 0.000s
I20260709 12:13:54.679230  7175 leader_election.cc:290] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:54.741214  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:54.609969  7466 consensus_queue.cc:1059] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.180s
I20260709 12:13:54.649730  7476 consensus_queue.cc:1048] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.110s
I20260709 12:13:54.651731  7260 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:54.756346  7465 consensus_queue.cc:237] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:54.758482  7249 leader_election.cc:290] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:54.760638  7161 raft_consensus.cc:3060] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:54.632875  7475 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:54.761747  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:54.762164  7474 raft_consensus.cc:493] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.764010  7406 leader_election.cc:290] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:54.764984  7439 leader_election.cc:290] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:54.765555  7318 raft_consensus.cc:3055] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:54.766563  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:54.767123  7411 raft_consensus.cc:3060] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:54.736680  7467 raft_consensus.cc:493] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.733997  7265 raft_consensus.cc:493] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:54.774701  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 133491us
I20260709 12:13:54.799625  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:54.823068  7480 raft_consensus.cc:493] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:54.929263  5089 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.027s	sys 0.016s
I20260709 12:13:54.846493  7344 raft_consensus.cc:3060] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:54.767982  5164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:54.792462  5120 raft_consensus.cc:2468] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 4.
I20260709 12:13:54.782042  5273 raft_consensus.cc:2468] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 4.
I20260709 12:13:54.689456  7472 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:54.737411  7463 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:54.694763  7400 raft_consensus.cc:515] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:54.796226  5163 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.855s	user 0.011s	sys 0.002s
I20260709 12:13:54.896979  7318 raft_consensus.cc:740] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:54.744586  7470 raft_consensus.cc:493] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:54.868774  7459 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:54.929097  7007 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.914s	user 0.011s	sys 0.034s
W20260709 12:13:54.796523  7243 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.004s	sys 0.010s
I20260709 12:13:54.758498  7445 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:54.833616  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:54.742774  7330 raft_consensus.cc:515] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:54.790493  7471 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:54.822824  7405 raft_consensus.cc:697] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:54.826625  7319 raft_consensus.cc:3055] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:54.847133  7475 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:54.813694  7452 raft_consensus.cc:515] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:54.855646  7485 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.874419  7349 leader_election.cc:290] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:54.822789  7116 raft_consensus.cc:493] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:54.877583  7474 raft_consensus.cc:515] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:54.886600  5267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34674 (request call id 1823) took 1506 ms. Trace:
I20260709 12:13:54.893158  7455 raft_consensus.cc:3055] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:13:54.894271  5117 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40386 (request call id 1600) took 2703 ms (client timeout 1820 ms). Trace:
I20260709 12:13:54.913604  5198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41416 (request call id 412) took 1103 ms. Trace:
I20260709 12:13:54.848018  7388 leader_election.cc:290] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:54.917542  7264 raft_consensus.cc:2749] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:54.799041  7296 raft_consensus.cc:493] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:54.930169  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 247913us
W20260709 12:13:54.929909  5089 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.027s	sys 0.016s
I20260709 12:13:54.919425  7326 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:54.934669  5163 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.994s	user 0.011s	sys 0.003s
I20260709 12:13:54.767704  7396 raft_consensus.cc:493] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.936437  5237 leader_election.cc:304] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:54.937042  5801 leader_election.cc:304] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:54.950824  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:13:54.951051  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:54.953505  5832 raft_consensus.cc:1275] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:13:54.954698  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:54.952003  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:54.936101  7381 raft_consensus.cc:493] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:54.939489  7375 raft_consensus.cc:493] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.928619  7265 raft_consensus.cc:515] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:54.959426  5164 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:54.962357  5266 raft_consensus.cc:2468] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 7.
W20260709 12:13:54.952613  7243 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.876s	user 0.004s	sys 0.010s
W20260709 12:13:54.961238  5165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:54.963690  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:13:54.945665  7007 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.926s	user 0.012s	sys 0.034s
W20260709 12:13:54.962792  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 397188us
I20260709 12:13:54.952453  7376 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.957245  7260 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:13:54.971494  7447 consensus_meta.cc:287] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.977s	user 0.003s	sys 0.008s
I20260709 12:13:54.945583  7470 raft_consensus.cc:515] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:54.926100  7467 raft_consensus.cc:515] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:54.975049  5198 rpcz_store.cc:276] 0709 12:13:53.810320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:54.745716 (+935396us) service_pool.cc:224] Handling call
0709 12:13:54.913518 (+167802us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:13:55.099964  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 140605us
I20260709 12:13:55.061290  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:13:54.975585  5117 rpcz_store.cc:269] 0709 12:13:52.191270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:52.191418 (+   148us) service_pool.cc:224] Handling call
0709 12:13:54.894013 (+2702595us) spinlock_profiling.cc:243] Waited 792 ms on lock 0x7b54001b2954. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:13:54.894188 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1822103296}
W20260709 12:13:55.100611  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 163642us
I20260709 12:13:55.099556  5123 raft_consensus.cc:3060] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:55.102174  5238 leader_election.cc:336] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Timed out: RequestConsensusVote RPC to 127.3.212.132:43539 timed out after 1.961s (SENT)
W20260709 12:13:55.102588  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 166768us
I20260709 12:13:55.105787  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:13:55.102653  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 770169us
W20260709 12:13:55.108058  5163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:54.956753  7341 raft_consensus.cc:493] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.106230  5267 rpcz_store.cc:276] 0709 12:13:53.380092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:53.380553 (+   461us) service_pool.cc:224] Handling call
0709 12:13:53.393780 (+ 13227us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:53.578667 (+184887us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:53.578701 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:53.584923 (+  6222us) log.cc:844] Serialized 26 byte log entry
0709 12:13:53.884804 (+299881us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:13:54.885717 (+1000913us) spinlock_profiling.cc:243] Waited 2.14 ms on lock 0x7b18003443e0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e676b4bc 00007f84e3ab948b 00007f84ec9139a9 00007f84e3ad569b 00007f84e3ad393f 00007f84e3ad3455 00007f84ea5bb3c7 00007f84e6bcd9a7 00007f84e6bdd0bf
0709 12:13:54.885900 (+   183us) log.cc:844] Serialized 14 byte log entry
0709 12:13:54.886150 (+   250us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:54.886242 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:54.886288 (+    46us) raft_consensus.cc:1685] finished
0709 12:13:54.886379 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:54.886524 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47731,"prepare.queue_time_us":173800,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":177950,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":3666,"spinlock_wait_cycles":4931968,"thread_start_us":392850,"threads_started":3,"wal-append.queue_time_us":363204}
I20260709 12:13:54.933993  7460 raft_consensus.cc:515] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:55.031360  7459 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:13:55.094236  7256 consensus_meta.cc:287] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 1.240s	user 0.007s	sys 0.004s
I20260709 12:13:54.930449  7480 raft_consensus.cc:515] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:55.108969  7466 raft_consensus.cc:2804] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:55.111878  7486 consensus_queue.cc:1048] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:13:55.114705  7469 consensus_queue.cc:1048] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:55.115968  7490 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:55.116824  5121 raft_consensus.cc:3060] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:54.959820  7319 raft_consensus.cc:740] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:54.941794  7463 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:54.980217  7318 consensus_queue.cc:260] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:55.110266  5838 raft_consensus.cc:2393] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 5: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:13:54.975492  7485 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:55.106513  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:55.355996  7250 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.968240  7475 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:55.727360  7250 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:55.728286  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 626065us
I20260709 12:13:55.117973  7447 raft_consensus.cc:515] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:55.479023  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:55.730968  7447 leader_election.cc:290] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:55.104848  7465 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.460208  5266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50932 (request call id 450) took 1505 ms. Trace:
I20260709 12:13:55.732172  7325 raft_consensus.cc:493] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.152667  7249 consensus_queue.cc:1059] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.580s
I20260709 12:13:55.564553  5023 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33896 (request call id 318) took 5884 ms. Trace:
I20260709 12:13:55.732934  7325 raft_consensus.cc:515] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:54.980388  7116 raft_consensus.cc:515] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:55.733888  5023 rpcz_store.cc:276] 0709 12:13:49.680007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:49.680151 (+   144us) service_pool.cc:224] Handling call
0709 12:13:55.564469 (+5884318us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:52.698594 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:52.747212 (+ 48618us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:52.747293 (+    81us) write_op.cc:435] Acquired schema lock
0709 12:13:52.747315 (+    22us) tablet.cc:662] Decoding operations
0709 12:13:52.747724 (+   409us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:52.747810 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:52.747842 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:13:52.748090 (+   248us) tablet.cc:701] Row locks acquired
0709 12:13:52.748126 (+    36us) write_op.cc:260] PREPARE: finished
0709 12:13:52.748322 (+   196us) write_op.cc:270] Start()
0709 12:13:52.748472 (+   150us) write_op.cc:276] Timestamp: P: 1783599232748238 usec, L: 0
0709 12:13:52.748495 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:13:52.755504 (+  7009us) log.cc:844] Serialized 536 byte log entry
0709 12:13:53.113938 (+358434us) op_driver.cc:464] REPLICATION: finished
0709 12:13:53.423716 (+309778us) write_op.cc:301] APPLY: starting
0709 12:13:53.423808 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:53.423917 (+   109us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:53.429717 (+  5800us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:53.430024 (+   307us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:53.430193 (+   169us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:13:53.437139 (+  6946us) write_op.cc:312] APPLY: finished
0709 12:13:53.546670 (+109531us) log.cc:844] Serialized 23 byte log entry
0709 12:13:53.569730 (+ 23060us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:53.574543 (+  4813us) write_op.cc:454] Released schema lock
0709 12:13:53.577270 (+  2727us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:53.604680 (+ 27410us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:53.612243 (+  7563us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":309532,"apply.run_cpu_time_us":2515,"apply.run_wall_time_us":164542,"num_ops":1,"prepare.queue_time_us":478976,"prepare.run_cpu_time_us":16126,"prepare.run_wall_time_us":235514,"raft.queue_time_us":158448,"raft.run_cpu_time_us":19380,"raft.run_wall_time_us":273602,"replication_time_us":365289,"thread_start_us":887238,"threads_started":4,"wal-append.queue_time_us":185891,"wal-append.run_cpu_time_us":20502,"wal-append.run_wall_time_us":1658650}]]}
I20260709 12:13:55.402268  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:55.740435  5122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40402 (request call id 1867) took 1238 ms. Trace:
I20260709 12:13:55.108522  7396 raft_consensus.cc:515] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:55.105476  7296 raft_consensus.cc:515] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:55.109050  7381 raft_consensus.cc:515] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:55.738924  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:13:55.749781  7423 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.701s	user 0.013s	sys 0.012s
I20260709 12:13:55.038935  7471 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:55.103179  7406 raft_consensus.cc:2749] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:55.431347  7239 raft_consensus.cc:3060] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:55.435468  7345 leader_election.cc:290] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:55.739249  7319 consensus_queue.cc:260] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:55.208525  7472 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:55.772217  5801 leader_election.cc:304] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
W20260709 12:13:55.554077  5274 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.030s	sys 0.071s
W20260709 12:13:55.291725  5194 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47744 (request call id 1778) took 2333 ms (client timeout 2183 ms). Trace:
W20260709 12:13:55.295109  7489 log.cc:927] Time spent T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.227s	user 0.000s	sys 0.001s
I20260709 12:13:55.189127  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:55.741082  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:55.741169  7249 consensus_queue.cc:1243] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer 9e794b72ed7640219f90ec4232363929 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:13:55.288110  7394 leader_election.cc:290] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:55.105885  7388 raft_consensus.cc:2804] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:13:55.463660  7407 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:55.727620  5119 raft_consensus.cc:2393] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 4: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:55.478018  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:55.739553  7347 raft_consensus.cc:3060] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:55.732928  7386 raft_consensus.cc:3060] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:55.416666  7461 consensus_queue.cc:260] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:55.209028  7265 leader_election.cc:290] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:13:55.244735  7321 consensus_meta.cc:287] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 1.289s	user 0.006s	sys 0.001s
I20260709 12:13:55.735424  7116 leader_election.cc:290] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:55.739830  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:13:55.153278  5199 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47744 (request call id 1781) took 2189 ms (client timeout 1666 ms). Trace:
I20260709 12:13:55.776456  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:55.746451  5272 raft_consensus.cc:1240] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:13:55.355516  7354 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.747128  5834 raft_consensus.cc:2468] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
I20260709 12:13:55.239017  7452 leader_election.cc:290] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:55.799587  7381 leader_election.cc:290] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:55.801046  7396 leader_election.cc:290] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:55.781482  7359 consensus_queue.cc:1048] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 12:13:55.443712  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:55.748205  7460 leader_election.cc:290] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:55.110136  7405 consensus_queue.cc:237] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:55.120098  5833 raft_consensus.cc:1275] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:13:55.718611  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 49680.7us
W20260709 12:13:55.462535  7411 consensus_meta.cc:287] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.539s	user 0.009s	sys 0.000s
I20260709 12:13:55.749140  7356 raft_consensus.cc:493] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:55.732321  5266 rpcz_store.cc:276] 0709 12:13:53.955092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:53.988676 (+ 33584us) service_pool.cc:224] Handling call
0709 12:13:55.460001 (+1471325us) spinlock_profiling.cc:243] Waited 951 ms on lock 0x7b54000d3754. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:13:55.460129 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2187428096}
I20260709 12:13:55.109795  7326 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:55.812969  5166 leader_election.cc:304] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:55.284456  5265 raft_consensus.cc:1275] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 12:13:55.815092  5265 pending_rounds.cc:85] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929: Aborting all ops after (but not including) 6
I20260709 12:13:55.815382  5265 pending_rounds.cc:107] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 12:13:55.815613  5265 raft_consensus.cc:2889] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:13:55.126703  5165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:55.755169  7384 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.409161  6971 raft_consensus.cc:493] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.111791  7376 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:55.560927  5018 catalog_manager.cc:5697] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 3 to 5, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 5 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:55.819937  7396 raft_consensus.cc:2804] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:55.239032  7439 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.290683  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:55.829838  5125 raft_consensus.cc:2393] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 6: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:55.403147  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:55.830313  5124 raft_consensus.cc:3060] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:55.293746  5197 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47728 (request call id 1809) took 2278 ms (client timeout 1819 ms). Trace:
I20260709 12:13:55.105369  7375 raft_consensus.cc:515] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:13:55.755954  5088 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.012s	sys 0.016s
W20260709 12:13:55.840786  5088 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.012s	sys 0.017s
W20260709 12:13:55.833564  5197 rpcz_store.cc:269] 0709 12:13:53.014903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:53.055466 (+ 40563us) service_pool.cc:224] Handling call
0709 12:13:55.293545 (+2238079us) spinlock_profiling.cc:243] Waited 25.4 ms on lock 0x7b54001c9dd4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:13:55.293673 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58477312}
I20260709 12:13:55.841452  5125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59390 (request call id 437) took 1289 ms. Trace:
I20260709 12:13:55.841784  5088 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:55.728098  7475 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:55.732007  7465 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:55.758096  5237 leader_election.cc:304] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:55.755363  5163 leader_election.cc:304] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:55.841850  5125 rpcz_store.cc:276] 0709 12:13:54.551805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:55.290386 (+738581us) service_pool.cc:224] Handling call
0709 12:13:55.841367 (+550981us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:54.975976  7455 raft_consensus.cc:740] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:55.282346  7229 leader_election.cc:290] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:55.763584  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:55.746479  5240 leader_election.cc:304] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:13:55.763648  5804 leader_election.cc:304] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:55.765137  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:55.854012  7472 raft_consensus.cc:493] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.745270  7318 raft_consensus.cc:3060] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:55.738042  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:55.843101  7439 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:55.854662  7472 raft_consensus.cc:515] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:55.855469  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:55.856297  5835 raft_consensus.cc:2410] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:13:55.856544  7439 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:55.856729  7472 leader_election.cc:290] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:55.857587  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:55.858173  5835 raft_consensus.cc:2468] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 5.
I20260709 12:13:55.858989  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:55.860056  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:55.861014  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:55.767709  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:55.853230  7394 raft_consensus.cc:2804] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:55.758683  5122 rpcz_store.cc:276] 0709 12:13:54.502418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:54.560258 (+ 57840us) service_pool.cc:224] Handling call
0709 12:13:54.560677 (+   419us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:54.613803 (+ 53126us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:54.613837 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:54.635911 (+ 22074us) log.cc:844] Serialized 26 byte log entry
0709 12:13:55.295089 (+659178us) spinlock_profiling.cc:243] Waited 1.48 ms on lock 0x7b18003dd320. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3ab8e07 00007f84ec9139a9 00007f84e3ad569b 00007f84e3ad393f 00007f84e3ad5c02 00007f84e675d20b 00007f84e6762d23 00007f84e67630d1 00007f84e6b7ea0f
0709 12:13:55.740033 (+444944us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:13:55.740072 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:55.740133 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:55.740173 (+    40us) raft_consensus.cc:1685] finished
0709 12:13:55.740182 (+     9us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:55.740369 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52668,"raft.queue_time_us":100178,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":5236,"spinlock_wait_cycles":3401472,"thread_start_us":444771,"threads_started":1,"wal-append.queue_time_us":1059222}
I20260709 12:13:55.393821  7474 leader_election.cc:290] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:55.284070  7267 leader_election.cc:290] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:55.768486  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:55.747330  7466 raft_consensus.cc:697] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 5 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:55.862735  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:55.863212  7466 consensus_queue.cc:237] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:55.863795  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:55.864017  7375 leader_election.cc:290] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:13:55.738080  5089 connection.cc:256] RPC call timeout handler was delayed by -1.3722186899999542s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20440000000000003s for a response
W20260709 12:13:55.864697  5089 connection.cc:256] RPC call timeout handler was delayed by -1.2550797349997538s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16140000000000002s for a response
I20260709 12:13:55.865195  7463 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:55.239655  7148 leader_election.cc:290] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:13:55.763116  7423 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.714s	user 0.013s	sys 0.012s
I20260709 12:13:55.865685  7265 raft_consensus.cc:2804] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:13:55.866165  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:55.865654  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:55.866979  5832 raft_consensus.cc:2468] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 5.
I20260709 12:13:55.867275  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:55.867810  5838 raft_consensus.cc:3060] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:55.772912  5836 raft_consensus.cc:2468] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
W20260709 12:13:55.773038  5274 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.820s	user 0.030s	sys 0.081s
I20260709 12:13:55.390272  7470 leader_election.cc:290] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:13:55.773132  5194 rpcz_store.cc:269] 0709 12:13:52.958549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:53.605014 (+646465us) service_pool.cc:224] Handling call
0709 12:13:55.291540 (+1686526us) spinlock_profiling.cc:243] Waited 312 ms on lock 0x7b54003917d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:13:55.291648 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":717727616}
I20260709 12:13:55.869625  7267 raft_consensus.cc:2749] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:55.870332  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:55.865938  7480 leader_election.cc:290] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:55.870850  5194 raft_consensus.cc:3060] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:55.871165  7394 raft_consensus.cc:493] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:55.871565  7394 raft_consensus.cc:3060] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:55.868688  7265 raft_consensus.cc:493] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:55.749636  7467 leader_election.cc:290] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:55.764148  7250 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:55.873588  7265 raft_consensus.cc:3060] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:55.778946  5801 leader_election.cc:304] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:55.874291  7470 raft_consensus.cc:2749] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:13:55.874456  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 95557.4us
I20260709 12:13:55.780191  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:55.877697  5117 raft_consensus.cc:2468] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 6.
I20260709 12:13:55.759267  7256 raft_consensus.cc:515] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:55.762009  7341 raft_consensus.cc:515] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:55.793107  5198 raft_consensus.cc:2468] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 2.
W20260709 12:13:55.793013  5199 rpcz_store.cc:269] 0709 12:13:52.964165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:53.030111 (+ 65946us) service_pool.cc:224] Handling call
0709 12:13:55.152999 (+2122888us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b54001941d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:13:55.153185 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":826369792}
I20260709 12:13:55.210745  7476 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:55.778697  7319 raft_consensus.cc:3060] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:55.740373  7490 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:55.780614  7406 raft_consensus.cc:2804] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:55.797770  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:55.802901  5116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59390 (request call id 449) took 1101 ms. Trace:
I20260709 12:13:55.905710  5834 raft_consensus.cc:3060] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:55.905678  5116 rpcz_store.cc:276] 0709 12:13:54.701673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:55.443395 (+741722us) service_pool.cc:224] Handling call
0709 12:13:55.802855 (+359460us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:13:55.905058  5164 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.212.132:43539 timed out after 1.617s (SENT) [suppressed 19 similar messages]
I20260709 12:13:55.794991  7461 raft_consensus.cc:3060] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:55.792440  5119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59390 (request call id 442) took 1160 ms. Trace:
I20260709 12:13:55.096894  5830 raft_consensus.cc:1275] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:13:55.816061  7356 raft_consensus.cc:515] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:55.816735  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:55.793740  7321 raft_consensus.cc:515] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:55.817414  7358 raft_consensus.cc:3055] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:55.818429  5272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50932 (request call id 448) took 1870 ms. Trace:
I20260709 12:13:55.819069  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:55.816248  7323 raft_consensus.cc:493] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.820814  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:55.820976  7411 raft_consensus.cc:2749] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455) with higher term. Message: Invalid argument: T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 3. Current term is 4.
W20260709 12:13:55.822438  5165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:55.822815  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:55.291179  7330 leader_election.cc:290] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:55.827574  5018 catalog_manager.cc:5697] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:55.919736  5018 catalog_manager.cc:5697] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 1 to 4, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 4 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:55.920709  5018 catalog_manager.cc:5697] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 2 to 4, leader changed from bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 4 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:55.839148  5124 raft_consensus.cc:2468] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 3.
I20260709 12:13:55.842204  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:55.738662  7325 leader_election.cc:290] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:13:55.844708  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 89440.2us
I20260709 12:13:55.847800  5200 raft_consensus.cc:2468] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
I20260709 12:13:55.849478  5088 leader_election.cc:304] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:55.923995  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:13:55.924171  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 74801.8us
I20260709 12:13:55.924829  5267 raft_consensus.cc:2410] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:13:55.928222  5018 catalog_manager.cc:5697] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 2 to 4, leader changed from bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 4 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:55.845654  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:55.803627  7354 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:55.279141  7400 leader_election.cc:290] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:55.293356  7451 raft_consensus.cc:3055] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:55.930369  7451 raft_consensus.cc:740] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:55.931216  7451 consensus_queue.cc:260] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:55.932297  7451 raft_consensus.cc:3060] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:55.854425  7459 raft_consensus.cc:2804] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:55.933948  5018 catalog_manager.cc:5697] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 1 to 3, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 3 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } }
I20260709 12:13:55.770169  5123 raft_consensus.cc:2468] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 4.
I20260709 12:13:55.938247  5834 raft_consensus.cc:2410] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 6 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:13:55.744246  7485 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:55.269235  7324 raft_consensus.cc:493] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:55.854437  5273 raft_consensus.cc:3060] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:55.939934  5163 leader_election.cc:304] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:13:55.853011  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 95003.5us
W20260709 12:13:55.853933  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 107529us
W20260709 12:13:55.867981  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 104407us
I20260709 12:13:55.843081  7452 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:55.867400  7475 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:55.946241  7452 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:55.946942  7341 leader_election.cc:290] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:55.866891  7455 consensus_queue.cc:260] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:55.948354  7455 raft_consensus.cc:3060] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:55.774188  5192 raft_consensus.cc:2468] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 4.
I20260709 12:13:55.879312  5838 raft_consensus.cc:2468] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 6.
I20260709 12:13:55.950373  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:13:55.951786  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:55.879910  5194 raft_consensus.cc:2468] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 5.
I20260709 12:13:55.826767  7396 raft_consensus.cc:493] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:55.884967  5120 raft_consensus.cc:2468] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 3.
I20260709 12:13:55.885895  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:55.886556  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:55.852612  7486 raft_consensus.cc:2804] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:55.889698  5265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34674 (request call id 1818) took 2997 ms. Trace:
I20260709 12:13:55.918722  7386 raft_consensus.cc:493] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.894217  7465 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:55.895562  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:55.965636  5198 raft_consensus.cc:2468] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 2.
I20260709 12:13:55.966028  5198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47728 (request call id 1825) took 1011 ms. Trace:
I20260709 12:13:55.966236  5198 rpcz_store.cc:276] 0709 12:13:54.954491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:55.895254 (+940763us) service_pool.cc:224] Handling call
0709 12:13:55.965983 (+ 70729us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:55.898162  7376 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:55.901365  5191 raft_consensus.cc:2468] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 6.
I20260709 12:13:55.902240  5837 raft_consensus.cc:1240] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:55.903458  7256 leader_election.cc:290] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:55.825117  7384 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:55.826503  6971 raft_consensus.cc:515] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:55.791102  7388 raft_consensus.cc:697] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:55.907537  5193 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 5.
I20260709 12:13:55.911847  5272 rpcz_store.cc:276] 0709 12:13:53.947766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:54.024674 (+ 76908us) service_pool.cc:224] Handling call
0709 12:13:54.474270 (+449596us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:55.794989 (+1320719us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:55.818168 (+ 23179us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54000d2354. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:13:55.818359 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2925130624}
I20260709 12:13:55.913260  5266 raft_consensus.cc:2468] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 5.
I20260709 12:13:55.913396  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
W20260709 12:13:55.971297  5091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:55.917755  5274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50932 (request call id 462) took 1351 ms. Trace:
I20260709 12:13:55.971873  5274 rpcz_store.cc:276] 0709 12:13:54.566511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:54.579028 (+ 12517us) service_pool.cc:224] Handling call
0709 12:13:54.579444 (+   416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:54.952909 (+373465us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:13:54.953207 (+   298us) log.cc:844] Serialized 14 byte log entry
0709 12:13:55.869751 (+916544us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:55.869804 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:13:55.869852 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:55.917553 (+ 47701us) spinlock_profiling.cc:243] Waited 373 ms on lock 0x7b54002eefd4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:13:55.917593 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:55.917704 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":3936,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":4880,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":79,"spinlock_wait_cycles":858325888,"thread_start_us":915318,"threads_started":1,"wal-append.queue_time_us":777537}
I20260709 12:13:55.912748  7265 raft_consensus.cc:515] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:13:55.921656  5124 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40386 (request call id 1627) took 1962 ms (client timeout 1796 ms). Trace:
I20260709 12:13:55.921759  5197 raft_consensus.cc:2468] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 2.
I20260709 12:13:55.948635  7452 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:55.976805  5197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47728 (request call id 1828) took 1021 ms. Trace:
I20260709 12:13:55.862418  5835 raft_consensus.cc:2393] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 2: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:13:55.905405  7406 raft_consensus.cc:493] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:55.934948  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:55.960263  7459 raft_consensus.cc:697] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 5 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:55.910179  5831 raft_consensus.cc:1240] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 4 LEADER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:55.938490  5123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59390 (request call id 446) took 1251 ms. Trace:
I20260709 12:13:56.002074  5123 rpcz_store.cc:276] 0709 12:13:54.687452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:54.951351 (+263899us) service_pool.cc:224] Handling call
0709 12:13:55.938435 (+987084us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:56.002631  7325 raft_consensus.cc:493] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:55.941748  5804 leader_election.cc:304] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:56.003191  7325 raft_consensus.cc:515] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:55.943802  5237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:56.004184  7384 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:55.916874  7358 raft_consensus.cc:740] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:56.006278  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:56.007148  5198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47728 (request call id 1832) took 1050 ms. Trace:
I20260709 12:13:56.007459  5198 rpcz_store.cc:276] 0709 12:13:54.956514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:55.998332 (+1041818us) service_pool.cc:224] Handling call
0709 12:13:56.007092 (+  8760us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:56.008347  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:56.008626  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:56.009045  5120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59390 (request call id 445) took 1341 ms. Trace:
I20260709 12:13:55.903988  7476 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:55.910238  5119 rpcz_store.cc:276] 0709 12:13:54.629834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:55.026139 (+396305us) service_pool.cc:224] Handling call
0709 12:13:55.790138 (+763999us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:55.945047  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:55.945660  5240 leader_election.cc:304] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:13:55.956732  5273 raft_consensus.cc:2468] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
W20260709 12:13:55.957604  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 92443.4us
I20260709 12:13:55.957839  5117 raft_consensus.cc:2468] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 4.
I20260709 12:13:55.956056  7324 raft_consensus.cc:515] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:55.890655  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:55.959918  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:55.959538  5265 rpcz_store.cc:276] 0709 12:13:52.892434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:52.892543 (+   109us) service_pool.cc:224] Handling call
0709 12:13:52.906625 (+ 14082us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:55.816073 (+2909448us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:55.889432 (+ 73359us) spinlock_profiling.cc:243] Waited 2.38 s on lock 0x7b54000a7154. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:13:55.889630 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5467358976}
I20260709 12:13:55.959591  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:56.020370  5237 leader_election.cc:304] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:56.026033  5194 raft_consensus.cc:2393] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 3: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:56.026589  5194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47728 (request call id 1821) took 1073 ms. Trace:
I20260709 12:13:55.945672  5829 raft_consensus.cc:2393] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 6: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:55.926198  7326 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:55.962401  5163 leader_election.cc:304] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:55.966987  6862 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.030279  6862 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:55.959367  7486 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:55.917659  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:55.968178  7386 raft_consensus.cc:515] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:56.032142  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:56.000801  7351 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.961309  7396 raft_consensus.cc:3060] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:55.976430  5124 rpcz_store.cc:269] 0709 12:13:53.958911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:53.959153 (+   242us) service_pool.cc:224] Handling call
0709 12:13:55.402992 (+1443839us) spinlock_profiling.cc:243] Waited 3.73 ms on lock 0x7b5800002a98. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb890a0 00007f84ebb88984 00007f84e51036d4 00007f84e5103662
0709 12:13:55.921585 (+518593us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8568704}
I20260709 12:13:55.931656  7354 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:55.977236  5197 rpcz_store.cc:276] 0709 12:13:54.955249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:55.841954 (+886705us) service_pool.cc:224] Handling call
0709 12:13:55.976745 (+134791us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:55.930265  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:56.063467  5125 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 4.
I20260709 12:13:55.925485  7323 raft_consensus.cc:515] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:55.968956  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:55.967427  7341 raft_consensus.cc:2749] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:56.009269  5835 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 5.
I20260709 12:13:56.009622  7321 leader_election.cc:290] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:56.028487  7256 raft_consensus.cc:2804] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:56.073544  7256 raft_consensus.cc:493] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:56.073711  5266 raft_consensus.cc:2468] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 5.
I20260709 12:13:56.074030  7256 raft_consensus.cc:3060] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:56.074465  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:56.075192  5835 raft_consensus.cc:2393] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 2: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:13:56.075973  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:56.076500  5835 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 2.
W20260709 12:13:56.010224  5191 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47728 (request call id 1815) took 2993 ms (client timeout 1592 ms). Trace:
I20260709 12:13:56.033962  7358 consensus_queue.cc:260] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:13:56.077600  5191 rpcz_store.cc:269] 0709 12:13:53.016268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:53.021958 (+  5690us) service_pool.cc:224] Handling call
0709 12:13:56.010047 (+2988089us) spinlock_profiling.cc:243] Waited 2.88 s on lock 0x7b54001c98d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:13:56.010148 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6619682560}
I20260709 12:13:56.078521  7358 raft_consensus.cc:3060] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:56.078822  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:56.079857  5191 raft_consensus.cc:2410] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:13:56.080685  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:56.033922  7486 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:56.082553  5271 raft_consensus.cc:2393] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 5: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:13:56.083523  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:56.083904  5192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47728 (request call id 1823) took 1129 ms. Trace:
I20260709 12:13:56.084106  5271 raft_consensus.cc:2468] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 4.
I20260709 12:13:56.010492  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:56.085321  5274 raft_consensus.cc:2393] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 5: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:13:56.086102  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:56.086777  5274 raft_consensus.cc:2393] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 6: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:13:56.087474  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:56.088102  5274 raft_consensus.cc:2393] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 4: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:13:56.088758  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:56.011274  7265 leader_election.cc:290] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:55.939383  7439 raft_consensus.cc:2804] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:56.089740  7439 raft_consensus.cc:493] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:56.013108  5198 raft_consensus.cc:2393] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 2: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:56.090729  5198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47728 (request call id 1826) took 1136 ms. Trace:
I20260709 12:13:56.091048  5198 rpcz_store.cc:276] 0709 12:13:54.954729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.008086 (+1053357us) service_pool.cc:224] Handling call
0709 12:13:56.090673 (+ 82587us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:13:56.091686  5193 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41416 (request call id 397) took 3454 ms (client timeout 1685 ms). Trace:
W20260709 12:13:56.013193  5200 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47744 (request call id 1790) took 1464 ms (client timeout 1535 ms). Trace:
W20260709 12:13:56.091118  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:56.090193  7439 raft_consensus.cc:3060] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:56.014046  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:13:56.019227  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 77542.2us
I20260709 12:13:56.097764  5268 raft_consensus.cc:2468] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 4.
I20260709 12:13:56.098304  5804 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:56.098771  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:55.957904  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:56.101394  5838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46100 (request call id 786) took 1065 ms. Trace:
I20260709 12:13:56.101732  5838 rpcz_store.cc:276] 0709 12:13:55.035572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:55.957646 (+922074us) service_pool.cc:224] Handling call
0709 12:13:56.101301 (+143655us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:56.003078  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:56.018559  5836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46094 (request call id 681) took 1064 ms. Trace:
I20260709 12:13:56.102818  5836 rpcz_store.cc:276] 0709 12:13:54.954313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:54.954463 (+   150us) service_pool.cc:224] Handling call
0709 12:13:56.018348 (+1063885us) spinlock_profiling.cc:243] Waited 672 ms on lock 0x7b5400480b54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:13:56.018490 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1546486016}
W20260709 12:13:56.019598  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:56.019496  5117 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
new_leader_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:45628
I20260709 12:13:56.103890  5117 raft_consensus.cc:606] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Received request to transfer leadership to TS 9e794b72ed7640219f90ec4232363929
I20260709 12:13:56.104249  5117 raft_consensus.cc:614] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:56.013974  5120 rpcz_store.cc:276] 0709 12:13:54.667381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:55.108745 (+441364us) service_pool.cc:224] Handling call
0709 12:13:56.008893 (+900148us) spinlock_profiling.cc:243] Waited 81.2 ms on lock 0x7b540038ccd4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:13:56.008990 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":186806144}
W20260709 12:13:56.023895  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 78292.2us
I20260709 12:13:56.027024  5237 leader_election.cc:304] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:56.024178  5269 raft_consensus.cc:2468] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 4.
I20260709 12:13:56.026969  5194 rpcz_store.cc:276] 0709 12:13:54.953510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:55.959358 (+1005848us) service_pool.cc:224] Handling call
0709 12:13:56.026519 (+ 67161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:56.018747  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:55.998883  7406 raft_consensus.cc:3060] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:55.976483  5121 raft_consensus.cc:2468] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 5.
W20260709 12:13:56.127610  5121 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40402 (request call id 1852) took 3098 ms (client timeout 2149 ms). Trace:
W20260709 12:13:56.128029  5121 rpcz_store.cc:269] 0709 12:13:53.029548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:53.030460 (+   912us) service_pool.cc:224] Handling call
0709 12:13:55.116442 (+2085982us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b58007805d0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6b1f0aa 00007f84e6ba1447 00007f84e6bb9fe7 00007f84e6bbb7de 00007f84e6bc727c 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c
0709 12:13:56.127526 (+1011084us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":365872000}
W20260709 12:13:56.033416  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 71085.8us
I20260709 12:13:56.129884  5163 leader_election.cc:304] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:56.011376  7490 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:56.064667  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:56.034934  5122 raft_consensus.cc:2468] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 5.
I20260709 12:13:56.029472  5116 raft_consensus.cc:2468] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 3.
I20260709 12:13:56.065392  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:13:56.067667  7508 log.cc:927] Time spent T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:13:56.067498  7351 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:56.069254  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:56.156991  5197 raft_consensus.cc:2468] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 4.
I20260709 12:13:56.009829  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:56.157941  5267 raft_consensus.cc:2376] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 4. Re-sending same reply.
I20260709 12:13:56.071475  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:56.072540  5119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59390 (request call id 438) took 1520 ms. Trace:
I20260709 12:13:56.073004  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:56.084404  5192 rpcz_store.cc:276] 0709 12:13:54.954007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:55.478674 (+524667us) service_pool.cc:224] Handling call
0709 12:13:56.083724 (+605050us) spinlock_profiling.cc:243] Waited 44.2 ms on lock 0x7b54001388d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:13:56.083839 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":101635328}
I20260709 12:13:56.014619  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:56.077244  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:13:56.092276  5200 rpcz_store.cc:269] 0709 12:13:54.548592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:55.401902 (+853310us) service_pool.cc:224] Handling call
0709 12:13:56.013041 (+611139us) spinlock_profiling.cc:243] Waited 89.1 ms on lock 0x7b540041f354. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:13:56.013139 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":205042560}
I20260709 12:13:56.093941  5191 raft_consensus.cc:2468] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 6.
I20260709 12:13:56.094470  5274 raft_consensus.cc:2393] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 3: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
W20260709 12:13:56.092164  5193 rpcz_store.cc:269] 0709 12:13:52.637457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:52.637580 (+   123us) service_pool.cc:224] Handling call
0709 12:13:56.091496 (+3453916us) spinlock_profiling.cc:243] Waited 3.24 s on lock 0x7b5400037fd4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:13:56.091605 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7454333312}
I20260709 12:13:56.094926  5124 raft_consensus.cc:1240] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 5. Current term is 6. Ops: []
I20260709 12:13:56.093199  5088 leader_election.cc:304] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:13:56.032047  7345 raft_consensus.cc:2804] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:13:56.172569  5166 leader_election.cc:336] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Timed out: RequestConsensusVote RPC to 127.3.212.129:34443 timed out after 1.820s (SENT)
I20260709 12:13:56.106859  5273 raft_consensus.cc:2468] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 3.
I20260709 12:13:56.110049  5804 leader_election.cc:304] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:13:56.124573  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:56.174242  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:56.129118  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:56.174892  5273 raft_consensus.cc:2468] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
I20260709 12:13:56.090298  5831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46088 (request call id 393) took 4823 ms. Trace:
I20260709 12:13:56.063659  7384 raft_consensus.cc:2804] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:56.147442  5199 raft_consensus.cc:3060] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:56.028276  7388 consensus_queue.cc:237] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:56.147511  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:56.148607  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:56.149516  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:56.181020  5194 raft_consensus.cc:2393] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 6: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
W20260709 12:13:56.151368  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 124428us
I20260709 12:13:56.129165  5240 leader_election.cc:304] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:13:56.181439  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:56.181840  5237 leader_election.cc:304] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:56.066974  7325 leader_election.cc:290] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:55.948616  7330 raft_consensus.cc:2955] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:56.158798  5834 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:56.188441  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 59354.7us
I20260709 12:13:56.159907  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:56.199962  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:56.200501  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:56.034180  7400 raft_consensus.cc:2804] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:56.160822  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:56.200032  5240 leader_election.cc:304] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
W20260709 12:13:56.161463  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 254021us
I20260709 12:13:56.162928  5163 leader_election.cc:304] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:56.161083  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:56.205018  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:56.207980  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:56.208618  5117 raft_consensus.cc:2376] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 3. Re-sending same reply.
I20260709 12:13:56.209614  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:56.210276  5117 raft_consensus.cc:2468] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 3.
I20260709 12:13:56.211138  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:56.211851  5117 raft_consensus.cc:2393] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 6: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:13:56.170743  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:56.203261  7400 raft_consensus.cc:493] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:56.214036  7400 raft_consensus.cc:3060] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:56.161401  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:13:56.214272  7507 log.cc:927] Time spent T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 12:13:56.214071  5191 raft_consensus.cc:2468] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
I20260709 12:13:56.214690  5198 raft_consensus.cc:2468] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 4.
I20260709 12:13:56.215364  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:56.215540  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:56.216071  5198 raft_consensus.cc:2468] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:13:56.216116  5191 raft_consensus.cc:2393] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 3: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:56.172147  5124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59390 (request call id 439) took 1619 ms. Trace:
I20260709 12:13:56.217530  5124 rpcz_store.cc:276] 0709 12:13:54.552301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.070267 (+1517966us) service_pool.cc:224] Handling call
0709 12:13:56.070545 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:56.171917 (+101372us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:56.172103 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:56.217998  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:56.218566  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:56.218878  5191 raft_consensus.cc:2393] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 3: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:56.219249  5124 raft_consensus.cc:2393] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 3: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:13:56.219573  5191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47728 (request call id 1820) took 1266 ms. Trace:
I20260709 12:13:56.219975  5191 rpcz_store.cc:276] 0709 12:13:54.953193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.217762 (+1264569us) service_pool.cc:224] Handling call
0709 12:13:56.219515 (+  1753us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:56.197355  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:56.220975  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:56.221634  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:56.221833  5191 raft_consensus.cc:2368] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 7. Current term is 8.
I20260709 12:13:56.222492  5833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46100 (request call id 777) took 1189 ms. Trace:
I20260709 12:13:56.222950  5833 rpcz_store.cc:276] 0709 12:13:55.033294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.221343 (+1188049us) service_pool.cc:224] Handling call
0709 12:13:56.222431 (+  1088us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:56.223331  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:56.175995  5273 raft_consensus.cc:3060] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:13:56.226245  7476 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:13:56.176004  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 66016.4us
I20260709 12:13:56.176434  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:56.227661  5274 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 4.
I20260709 12:13:56.178346  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:13:56.178774  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 85678.6us
I20260709 12:13:56.202884  5267 raft_consensus.cc:2468] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
I20260709 12:13:56.182006  5116 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 3.
I20260709 12:13:56.171566  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:56.203811  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:56.229971  5804 leader_election.cc:304] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:56.152971  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:56.220050  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:56.147617  7175 raft_consensus.cc:493] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.152181  7354 raft_consensus.cc:2749] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:13:56.186549  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:56.216913  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:56.197732  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:56.198050  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:56.178045  5831 rpcz_store.cc:276] 0709 12:13:51.266757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.267950 (+  1193us) service_pool.cc:224] Handling call
0709 12:13:51.499188 (+231238us) spinlock_profiling.cc:243] Waited 3.42 ms on lock 0x7b58000b0498. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb9cfc0 00007f84ebb87929 00007f84ebb873d2 00007f84e50febd4
0709 12:13:52.806110 (+1306922us) spinlock_profiling.cc:243] Waited 7.27 ms on lock 0x7b58000b0498. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9eeee 000000000036eb39 00007f84ebb121e0 00007f84ebbdb0c4 00007f84ebbdb131 00007f84ebb9cfc0 00007f84ebb87929 00007f84ebb873d2 00007f84e50febd4
0709 12:13:52.806291 (+   181us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:56.015288 (+3208997us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:56.089996 (+ 74708us) spinlock_profiling.cc:243] Waited 3.1 s on lock 0x7b54003d2f54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:13:56.090206 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7162161536}
I20260709 12:13:56.201113  5832 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 4 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 4.
I20260709 12:13:56.200137  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:56.167115  7265 raft_consensus.cc:2804] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:56.360508  7460 raft_consensus.cc:493] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.361521  7175 raft_consensus.cc:515] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:56.362229  7386 leader_election.cc:290] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:56.167371  7503 consensus_queue.cc:1048] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.202s
I20260709 12:13:56.147845  7459 consensus_queue.cc:237] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:56.166133  5837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46094 (request call id 683) took 1210 ms. Trace:
I20260709 12:13:56.377656  5837 rpcz_store.cc:276] 0709 12:13:54.955977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:54.956123 (+   146us) service_pool.cc:224] Handling call
0709 12:13:54.956442 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:55.967092 (+1010650us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:56.165863 (+198771us) spinlock_profiling.cc:243] Waited 945 ms on lock 0x7b5400457254. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:13:56.166064 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2174639872}
I20260709 12:13:56.379151  5837 raft_consensus.cc:1240] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:56.379753  5837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46100 (request call id 782) took 1345 ms. Trace:
I20260709 12:13:56.197508  7321 raft_consensus.cc:2804] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:56.198308  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:56.384929  5120 raft_consensus.cc:2468] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 6.
I20260709 12:13:56.216969  7296 leader_election.cc:290] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:56.175441  7405 raft_consensus.cc:2804] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:56.205622  5801 leader_election.cc:304] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:56.173573  7345 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:56.187971  7490 raft_consensus.cc:2804] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:13:56.306878  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:56.202481  7463 raft_consensus.cc:2804] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:13:56.230865  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 68036.9us
I20260709 12:13:56.343971  5835 raft_consensus.cc:2468] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 3.
I20260709 12:13:56.401898  5835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46088 (request call id 404) took 1297 ms. Trace:
I20260709 12:13:56.205446  7384 raft_consensus.cc:697] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:56.344864  5200 raft_consensus.cc:2393] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 6: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:56.213644  5836 raft_consensus.cc:2468] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 4.
I20260709 12:13:56.401192  5163 leader_election.cc:304] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:56.403219  5836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46100 (request call id 787) took 1367 ms. Trace:
I20260709 12:13:56.403715  5836 rpcz_store.cc:276] 0709 12:13:55.035803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.147223 (+1111420us) service_pool.cc:224] Handling call
0709 12:13:56.403156 (+255933us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:56.256743  5273 raft_consensus.cc:1275] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:13:56.216913  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:56.345774  5832 raft_consensus.cc:1275] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 4 LEARNER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:13:56.402341  5835 rpcz_store.cc:276] 0709 12:13:55.104615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.172995 (+1068380us) service_pool.cc:224] Handling call
0709 12:13:56.401819 (+228824us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:56.343079  5191 raft_consensus.cc:2393] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 4: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:56.347572  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:56.406395  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:56.407358  5197 raft_consensus.cc:2468] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 4.
I20260709 12:13:56.293769  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:56.283653  5199 raft_consensus.cc:2468] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 5.
W20260709 12:13:56.276597  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 76617.9us
I20260709 12:13:56.411082  5163 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:56.349681  5831 raft_consensus.cc:1275] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:13:56.228436  7467 raft_consensus.cc:493] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:56.421520  5831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46100 (request call id 780) took 1387 ms. Trace:
I20260709 12:13:56.421404  7467 raft_consensus.cc:515] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:56.421923  5831 rpcz_store.cc:276] 0709 12:13:55.034136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.348936 (+1314800us) service_pool.cc:224] Handling call
0709 12:13:56.349311 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:56.421175 (+ 71864us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:56.421447 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:56.423470  7376 raft_consensus.cc:2804] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:56.423904  7467 leader_election.cc:290] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:56.423996  7376 raft_consensus.cc:697] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:56.425041  7376 consensus_queue.cc:237] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:56.425904  7406 raft_consensus.cc:515] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:56.213202  7256 raft_consensus.cc:515] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:56.352065  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:56.230156  5166 leader_election.cc:304] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
W20260709 12:13:56.447185  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 217061us
I20260709 12:13:56.275738  5838 raft_consensus.cc:2393] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 4: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:13:56.448709  5838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46100 (request call id 781) took 1414 ms. Trace:
I20260709 12:13:56.449061  5838 rpcz_store.cc:276] 0709 12:13:55.034373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.152735 (+1118362us) service_pool.cc:224] Handling call
0709 12:13:56.448638 (+295903us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:56.229504  5193 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
W20260709 12:13:56.353669  7513 log.cc:927] Time spent T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
W20260709 12:13:56.354051  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 125097us
I20260709 12:13:56.354533  7465 raft_consensus.cc:2749] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:13:56.159174  5007 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet c7bb7b814fea4a2488cc39d06fc90483 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 9e794b72ed7640219f90ec4232363929 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:56.373402  7324 leader_election.cc:290] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:56.373895  7356 leader_election.cc:290] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:56.375423  5830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46094 (request call id 687) took 1343 ms. Trace:
I20260709 12:13:56.375826  6971 leader_election.cc:290] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:56.213016  5834 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 3.
I20260709 12:13:56.230334  5194 raft_consensus.cc:2393] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 6: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:13:56.476666  5834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46100 (request call id 783) took 1441 ms. Trace:
I20260709 12:13:56.208662  5272 raft_consensus.cc:3060] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:56.477197  5834 rpcz_store.cc:276] 0709 12:13:55.034854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.031554 (+996700us) service_pool.cc:224] Handling call
0709 12:13:56.476601 (+445047us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:56.380074  5837 rpcz_store.cc:276] 0709 12:13:55.034610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.378601 (+1343991us) service_pool.cc:224] Handling call
0709 12:13:56.378953 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:56.379514 (+   561us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:56.379695 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:56.381170  7289 raft_consensus.cc:2804] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:13:56.385370  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 155478us
I20260709 12:13:56.184520  7475 raft_consensus.cc:2804] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:13:56.388880  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 183303us
I20260709 12:13:56.482308  5801 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:56.483687  5801 leader_election.cc:304] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:56.395131  7345 raft_consensus.cc:3060] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:56.230953  5124 raft_consensus.cc:2468] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 4.
W20260709 12:13:56.451786  7455 consensus_meta.cc:287] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.503s	user 0.006s	sys 0.005s
I20260709 12:13:56.167654  5119 rpcz_store.cc:276] 0709 12:13:54.552072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.068053 (+1515981us) service_pool.cc:224] Handling call
0709 12:13:56.068448 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:56.070758 (+  2310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:56.072133 (+  1375us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:56.072206 (+    73us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:13:56.072253 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:56.072334 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:56.072474 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:56.406836  5832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46100 (request call id 774) took 1374 ms. Trace:
I20260709 12:13:56.415904  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:56.416646  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:56.416461  7396 raft_consensus.cc:515] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:56.395191  7325 consensus_queue.cc:1048] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:13:56.417753  5833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46100 (request call id 779) took 1383 ms. Trace:
I20260709 12:13:56.516731  5833 rpcz_store.cc:276] 0709 12:13:55.033877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.231236 (+1197359us) service_pool.cc:224] Handling call
0709 12:13:56.417678 (+186442us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:56.395973  7405 raft_consensus.cc:493] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:56.517593  7405 raft_consensus.cc:3060] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:56.418839  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:56.521898  5191 raft_consensus.cc:2468] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 6.
I20260709 12:13:56.419538  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:56.420761  7471 raft_consensus.cc:2804] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:56.522975  5200 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
I20260709 12:13:56.217269  7486 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:56.361161  7460 raft_consensus.cc:515] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:56.384625  7321 raft_consensus.cc:493] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:56.448036  5166 leader_election.cc:304] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:56.388549  7386 raft_consensus.cc:493] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:56.402093  7354 raft_consensus.cc:2749] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:13:56.460005  5165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:56.514370  7296 raft_consensus.cc:2804] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:56.400357  7463 raft_consensus.cc:493] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
W20260709 12:13:56.439116  7347 consensus_meta.cc:287] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.649s	user 0.010s	sys 0.000s
I20260709 12:13:56.506470  5832 rpcz_store.cc:276] 0709 12:13:55.032534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.345090 (+1312556us) service_pool.cc:224] Handling call
0709 12:13:56.345435 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:56.406582 (+ 61147us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:56.406781 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:13:56.509370  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:56.446455  7490 raft_consensus.cc:697] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:56.456112  7423 raft_consensus.cc:2749] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:56.467900  7229 raft_consensus.cc:2804] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:13:56.503098  7394 consensus_meta.cc:287] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.631s	user 0.010s	sys 0.001s
I20260709 12:13:56.475840  7265 raft_consensus.cc:697] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 5 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:56.552635  7321 raft_consensus.cc:3060] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:56.476075  5830 rpcz_store.cc:276] 0709 12:13:55.032185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:55.032374 (+   189us) service_pool.cc:224] Handling call
0709 12:13:55.032777 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:55.910271 (+877494us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:56.375130 (+464859us) spinlock_profiling.cc:243] Waited 6.62 ms on lock 0x7b54004542d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:13:56.375346 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15230848}
I20260709 12:13:56.560354  7386 raft_consensus.cc:515] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:56.568287  7463 raft_consensus.cc:3060] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:56.561368  7354 raft_consensus.cc:2749] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:13:56.556095  6971 raft_consensus.cc:2804] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:13:56.541621  7319 consensus_meta.cc:287] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.648s	user 0.009s	sys 0.000s
I20260709 12:13:56.534868  7471 raft_consensus.cc:493] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:56.506435  7452 consensus_queue.cc:1048] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:13:56.526947  7358 consensus_queue.cc:1059] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:13:56.527300  7289 raft_consensus.cc:697] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 3 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:56.557857  7296 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:56.548748  5272 raft_consensus.cc:1275] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:13:56.560945  7486 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:56.572508  7389 raft_consensus.cc:493] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.578358  7229 raft_consensus.cc:697] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:56.596299  7265 consensus_queue.cc:237] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:13:56.613786  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 130156us
I20260709 12:13:56.603017  7358 raft_consensus.cc:3055] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:56.550238  7384 consensus_queue.cc:237] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:56.583034  7323 leader_election.cc:290] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:56.586879  6971 raft_consensus.cc:493] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:56.594728  7471 raft_consensus.cc:3060] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:56.577782  7394 raft_consensus.cc:515] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:56.600430  7296 raft_consensus.cc:3060] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:56.619812  7358 raft_consensus.cc:740] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:56.637074  7289 consensus_queue.cc:237] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:56.613906  7389 raft_consensus.cc:515] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:56.601635  7490 consensus_queue.cc:237] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:56.636166  7406 leader_election.cc:290] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:56.648056  7396 leader_election.cc:290] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:56.655754  7394 leader_election.cc:290] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:13:56.658175  7439 consensus_meta.cc:287] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.503s	user 0.009s	sys 0.000s
I20260709 12:13:56.658591  7439 raft_consensus.cc:515] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:56.660117  7439 leader_election.cc:290] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:13:56.457211  5007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 302406us
I20260709 12:13:56.406576  5117 raft_consensus.cc:3060] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:13:56.498200  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:56.510341  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
W20260709 12:13:56.550982  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 103034us
I20260709 12:13:56.527094  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:56.469879  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:56.457432  5088 leader_election.cc:304] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
W20260709 12:13:56.475063  5091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:56.516117  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:56.511456  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:56.507503  5197 raft_consensus.cc:2468] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 2.
I20260709 12:13:56.535027  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:56.559906  5196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:41400 (request call id 14) took 4215 ms. Trace:
I20260709 12:13:56.533192  5164 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:56.477355  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:13:56.558431  5237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:56.624186  6971 raft_consensus.cc:3060] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:56.691392  5195 raft_consensus.cc:2468] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 2.
I20260709 12:13:56.614835  5801 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:56.809855  5194 raft_consensus.cc:2468] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
I20260709 12:13:56.810825  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:56.811467  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:56.811954  5191 raft_consensus.cc:2393] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 3: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
W20260709 12:13:56.811873  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 354415us
I20260709 12:13:56.629251  7256 leader_election.cc:290] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:56.812673  7229 consensus_queue.cc:237] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:56.814033  7439 raft_consensus.cc:2804] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:56.814579  7439 raft_consensus.cc:493] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:56.814944  7439 raft_consensus.cc:3060] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:56.818250  7459 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.819355  7459 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:13:56.695778  5123 raft_consensus.cc:1240] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 4. Current term is 5. Ops: []
W20260709 12:13:56.694546  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:56.808943  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:56.649582  7358 consensus_queue.cc:260] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:56.662052  7521 log.cc:927] Time spent T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:13:56.736825  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:56.803112  5166 leader_election.cc:304] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:56.737686  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:13:56.834911  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 301683us
I20260709 12:13:56.835362  5124 raft_consensus.cc:2410] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:13:56.835937  7396 raft_consensus.cc:2804] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:56.836334  5194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 1779) took 3876 ms. Trace:
I20260709 12:13:56.837306  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:56.661471  7405 raft_consensus.cc:515] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:56.849960  5119 raft_consensus.cc:3060] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:56.852103  7405 leader_election.cc:290] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:56.661474  7400 raft_consensus.cc:515] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:56.853657  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:56.854067  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:56.855077  5830 raft_consensus.cc:2468] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 4.
I20260709 12:13:56.855764  5120 raft_consensus.cc:2468] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 3.
I20260709 12:13:56.856070  7400 leader_election.cc:290] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:56.843024  7386 leader_election.cc:290] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:56.845788  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:13:56.854271  5199 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47728 (request call id 1827) took 1899 ms (client timeout 1857 ms). Trace:
W20260709 12:13:56.857810  5199 rpcz_store.cc:269] 0709 12:13:54.954976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:55.886303 (+931327us) service_pool.cc:224] Handling call
0709 12:13:56.853871 (+967568us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b54003778d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:13:56.854070 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":435807616}
I20260709 12:13:56.860657  5199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41416 (request call id 400) took 3824 ms. Trace:
I20260709 12:13:56.839318  5166 leader_election.cc:304] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:56.861434  5199 rpcz_store.cc:276] 0709 12:13:53.035927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.859430 (+3823503us) service_pool.cc:224] Handling call
0709 12:13:56.859894 (+   464us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:56.860297 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:56.860332 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:56.860406 (+    74us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:56.860438 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:56.860492 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:56.860605 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:56.839905  7394 raft_consensus.cc:2804] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:13:56.837946  5122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40402 (request call id 1872) took 1292 ms. Trace:
I20260709 12:13:56.866343  5197 raft_consensus.cc:2393] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 6: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:56.836947  5194 rpcz_store.cc:276] 0709 12:13:52.960309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.834927 (+3874618us) service_pool.cc:224] Handling call
0709 12:13:56.835445 (+   518us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:56.835852 (+   407us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:56.835885 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:56.835953 (+    68us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:13:56.835990 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:56.836089 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:56.836221 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:56.864848  5122 rpcz_store.cc:276] 0709 12:13:55.545256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:55.863594 (+318338us) service_pool.cc:224] Handling call
0709 12:13:56.837424 (+973830us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b5400070b54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:13:56.837677 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":392093440}
I20260709 12:13:56.869048  7354 raft_consensus.cc:2749] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:56.853562  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:56.870604  5834 raft_consensus.cc:2410] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 6 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:13:56.872104  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:56.878053  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:56.879249  5831 raft_consensus.cc:2393] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 6: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:13:56.863420  7394 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:56.881004  7394 raft_consensus.cc:3060] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:13:56.881186  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:56.882903  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:56.883167  7405 consensus_queue.cc:1048] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:13:56.883915  5830 raft_consensus.cc:2393] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 4: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:56.883136  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:56.888417  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:56.889336  5832 raft_consensus.cc:2368] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 3. Current term is 4.
W20260709 12:13:56.891654  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 249435us
I20260709 12:13:56.893060  5801 leader_election.cc:304] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:56.894430  7525 raft_consensus.cc:2804] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:56.894585  5801 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:56.894945  7525 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:56.895383  7525 raft_consensus.cc:3060] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:56.910923  5122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40402 (request call id 1870) took 1366 ms. Trace:
W20260709 12:13:56.920399  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:56.911548  5122 rpcz_store.cc:276] 0709 12:13:55.544762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.909516 (+1364754us) service_pool.cc:224] Handling call
0709 12:13:56.910125 (+   609us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:56.910545 (+   420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:56.910569 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:56.910621 (+    52us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:13:56.910663 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:56.910713 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:56.910829 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:56.852128  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:56.880609  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:56.934528  5191 raft_consensus.cc:1240] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 1. Current term is 2. Ops: []
W20260709 12:13:57.003649  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:57.030360  5120 raft_consensus.cc:1240] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 2. Current term is 3. Ops: []
W20260709 12:13:57.037678  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 171059us
W20260709 12:13:57.052443  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:56.897060  5196 rpcz_store.cc:276] 0709 12:13:52.344812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:52.345258 (+   446us) service_pool.cc:224] Handling call
0709 12:13:56.559589 (+4214331us) spinlock_profiling.cc:243] Waited 3.62 s on lock 0x7b5400037fd4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc9735 00007f84ebb89d29 00007f84e51081d4 00007f84e5108162 00007f84e5108091 00007f84e510800c 00007f84e51072c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:13:56.559820 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8336975104}
W20260709 12:13:57.046521  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 207461us
I20260709 12:13:56.837635  7358 raft_consensus.cc:3060] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:57.054085  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:57.060374  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:57.053447  5838 raft_consensus.cc:2376] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 6. Re-sending same reply.
I20260709 12:13:57.059280  5120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40402 (request call id 1871) took 1510 ms. Trace:
I20260709 12:13:56.906154  7405 raft_consensus.cc:2804] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:57.061523  5191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 1777) took 4095 ms. Trace:
I20260709 12:13:57.063117  5120 rpcz_store.cc:276] 0709 12:13:55.545007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.934735 (+1389728us) service_pool.cc:224] Handling call
0709 12:13:57.030004 (+ 95269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:57.054787 (+ 24783us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:57.055005 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:57.092005  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:57.052006  7459 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:57.066617  5191 rpcz_store.cc:276] 0709 12:13:52.958199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.812856 (+3854657us) service_pool.cc:224] Handling call
0709 12:13:56.831927 (+ 19071us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:57.053124 (+221197us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:57.053368 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:57.098060  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:57.098949  5835 raft_consensus.cc:2468] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 3.
I20260709 12:13:56.911559  7396 raft_consensus.cc:697] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
W20260709 12:13:57.093461  5268 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.107s	sys 0.111s
I20260709 12:13:57.100059  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:57.103276  5194 raft_consensus.cc:1240] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:57.104367  7471 raft_consensus.cc:515] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:57.022660  7296 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:57.109999  5165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:57.112550  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:57.108479  5194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41416 (request call id 404) took 4071 ms. Trace:
I20260709 12:13:57.113502  5194 rpcz_store.cc:276] 0709 12:13:53.036900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.993439 (+3956539us) service_pool.cc:224] Handling call
0709 12:13:57.103041 (+109602us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:57.108234 (+  5193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:57.108421 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:57.105957  7175 leader_election.cc:290] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:13:57.116459  5268 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.915s	user 0.108s	sys 0.111s
I20260709 12:13:57.091080  5831 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
I20260709 12:13:57.069864  7405 raft_consensus.cc:493] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:57.130854  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:57.070915  7354 raft_consensus.cc:2749] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:13:57.065936  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:57.138896  5832 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 4 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 4.
I20260709 12:13:57.143150  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:57.144061  5832 raft_consensus.cc:2393] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 6: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:13:57.144979  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:57.155205  7323 raft_consensus.cc:493] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.156188  7323 raft_consensus.cc:515] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:57.142061  7405 raft_consensus.cc:3060] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:57.162706  5124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40386 (request call id 1630) took 1013 ms. Trace:
I20260709 12:13:57.165633  5124 rpcz_store.cc:276] 0709 12:13:56.149740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:57.053979 (+904239us) service_pool.cc:224] Handling call
0709 12:13:57.123688 (+ 69709us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:57.159061 (+ 35373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:57.159091 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:57.162484 (+  3393us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:13:57.162528 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:57.162581 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:57.162662 (+    81us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:57.164007  5834 raft_consensus.cc:2468] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 4.
I20260709 12:13:57.174576  5192 raft_consensus.cc:2393] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 4: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:57.175125  5835 raft_consensus.cc:2368] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 5. Current term is 6.
I20260709 12:13:57.155622  5830 raft_consensus.cc:2468] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
I20260709 12:13:57.181154  5194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41416 (request call id 408) took 3801 ms. Trace:
I20260709 12:13:57.161154  7229 raft_consensus.cc:493] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.183521  7384 raft_consensus.cc:493] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.167260  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:57.181931  5194 rpcz_store.cc:276] 0709 12:13:53.377495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:57.122313 (+3744818us) service_pool.cc:224] Handling call
0709 12:13:57.152047 (+ 29734us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:57.173610 (+ 21563us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:57.173638 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:57.177340 (+  3702us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:57.177402 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:57.177460 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:57.177569 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:57.174942  7175 raft_consensus.cc:493] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.205672  5196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41416 (request call id 409) took 3828 ms. Trace:
I20260709 12:13:57.208279  5196 rpcz_store.cc:276] 0709 12:13:53.377757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:57.151469 (+3773712us) service_pool.cc:224] Handling call
0709 12:13:57.181565 (+ 30096us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:57.205285 (+ 23720us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:57.205311 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:57.205401 (+    90us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:57.205434 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:57.205503 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:57.205618 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:57.212633  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:13:57.214661  5007 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet c7bb7b814fea4a2488cc39d06fc90483 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 9e794b72ed7640219f90ec4232363929 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:57.218499  5196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41416 (request call id 410) took 3744 ms. Trace:
I20260709 12:13:57.212834  5120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40386 (request call id 1637) took 1044 ms. Trace:
I20260709 12:13:57.218823  5274 raft_consensus.cc:2468] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 8.
I20260709 12:13:57.219257  5120 rpcz_store.cc:276] 0709 12:13:56.168514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:57.123702 (+955188us) service_pool.cc:224] Handling call
0709 12:13:57.193584 (+ 69882us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:57.212469 (+ 18885us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:13:57.212502 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:57.212578 (+    76us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:13:57.212610 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:57.212663 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:57.212780 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:57.210229  7229 raft_consensus.cc:515] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:57.222503  7229 leader_election.cc:290] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:57.205291  5117 raft_consensus.cc:2468] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 4.
I20260709 12:13:57.218936  5196 rpcz_store.cc:276] 0709 12:13:53.474567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:57.217433 (+3742866us) service_pool.cc:224] Handling call
0709 12:13:57.217835 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:57.218120 (+   285us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:57.218147 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:57.218202 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:13:57.218252 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:57.218301 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:57.218408 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:57.224208  5119 raft_consensus.cc:2468] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 4.
I20260709 12:13:57.225095  5119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40386 (request call id 1628) took 1076 ms. Trace:
I20260709 12:13:57.225598  5196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 1783) took 3197 ms. Trace:
I20260709 12:13:57.225548  5119 rpcz_store.cc:276] 0709 12:13:56.149175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.510002 (+360827us) service_pool.cc:224] Handling call
0709 12:13:57.224983 (+714981us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:57.223184  5832 raft_consensus.cc:1240] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:57.226723  5117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40402 (request call id 1880) took 1117 ms. Trace:
I20260709 12:13:57.227104  5117 rpcz_store.cc:276] 0709 12:13:56.109288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.216677 (+107389us) service_pool.cc:224] Handling call
0709 12:13:57.226640 (+1009963us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:13:57.205597  5071 auto_rebalancer.cc:893] Removing replace marker failed: Replica dd62e75bd3ed4ed28f1fb5955d650808 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:57.230971  7405 raft_consensus.cc:515] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:57.234287  7405 leader_election.cc:290] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:57.234470  7389 leader_election.cc:290] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:13:57.241006  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:57.231310  7351 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:57.244365  5198 raft_consensus.cc:1275] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:57.245077  5198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 1784) took 3212 ms. Trace:
I20260709 12:13:57.245368  5198 rpcz_store.cc:276] 0709 12:13:54.033197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:57.243441 (+3210244us) service_pool.cc:224] Handling call
0709 12:13:57.243848 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:57.244832 (+   984us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:57.245021 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:57.226083  5196 rpcz_store.cc:276] 0709 12:13:54.028320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:57.224269 (+3195949us) service_pool.cc:224] Handling call
0709 12:13:57.224702 (+   433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:57.225207 (+   505us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:57.225232 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:57.225331 (+    99us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:57.225360 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:57.225435 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:57.225541 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:57.254577  5196 raft_consensus.cc:1275] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:13:57.255234  5196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 1786) took 3221 ms. Trace:
I20260709 12:13:57.255537  5196 rpcz_store.cc:276] 0709 12:13:54.033750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:57.253712 (+3219962us) service_pool.cc:224] Handling call
0709 12:13:57.254111 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:57.254974 (+   863us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:57.255177 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:57.257097  5196 raft_consensus.cc:1240] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 LEADER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
W20260709 12:13:57.231197  5071 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 756d32b8c4d642a6955517f66ac5bb45 already in progress
W20260709 12:13:57.257895  5071 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 756d32b8c4d642a6955517f66ac5bb45 already in progress
I20260709 12:13:57.260308  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:57.208498  7384 raft_consensus.cc:515] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:57.262650  5123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59390 (request call id 441) took 2649 ms. Trace:
I20260709 12:13:57.263033  5123 rpcz_store.cc:276] 0709 12:13:54.612790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.103218 (+1490428us) service_pool.cc:224] Handling call
0709 12:13:56.103543 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:56.860827 (+757284us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:57.262315 (+401488us) spinlock_profiling.cc:243] Waited 591 ms on lock 0x7b540038d1d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:13:57.262555 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1360237824}
I20260709 12:13:57.263701  7384 leader_election.cc:290] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:57.261087  5271 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
I20260709 12:13:57.269919  5196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 1787) took 3235 ms. Trace:
I20260709 12:13:57.270722  5196 rpcz_store.cc:276] 0709 12:13:54.033987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:57.256385 (+3222398us) service_pool.cc:224] Handling call
0709 12:13:57.256809 (+   424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:57.266943 (+ 10134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:57.269779 (+  2836us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:57.268959  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:57.281440  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:57.282819  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:57.225216  6971 raft_consensus.cc:515] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:57.285342  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:57.286207  7323 leader_election.cc:290] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:57.287127  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
W20260709 12:13:57.287560  5829 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46094 (request call id 682) took 2332 ms (client timeout 1614 ms). Trace:
I20260709 12:13:57.278198  5271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34674 (request call id 1845) took 1161 ms. Trace:
I20260709 12:13:57.288880  5271 rpcz_store.cc:276] 0709 12:13:56.115050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:57.259862 (+1144812us) service_pool.cc:224] Handling call
0709 12:13:57.276021 (+ 16159us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:13:57.288010  5829 rpcz_store.cc:269] 0709 12:13:54.955481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:54.957214 (+  1733us) service_pool.cc:224] Handling call
0709 12:13:55.477705 (+520491us) spinlock_profiling.cc:243] Waited 5.83 ms on lock 0x7b58000b0498. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb890a0 00007f84ebb88984 00007f84e51036d4 00007f84e5103662
0709 12:13:57.287073 (+1809368us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b54004f24d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:13:57.287355 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":358746240}
I20260709 12:13:57.283783  5191 raft_consensus.cc:2393] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 4: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:57.292658  5192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47728 (request call id 1842) took 1341 ms. Trace:
I20260709 12:13:57.293303  5198 raft_consensus.cc:1240] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:57.275718  7396 consensus_queue.cc:237] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:57.325567  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:57.300173  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:57.276108  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:57.301786  5192 rpcz_store.cc:276] 0709 12:13:55.951502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.453769 (+502267us) service_pool.cc:224] Handling call
0709 12:13:57.292375 (+838606us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b540003a554. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:13:57.292589 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":742626176}
I20260709 12:13:57.278595  7471 leader_election.cc:290] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:57.286242  6971 leader_election.cc:290] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:57.225878  7175 raft_consensus.cc:515] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:57.337428  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:57.346120  6862 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:57.345690  5194 raft_consensus.cc:2376] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 5. Re-sending same reply.
I20260709 12:13:57.304529  7323 raft_consensus.cc:493] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
W20260709 12:13:57.358662  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 203433us
I20260709 12:13:57.359877  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:57.344961  5830 raft_consensus.cc:2468] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 4.
I20260709 12:13:57.361560  5196 raft_consensus.cc:1240] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:13:57.352927  7296 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:57.370445  5196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 1789) took 3217 ms. Trace:
I20260709 12:13:57.370865  5196 rpcz_store.cc:276] 0709 12:13:54.147880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:57.334773 (+3186893us) service_pool.cc:224] Handling call
0709 12:13:57.357651 (+ 22878us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:57.364671 (+  7020us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:57.364899 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:13:57.362954  7439 consensus_meta.cc:287] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.548s	user 0.010s	sys 0.004s
I20260709 12:13:57.377666  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:57.360139  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:57.351954  7394 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:57.396497  5192 raft_consensus.cc:1275] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:57.398069  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:57.397187  5192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47728 (request call id 1822) took 2443 ms. Trace:
I20260709 12:13:57.399195  5192 rpcz_store.cc:276] 0709 12:13:54.953768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:57.347085 (+2393317us) service_pool.cc:224] Handling call
0709 12:13:57.393542 (+ 46457us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:57.396945 (+  3403us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:57.397130 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:13:57.393775  7475 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.828s	user 0.005s	sys 0.013s
W20260709 12:13:57.401185  7475 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.878s	user 0.006s	sys 0.013s
I20260709 12:13:57.401362  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:57.406097  7475 raft_consensus.cc:697] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 4 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:13:57.407039  5271 raft_consensus.cc:1240] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:57.384474  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:57.407508  7475 consensus_queue.cc:237] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:57.413691  5194 raft_consensus.cc:1240] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:13:57.407183  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:57.397539  5831 raft_consensus.cc:3060] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:57.416239  5194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47728 (request call id 1830) took 2460 ms. Trace:
I20260709 12:13:57.424782  5194 rpcz_store.cc:276] 0709 12:13:54.956000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:57.357512 (+2401512us) service_pool.cc:224] Handling call
0709 12:13:57.404404 (+ 46892us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:57.415924 (+ 11520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:57.416165 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:57.429881  5192 raft_consensus.cc:2393] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 2: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:57.419282  5122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40402 (request call id 1882) took 1304 ms. Trace:
I20260709 12:13:57.431340  5191 raft_consensus.cc:2410] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 5 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
W20260709 12:13:57.418133  7525 consensus_meta.cc:287] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.522s	user 0.008s	sys 0.004s
W20260709 12:13:57.434783  7330 consensus_meta.cc:287] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 1.025s	user 0.000s	sys 0.017s
I20260709 12:13:57.381114  7439 raft_consensus.cc:515] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:13:57.443225  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 79226.8us
W20260709 12:13:57.449326  7345 consensus_meta.cc:287] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.918s	user 0.006s	sys 0.010s
I20260709 12:13:57.449736  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:57.449419  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
W20260709 12:13:57.451758  7535 log.cc:927] Time spent T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:13:57.452185  5197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41416 (request call id 401) took 4416 ms. Trace:
I20260709 12:13:57.452656  5197 rpcz_store.cc:276] 0709 12:13:53.036187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.934921 (+3898734us) service_pool.cc:224] Handling call
0709 12:13:57.100078 (+165157us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:57.124152 (+ 24074us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:13:57.342310 (+218158us) log.cc:844] Serialized 14 byte log entry
0709 12:13:57.451793 (+109483us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:57.451850 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:57.451929 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:57.451997 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:57.452108 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":247911,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"thread_start_us":241450,"threads_started":2}
I20260709 12:13:57.454113  7394 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:57.454249  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:13:57.430361  7463 consensus_meta.cc:287] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.748s	user 0.007s	sys 0.007s
I20260709 12:13:57.455130  5197 raft_consensus.cc:1275] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:13:57.446152  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:57.455883  5197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41416 (request call id 419) took 1528 ms. Trace:
I20260709 12:13:57.446712  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:57.456322  5197 rpcz_store.cc:276] 0709 12:13:55.927144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:57.454466 (+1527322us) service_pool.cc:224] Handling call
0709 12:13:57.454838 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:57.455629 (+   791us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:57.455831 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:57.455750  5268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50932 (request call id 477) took 1438 ms. Trace:
I20260709 12:13:57.416453  7323 raft_consensus.cc:515] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:57.427875  7400 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:57.465022  5196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47728 (request call id 1831) took 2504 ms. Trace:
I20260709 12:13:57.466578  5196 rpcz_store.cc:276] 0709 12:13:54.956250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:57.381895 (+2425645us) service_pool.cc:224] Handling call
0709 12:13:57.418653 (+ 36758us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:57.448005 (+ 29352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:57.448038 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:57.460838 (+ 12800us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:13:57.460879 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:57.460938 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:57.461049 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:57.469460  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:57.470147  5117 raft_consensus.cc:2468] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 3.
I20260709 12:13:57.469095  7463 raft_consensus.cc:515] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:57.472730  5267 raft_consensus.cc:2393] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 6: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:13:57.474746  5166 leader_election.cc:304] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:57.475073  5088 leader_election.cc:304] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:13:57.475845  7400 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:57.430342  5122 rpcz_store.cc:276] 0709 12:13:56.109750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:57.026344 (+916594us) service_pool.cc:224] Handling call
0709 12:13:57.026818 (+   474us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:57.027241 (+   423us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:13:57.122561 (+ 95320us) log.cc:844] Serialized 14 byte log entry
0709 12:13:57.397997 (+275436us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:57.398053 (+    56us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:13:57.405769 (+  7716us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:57.405843 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:57.414239 (+  8396us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16708,"prepare.queue_time_us":184233,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":2992,"spinlock_wait_cycles":2032000,"thread_start_us":323773,"threads_started":3,"wal-append.queue_time_us":230999}
I20260709 12:13:57.462358  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:57.438755  7525 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:57.476259  7463 leader_election.cc:290] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:57.459685  5268 rpcz_store.cc:276] 0709 12:13:56.008672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.185294 (+176622us) service_pool.cc:224] Handling call
0709 12:13:56.185650 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:56.185840 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:13:57.149711 (+963871us) log.cc:844] Serialized 14 byte log entry
0709 12:13:57.393970 (+244259us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:57.403930 (+  9960us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:57.430005 (+ 26075us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:57.444869 (+ 14864us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:57.446622 (+  1753us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":655748,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":79,"raft.queue_time_us":4866,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":29999,"thread_start_us":1109015,"threads_started":2,"wal-append.queue_time_us":280746}
I20260709 12:13:57.477584  7394 raft_consensus.cc:2804] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:57.491236  7548 raft_consensus.cc:2804] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:57.492331  5123 raft_consensus.cc:2393] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 5: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
W20260709 12:13:57.512180  7538 log.cc:927] Time spent T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:13:57.513077  5118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40402 (request call id 1861) took 3014 ms. Trace:
I20260709 12:13:57.513638  5118 rpcz_store.cc:276] 0709 12:13:54.498349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:54.503816 (+  5467us) service_pool.cc:224] Handling call
0709 12:13:55.394238 (+890422us) spinlock_profiling.cc:243] Waited 8.99 ms on lock 0x7b5800002a98. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb9cfc0 00007f84ebb87929 00007f84ebb873d2 00007f84e50febd4
0709 12:13:55.394482 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:56.068322 (+673840us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:56.068353 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:56.068414 (+    61us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:13:56.068446 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:57.512448 (+1444002us) spinlock_profiling.cc:243] Waited 671 ms on lock 0x7b540038dbd4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:13:57.512528 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:57.512789 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1563932928}
I20260709 12:13:57.514542  5836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46088 (request call id 418) took 1976 ms. Trace:
I20260709 12:13:57.514961  5836 rpcz_store.cc:276] 0709 12:13:55.538222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.404549 (+866327us) service_pool.cc:224] Handling call
0709 12:13:56.404936 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:56.405334 (+   398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:56.405366 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:56.408504 (+  3138us) log.cc:844] Serialized 26 byte log entry
0709 12:13:57.046508 (+638004us) spinlock_profiling.cc:243] Waited 4.45 ms on lock 0x7b18003b3140. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3ab8e07 00007f84ec9139a9 00007f84e3ad569b 00007f84e3ad393f 00007f84e3ad5c02 00007f84e675d20b 00007f84e6762d23 00007f84e67630d1 00007f84e6b7ea0f
0709 12:13:57.201978 (+155470us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:57.372133 (+170155us) log.cc:844] Serialized 14 byte log entry
0709 12:13:57.380943 (+  8810us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:57.400736 (+ 19793us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:57.514106 (+113370us) raft_consensus.cc:1685] finished
0709 12:13:57.514217 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:57.514363 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6028,"prepare.queue_time_us":231812,"raft.queue_time_us":25474,"raft.run_cpu_time_us":299,"raft.run_wall_time_us":35313,"spinlock_wait_cycles":26829440,"thread_start_us":283155,"threads_started":2,"wal-append.queue_time_us":939192}
I20260709 12:13:57.517526  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:13:57.519150  7533 log.cc:927] Time spent T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 12:13:57.521771  5198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 1785) took 3488 ms. Trace:
I20260709 12:13:57.522267  5198 rpcz_store.cc:276] 0709 12:13:54.033494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:57.246124 (+3212630us) service_pool.cc:224] Handling call
0709 12:13:57.293088 (+ 46964us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:57.324499 (+ 31411us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:57.521512 (+197013us) spinlock_profiling.cc:243] Waited 46.6 ms on lock 0x7b540003a550. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc28ad 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:13:57.521670 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":107081088}
W20260709 12:13:57.524220  7539 log.cc:927] Time spent T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 12:13:57.525570  7175 leader_election.cc:290] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:57.525786  5196 raft_consensus.cc:1275] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:13:57.449884  7345 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:57.526437  5196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 1793) took 1557 ms. Trace:
I20260709 12:13:57.526767  5196 rpcz_store.cc:276] 0709 12:13:55.969196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:57.468609 (+1499413us) service_pool.cc:224] Handling call
0709 12:13:57.493747 (+ 25138us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:57.526147 (+ 32400us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:57.526382 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:13:57.564394  5165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:57.570518  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:13:57.532696  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 53709.2us
I20260709 12:13:57.575670  5194 raft_consensus.cc:1240] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 5. Current term is 6. Ops: [5.8-5.8]
W20260709 12:13:57.537101  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:57.577565  5194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 1791) took 2464 ms. Trace:
I20260709 12:13:57.580375  5194 rpcz_store.cc:276] 0709 12:13:55.113422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:57.446721 (+2333299us) service_pool.cc:224] Handling call
0709 12:13:57.478514 (+ 31793us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:57.577328 (+ 98814us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:57.577515 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:57.579146  5838 raft_consensus.cc:2468] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 6.
I20260709 12:13:57.580397  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:57.495033  7394 raft_consensus.cc:493] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:57.526855  5265 raft_consensus.cc:2468] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:13:57.573959  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:57.588150  5197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47728 (request call id 1837) took 1637 ms. Trace:
I20260709 12:13:57.588565  5197 rpcz_store.cc:276] 0709 12:13:55.950275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:57.478090 (+1527815us) service_pool.cc:224] Handling call
0709 12:13:57.585780 (+107690us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:57.587809 (+  2029us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:57.587836 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:57.587883 (+    47us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:13:57.587924 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:57.587984 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:57.588097 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:13:57.530273  7321 consensus_meta.cc:287] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.946s	user 0.010s	sys 0.006s
I20260709 12:13:57.569250  7475 consensus_queue.cc:1059] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:13:57.592792  5832 raft_consensus.cc:2468] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 4.
I20260709 12:13:57.593751  7528 raft_consensus.cc:3055] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:13:57.495353  7548 raft_consensus.cc:493] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:57.594689  7548 raft_consensus.cc:3060] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:57.595559  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:57.590530  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:57.594226  7528 raft_consensus.cc:740] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:13:57.600893  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:57.607142  5830 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 5.
I20260709 12:13:57.594027  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:57.608361  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:57.609110  5119 raft_consensus.cc:3060] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:57.610147  5116 raft_consensus.cc:1275] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:13:57.572893  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:57.610344  5199 raft_consensus.cc:1275] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:13:57.610867  5833 raft_consensus.cc:2468] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 3.
I20260709 12:13:57.611835  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:57.612690  5123 raft_consensus.cc:2393] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 5: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:13:57.613025  5197 raft_consensus.cc:1240] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:57.613677  5197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 1797) took 1593 ms. Trace:
I20260709 12:13:57.614157  5122 raft_consensus.cc:1275] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:13:57.614015  5197 rpcz_store.cc:276] 0709 12:13:56.020474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:57.612462 (+1591988us) service_pool.cc:224] Handling call
0709 12:13:57.612832 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:57.613440 (+   608us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:57.613616 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:57.615468  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:57.616257  5117 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 5.
I20260709 12:13:57.528698  7439 leader_election.cc:290] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:57.617465  5194 raft_consensus.cc:1240] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:57.617657  5192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41416 (request call id 416) took 1701 ms. Trace:
I20260709 12:13:57.592680  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:57.601727  7528 consensus_queue.cc:260] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:57.618638  5834 raft_consensus.cc:2468] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 5.
I20260709 12:13:57.605284  7525 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:57.606055  7400 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:57.617970  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:57.598285  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:57.620206  5837 raft_consensus.cc:2410] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:13:57.599232  5191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41416 (request call id 418) took 1682 ms. Trace:
I20260709 12:13:57.621795  5194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 1800) took 1527 ms. Trace:
W20260709 12:13:57.612783  5265 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34674 (request call id 1852) took 1496 ms (client timeout 1725 ms). Trace:
I20260709 12:13:57.622079  5191 rpcz_store.cc:276] 0709 12:13:55.916589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:57.448810 (+1532221us) service_pool.cc:224] Handling call
0709 12:13:57.478851 (+ 30041us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:57.589779 (+110928us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:57.589807 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:57.598931 (+  9124us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:13:57.598977 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:57.599046 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:57.599171 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:13:57.623121  5265 rpcz_store.cc:269] 0709 12:13:56.116799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.150942 (+ 34143us) service_pool.cc:224] Handling call
0709 12:13:57.612593 (+1461651us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b540036c4d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:13:57.612711 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2985202944}
I20260709 12:13:57.618003  5192 rpcz_store.cc:276] 0709 12:13:55.916115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:57.446873 (+1530758us) service_pool.cc:224] Handling call
0709 12:13:57.585548 (+138675us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:57.617312 (+ 31764us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:57.617342 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:57.617408 (+    66us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:13:57.617443 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:57.617499 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:57.617604 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":925,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":100}
I20260709 12:13:57.588675  7394 raft_consensus.cc:3060] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:57.626801  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:57.619124  7528 raft_consensus.cc:3060] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:57.627417  7321 raft_consensus.cc:515] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:57.659807  5269 raft_consensus.cc:1240] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:57.622118  5194 rpcz_store.cc:276] 0709 12:13:56.094249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:57.597741 (+1503492us) service_pool.cc:224] Handling call
0709 12:13:57.617254 (+ 19513us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:57.621565 (+  4311us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:57.621736 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:13:57.661955  5091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:57.658099  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 1.24583e+06us
I20260709 12:13:57.665830  5836 raft_consensus.cc:2393] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 2: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:13:57.665026  5198 raft_consensus.cc:1240] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 LEADER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:57.669967  5198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47728 (request call id 1844) took 1465 ms. Trace:
I20260709 12:13:57.670320  5198 rpcz_store.cc:276] 0709 12:13:56.204672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:57.623055 (+1418383us) service_pool.cc:224] Handling call
0709 12:13:57.662328 (+ 39273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:57.669702 (+  7374us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:57.669908 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:57.657994  7323 leader_election.cc:290] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:57.673908  5121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40386 (request call id 1639) took 1484 ms. Trace:
I20260709 12:13:57.674331  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:57.678283  5163 leader_election.cc:304] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:57.680934  5163 leader_election.cc:304] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:57.681958  7396 raft_consensus.cc:2749] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:57.676985  7321 leader_election.cc:290] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:57.683408  5119 raft_consensus.cc:2468] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 5.
I20260709 12:13:57.674592  5121 rpcz_store.cc:276] 0709 12:13:56.187218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:57.131640 (+944422us) service_pool.cc:224] Handling call
0709 12:13:57.196409 (+ 64769us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:57.297953 (+101544us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:13:57.426740 (+128787us) log.cc:844] Serialized 14 byte log entry
0709 12:13:57.671362 (+244622us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:57.671411 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:13:57.671448 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:57.671516 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:57.671636 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":49553,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":6369,"raft.queue_time_us":87,"spinlock_wait_cycles":1853824,"thread_start_us":268336,"threads_started":2}
I20260709 12:13:57.696018  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:57.696915  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:57.697822  5117 raft_consensus.cc:2410] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:13:57.697871  5123 raft_consensus.cc:1275] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:57.698443  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:57.699024  5122 raft_consensus.cc:2376] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 4. Re-sending same reply.
I20260709 12:13:57.696440  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:57.700292  5118 raft_consensus.cc:3060] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:13:57.671578  7358 raft_consensus.cc:493] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:57.701792  7358 raft_consensus.cc:515] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:57.675416  7460 leader_election.cc:290] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:57.704007  5116 raft_consensus.cc:2468] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 5.
W20260709 12:13:57.707695  7536 log.cc:927] Time spent T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.329s	user 0.002s	sys 0.000s
I20260709 12:13:57.708109  7396 raft_consensus.cc:2749] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:57.712951  5193 raft_consensus.cc:1240] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:13:57.715649  7553 raft_consensus.cc:493] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.716317  7553 raft_consensus.cc:515] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:57.713948  5831 raft_consensus.cc:2468] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 4.
I20260709 12:13:57.718559  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:13:57.725819  5088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:57.726235  5122 raft_consensus.cc:1275] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:13:57.726639  5122 pending_rounds.cc:85] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting all ops after (but not including) 3
I20260709 12:13:57.726996  5122 pending_rounds.cc:107] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:13:57.727272  5122 raft_consensus.cc:2889] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:57.727532  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:57.728621  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:57.725867  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:57.730194  7358 leader_election.cc:290] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:57.728708  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:57.731215  5834 raft_consensus.cc:2393] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 3: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:13:57.731962  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:13:57.732698  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:57.733668  5831 raft_consensus.cc:2468] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 6.
I20260709 12:13:57.740542  5193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41416 (request call id 407) took 4337 ms. Trace:
I20260709 12:13:57.742831  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:57.743633  5832 raft_consensus.cc:2468] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 2.
I20260709 12:13:57.744717  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:57.745357  5198 raft_consensus.cc:2468] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
I20260709 12:13:57.734246  7557 raft_consensus.cc:493] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.746598  7557 raft_consensus.cc:515] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:57.747599  7553 leader_election.cc:290] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:57.750170  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
W20260709 12:13:57.750862  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 96748.4us
I20260709 12:13:57.741051  5193 rpcz_store.cc:276] 0709 12:13:53.377197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:57.708615 (+4331418us) service_pool.cc:224] Handling call
0709 12:13:57.709017 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:57.713429 (+  4412us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:57.714675 (+  1246us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:57.753300  5118 raft_consensus.cc:2468] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 7.
I20260709 12:13:57.755558  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:57.749053  7557 leader_election.cc:290] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:57.756269  5837 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 5.
I20260709 12:13:57.759683  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:13:57.762198  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:57.765488  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:57.767118  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:57.767671  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:57.768081  5833 raft_consensus.cc:2393] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 4: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:13:57.768296  5194 raft_consensus.cc:3060] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:57.769104  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:57.769826  5198 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:57.770483  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:57.772068  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:57.772670  5192 raft_consensus.cc:2468] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
I20260709 12:13:57.773782  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:57.776384  5166 leader_election.cc:304] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:57.777266  7330 raft_consensus.cc:2804] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:57.777745  7330 raft_consensus.cc:493] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
W20260709 12:13:57.777976  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 53829.2us
I20260709 12:13:57.780114  7321 consensus_queue.cc:1059] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:13:57.777604  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:57.778853  5836 raft_consensus.cc:1240] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 12:13:57.782295  5195 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41416 (request call id 383) took 6103 ms (client timeout 2096 ms). Trace:
W20260709 12:13:57.782778  5195 rpcz_store.cc:269] 0709 12:13:51.678759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:51.680799 (+  2040us) service_pool.cc:224] Handling call
0709 12:13:57.782012 (+6101213us) spinlock_profiling.cc:243] Waited 4.96 s on lock 0x7b5400137ed4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:13:57.782192 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11405837184}
I20260709 12:13:57.778275  7330 raft_consensus.cc:3060] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:57.784058  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:57.784803  5834 raft_consensus.cc:2468] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 4.
I20260709 12:13:57.786055  5269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50932 (request call id 475) took 1777 ms. Trace:
I20260709 12:13:57.786580  5269 rpcz_store.cc:276] 0709 12:13:56.008233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:56.180516 (+172283us) service_pool.cc:224] Handling call
0709 12:13:56.199795 (+ 19279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:57.660372 (+1460577us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:57.785773 (+125401us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b54000d3c54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:13:57.785994 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3356578176}
I20260709 12:13:57.788489  7345 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:13:57.789235  5237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:57.789636  7321 raft_consensus.cc:3055] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:13:57.783386  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 48917.6us
I20260709 12:13:57.791177  5088 leader_election.cc:304] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:57.791440  7394 raft_consensus.cc:515] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:57.792444  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:57.790086  7321 raft_consensus.cc:740] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:57.793776  5163 leader_election.cc:304] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
W20260709 12:13:57.801318  5089 leader_election.cc:336] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Timed out: RequestConsensusVote RPC to 127.3.212.132:43539 timed out after 1.522s (SENT)
I20260709 12:13:57.802645  7396 consensus_queue.cc:1048] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:13:57.803134  5238 connection.cc:256] RPC call timeout handler was delayed by -1.4724232270000357s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24980000000000002s for a response
I20260709 12:13:57.812970  5198 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
I20260709 12:13:57.804665  5166 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:57.804695  5088 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:13:57.793668  7557 raft_consensus.cc:2764] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:13:57.809085  5240 leader_election.cc:304] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
W20260709 12:13:57.809803  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 56139.5us
I20260709 12:13:57.781404  5830 raft_consensus.cc:2376] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 3. Re-sending same reply.
I20260709 12:13:57.803534  6971 consensus_queue.cc:1048] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:13:57.815106  5194 raft_consensus.cc:2468] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
I20260709 12:13:57.825775  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:57.826134  5089 leader_election.cc:304] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:57.712232  7548 raft_consensus.cc:515] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:57.827615  5835 raft_consensus.cc:2410] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:13:57.828936  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:57.830056  5198 raft_consensus.cc:2468] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
W20260709 12:13:57.833945  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 70972us
I20260709 12:13:57.811661  5833 raft_consensus.cc:1275] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:13:57.836761  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 57031.9us
I20260709 12:13:57.838056  5196 raft_consensus.cc:1240] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 2. Current term is 4. Ops: []
I20260709 12:13:57.839269  5121 raft_consensus.cc:2393] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 4: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:13:57.827277  5831 raft_consensus.cc:3060] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:57.844287  7549 raft_consensus.cc:2804] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:57.844429  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:57.844910  7549 raft_consensus.cc:493] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:57.845297  7549 raft_consensus.cc:3060] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:57.845742  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:57.846710  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:13:57.850078  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 56780.2us
I20260709 12:13:57.832904  7386 raft_consensus.cc:2749] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:57.847441  5269 raft_consensus.cc:2468] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
I20260709 12:13:57.833809  7439 raft_consensus.cc:2804] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:57.835129  7345 raft_consensus.cc:493] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:57.861312  7358 raft_consensus.cc:493] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:57.861500  7265 raft_consensus.cc:2804] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:57.862111  7358 raft_consensus.cc:515] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:57.862936  7544 raft_consensus.cc:493] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.863529  7544 raft_consensus.cc:515] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:57.864451  7358 leader_election.cc:290] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:57.865818  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:57.866920  5125 raft_consensus.cc:2393] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 3: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:57.867445  7528 consensus_queue.cc:1059] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:13:57.867947  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:57.868747  5118 raft_consensus.cc:2393] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 4: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:13:57.868933  7525 raft_consensus.cc:3055] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:13:57.869346  7525 raft_consensus.cc:740] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:13:57.869974  5801 leader_election.cc:304] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:57.870354  7525 consensus_queue.cc:260] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:57.870967  7423 raft_consensus.cc:2804] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:13:57.859740  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:57.871511  7423 raft_consensus.cc:493] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:57.871603  5801 leader_election.cc:304] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:57.871917  7423 raft_consensus.cc:3060] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:13:57.871989  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:57.872596  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:57.860348  7325 raft_consensus.cc:2749] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:57.873581  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:57.873883  7325 consensus_queue.cc:1048] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:57.874498  5089 leader_election.cc:304] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:57.860961  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:57.869524  7345 raft_consensus.cc:515] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:57.861220  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:57.876506  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:57.876890  5829 raft_consensus.cc:2468] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 5.
I20260709 12:13:57.852501  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:57.860144  7553 raft_consensus.cc:493] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.877990  7345 leader_election.cc:290] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:57.874526  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:57.878582  7553 raft_consensus.cc:515] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:57.860637  7557 raft_consensus.cc:493] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.880811  5119 raft_consensus.cc:2368] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 4. Current term is 5.
I20260709 12:13:57.881222  7557 raft_consensus.cc:515] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:57.882108  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:57.882927  7423 raft_consensus.cc:515] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:57.875478  5117 raft_consensus.cc:1240] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:57.884363  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:57.887522  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:57.885093  5089 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:57.883325  7557 leader_election.cc:290] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:57.887704  5123 raft_consensus.cc:2376] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 5. Re-sending same reply.
I20260709 12:13:57.888646  7544 leader_election.cc:290] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:57.880802  7553 leader_election.cc:290] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:57.885725  7325 raft_consensus.cc:2749] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:57.883396  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:57.890978  7423 leader_election.cc:290] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:57.890888  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:57.892117  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:57.892486  7330 raft_consensus.cc:515] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:57.893273  7439 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:57.894275  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:57.895483  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:57.889310  5125 raft_consensus.cc:2468] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 6.
I20260709 12:13:57.862103  7265 raft_consensus.cc:697] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 4 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:57.896806  5124 raft_consensus.cc:1240] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:57.887388  7548 leader_election.cc:290] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:57.898152  5120 raft_consensus.cc:1275] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:13:57.898504  7475 raft_consensus.cc:2749] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:57.898736  5801 leader_election.cc:304] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:57.899780  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:57.900529  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:57.917654  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:57.901739  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:57.902985  5196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 1794) took 1930 ms. Trace:
I20260709 12:13:57.903571  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:57.896905  5018 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58198 (request call id 325) took 7787 ms. Trace:
I20260709 12:13:57.914620  5238 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
W20260709 12:13:57.905900  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 115977us
I20260709 12:13:57.915755  5117 raft_consensus.cc:2468] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 3.
I20260709 12:13:57.916343  5122 raft_consensus.cc:2393] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 5: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:13:57.918411  5196 rpcz_store.cc:276] 0709 12:13:55.972162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:57.580148 (+1607986us) service_pool.cc:224] Handling call
0709 12:13:57.626156 (+ 46008us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:57.838516 (+212360us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:57.902650 (+ 64134us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b54001f8954. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:13:57.902924 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":486908800}
I20260709 12:13:57.924762  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:57.928303  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:57.928295  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:57.915665  7544 raft_consensus.cc:2749] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:57.930297  7345 raft_consensus.cc:2804] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:57.930729  7345 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:57.931090  7345 raft_consensus.cc:3060] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:57.916798  7439 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:57.933866  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:57.934629  5116 raft_consensus.cc:2468] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 4.
I20260709 12:13:57.929721  7423 raft_consensus.cc:2749] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:57.936892  5123 raft_consensus.cc:3060] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:57.937633  7423 consensus_queue.cc:1059] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:57.938243  5120 raft_consensus.cc:1275] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:13:57.938421  7423 consensus_queue.cc:1243] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer ad2f9a1e2f7a45429fa69fd23d09f821 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:13:57.939004  7475 raft_consensus.cc:3055] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:57.939363  7475 raft_consensus.cc:740] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:13:57.940253  7475 consensus_queue.cc:260] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:57.941596  5124 raft_consensus.cc:2368] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 6. Current term is 7.
I20260709 12:13:57.942008  7475 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:57.942255  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:57.885671  7321 consensus_queue.cc:260] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:57.942729  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:57.942844  5837 raft_consensus.cc:2376] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 3. Re-sending same reply.
I20260709 12:13:57.943238  7321 raft_consensus.cc:3060] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:57.943403  5838 raft_consensus.cc:2376] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 4. Re-sending same reply.
I20260709 12:13:57.942766  7265 consensus_queue.cc:237] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:57.945222  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:57.945703  5120 pending_rounds.cc:85] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting all ops after (but not including) 1
I20260709 12:13:57.945762  7325 consensus_queue.cc:1059] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:57.946162  7548 consensus_queue.cc:1048] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:57.947026  7325 raft_consensus.cc:3055] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:57.947412  7325 raft_consensus.cc:740] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:57.948041  5838 raft_consensus.cc:1275] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:13:57.948442  7325 consensus_queue.cc:260] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:57.950891  5838 raft_consensus.cc:1275] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:13:57.954252  5123 raft_consensus.cc:2468] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 5.
W20260709 12:13:57.957926  5237 leader_election.cc:336] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Timed out: RequestConsensusVote RPC to 127.3.212.130:44455 timed out after 1.592s (SENT)
I20260709 12:13:57.956984  7325 raft_consensus.cc:3060] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:57.958143  7394 leader_election.cc:290] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:57.955832  7345 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:57.961205  5164 leader_election.cc:336] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Timed out: RequestConsensusVote RPC to 127.3.212.132:43539 timed out after 1.779s (SENT)
I20260709 12:13:57.961547  5120 pending_rounds.cc:107] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 12:13:57.964164  5120 raft_consensus.cc:2889] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:13:57.963292  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 78305.9us
I20260709 12:13:57.965494  5118 raft_consensus.cc:2468] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 3.
I20260709 12:13:57.967695  5164 leader_election.cc:304] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:57.968438  5122 raft_consensus.cc:1275] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 12:13:57.969524  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 111356us
I20260709 12:13:57.976619  5122 raft_consensus.cc:1240] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 2. Current term is 3. Ops: []
W20260709 12:13:57.987450  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 88847.9us
I20260709 12:13:57.988276  5089 leader_election.cc:304] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:57.979034  7394 raft_consensus.cc:2749] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:13:57.994004  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:57.997176  5122 raft_consensus.cc:2468] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 3.
W20260709 12:13:58.001564  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 73831.9us
I20260709 12:13:57.976454  7471 consensus_queue.cc:1048] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
W20260709 12:13:58.018076  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:57.919657  5018 rpcz_store.cc:276] 0709 12:13:50.109814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:50.117599 (+  7785us) service_pool.cc:224] Handling call
0709 12:13:57.896683 (+7779084us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:56.376789 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:56.381815 (+  5026us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:56.381848 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:13:56.381867 (+    19us) tablet.cc:662] Decoding operations
0709 12:13:56.382677 (+   810us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:56.382730 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:56.382761 (+    31us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:13:56.383314 (+   553us) tablet.cc:701] Row locks acquired
0709 12:13:56.383337 (+    23us) write_op.cc:260] PREPARE: finished
0709 12:13:56.383518 (+   181us) write_op.cc:270] Start()
0709 12:13:56.383678 (+   160us) write_op.cc:276] Timestamp: P: 1783599236383459 usec, L: 0
0709 12:13:56.383702 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:13:56.415583 (+ 31881us) log.cc:844] Serialized 2453 byte log entry
0709 12:13:57.182819 (+767236us) op_driver.cc:464] REPLICATION: finished
0709 12:13:57.437256 (+254437us) write_op.cc:301] APPLY: starting
0709 12:13:57.447832 (+ 10576us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:57.477535 (+ 29703us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:57.477677 (+   142us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:57.489359 (+ 11682us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:57.489792 (+   433us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:13:57.489844 (+    52us) write_op.cc:312] APPLY: finished
0709 12:13:57.490275 (+   431us) log.cc:844] Serialized 53 byte log entry
0709 12:13:57.490515 (+   240us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:57.490687 (+   172us) write_op.cc:454] Released schema lock
0709 12:13:57.490766 (+    79us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:57.527299 (+ 36533us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:57.527345 (+    46us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":20,"child_traces":[["op",{"apply.queue_time_us":230530,"apply.run_cpu_time_us":4547,"apply.run_wall_time_us":90061,"num_ops":6,"prepare.queue_time_us":411978,"prepare.run_cpu_time_us":44859,"prepare.run_wall_time_us":208289,"raft.queue_time_us":497744,"raft.run_cpu_time_us":57413,"raft.run_wall_time_us":176863,"replication_time_us":798853,"thread_start_us":689809,"threads_started":4,"wal-append.queue_time_us":213350}]]}
I20260709 12:13:58.019347  5166 leader_election.cc:304] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:58.020442  5801 leader_election.cc:304] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:57.996729  7544 consensus_queue.cc:1048] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:13:58.007546  7548 raft_consensus.cc:2749] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:13:58.027781  7330 leader_election.cc:290] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:58.030736  7525 raft_consensus.cc:3060] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:58.036502  5831 raft_consensus.cc:2468] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
I20260709 12:13:58.038774  5240 leader_election.cc:304] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:13:58.039703  7400 consensus_queue.cc:1059] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:58.040555  7463 raft_consensus.cc:2804] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:58.041039  7463 raft_consensus.cc:493] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:58.025408  7394 consensus_queue.cc:1048] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:13:58.041752  7460 consensus_queue.cc:1048] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:58.041438  7463 raft_consensus.cc:3060] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:13:58.043222  5091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:58.044075  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 63551.8us
W20260709 12:13:58.053021  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 76822.5us
W20260709 12:13:58.057855  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 55526.6us
I20260709 12:13:58.060163  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:58.061272  5237 leader_election.cc:400] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 election: Vote denied by peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455) with higher term. Message: Invalid argument: T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 7. Current term is 8.
I20260709 12:13:58.061579  7439 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:58.062680  5120 raft_consensus.cc:1240] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:58.063323  5237 leader_election.cc:403] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:13:58.063879  7439 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:58.069149  5240 leader_election.cc:304] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
W20260709 12:13:58.070914  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 51666.1us
I20260709 12:13:58.071691  5166 leader_election.cc:304] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:58.072546  5166 leader_election.cc:304] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
W20260709 12:13:58.075117  5804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:58.078007  7386 raft_consensus.cc:2804] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:58.078394  5240 leader_election.cc:400] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 election: Vote denied by peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443) with higher term. Message: Invalid argument: T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 6. Current term is 7.
I20260709 12:13:58.080202  7386 raft_consensus.cc:493] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:58.080317  5240 leader_election.cc:403] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:13:58.080757  7386 raft_consensus.cc:3060] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:58.078511  7394 raft_consensus.cc:2804] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:58.066463  7321 raft_consensus.cc:2749] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455) with higher term. Message: Invalid argument: T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 7. Current term is 8.
I20260709 12:13:58.086756  5120 raft_consensus.cc:1240] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:58.085112  5237 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:58.053521  5122 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
new_leader_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:45628
I20260709 12:13:58.088507  5122 raft_consensus.cc:606] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 LEADER]: Received request to transfer leadership to TS 9e794b72ed7640219f90ec4232363929
W20260709 12:13:58.089010  5803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:58.089501  5089 leader_election.cc:304] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
W20260709 12:13:58.096179  7563 log.cc:927] Time spent T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:13:58.096630  5164 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
W20260709 12:13:58.099984  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 94242us
I20260709 12:13:58.101126  5089 leader_election.cc:304] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:58.101851  7544 raft_consensus.cc:2749] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:58.106338  5164 leader_election.cc:304] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:58.108218  5164 leader_election.cc:304] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:58.110922  5088 leader_election.cc:304] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:58.116701  7548 consensus_queue.cc:1059] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:58.117676  7358 raft_consensus.cc:2749] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:58.118546  5089 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:58.119562  5089 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:58.120510  7553 raft_consensus.cc:2804] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:58.120893  7553 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:58.117686  7557 raft_consensus.cc:3055] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:58.121884  7557 raft_consensus.cc:740] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:58.122887  7557 consensus_queue.cc:260] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:58.124231  7557 raft_consensus.cc:3060] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:58.086730  7567 raft_consensus.cc:2749] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:58.121228  7553 raft_consensus.cc:3060] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:58.126276  7345 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:58.088300  7394 raft_consensus.cc:697] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:58.134287  7394 consensus_queue.cc:237] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:58.136837  7557 raft_consensus.cc:2749] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:13:58.108937  7471 raft_consensus.cc:2749] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:13:58.133512  5803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:58.139030  7549 raft_consensus.cc:515] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:58.146047  7566 log.cc:927] Time spent T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:13:58.146929  7553 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:58.147943  5801 leader_election.cc:304] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:58.118479  7358 raft_consensus.cc:2749] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:58.145789  7544 consensus_queue.cc:1048] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:13:58.150518  7553 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:58.128707  7460 raft_consensus.cc:3055] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:58.153913  7460 raft_consensus.cc:740] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:58.154862  7460 consensus_queue.cc:260] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:58.156212  7460 raft_consensus.cc:3060] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:58.093040  7439 consensus_queue.cc:1059] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 12:13:58.158414  7553 raft_consensus.cc:3055] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:58.158861  7553 raft_consensus.cc:740] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:58.159807  7553 consensus_queue.cc:260] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:58.161074  7553 raft_consensus.cc:3060] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:58.165568  5088 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:13:58.166558  7525 raft_consensus.cc:2749] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:13:58.166882  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 53857.9us
I20260709 12:13:58.168044  5088 leader_election.cc:304] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:58.168730  5801 leader_election.cc:304] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:13:58.094880  7528 raft_consensus.cc:2804] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:58.168902  7557 raft_consensus.cc:2804] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:58.169449  7557 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:58.169413  7528 raft_consensus.cc:493] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:58.169809  6971 raft_consensus.cc:2749] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:58.170142  7528 raft_consensus.cc:3060] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:58.170387  7525 raft_consensus.cc:2804] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:13:58.170791  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 62666.4us
I20260709 12:13:58.171023  7525 raft_consensus.cc:493] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:58.171448  7525 raft_consensus.cc:3060] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:58.172009  5164 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:58.170380  7396 raft_consensus.cc:2804] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:58.172811  7330 raft_consensus.cc:2804] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:58.169516  7439 raft_consensus.cc:2804] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:58.173864  7439 raft_consensus.cc:493] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:58.175213  7439 raft_consensus.cc:3060] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:58.173228  7330 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:58.177703  7330 raft_consensus.cc:3060] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:58.178673  7557 raft_consensus.cc:3060] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:58.181838  7471 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.182530  7471 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:58.174430  5804 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:58.172885  7396 raft_consensus.cc:493] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:58.185606  7396 raft_consensus.cc:3060] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:58.187043  7570 raft_consensus.cc:2749] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:58.165872  7549 leader_election.cc:290] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:58.190208  5801 leader_election.cc:304] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:58.191154  7570 raft_consensus.cc:2804] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:58.191540  7570 raft_consensus.cc:493] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:58.191866  7570 raft_consensus.cc:3060] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:58.193082  7471 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:58.197691  5804 leader_election.cc:304] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:58.198678  7423 raft_consensus.cc:2749] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:58.199390  5804 leader_election.cc:400] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 election: Vote denied by peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443) with higher term. Message: Invalid argument: T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 4. Current term is 5.
I20260709 12:13:58.199741  5804 leader_election.cc:403] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:13:58.200294  7423 raft_consensus.cc:2749] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443) with higher term. Message: Invalid argument: T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 4. Current term is 5.
I20260709 12:13:58.178038  7528 raft_consensus.cc:515] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:58.201399  7423 consensus_queue.cc:1059] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:58.202405  7423 raft_consensus.cc:3055] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:58.202713  7423 raft_consensus.cc:740] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:13:58.203152  7528 leader_election.cc:290] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:58.203648  7423 consensus_queue.cc:260] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:58.205053  7423 raft_consensus.cc:3060] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:58.207448  5164 leader_election.cc:304] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:58.182657  7463 raft_consensus.cc:515] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:58.169214  5088 leader_election.cc:304] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
W20260709 12:13:58.216969  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 138716us
W20260709 12:13:58.219772  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 50608.5us
W20260709 12:13:58.218542  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 173658us
I20260709 12:13:58.234469  5240 leader_election.cc:304] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:13:58.234719  5088 leader_election.cc:304] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:58.238561  5804 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:13:58.241803  5164 leader_election.cc:304] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:58.218004  7400 raft_consensus.cc:2804] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:13:58.246289  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 56203.5us
W20260709 12:13:58.250722  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 185064us
I20260709 12:13:58.236843  7325 raft_consensus.cc:2804] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:58.253691  5238 leader_election.cc:304] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:58.238425  7471 raft_consensus.cc:2804] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:13:58.262533  5804 leader_election.cc:304] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
W20260709 12:13:58.264753  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:58.243323  7544 raft_consensus.cc:2804] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:58.282042  5240 leader_election.cc:304] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:13:58.248775  7323 raft_consensus.cc:2804] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:13:58.274312  5803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:58.247869  7321 raft_consensus.cc:2749] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:13:58.235484  7396 raft_consensus.cc:515] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:58.250066  7400 raft_consensus.cc:493] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:58.235677  7386 raft_consensus.cc:515] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:58.312831  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:58.262269  7475 raft_consensus.cc:2804] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:13:58.315402  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:58.237773  7330 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:58.315935  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:58.252072  7265 consensus_queue.cc:1048] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 12:13:58.265910  7471 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:58.282374  7544 raft_consensus.cc:493] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:58.329656  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 87943.2us
W20260709 12:13:58.267241  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 147733us
I20260709 12:13:58.335273  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:58.288789  7528 raft_consensus.cc:2804] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:58.327282  5196 raft_consensus.cc:3060] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:58.314785  7394 raft_consensus.cc:2764] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 12:13:58.337265  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 45616.9us
I20260709 12:13:58.339440  7471 raft_consensus.cc:3060] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:13:58.284713  7325 raft_consensus.cc:697] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:58.411968  5122 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
new_leader_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:45628
I20260709 12:13:58.288978  7573 consensus_queue.cc:1048] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.094s
I20260709 12:13:58.336326  7345 raft_consensus.cc:2804] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:58.399659  5089 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:58.364493  7544 raft_consensus.cc:3060] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:58.375010  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 109506us
I20260709 12:13:58.326622  7475 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:58.266882  7525 raft_consensus.cc:515] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:58.339706  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:58.442684  5197 raft_consensus.cc:2393] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 4: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:58.433444  5122 raft_consensus.cc:606] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 LEADER]: Received request to transfer leadership to TS 9e794b72ed7640219f90ec4232363929
I20260709 12:13:58.410663  7571 raft_consensus.cc:3060] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:13:58.339836  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:58.445183  5192 raft_consensus.cc:2393] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 4: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:58.329200  7572 raft_consensus.cc:2804] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:58.324103  7400 raft_consensus.cc:3060] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:13:58.414291  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 173756us
I20260709 12:13:58.419128  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:58.344493  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:58.376843  7557 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:58.442408  7358 raft_consensus.cc:2804] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:58.437754  7323 raft_consensus.cc:697] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 5 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:58.438586  7579 consensus_queue.cc:1059] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 12:13:58.449749  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:58.444381  7265 consensus_queue.cc:1059] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 12:13:58.434435  7570 raft_consensus.cc:515] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:58.401064  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 134216us
I20260709 12:13:58.422153  7345 raft_consensus.cc:493] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:58.463919  5193 raft_consensus.cc:2468] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:13:58.436923  7475 raft_consensus.cc:3060] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:13:58.464540  5237 leader_election.cc:304] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:58.438655  7325 consensus_queue.cc:237] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:58.472131  5200 raft_consensus.cc:2468] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
I20260709 12:13:58.485183  7581 raft_consensus.cc:3055] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:58.485635  7582 raft_consensus.cc:2804] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:58.486126  7582 raft_consensus.cc:493] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:58.486497  7582 raft_consensus.cc:3060] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:58.451152  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:58.488469  5195 raft_consensus.cc:2468] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
I20260709 12:13:58.488876  5237 leader_election.cc:304] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:13:58.472556  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:58.419713  7439 raft_consensus.cc:515] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:13:58.477604  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 78041.6us
I20260709 12:13:58.492089  5089 leader_election.cc:304] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:13:58.445565  7463 leader_election.cc:290] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:58.453946  7572 raft_consensus.cc:493] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:58.482857  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
W20260709 12:13:58.483150  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 74320.1us
I20260709 12:13:58.510527  5198 raft_consensus.cc:2393] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 6: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:58.511664  5089 leader_election.cc:400] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Vote denied by peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539) with higher term. Message: Invalid argument: T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 5. Current term is 6.
I20260709 12:13:58.512020  5089 leader_election.cc:403] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:58.467036  7358 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:58.482195  7345 raft_consensus.cc:3060] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:58.528307  5238 leader_election.cc:304] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:58.445088  7580 consensus_queue.cc:1048] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
I20260709 12:13:58.512573  7553 raft_consensus.cc:2764] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 12:13:58.536206  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 135416us
W20260709 12:13:58.536566  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 67734us
I20260709 12:13:58.485666  7581 raft_consensus.cc:740] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:58.512445  7572 raft_consensus.cc:3060] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:58.521782  7358 raft_consensus.cc:3060] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:13:58.543046  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 65385.2us
I20260709 12:13:58.532652  7573 raft_consensus.cc:2749] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:13:58.552052  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 58718.6us
I20260709 12:13:58.549878  5118 raft_consensus.cc:1240] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 12:13:58.549950  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
W20260709 12:13:58.558161  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 69399.5us
I20260709 12:13:58.542724  7396 leader_election.cc:290] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:58.540292  7575 raft_consensus.cc:2749] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:13:58.563691  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:58.559456  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:58.575263  5237 leader_election.cc:304] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:58.545644  7574 raft_consensus.cc:2749] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539) with higher term. Message: Invalid argument: T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 5. Current term is 6.
I20260709 12:13:58.581627  5124 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
new_leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
 from {username='slave'} at 127.0.0.1:45628
I20260709 12:13:58.549571  7583 raft_consensus.cc:493] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:58.583897  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 102276us
W20260709 12:13:58.584836  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 44877.7us
I20260709 12:13:58.588872  5164 leader_election.cc:304] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:58.567749  7528 raft_consensus.cc:697] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 3 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:13:58.582644  5124 raft_consensus.cc:606] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 LEADER]: Received request to transfer leadership to TS dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:58.606827  5237 leader_election.cc:304] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
W20260709 12:13:58.622674  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 75602us
I20260709 12:13:58.623703  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:58.632931  5191 raft_consensus.cc:1240] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:58.601637  7396 raft_consensus.cc:2749] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:58.600219  7463 raft_consensus.cc:2749] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:13:58.603919  7525 leader_election.cc:290] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:58.560046  7323 consensus_queue.cc:237] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:58.637001  5804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:58.626762  7575 raft_consensus.cc:2804] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:58.610350  7330 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:58.651252  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:13:58.657469  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 322893us
I20260709 12:13:58.658656  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:58.659031  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:58.658665  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:58.646301  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:58.664659  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:13:58.663681  5238 leader_election.cc:304] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:58.600307  7587 consensus_queue.cc:1059] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
W20260709 12:13:58.665762  5803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:58.665576  7463 raft_consensus.cc:2749] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:58.666164  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:58.666844  5837 raft_consensus.cc:2468] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 4.
I20260709 12:13:58.667869  5238 leader_election.cc:304] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:13:58.668031  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:58.664906  5195 raft_consensus.cc:2468] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 5.
I20260709 12:13:58.666852  5237 leader_election.cc:304] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:58.670467  5801 leader_election.cc:304] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:58.670811  5237 leader_election.cc:304] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:58.671999  5237 leader_election.cc:304] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:58.665452  5831 raft_consensus.cc:1275] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:58.598030  7581 consensus_queue.cc:260] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:58.679390  7577 consensus_queue.cc:1048] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:13:58.680249  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:58.684084  7548 consensus_queue.cc:1048] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:58.684504  7439 leader_election.cc:290] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:58.657054  7575 raft_consensus.cc:493] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:58.685467  7463 raft_consensus.cc:2804] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:58.685885  7573 raft_consensus.cc:2749] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:58.687203  7321 raft_consensus.cc:2749] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:13:58.661063  7557 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:58.593976  7583 raft_consensus.cc:515] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:58.709323  5088 leader_election.cc:304] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:58.627318  7549 consensus_queue.cc:1048] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:13:58.713289  5191 raft_consensus.cc:2393] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 5: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:58.715447  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:58.716130  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:58.723759  7597 raft_consensus.cc:3060] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:58.660213  7570 leader_election.cc:290] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:13:58.729146  5803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:58.731271  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 166909us
I20260709 12:13:58.720147  7577 consensus_queue.cc:1243] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer bce73265e27d4b30a4dcc1e491305088 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:13:58.662379  7471 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:58.777324  5836 raft_consensus.cc:3060] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:58.779175  5835 raft_consensus.cc:1275] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:58.695350  7525 consensus_queue.cc:1059] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
W20260709 12:13:58.809990  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 138043us
I20260709 12:13:58.733492  7581 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:58.727787  7463 raft_consensus.cc:493] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:58.784317  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 113923us
I20260709 12:13:58.728112  7575 raft_consensus.cc:3060] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:58.780560  5834 raft_consensus.cc:2393] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 5: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
W20260709 12:13:58.777402  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 68123.8us
I20260709 12:13:58.731665  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:58.838408  5088 leader_election.cc:304] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:58.732929  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:58.849062  5088 leader_election.cc:304] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:58.782375  7439 raft_consensus.cc:2804] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:13:58.712709  7528 consensus_queue.cc:237] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:58.830986  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:58.855307  7557 raft_consensus.cc:2804] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:58.860965  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:58.860340  7598 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:13:58.863943  7330 consensus_queue.cc:1048] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:58.867697  5836 raft_consensus.cc:2468] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 3.
I20260709 12:13:58.886211  5164 leader_election.cc:304] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:58.837046  7463 raft_consensus.cc:3060] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:58.882184  5196 raft_consensus.cc:2468] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 4.
W20260709 12:13:58.883884  7460 consensus_meta.cc:287] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.727s	user 0.014s	sys 0.000s
I20260709 12:13:58.858153  7439 raft_consensus.cc:493] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:58.883528  5830 raft_consensus.cc:3060] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:58.880854  7557 raft_consensus.cc:493] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
W20260709 12:13:58.905194  5007 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet c7bb7b814fea4a2488cc39d06fc90483 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 9e794b72ed7640219f90ec4232363929 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:58.853255  7396 consensus_queue.cc:1048] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
W20260709 12:13:58.901758  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 51389.6us
I20260709 12:13:58.891275  7567 raft_consensus.cc:2804] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:13:58.903540  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 54557.8us
I20260709 12:13:58.910742  7590 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.911298  7590 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:58.916302  7423 consensus_meta.cc:287] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.710s	user 0.009s	sys 0.002s
I20260709 12:13:58.901541  5195 raft_consensus.cc:2393] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 6: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:58.923466  7265 consensus_queue.cc:1048] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:58.927628  5237 leader_election.cc:304] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:58.929105  7265 raft_consensus.cc:3060] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:58.937760  5237 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:58.902683  7439 raft_consensus.cc:3060] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:13:58.891026  7598 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:58.943225  7590 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:58.953337  7579 consensus_queue.cc:1059] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:13:58.962239  7593 log.cc:927] Time spent T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:13:58.902418  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:58.906950  7557 raft_consensus.cc:3060] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:58.965924  5120 raft_consensus.cc:2468] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 3.
I20260709 12:13:58.957059  5830 raft_consensus.cc:2468] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 5.
I20260709 12:13:58.922757  7567 raft_consensus.cc:697] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:58.908492  7592 raft_consensus.cc:2749] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:13:58.979511  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 416934us
W20260709 12:13:58.979506  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 297508us
I20260709 12:13:58.953256  7548 raft_consensus.cc:2804] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:58.978929  5198 raft_consensus.cc:1275] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:59.004938  7548 raft_consensus.cc:493] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:13:59.013316  7548 raft_consensus.cc:3060] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:59.018667  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:59.019577  5199 raft_consensus.cc:3060] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:59.021345  7548 raft_consensus.cc:515] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:59.023974  7548 leader_election.cc:290] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:13:59.025480  7591 log.cc:927] Time spent T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 12:13:59.025791  7471 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:58.990046  7475 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:59.030723  5833 raft_consensus.cc:1240] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 6. Current term is 7. Ops: []
I20260709 12:13:58.980086  7582 raft_consensus.cc:515] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:59.033455  7582 leader_election.cc:290] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:59.001740  7601 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:59.010087  7574 raft_consensus.cc:993] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821: : Instructing follower dd62e75bd3ed4ed28f1fb5955d650808 to start an election
I20260709 12:13:59.038138  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:59.039189  5194 raft_consensus.cc:2368] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 6. Current term is 7.
I20260709 12:13:59.041549  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:58.986722  5831 raft_consensus.cc:3060] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:13:59.049777  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 129259us
I20260709 12:13:59.050886  5088 leader_election.cc:304] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:59.047745  7548 raft_consensus.cc:1081] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 LEADER]: Signalling peer dd62e75bd3ed4ed28f1fb5955d650808 to start an election
I20260709 12:13:59.055428  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:59.055879  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:59.055284  5832 raft_consensus.cc:2955] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:59.050200  7423 raft_consensus.cc:493] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.056890  5238 leader_election.cc:304] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:59.057299  7423 raft_consensus.cc:515] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:59.058763  5238 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:59.059468  7423 leader_election.cc:290] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:59.060489  7548 consensus_queue.cc:1059] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:13:59.061474  7325 raft_consensus.cc:2804] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:59.061975  7325 raft_consensus.cc:697] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
W20260709 12:13:59.062469  7400 consensus_meta.cc:287] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.583s	user 0.009s	sys 0.000s
I20260709 12:13:59.062923  7400 raft_consensus.cc:515] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:59.052784  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:59.056669  5193 raft_consensus.cc:2393] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 4: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:59.063758  7567 consensus_queue.cc:237] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:58.972335  7463 raft_consensus.cc:515] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:59.067142  5192 raft_consensus.cc:2368] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 6. Current term is 7.
I20260709 12:13:59.067507  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:59.012264  7583 leader_election.cc:290] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:59.072366  7581 raft_consensus.cc:2804] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:59.056200  5195 raft_consensus.cc:2468] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 6.
I20260709 12:13:59.072571  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:59.073764  5191 raft_consensus.cc:3060] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:59.062932  7325 consensus_queue.cc:237] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:13:59.079170  7571 consensus_meta.cc:287] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.611s	user 0.006s	sys 0.002s
I20260709 12:13:59.079592  7581 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:59.079696  7571 raft_consensus.cc:2749] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443) with higher term. Message: Invalid argument: T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 6. Current term is 7.
I20260709 12:13:59.080042  7581 raft_consensus.cc:3060] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:59.081250  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:13:59.084075  7572 consensus_meta.cc:287] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.522s	user 0.009s	sys 0.000s
I20260709 12:13:59.084545  7572 raft_consensus.cc:515] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:59.088388  7400 leader_election.cc:290] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:13:59.089073  7544 consensus_meta.cc:287] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.643s	user 0.007s	sys 0.000s
I20260709 12:13:59.090169  5238 leader_election.cc:304] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:59.102035  5199 raft_consensus.cc:2468] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 4.
W20260709 12:13:59.109215  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 101489us
I20260709 12:13:59.112351  5191 raft_consensus.cc:2468] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:13:59.092541  7582 raft_consensus.cc:2804] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:13:59.090080  7601 raft_consensus.cc:2749] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:59.133313  5238 leader_election.cc:304] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:13:59.132431  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 128908us
I20260709 12:13:59.134641  5089 leader_election.cc:304] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:59.136511  5237 leader_election.cc:304] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:59.100764  7544 raft_consensus.cc:515] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:59.131337  7599 raft_consensus.cc:2804] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:13:59.134995  7582 raft_consensus.cc:493] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:59.137650  7265 raft_consensus.cc:2749] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:59.131158  7400 consensus_queue.cc:1048] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:13:59.155745  5237 leader_election.cc:304] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
W20260709 12:13:59.182631  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 54060.3us
I20260709 12:13:59.191767  5237 leader_election.cc:304] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:59.139585  7575 raft_consensus.cc:515] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:59.160856  7323 raft_consensus.cc:2749] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:59.209717  7460 raft_consensus.cc:2804] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:59.211014  7612 raft_consensus.cc:2749] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:59.214956  7598 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:59.218801  7544 leader_election.cc:290] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:59.157519  7571 raft_consensus.cc:2804] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:13:59.156452  7599 raft_consensus.cc:493] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:59.157887  7582 raft_consensus.cc:3060] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:13:59.270835  7358 consensus_meta.cc:287] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.709s	user 0.010s	sys 0.000s
W20260709 12:13:59.275197  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 83498us
I20260709 12:13:59.237123  5238 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:13:59.285020  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 150463us
I20260709 12:13:59.236271  7460 raft_consensus.cc:493] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:59.284749  7323 raft_consensus.cc:3060] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:59.160657  7581 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:59.287039  7345 consensus_meta.cc:287] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.744s	user 0.011s	sys 0.000s
I20260709 12:13:59.302042  7619 consensus_queue.cc:1048] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:13:59.349525  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 124168us
I20260709 12:13:59.293303  7460 raft_consensus.cc:3060] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:59.285211  7571 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:59.289259  7611 raft_consensus.cc:493] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.288324  7599 raft_consensus.cc:3060] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:13:59.297724  7606 log.cc:927] Time spent T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 12:13:59.307623  7358 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:59.309801  7572 leader_election.cc:290] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:13:59.298408  7605 log.cc:927] Time spent T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 12:13:59.361343  7358 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:59.304579  7584 raft_consensus.cc:3055] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:59.284341  5831 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 6.
I20260709 12:13:59.353781  7571 raft_consensus.cc:3060] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:13:59.364192  7584 raft_consensus.cc:740] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:13:59.365291  7584 consensus_queue.cc:260] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:59.366572  7597 consensus_meta.cc:287] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.536s	user 0.009s	sys 0.000s
I20260709 12:13:59.366819  7584 raft_consensus.cc:3060] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:59.367053  7597 raft_consensus.cc:2749] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:59.347365  7345 raft_consensus.cc:515] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:59.348824  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 55593.1us
W20260709 12:13:59.355103  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 43868.7us
I20260709 12:13:59.369997  7345 leader_election.cc:290] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:59.370548  5240 leader_election.cc:304] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:13:59.373682  7622 raft_consensus.cc:2804] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:59.362255  7611 raft_consensus.cc:515] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:59.354439  7587 raft_consensus.cc:2804] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:13:59.399772  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 206439us
I20260709 12:13:59.400022  5123 raft_consensus.cc:1240] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:59.402053  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:59.402974  5123 raft_consensus.cc:2410] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for term 7 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:13:59.404160  7618 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.405457  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:59.405613  5118 raft_consensus.cc:1275] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:59.405717  5804 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:59.406239  5121 raft_consensus.cc:3060] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:59.406665  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:59.407256  5837 raft_consensus.cc:2468] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:13:59.406608  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:59.409956  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:59.410485  5118 raft_consensus.cc:3060] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:59.406208  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:59.412122  5836 raft_consensus.cc:1240] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:59.413050  5238 leader_election.cc:304] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:59.374275  7622 raft_consensus.cc:697] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 3 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:59.414767  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:59.404758  7618 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:59.351325  7583 consensus_queue.cc:1059] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:13:59.416347  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:59.420257  5123 raft_consensus.cc:2393] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 5: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:13:59.396109  7463 leader_election.cc:290] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:59.439610  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:59.440490  5117 raft_consensus.cc:2393] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 6: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:13:59.401005  7587 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:59.444584  5125 raft_consensus.cc:1275] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:13:59.446584  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:59.447350  5123 raft_consensus.cc:2368] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 3. Current term is 4.
I20260709 12:13:59.418915  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:59.450553  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:59.452081  5120 raft_consensus.cc:2393] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 6: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:13:59.422958  7590 raft_consensus.cc:2749] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:13:59.421070  7592 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:13:59.456881  7592 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:59.446741  7386 leader_election.cc:290] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:59.439000  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:59.461138  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:59.447201  7587 raft_consensus.cc:3060] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:59.469568  5117 raft_consensus.cc:1275] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:13:59.470749  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 57783us
I20260709 12:13:59.459650  5119 raft_consensus.cc:2393] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 3: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:13:59.477823  5118 raft_consensus.cc:2468] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 5.
I20260709 12:13:59.481500  5118 raft_consensus.cc:1275] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:59.457600  7557 raft_consensus.cc:515] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:59.484547  5238 leader_election.cc:304] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:59.487649  5118 raft_consensus.cc:1275] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:13:59.488225  5238 leader_election.cc:304] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:59.481078  7575 leader_election.cc:290] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:59.496954  5830 raft_consensus.cc:1240] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 5. Current term is 6. Ops: []
I20260709 12:13:59.498919  7589 raft_consensus.cc:3055] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:59.499138  7570 raft_consensus.cc:3055] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:59.499608  7570 raft_consensus.cc:740] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:13:59.500478  7570 consensus_queue.cc:260] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:59.491663  7321 raft_consensus.cc:2749] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:59.503058  7604 raft_consensus.cc:3055] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:59.503592  7604 raft_consensus.cc:740] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:59.504508  7604 consensus_queue.cc:260] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:59.507874  5238 leader_election.cc:304] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:13:59.514526  7463 raft_consensus.cc:2749] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:13:59.514849  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:59.515376  7463 raft_consensus.cc:493] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.515793  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:59.515930  7463 raft_consensus.cc:515] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:59.517544  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:59.518308  5270 raft_consensus.cc:2368] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 4. Current term is 5.
I20260709 12:13:59.519549  7460 raft_consensus.cc:515] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:59.521884  7460 leader_election.cc:290] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:59.522228  7592 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:59.524977  5270 raft_consensus.cc:1240] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 5 LEADER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:59.482494  7622 consensus_queue.cc:237] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:59.550661  5088 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:59.507300  7589 raft_consensus.cc:740] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:13:59.557077  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:59.560216  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:59.560487  7553 raft_consensus.cc:2804] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:13:59.560930  7553 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:59.561328  7553 raft_consensus.cc:3060] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:59.561650  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:13:59.563519  7439 consensus_meta.cc:287] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.576s	user 0.005s	sys 0.005s
I20260709 12:13:59.542316  7601 raft_consensus.cc:2749] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:13:59.566882  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:59.495903  7625 raft_consensus.cc:3060] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:59.574662  7463 leader_election.cc:290] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:59.563970  7439 raft_consensus.cc:515] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:59.596009  5123 raft_consensus.cc:2393] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 7: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
W20260709 12:13:59.575629  7595 log.cc:927] Time spent T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.738s	user 0.004s	sys 0.000s
I20260709 12:13:59.597965  7439 leader_election.cc:290] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:59.599085  5122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40402 (request call id 1903) took 1057 ms. Trace:
I20260709 12:13:59.599494  5122 rpcz_store.cc:276] 0709 12:13:58.541290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:58.541487 (+   197us) service_pool.cc:224] Handling call
0709 12:13:58.547841 (+  6354us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:13:58.563232 (+ 15391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:58.563266 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:13:58.579966 (+ 16700us) log.cc:844] Serialized 52 byte log entry
0709 12:13:58.635869 (+ 55903us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:13:58.635908 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:58.635982 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:59.574979 (+938997us) spinlock_profiling.cc:243] Waited 2.67 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e675e86e 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221 00007f84e67671d9 00007f84e6767169
0709 12:13:59.598790 (+ 23811us) raft_consensus.cc:1685] finished
0709 12:13:59.598815 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:59.599025 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":510,"raft.queue_time_us":463,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":5262,"spinlock_wait_cycles":6145792,"thread_start_us":25990,"threads_started":1,"wal-append.queue_time_us":131784}
I20260709 12:13:59.600488  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:59.601620  5122 raft_consensus.cc:1240] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 5. Current term is 6. Ops: []
I20260709 12:13:59.603008  7589 consensus_queue.cc:260] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:59.604140  7589 raft_consensus.cc:3060] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:59.607048  7599 raft_consensus.cc:515] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:59.608320  5265 raft_consensus.cc:2393] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 4: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:13:59.570822  7571 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:59.572361  5829 raft_consensus.cc:1240] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:13:59.610262  5269 raft_consensus.cc:2368] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 6. Current term is 7.
I20260709 12:13:59.610834  7571 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:59.612401  7599 leader_election.cc:290] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:59.574733  7557 leader_election.cc:290] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:59.615880  7604 raft_consensus.cc:3060] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:59.613754  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:59.617671  5274 raft_consensus.cc:3060] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:59.618499  7587 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:59.614014  5273 raft_consensus.cc:1240] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:59.613770  5272 raft_consensus.cc:1240] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:59.613302  5271 raft_consensus.cc:1240] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:59.626242  7618 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:59.630452  7611 leader_election.cc:290] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:59.632794  7581 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:59.638842  7475 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:59.647315  7323 raft_consensus.cc:2749] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:59.573751  7636 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.648454  7636 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:59.650950  7636 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:59.653339  7596 raft_consensus.cc:3055] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:13:59.653757  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:59.654050  5801 leader_election.cc:400] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 election: Vote denied by peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709) with higher term. Message: Invalid argument: T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 4. Current term is 5.
I20260709 12:13:59.654655  5271 raft_consensus.cc:2393] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 6: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:13:59.655409  5269 raft_consensus.cc:1240] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:59.657631  7548 raft_consensus.cc:493] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.658239  7548 raft_consensus.cc:515] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:59.662640  5089 leader_election.cc:304] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:59.660795  7548 leader_election.cc:290] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:13:59.664860  7548 consensus_queue.cc:1059] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:13:59.666075  7548 raft_consensus.cc:3060] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:59.669840  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:59.670504  7603 consensus_queue.cc:1059] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:13:59.671322  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:59.671869  7603 raft_consensus.cc:3055] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:13:59.672320  7603 raft_consensus.cc:740] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:59.673136  5240 leader_election.cc:400] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Vote denied by peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443) with higher term. Message: Invalid argument: T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 3. Current term is 4.
I20260709 12:13:59.694670  5166 leader_election.cc:304] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:59.674010  5123 raft_consensus.cc:1240] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:59.685612  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:59.699584  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:59.727002  5832 raft_consensus.cc:1275] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:13:59.700417  5121 raft_consensus.cc:2468] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 4.
I20260709 12:13:59.694223  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:59.723340  5274 raft_consensus.cc:2468] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 6.
I20260709 12:13:59.674654  5125 raft_consensus.cc:1240] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:59.701020  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:59.726207  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:59.751662  5194 raft_consensus.cc:3060] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:59.752245  5192 raft_consensus.cc:2393] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 3: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:59.685895  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:59.699965  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:59.739817  5240 leader_election.cc:403] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:13:59.698400  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
W20260709 12:13:59.748971  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 54385.3us
I20260709 12:13:59.754338  5120 raft_consensus.cc:2393] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 6: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
W20260709 12:13:59.747711  5804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:59.746387  5801 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:59.750792  5272 raft_consensus.cc:2393] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 5: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:13:59.755892  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:59.758925  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:59.697558  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:13:59.695343  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:59.761245  5834 raft_consensus.cc:2393] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 5: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:59.677482  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:59.755853  5088 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:59.719224  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:59.725905  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:59.689775  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:59.786731  5196 raft_consensus.cc:2468] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
I20260709 12:13:59.798789  5273 raft_consensus.cc:2468] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 2.
I20260709 12:13:59.798091  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:13:59.799431  5803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:59.788580  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:59.788884  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:13:59.801717  5265 raft_consensus.cc:2393] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 6: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:13:59.801921  5837 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 5.
I20260709 12:13:59.805598  5193 raft_consensus.cc:3060] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:13:59.806092  5270 raft_consensus.cc:2468] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 4.
I20260709 12:13:59.808703  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:59.789443  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
W20260709 12:13:59.811071  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 64776.8us
I20260709 12:13:59.812343  5838 raft_consensus.cc:3060] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:13:59.678229  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:59.812855  5270 raft_consensus.cc:2393] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 6: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
W20260709 12:13:59.811843  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 138846us
I20260709 12:13:59.813159  5801 leader_election.cc:304] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:13:59.811579  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 55842.9us
I20260709 12:13:59.813763  5240 leader_election.cc:304] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:13:59.814764  5088 leader_election.cc:304] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:59.816998  5801 leader_election.cc:400] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 election: Vote denied by peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455) with higher term. Message: Invalid argument: T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 6. Current term is 7.
I20260709 12:13:59.817845  5801 leader_election.cc:403] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:13:59.817756  5266 raft_consensus.cc:2410] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260709 12:13:59.819378  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:59.747705  5237 leader_election.cc:400] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 election: Vote denied by peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455) with higher term. Message: Invalid argument: T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 6. Current term is 7.
I20260709 12:13:59.818639  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:59.833237  5801 leader_election.cc:304] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:13:59.835255  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 87691.6us
I20260709 12:13:59.701691  5119 raft_consensus.cc:1240] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 3. Current term is 4. Ops: []
I20260709 12:13:59.837206  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:59.837141  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:59.713753  7439 raft_consensus.cc:493] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.790242  7557 raft_consensus.cc:493] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.688762  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:59.845299  7475 raft_consensus.cc:2749] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:59.856776  5833 raft_consensus.cc:2393] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 6: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:59.686934  7528 raft_consensus.cc:3055] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:59.862704  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:59.862896  5089 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:59.772519  5164 leader_election.cc:304] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:13:59.677050  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:59.677309  7570 raft_consensus.cc:3060] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:59.840369  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:59.850139  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:59.864327  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:59.850543  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:59.864951  5266 raft_consensus.cc:2393] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 5: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:13:59.850838  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:59.693701  5200 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf"
dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
 from {username='slave'} at 127.0.0.1:47744
I20260709 12:13:59.740118  7596 raft_consensus.cc:740] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:59.847566  7599 raft_consensus.cc:2804] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:13:59.875525  5193 raft_consensus.cc:2468] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 7.
I20260709 12:13:59.790493  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:59.716457  5018 catalog_manager.cc:5697] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: config changed from index 4 to 6, term changed from 4 to 6, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to <none>, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New cstate: current_term: 6 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:59.882700  5018 catalog_manager.cc:5697] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 3 to 5, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 5 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:59.852782  5272 raft_consensus.cc:2468] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 6.
I20260709 12:13:59.788273  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:59.855130  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:59.855367  7615 raft_consensus.cc:2804] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:13:59.791551  7567 consensus_queue.cc:1059] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 12:13:59.855942  7611 raft_consensus.cc:2804] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:13:59.856549  7588 consensus_queue.cc:1059] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:13:59.846711  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:59.857650  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:13:59.857517  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:59.914844  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:59.915441  5124 raft_consensus.cc:2468] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 4.
I20260709 12:13:59.915681  5265 raft_consensus.cc:2410] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:13:59.685477  5195 raft_consensus.cc:1275] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:13:59.856331  5835 pending_rounds.cc:85] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088: Aborting all ops after (but not including) 5
I20260709 12:13:59.865275  7528 raft_consensus.cc:740] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:13:59.919991  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:59.825452  7581 raft_consensus.cc:3060] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:13:59.838682  7525 raft_consensus.cc:2749] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:13:59.851660  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:59.928862  5198 raft_consensus.cc:2468] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 2.
I20260709 12:13:59.883909  7612 raft_consensus.cc:2749] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:13:59.694921  7386 consensus_queue.cc:1048] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.157s
I20260709 12:13:59.865219  5270 raft_consensus.cc:2393] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 3: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:13:59.865339  5088 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:59.865582  5194 raft_consensus.cc:2468] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:13:59.935192  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:59.935796  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:59.936650  5194 raft_consensus.cc:2368] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 3. Current term is 4.
I20260709 12:13:59.866215  5200 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:59.865636  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:59.857266  7579 consensus_queue.cc:1059] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:13:59.937469  5200 raft_consensus.cc:3060] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:59.937623  5196 raft_consensus.cc:3060] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:13:59.865828  5199 raft_consensus.cc:2393] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 5: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:59.838101  7583 raft_consensus.cc:3060] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:13:59.850769  7571 consensus_queue.cc:1048] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:13:59.867573  5269 raft_consensus.cc:2393] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 6: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:13:59.787884  5830 raft_consensus.cc:1275] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:13:59.867286  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:13:59.930845  7544 raft_consensus.cc:3055] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:13:59.954210  7544 raft_consensus.cc:740] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:59.954701  7599 raft_consensus.cc:697] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 5 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:13:59.955148  7544 consensus_queue.cc:260] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:59.955662  7599 consensus_queue.cc:237] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:59.956418  7544 raft_consensus.cc:3060] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:59.849990  7584 raft_consensus.cc:493] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:13:59.957733  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:59.869580  5271 raft_consensus.cc:2393] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 3: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:13:59.958488  5194 raft_consensus.cc:2393] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 7: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:59.959080  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:59.959280  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:59.959846  5194 raft_consensus.cc:3060] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:59.960103  7583 raft_consensus.cc:2749] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455) with higher term. Message: Invalid argument: T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 6. Current term is 7.
I20260709 12:13:59.960340  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:59.852880  7439 raft_consensus.cc:515] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:59.706380  7582 raft_consensus.cc:515] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:59.793620  7396 raft_consensus.cc:2804] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:13:59.877696  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:59.860894  5801 leader_election.cc:304] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:13:59.916821  5835 pending_rounds.cc:107] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:13:59.589196  7553 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:59.913399  5018 catalog_manager.cc:5697] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 4 to 8, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 8 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:13:59.673246  7603 consensus_queue.cc:260] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:59.921192  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:59.922950  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:13:59.923775  5837 raft_consensus.cc:1240] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 4. Current term is 5. Ops: []
I20260709 12:13:59.912786  5274 raft_consensus.cc:2410] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:13:59.864964  5191 raft_consensus.cc:2468] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 4.
I20260709 12:13:59.867715  7475 consensus_queue.cc:1059] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:13:59.981508  7475 raft_consensus.cc:3055] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:13:59.982182  7475 raft_consensus.cc:740] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:13:59.975793  5272 raft_consensus.cc:2468] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 6.
I20260709 12:13:59.986186  7528 consensus_queue.cc:260] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:59.930616  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 53757.3us
I20260709 12:13:59.935954  5198 raft_consensus.cc:3060] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:59.988071  7528 raft_consensus.cc:3060] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:59.862655  7557 raft_consensus.cc:515] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:59.975147  5018 catalog_manager.cc:5697] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 2 to 3, leader changed from bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 3 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:59.990358  7557 leader_election.cc:290] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:59.916497  7587 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:59.945904  7642 consensus_queue.cc:1048] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:13:59.990715  5018 catalog_manager.cc:5697] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 2 to 4, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 4 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:59.946101  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:59.995098  5267 raft_consensus.cc:2393] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 5: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:13:59.996341  7582 leader_election.cc:290] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:13:59.946602  7613 raft_consensus.cc:493] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.946765  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:59.941918  7615 raft_consensus.cc:697] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:13:59.999387  5270 raft_consensus.cc:2393] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 5: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:13:59.998957  7613 raft_consensus.cc:515] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:00.000264  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:00.000895  5270 raft_consensus.cc:2468] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
I20260709 12:13:59.947672  7579 raft_consensus.cc:3055] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:00.001650  7579 raft_consensus.cc:740] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:00.002264  7613 leader_election.cc:290] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:13:59.946385  7611 raft_consensus.cc:697] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:00.003509  7642 raft_consensus.cc:2804] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:00.003299  7611 consensus_queue.cc:237] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:00.004036  7642 raft_consensus.cc:697] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:13:59.949651  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:13:59.949914  7596 consensus_queue.cc:260] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:59.999840  5266 raft_consensus.cc:2393] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 7: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:13:59.962719  7325 raft_consensus.cc:2749] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:13:59.937530  5829 raft_consensus.cc:3060] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:13:59.974304  5835 raft_consensus.cc:2889] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:00.006596  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:59.951421  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:59.957504  7584 raft_consensus.cc:515] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:13:59.962074  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 96799.9us
I20260709 12:13:59.870152  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:59.971814  5193 raft_consensus.cc:2393] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 6: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:00.013625  5198 raft_consensus.cc:2468] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 6.
W20260709 12:13:59.972448  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 111651us
I20260709 12:14:00.014510  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:00.014755  5801 leader_election.cc:400] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 election: Vote denied by peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709) with higher term. Message: Invalid argument: T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 6. Current term is 7.
I20260709 12:13:59.972733  7589 raft_consensus.cc:2749] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:13:59.974120  7625 raft_consensus.cc:2749] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:59.979504  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:00.017963  5273 raft_consensus.cc:2410] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:13:59.980058  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:00.019183  5274 raft_consensus.cc:2393] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 6: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:00.018745  5191 raft_consensus.cc:2393] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 3: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:13:59.961018  7548 raft_consensus.cc:2749] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:13:59.930169  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 139080us
I20260709 12:13:59.789119  7323 consensus_queue.cc:1048] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 12:13:59.975850  5194 raft_consensus.cc:2468] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 3.
I20260709 12:13:59.976239  5192 raft_consensus.cc:2393] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 5: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:00.013206  5088 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:13:59.987072  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:13:59.974268  5200 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:13:59.984709  7475 consensus_queue.cc:260] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:59.964514  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:00.002482  7579 consensus_queue.cc:260] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:13:59.999770  7615 consensus_queue.cc:237] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:00.004952  7642 consensus_queue.cc:237] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:00.031699  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:00.322300  7597 consensus_queue.cc:1059] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:59.978048  7386 raft_consensus.cc:493] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.323979  7386 raft_consensus.cc:515] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:00.244663  7589 raft_consensus.cc:493] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.325987  7589 raft_consensus.cc:515] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:00.328266  7589 leader_election.cc:290] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:00.328626  5166 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:00.217391  5265 raft_consensus.cc:3060] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:59.971494  7396 raft_consensus.cc:697] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:00.334434  7396 consensus_queue.cc:237] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:00.334961  7645 raft_consensus.cc:3060] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:00.335896  7651 consensus_queue.cc:1048] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:00.270833  5838 raft_consensus.cc:2468] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 7.
I20260709 12:14:00.338109  7423 raft_consensus.cc:2764] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:14:00.195353  7325 raft_consensus.cc:493] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.006071  7596 raft_consensus.cc:3060] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:00.322530  5196 raft_consensus.cc:2468] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 5.
I20260709 12:14:00.339411  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:14:00.328883  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 315760us
I20260709 12:14:00.016738  5018 catalog_manager.cc:5697] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 1 to 3, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 3 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:00.340596  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:00.249213  5829 raft_consensus.cc:2468] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 6.
I20260709 12:14:00.341826  5018 catalog_manager.cc:5697] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 2 to 4, leader changed from bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 4 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:00.044476  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:00.120685  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:00.270329  7612 raft_consensus.cc:493] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.343907  5088 leader_election.cc:304] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:00.328439  7647 raft_consensus.cc:493] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.076229  5116 raft_consensus.cc:1240] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 12:14:00.344897  5088 leader_election.cc:304] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:00.345088  7611 raft_consensus.cc:2749] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:00.077476  5191 raft_consensus.cc:1240] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 12:14:00.346061  7611 raft_consensus.cc:2804] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:14:00.346554  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 331922us
I20260709 12:14:00.346812  7611 raft_consensus.cc:493] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:00.347347  7611 raft_consensus.cc:3060] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:00.348390  5801 leader_election.cc:304] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:00.242962  7584 leader_election.cc:290] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:00.044314  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:00.044731  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:00.051585  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:00.120150  5122 raft_consensus.cc:1275] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:14:00.201282  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 50143.3us
W20260709 12:14:00.190145  5803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:00.353364  5240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:00.242403  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:13:59.975950  7553 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:00.332734  5163 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.006s	sys 0.007s
I20260709 12:14:00.343184  5269 raft_consensus.cc:2468] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
W20260709 12:14:00.357637  5163 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.007s	sys 0.007s
I20260709 12:14:00.343875  7579 raft_consensus.cc:3060] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:00.345204  7645 raft_consensus.cc:2749] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:00.342934  5272 raft_consensus.cc:2410] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:14:00.358557  5018 catalog_manager.cc:5697] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: config changed from index 2 to 3, term changed from 1 to 4, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:00.330032  5197 raft_consensus.cc:1240] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:14:00.351300  5270 raft_consensus.cc:2393] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 3: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:00.355484  5801 leader_election.cc:304] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:00.351783  5193 raft_consensus.cc:2368] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 3. Current term is 4.
I20260709 12:14:00.338915  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:00.331097  5194 raft_consensus.cc:1240] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:59.966131  7439 leader_election.cc:290] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:00.363417  5088 leader_election.cc:304] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:00.363911  5265 raft_consensus.cc:2468] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 3.
I20260709 12:14:00.349846  7570 raft_consensus.cc:2804] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:00.369103  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:00.372241  5192 raft_consensus.cc:1275] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:14:00.373008  5116 raft_consensus.cc:1240] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:00.373021  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:00.379160  5269 raft_consensus.cc:2393] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 6: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:00.242306  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:00.288072  7581 raft_consensus.cc:2749] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443) with higher term. Message: Invalid argument: T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 3. Current term is 4.
I20260709 12:14:00.378427  5088 leader_election.cc:304] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:00.383036  5018 catalog_manager.cc:5697] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 2 to 5, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 5 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:00.374655  5123 raft_consensus.cc:1240] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 3. Current term is 4. Ops: []
W20260709 12:14:00.375002  5801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:00.375741  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:00.376385  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:00.374007  5273 raft_consensus.cc:2410] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260709 12:14:00.384826  5018 catalog_manager.cc:5697] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 3 to 6, leader changed from bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 6 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:00.389413  5018 catalog_manager.cc:5697] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 2 to 6, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 6 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:00.393905  5193 raft_consensus.cc:1240] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:00.396737  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:00.397552  5268 raft_consensus.cc:2393] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 7: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:00.017700  7587 consensus_queue.cc:1059] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.355s
I20260709 12:14:00.399001  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:00.403733  5266 raft_consensus.cc:2468] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 4.
I20260709 12:14:00.403975  5199 raft_consensus.cc:2468] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 5.
I20260709 12:14:00.406098  7567 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.406414  7654 raft_consensus.cc:493] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.406644  7567 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:00.406904  7654 raft_consensus.cc:515] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:00.408933  7654 leader_election.cc:290] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:00.402868  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:00.410514  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:00.409821  5194 raft_consensus.cc:1275] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:00.411481  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:00.403029  5018 catalog_manager.cc:5697] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 1 to 4, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 4 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:14:00.415946  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:00.377036  5195 raft_consensus.cc:1240] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:00.338824  7325 raft_consensus.cc:515] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:00.365957  7544 raft_consensus.cc:2804] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:00.395357  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:00.429670  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:00.382619  7589 raft_consensus.cc:2804] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:00.388301  7475 raft_consensus.cc:3060] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:00.377353  5833 raft_consensus.cc:2468] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 7.
I20260709 12:14:00.449867  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:00.398496  7528 raft_consensus.cc:493] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.454622  5268 raft_consensus.cc:2410] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260709 12:14:00.414497  5018 catalog_manager.cc:5697] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 2 to 3, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 3 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:00.452106  5193 raft_consensus.cc:2468] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 4.
I20260709 12:14:00.398283  7439 raft_consensus.cc:2804] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:00.460803  5270 raft_consensus.cc:2468] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 5.
I20260709 12:14:00.387990  7553 raft_consensus.cc:2804] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:00.388404  7588 raft_consensus.cc:493] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.462371  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:00.453048  7525 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:00.402318  7570 raft_consensus.cc:697] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 6 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:00.344913  7647 raft_consensus.cc:515] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:00.412576  7583 raft_consensus.cc:493] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.428747  7581 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.344496  7612 raft_consensus.cc:515] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:00.472834  5272 raft_consensus.cc:3060] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:00.432914  7625 raft_consensus.cc:493] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
W20260709 12:14:00.474625  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 139495us
I20260709 12:14:00.431384  7580 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:00.475917  5268 raft_consensus.cc:1275] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:14:00.481369  7567 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:00.402104  7627 consensus_queue.cc:1048] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 12:14:00.484891  5271 raft_consensus.cc:1240] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:00.470009  7553 raft_consensus.cc:493] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:00.486778  7553 raft_consensus.cc:3060] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:00.488281  7612 leader_election.cc:290] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:00.476606  7525 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:00.483063  7325 leader_election.cc:290] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:00.484676  7647 leader_election.cc:290] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:00.493894  5273 raft_consensus.cc:1240] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:00.498462  5166 leader_election.cc:304] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:00.506157  5268 raft_consensus.cc:1275] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:00.469308  7528 raft_consensus.cc:515] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:00.510915  5273 raft_consensus.cc:1240] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:00.512861  5166 leader_election.cc:304] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:00.472786  7588 raft_consensus.cc:515] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:00.518060  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 125838us
W20260709 12:14:00.520303  5088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:00.481120  7625 raft_consensus.cc:515] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:00.478458  7581 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:00.478677  7583 raft_consensus.cc:515] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:00.505548  7647 raft_consensus.cc:2749] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:00.527068  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:00.521138  7567 raft_consensus.cc:2804] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:00.503842  7654 consensus_queue.cc:1048] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:14:00.543674  5273 raft_consensus.cc:1275] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:00.494014  7580 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:00.534544  7544 raft_consensus.cc:697] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
W20260709 12:14:00.553727  5007 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet c7bb7b814fea4a2488cc39d06fc90483 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 9e794b72ed7640219f90ec4232363929 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:14:00.533902  7570 consensus_queue.cc:237] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:00.556397  7601 raft_consensus.cc:493] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.515069  7645 consensus_queue.cc:1048] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:14:00.574819  5193 raft_consensus.cc:2468] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
I20260709 12:14:00.568341  5273 raft_consensus.cc:1240] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:00.570322  7601 raft_consensus.cc:515] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:00.533718  7439 raft_consensus.cc:697] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
W20260709 12:14:00.584744  5802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:00.585762  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:00.591709  7589 raft_consensus.cc:697] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 4 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
W20260709 12:14:00.584928  7599 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.001s	sys 0.018s
W20260709 12:14:00.605502  7599 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.002s	sys 0.019s
I20260709 12:14:00.610833  5265 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 4.
I20260709 12:14:00.627704  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:00.629118  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:00.630527  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:00.635771  5272 raft_consensus.cc:2468] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 4.
I20260709 12:14:00.642879  5265 raft_consensus.cc:2393] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 6: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:00.646821  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:00.647596  5191 raft_consensus.cc:2468] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 6.
I20260709 12:14:00.651263  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:14:00.658133  5164 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.792s	user 0.028s	sys 0.049s
W20260709 12:14:00.658538  5164 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.792s	user 0.028s	sys 0.049s
W20260709 12:14:00.658799  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 889362us
W20260709 12:14:00.669556  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 66186.3us
I20260709 12:14:00.649616  7439 consensus_queue.cc:237] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:00.656968  7544 consensus_queue.cc:237] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:00.676673  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:00.925565  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 220224us
I20260709 12:14:00.927470  7592 raft_consensus.cc:493] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.928143  7592 raft_consensus.cc:515] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:00.930508  7592 leader_election.cc:290] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:00.730408  5270 raft_consensus.cc:1275] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:14:00.927083  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:00.931922  7580 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:00.931684  5270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34672 (request call id 1765) took 1138 ms. Trace:
I20260709 12:14:00.681964  7589 consensus_queue.cc:237] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:00.932857  5801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:00.779659  5120 raft_consensus.cc:1240] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:00.935122  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
W20260709 12:14:00.936877  5804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:00.789109  5088 leader_election.cc:336] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 1.725s (SENT)
I20260709 12:14:00.779922  5274 raft_consensus.cc:2410] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:14:00.932729  5270 rpcz_store.cc:276] 0709 12:13:59.792845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:00.729284 (+936439us) service_pool.cc:224] Handling call
0709 12:14:00.730027 (+   743us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:00.931393 (+201366us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:00.931624 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:00.754491  5269 raft_consensus.cc:2468] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 7.
I20260709 12:14:00.752705  7581 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:00.825249  7662 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:00.947538  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 158473us
I20260709 12:14:00.948724  5801 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:00.941784  5269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34672 (request call id 1762) took 1151 ms. Trace:
I20260709 12:14:00.942560  5832 raft_consensus.cc:1275] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:14:00.942559  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:00.950508  5838 raft_consensus.cc:2468] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 5.
I20260709 12:14:00.950062  5269 rpcz_store.cc:276] 0709 12:13:59.789940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:00.382423 (+592483us) service_pool.cc:224] Handling call
0709 12:14:00.941726 (+559303us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:00.952661  5834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46100 (request call id 833) took 1166 ms. Trace:
I20260709 12:14:00.945726  5124 raft_consensus.cc:2410] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 6 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:14:00.954069  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:00.955026  5838 raft_consensus.cc:2468] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
W20260709 12:14:00.891532  7611 consensus_meta.cc:287] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.543s	user 0.009s	sys 0.000s
I20260709 12:14:00.962077  5191 raft_consensus.cc:1275] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:14:00.824959  7660 raft_consensus.cc:493] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:00.957656  5803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:00.858843  7525 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:00.949710  5088 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 2.585s (SENT) [suppressed 83 similar messages]
I20260709 12:14:00.939946  7592 raft_consensus.cc:493] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:00.741045  7463 raft_consensus.cc:493] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.891352  7400 raft_consensus.cc:3055] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:14:00.963438  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:00.702018  7644 raft_consensus.cc:3055] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:00.674106  7567 raft_consensus.cc:697] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:00.956712  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:00.953560  5834 rpcz_store.cc:276] 0709 12:13:59.786000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:59.835090 (+ 49090us) service_pool.cc:224] Handling call
0709 12:13:59.835436 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:59.966899 (+131463us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:59.966935 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:59.967474 (+   539us) log.cc:844] Serialized 26 byte log entry
0709 12:14:00.344420 (+376946us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:00.344459 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:00.826681 (+482222us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b54007d0d54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:00.826739 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:00.826793 (+    54us) raft_consensus.cc:1685] finished
0709 12:14:00.826808 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:00.952583 (+125775us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1208,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":104,"spinlock_wait_cycles":301380864,"thread_start_us":376564,"threads_started":1,"wal-append.queue_time_us":363967}
I20260709 12:14:01.026932  5198 raft_consensus.cc:1240] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 12:14:00.849351  7604 consensus_queue.cc:1048] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.123s
I20260709 12:14:00.963284  5801 leader_election.cc:304] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:00.958544  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:00.677685  7642 consensus_queue.cc:1059] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.304s
I20260709 12:14:00.977254  5804 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:14:01.030359  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 67141.3us
I20260709 12:14:00.978740  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:00.992218  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:00.939291  7625 leader_election.cc:290] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:00.703148  7528 leader_election.cc:290] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:00.924631  7583 leader_election.cc:290] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:00.939538  7475 raft_consensus.cc:493] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.959713  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:00.973431  7661 raft_consensus.cc:493] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
W20260709 12:14:00.981034  5088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:00.819468  7553 raft_consensus.cc:515] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:00.974545  7652 log.cc:927] Time spent T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.444s	user 0.000s	sys 0.004s
I20260709 12:14:01.025671  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:00.722910  7386 leader_election.cc:290] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:01.025997  5164 leader_election.cc:304] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:01.041653  5801 leader_election.cc:304] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:01.031211  5269 raft_consensus.cc:2393] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 5: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:00.674540  7666 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:01.031688  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:00.959630  7423 raft_consensus.cc:2749] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:01.034670  7670 raft_consensus.cc:493] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.106374  7618 raft_consensus.cc:493] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:01.118986  7670 raft_consensus.cc:515] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:01.119169  7618 raft_consensus.cc:515] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:01.035074  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 57982.3us
I20260709 12:14:01.121616  7669 raft_consensus.cc:2804] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:14:00.980645  5240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:01.025287  7571 raft_consensus.cc:3055] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:01.038901  5191 raft_consensus.cc:1240] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:01.041499  5088 leader_election.cc:304] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:01.032011  7463 raft_consensus.cc:515] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:00.963366  7611 raft_consensus.cc:515] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:00.958966  7662 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:00.979465  7579 consensus_queue.cc:1048] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 12:14:01.024240  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:01.077845  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:01.100740  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:00.982110  7596 consensus_queue.cc:1048] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 12:14:01.080111  5270 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
I20260709 12:14:01.103241  7553 leader_election.cc:290] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:01.069780  7583 raft_consensus.cc:2804] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:01.042235  7475 raft_consensus.cc:515] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:00.984232  7659 consensus_queue.cc:1059] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.126s
I20260709 12:14:01.044514  7525 raft_consensus.cc:3060] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:00.986706  7581 consensus_queue.cc:1059] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 12:14:01.028132  7644 raft_consensus.cc:740] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:01.031582  7400 raft_consensus.cc:740] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:01.114420  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:01.169010  5265 raft_consensus.cc:2468] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
I20260709 12:14:01.169997  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:00.984268  7321 consensus_queue.cc:1059] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.095s
I20260709 12:14:01.121944  5804 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:14:01.174605  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 52751.1us
I20260709 12:14:01.122167  5125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40402 (request call id 1926) took 1112 ms. Trace:
W20260709 12:14:01.122618  5802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:01.036490  5835 raft_consensus.cc:2410] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:14:01.045121  7661 raft_consensus.cc:515] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:01.121192  7670 leader_election.cc:290] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:01.123636  7567 consensus_queue.cc:237] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:01.124614  7325 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:01.121177  7618 leader_election.cc:290] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:01.116959  7601 leader_election.cc:290] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:01.126178  5273 raft_consensus.cc:1240] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:01.049160  7658 raft_consensus.cc:3055] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:01.038399  7528 raft_consensus.cc:2804] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:00.989979  7592 raft_consensus.cc:515] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:01.133688  7571 raft_consensus.cc:740] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:01.145219  7604 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.215802  7618 raft_consensus.cc:493] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:01.146811  7463 leader_election.cc:290] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:01.032232  7612 consensus_queue.cc:1059] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
I20260709 12:14:01.216295  7644 consensus_queue.cc:260] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:01.124670  7584 raft_consensus.cc:493] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:01.047497  7548 consensus_queue.cc:1048] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.090s
I20260709 12:14:01.151430  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:01.133834  7625 raft_consensus.cc:493] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.153916  5122 raft_consensus.cc:2368] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 5. Current term is 6.
I20260709 12:14:01.153903  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:00.983038  7660 raft_consensus.cc:515] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:01.231168  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 189741us
I20260709 12:14:01.158571  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:01.157094  5163 leader_election.cc:336] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 1.564s (SENT)
I20260709 12:14:01.234426  5124 raft_consensus.cc:2393] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 5: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
W20260709 12:14:01.234530  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 77470.6us
W20260709 12:14:01.235567  5163 leader_election.cc:336] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 1.586s (SENT)
I20260709 12:14:01.235950  5163 leader_election.cc:304] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:01.106016  7608 consensus_queue.cc:1059] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.103s
I20260709 12:14:01.144009  7669 raft_consensus.cc:697] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:01.159770  7581 raft_consensus.cc:3055] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:01.162453  7475 leader_election.cc:290] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:01.164678  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:01.166371  5120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59390 (request call id 477) took 1324 ms. Trace:
I20260709 12:14:01.152143  7583 raft_consensus.cc:493] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:01.118152  7666 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:01.181561  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:01.183693  5838 raft_consensus.cc:1275] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:01.159088  7627 raft_consensus.cc:2804] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:01.192329  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:01.330384  5265 raft_consensus.cc:2468] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 4.
I20260709 12:14:01.331254  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:01.331826  5265 raft_consensus.cc:2468] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
I20260709 12:14:01.321135  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:01.332710  5116 raft_consensus.cc:2393] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 6: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:01.185003  5164 leader_election.cc:304] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:01.217535  7612 raft_consensus.cc:3055] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:01.176596  5125 rpcz_store.cc:276] 0709 12:14:00.009744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:00.010243 (+   499us) service_pool.cc:224] Handling call
0709 12:14:00.044563 (+ 34320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:00.121044 (+ 76481us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:00.121081 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:00.249520 (+128439us) log.cc:844] Serialized 26 byte log entry
0709 12:14:00.373417 (+123897us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:00.373452 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:00.373509 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:00.925167 (+551658us) spinlock_profiling.cc:243] Waited 7.68 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e675e86e 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221 00007f84e67671d9 00007f84e6767169
0709 12:14:01.106472 (+181305us) raft_consensus.cc:1685] finished
0709 12:14:01.106492 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:01.122102 (+ 15610us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6476,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":122760,"spinlock_wait_cycles":17654144,"thread_start_us":123456,"threads_started":1,"wal-append.queue_time_us":222905}
I20260709 12:14:01.188792  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:01.200151  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:01.185626  7423 raft_consensus.cc:2804] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:01.226471  5269 raft_consensus.cc:2468] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 2.
I20260709 12:14:01.237596  5088 leader_election.cc:304] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:01.216408  7571 consensus_queue.cc:260] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:01.212234  7528 raft_consensus.cc:493] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:01.293743  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:01.372177  5804 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:01.372596  5124 raft_consensus.cc:2468] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 5.
I20260709 12:14:01.291030  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:01.373713  5121 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 4.
I20260709 12:14:01.303401  5120 rpcz_store.cc:276] 0709 12:13:59.842419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:59.842531 (+   112us) service_pool.cc:224] Handling call
0709 12:13:59.842814 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:00.934486 (+1091672us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:01.166093 (+231607us) spinlock_profiling.cc:243] Waited 937 ms on lock 0x7b540039e4d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:01.166302 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2154044288}
I20260709 12:14:01.321664  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:01.374672  5270 raft_consensus.cc:2468] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
I20260709 12:14:01.332545  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:14:01.336606  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 151692us
W20260709 12:14:01.375599  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 140045us
I20260709 12:14:01.376464  5164 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:01.376722  5838 raft_consensus.cc:1275] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:01.334528  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:01.334525  5273 raft_consensus.cc:2410] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260709 12:14:01.378278  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
W20260709 12:14:01.379076  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 175552us
I20260709 12:14:01.195363  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:01.201989  7658 raft_consensus.cc:740] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:01.379626  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:01.380831  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:01.380487  7658 consensus_queue.cc:260] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:01.381907  7658 raft_consensus.cc:3060] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:01.381989  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:01.356091  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:01.219902  7661 leader_election.cc:290] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:01.369799  5200 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:01.383523  5200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:47744 (request call id 1831) took 1699 ms. Trace:
I20260709 12:14:01.383857  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:01.370767  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:01.194567  7671 consensus_queue.cc:1048] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:14:01.382663  5270 raft_consensus.cc:2468] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
I20260709 12:14:01.385180  5117 raft_consensus.cc:2468] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 3.
I20260709 12:14:01.385885  5834 raft_consensus.cc:2393] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 7: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:01.396080  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:01.206234  7325 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:01.386161  5265 raft_consensus.cc:1275] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:01.383924  5200 rpcz_store.cc:276] 0709 12:13:59.683947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:59.693522 (+  9575us) service_pool.cc:224] Handling call
0709 12:14:01.354662 (+1661140us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b24002c2028. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3959cb9 00007f84e3957dcb 00007f84e3a562b1 00007f84e3a51848 00007f84e3a517ad 00007f84e4e929a7 00007f84e6b1f85c 00007f84e6b1f699 00007f84e6b70012 00007f84e6bbaa55
0709 12:14:01.383420 (+ 28758us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37272960}
W20260709 12:14:01.388598  5163 leader_election.cc:336] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 1.629s (SENT)
I20260709 12:14:01.418642  5163 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
W20260709 12:14:01.390842  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 153301us
I20260709 12:14:01.391651  5266 raft_consensus.cc:2468] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 4.
I20260709 12:14:01.292196  7611 leader_election.cc:290] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:01.421785  7679 log.cc:927] Time spent T 00000000000000000000000000000000 P 221aa011207d421b9725197ff8bed389: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
I20260709 12:14:01.216411  7618 raft_consensus.cc:515] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:01.392812  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:01.371732  7396 raft_consensus.cc:2804] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:01.428145  7666 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:01.428673  7396 raft_consensus.cc:493] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:01.428995  7695 raft_consensus.cc:493] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.460047  7396 raft_consensus.cc:3060] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:01.460343  7695 raft_consensus.cc:515] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:01.460768  7669 consensus_queue.cc:237] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:01.461947  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:01.397114  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:01.462553  5200 raft_consensus.cc:3060] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:01.340262  7627 raft_consensus.cc:493] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:01.403106  7386 raft_consensus.cc:2749] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:01.404484  7670 raft_consensus.cc:493] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.236285  7604 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:01.292863  7608 consensus_queue.cc:1048] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.101s
I20260709 12:14:01.477471  5200 raft_consensus.cc:2468] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
I20260709 12:14:01.421636  7592 leader_election.cc:290] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:01.383738  5119 raft_consensus.cc:2468] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 6.
I20260709 12:14:01.387475  7475 raft_consensus.cc:3060] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:01.292335  7625 raft_consensus.cc:515] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:01.507198  7625 leader_election.cc:290] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:01.508131  7659 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:01.508836  7463 raft_consensus.cc:493] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.508702  7659 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:01.239440  7584 raft_consensus.cc:515] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:01.510860  7659 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:01.292637  7660 leader_election.cc:290] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:01.412725  7684 log.cc:927] Time spent T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.176s	user 0.000s	sys 0.000s
I20260709 12:14:01.384068  7528 raft_consensus.cc:3060] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:01.411056  7571 raft_consensus.cc:3060] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:01.520740  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:01.235473  7400 consensus_queue.cc:260] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:01.521739  5833 raft_consensus.cc:2410] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:14:01.521833  7400 raft_consensus.cc:3060] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:01.522692  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:01.523556  5833 raft_consensus.cc:2393] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 5: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:01.524724  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:01.341423  7321 consensus_queue.cc:1243] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer ad2f9a1e2f7a45429fa69fd23d09f821 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:14:01.340739  7596 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.329696  7553 raft_consensus.cc:3055] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:01.416429  5834 raft_consensus.cc:2393] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 6: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:01.526569  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:01.354018  7589 raft_consensus.cc:493] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.333822  7583 raft_consensus.cc:3060] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:01.297430  7581 raft_consensus.cc:740] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:01.529759  7553 raft_consensus.cc:740] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
W20260709 12:14:01.530510  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:01.427496  7642 consensus_queue.cc:1048] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:01.378028  7423 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:01.530325  7596 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:01.531111  7423 raft_consensus.cc:3060] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:01.395080  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:01.532143  5089 leader_election.cc:304] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:01.532975  7611 raft_consensus.cc:2804] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:01.397625  7439 raft_consensus.cc:2804] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:01.469678  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:01.478014  7670 raft_consensus.cc:515] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:01.473928  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:01.474550  5124 raft_consensus.cc:1240] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:01.475672  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:01.476707  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:01.341423  7612 raft_consensus.cc:740] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:01.370347  7665 raft_consensus.cc:2749] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:01.479336  7690 raft_consensus.cc:493] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.480609  7661 raft_consensus.cc:493] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.481735  7695 leader_election.cc:290] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:01.483126  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:01.480335  7618 leader_election.cc:290] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:01.486107  7691 log.cc:927] Time spent T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:14:01.487671  7604 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:01.480458  5088 leader_election.cc:304] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:01.462918  7653 raft_consensus.cc:2749] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:01.467964  7627 raft_consensus.cc:3060] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:01.564602  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 84211.6us
I20260709 12:14:01.533516  7439 raft_consensus.cc:493] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:01.569342  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:01.501685  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 113116us
I20260709 12:14:01.502121  7579 raft_consensus.cc:493] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:01.501807  7592 raft_consensus.cc:493] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.510914  7584 leader_election.cc:290] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:01.410971  7675 log.cc:927] Time spent T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
I20260709 12:14:01.525635  5833 raft_consensus.cc:2468] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 6.
I20260709 12:14:01.527786  7589 raft_consensus.cc:515] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:01.530015  7581 consensus_queue.cc:260] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:01.358208  7644 raft_consensus.cc:3060] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:01.535323  5836 raft_consensus.cc:2393] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 4: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:01.534435  5193 raft_consensus.cc:3060] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:01.478279  7603 raft_consensus.cc:3060] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:01.585878  7581 raft_consensus.cc:3060] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:01.533114  5273 raft_consensus.cc:2410] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:14:01.537225  5125 raft_consensus.cc:1240] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:01.582494  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:01.587766  5836 raft_consensus.cc:2468] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
I20260709 12:14:01.588665  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:01.589936  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:01.533402  7611 raft_consensus.cc:493] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:01.590598  5836 raft_consensus.cc:2468] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
I20260709 12:14:01.568491  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:01.547610  5120 raft_consensus.cc:1240] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:01.497661  5238 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:01.570050  5200 raft_consensus.cc:2468] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
W20260709 12:14:01.541051  7686 log.cc:927] Time spent T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.113s	user 0.000s	sys 0.003s
I20260709 12:14:01.568495  7660 raft_consensus.cc:2804] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:01.535275  7670 leader_election.cc:290] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:01.575826  5163 leader_election.cc:336] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 1.670s (SENT)
I20260709 12:14:01.602562  5163 leader_election.cc:304] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:01.572034  7439 raft_consensus.cc:3060] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:01.578258  7553 consensus_queue.cc:260] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:01.509363  7463 raft_consensus.cc:515] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:01.555766  7525 raft_consensus.cc:2749] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:01.582321  5197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 1849) took 1049 ms. Trace:
I20260709 12:14:01.586586  7528 raft_consensus.cc:515] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:01.623208  7528 leader_election.cc:290] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:01.533325  7325 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:01.593072  7611 raft_consensus.cc:3060] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:01.577574  7612 consensus_queue.cc:260] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:01.623901  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:01.624462  7612 raft_consensus.cc:3060] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:01.617007  7695 raft_consensus.cc:2749] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:01.625801  7553 raft_consensus.cc:3060] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:01.617005  7660 raft_consensus.cc:697] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
W20260709 12:14:01.626364  5240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:01.626948  5240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:01.600867  7618 consensus_queue.cc:1059] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:01.629791  7618 raft_consensus.cc:3055] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:01.630151  7618 raft_consensus.cc:740] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:01.630985  7618 consensus_queue.cc:260] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:01.632126  7618 raft_consensus.cc:3060] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:01.624572  5835 raft_consensus.cc:2468] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
W20260709 12:14:01.603193  5804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:01.606483  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:01.610106  5272 raft_consensus.cc:2410] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:14:01.613945  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:01.635308  5200 raft_consensus.cc:2468] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 4.
W20260709 12:14:01.615264  5163 leader_election.cc:336] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 1.671s (SENT)
I20260709 12:14:01.615808  5193 raft_consensus.cc:2468] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:14:01.636101  5163 leader_election.cc:304] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:01.557401  7661 raft_consensus.cc:515] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:01.619293  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 121737us
I20260709 12:14:01.601432  7475 raft_consensus.cc:2749] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:01.577282  7592 raft_consensus.cc:515] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:01.620810  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:01.618691  5197 rpcz_store.cc:276] 0709 12:14:00.532953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:00.533670 (+   717us) service_pool.cc:224] Handling call
0709 12:14:00.554502 (+ 20832us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:00.657020 (+102518us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:00.657054 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:00.680702 (+ 23648us) log.cc:844] Serialized 26 byte log entry
0709 12:14:00.960115 (+279413us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:00.960154 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:00.960227 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:01.582069 (+621842us) raft_consensus.cc:1685] finished
0709 12:14:01.582092 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:01.582239 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14996,"raft.queue_time_us":67033,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":15992,"spinlock_wait_cycles":874240,"thread_start_us":348121,"threads_started":2,"wal-append.queue_time_us":489716}
I20260709 12:14:01.577127  7579 raft_consensus.cc:515] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:01.601315  7588 leader_election.cc:290] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:01.664150  5238 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:01.606895  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:01.550522  7690 raft_consensus.cc:515] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:01.669404  7463 leader_election.cc:290] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:01.669893  7690 leader_election.cc:290] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:01.671538  7589 leader_election.cc:290] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:01.634182  5195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41416 (request call id 435) took 1792 ms. Trace:
I20260709 12:14:01.673708  5195 rpcz_store.cc:276] 0709 12:13:59.841905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:00.333232 (+491327us) service_pool.cc:224] Handling call
0709 12:14:00.359953 (+ 26721us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:00.432894 (+ 72941us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:01.633974 (+1201080us) spinlock_profiling.cc:243] Waited 21.4 ms on lock 0x7b54001388d0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc28ad 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:01.634123 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49235712}
I20260709 12:14:01.617642  7604 consensus_queue.cc:1059] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 12:14:01.675230  7604 raft_consensus.cc:3055] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:01.675609  7604 raft_consensus.cc:740] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:01.676507  7604 consensus_queue.cc:260] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:01.666556  7695 raft_consensus.cc:2749] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:01.679127  7660 consensus_queue.cc:237] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:01.680461  7579 leader_election.cc:290] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:14:01.637197  5163 leader_election.cc:336] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 1.679s (SENT)
I20260709 12:14:01.667467  5088 leader_election.cc:304] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:01.619057  7670 raft_consensus.cc:2749] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:01.697185  5163 leader_election.cc:304] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:01.697962  5238 leader_election.cc:304] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:01.648867  7653 raft_consensus.cc:2749] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:01.698593  7463 consensus_queue.cc:1048] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:14:01.681995  7596 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:01.715564  5238 leader_election.cc:304] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:01.675657  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:14:01.710942  5274 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34672 (request call id 1771) took 1916 ms (client timeout 2155 ms). Trace:
I20260709 12:14:01.620252  7643 consensus_queue.cc:1059] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.142s
W20260709 12:14:01.714869  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 77701.8us
W20260709 12:14:01.709818  5267 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50932 (request call id 487) took 2195 ms (client timeout 1954 ms). Trace:
W20260709 12:14:01.717154  5237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:01.717818  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:01.725907  5266 raft_consensus.cc:2376] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 3. Re-sending same reply.
I20260709 12:14:01.718994  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:01.637996  7423 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:01.720023  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:01.720001  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:01.731292  5088 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:01.703359  7658 raft_consensus.cc:2749] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:01.719157  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:01.733906  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:01.734282  5196 raft_consensus.cc:2468] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 6.
I20260709 12:14:01.697244  7588 raft_consensus.cc:493] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:01.736644  5268 raft_consensus.cc:2393] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 7: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
W20260709 12:14:01.725929  5267 rpcz_store.cc:269] 0709 12:13:59.514207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:59.515508 (+  1301us) service_pool.cc:224] Handling call
0709 12:14:01.709596 (+2194088us) spinlock_profiling.cc:243] Waited 478 ms on lock 0x7b5400104ad4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:01.709744 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1100454784}
I20260709 12:14:01.667804  7325 consensus_queue.cc:1048] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:14:01.745488  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:01.746378  5266 raft_consensus.cc:2410] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:14:01.730330  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:14:01.723028  5274 rpcz_store.cc:269] 0709 12:13:59.794611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:00.355062 (+560451us) service_pool.cc:224] Handling call
0709 12:14:01.710757 (+1355695us) spinlock_profiling.cc:243] Waited 402 ms on lock 0x7b5400171e54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:01.710884 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":924045568}
W20260709 12:14:01.725472  5163 leader_election.cc:336] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 1.693s (SENT)
I20260709 12:14:01.731917  5193 raft_consensus.cc:2468] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 4.
W20260709 12:14:01.732450  5237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:01.747673  5163 leader_election.cc:304] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
W20260709 12:14:01.748826  5163 leader_election.cc:336] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 1.697s (SENT)
I20260709 12:14:01.749027  5237 leader_election.cc:304] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:01.749307  5163 leader_election.cc:304] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:01.693892  7583 raft_consensus.cc:515] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:01.724001  7589 raft_consensus.cc:493] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.735852  5270 raft_consensus.cc:2393] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 6: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:01.711993  7690 raft_consensus.cc:2749] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:01.703490  7571 raft_consensus.cc:2749] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:01.736886  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:01.758919  5832 raft_consensus.cc:1240] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:01.758109  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:01.760437  5267 raft_consensus.cc:2393] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 5: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:01.760682  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:01.761185  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:01.761400  5274 raft_consensus.cc:2468] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 4.
W20260709 12:14:01.761665  5163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:01.761904  5269 raft_consensus.cc:2393] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 6: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:01.741968  7548 raft_consensus.cc:2804] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:01.741770  5118 raft_consensus.cc:2468] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 4.
I20260709 12:14:01.723829  7695 raft_consensus.cc:2804] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:01.733125  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:01.733134  7596 raft_consensus.cc:493] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.729862  5830 raft_consensus.cc:2468] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
I20260709 12:14:01.757731  5237 leader_election.cc:400] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Vote denied by peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455) with higher term. Message: Invalid argument: T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 3. Current term is 4.
I20260709 12:14:01.703209  7439 raft_consensus.cc:515] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:01.734496  5271 raft_consensus.cc:1240] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:01.727690  7525 consensus_queue.cc:1059] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:14:01.753657  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:01.757433  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:01.788897  5266 raft_consensus.cc:2393] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 7: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:01.788821  5270 raft_consensus.cc:2393] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 3: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:01.789755  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:01.769647  5200 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 5.
I20260709 12:14:01.762712  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:01.758037  7670 raft_consensus.cc:2749] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:01.744026  5088 leader_election.cc:304] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:01.773448  5237 leader_election.cc:304] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:01.726810  7604 raft_consensus.cc:3060] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:01.745054  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:01.783198  5834 raft_consensus.cc:2393] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 7: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
W20260709 12:14:01.783663  5802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:01.762548  5163 leader_election.cc:336] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 1.753s (SENT)
I20260709 12:14:01.794322  5237 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:01.794831  5163 leader_election.cc:304] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:01.795558  5237 leader_election.cc:304] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:14:01.791750  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 47792.3us
I20260709 12:14:01.790385  5274 raft_consensus.cc:2376] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 5. Re-sending same reply.
I20260709 12:14:01.790629  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:01.769281  7548 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:01.767712  7643 raft_consensus.cc:2749] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:01.790011  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:01.796721  5267 raft_consensus.cc:2376] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 4. Re-sending same reply.
I20260709 12:14:01.800534  5270 raft_consensus.cc:3060] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:01.783475  7590 raft_consensus.cc:3055] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:01.759670  7463 raft_consensus.cc:2749] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:01.791095  5268 raft_consensus.cc:2376] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 3. Re-sending same reply.
I20260709 12:14:01.841141  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:01.796698  5088 leader_election.cc:304] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:14:01.842312  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 45686.3us
I20260709 12:14:01.770665  7544 raft_consensus.cc:493] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.800935  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:01.796976  5117 raft_consensus.cc:1240] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:01.842989  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:01.787807  7695 raft_consensus.cc:697] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 6 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:01.738391  7627 raft_consensus.cc:515] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:01.802646  7625 raft_consensus.cc:2804] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:01.800567  5195 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 3.
I20260709 12:14:01.803448  7396 raft_consensus.cc:515] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:01.748425  7588 raft_consensus.cc:515] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:01.804780  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:01.862119  5831 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 5.
I20260709 12:14:01.863706  5831 raft_consensus.cc:1275] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 12:14:01.806537  7703 log.cc:927] Time spent T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 12:14:01.807799  7712 raft_consensus.cc:2749] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:01.863737  7588 leader_election.cc:290] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:01.866071  7695 consensus_queue.cc:237] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:01.865149  5831 raft_consensus.cc:1240] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:01.809028  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:01.760293  7589 raft_consensus.cc:515] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:01.870995  7588 raft_consensus.cc:493] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.871542  7588 raft_consensus.cc:515] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:01.871872  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:01.872454  7589 leader_election.cc:290] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:01.802659  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:01.799151  7548 raft_consensus.cc:3060] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:01.812357  5265 raft_consensus.cc:2410] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:14:01.812784  7571 raft_consensus.cc:2749] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:01.813776  5237 leader_election.cc:304] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:01.797288  7690 raft_consensus.cc:2804] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:01.876698  5830 raft_consensus.cc:2468] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 3.
I20260709 12:14:01.876888  7712 raft_consensus.cc:2804] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:01.876755  7690 raft_consensus.cc:493] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:01.877936  7396 leader_election.cc:290] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:01.878091  7712 raft_consensus.cc:697] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 3 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:01.849900  7608 raft_consensus.cc:2749] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:01.816828  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:01.821884  7692 log.cc:927] Time spent T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.401s	user 0.000s	sys 0.002s
I20260709 12:14:01.826927  5270 raft_consensus.cc:2468] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:14:01.852679  7625 raft_consensus.cc:493] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:01.837997  7647 raft_consensus.cc:2749] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:01.887138  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:01.838848  7661 leader_election.cc:290] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:01.843636  5274 raft_consensus.cc:2376] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 4. Re-sending same reply.
I20260709 12:14:01.844627  5268 raft_consensus.cc:2410] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:14:01.843029  5088 leader_election.cc:304] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:14:01.889456  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 60516us
W20260709 12:14:01.890000  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 47042.5us
I20260709 12:14:01.890787  5088 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:01.849625  5836 raft_consensus.cc:1240] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:14:01.857216  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:01.785279  7611 raft_consensus.cc:515] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:01.784468  7596 raft_consensus.cc:515] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:01.872996  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:01.823889  7590 raft_consensus.cc:740] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
W20260709 12:14:01.876142  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 62438.1us
I20260709 12:14:01.877949  7690 raft_consensus.cc:3060] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:01.902292  7661 raft_consensus.cc:493] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.902858  7661 raft_consensus.cc:515] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:01.903515  7439 leader_election.cc:290] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:01.882567  5191 raft_consensus.cc:2468] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 6.
I20260709 12:14:01.853371  7525 raft_consensus.cc:493] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:01.850629  7567 raft_consensus.cc:493] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:01.884953  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:01.886276  5193 raft_consensus.cc:1275] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:01.853011  7544 raft_consensus.cc:515] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:01.836858  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 74325.1us
I20260709 12:14:01.815744  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:01.896396  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:01.897186  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:01.897537  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:01.898111  7611 leader_election.cc:290] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:01.898228  7601 raft_consensus.cc:3055] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:01.898945  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:01.916208  7588 leader_election.cc:290] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:01.899492  7627 leader_election.cc:290] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:01.892508  5801 leader_election.cc:304] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:01.904654  5267 raft_consensus.cc:2376] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 7. Re-sending same reply.
I20260709 12:14:01.902738  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:01.905352  5237 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:01.890462  7625 raft_consensus.cc:3060] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:01.891675  5266 raft_consensus.cc:3060] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:01.916916  7525 raft_consensus.cc:515] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:01.926851  7589 consensus_queue.cc:1048] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:01.911803  5270 raft_consensus.cc:2393] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 6: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:01.913537  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:01.914717  5163 leader_election.cc:336] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 1.754s (SENT)
I20260709 12:14:01.915674  5836 raft_consensus.cc:2393] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 6: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:01.915164  5837 raft_consensus.cc:2468] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 4.
I20260709 12:14:01.917708  5200 raft_consensus.cc:2468] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 2.
I20260709 12:14:01.917016  7423 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:01.922834  5829 raft_consensus.cc:1275] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:14:01.917327  7567 raft_consensus.cc:515] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:01.931277  5237 leader_election.cc:304] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:01.932509  5266 raft_consensus.cc:2468] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 5.
I20260709 12:14:01.895121  7660 raft_consensus.cc:2804] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:01.935019  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:01.935871  5266 raft_consensus.cc:2468] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 2.
I20260709 12:14:01.936645  7713 raft_consensus.cc:2804] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:01.937166  5837 raft_consensus.cc:1275] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:14:01.937899  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:01.940222  5270 raft_consensus.cc:2410] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:14:01.938195  5118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40402 (request call id 1922) took 2241 ms (client timeout 2025 ms). Trace:
W20260709 12:14:01.940716  5118 rpcz_store.cc:269] 0709 12:13:59.697167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:59.697305 (+   138us) service_pool.cc:224] Handling call
0709 12:14:01.937975 (+2240670us) spinlock_profiling.cc:243] Waited 1.96 s on lock 0x7b54003fd9d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:01.938092 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4514823936}
I20260709 12:14:01.939435  5837 pending_rounds.cc:85] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088: Aborting all ops after (but not including) 5
I20260709 12:14:01.942134  5837 pending_rounds.cc:107] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:14:01.942489  5837 raft_consensus.cc:2889] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:01.921265  5088 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:01.911197  7618 raft_consensus.cc:2749] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:01.945418  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:01.950604  5270 raft_consensus.cc:2410] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260709 12:14:01.951706  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:01.913985  7661 leader_election.cc:290] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:01.952464  5270 raft_consensus.cc:2393] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 4: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:01.945726  5237 leader_election.cc:400] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 3 pre-election: Vote denied by peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455) with higher term. Message: Invalid argument: T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 3. Current term is 4.
I20260709 12:14:01.916224  7601 raft_consensus.cc:740] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:01.879074  7712 consensus_queue.cc:237] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:01.964257  7601 consensus_queue.cc:260] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:01.965518  7627 raft_consensus.cc:2804] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:01.965821  5829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46100 (request call id 837) took 1024 ms. Trace:
I20260709 12:14:01.966218  5829 rpcz_store.cc:276] 0709 12:14:00.941852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:00.948064 (+  6212us) service_pool.cc:224] Handling call
0709 12:14:01.922263 (+974199us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b58000b0498. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb9cfc0 00007f84ebb87929 00007f84ebb873d2 00007f84e50febd4
0709 12:14:01.922466 (+   203us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:01.939008 (+ 16542us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:01.965744 (+ 26736us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26386816}
I20260709 12:14:01.967238  5237 leader_election.cc:304] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:01.957195  5270 raft_consensus.cc:1275] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:14:01.934325  7611 consensus_queue.cc:1048] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:14:01.968869  7592 leader_election.cc:290] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:01.969213  5270 raft_consensus.cc:1275] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:01.954902  5088 leader_election.cc:304] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
W20260709 12:14:01.970082  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 55384.7us
I20260709 12:14:01.965354  7601 raft_consensus.cc:3060] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:01.945914  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:01.952015  7713 raft_consensus.cc:697] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 5 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:01.972946  5163 leader_election.cc:304] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:01.954739  5801 leader_election.cc:304] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:01.971342  5237 leader_election.cc:304] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:01.970518  5270 raft_consensus.cc:1275] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:14:01.942080  7660 raft_consensus.cc:493] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:01.984758  7581 raft_consensus.cc:2804] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:01.976270  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:01.985920  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:01.986588  5192 raft_consensus.cc:2468] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 6.
I20260709 12:14:01.990414  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:01.985920  5194 raft_consensus.cc:3060] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:01.994068  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:01.974398  5266 raft_consensus.cc:2376] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 4. Re-sending same reply.
I20260709 12:14:01.941643  7571 raft_consensus.cc:2749] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:01.997229  5121 raft_consensus.cc:2468] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 5.
I20260709 12:14:01.997884  5166 leader_election.cc:400] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 election: Vote denied by peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443) with higher term. Message: Invalid argument: T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 5. Current term is 6.
I20260709 12:14:02.000057  5166 leader_election.cc:403] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:14:02.000883  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:02.001730  5118 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 3.
I20260709 12:14:01.998142  5088 leader_election.cc:304] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:02.004940  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:02.005686  5266 raft_consensus.cc:2468] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 2.
I20260709 12:14:01.991577  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:01.902683  7590 consensus_queue.cc:260] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:01.965242  7567 leader_election.cc:290] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:01.963375  7662 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:02.008977  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:02.188844  5804 leader_election.cc:304] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:02.070843  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:02.032793  5801 leader_election.cc:304] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:02.207149  5197 raft_consensus.cc:2468] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 5.
W20260709 12:14:02.067909  5240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:02.188310  5116 raft_consensus.cc:1217] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Deduplicated request from leader. Original: 1.1->[3.2-5.3]   Dedup: 5.3->[]
W20260709 12:14:02.062534  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 64804.9us
I20260709 12:14:02.068816  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:02.069552  5268 raft_consensus.cc:1275] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:02.098412  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:02.210045  5122 raft_consensus.cc:2468] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 4.
W20260709 12:14:02.114995  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 104328us
I20260709 12:14:02.182564  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:02.144264  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:02.211409  5192 raft_consensus.cc:3060] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:02.063131  5088 leader_election.cc:336] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 2.012s (SENT)
I20260709 12:14:02.222465  5088 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:02.016213  5194 raft_consensus.cc:2468] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 7.
I20260709 12:14:02.164762  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:02.120234  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:02.024797  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:02.064667  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:02.026626  5237 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:02.213737  5125 raft_consensus.cc:2468] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 4.
I20260709 12:14:02.224561  5270 raft_consensus.cc:3060] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:02.214146  5116 raft_consensus.cc:1240] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 12:14:02.063784  5199 raft_consensus.cc:1240] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 2. Current term is 3. Ops: []
W20260709 12:14:02.215745  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 183027us
I20260709 12:14:02.207360  5804 leader_election.cc:304] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:01.985239  7581 raft_consensus.cc:493] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:01.978628  7627 raft_consensus.cc:697] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:02.012598  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:02.257061  5834 raft_consensus.cc:3060] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:02.249392  5123 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 5.
I20260709 12:14:01.936103  7588 raft_consensus.cc:2804] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:14:02.237656  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 211072us
I20260709 12:14:01.979225  7463 raft_consensus.cc:2804] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:01.978919  7525 leader_election.cc:290] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:02.230921  5804 leader_election.cc:304] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:02.260461  5237 leader_election.cc:304] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:02.244760  5832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46100 (request call id 844) took 1062 ms. Trace:
I20260709 12:14:02.255909  5163 leader_election.cc:304] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:14:02.073334  7716 log.cc:927] Time spent T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:14:02.251642  5117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59390 (request call id 479) took 1222 ms. Trace:
I20260709 12:14:02.278640  5117 rpcz_store.cc:276] 0709 12:14:01.029116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:01.543480 (+514364us) service_pool.cc:224] Handling call
0709 12:14:01.543850 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:01.843401 (+299551us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:02.251380 (+407979us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b540038d6d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:02.251577 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":581704448}
I20260709 12:14:01.993449  7618 raft_consensus.cc:2804] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:01.983666  7592 raft_consensus.cc:2804] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:02.280479  5163 leader_election.cc:304] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:01.994894  7660 raft_consensus.cc:3060] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:01.993220  7651 raft_consensus.cc:2749] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:02.271500  5804 leader_election.cc:304] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:02.149017  5829 raft_consensus.cc:1275] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:02.065129  7666 raft_consensus.cc:2749] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443) with higher term. Message: Invalid argument: T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 5. Current term is 6.
I20260709 12:14:02.156047  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:02.068068  7647 consensus_queue.cc:1048] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.242s
I20260709 12:14:02.290340  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:02.309051  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:02.062114  7439 raft_consensus.cc:2804] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:02.248624  7662 raft_consensus.cc:493] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:02.248804  7570 raft_consensus.cc:2804] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:02.249218  7580 raft_consensus.cc:2804] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:02.249461  7661 raft_consensus.cc:2804] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:02.256314  7581 raft_consensus.cc:3060] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:02.308641  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 245525us
I20260709 12:14:02.252676  7571 raft_consensus.cc:2804] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:02.075137  7548 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:02.261397  5195 raft_consensus.cc:2468] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 2.
I20260709 12:14:02.314486  7321 raft_consensus.cc:2804] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:02.249029  7400 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:02.162699  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:02.265069  7463 raft_consensus.cc:493] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:02.266443  5832 rpcz_store.cc:276] 0709 12:14:01.182056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:01.182196 (+   140us) service_pool.cc:224] Handling call
0709 12:14:01.182490 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:01.759468 (+576978us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:02.244411 (+484943us) spinlock_profiling.cc:243] Waited 576 ms on lock 0x7b540068ef54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:02.244686 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1325167488}
I20260709 12:14:02.326458  5122 raft_consensus.cc:2376] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 4. Re-sending same reply.
I20260709 12:14:02.326378  5268 raft_consensus.cc:2468] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 7.
I20260709 12:14:02.165755  7690 raft_consensus.cc:515] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:02.155441  7625 raft_consensus.cc:515] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:02.330297  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 49918.5us
I20260709 12:14:02.338867  7580 raft_consensus.cc:493] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:02.334913  7618 raft_consensus.cc:697] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:02.308280  7325 raft_consensus.cc:2749] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:02.334722  5270 raft_consensus.cc:2468] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
I20260709 12:14:02.318642  7589 raft_consensus.cc:2804] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:02.341876  7596 leader_election.cc:290] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:02.266142  7567 consensus_queue.cc:1048] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 12:14:02.290071  7671 raft_consensus.cc:2749] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:02.349591  7321 raft_consensus.cc:493] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:02.327486  7592 raft_consensus.cc:493] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:02.335270  7695 raft_consensus.cc:493] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:02.365137  5163 leader_election.cc:304] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:02.390226  5163 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:02.354997  7400 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:02.248499  7644 consensus_queue.cc:1048] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 12:14:02.337147  7396 raft_consensus.cc:2749] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:02.064349  7713 consensus_queue.cc:237] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:02.337826  7570 raft_consensus.cc:493] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:02.342921  7571 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:02.339066  7661 raft_consensus.cc:493] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:02.402825  7570 raft_consensus.cc:3060] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:02.402655  7618 consensus_queue.cc:237] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:02.406380  7548 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:02.395872  7695 raft_consensus.cc:515] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:02.409026  7695 leader_election.cc:290] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:02.371112  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:02.409971  7571 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:02.410384  5268 raft_consensus.cc:3060] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:14:02.362728  7463 raft_consensus.cc:3060] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:02.391505  5163 leader_election.cc:304] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:02.411428  7570 raft_consensus.cc:515] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:02.365139  7611 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:02.366976  7580 raft_consensus.cc:3060] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:02.340696  7662 raft_consensus.cc:515] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:02.365477  5119 raft_consensus.cc:2468] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 6.
I20260709 12:14:02.369146  7589 raft_consensus.cc:493] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:02.386483  7627 consensus_queue.cc:237] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:02.397884  7647 raft_consensus.cc:2804] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:02.389213  7592 raft_consensus.cc:3060] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:02.409641  7661 raft_consensus.cc:3060] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:02.339720  7439 raft_consensus.cc:697] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:02.402391  5271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34674 (request call id 1866) took 2410 ms. Trace:
I20260709 12:14:02.416946  5192 raft_consensus.cc:2468] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
I20260709 12:14:02.422653  7625 leader_election.cc:290] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:02.389545  7321 raft_consensus.cc:3060] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:02.431841  5271 rpcz_store.cc:276] 0709 12:13:59.991610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:00.485696 (+494086us) service_pool.cc:224] Handling call
0709 12:14:01.714806 (+1229110us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:01.788712 (+ 73906us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:02.402149 (+613437us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b5400104ad0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc28ad 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:02.402311 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2817293184}
I20260709 12:14:02.433116  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:02.433954  5271 raft_consensus.cc:1275] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:14:02.434665  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:02.398646  7666 raft_consensus.cc:2749] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:02.439971  7611 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:02.391634  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 131274us
I20260709 12:14:02.458406  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:02.460007  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:02.474810  5119 raft_consensus.cc:2468] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 5.
I20260709 12:14:02.477000  7580 raft_consensus.cc:515] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:02.477357  7571 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:02.479816  7580 leader_election.cc:290] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:02.437247  7662 leader_election.cc:290] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:02.481393  5163 leader_election.cc:304] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:02.446846  7589 raft_consensus.cc:3060] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:02.420342  7644 raft_consensus.cc:3060] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:02.435484  7647 raft_consensus.cc:493] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:02.493021  5163 leader_election.cc:304] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:14:02.493927  5088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:02.465346  7671 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:02.500509  5088 leader_election.cc:304] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:14:02.499619  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 110587us
I20260709 12:14:02.506636  5268 raft_consensus.cc:2468] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 7.
I20260709 12:14:02.507690  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:02.508450  5268 raft_consensus.cc:2393] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 5: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:02.477057  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:02.509773  5088 leader_election.cc:336] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 1.509s (SENT)
I20260709 12:14:02.510121  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:02.513358  5088 leader_election.cc:304] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:02.510612  7608 raft_consensus.cc:2749] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:02.508905  7645 raft_consensus.cc:2764] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:14:02.515422  7608 raft_consensus.cc:2749] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:02.493952  7571 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:02.516878  5163 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:02.438082  7439 consensus_queue.cc:237] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:02.519279  5834 raft_consensus.cc:2468] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 7.
I20260709 12:14:02.501044  7548 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:02.497843  7690 leader_election.cc:290] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:02.500797  7647 raft_consensus.cc:3060] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:02.497929  7544 leader_election.cc:290] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:02.500577  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:02.522960  5088 leader_election.cc:304] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:02.557941  5163 leader_election.cc:304] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:02.539716  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:02.559041  5270 raft_consensus.cc:2393] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 4: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:02.568034  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:02.520959  7528 raft_consensus.cc:2764] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:14:02.580212  5166 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:02.571933  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:02.528183  7651 raft_consensus.cc:2749] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:02.510563  7671 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:02.584956  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:02.600677  5270 raft_consensus.cc:2393] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 7: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:02.590582  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:14:02.574788  7721 log.cc:927] Time spent T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 12:14:02.596673  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:02.597923  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:02.601275  5266 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 3.
I20260709 12:14:02.609359  5267 raft_consensus.cc:3060] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:02.609850  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:02.610561  5266 raft_consensus.cc:2468] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 4.
I20260709 12:14:02.611526  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:02.605611  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:02.619146  5270 raft_consensus.cc:2468] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 3.
I20260709 12:14:02.620113  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:02.571206  5830 raft_consensus.cc:2468] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 3.
I20260709 12:14:02.622225  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:02.622992  5834 raft_consensus.cc:2393] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 7: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:02.577935  7611 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:02.623374  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 47357.4us
I20260709 12:14:02.612152  5266 raft_consensus.cc:2468] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:14:02.532718  7548 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:02.635887  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:02.617091  7690 raft_consensus.cc:2804] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:02.640159  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:02.584820  7567 raft_consensus.cc:2749] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:02.629347  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:02.645092  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:02.645793  5266 raft_consensus.cc:2468] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 3.
I20260709 12:14:02.646622  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:02.627205  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:02.643719  5238 leader_election.cc:304] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:02.647817  5270 raft_consensus.cc:2393] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 5: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
W20260709 12:14:02.645097  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 64971.7us
W20260709 12:14:02.622529  7712 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.010s	sys 0.016s
I20260709 12:14:02.648761  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:02.628836  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
W20260709 12:14:02.639575  5007 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet c7bb7b814fea4a2488cc39d06fc90483 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
W20260709 12:14:02.647817  5163 leader_election.cc:336] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 1.969s (SENT)
I20260709 12:14:02.649883  5238 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:02.650853  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:02.651093  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:02.630134  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:02.632335  7666 raft_consensus.cc:2804] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:02.606741  7731 consensus_queue.cc:1048] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 12:14:02.632843  7400 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:02.656365  5238 leader_election.cc:304] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:02.637339  7651 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:02.665762  7400 raft_consensus.cc:2749] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:02.668201  5238 leader_election.cc:304] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:02.602548  7665 consensus_queue.cc:1048] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
W20260709 12:14:02.651897  7712 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.010s	sys 0.016s
I20260709 12:14:02.643110  7690 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:02.635337  7728 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:02.671960  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:02.674978  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:02.641755  7570 leader_election.cc:290] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:02.704738  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:02.705529  5270 raft_consensus.cc:2468] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 4.
I20260709 12:14:02.706530  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:14:02.688755  7744 log.cc:927] Time spent T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:14:02.624498  7654 consensus_queue.cc:1048] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:14:02.669308  7400 raft_consensus.cc:2764] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:14:02.669952  5238 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:02.709698  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:02.660251  7601 raft_consensus.cc:2749] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:02.714325  7728 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:02.697469  5117 raft_consensus.cc:1240] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:02.716074  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:02.736101  5270 raft_consensus.cc:2468] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 3.
I20260709 12:14:02.654574  7729 raft_consensus.cc:2749] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:02.660880  5831 raft_consensus.cc:3060] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:02.720454  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 197550us
W20260709 12:14:02.729283  5273 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34674 (request call id 1891) took 1565 ms (client timeout 2012 ms). Trace:
I20260709 12:14:02.648988  7625 consensus_queue.cc:1048] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 12:14:02.740670  5088 leader_election.cc:304] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:02.741914  7325 raft_consensus.cc:2804] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:02.742219  5088 leader_election.cc:304] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:02.742429  7325 raft_consensus.cc:697] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:02.743320  7325 consensus_queue.cc:237] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:02.730213  5091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:02.731066  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 61185.4us
I20260709 12:14:02.705292  7690 raft_consensus.cc:3060] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:02.745126  7611 raft_consensus.cc:493] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:02.745734  7611 raft_consensus.cc:515] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:02.746222  5273 rpcz_store.cc:269] 0709 12:14:01.163527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:01.377998 (+214471us) service_pool.cc:224] Handling call
0709 12:14:02.729062 (+1351064us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b540040ae54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:02.729215 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":354001152}
I20260709 12:14:02.743636  5088 leader_election.cc:304] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:02.749854  5238 leader_election.cc:304] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:02.750722  5088 leader_election.cc:304] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:02.739174  5089 leader_election.cc:304] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:14:02.738052  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 87781.4us
I20260709 12:14:02.743551  7618 consensus_queue.cc:1048] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:02.744007  7619 raft_consensus.cc:2804] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:02.752151  5117 raft_consensus.cc:1240] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:02.753278  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:02.753963  5196 raft_consensus.cc:2468] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 2.
I20260709 12:14:02.754843  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:02.756515  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:02.737753  7596 raft_consensus.cc:2804] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:02.718502  7712 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:02.759326  5089 leader_election.cc:304] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:14:02.766199  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:02.771291  5192 raft_consensus.cc:1275] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:02.717067  7567 consensus_queue.cc:1048] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 12:14:02.761680  7615 raft_consensus.cc:2804] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:02.760510  7596 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:02.760633  7625 raft_consensus.cc:2804] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:02.758620  7747 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:02.780947  5164 leader_election.cc:304] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:02.761893  7745 raft_consensus.cc:2749] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:02.793152  5089 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:02.758744  7463 raft_consensus.cc:515] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:02.798491  5089 leader_election.cc:304] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:02.775559  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:02.766479  7571 consensus_queue.cc:1048] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:14:02.801222  5268 raft_consensus.cc:2393] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 7: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:02.780190  7615 raft_consensus.cc:493] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:02.783293  7608 raft_consensus.cc:2804] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:14:02.803576  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 65039.4us
I20260709 12:14:02.780894  7625 raft_consensus.cc:493] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:02.780411  7596 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:02.770062  7321 raft_consensus.cc:515] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:02.807264  5166 leader_election.cc:304] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:02.769120  7581 raft_consensus.cc:515] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:02.794868  7627 raft_consensus.cc:2804] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:02.799657  5238 leader_election.cc:304] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
W20260709 12:14:02.901155  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 93966.7us
I20260709 12:14:02.805228  5089 leader_election.cc:304] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:14:02.772104  7712 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:02.795153  7611 leader_election.cc:290] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:02.881235  7615 raft_consensus.cc:3060] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:02.806062  7608 raft_consensus.cc:493] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:02.884511  7704 log.cc:927] Time spent T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:14:02.884967  7625 raft_consensus.cc:3060] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:02.925101  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 119965us
I20260709 12:14:02.891644  7618 raft_consensus.cc:2804] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:02.897908  7525 raft_consensus.cc:493] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:02.957593  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 152572us
I20260709 12:14:02.884457  7671 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:02.972280  5267 raft_consensus.cc:2468] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:14:02.796020  7747 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:02.995631  7747 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:02.899009  7750 raft_consensus.cc:2749] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:14:02.995955  7733 log.cc:927] Time spent T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.267s	user 0.000s	sys 0.000s
I20260709 12:14:02.907335  7731 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:02.956887  7618 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:02.943900  7745 raft_consensus.cc:2804] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:02.944252  7400 raft_consensus.cc:493] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:03.013046  7647 raft_consensus.cc:515] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:03.013852  7731 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:03.015333  7647 leader_election.cc:290] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:03.016789  7731 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:02.985998  7751 raft_consensus.cc:2749] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:02.948585  7608 raft_consensus.cc:3060] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:02.992355  5273 raft_consensus.cc:1240] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:14:02.899317  7592 raft_consensus.cc:515] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:03.032850  7592 leader_election.cc:290] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:02.956525  7463 leader_election.cc:290] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:02.998781  5267 raft_consensus.cc:1240] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 4. Current term is 5. Ops: []
W20260709 12:14:02.985859  7741 log.cc:927] Time spent T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.310s	user 0.001s	sys 0.001s
I20260709 12:14:02.982252  7654 consensus_queue.cc:1048] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:14:03.038148  7581 leader_election.cc:290] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:03.013653  7745 raft_consensus.cc:493] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:03.039093  7745 raft_consensus.cc:3060] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:02.988626  7645 consensus_queue.cc:1048] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:14:03.042477  7728 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:03.012252  7743 log.cc:927] Time spent T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.239s	user 0.001s	sys 0.000s
I20260709 12:14:02.986016  5089 leader_election.cc:304] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:03.019366  5237 leader_election.cc:304] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:03.012784  7400 raft_consensus.cc:515] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:03.013641  7752 log.cc:927] Time spent T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:14:02.983071  7754 raft_consensus.cc:2804] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:14:03.001505  7740 log.cc:927] Time spent T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.292s	user 0.001s	sys 0.000s
I20260709 12:14:03.033718  7671 consensus_queue.cc:1059] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:14:03.012461  7739 log.cc:927] Time spent T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
W20260709 12:14:03.049489  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 63569.6us
W20260709 12:14:03.067288  7720 log.cc:927] Time spent T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.995s	user 0.009s	sys 0.015s
I20260709 12:14:02.992282  7611 consensus_queue.cc:1048] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:14:03.070235  7712 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:03.071152  7671 raft_consensus.cc:3055] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:03.071584  7671 raft_consensus.cc:740] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:03.072417  7671 consensus_queue.cc:260] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:03.063133  7750 raft_consensus.cc:493] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:03.041929  7548 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:02.897092  7627 raft_consensus.cc:493] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:02.997435  7525 raft_consensus.cc:515] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:02.999540  7439 consensus_queue.cc:1059] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:14:03.001645  7571 raft_consensus.cc:2804] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:03.006255  7618 raft_consensus.cc:3060] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:03.061677  7662 raft_consensus.cc:2749] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:03.051324  5237 leader_election.cc:304] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:03.051909  7728 raft_consensus.cc:2749] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:03.073942  7750 raft_consensus.cc:515] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:03.062769  7754 raft_consensus.cc:493] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:03.074016  7615 raft_consensus.cc:515] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:03.077680  7627 raft_consensus.cc:3060] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:03.080783  7671 raft_consensus.cc:3060] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:03.076686  7611 raft_consensus.cc:493] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:03.081467  7571 raft_consensus.cc:493] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:03.087077  7463 raft_consensus.cc:2749] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:14:03.114763  7589 consensus_meta.cc:287] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.614s	user 0.007s	sys 0.003s
I20260709 12:14:03.101506  7754 raft_consensus.cc:3060] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:03.104007  7619 raft_consensus.cc:697] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
W20260709 12:14:03.126289  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 223520us
I20260709 12:14:03.120307  7571 raft_consensus.cc:3060] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:03.083822  7690 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:03.046432  5831 raft_consensus.cc:2468] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:14:03.169677  5120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40402 (request call id 1943) took 1005 ms. Trace:
I20260709 12:14:03.100870  7596 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:03.174212  7767 consensus_queue.cc:1059] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:14:03.189623  7615 leader_election.cc:290] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:03.190093  7583 leader_election.cc:290] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:03.195103  7755 log.cc:927] Time spent T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
I20260709 12:14:03.129168  7666 raft_consensus.cc:697] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:03.121142  7611 raft_consensus.cc:515] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:03.204627  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:03.207089  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:03.207753  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:03.174327  7751 consensus_queue.cc:1059] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:14:03.210377  5123 raft_consensus.cc:1275] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:03.211565  7571 raft_consensus.cc:515] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:03.212440  7588 raft_consensus.cc:493] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:03.220304  7715 log.cc:927] Time spent T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 1.253s	user 0.003s	sys 0.009s
I20260709 12:14:03.221467  7544 raft_consensus.cc:493] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:03.287963  7544 raft_consensus.cc:515] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:03.222090  7653 raft_consensus.cc:3055] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:03.290011  7653 raft_consensus.cc:740] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:03.290756  7571 leader_election.cc:290] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:03.226408  7644 consensus_meta.cc:287] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.727s	user 0.006s	sys 0.004s
I20260709 12:14:03.231181  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:03.132795  7589 raft_consensus.cc:515] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:03.235188  5270 raft_consensus.cc:1275] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:14:03.238155  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:03.239714  5801 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:03.242048  7525 leader_election.cc:290] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:03.101660  7581 consensus_queue.cc:1048] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:14:03.122723  7548 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:03.245227  7660 consensus_meta.cc:287] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.924s	user 0.011s	sys 0.000s
I20260709 12:14:03.262815  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:03.261425  5120 rpcz_store.cc:276] 0709 12:14:02.164623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:02.166187 (+  1564us) service_pool.cc:224] Handling call
0709 12:14:02.166520 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:02.166765 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:14:02.657658 (+490893us) log.cc:844] Serialized 14 byte log entry
0709 12:14:03.168881 (+511223us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:03.169323 (+   442us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:03.169397 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:03.169469 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:03.169613 (+   144us) inbound_call.cc:177] Queueing success response
0709 12:14:03.194598 (+ 24985us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e675e86e 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221 00007f84e67671d9 00007f84e6767169
Metrics: {"mutex_wait_us":9028,"prepare.queue_time_us":409084,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":20710,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":3841,"spinlock_wait_cycles":43635456,"thread_start_us":1001069,"threads_started":3,"wal-append.queue_time_us":226565}
I20260709 12:14:03.270035  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:03.270771  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:03.271045  7596 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:03.271984  5125 raft_consensus.cc:1240] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:03.273438  5116 raft_consensus.cc:2468] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 6.
I20260709 12:14:03.276294  7690 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:03.276407  7611 leader_election.cc:290] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:03.272861  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 473205us
I20260709 12:14:03.273408  5122 raft_consensus.cc:2468] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 5.
I20260709 12:14:03.282441  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:03.319556  5832 raft_consensus.cc:2468] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
I20260709 12:14:03.282166  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:03.320621  5834 raft_consensus.cc:3060] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:03.285086  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:03.287199  7767 consensus_queue.cc:1048] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:03.293243  5089 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:03.291725  7666 consensus_queue.cc:237] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:03.297861  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 58210.9us
I20260709 12:14:03.373914  5801 leader_election.cc:304] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:03.298341  5274 raft_consensus.cc:2393] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 7: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
W20260709 12:14:03.282132  7651 consensus_meta.cc:287] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.617s	user 0.008s	sys 0.003s
I20260709 12:14:03.285089  7588 raft_consensus.cc:3060] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:03.308100  5838 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:14:03.388600  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:03.389864  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:03.291824  7644 raft_consensus.cc:2749] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:03.290119  7590 raft_consensus.cc:3060] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:03.321671  5835 raft_consensus.cc:2468] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 7.
I20260709 12:14:03.299631  7400 leader_election.cc:290] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:03.306614  7777 raft_consensus.cc:2804] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:03.375249  5801 leader_election.cc:304] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:03.417237  5801 leader_election.cc:304] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:03.382566  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:03.348475  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:03.418078  5274 raft_consensus.cc:3060] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:03.418270  5270 raft_consensus.cc:2468] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
I20260709 12:14:03.419637  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:03.410864  7750 leader_election.cc:290] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:03.411084  7690 raft_consensus.cc:2804] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:03.420809  7690 raft_consensus.cc:697] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:03.420910  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:03.272379  7619 consensus_queue.cc:237] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:03.421738  7690 consensus_queue.cc:237] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:03.427199  5270 raft_consensus.cc:3060] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:03.429752  5834 raft_consensus.cc:2468] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
I20260709 12:14:03.407423  7651 raft_consensus.cc:2749] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:03.300160  7625 raft_consensus.cc:515] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:03.323987  5833 raft_consensus.cc:2468] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
I20260709 12:14:03.424888  7596 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:03.320403  5830 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
I20260709 12:14:03.396200  7592 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:03.399441  7765 log.cc:927] Time spent T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.252s	user 0.001s	sys 0.000s
I20260709 12:14:03.290896  7653 consensus_queue.cc:260] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:03.400779  5265 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34672 (request call id 1786) took 1682 ms (client timeout 1969 ms). Trace:
I20260709 12:14:03.438853  7583 raft_consensus.cc:2764] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:14:03.328289  5088 leader_election.cc:304] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:03.412371  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:03.413290  5164 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:03.471254  5835 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:03.357471  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:14:03.471560  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 58370.2us
I20260709 12:14:03.442826  5274 raft_consensus.cc:2468] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 8.
I20260709 12:14:03.468873  7596 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:03.436806  5801 leader_election.cc:304] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:03.309891  7548 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:03.424795  7777 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:03.392256  7525 raft_consensus.cc:2804] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:03.463383  5270 raft_consensus.cc:2468] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
I20260709 12:14:03.464427  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
W20260709 12:14:03.469408  5265 rpcz_store.cc:269] 0709 12:14:01.718593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:01.718724 (+   131us) service_pool.cc:224] Handling call
0709 12:14:03.400569 (+1681845us) spinlock_profiling.cc:243] Waited 85.5 ms on lock 0x7b54000a5d54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:03.400719 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":196699008}
I20260709 12:14:03.483363  5269 raft_consensus.cc:3060] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:03.483857  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:03.401751  7589 leader_election.cc:290] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:03.483760  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:03.484555  5265 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:14:03.485098  5270 raft_consensus.cc:2468] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 4.
I20260709 12:14:03.438781  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:03.486366  5834 raft_consensus.cc:2393] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 7: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:03.473006  7750 raft_consensus.cc:2804] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:03.473368  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:03.518570  5274 raft_consensus.cc:1275] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:14:03.518965  5274 pending_rounds.cc:85] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929: Aborting all ops after (but not including) 2
I20260709 12:14:03.519187  5274 pending_rounds.cc:107] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:14:03.519428  5274 raft_consensus.cc:2889] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:03.474715  5268 raft_consensus.cc:2393] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 4: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
W20260709 12:14:03.391505  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 98326.4us
I20260709 12:14:03.472070  5267 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
I20260709 12:14:03.310168  7660 raft_consensus.cc:515] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:03.471251  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 143053us
I20260709 12:14:03.468782  5195 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:03.498092  7773 log.cc:927] Time spent T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
I20260709 12:14:03.434507  7608 raft_consensus.cc:515] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:03.509687  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:14:03.513486  7756 log.cc:927] Time spent T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.316s	user 0.011s	sys 0.000s
I20260709 12:14:03.534269  5166 leader_election.cc:304] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:03.514847  7625 leader_election.cc:290] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:03.456249  7776 raft_consensus.cc:2749] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:03.522969  5269 raft_consensus.cc:2468] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
I20260709 12:14:03.526765  7583 raft_consensus.cc:2749] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:14:03.543236  5269 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34674 (request call id 1906) took 1772 ms (client timeout 2145 ms). Trace:
I20260709 12:14:03.469034  7592 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:03.526860  5088 leader_election.cc:304] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:03.489681  5270 raft_consensus.cc:1275] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:03.430377  7618 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:03.478034  7651 raft_consensus.cc:2804] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:03.516870  7525 raft_consensus.cc:493] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:03.480461  7777 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:03.555163  5803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:03.542042  5119 raft_consensus.cc:1240] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 3. Current term is 4. Ops: []
W20260709 12:14:03.531370  7661 consensus_meta.cc:287] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 1.100s	user 0.003s	sys 0.015s
I20260709 12:14:03.524327  5089 leader_election.cc:304] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:03.544744  5265 raft_consensus.cc:1275] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:14:03.543604  5269 rpcz_store.cc:269] 0709 12:14:01.770873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:01.771448 (+   575us) service_pool.cc:224] Handling call
0709 12:14:03.464315 (+1692867us) spinlock_profiling.cc:243] Waited 2.7 ms on lock 0x7b5800190b98. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9eeee 000000000036eb39 00007f84ebb121e0 00007f84ebbdb0c4 00007f84ebbdb131 00007f84ebb890a0 00007f84ebb88984 00007f84e51036d4 00007f84e5103662
0709 12:14:03.543177 (+ 78862us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6216576}
I20260709 12:14:03.530889  7750 raft_consensus.cc:697] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:03.546872  5088 leader_election.cc:304] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:03.531176  7767 raft_consensus.cc:493] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:03.513142  7745 raft_consensus.cc:515] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:03.542893  7653 raft_consensus.cc:3060] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:03.558725  5089 leader_election.cc:304] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:03.559222  5124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40386 (request call id 1693) took 1193 ms. Trace:
I20260709 12:14:03.565529  5124 rpcz_store.cc:276] 0709 12:14:02.362099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:02.434425 (+ 72326us) service_pool.cc:224] Handling call
0709 12:14:03.554910 (+1120485us) spinlock_profiling.cc:243] Waited 531 ms on lock 0x7b540024b154. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:03.555087 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1221930368}
I20260709 12:14:03.562740  5117 raft_consensus.cc:1240] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:03.543344  5829 raft_consensus.cc:2376] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5. Re-sending same reply.
I20260709 12:14:03.551259  7651 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:03.551388  7662 raft_consensus.cc:2804] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:03.569519  5166 leader_election.cc:304] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:03.556209  7525 raft_consensus.cc:3060] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:03.585189  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:03.585672  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:03.586076  5193 raft_consensus.cc:2468] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 8.
I20260709 12:14:03.586251  5194 raft_consensus.cc:3060] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:03.586809  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:03.587090  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:03.587414  5198 raft_consensus.cc:3060] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:14:03.587821  5193 raft_consensus.cc:2468] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 6.
I20260709 12:14:03.573731  7615 raft_consensus.cc:2804] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:03.576079  7759 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:03.576488  7772 raft_consensus.cc:493] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:03.577502  7775 raft_consensus.cc:2749] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:03.576136  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:14:03.579056  7780 log.cc:927] Time spent T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 12:14:03.603590  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:03.589123  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
W20260709 12:14:03.600162  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 163423us
I20260709 12:14:03.604787  5237 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:03.617118  5193 raft_consensus.cc:3060] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:03.618172  5237 leader_election.cc:304] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:03.590143  5196 raft_consensus.cc:1275] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:03.562582  7325 raft_consensus.cc:2804] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:03.609555  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:03.612638  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:03.545729  7754 raft_consensus.cc:515] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:03.580494  7651 raft_consensus.cc:3060] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:03.615003  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:03.615149  5194 raft_consensus.cc:2468] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 5.
I20260709 12:14:03.616485  5199 raft_consensus.cc:2468] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 4.
I20260709 12:14:03.634636  5801 leader_election.cc:304] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:03.564845  7611 raft_consensus.cc:2804] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:03.633992  5192 raft_consensus.cc:3060] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:03.634183  5200 raft_consensus.cc:2393] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 7: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:03.634610  5193 raft_consensus.cc:2468] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 4.
I20260709 12:14:03.563113  7661 raft_consensus.cc:515] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:03.580376  7662 raft_consensus.cc:493] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:03.637945  5198 raft_consensus.cc:2468] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 4.
I20260709 12:14:03.637900  5197 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:03.638967  5237 leader_election.cc:304] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:03.648247  5836 raft_consensus.cc:1240] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:03.630232  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:03.561316  7627 raft_consensus.cc:515] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:03.632683  7325 raft_consensus.cc:493] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:03.613039  7615 raft_consensus.cc:697] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:03.655045  5836 raft_consensus.cc:1240] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:03.657150  5237 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:03.661906  5836 raft_consensus.cc:1240] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:14:03.637518  7625 raft_consensus.cc:2804] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:03.660391  5237 leader_election.cc:304] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:03.670372  5837 raft_consensus.cc:1240] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:03.639202  7601 raft_consensus.cc:2804] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:14:03.661013  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 1.44202e+06us
I20260709 12:14:03.671068  5237 leader_election.cc:304] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:03.648970  7581 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:03.656642  7662 raft_consensus.cc:3060] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:03.695267  7596 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:03.696934  5192 raft_consensus.cc:2468] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 7.
I20260709 12:14:03.697099  5199 raft_consensus.cc:1275] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:03.571879  7767 raft_consensus.cc:515] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:03.699682  7767 leader_election.cc:290] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:03.656601  7400 raft_consensus.cc:2804] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:03.701270  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:03.658741  7528 raft_consensus.cc:2804] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:03.702039  7528 raft_consensus.cc:493] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:03.701925  5199 raft_consensus.cc:3060] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:03.702579  7528 raft_consensus.cc:3060] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:03.638612  7695 consensus_queue.cc:1048] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:14:03.669580  7571 raft_consensus.cc:2804] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:03.669823  7625 raft_consensus.cc:493] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:03.669569  7589 consensus_queue.cc:1059] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 12:14:03.708828  7662 raft_consensus.cc:515] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:03.748181  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 79529.3us
I20260709 12:14:03.659742  7325 raft_consensus.cc:3060] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:03.659420  7611 raft_consensus.cc:697] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:03.716658  5829 raft_consensus.cc:2393] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 4: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:03.676013  7601 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:03.763389  5199 raft_consensus.cc:2468] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:14:03.717793  5191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 1862) took 1711 ms. Trace:
I20260709 12:14:03.612676  7759 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:03.757093  7548 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:03.659183  7750 consensus_queue.cc:237] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:03.631863  7772 raft_consensus.cc:515] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:03.765890  7400 raft_consensus.cc:697] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 5 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:03.757817  7660 leader_election.cc:290] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:03.778720  5191 rpcz_store.cc:276] 0709 12:14:02.006129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:02.006293 (+   164us) service_pool.cc:224] Handling call
0709 12:14:02.063050 (+ 56757us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:14:02.317070 (+254020us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:02.317102 (+    32us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:14:02.328678 (+ 11576us) log.cc:844] Serialized 78 byte log entry
0709 12:14:02.525958 (+197280us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:14:02.526002 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:03.665886 (+1139884us) spinlock_profiling.cc:243] Waited 254 ms on lock 0x7b54003778d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:03.665948 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:03.666006 (+    58us) raft_consensus.cc:1685] finished
0709 12:14:03.666022 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:03.717715 (+ 51693us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1762,"raft.queue_time_us":3087,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":3945,"spinlock_wait_cycles":583144192,"thread_start_us":162042,"threads_started":1,"wal-append.queue_time_us":303672}
I20260709 12:14:03.773344  5192 raft_consensus.cc:1275] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:14:03.771508  5801 leader_election.cc:304] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:14:03.766851  7571 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:03.690785  7581 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:03.731802  7775 raft_consensus.cc:493] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:03.768241  7625 raft_consensus.cc:3060] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:03.765702  7728 raft_consensus.cc:2804] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:03.862185  5835 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 6.
I20260709 12:14:03.954566  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:04.104966  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 333523us
I20260709 12:14:03.902050  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:04.149258  5801 leader_election.cc:304] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
W20260709 12:14:04.149814  5240 connection.cc:256] RPC call timeout handler was delayed by -1.1997121659999266s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15780000000000002s for a response
I20260709 12:14:03.774719  7475 consensus_queue.cc:1048] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.373s
I20260709 12:14:04.157775  7581 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:03.780654  7615 consensus_queue.cc:237] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:04.160286  7325 raft_consensus.cc:515] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:04.140071  7583 raft_consensus.cc:2804] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:04.161829  7583 raft_consensus.cc:493] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:03.901366  7548 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:03.904059  7396 raft_consensus.cc:493] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:04.162276  7800 raft_consensus.cc:493] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:04.162943  7548 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:04.163559  7800 raft_consensus.cc:515] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:04.165524  7746 raft_consensus.cc:3055] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:04.165940  7746 raft_consensus.cc:740] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:04.166385  7627 leader_election.cc:290] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:04.166767  7746 consensus_queue.cc:260] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:04.167558  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:04.168011  7746 raft_consensus.cc:3060] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:03.780746  7601 raft_consensus.cc:3060] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:04.029186  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:04.155294  7789 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:03.919384  7671 consensus_meta.cc:287] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.801s	user 0.009s	sys 0.001s
I20260709 12:14:04.052598  5119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40386 (request call id 1697) took 1654 ms. Trace:
I20260709 12:14:04.203864  5119 rpcz_store.cc:276] 0709 12:14:02.398339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:02.687491 (+289152us) service_pool.cc:224] Handling call
0709 12:14:02.687799 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:03.555853 (+868054us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:04.052259 (+496406us) spinlock_profiling.cc:243] Waited 854 ms on lock 0x7b54002dcb54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:04.052527 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1964110208}
I20260709 12:14:04.025089  5197 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 6.
I20260709 12:14:03.781821  7618 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:03.919404  7764 log.cc:927] Time spent T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.702s	user 0.001s	sys 0.001s
I20260709 12:14:04.178658  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
W20260709 12:14:03.919714  7782 log.cc:927] Time spent T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:14:04.230456  5191 raft_consensus.cc:2393] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 4: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
W20260709 12:14:03.924841  7787 log.cc:927] Time spent T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.269s	user 0.001s	sys 0.000s
W20260709 12:14:04.041904  7590 consensus_meta.cc:287] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.617s	user 0.006s	sys 0.003s
I20260709 12:14:04.231432  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:04.231565  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
W20260709 12:14:03.939270  7784 log.cc:927] Time spent T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.334s	user 0.001s	sys 0.000s
W20260709 12:14:03.962670  7792 log.cc:927] Time spent T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:14:04.232579  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:04.029285  7791 log.cc:927] Time spent T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:14:04.234447  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:03.925513  7783 log.cc:927] Time spent T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.310s	user 0.001s	sys 0.000s
I20260709 12:14:04.235208  7759 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:03.963759  7790 log.cc:927] Time spent T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.182s	user 0.000s	sys 0.000s
I20260709 12:14:04.237018  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:03.970034  7795 raft_consensus.cc:3055] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:04.237692  5121 raft_consensus.cc:3060] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:04.237526  7400 consensus_queue.cc:237] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:03.927834  7770 log.cc:927] Time spent T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.738s	user 0.004s	sys 0.000s
I20260709 12:14:04.205926  7789 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:03.926810  7788 log.cc:927] Time spent T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 12:14:04.144775  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:04.239671  5835 raft_consensus.cc:2468] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:14:04.240545  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:04.240760  7570 raft_consensus.cc:493] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:03.936190  7588 consensus_meta.cc:287] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.510s	user 0.007s	sys 0.002s
I20260709 12:14:04.162247  7583 raft_consensus.cc:3060] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:04.241220  7570 raft_consensus.cc:515] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:04.241667  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:04.242364  5835 raft_consensus.cc:2393] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 6: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:03.912825  7760 raft_consensus.cc:2804] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:04.145326  7775 raft_consensus.cc:515] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:04.242828  7760 raft_consensus.cc:697] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 4 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:04.243728  7760 consensus_queue.cc:237] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:04.244477  7800 leader_election.cc:290] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:03.842995  7608 leader_election.cc:290] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:03.912670  7611 consensus_queue.cc:237] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:03.939625  7662 leader_election.cc:290] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:04.210569  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 650226us
I20260709 12:14:04.107944  7571 raft_consensus.cc:3060] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:03.913602  5195 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 5.
I20260709 12:14:03.918020  7745 leader_election.cc:290] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:04.237141  7653 consensus_meta.cc:287] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.662s	user 0.008s	sys 0.001s
I20260709 12:14:03.912343  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:04.225961  7589 consensus_queue.cc:1059] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:04.226902  7793 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:04.237268  7651 consensus_meta.cc:287] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.585s	user 0.007s	sys 0.001s
I20260709 12:14:04.163012  7396 raft_consensus.cc:515] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:03.905879  7592 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:04.246419  5088 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:04.214062  5118 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "00645b1f1e014de995e4a937f842d909"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
new_leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
 from {username='slave'} at 127.0.0.1:45628
I20260709 12:14:04.197993  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:04.176755  7584 raft_consensus.cc:2804] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:04.233166  5191 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
I20260709 12:14:04.271108  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:04.271811  5123 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:04.272034  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:04.249576  7588 raft_consensus.cc:515] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:04.250846  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:04.274698  5193 raft_consensus.cc:1275] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:14:04.274966  5197 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:14:04.252389  5121 raft_consensus.cc:2468] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 7.
I20260709 12:14:04.275815  5193 raft_consensus.cc:1240] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:04.276753  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:04.252794  5237 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.004s	sys 0.010s
W20260709 12:14:04.278512  5237 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.005s	sys 0.010s
W20260709 12:14:04.278836  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 607778us
I20260709 12:14:04.281368  5088 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:04.247412  7795 raft_consensus.cc:740] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:04.053849  7525 raft_consensus.cc:515] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:04.264901  7768 raft_consensus.cc:493] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:04.257691  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:04.306457  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:04.307178  5120 raft_consensus.cc:2368] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 4. Current term is 5.
I20260709 12:14:04.308007  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:04.176875  7728 raft_consensus.cc:697] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 4 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:04.263479  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:04.240454  7789 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:04.270721  7793 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:04.304678  7754 leader_election.cc:290] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:04.318043  5269 raft_consensus.cc:1240] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 4. Current term is 5. Ops: []
W20260709 12:14:04.318223  7757 log.cc:927] Time spent T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 1.330s	user 0.000s	sys 0.003s
I20260709 12:14:04.319478  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:04.320108  5269 raft_consensus.cc:3060] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:04.320802  7795 consensus_queue.cc:260] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:04.267549  5194 raft_consensus.cc:1275] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:14:04.322156  7795 raft_consensus.cc:3060] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:04.322454  7713 raft_consensus.cc:493] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:04.323012  7713 raft_consensus.cc:515] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:04.323920  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:04.324380  5804 leader_election.cc:336] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Timed out: RequestConsensusVote RPC to 127.3.212.129:34443 timed out after 1.538s (SENT)
I20260709 12:14:04.325042  7713 leader_election.cc:290] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:04.237958  7729 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:04.237793  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:04.269964  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:04.328433  5119 raft_consensus.cc:3060] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:04.314894  5829 raft_consensus.cc:3060] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:04.259177  7777 consensus_meta.cc:287] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.693s	user 0.004s	sys 0.006s
I20260709 12:14:04.258222  7802 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:04.331732  7325 leader_election.cc:290] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:04.331415  7777 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:04.331506  7802 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:04.205049  7528 raft_consensus.cc:515] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:04.333560  7525 leader_election.cc:290] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:04.333838  7802 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:04.283671  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:04.283828  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:04.273149  5118 raft_consensus.cc:606] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Received request to transfer leadership to TS dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:04.343958  5118 raft_consensus.cc:614] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:04.346276  5117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40386 (request call id 1710) took 1112 ms. Trace:
I20260709 12:14:04.284432  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:04.285679  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:04.347390  5266 raft_consensus.cc:2468] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 7.
I20260709 12:14:04.347594  5837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46100 (request call id 853) took 1062 ms. Trace:
I20260709 12:14:04.348232  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:04.348802  5266 raft_consensus.cc:3060] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:04.287205  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:04.349601  5268 raft_consensus.cc:2468] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 6.
I20260709 12:14:04.350173  5123 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 6.
I20260709 12:14:04.350466  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:04.351904  5268 raft_consensus.cc:1275] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:14:04.265223  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 114154us
I20260709 12:14:04.266690  7800 raft_consensus.cc:493] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:04.405042  7800 raft_consensus.cc:515] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:04.409489  5120 raft_consensus.cc:2393] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 4: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:04.334146  5830 raft_consensus.cc:1240] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:04.413980  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:04.414914  5118 raft_consensus.cc:2393] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 6: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:04.415815  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:04.416376  5118 raft_consensus.cc:3060] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:04.431846  5273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34672 (request call id 1811) took 1949 ms. Trace:
I20260709 12:14:04.432478  5273 rpcz_store.cc:276] 0709 12:14:02.482708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:02.747207 (+264499us) service_pool.cc:224] Handling call
0709 12:14:02.992108 (+244901us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:03.027612 (+ 35504us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:04.431601 (+1403989us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b54002ef9d0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc28ad 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:04.431774 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":562100480}
I20260709 12:14:04.436312  5836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46088 (request call id 481) took 1109 ms. Trace:
I20260709 12:14:04.438606  5273 raft_consensus.cc:1275] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:14:04.343765  5119 raft_consensus.cc:2468] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 5.
I20260709 12:14:04.440748  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:04.436718  5836 rpcz_store.cc:276] 0709 12:14:03.326665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.673639 (+346974us) service_pool.cc:224] Handling call
0709 12:14:03.673945 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:04.068696 (+394751us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:04.068772 (+    76us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:04.069488 (+   716us) log.cc:844] Serialized 26 byte log entry
0709 12:14:04.290248 (+220760us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:04.290871 (+   623us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:04.290938 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:04.436079 (+145141us) raft_consensus.cc:1685] finished
0709 12:14:04.436099 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:04.436249 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1131,"raft.queue_time_us":105742,"raft.run_cpu_time_us":900,"raft.run_wall_time_us":67509,"spinlock_wait_cycles":77184,"thread_start_us":614508,"threads_started":2,"wal-append.queue_time_us":283652}
I20260709 12:14:04.446024  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:04.446689  5836 raft_consensus.cc:3060] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:04.452724  5118 raft_consensus.cc:2468] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 5.
I20260709 12:14:04.299798  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:04.300551  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:04.301982  5197 raft_consensus.cc:1240] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:04.461050  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:04.255824  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:04.272269  7423 raft_consensus.cc:3055] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:04.290038  7584 raft_consensus.cc:697] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 7 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:04.325672  7729 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:04.247325  7661 leader_election.cc:290] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:04.330942  7588 leader_election.cc:290] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:04.334896  7528 leader_election.cc:290] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:04.335119  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:04.336000  7793 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:04.333774  5271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34674 (request call id 1922) took 2232 ms. Trace:
I20260709 12:14:04.336843  5124 raft_consensus.cc:2393] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 6: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:04.311861  7768 raft_consensus.cc:515] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:04.338310  7777 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:04.339068  5121 raft_consensus.cc:2468] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 4.
I20260709 12:14:04.302554  7745 raft_consensus.cc:2804] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:04.526531  7745 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:04.527007  7745 raft_consensus.cc:3060] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:04.528875  7800 leader_election.cc:290] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:04.491228  5271 rpcz_store.cc:276] 0709 12:14:02.101210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:02.434866 (+333656us) service_pool.cc:224] Handling call
0709 12:14:02.435307 (+   441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:02.435727 (+   420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:02.435762 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:02.440747 (+  4985us) log.cc:844] Serialized 26 byte log entry
0709 12:14:03.672779 (+1232032us) spinlock_profiling.cc:243] Waited 40.8 ms on lock 0x7b180041f620. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3ab8e07 00007f84ec9139a9 00007f84e3ad569b 00007f84e3ad393f 00007f84e3ad5c02 00007f84e675d20b 00007f84e6762d23 00007f84e67630d1 00007f84e6b7ea0f
0709 12:14:04.206355 (+533576us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:04.255350 (+ 48995us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:04.264774 (+  9424us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:04.333454 (+ 68680us) raft_consensus.cc:1685] finished
0709 12:14:04.333471 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:04.333699 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":515,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":155,"spinlock_wait_cycles":93880704,"thread_start_us":497390,"threads_started":1,"wal-append.queue_time_us":1839334}
I20260709 12:14:04.334229  5838 raft_consensus.cc:2393] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 4: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:04.254180  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:14:04.354458  5240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:04.532160  5835 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 5.
I20260709 12:14:04.533190  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:04.534349  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:04.535071  5835 raft_consensus.cc:2393] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 5: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:04.534690  7601 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:04.535270  5240 leader_election.cc:336] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Timed out: RequestConsensusVote RPC to 127.3.212.129:34443 timed out after 2.025s (SENT)
I20260709 12:14:04.535714  5240 leader_election.cc:304] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
W20260709 12:14:04.358716  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 53330.6us
I20260709 12:14:04.535944  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:04.536550  5835 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 6.
I20260709 12:14:04.536885  7601 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:04.537055  7793 consensus_queue.cc:1048] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:04.540889  7802 consensus_queue.cc:1059] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:04.542177  7325 consensus_queue.cc:1048] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:04.541417  7660 consensus_queue.cc:1048] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:14:04.362905  5269 raft_consensus.cc:2468] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:14:04.346860  5117 rpcz_store.cc:276] 0709 12:14:03.233711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.274234 (+ 40523us) service_pool.cc:224] Handling call
0709 12:14:03.283303 (+  9069us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:03.566813 (+283510us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:04.346003 (+779190us) spinlock_profiling.cc:243] Waited 278 ms on lock 0x7b5400071554. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:04.346211 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":638591232}
I20260709 12:14:04.348022  5837 rpcz_store.cc:276] 0709 12:14:03.285033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.285154 (+   121us) service_pool.cc:224] Handling call
0709 12:14:03.287554 (+  2400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:03.670791 (+383237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:04.347299 (+676508us) spinlock_profiling.cc:243] Waited 383 ms on lock 0x7b54006e73d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:04.347531 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":879957248}
I20260709 12:14:04.545670  7660 raft_consensus.cc:3055] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:04.492031  7396 leader_election.cc:290] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:04.320240  7775 leader_election.cc:290] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:04.545856  7729 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:04.314332  7662 raft_consensus.cc:2804] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:04.532930  7625 raft_consensus.cc:515] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:04.395040  5829 raft_consensus.cc:2468] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 7.
I20260709 12:14:04.386133  5191 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 6.
I20260709 12:14:04.547531  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:04.547760  5268 raft_consensus.cc:1240] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:04.276167  7651 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:04.548751  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:04.549242  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:04.549852  7651 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:04.403811  7583 raft_consensus.cc:515] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:04.550707  5829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46088 (request call id 484) took 1214 ms. Trace:
I20260709 12:14:04.313505  7772 leader_election.cc:290] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:04.288205  5237 leader_election.cc:304] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:04.290078  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:04.551180  5837 raft_consensus.cc:1275] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:14:04.552789  5196 raft_consensus.cc:2368] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 7. Current term is 8.
I20260709 12:14:04.552139  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:04.553118  5836 raft_consensus.cc:2468] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 4.
W20260709 12:14:04.553679  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 265535us
I20260709 12:14:04.551662  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:04.554329  5271 raft_consensus.cc:3060] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:04.553766  5267 raft_consensus.cc:2468] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
I20260709 12:14:04.556207  5088 leader_election.cc:304] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:04.558730  5801 leader_election.cc:304] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:04.560195  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:04.562121  5121 raft_consensus.cc:2468] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 5.
I20260709 12:14:04.471019  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:04.460604  5270 raft_consensus.cc:2468] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:14:04.564507  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:04.568867  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:04.570201  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:04.570845  5267 raft_consensus.cc:3060] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:04.573204  5835 raft_consensus.cc:1240] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:04.475638  5197 raft_consensus.cc:1275] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:14:04.476352  5266 raft_consensus.cc:2468] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 4.
I20260709 12:14:04.467895  7423 raft_consensus.cc:740] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
W20260709 12:14:04.591224  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 55982.6us
I20260709 12:14:04.481724  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:04.593457  5118 raft_consensus.cc:3060] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:04.593886  5836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46094 (request call id 750) took 1070 ms. Trace:
I20260709 12:14:04.594264  5836 rpcz_store.cc:276] 0709 12:14:03.523146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:04.593121 (+1069975us) service_pool.cc:224] Handling call
0709 12:14:04.593434 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:04.593597 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:04.593620 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:04.593659 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:04.593686 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:04.593737 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:04.593834 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:04.595049  5088 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:04.481936  7584 consensus_queue.cc:237] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:04.596860  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:04.445868  7762 raft_consensus.cc:3055] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:04.315063  7619 raft_consensus.cc:493] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:04.546545  7662 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:04.392318  7728 consensus_queue.cc:237] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:04.420648  7571 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:04.470438  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 118688us
I20260709 12:14:04.610545  5240 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:04.582230  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:04.588182  5837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46088 (request call id 485) took 1251 ms. Trace:
I20260709 12:14:04.612298  5837 rpcz_store.cc:276] 0709 12:14:03.336540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:04.550594 (+1214054us) service_pool.cc:224] Handling call
0709 12:14:04.550862 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:04.552539 (+  1677us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:04.588105 (+ 35566us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:04.551838  7583 leader_election.cc:290] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:04.589130  5801 leader_election.cc:304] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:04.596966  7777 raft_consensus.cc:2749] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:04.602902  5088 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:04.604121  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:04.639185  5088 leader_election.cc:304] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:04.604991  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:04.605552  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:04.639979  5269 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:04.548264  7625 leader_election.cc:290] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:04.615551  5801 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:04.602823  7762 raft_consensus.cc:740] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:04.597199  7729 raft_consensus.cc:2804] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:04.607698  7802 raft_consensus.cc:2804] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:04.602504  7760 raft_consensus.cc:2749] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:04.546128  7660 raft_consensus.cc:740] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:04.642378  7528 raft_consensus.cc:2804] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:04.640079  5119 raft_consensus.cc:2393] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 4: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:04.606784  7772 raft_consensus.cc:2804] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:04.595803  5836 raft_consensus.cc:1240] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:14:04.643671  7661 raft_consensus.cc:2804] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:04.641646  7423 consensus_queue.cc:260] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:04.647513  5274 raft_consensus.cc:1240] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:04.607739  7662 raft_consensus.cc:3060] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:04.545416  7745 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:04.639410  5121 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 3.
I20260709 12:14:04.688884  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:04.690132  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:04.691450  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:04.651597  7802 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:04.638960  7400 raft_consensus.cc:2804] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:04.681241  7661 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:04.683377  7762 consensus_queue.cc:260] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:04.608848  7619 raft_consensus.cc:515] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:04.652848  5837 raft_consensus.cc:1240] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:04.697829  5267 raft_consensus.cc:2468] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 4.
I20260709 12:14:04.655301  7528 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:04.729784  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:04.748798  5119 raft_consensus.cc:2468] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 5.
I20260709 12:14:04.551101  5829 rpcz_store.cc:276] 0709 12:14:03.336289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:04.549831 (+1213542us) service_pool.cc:224] Handling call
0709 12:14:04.550137 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:04.550351 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:04.550381 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:04.550434 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:04.550477 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:04.550547 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:04.550656 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:04.729122  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:04.741714  5269 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 4.
I20260709 12:14:04.744273  5801 leader_election.cc:304] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:04.722663  5118 raft_consensus.cc:2468] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 4.
I20260709 12:14:04.688123  7729 raft_consensus.cc:697] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 7 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:04.701835  7772 raft_consensus.cc:697] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
W20260709 12:14:04.752713  7816 log.cc:927] Time spent T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:14:04.754722  7619 leader_election.cc:290] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:04.755198  5831 raft_consensus.cc:3060] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:04.755362  7786 log.cc:927] Time spent T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 1.141s	user 0.001s	sys 0.016s
I20260709 12:14:04.702126  7615 raft_consensus.cc:2804] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:04.758033  5121 raft_consensus.cc:2393] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 7: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:04.761366  5118 raft_consensus.cc:1240] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:04.703105  7802 raft_consensus.cc:3060] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:04.742038  7661 raft_consensus.cc:3060] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:04.758530  7528 raft_consensus.cc:3060] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:04.873413  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:04.853219  5271 raft_consensus.cc:2468] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
I20260709 12:14:04.858247  5835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46088 (request call id 483) took 1522 ms. Trace:
I20260709 12:14:04.780534  5119 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
new_leader_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:45628
I20260709 12:14:04.884567  5119 raft_consensus.cc:606] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Received request to transfer leadership to TS 9e794b72ed7640219f90ec4232363929
I20260709 12:14:04.884886  5119 raft_consensus.cc:614] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:04.741768  7731 raft_consensus.cc:2804] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:04.866391  5833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46100 (request call id 856) took 1579 ms. Trace:
I20260709 12:14:04.883045  5835 rpcz_store.cc:276] 0709 12:14:03.336003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:04.537137 (+1201134us) service_pool.cc:224] Handling call
0709 12:14:04.573033 (+ 35896us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:04.575474 (+  2441us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:04.858023 (+282549us) spinlock_profiling.cc:243] Waited 35.6 ms on lock 0x7b54005e01d0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc28ad 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:04.858175 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":81891072}
I20260709 12:14:04.747872  7400 raft_consensus.cc:697] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 6 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:04.762004  7777 raft_consensus.cc:2804] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:04.886452  5833 rpcz_store.cc:276] 0709 12:14:03.287290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.469506 (+182216us) service_pool.cc:224] Handling call
0709 12:14:03.480238 (+ 10732us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:03.563070 (+ 82832us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:03.563101 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:03.573432 (+ 10331us) log.cc:844] Serialized 26 byte log entry
0709 12:14:03.671692 (+ 98260us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:03.671728 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:04.865962 (+1194234us) spinlock_profiling.cc:243] Waited 82.5 ms on lock 0x7b5400655ed4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:04.866015 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:04.866066 (+    51us) raft_consensus.cc:1685] finished
0709 12:14:04.866079 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:04.866315 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1746,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":9781,"spinlock_wait_cycles":189671296,"thread_start_us":55024,"threads_started":1,"wal-append.queue_time_us":617010}
I20260709 12:14:04.774755  7762 raft_consensus.cc:3060] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:04.761848  7814 log.cc:927] Time spent T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:14:04.759445  7423 raft_consensus.cc:3060] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:04.893779  5832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46100 (request call id 855) took 1606 ms. Trace:
I20260709 12:14:04.872885  5830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46100 (request call id 857) took 1585 ms. Trace:
W20260709 12:14:04.898196  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 258162us
I20260709 12:14:04.911942  5832 rpcz_store.cc:276] 0709 12:14:03.287039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.320330 (+ 33291us) service_pool.cc:224] Handling call
0709 12:14:03.405815 (+ 85485us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:03.406207 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:03.406237 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:03.421619 (+ 15382us) log.cc:844] Serialized 26 byte log entry
0709 12:14:03.532630 (+111011us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:03.532672 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:03.533831 (+  1159us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:03.926755 (+392924us) spinlock_profiling.cc:243] Waited 5.56 ms on lock 0x7b48000621d8. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ebaecaa1 00007f84ebae3b37 00007f84ebae39ca 00007f84ebbdb26f 00007f84ebbdaf37 00007f84ebbef55c 00007f84ebbef508 00007f84ebbef488 00007f84ebbef443 00007f84ebbee6ec 00007f84eab18a96
0709 12:14:04.754810 (+828055us) spinlock_profiling.cc:243] Waited 1.89 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e675e86e 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221 00007f84e67671d9 00007f84e6767169
0709 12:14:04.893531 (+138721us) raft_consensus.cc:1685] finished
0709 12:14:04.893556 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:04.893709 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":99,"raft.run_cpu_time_us":1499,"raft.run_wall_time_us":516290,"spinlock_wait_cycles":17119360,"thread_start_us":94721,"threads_started":1,"wal-append.queue_time_us":132790}
I20260709 12:14:04.871037  7570 leader_election.cc:290] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:04.917771  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:04.893424  7615 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:04.917181  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:04.927968  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:04.918478  5119 raft_consensus.cc:2376] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 6. Re-sending same reply.
I20260709 12:14:04.931186  5269 raft_consensus.cc:1240] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:14:04.931731  5833 raft_consensus.cc:2393] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 5: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
W20260709 12:14:04.932323  5088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:04.896070  7731 raft_consensus.cc:697] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:04.917085  5274 raft_consensus.cc:1275] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:14:04.937764  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:04.938410  5832 raft_consensus.cc:2376] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5. Re-sending same reply.
I20260709 12:14:04.926579  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:04.947170  5118 raft_consensus.cc:2376] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 5. Re-sending same reply.
I20260709 12:14:04.909724  7777 raft_consensus.cc:697] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 4 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:04.948437  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:04.916000  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
W20260709 12:14:04.931242  7812 log.cc:927] Time spent T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.289s	user 0.001s	sys 0.000s
I20260709 12:14:04.931344  7615 raft_consensus.cc:3060] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:04.954272  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:04.956614  5118 raft_consensus.cc:1240] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:04.889554  7729 consensus_queue.cc:237] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:04.963095  7818 consensus_queue.cc:1059] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:04.964006  7731 consensus_queue.cc:237] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:04.962818  7777 consensus_queue.cc:237] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:04.895629  7772 consensus_queue.cc:237] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:04.956785  5829 raft_consensus.cc:3060] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:14:04.968720  7819 raft_consensus.cc:3055] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:04.971359  7802 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:04.968058  5833 raft_consensus.cc:1275] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:14:04.972132  7795 consensus_meta.cc:287] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.650s	user 0.008s	sys 0.000s
I20260709 12:14:04.913460  5830 rpcz_store.cc:276] 0709 12:14:03.287551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.505701 (+218150us) service_pool.cc:224] Handling call
0709 12:14:03.506108 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:04.410518 (+904410us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:04.872595 (+462077us) spinlock_profiling.cc:243] Waited 828 ms on lock 0x7b540045a1d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:04.872809 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1903763328}
W20260709 12:14:05.012209  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 78339.7us
I20260709 12:14:05.018685  7321 leader_election.cc:290] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:05.019721  7802 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:04.983752  7819 raft_consensus.cc:740] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:05.024768  5196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47744 (request call id 1871) took 1325 ms. Trace:
I20260709 12:14:05.045542  5196 rpcz_store.cc:276] 0709 12:14:03.699717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.954271 (+254554us) service_pool.cc:224] Handling call
0709 12:14:05.024569 (+1070298us) spinlock_profiling.cc:243] Waited 403 ms on lock 0x7b54002add54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:05.024702 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":927926656}
I20260709 12:14:05.025547  5125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40386 (request call id 1692) took 2663 ms. Trace:
I20260709 12:14:05.046043  7819 consensus_queue.cc:260] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:05.046380  5125 rpcz_store.cc:276] 0709 12:14:02.361865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:02.641274 (+279409us) service_pool.cc:224] Handling call
0709 12:14:02.641572 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:03.313871 (+672299us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:05.025302 (+1711431us) spinlock_profiling.cc:243] Waited 630 ms on lock 0x7b54003f0554. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:05.025491 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1449371392}
I20260709 12:14:05.031440  7571 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:05.047257  7819 raft_consensus.cc:3060] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:05.032523  5838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46088 (request call id 487) took 1695 ms. Trace:
I20260709 12:14:05.047854  5838 rpcz_store.cc:276] 0709 12:14:03.337068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.389614 (+ 52546us) service_pool.cc:224] Handling call
0709 12:14:05.032298 (+1642684us) spinlock_profiling.cc:243] Waited 943 ms on lock 0x7b54005ca154. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:05.032435 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2169983232}
I20260709 12:14:04.983476  7805 raft_consensus.cc:493] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:05.049120  7805 raft_consensus.cc:515] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:05.052178  7805 leader_election.cc:290] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:05.052852  7768 leader_election.cc:290] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:05.053452  7768 raft_consensus.cc:493] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.053910  7768 raft_consensus.cc:515] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:05.054368  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:04.980103  7400 consensus_queue.cc:237] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:05.058990  5831 raft_consensus.cc:2468] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:14:05.054606  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:05.040647  5119 raft_consensus.cc:1240] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:05.067065  5088 leader_election.cc:304] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
W20260709 12:14:05.073556  5803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:05.077945  5833 raft_consensus.cc:1275] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:05.067998  7661 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:05.087953  7661 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:05.044204  7615 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:05.093392  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:05.085126  7819 consensus_queue.cc:1048] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:05.096453  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:05.077916  7802 raft_consensus.cc:2804] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:05.078095  7745 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:05.104800  5166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:05.119851  5833 raft_consensus.cc:3060] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:05.125649  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:05.045112  7662 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:05.124833  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:05.098498  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:05.135471  5274 raft_consensus.cc:3060] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:05.136093  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:05.136659  5119 raft_consensus.cc:3060] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:05.134099  5269 raft_consensus.cc:3060] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:05.121634  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:05.138619  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:05.139178  5122 raft_consensus.cc:3060] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:14:05.139235  5273 raft_consensus.cc:3060] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:14:05.122246  5267 raft_consensus.cc:1275] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:05.116808  7751 raft_consensus.cc:493] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.116709  7644 raft_consensus.cc:493] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.113302  7802 raft_consensus.cc:697] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:05.117496  7665 consensus_queue.cc:1059] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:14:05.154397  5121 raft_consensus.cc:2393] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 6: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:05.134255  7615 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:05.162600  5119 raft_consensus.cc:2468] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 5.
I20260709 12:14:05.116462  7654 raft_consensus.cc:493] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:05.113711  7828 consensus_queue.cc:1059] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 12:14:05.180943  5833 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 7.
I20260709 12:14:05.181810  5274 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 7.
I20260709 12:14:05.150645  7819 raft_consensus.cc:493] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:05.204903  7802 consensus_queue.cc:237] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:05.211503  5269 raft_consensus.cc:2468] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 7.
I20260709 12:14:05.154170  7751 raft_consensus.cc:515] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:05.213598  7768 leader_election.cc:290] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:05.243356  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:05.235383  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:05.246899  5117 raft_consensus.cc:2376] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 7. Re-sending same reply.
W20260709 12:14:05.245072  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 127306us
I20260709 12:14:05.199934  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:05.156752  7644 raft_consensus.cc:515] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:05.245721  5122 raft_consensus.cc:2468] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 8.
I20260709 12:14:05.217712  7819 raft_consensus.cc:515] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:05.251943  7662 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:05.258052  5804 leader_election.cc:336] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Timed out: RequestConsensusVote RPC to 127.3.212.129:34443 timed out after 1.967s (SENT)
I20260709 12:14:05.289860  5804 leader_election.cc:304] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:05.210050  5829 raft_consensus.cc:2468] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
I20260709 12:14:05.244050  7544 leader_election.cc:290] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:05.284313  5830 raft_consensus.cc:2393] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 7: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:05.273240  7528 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:05.287263  7644 leader_election.cc:290] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:05.187186  7654 raft_consensus.cc:515] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:05.321985  5273 raft_consensus.cc:2468] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 7.
I20260709 12:14:05.294057  7647 raft_consensus.cc:493] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.293561  7661 raft_consensus.cc:2749] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:05.430675  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 182827us
I20260709 12:14:05.439904  7843 consensus_queue.cc:1059] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:05.441570  7838 raft_consensus.cc:3055] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:05.441946  7838 raft_consensus.cc:740] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:05.442773  7838 consensus_queue.cc:260] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:05.443995  7838 raft_consensus.cc:3060] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:05.365729  7644 consensus_queue.cc:1059] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.102s
I20260709 12:14:05.446194  7644 raft_consensus.cc:3055] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:05.446574  7644 raft_consensus.cc:740] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:05.447371  7644 consensus_queue.cc:260] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:05.448666  7644 raft_consensus.cc:3060] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:05.450367  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 186020us
I20260709 12:14:05.452668  5166 leader_election.cc:304] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:05.457306  5163 leader_election.cc:304] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:05.478253  7847 raft_consensus.cc:493] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:05.478986  7847 raft_consensus.cc:515] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:05.483700  7841 raft_consensus.cc:2804] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:05.484388  7841 raft_consensus.cc:697] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:05.479007  7528 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:05.485395  7841 consensus_queue.cc:237] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:05.455199  7768 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:05.398803  7647 raft_consensus.cc:515] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:05.458730  7548 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:05.495160  7847 leader_election.cc:290] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:05.499150  7768 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:05.513690  7846 raft_consensus.cc:2749] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:05.537262  5265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34674 (request call id 1933) took 2179 ms. Trace:
I20260709 12:14:05.537716  5265 rpcz_store.cc:276] 0709 12:14:03.357886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:03.485708 (+127822us) service_pool.cc:224] Handling call
0709 12:14:03.544422 (+ 58714us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:03.558222 (+ 13800us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:05.537038 (+1978816us) spinlock_profiling.cc:243] Waited 53.1 ms on lock 0x7b540040a450. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc28ad 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:05.537193 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":122027904}
W20260709 12:14:05.539264  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 86652.3us
W20260709 12:14:05.539530  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 82310.7us
I20260709 12:14:05.540233  5163 leader_election.cc:304] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:05.547246  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:05.544621  7654 leader_election.cc:290] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:05.543574  7846 raft_consensus.cc:2749] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:05.567651  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:05.543582  7751 leader_election.cc:290] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:05.573696  5125 raft_consensus.cc:2393] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 7: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:05.588668  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:05.568889  7835 log.cc:927] Time spent T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:14:05.590520  5125 raft_consensus.cc:2393] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 7: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:05.592269  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:05.585243  7834 log.cc:927] Time spent T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 12:14:05.600127  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:05.601035  5122 raft_consensus.cc:2393] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 5: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:05.604871  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:05.565852  7654 consensus_queue.cc:1048] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:14:05.614073  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:05.589695  7751 consensus_queue.cc:1048] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:14:05.615016  5122 raft_consensus.cc:2376] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 5. Re-sending same reply.
I20260709 12:14:05.612092  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:05.618316  5125 raft_consensus.cc:2393] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 4: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:05.618978  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:05.620961  5122 raft_consensus.cc:2468] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 4.
I20260709 12:14:05.623411  7754 raft_consensus.cc:3055] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:05.623889  7754 raft_consensus.cc:740] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
W20260709 12:14:05.620692  5831 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46094 (request call id 756) took 1606 ms (client timeout 1763 ms). Trace:
W20260709 12:14:05.625824  5831 rpcz_store.cc:269] 0709 12:14:04.014178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:04.237531 (+223353us) service_pool.cc:224] Handling call
0709 12:14:05.620494 (+1382963us) spinlock_profiling.cc:243] Waited 420 ms on lock 0x7b54004637d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:05.620631 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":966845312}
I20260709 12:14:05.627388  5268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34674 (request call id 1947) took 1328 ms. Trace:
I20260709 12:14:05.627781  5268 rpcz_store.cc:276] 0709 12:14:04.298485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:04.356729 (+ 58244us) service_pool.cc:224] Handling call
0709 12:14:04.357063 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:04.548177 (+191114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:05.627156 (+1078979us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b54000f8054. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:05.627332 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":438140288}
I20260709 12:14:05.619757  7768 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:14:05.620289  5195 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47728 (request call id 1893) took 2866 ms (client timeout 1795 ms). Trace:
I20260709 12:14:05.631769  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:05.633113  5122 raft_consensus.cc:2410] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:14:05.633807  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
W20260709 12:14:05.633621  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 81602.6us
I20260709 12:14:05.617740  7647 leader_election.cc:290] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:05.624763  7754 consensus_queue.cc:260] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:05.635047  5125 raft_consensus.cc:2376] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 4. Re-sending same reply.
I20260709 12:14:05.637192  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:05.632166  5195 rpcz_store.cc:269] 0709 12:14:02.753856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:02.758140 (+  4284us) service_pool.cc:224] Handling call
0709 12:14:05.620064 (+2861924us) spinlock_profiling.cc:243] Waited 658 ms on lock 0x7b54001c93d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:05.620202 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1514505984}
I20260709 12:14:05.643024  7819 leader_election.cc:290] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:05.646502  7754 raft_consensus.cc:3060] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:05.647163  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:05.650701  5803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:05.651001  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:05.652025  5125 raft_consensus.cc:2393] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 7: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:05.656184  7660 consensus_queue.cc:260] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:05.658188  7769 raft_consensus.cc:493] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:05.658780  7769 raft_consensus.cc:515] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:05.661429  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
W20260709 12:14:05.667346  5088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:05.669130  5165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:05.673338  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:05.674254  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:05.674741  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:05.675031  5268 raft_consensus.cc:2393] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 7: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:05.675442  5240 leader_election.cc:304] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:05.675331  5273 raft_consensus.cc:3060] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:05.678884  5804 leader_election.cc:304] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:05.679126  5240 leader_election.cc:304] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:05.683627  5273 raft_consensus.cc:2468] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 8.
I20260709 12:14:05.685818  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:05.687860  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:05.688524  5196 raft_consensus.cc:2468] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
I20260709 12:14:05.688792  5164 leader_election.cc:304] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:05.689538  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:05.690165  5194 raft_consensus.cc:2468] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:14:05.694600  5191 raft_consensus.cc:1240] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:05.695956  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:05.696285  5118 raft_consensus.cc:2468] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 5.
I20260709 12:14:05.696482  5801 leader_election.cc:304] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:05.696676  5122 raft_consensus.cc:2376] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 5. Re-sending same reply.
I20260709 12:14:05.698213  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:05.698819  5196 raft_consensus.cc:3060] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:05.699615  5237 leader_election.cc:304] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:05.706418  5265 raft_consensus.cc:1275] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:14:05.708973  5272 raft_consensus.cc:1240] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:05.701977  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:05.710590  5191 raft_consensus.cc:3060] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:05.681842  7729 raft_consensus.cc:2749] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:05.714008  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:05.681632  7712 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.714784  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:05.714794  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:05.717942  5200 raft_consensus.cc:2468] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 2.
I20260709 12:14:05.718026  5123 raft_consensus.cc:2376] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 5. Re-sending same reply.
I20260709 12:14:05.718420  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:05.717202  5198 raft_consensus.cc:2468] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 4.
I20260709 12:14:05.719218  5199 raft_consensus.cc:2368] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 7. Current term is 8.
I20260709 12:14:05.719431  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:05.719666  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:05.719920  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:05.720005  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:05.720907  5199 raft_consensus.cc:3060] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:05.721169  5198 raft_consensus.cc:1275] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:14:05.722697  5271 raft_consensus.cc:1275] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:05.793583  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
W20260709 12:14:05.794768  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 70877us
I20260709 12:14:05.795857  5200 raft_consensus.cc:2410] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 12:14:05.793809  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 95450.2us
I20260709 12:14:05.719013  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:05.797461  7712 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:05.728577  5198 raft_consensus.cc:1275] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:14:05.800932  7712 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:05.684132  7777 raft_consensus.cc:2749] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:05.801868  7777 raft_consensus.cc:2804] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:05.802356  7777 raft_consensus.cc:697] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 8 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:05.803233  7777 consensus_queue.cc:237] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:05.718209  7841 raft_consensus.cc:493] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.807323  7841 raft_consensus.cc:515] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:05.809583  7841 leader_election.cc:290] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:05.812208  5197 raft_consensus.cc:3060] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:05.813881  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:05.712709  7819 consensus_queue.cc:1048] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.103s
I20260709 12:14:05.716037  7843 raft_consensus.cc:493] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.720027  7769 leader_election.cc:290] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:05.718698  7644 raft_consensus.cc:493] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:05.711999  7847 raft_consensus.cc:493] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.682029  7793 raft_consensus.cc:493] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:05.807631  5192 raft_consensus.cc:2468] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 7.
I20260709 12:14:05.715415  7751 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.682958  7660 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:05.815256  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:05.816054  5199 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:14:05.720223  7625 raft_consensus.cc:2804] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:05.828020  5123 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
new_leader_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:45628
I20260709 12:14:05.716513  7713 raft_consensus.cc:2749] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:05.852085  5198 raft_consensus.cc:2393] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 4: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:05.715260  7776 consensus_queue.cc:1059] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.116s
I20260709 12:14:05.841030  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:05.846755  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:05.850339  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:05.712428  7608 consensus_queue.cc:1048] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.118s
I20260709 12:14:05.838757  5191 raft_consensus.cc:2468] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 7.
I20260709 12:14:05.839658  5196 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 7.
I20260709 12:14:05.852182  5123 raft_consensus.cc:606] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 LEADER]: Received request to transfer leadership to TS 9e794b72ed7640219f90ec4232363929
I20260709 12:14:05.879078  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:05.878322  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 178154us
I20260709 12:14:05.879793  5199 raft_consensus.cc:2468] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 3.
I20260709 12:14:05.713423  7728 consensus_queue.cc:1048] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.125s
I20260709 12:14:05.853158  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:05.881665  5198 raft_consensus.cc:3060] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:05.851745  7625 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:05.882663  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 181885us
I20260709 12:14:05.862565  5088 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:05.863227  7548 consensus_queue.cc:1048] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:14:05.870281  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:05.902034  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:05.816622  7665 raft_consensus.cc:2749] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:05.812640  7823 consensus_queue.cc:1059] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 12:14:05.830610  7712 consensus_queue.cc:1059] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:14:05.913647  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:05.872028  7751 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:05.892218  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:05.896122  5196 raft_consensus.cc:1275] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:14:05.900959  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:05.925413  5192 raft_consensus.cc:3060] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:05.815907  7618 consensus_queue.cc:1048] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 12:14:05.898805  5088 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
W20260709 12:14:05.912020  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 231364us
I20260709 12:14:05.829285  7754 consensus_queue.cc:1059] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
W20260709 12:14:05.917090  5166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:05.884657  7528 raft_consensus.cc:493] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.931639  5198 raft_consensus.cc:2410] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:14:05.919514  5240 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:05.906772  7660 raft_consensus.cc:2804] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:05.902729  7625 raft_consensus.cc:3060] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:05.952100  5197 raft_consensus.cc:1275] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:05.850646  7847 raft_consensus.cc:515] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:05.878597  7647 consensus_queue.cc:1059] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 12:14:05.848186  7843 raft_consensus.cc:515] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:05.852514  7793 raft_consensus.cc:515] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:05.954870  5124 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40402 (request call id 1948) took 1721 ms (client timeout 2089 ms). Trace:
I20260709 12:14:05.852033  7854 consensus_queue.cc:1059] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.096s
I20260709 12:14:05.847070  7644 raft_consensus.cc:515] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:05.956563  5088 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:05.957424  5192 raft_consensus.cc:2410] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:14:06.024996  5124 rpcz_store.cc:269] 0709 12:14:04.232980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:04.234197 (+  1217us) service_pool.cc:224] Handling call
0709 12:14:05.954657 (+1720460us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b5400070b54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:05.954802 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":233684864}
I20260709 12:14:05.923367  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:05.933652  7654 raft_consensus.cc:493] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.958541  5197 raft_consensus.cc:1275] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:14:06.031040  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 199313us
I20260709 12:14:06.034024  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:06.016808  7544 consensus_queue.cc:1059] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 12:14:06.014331  7777 consensus_queue.cc:1048] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:14:06.047572  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:05.960331  7325 consensus_queue.cc:1048] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.103s
I20260709 12:14:06.048794  7754 raft_consensus.cc:493] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:06.076288  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:06.083148  5200 raft_consensus.cc:2393] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 4: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:06.084043  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:06.084751  5200 raft_consensus.cc:2393] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 5: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:06.087543  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:06.093515  5200 raft_consensus.cc:2468] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 6.
I20260709 12:14:06.094605  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:06.095345  5200 raft_consensus.cc:2468] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 6.
I20260709 12:14:05.955420  7768 consensus_queue.cc:1059] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.119s
I20260709 12:14:06.106313  5237 leader_election.cc:304] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:06.035228  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:06.034626  7660 raft_consensus.cc:697] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:06.047318  5199 raft_consensus.cc:2393] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 4: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:06.069837  5191 raft_consensus.cc:2376] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 5. Re-sending same reply.
I20260709 12:14:06.108819  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:06.109470  5237 leader_election.cc:304] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:06.109879  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
W20260709 12:14:06.070648  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 114166us
I20260709 12:14:06.073793  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:06.098644  5166 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:05.949213  7528 raft_consensus.cc:515] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:06.110455  5191 raft_consensus.cc:3060] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:06.048199  7712 raft_consensus.cc:3055] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:06.064248  7654 raft_consensus.cc:515] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:06.072173  7808 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.073218  7619 raft_consensus.cc:2764] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:14:06.114276  5197 raft_consensus.cc:3060] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:06.126150  5804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:06.110710  5237 leader_election.cc:304] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:06.131686  5237 leader_election.cc:304] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:05.947026  7857 raft_consensus.cc:3055] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:05.954528  7802 raft_consensus.cc:2804] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:06.094154  7859 raft_consensus.cc:2804] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:06.129854  5088 leader_election.cc:304] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:14:06.133713  5237 leader_election.cc:304] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:06.121582  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:06.099617  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:06.112816  5195 raft_consensus.cc:1275] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:14:06.140610  5192 raft_consensus.cc:2393] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 6: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:06.140257  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:06.142624  5088 leader_election.cc:400] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Vote denied by peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455) with higher term. Message: Invalid argument: T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 7. Current term is 8.
I20260709 12:14:06.142979  5088 leader_election.cc:403] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:14:06.119850  7728 raft_consensus.cc:3055] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:06.142050  5834 raft_consensus.cc:1275] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:06.095366  7754 raft_consensus.cc:515] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:06.118114  7768 raft_consensus.cc:2749] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:06.120198  7712 raft_consensus.cc:740] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:06.153921  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:06.137362  7818 raft_consensus.cc:493] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.097832  7856 consensus_queue.cc:1059] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 12:14:06.135320  7857 raft_consensus.cc:740] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:06.151525  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:06.147545  5197 raft_consensus.cc:2468] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 9.
I20260709 12:14:06.154695  5833 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 5.
I20260709 12:14:06.157311  5838 raft_consensus.cc:1275] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:06.183574  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:06.184345  5832 raft_consensus.cc:2393] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 6: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:06.185030  7608 consensus_queue.cc:1048] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:06.185784  7843 leader_election.cc:290] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:06.157424  7729 raft_consensus.cc:2749] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:06.186890  7729 raft_consensus.cc:3060] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:06.187599  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:06.188207  5837 raft_consensus.cc:2468] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 3.
I20260709 12:14:06.189401  5837 raft_consensus.cc:1240] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 4 LEADER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 3. Current term is 4. Ops: []
W20260709 12:14:06.190016  7860 log.cc:927] Time spent T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:14:06.189729  7712 consensus_queue.cc:260] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:06.190783  5837 raft_consensus.cc:1275] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:14:06.190948  7712 raft_consensus.cc:3060] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:06.182603  7838 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.191658  5836 raft_consensus.cc:1240] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 8 LEADER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:06.191999  7838 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:06.153162  7660 consensus_queue.cc:237] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:06.193614  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:06.182529  5834 raft_consensus.cc:2468] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 5.
I20260709 12:14:06.194701  7754 leader_election.cc:290] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:06.195137  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:06.150255  7619 raft_consensus.cc:2804] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:06.160540  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:06.201520  5835 raft_consensus.cc:3060] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:06.180742  5192 raft_consensus.cc:1275] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:14:06.132447  7808 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:06.146310  7728 raft_consensus.cc:740] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:06.195711  5832 raft_consensus.cc:2468] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 6.
I20260709 12:14:06.146623  5191 raft_consensus.cc:2468] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 7.
I20260709 12:14:06.187049  5804 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:06.151937  7802 raft_consensus.cc:697] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:06.157145  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:14:06.247905  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 60909.6us
I20260709 12:14:06.273054  5804 leader_election.cc:304] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:06.252719  7644 leader_election.cc:290] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:06.253201  7768 raft_consensus.cc:2804] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:06.262787  7800 raft_consensus.cc:493] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:06.263641  7805 raft_consensus.cc:2804] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:06.264849  7847 leader_election.cc:290] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:06.237715  7754 raft_consensus.cc:493] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.289047  7768 raft_consensus.cc:493] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:06.268056  7528 leader_election.cc:290] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:06.297889  7800 raft_consensus.cc:515] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:06.218415  5835 raft_consensus.cc:2468] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 8.
I20260709 12:14:06.321542  7802 consensus_queue.cc:237] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:06.279575  5192 raft_consensus.cc:1240] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 6. Current term is 7. Ops: []
W20260709 12:14:06.281240  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 380831us
I20260709 12:14:06.323640  7800 leader_election.cc:290] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:06.289258  7801 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.229372  7848 raft_consensus.cc:2804] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:06.181732  7819 raft_consensus.cc:2749] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455) with higher term. Message: Invalid argument: T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 7. Current term is 8.
I20260709 12:14:06.266775  7808 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:06.238324  7751 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:06.216931  7619 raft_consensus.cc:493] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:06.319900  7754 raft_consensus.cc:515] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:06.325877  7619 raft_consensus.cc:3060] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:06.327291  7754 leader_election.cc:290] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:06.273162  5191 raft_consensus.cc:1275] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:14:06.324674  7801 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:06.291121  7805 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:06.282972  7548 raft_consensus.cc:493] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.182070  7818 raft_consensus.cc:515] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:06.330016  5192 raft_consensus.cc:1275] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:06.320043  7768 raft_consensus.cc:3060] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:06.353559  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:06.370626  5196 raft_consensus.cc:3055] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:06.371071  5196 raft_consensus.cc:740] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
W20260709 12:14:06.373927  5165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:06.336686  7805 raft_consensus.cc:3060] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:06.371806  5196 consensus_queue.cc:260] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:06.379792  5196 raft_consensus.cc:3060] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:06.368085  5831 raft_consensus.cc:2410] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:14:06.389175  5196 raft_consensus.cc:1275] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:06.349565  7848 raft_consensus.cc:697] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:06.375728  7793 leader_election.cc:290] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:06.379004  7867 raft_consensus.cc:493] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.340821  7548 raft_consensus.cc:515] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:06.393297  7528 raft_consensus.cc:493] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.390492  7819 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.397930  7870 raft_consensus.cc:493] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
W20260709 12:14:06.434156  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 514659us
I20260709 12:14:06.338867  7728 consensus_queue.cc:260] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:06.455127  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:06.456056  5198 raft_consensus.cc:2468] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 3.
I20260709 12:14:06.458753  5121 raft_consensus.cc:1275] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:14:06.461691  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:06.463202  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:06.465422  7625 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:06.467721  7625 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:06.471479  7801 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:06.339443  7857 consensus_queue.cc:260] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:06.473623  7857 raft_consensus.cc:3060] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:06.477334  7848 consensus_queue.cc:237] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:06.481969  5240 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.212.129:34443 timed out after 2.089s (SENT) [suppressed 33 similar messages]
I20260709 12:14:06.482897  7713 raft_consensus.cc:493] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.483321  7619 raft_consensus.cc:515] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:06.483405  7713 raft_consensus.cc:515] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:06.485880  7713 leader_election.cc:290] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:06.489048  7870 raft_consensus.cc:515] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:06.490859  7729 raft_consensus.cc:2749] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:06.491773  7870 leader_election.cc:290] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:06.492479  7870 raft_consensus.cc:2749] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:06.493089  7870 raft_consensus.cc:2749] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:06.494642  7548 leader_election.cc:290] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:06.440953  7528 raft_consensus.cc:515] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:06.458082  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:06.499291  5124 raft_consensus.cc:2393] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 6: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:06.501346  5123 raft_consensus.cc:1275] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 12:14:06.505566  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 360649us
I20260709 12:14:06.465647  7818 leader_election.cc:290] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:06.504004  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 392780us
I20260709 12:14:06.517669  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:06.519738  5166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:06.520375  5166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:06.538357  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:06.539485  5238 leader_election.cc:304] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:06.545569  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:06.549062  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 415377us
I20260709 12:14:06.552172  5238 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:06.538189  7644 raft_consensus.cc:493] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.554080  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:06.538460  7859 raft_consensus.cc:697] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 5 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:06.509863  7619 leader_election.cc:290] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:06.505218  7870 consensus_queue.cc:1048] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:14:06.496809  7819 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:06.555682  5121 raft_consensus.cc:2468] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 6.
I20260709 12:14:06.554260  5124 raft_consensus.cc:1240] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:06.557286  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:06.558933  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:06.449594  7867 raft_consensus.cc:515] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:06.564563  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:06.549805  5237 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:06.551959  7871 raft_consensus.cc:2749] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:06.582228  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:06.592341  5116 raft_consensus.cc:2468] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 5.
I20260709 12:14:06.613669  5268 raft_consensus.cc:1275] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:06.613756  5119 raft_consensus.cc:2393] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 4: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:06.595206  5117 raft_consensus.cc:1275] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:14:06.605178  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 332204us
I20260709 12:14:06.616338  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:06.616830  5804 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:06.555155  7729 raft_consensus.cc:2764] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:14:06.592341  5089 leader_election.cc:304] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:06.617442  5270 raft_consensus.cc:1240] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 5. Current term is 7. Ops: []
I20260709 12:14:06.614923  5269 raft_consensus.cc:1275] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:14:06.617170  5268 raft_consensus.cc:2393] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 6: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:06.618064  5267 raft_consensus.cc:1240] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:14:06.619951  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:06.621249  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:06.622866  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:06.624500  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:06.626048  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:06.626695  5270 raft_consensus.cc:2468] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 4.
I20260709 12:14:06.629279  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:06.635455  7878 consensus_queue.cc:1059] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:06.636139  7841 raft_consensus.cc:3055] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:06.636755  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:06.638214  5273 raft_consensus.cc:1275] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:06.638343  5265 raft_consensus.cc:2393] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 4: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:06.639308  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:06.629606  5267 raft_consensus.cc:2468] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 5.
W20260709 12:14:06.636790  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 87058us
I20260709 12:14:06.620159  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:06.641366  5268 raft_consensus.cc:2468] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 4.
I20260709 12:14:06.642176  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:06.642447  5268 raft_consensus.cc:1240] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:06.621934  5269 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 5.
I20260709 12:14:06.553524  7858 consensus_queue.cc:1059] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:14:06.639963  5273 raft_consensus.cc:2468] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 6.
I20260709 12:14:06.645149  5804 leader_election.cc:304] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:06.646049  5270 raft_consensus.cc:2468] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 7.
I20260709 12:14:06.646459  5265 raft_consensus.cc:1240] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:06.646545  5237 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:06.636657  7841 raft_consensus.cc:740] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:06.651897  5267 raft_consensus.cc:1240] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:14:06.653673  5118 raft_consensus.cc:1275] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:14:06.656803  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:06.657701  5273 raft_consensus.cc:2410] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:14:06.657753  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:06.658493  5267 raft_consensus.cc:2393] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 5: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:06.654508  5266 raft_consensus.cc:1240] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:14:06.663755  5804 leader_election.cc:304] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:06.665086  5804 leader_election.cc:304] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:06.662812  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:06.666167  5271 raft_consensus.cc:3060] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:06.560328  7644 raft_consensus.cc:515] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:06.672462  5804 leader_election.cc:304] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:06.673571  5804 leader_election.cc:304] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:14:06.674741  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 168168us
W20260709 12:14:06.675060  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 82878.7us
I20260709 12:14:06.676128  5088 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:06.637738  7856 raft_consensus.cc:493] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.647819  7887 raft_consensus.cc:493] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.681722  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:06.686259  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 128077us
I20260709 12:14:06.684931  5089 leader_election.cc:304] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:06.663398  7857 raft_consensus.cc:2804] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:06.668558  7760 raft_consensus.cc:2804] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:06.691057  5088 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:06.708352  5089 leader_election.cc:304] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
W20260709 12:14:06.691035  5801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:06.710171  5089 leader_election.cc:304] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:14:06.705293  5271 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:14:06.691382  5198 raft_consensus.cc:2410] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:14:06.562346  7869 consensus_queue.cc:1048] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.100s
I20260709 12:14:06.672068  7713 raft_consensus.cc:3055] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:06.724640  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:06.811003  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:06.811659  5198 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:14:06.812629  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:06.683668  7865 raft_consensus.cc:2749] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:06.743111  5089 leader_election.cc:304] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:06.814845  7865 raft_consensus.cc:2749] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:06.696979  7712 raft_consensus.cc:2749] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:06.689728  7325 raft_consensus.cc:2749] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:06.695299  7888 consensus_queue.cc:1048] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 12:14:06.816459  7325 raft_consensus.cc:493] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:06.817000  7888 raft_consensus.cc:2749] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:06.817142  7325 raft_consensus.cc:515] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:06.813233  5198 raft_consensus.cc:2468] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:14:06.818897  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:06.819950  7325 leader_election.cc:290] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:06.743556  7774 consensus_queue.cc:1048] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 12:14:06.741160  7823 raft_consensus.cc:493] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.821044  7823 raft_consensus.cc:515] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:06.823262  7823 leader_election.cc:290] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:06.690311  7872 raft_consensus.cc:493] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.819962  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:06.681037  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 199082us
I20260709 12:14:06.711922  7660 raft_consensus.cc:2804] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:06.824059  7872 raft_consensus.cc:515] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:06.824865  7660 raft_consensus.cc:697] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:06.825476  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:06.825788  7660 consensus_queue.cc:237] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:06.826719  7872 leader_election.cc:290] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:06.743758  7793 raft_consensus.cc:2804] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:06.826964  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:06.717712  7802 raft_consensus.cc:2749] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:14:06.795380  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 121860us
I20260709 12:14:06.712657  7878 raft_consensus.cc:493] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:06.828389  5804 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:06.828542  7793 raft_consensus.cc:697] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:06.828235  7878 raft_consensus.cc:515] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:06.828255  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:06.739814  7877 log.cc:927] Time spent T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:14:06.829648  5804 leader_election.cc:304] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:06.706291  7868 raft_consensus.cc:3055] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:06.823256  5088 leader_election.cc:304] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:06.725499  7801 raft_consensus.cc:2804] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:06.831274  7801 raft_consensus.cc:697] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:06.718272  7892 raft_consensus.cc:2804] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:06.832208  7892 raft_consensus.cc:493] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:06.832576  7878 leader_election.cc:290] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:06.740087  7871 raft_consensus.cc:493] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.832971  5164 leader_election.cc:304] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:06.743198  7760 raft_consensus.cc:697] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 5 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:06.740803  7867 leader_election.cc:290] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:06.833344  7871 raft_consensus.cc:515] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:06.725740  7858 raft_consensus.cc:493] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.834524  7872 raft_consensus.cc:2804] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:06.832647  7892 raft_consensus.cc:3060] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:06.837049  7878 raft_consensus.cc:493] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.726020  7870 raft_consensus.cc:2749] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:06.833884  7867 raft_consensus.cc:2749] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:06.838665  7870 raft_consensus.cc:2749] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:06.838974  5164 leader_election.cc:304] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:06.839205  7886 consensus_queue.cc:1048] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:06.839583  7872 raft_consensus.cc:493] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:06.839964  7872 raft_consensus.cc:3060] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:06.840431  7873 consensus_queue.cc:1059] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:06.829574  7793 consensus_queue.cc:237] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:06.841315  7873 consensus_queue.cc:1243] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer bce73265e27d4b30a4dcc1e491305088 log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:14:06.841899  7873 raft_consensus.cc:3055] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:06.842286  7873 raft_consensus.cc:740] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:06.834477  7858 raft_consensus.cc:515] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:06.837689  7878 raft_consensus.cc:515] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:06.845147  7858 leader_election.cc:290] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:06.833546  7801 consensus_queue.cc:237] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:06.846268  7878 leader_election.cc:290] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:06.835793  7871 leader_election.cc:290] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:06.835780  7760 consensus_queue.cc:237] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:06.836817  7823 raft_consensus.cc:2804] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:06.847981  7823 raft_consensus.cc:493] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:06.848383  7823 raft_consensus.cc:3060] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:06.840811  7886 raft_consensus.cc:2804] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:06.849637  7886 raft_consensus.cc:493] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:06.850024  7886 raft_consensus.cc:3060] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:06.854259  7873 consensus_queue.cc:260] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:06.855769  7873 raft_consensus.cc:3060] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:06.716297  7548 raft_consensus.cc:2749] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:06.830560  7868 raft_consensus.cc:740] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:06.858572  7868 consensus_queue.cc:260] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:06.859967  7868 raft_consensus.cc:3060] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:06.863725  7892 raft_consensus.cc:515] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:06.866021  7872 raft_consensus.cc:515] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:06.866933  7892 leader_election.cc:290] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:06.868474  7872 leader_election.cc:290] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:06.870025  7867 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.870643  7867 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:06.873517  7867 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:06.874866  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:06.875113  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:06.875422  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:06.876222  5832 raft_consensus.cc:2393] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 4: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:06.876263  5836 raft_consensus.cc:1275] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:06.877456  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:06.879014  5088 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:06.829607  5198 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
I20260709 12:14:06.879978  5088 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:06.881668  7802 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:06.750921  7625 raft_consensus.cc:493] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:06.743363  7879 consensus_queue.cc:1048] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 12:14:06.880635  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:06.882663  5834 raft_consensus.cc:1275] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:14:06.677861  7859 consensus_queue.cc:237] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:06.883981  5835 raft_consensus.cc:3060] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:06.742887  7819 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:06.739396  7880 consensus_queue.cc:1048] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 12:14:06.696946  7856 raft_consensus.cc:515] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:06.749485  7619 consensus_queue.cc:1048] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 12:14:06.923877  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:06.924755  5834 raft_consensus.cc:2468] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 7.
W20260709 12:14:06.924850  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 181784us
I20260709 12:14:06.925740  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:06.926358  5833 raft_consensus.cc:2468] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 6.
I20260709 12:14:06.883294  5088 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:06.882721  7713 raft_consensus.cc:740] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:06.800680  7894 raft_consensus.cc:2804] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:06.908476  5835 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
W20260709 12:14:06.927376  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 44163.3us
I20260709 12:14:06.891497  5198 raft_consensus.cc:2410] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:14:06.924145  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:06.799237  7805 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:06.888309  7548 raft_consensus.cc:2804] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:06.935760  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:06.753549  7841 consensus_queue.cc:260] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:06.707347  7887 raft_consensus.cc:515] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:06.956403  5272 raft_consensus.cc:1240] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:06.933697  7818 raft_consensus.cc:2804] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:06.899899  7625 raft_consensus.cc:515] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:06.951778  7884 raft_consensus.cc:493] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.948680  7894 raft_consensus.cc:697] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 4 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:06.953678  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:14:06.950214  5240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:07.050899  5829 raft_consensus.cc:2468] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 5.
W20260709 12:14:07.035027  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 96030.9us
I20260709 12:14:06.946889  5198 raft_consensus.cc:2468] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 7.
I20260709 12:14:07.053912  5089 leader_election.cc:304] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:07.055265  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:07.056625  5198 raft_consensus.cc:2468] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 4.
W20260709 12:14:07.057958  5166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:07.061975  5196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41416 (request call id 486) took 1135 ms. Trace:
I20260709 12:14:07.062634  5196 rpcz_store.cc:276] 0709 12:14:05.926270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:05.926403 (+   133us) service_pool.cc:224] Handling call
0709 12:14:05.926693 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:06.390994 (+464301us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:07.061141 (+670147us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b5400137ed4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:07.061717 (+   576us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1021554176}
I20260709 12:14:07.065521  5829 raft_consensus.cc:1275] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:07.065600  5193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 1885) took 1362 ms. Trace:
I20260709 12:14:07.070441  5193 rpcz_store.cc:276] 0709 12:14:05.686827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:05.690807 (+  3980us) service_pool.cc:224] Handling call
0709 12:14:05.691126 (+   319us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:05.712164 (+ 21038us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:05.712195 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:05.712777 (+   582us) log.cc:844] Serialized 52 byte log entry
0709 12:14:06.027648 (+314871us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:06.385786 (+358138us) log.cc:844] Serialized 14 byte log entry
0709 12:14:06.386578 (+   792us) log.cc:844] Serialized 14 byte log entry
0709 12:14:07.047775 (+661197us) spinlock_profiling.cc:243] Waited 1.3 ms on lock 0x7b1800374aa0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3a50c0a 00007f84ed190219 00007f84e6779d70 00007f84e676d293 00007f84e6762cea 00007f84e676323a 00007f84e6bcda2a 00007f84e6bdd0bf 00007f84e6bdd038
0709 12:14:07.048606 (+   831us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:07.048794 (+   188us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:07.049030 (+   236us) raft_consensus.cc:1685] finished
0709 12:14:07.049050 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:07.049321 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25508,"prepare.queue_time_us":68851,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":77,"raft.queue_time_us":137146,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":19121,"spinlock_wait_cycles":11579520,"thread_start_us":508523,"threads_started":2,"wal-append.queue_time_us":335735}
W20260709 12:14:07.044553  5165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:07.075551  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:14:06.948336  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 134635us
I20260709 12:14:07.089504  7879 consensus_queue.cc:1048] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:07.077710  5196 raft_consensus.cc:1240] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:07.091149  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:07.091706  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:07.092696  5196 raft_consensus.cc:2376] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 7. Re-sending same reply.
I20260709 12:14:06.946061  7325 consensus_queue.cc:1048] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:14:06.951586  7548 raft_consensus.cc:697] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:07.101630  7548 consensus_queue.cc:237] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:06.992734  7625 leader_election.cc:290] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:07.105544  7528 leader_election.cc:290] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:06.976727  7644 leader_election.cc:290] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:06.973320  7713 consensus_queue.cc:260] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:07.108992  7713 raft_consensus.cc:3060] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:07.110080  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:07.110998  5193 raft_consensus.cc:3060] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:06.979199  7768 consensus_meta.cc:287] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.593s	user 0.004s	sys 0.005s
I20260709 12:14:07.113943  5199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41416 (request call id 483) took 1222 ms. Trace:
I20260709 12:14:07.114215  7768 raft_consensus.cc:515] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:07.116103  5197 raft_consensus.cc:1275] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:14:06.936144  7774 consensus_queue.cc:1048] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:14:07.117645  7618 raft_consensus.cc:3055] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:07.118212  7618 raft_consensus.cc:740] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:06.996239  7805 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:06.979811  7823 raft_consensus.cc:515] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:06.971887  7818 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:06.963542  7841 raft_consensus.cc:3060] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:07.130487  7823 leader_election.cc:290] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:07.130791  7848 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:06.991412  7856 leader_election.cc:290] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:06.949182  7857 raft_consensus.cc:697] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 5 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:07.079291  7859 raft_consensus.cc:493] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:07.132584  7859 raft_consensus.cc:515] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:06.978499  7897 log.cc:927] Time spent T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:14:07.135056  5274 raft_consensus.cc:1240] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:07.133365  7857 consensus_queue.cc:237] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:06.975837  7884 raft_consensus.cc:515] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:07.136826  5196 raft_consensus.cc:1240] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 6. Current term is 7. Ops: [3.2-6.4]
I20260709 12:14:06.953747  7871 consensus_queue.cc:1048] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:14:07.092900  5163 leader_election.cc:304] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:06.955417  7886 raft_consensus.cc:515] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:07.141645  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 49235us
I20260709 12:14:07.143108  5163 leader_election.cc:304] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:07.143843  7886 leader_election.cc:290] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:06.986871  7887 leader_election.cc:290] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:06.997736  7894 consensus_queue.cc:237] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:07.158475  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:07.170147  5838 raft_consensus.cc:2468] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 4.
I20260709 12:14:07.048305  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:07.087914  7910 raft_consensus.cc:2749] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:07.088900  7880 consensus_queue.cc:1048] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:14:06.949518  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 69125.7us
I20260709 12:14:07.114468  5199 rpcz_store.cc:276] 0709 12:14:05.891821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:05.891968 (+   147us) service_pool.cc:224] Handling call
0709 12:14:07.085480 (+1193512us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b54001946d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:07.113714 (+ 28234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":281566464}
I20260709 12:14:07.119889  7618 consensus_queue.cc:260] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:06.947679  7801 consensus_queue.cc:1048] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:14:07.192940  7871 consensus_queue.cc:1048] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:07.092814  5829 raft_consensus.cc:2410] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:14:07.194918  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:07.196165  5829 raft_consensus.cc:2410] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for term 7 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:14:07.138487  5088 leader_election.cc:304] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
W20260709 12:14:07.198036  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 59853.3us
I20260709 12:14:07.144960  7886 raft_consensus.cc:2749] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:07.165014  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:07.084730  5801 leader_election.cc:304] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:07.149581  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:07.152284  5163 leader_election.cc:304] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:07.167263  7818 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:07.203105  7769 consensus_queue.cc:1048] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:07.157793  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:07.158474  5166 leader_election.cc:304] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:07.206180  7910 raft_consensus.cc:2804] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:07.151039  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:14:07.207089  5804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:07.206765  7910 raft_consensus.cc:493] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:07.207667  5804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:07.153110  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:07.149344  7872 raft_consensus.cc:2804] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:07.208606  5835 raft_consensus.cc:1240] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:07.155364  7859 leader_election.cc:290] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:07.206516  5836 raft_consensus.cc:2468] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 4.
I20260709 12:14:07.209326  7859 consensus_queue.cc:1048] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:07.210299  7886 raft_consensus.cc:2804] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:07.131640  7848 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:07.210952  7886 raft_consensus.cc:697] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:07.185324  7618 raft_consensus.cc:3060] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:07.188619  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
W20260709 12:14:07.206256  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 141219us
I20260709 12:14:07.121937  5832 raft_consensus.cc:2468] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:14:07.205907  5834 raft_consensus.cc:2468] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 4.
I20260709 12:14:07.208936  7872 raft_consensus.cc:493] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:07.184799  5191 raft_consensus.cc:2410] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:14:07.190814  5240 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:07.206802  7866 raft_consensus.cc:2749] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:07.208803  5833 raft_consensus.cc:2468] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 5.
I20260709 12:14:07.207280  5237 leader_election.cc:304] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:07.219295  5193 raft_consensus.cc:2468] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 7.
W20260709 12:14:07.221276  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 62969.1us
I20260709 12:14:07.222561  5801 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:07.224953  5801 leader_election.cc:304] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:14:07.210541  7910 raft_consensus.cc:3060] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:07.230096  5199 raft_consensus.cc:2393] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 7: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:07.217454  7872 raft_consensus.cc:3060] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:07.235205  7848 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:07.235947  7848 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:07.236609  7848 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:07.236971  7838 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:07.237684  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:07.238909  7909 raft_consensus.cc:2749] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:14:07.247606  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 57137.9us
I20260709 12:14:07.239897  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:07.240965  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:07.252295  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:07.252489  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:07.252732  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 45710.3us
I20260709 12:14:07.253623  7859 raft_consensus.cc:2749] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:07.254019  5237 leader_election.cc:304] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:07.254498  7859 raft_consensus.cc:2749] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:07.256275  5117 raft_consensus.cc:2393] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 7: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:07.238821  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:07.257416  5166 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:07.257972  5838 raft_consensus.cc:1240] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 4 LEADER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:07.256311  5193 raft_consensus.cc:1240] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 6. Current term is 7. Ops: []
W20260709 12:14:07.242664  7745 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.070s	user 0.006s	sys 0.009s
I20260709 12:14:07.259586  7866 raft_consensus.cc:2804] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:07.241976  7644 raft_consensus.cc:2749] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:07.255352  7859 raft_consensus.cc:2749] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:07.261585  7745 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.159s	user 0.006s	sys 0.009s
I20260709 12:14:07.264400  5801 leader_election.cc:304] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:14:07.270074  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 124779us
I20260709 12:14:07.270835  5198 raft_consensus.cc:2376] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 9. Re-sending same reply.
I20260709 12:14:07.275257  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:07.264670  7866 raft_consensus.cc:493] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:07.275434  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:07.288656  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:07.281055  7866 raft_consensus.cc:3060] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:07.295339  7805 consensus_queue.cc:1048] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:07.296245  7665 raft_consensus.cc:3055] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:07.297802  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:07.298009  5164 leader_election.cc:304] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:07.298179  5197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47728 (request call id 1923) took 1263 ms. Trace:
I20260709 12:14:07.305553  5197 rpcz_store.cc:276] 0709 12:14:06.035172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:06.231080 (+195908us) service_pool.cc:224] Handling call
0709 12:14:07.115331 (+884251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:07.116555 (+  1224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:07.297994 (+181439us) spinlock_profiling.cc:243] Waited 883 ms on lock 0x7b54001946d0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc28ad 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:07.298121 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2031161216}
I20260709 12:14:07.305265  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:07.309115  5832 raft_consensus.cc:2393] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 6: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:07.311554  5199 raft_consensus.cc:1275] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:14:07.262758  7886 consensus_queue.cc:237] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:07.311946  5199 pending_rounds.cc:85] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808: Aborting all ops after (but not including) 4
I20260709 12:14:07.316398  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:07.294070  7838 raft_consensus.cc:2804] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:07.273617  7859 consensus_queue.cc:1048] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:14:07.315060  5163 leader_election.cc:304] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:07.316015  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:07.308156  7805 consensus_queue.cc:1243] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer ad2f9a1e2f7a45429fa69fd23d09f821 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:14:07.320833  5832 raft_consensus.cc:1275] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:14:07.322540  5832 raft_consensus.cc:1275] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:14:07.325188  5199 pending_rounds.cc:107] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:14:07.325667  5199 raft_consensus.cc:2889] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:07.337815  5118 raft_consensus.cc:2393] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 7: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:07.338330  5237 leader_election.cc:304] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:07.339315  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:07.340715  7871 raft_consensus.cc:2804] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:07.341318  7871 raft_consensus.cc:493] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:07.341835  7871 raft_consensus.cc:3060] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:07.344323  7802 raft_consensus.cc:2749] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:07.345973  7848 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:07.346441  7894 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:07.346704  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 82512.9us
I20260709 12:14:07.304742  7665 raft_consensus.cc:740] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:07.340726  5237 leader_election.cc:304] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:07.326660  7548 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:07.376487  7927 log.cc:927] Time spent T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:14:07.378785  5237 leader_election.cc:304] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:07.379448  5089 leader_election.cc:304] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:07.379643  7858 raft_consensus.cc:2804] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:07.379266  7894 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:07.380287  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 54239.8us
I20260709 12:14:07.318102  7838 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:07.384372  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 86710.5us
I20260709 12:14:07.307483  7644 consensus_queue.cc:1048] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.085s
I20260709 12:14:07.399597  5117 raft_consensus.cc:1240] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:07.404884  5801 leader_election.cc:304] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:14:07.398092  7854 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.200s	user 0.006s	sys 0.007s
I20260709 12:14:07.393796  7838 raft_consensus.cc:3060] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:07.393960  7909 raft_consensus.cc:2749] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:07.415233  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:07.413316  7854 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.344s	user 0.007s	sys 0.008s
I20260709 12:14:07.405656  7858 raft_consensus.cc:697] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 7 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
W20260709 12:14:07.441797  5240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:07.440972  5237 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
W20260709 12:14:07.449395  7923 log.cc:927] Time spent T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 12:14:07.450455  5830 raft_consensus.cc:1275] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:14:07.450724  7888 consensus_queue.cc:1048] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:14:07.451354  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:07.452899  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:07.453890  7768 leader_election.cc:290] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:07.454144  5192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47728 (request call id 1932) took 1353 ms. Trace:
I20260709 12:14:07.454559  5192 rpcz_store.cc:276] 0709 12:14:06.100442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:06.323142 (+222700us) service_pool.cc:224] Handling call
0709 12:14:06.323453 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:06.337295 (+ 13842us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:07.437546 (+1100251us) spinlock_profiling.cc:243] Waited 5.92 ms on lock 0x7b5400377dd4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:07.453963 (+ 16417us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13622528}
I20260709 12:14:07.457492  7849 raft_consensus.cc:2804] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:07.458014  7849 raft_consensus.cc:493] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:07.458915  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 64409.4us
I20260709 12:14:07.459651  5164 leader_election.cc:304] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:07.458372  7849 raft_consensus.cc:3060] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:07.464103  7581 raft_consensus.cc:2804] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:07.437672  7548 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:07.484887  5831 raft_consensus.cc:2410] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:14:07.485127  7843 raft_consensus.cc:2804] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:14:07.487421  7932 log.cc:927] Time spent T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.110s	user 0.000s	sys 0.003s
I20260709 12:14:07.489004  7777 raft_consensus.cc:3055] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:07.489506  5195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 1879) took 1804 ms. Trace:
I20260709 12:14:07.490406  5125 raft_consensus.cc:1217] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Deduplicated request from leader. Original: 2.3->[2.4-6.6]   Dedup: 2.4->[4.5-6.6]
W20260709 12:14:07.491277  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 285216us
I20260709 12:14:07.492342  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:07.493526  7894 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:14:07.496290  7895 log.cc:927] Time spent T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.517s	user 0.001s	sys 0.000s
I20260709 12:14:07.500252  5164 leader_election.cc:304] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:07.501017  7847 raft_consensus.cc:2804] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:14:07.502465  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 100509us
I20260709 12:14:07.509577  7581 raft_consensus.cc:697] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 7 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:07.480101  7776 raft_consensus.cc:2749] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:14:07.483160  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 193747us
I20260709 12:14:07.510504  7654 leader_election.cc:290] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:07.509764  7665 consensus_queue.cc:260] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:07.513943  5830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46088 (request call id 495) took 1342 ms. Trace:
I20260709 12:14:07.517490  7843 raft_consensus.cc:493] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
W20260709 12:14:07.521476  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 153128us
I20260709 12:14:07.523049  7858 consensus_queue.cc:237] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:07.527130  7802 raft_consensus.cc:2749] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:07.618096  7828 raft_consensus.cc:3055] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:07.517683  7768 raft_consensus.cc:2804] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:07.618551  7828 raft_consensus.cc:740] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:07.618935  7768 raft_consensus.cc:697] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 9 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:07.619678  7828 consensus_queue.cc:260] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:07.620085  7768 consensus_queue.cc:237] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:07.620940  7828 raft_consensus.cc:3060] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:07.533871  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:07.621789  5119 raft_consensus.cc:2468] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 4.
I20260709 12:14:07.622987  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:07.624236  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:07.625152  5119 raft_consensus.cc:2410] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:14:07.537005  7862 raft_consensus.cc:3055] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:07.537822  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:07.539098  7548 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:07.540418  7871 raft_consensus.cc:515] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:07.469029  5829 raft_consensus.cc:3060] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:07.547016  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 177297us
I20260709 12:14:07.548996  5125 pending_rounds.cc:85] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting all ops after (but not including) 4
W20260709 12:14:07.579202  5165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:07.597281  7581 consensus_queue.cc:237] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:07.598387  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:07.600739  5240 leader_election.cc:304] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:07.602838  5163 leader_election.cc:304] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:07.625460  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:07.606171  7878 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:07.449452  7870 consensus_queue.cc:1048] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.197s
I20260709 12:14:07.534956  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:07.545825  7777 raft_consensus.cc:740] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:07.624833  7625 consensus_queue.cc:1048] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:07.633571  5125 pending_rounds.cc:107] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:14:07.604104  7872 raft_consensus.cc:515] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:07.641155  5832 raft_consensus.cc:1275] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:07.617084  7843 raft_consensus.cc:3060] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:07.646693  5125 raft_consensus.cc:2889] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:14:07.643532  5237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:07.634222  7654 raft_consensus.cc:2804] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:07.626539  7665 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:14:07.628923  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 128711us
I20260709 12:14:07.645131  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:07.611135  7847 raft_consensus.cc:493] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:07.655776  7654 raft_consensus.cc:493] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:07.630126  7862 raft_consensus.cc:740] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:07.652413  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:07.662691  5238 leader_election.cc:304] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:07.671317  5164 leader_election.cc:304] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:07.673563  5801 leader_election.cc:304] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:14:07.675371  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 72619.4us
I20260709 12:14:07.548734  5195 rpcz_store.cc:276] 0709 12:14:05.685095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:05.705659 (+ 20564us) service_pool.cc:224] Handling call
0709 12:14:05.796881 (+ 91222us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:06.142420 (+345539us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:07.488954 (+1346534us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b540003a554. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:07.489305 (+   351us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":588709760}
I20260709 12:14:07.628443  7910 raft_consensus.cc:515] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:07.662649  7654 raft_consensus.cc:3060] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:07.680881  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 80224.7us
I20260709 12:14:07.676483  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:07.660840  7848 raft_consensus.cc:493] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:07.686010  5240 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:07.689714  7841 raft_consensus.cc:2804] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:07.612178  5830 rpcz_store.cc:276] 0709 12:14:06.140263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:06.141915 (+  1652us) service_pool.cc:224] Handling call
0709 12:14:07.430074 (+1288159us) spinlock_profiling.cc:243] Waited 1.17 ms on lock 0x7b58000b0498. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb9cfc0 00007f84ebb87929 00007f84ebb873d2 00007f84e50febd4
0709 12:14:07.437323 (+  7249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:07.464294 (+ 26971us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:07.482598 (+ 18304us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2686208}
I20260709 12:14:07.698657  7774 raft_consensus.cc:493] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:07.693635  7841 raft_consensus.cc:493] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:07.683476  5192 raft_consensus.cc:2468] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 4.
I20260709 12:14:07.699208  7871 leader_election.cc:290] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:07.699651  7841 raft_consensus.cc:3060] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:07.699383  7774 raft_consensus.cc:515] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:07.700191  7871 raft_consensus.cc:2804] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:07.700654  7871 raft_consensus.cc:493] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:07.701083  7871 raft_consensus.cc:3060] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:07.695221  5804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:07.668212  7847 raft_consensus.cc:3060] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:07.698770  7777 consensus_queue.cc:260] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:07.698203  7647 raft_consensus.cc:2804] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:07.674964  7769 raft_consensus.cc:2749] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:14:07.738219  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 46818us
I20260709 12:14:07.747560  5122 raft_consensus.cc:2393] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 8: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:07.747779  7777 raft_consensus.cc:3060] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:07.742527  7823 consensus_queue.cc:1048] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:14:07.700932  7862 consensus_queue.cc:260] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:07.706962  7869 raft_consensus.cc:2749] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:07.737116  7647 raft_consensus.cc:493] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:07.759685  5267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50932 (request call id 545) took 1050 ms. Trace:
I20260709 12:14:07.763064  7776 raft_consensus.cc:2749] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:14:07.753124  7944 log.cc:927] Time spent T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.225s	user 0.000s	sys 0.001s
I20260709 12:14:07.753839  7862 raft_consensus.cc:3060] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:07.786801  5165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:07.760345  5267 rpcz_store.cc:276] 0709 12:14:06.708741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:06.709349 (+   608us) service_pool.cc:224] Handling call
0709 12:14:07.077326 (+367977us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:07.079770 (+  2444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:07.079808 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:07.081050 (+  1242us) log.cc:844] Serialized 52 byte log entry
0709 12:14:07.178554 (+ 97504us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:07.178582 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:07.179880 (+  1298us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:07.586270 (+406390us) raft_consensus.cc:1685] finished
0709 12:14:07.586289 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:07.758926 (+172637us) spinlock_profiling.cc:243] Waited 367 ms on lock 0x7b54000d2350. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc28ad 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:07.759383 (+   457us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4285,"raft.run_cpu_time_us":454,"raft.run_wall_time_us":456,"spinlock_wait_cycles":844921216,"thread_start_us":94203,"threads_started":1,"wal-append.queue_time_us":175146}
I20260709 12:14:07.777822  7647 raft_consensus.cc:3060] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:07.672410  7878 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:07.796934  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 151292us
I20260709 12:14:07.802829  5089 leader_election.cc:304] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:14:07.803844  5804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:07.692095  7548 consensus_queue.cc:1059] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.103s
I20260709 12:14:07.778823  7866 raft_consensus.cc:515] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:07.812877  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 68542.3us
W20260709 12:14:07.818488  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 166959us
I20260709 12:14:07.820698  5163 leader_election.cc:304] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:07.823540  5088 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:07.795025  7848 raft_consensus.cc:515] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:07.827019  5802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:07.827777  5194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41416 (request call id 473) took 2004 ms. Trace:
W20260709 12:14:07.828207  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:07.829314  7884 leader_election.cc:290] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:14:07.842497  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 211962us
I20260709 12:14:07.849155  7838 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:07.851413  7872 leader_election.cc:290] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:07.851884  7838 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:07.858855  7841 raft_consensus.cc:515] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:07.851467  7654 raft_consensus.cc:515] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:07.862748  7774 leader_election.cc:290] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:07.863329  7774 raft_consensus.cc:2804] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:07.863687  7774 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:07.864014  7774 raft_consensus.cc:3060] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:07.869306  5200 raft_consensus.cc:1275] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:07.866593  7843 raft_consensus.cc:515] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:07.870709  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:07.871274  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:07.871466  7843 leader_election.cc:290] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:07.872112  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:07.872624  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:07.873624  5192 raft_consensus.cc:2468] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 4.
I20260709 12:14:07.829445  7846 consensus_queue.cc:1048] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.109s
I20260709 12:14:07.874867  5192 raft_consensus.cc:1240] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:07.875239  7644 raft_consensus.cc:2749] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:07.877019  7866 leader_election.cc:290] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:07.878165  7818 consensus_meta.cc:287] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.675s	user 0.011s	sys 0.004s
I20260709 12:14:07.878582  7818 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:07.879879  7847 raft_consensus.cc:515] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:07.880724  7818 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:07.881868  7910 leader_election.cc:290] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:07.882336  7847 leader_election.cc:290] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:07.883333  5831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46094 (request call id 767) took 1009 ms. Trace:
I20260709 12:14:07.883785  5831 rpcz_store.cc:276] 0709 12:14:06.874418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:06.874575 (+   157us) service_pool.cc:224] Handling call
0709 12:14:07.883043 (+1008468us) spinlock_profiling.cc:243] Waited 473 ms on lock 0x7b540048dd54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:07.883250 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1088841472}
W20260709 12:14:07.884580  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 198732us
W20260709 12:14:07.885980  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 65519.4us
I20260709 12:14:07.885236  5023 catalog_manager.cc:5697] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 1 to 2, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 2 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:07.887392  5023 catalog_manager.cc:5697] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 1 to 5, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 5 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:07.864135  7654 leader_election.cc:290] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:07.891849  7728 raft_consensus.cc:3060] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:07.861307  7841 leader_election.cc:290] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:07.849547  7619 consensus_queue.cc:1048] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:14:07.889981  5238 leader_election.cc:304] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:07.891660  7878 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:07.914040  5088 leader_election.cc:304] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
W20260709 12:14:07.917732  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 118559us
I20260709 12:14:07.917582  5804 leader_election.cc:304] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:07.918522  7802 consensus_queue.cc:1048] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:07.889873  7838 consensus_queue.cc:1059] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:14:07.919867  5197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 1915) took 1098 ms. Trace:
W20260709 12:14:07.921578  5165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:07.922318  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:07.926565  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:07.873317  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:07.828209  7801 raft_consensus.cc:3060] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:07.935204  5119 raft_consensus.cc:1240] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:07.919332  5116 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
new_leader_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:45628
W20260709 12:14:07.942466  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 52566us
I20260709 12:14:07.939736  5192 raft_consensus.cc:1275] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:14:07.942754  5116 raft_consensus.cc:606] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 LEADER]: Received request to transfer leadership to TS 9e794b72ed7640219f90ec4232363929
I20260709 12:14:07.843225  5194 rpcz_store.cc:276] 0709 12:14:05.796746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:05.797054 (+   308us) service_pool.cc:224] Handling call
0709 12:14:05.797348 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:06.078045 (+280697us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:14:06.503187 (+425142us) log.cc:844] Serialized 14 byte log entry
0709 12:14:06.648938 (+145751us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:06.649033 (+    95us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:06.649092 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:07.081881 (+432789us) spinlock_profiling.cc:243] Waited 4.48 ms on lock 0x7b180048e3e0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3aa42a6 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419
0709 12:14:07.784535 (+702654us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b54000bde54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:07.784593 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:07.801076 (+ 16483us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":27148,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":832,"raft.queue_time_us":99,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":21074,"spinlock_wait_cycles":655262848,"thread_start_us":567557,"threads_started":2,"wal-append.queue_time_us":244105,"wal-append.run_cpu_time_us":1210,"wal-append.run_wall_time_us":1014850}
I20260709 12:14:07.888432  7884 consensus_queue.cc:1059] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 12:14:07.898530  7849 raft_consensus.cc:515] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:07.957276  5238 leader_election.cc:304] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:07.960937  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:07.963508  5193 raft_consensus.cc:1240] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 LEADER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:07.937501  5197 rpcz_store.cc:276] 0709 12:14:06.821221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:07.316491 (+495270us) service_pool.cc:224] Handling call
0709 12:14:07.324334 (+  7843us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:07.396150 (+ 71816us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:14:07.669696 (+273546us) log.cc:844] Serialized 14 byte log entry
0709 12:14:07.809554 (+139858us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:07.843207 (+ 33653us) log.cc:844] Serialized 26 byte log entry
0709 12:14:07.843378 (+   171us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:07.843625 (+   247us) log.cc:844] Serialized 14 byte log entry
0709 12:14:07.845697 (+  2072us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:07.845770 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:07.919579 (+ 73809us) raft_consensus.cc:1685] finished
0709 12:14:07.919634 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:07.919804 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1837,"prepare.queue_time_us":244906,"prepare.run_cpu_time_us":149,"prepare.run_wall_time_us":148,"raft.queue_time_us":90139,"raft.run_cpu_time_us":508,"raft.run_wall_time_us":15739,"thread_start_us":390285,"threads_started":3,"wal-append.queue_time_us":165749}
I20260709 12:14:07.950400  7548 raft_consensus.cc:2804] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:07.953346  7644 raft_consensus.cc:3055] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:07.973099  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:07.973762  5192 raft_consensus.cc:3060] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:07.986644  5237 leader_election.cc:304] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:07.989727  5194 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:07.960338  7866 raft_consensus.cc:2804] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:07.991794  5089 leader_election.cc:304] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:07.948524  7859 consensus_queue.cc:1048] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:14:07.950829  7818 consensus_queue.cc:1048] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:14:07.999586  5237 leader_election.cc:304] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:07.998054  5119 raft_consensus.cc:1275] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:07.972476  7548 raft_consensus.cc:493] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:07.972615  7644 raft_consensus.cc:740] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:08.010262  5237 leader_election.cc:304] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:07.995384  7866 raft_consensus.cc:493] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:08.038856  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 87671.3us
I20260709 12:14:07.967497  7828 consensus_queue.cc:1059] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:14:08.003028  7884 raft_consensus.cc:2749] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:08.009893  7548 raft_consensus.cc:3060] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:08.075927  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 65743.9us
I20260709 12:14:08.064742  5023 catalog_manager.cc:5697] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 1 to 5, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 5 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:07.994755  7768 consensus_queue.cc:1059] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 12:14:08.107867  5237 leader_election.cc:304] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:14:08.108356  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 151165us
I20260709 12:14:08.073738  7866 raft_consensus.cc:3060] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:08.074620  7713 raft_consensus.cc:2804] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:14:08.135874  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 180716us
W20260709 12:14:08.145704  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 78534.3us
I20260709 12:14:08.077826  7954 raft_consensus.cc:2749] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:08.150949  5238 leader_election.cc:304] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:08.149973  7729 raft_consensus.cc:493] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:08.158404  7729 raft_consensus.cc:515] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:08.158941  7647 raft_consensus.cc:515] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:08.160858  7729 leader_election.cc:290] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:08.161479  7884 raft_consensus.cc:2749] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:08.163349  7953 raft_consensus.cc:2749] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:08.164149  7952 consensus_queue.cc:1048] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.172s
I20260709 12:14:08.164840  5198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:47718 (request call id 92) took 1389 ms. Trace:
W20260709 12:14:08.166896  7955 log.cc:927] Time spent T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.174s	user 0.000s	sys 0.000s
I20260709 12:14:08.169567  5124 raft_consensus.cc:1240] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 7. Current term is 8. Ops: [5.5-7.6]
I20260709 12:14:08.106530  7544 consensus_queue.cc:1048] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.233s
W20260709 12:14:08.172864  7964 log.cc:927] Time spent T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 12:14:08.111424  7871 raft_consensus.cc:515] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:08.176649  7962 log.cc:927] Time spent T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.065s	user 0.002s	sys 0.000s
I20260709 12:14:08.177322  7871 leader_election.cc:290] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:08.111100  7869 raft_consensus.cc:2749] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:08.179504  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 61316.2us
I20260709 12:14:08.165238  5198 rpcz_store.cc:276] 0709 12:14:06.775026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:07.281324 (+506298us) service_pool.cc:224] Handling call
0709 12:14:08.164505 (+883181us) spinlock_profiling.cc:243] Waited 587 ms on lock 0x7b54001950d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc9735 00007f84e6bc19fa 00007f84ebb894c9 00007f84e5105c54 00007f84e5105be2 00007f84e5105b11 00007f84e5105a8c 00007f84e5104d42 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:08.164748 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1349982464}
I20260709 12:14:08.126669  7713 raft_consensus.cc:493] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
W20260709 12:14:08.191380  5804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:08.183653  7888 raft_consensus.cc:2749] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:08.107627  7805 consensus_queue.cc:1048] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 12:14:08.154235  7768 consensus_queue.cc:1243] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer ad2f9a1e2f7a45429fa69fd23d09f821 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:14:08.190455  5192 raft_consensus.cc:2468] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 8.
I20260709 12:14:08.201085  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:08.201874  5833 raft_consensus.cc:3060] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:08.203519  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 76177.1us
I20260709 12:14:08.204290  5238 leader_election.cc:304] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:08.206101  5836 raft_consensus.cc:1240] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:08.207247  7805 raft_consensus.cc:2804] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:08.190647  7870 consensus_queue.cc:1048] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:14:08.207708  7805 raft_consensus.cc:493] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:08.208088  7805 raft_consensus.cc:3060] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:08.208492  7823 raft_consensus.cc:3055] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:08.208874  7823 raft_consensus.cc:740] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:08.193596  7713 raft_consensus.cc:3060] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:08.209748  7823 consensus_queue.cc:260] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:08.211814  7941 log.cc:927] Time spent T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.544s	user 0.002s	sys 0.005s
I20260709 12:14:08.212272  7581 raft_consensus.cc:2749] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:14:08.214040  7966 log.cc:927] Time spent T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:14:08.215293  7760 raft_consensus.cc:493] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:08.215828  7760 raft_consensus.cc:515] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:08.217991  7760 leader_election.cc:290] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:08.219748  5833 raft_consensus.cc:2468] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 5.
I20260709 12:14:08.221931  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:08.222505  7769 raft_consensus.cc:3055] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:08.222915  7769 raft_consensus.cc:740] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:08.223771  7769 consensus_queue.cc:260] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:08.213222  5191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 1905) took 1494 ms. Trace:
I20260709 12:14:08.225028  5191 rpcz_store.cc:276] 0709 12:14:06.719110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:07.229239 (+510129us) service_pool.cc:224] Handling call
0709 12:14:07.290424 (+ 61185us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:07.343352 (+ 52928us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:07.343376 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:07.343975 (+   599us) log.cc:844] Serialized 26 byte log entry
0709 12:14:07.433219 (+ 89244us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:07.433260 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:07.433449 (+   189us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:08.211164 (+777715us) spinlock_profiling.cc:243] Waited 3.74 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e675e86e 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221 00007f84e67671d9 00007f84e6767169
0709 12:14:08.212932 (+  1768us) raft_consensus.cc:1685] finished
0709 12:14:08.212953 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:08.213162 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8608512,"thread_start_us":88756,"threads_started":1,"wal-append.queue_time_us":205138}
I20260709 12:14:08.227097  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:08.185156  7544 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:08.227852  7544 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:08.207278  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:08.231979  5238 leader_election.cc:304] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:08.233989  7871 raft_consensus.cc:2804] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:14:08.231634  5829 consensus_meta.cc:287] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.552s	user 0.002s	sys 0.006s
I20260709 12:14:08.237085  5194 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:14:08.205629  7644 consensus_queue.cc:260] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:08.236779  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:08.161252  7647 leader_election.cc:290] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:08.259135  5194 raft_consensus.cc:3060] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:08.213161  7879 raft_consensus.cc:493] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:08.263387  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:08.201957  7884 raft_consensus.cc:493] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:08.242273  7871 raft_consensus.cc:493] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:08.284785  5802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:08.257054  7823 raft_consensus.cc:3060] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:08.289261  5834 raft_consensus.cc:2468] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 5.
W20260709 12:14:08.297825  5804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:08.253647  5829 raft_consensus.cc:2468] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 7.
I20260709 12:14:08.307022  5194 raft_consensus.cc:1275] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:14:08.306254  5804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:08.274755  7644 raft_consensus.cc:3060] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:08.304495  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 165371us
I20260709 12:14:08.310520  5166 leader_election.cc:304] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:08.312261  5198 raft_consensus.cc:1240] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:08.291038  7871 raft_consensus.cc:3060] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:08.291940  7769 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:08.253342  7774 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:08.348397  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:08.354110  5192 raft_consensus.cc:1240] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 12:14:08.360714  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:08.363649  5198 raft_consensus.cc:1240] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:08.311810  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:08.306836  7879 raft_consensus.cc:515] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:08.275876  7953 consensus_queue.cc:1048] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.080s
I20260709 12:14:08.347573  7838 raft_consensus.cc:2749] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:08.358335  5830 raft_consensus.cc:1275] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:14:08.382901  5270 raft_consensus.cc:1240] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 4. Current term is 5. Ops: []
W20260709 12:14:08.373687  5091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:08.373867  5832 raft_consensus.cc:1275] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:14:08.378368  7544 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:08.384805  7969 raft_consensus.cc:493] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:08.400933  5120 raft_consensus.cc:1240] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:08.396166  7969 raft_consensus.cc:515] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:08.400754  7947 log.cc:927] Time spent T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:14:08.355388  7884 raft_consensus.cc:515] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:08.424078  7972 log.cc:927] Time spent T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
W20260709 12:14:08.440958  7967 log.cc:927] Time spent T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.178s	user 0.002s	sys 0.000s
I20260709 12:14:08.524992  7849 leader_election.cc:290] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:08.525485  7528 raft_consensus.cc:493] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:08.539515  7528 raft_consensus.cc:515] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:08.550612  7858 raft_consensus.cc:493] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:08.551297  7858 raft_consensus.cc:515] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:08.552366  5122 raft_consensus.cc:1240] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:08.551637  7878 raft_consensus.cc:3055] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:08.539422  7774 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:08.587359  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:08.598801  5165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:08.599628  5165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:08.603888  5166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:08.563714  7878 raft_consensus.cc:740] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
W20260709 12:14:08.611357  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 690646us
I20260709 12:14:08.543599  5023 catalog_manager.cc:5697] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:14:08.605561  7849 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:08.619158  5270 raft_consensus.cc:1275] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:14:08.621070  5804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:08.578011  7768 consensus_queue.cc:1059] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
W20260709 12:14:08.627619  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 436123us
I20260709 12:14:08.601281  7954 consensus_queue.cc:1059] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:14:08.643657  5193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 1913) took 1922 ms. Trace:
I20260709 12:14:08.646754  5193 rpcz_store.cc:276] 0709 12:14:06.721047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:07.269043 (+547996us) service_pool.cc:224] Handling call
0709 12:14:07.290701 (+ 21658us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:07.963932 (+673231us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:08.643430 (+679498us) spinlock_profiling.cc:243] Waited 673 ms on lock 0x7b54003769d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:08.643597 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1546799488}
W20260709 12:14:08.637460  7801 consensus_meta.cc:287] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.685s	user 0.014s	sys 0.005s
I20260709 12:14:08.651008  5831 raft_consensus.cc:1275] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:14:08.656356  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:08.628579  5023 catalog_manager.cc:5697] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:08.662216  5801 leader_election.cc:304] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:08.629329  7849 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:08.673678  7879 leader_election.cc:290] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:08.643117  7777 consensus_queue.cc:1048] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:14:08.659191  7801 raft_consensus.cc:2749] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:14:08.678674  5237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:08.667153  7969 leader_election.cc:290] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:08.678469  7859 raft_consensus.cc:493] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:08.693189  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:08.677948  7957 raft_consensus.cc:493] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:08.680413  7528 leader_election.cc:290] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:08.702526  5117 raft_consensus.cc:1240] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:08.686921  7973 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:08.707018  5804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:08.705924  5018 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33888 (request call id 334) took 9998 ms. Trace:
I20260709 12:14:08.669853  7713 raft_consensus.cc:515] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:08.693992  7870 raft_consensus.cc:493] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:08.711098  7974 log.cc:927] Time spent T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 12:14:08.707482  5023 catalog_manager.cc:5697] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 4 to 5, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 5 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:08.695591  7618 raft_consensus.cc:493] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:08.712419  5837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46088 (request call id 500) took 1810 ms. Trace:
I20260709 12:14:08.698154  7884 leader_election.cc:290] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:08.724620  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:08.773164  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
W20260709 12:14:08.774827  5804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:08.737071  5237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:08.722959  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 60873.5us
I20260709 12:14:08.708787  7980 raft_consensus.cc:493] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
W20260709 12:14:08.780987  7986 log.cc:927] Time spent T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 12:14:08.797547  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
W20260709 12:14:08.714039  7548 consensus_meta.cc:287] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.599s	user 0.004s	sys 0.019s
I20260709 12:14:08.782858  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:14:08.716353  7728 consensus_meta.cc:287] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.824s	user 0.013s	sys 0.009s
W20260709 12:14:08.847209  5091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:08.779825  7981 log.cc:927] Time spent T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 12:14:08.786630  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:08.855008  5273 raft_consensus.cc:2468] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 4.
W20260709 12:14:08.772619  7960 log.cc:927] Time spent T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 12:14:08.776868  7801 raft_consensus.cc:493] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:08.856344  7801 raft_consensus.cc:515] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:08.858937  7801 leader_election.cc:290] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:08.794142  7713 leader_election.cc:290] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:08.716600  7866 consensus_meta.cc:287] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.559s	user 0.004s	sys 0.014s
W20260709 12:14:08.799206  5802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:08.724282  7865 raft_consensus.cc:2749] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:08.846349  5117 raft_consensus.cc:2393] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 4: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:08.859884  7866 raft_consensus.cc:515] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:08.862500  5838 raft_consensus.cc:2368] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 4. Current term is 5.
I20260709 12:14:08.862646  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:08.861801  5023 catalog_manager.cc:5697] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 2 to 4, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132), now has a pending config: VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129), VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130), VOTER 9e794b72ed7640219f90ec4232363929 (127.3.212.131), VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 4 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:14:08.784742  7870 raft_consensus.cc:515] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:08.864328  7866 leader_election.cc:290] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:08.864156  5023 catalog_manager.cc:5697] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 1 to 2, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 2 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } }
I20260709 12:14:08.865166  7870 leader_election.cc:290] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:08.868085  7808 raft_consensus.cc:493] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:08.868682  7808 raft_consensus.cc:515] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:08.869886  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 83710.4us
I20260709 12:14:08.709748  5018 rpcz_store.cc:276] 0709 12:13:58.680108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:58.680785 (+   677us) service_pool.cc:224] Handling call
0709 12:14:08.677891 (+9997106us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:00.719850 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:00.720507 (+   657us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:00.720557 (+    50us) write_op.cc:435] Acquired schema lock
0709 12:14:00.720575 (+    18us) tablet.cc:662] Decoding operations
0709 12:14:00.862426 (+141851us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:00.862531 (+   105us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:00.862583 (+    52us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:14:00.892567 (+ 29984us) tablet.cc:701] Row locks acquired
0709 12:14:00.892623 (+    56us) write_op.cc:260] PREPARE: finished
0709 12:14:00.892833 (+   210us) write_op.cc:270] Start()
0709 12:14:00.893009 (+   176us) write_op.cc:276] Timestamp: P: 1783599240892748 usec, L: 0
0709 12:14:00.893033 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:14:00.893906 (+   873us) log.cc:844] Serialized 5303 byte log entry
0709 12:14:01.540648 (+646742us) op_driver.cc:464] REPLICATION: finished
0709 12:14:01.723935 (+183287us) write_op.cc:301] APPLY: starting
0709 12:14:01.731886 (+  7951us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:01.790148 (+ 58262us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:01.821494 (+ 31346us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:01.838901 (+ 17407us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:01.839189 (+   288us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 12:14:01.839238 (+    49us) write_op.cc:312] APPLY: finished
0709 12:14:01.839605 (+   367us) log.cc:844] Serialized 95 byte log entry
0709 12:14:01.839808 (+   203us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:01.839946 (+   138us) write_op.cc:454] Released schema lock
0709 12:14:01.839991 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:01.840364 (+   373us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:01.840388 (+    24us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":12246,"reported_tablets":31,"child_traces":[["op",{"apply.queue_time_us":162786,"apply.run_cpu_time_us":4481,"apply.run_wall_time_us":125751,"num_ops":13,"prepare.queue_time_us":124833,"prepare.run_cpu_time_us":14450,"prepare.run_wall_time_us":347617,"raft.queue_time_us":117398,"raft.run_cpu_time_us":44950,"raft.run_wall_time_us":78944,"replication_time_us":647463,"thread_start_us":370721,"threads_started":4,"wal-append.queue_time_us":263279,"wal-append.run_cpu_time_us":31792,"wal-append.run_wall_time_us":1722507}]]}
I20260709 12:14:08.876637  5191 raft_consensus.cc:1275] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:14:08.881340  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:08.882370  7984 log.cc:927] Time spent T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.159s	user 0.003s	sys 0.000s
I20260709 12:14:08.885854  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:08.891534  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:08.889371  5195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 1924) took 1024 ms. Trace:
I20260709 12:14:08.710151  7957 raft_consensus.cc:515] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:08.722323  5837 rpcz_store.cc:276] 0709 12:14:06.885582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:06.885717 (+   135us) service_pool.cc:224] Handling call
0709 12:14:07.883283 (+997566us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:07.883565 (+   282us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:14:07.883914 (+   349us) log.cc:844] Serialized 14 byte log entry
0709 12:14:07.967311 (+ 83397us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:07.967361 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:07.967402 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:07.967534 (+   132us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:08.693652 (+726118us) spinlock_profiling.cc:243] Waited 997 ms on lock 0x7b540048dd50. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc28ad 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:08.695834 (+  2182us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":9776,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":13543,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":7285,"spinlock_wait_cycles":2293138816,"thread_start_us":74481,"threads_started":1,"wal-append.queue_time_us":117172}
I20260709 12:14:08.898653  5120 raft_consensus.cc:2468] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 7.
I20260709 12:14:08.716122  7859 raft_consensus.cc:515] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:08.905834  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:08.905954  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:08.907992  5119 raft_consensus.cc:3060] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:08.910208  5804 leader_election.cc:304] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:08.914148  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:08.914361  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:08.781672  7618 raft_consensus.cc:515] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:08.896766  7870 raft_consensus.cc:493] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:08.895641  5195 rpcz_store.cc:276] 0709 12:14:07.865060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:07.875710 (+ 10650us) service_pool.cc:224] Handling call
0709 12:14:08.168208 (+292498us) spinlock_profiling.cc:243] Waited 18.5 ms on lock 0x7b58000b3d98. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9eeee 000000000036eb39 00007f84ebb121e0 00007f84ebbdb0c4 00007f84ebbdb131 00007f84ebb9cfc0 00007f84ebb87929 00007f84ebb873d2 00007f84e50febd4
0709 12:14:08.168384 (+   176us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:08.182503 (+ 14119us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:14:08.239050 (+ 56547us) log.cc:844] Serialized 14 byte log entry
0709 12:14:08.629501 (+390451us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:08.643047 (+ 13546us) log.cc:844] Serialized 26 byte log entry
0709 12:14:08.643423 (+   376us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:08.643482 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:08.643597 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:08.881746 (+238149us) spinlock_profiling.cc:243] Waited 45.7 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e675e86e 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221 00007f84e67671d9 00007f84e6767169
0709 12:14:08.889183 (+  7437us) raft_consensus.cc:1685] finished
0709 12:14:08.889203 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:08.889315 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14616,"prepare.queue_time_us":12190,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":15934,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":10387,"spinlock_wait_cycles":147734656,"thread_start_us":347684,"threads_started":1,"wal-append.queue_time_us":430225}
I20260709 12:14:08.912974  5023 catalog_manager.cc:5697] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:14:08.784940  7973 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:08.936846  5271 raft_consensus.cc:1240] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:08.937155  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:08.938513  7973 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:08.940269  7859 leader_election.cc:290] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:08.941895  5089 leader_election.cc:304] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:08.942005  7870 raft_consensus.cc:515] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:08.916656  7777 raft_consensus.cc:2804] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:08.943634  7777 raft_consensus.cc:493] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:08.903652  7886 raft_consensus.cc:493] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:08.943743  5120 raft_consensus.cc:1275] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:14:08.945041  5119 raft_consensus.cc:2468] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 5.
I20260709 12:14:08.853528  7548 raft_consensus.cc:515] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:08.972651  5123 raft_consensus.cc:1240] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:08.895443  7728 consensus_queue.cc:1059] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:14:08.965276  7976 raft_consensus.cc:2804] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:08.986750  7976 raft_consensus.cc:697] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:08.854481  7980 raft_consensus.cc:515] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:08.944202  7777 raft_consensus.cc:3060] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:08.944199  7870 leader_election.cc:290] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:09.034130  7910 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:09.034796  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 91711.6us
I20260709 12:14:09.038569  5023 catalog_manager.cc:5697] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 3 to 4, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 4 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } }
I20260709 12:14:09.044667  5196 raft_consensus.cc:1275] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:14:08.962469  7886 raft_consensus.cc:515] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:09.048421  7745 consensus_queue.cc:1048] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:14:09.083786  7888 raft_consensus.cc:3055] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:09.084203  7888 raft_consensus.cc:740] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:09.083107  7713 raft_consensus.cc:3055] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:09.054200  5023 catalog_manager.cc:5697] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 3 to 4, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 4 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } }
I20260709 12:14:09.049321  5804 leader_election.cc:304] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:09.063277  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:09.069550  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:09.073603  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:09.058790  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:09.076417  5123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59390 (request call id 528) took 1165 ms. Trace:
I20260709 12:14:09.067716  5198 raft_consensus.cc:1240] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:09.077402  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:09.087544  5197 raft_consensus.cc:2468] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 5.
W20260709 12:14:09.093526  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 44292.3us
I20260709 12:14:09.089003  5123 rpcz_store.cc:276] 0709 12:14:07.912551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:07.961495 (+ 48944us) service_pool.cc:224] Handling call
0709 12:14:07.972289 (+ 10794us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:08.973223 (+1000934us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:09.076119 (+102896us) spinlock_profiling.cc:243] Waited 994 ms on lock 0x7b5400071f54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:09.076306 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2286583552}
W20260709 12:14:09.058301  7769 consensus_meta.cc:287] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.697s	user 0.008s	sys 0.007s
I20260709 12:14:09.099531  7998 raft_consensus.cc:493] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:09.052474  7886 leader_election.cc:290] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:09.100574  7870 raft_consensus.cc:2804] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:09.074903  7980 leader_election.cc:290] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:09.053529  7849 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:09.050165  7973 consensus_queue.cc:1048] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 12:14:09.048157  7910 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:09.101697  7849 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:09.067730  5007 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet c7bb7b814fea4a2488cc39d06fc90483 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica dd62e75bd3ed4ed28f1fb5955d650808 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:14:09.102350  7849 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:09.104212  7910 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:09.093003  7713 raft_consensus.cc:740] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:09.065459  7957 leader_election.cc:290] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:09.105628  7713 consensus_queue.cc:260] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:09.106882  7713 raft_consensus.cc:3060] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:09.107250  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:09.108008  5196 raft_consensus.cc:2393] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 4: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:09.108031  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:09.109568  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:09.050539  7647 raft_consensus.cc:493] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:09.110867  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:09.073562  7618 leader_election.cc:290] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:09.111095  7647 raft_consensus.cc:515] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:09.084447  7866 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:09.112365  7871 consensus_meta.cc:287] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.745s	user 0.010s	sys 0.017s
I20260709 12:14:09.112803  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:09.050311  7619 consensus_queue.cc:1048] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 12:14:09.050453  7665 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:09.115216  7888 consensus_queue.cc:260] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:09.116411  7888 raft_consensus.cc:3060] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:09.116882  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:09.117539  5273 raft_consensus.cc:2468] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 5.
I20260709 12:14:09.100260  7998 raft_consensus.cc:515] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:09.081944  7976 consensus_queue.cc:237] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:09.119083  5269 raft_consensus.cc:2410] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:14:09.106020  7849 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:09.074787  7644 consensus_meta.cc:287] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.748s	user 0.015s	sys 0.012s
I20260709 12:14:09.132944  5199 raft_consensus.cc:2468] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 6.
I20260709 12:14:09.133522  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:09.134161  5834 raft_consensus.cc:2468] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 7.
I20260709 12:14:09.078064  7953 raft_consensus.cc:3055] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:09.058200  7823 raft_consensus.cc:493] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:09.133069  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:09.136329  5193 raft_consensus.cc:2468] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:14:09.050927  7838 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:09.139281  5832 raft_consensus.cc:3060] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:09.140993  5199 raft_consensus.cc:1240] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:09.140033  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:09.137408  5023 catalog_manager.cc:5697] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 2 to 3, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 3 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } }
I20260709 12:14:09.143885  5116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:45628 (request call id 26) took 1240 ms. Trace:
I20260709 12:14:09.144307  5116 rpcz_store.cc:276] 0709 12:14:07.905268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:07.905446 (+   178us) service_pool.cc:224] Handling call
0709 12:14:09.132220 (+1226774us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b54000ab7a0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6b40520 00007f84e6bbd652 00007f84ebb8b60a 00007f84e51117d4 00007f84e5111762 00007f84e5111691 00007f84e511160c 00007f84e51108c2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:09.140010 (+  7790us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":540706688}
I20260709 12:14:09.148339  7869 raft_consensus.cc:493] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:09.112833  7871 raft_consensus.cc:515] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:09.149597  7838 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:09.121747  7647 leader_election.cc:290] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:09.151261  7871 leader_election.cc:290] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:09.151715  7980 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:09.151849  7871 raft_consensus.cc:493] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:09.152750  7769 raft_consensus.cc:493] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:09.152834  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:09.065831  7777 raft_consensus.cc:515] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:09.153157  7957 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:09.153316  7769 raft_consensus.cc:515] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:09.154150  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:09.154598  7823 raft_consensus.cc:515] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:09.138902  7953 raft_consensus.cc:740] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:09.155498  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:09.152472  7838 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:09.157655  5267 raft_consensus.cc:1240] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:14:09.100361  7548 leader_election.cc:290] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:09.157985  7866 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:09.160452  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:09.160858  7866 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:09.153797  7957 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:09.148882  7869 raft_consensus.cc:515] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:09.152418  7871 raft_consensus.cc:515] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:09.145081  7998 leader_election.cc:290] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:09.140834  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:09.169190  5196 raft_consensus.cc:3060] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:09.163184  5023 catalog_manager.cc:5697] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 2 to 3, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 3 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
W20260709 12:14:09.152241  7805 consensus_meta.cc:287] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.944s	user 0.014s	sys 0.005s
I20260709 12:14:09.156904  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:09.168150  5195 raft_consensus.cc:1240] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:09.172096  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:09.155200  7777 leader_election.cc:290] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:09.177546  5273 raft_consensus.cc:2393] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 5: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:09.174024  5834 raft_consensus.cc:2393] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 5: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:09.115294  7665 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:09.177560  5801 leader_election.cc:304] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:09.155556  7769 leader_election.cc:290] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:09.185958  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:09.217578  5832 raft_consensus.cc:2468] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 5.
W20260709 12:14:09.224629  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 171115us
W20260709 12:14:09.225180  5088 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.012s	sys 0.044s
W20260709 12:14:09.225596  5088 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.012s	sys 0.044s
W20260709 12:14:09.225914  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 775559us
I20260709 12:14:09.234138  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:09.238327  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:09.238976  7870 raft_consensus.cc:697] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 5 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:09.152318  7980 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:09.243170  5116 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
new_leader_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:45628
I20260709 12:14:09.244210  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:09.246973  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:09.247663  5195 raft_consensus.cc:2468] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 6.
W20260709 12:14:09.254156  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 76671.3us
I20260709 12:14:09.243794  5116 raft_consensus.cc:606] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 LEADER]: Received request to transfer leadership to TS 9e794b72ed7640219f90ec4232363929
I20260709 12:14:09.260294  7665 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:09.260663  7848 leader_election.cc:290] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:09.256469  7802 raft_consensus.cc:493] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:09.263163  7869 leader_election.cc:290] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:09.263720  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:09.264403  5838 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 4.
I20260709 12:14:09.268411  7953 consensus_queue.cc:260] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:09.240010  7870 consensus_queue.cc:237] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:09.272220  7823 leader_election.cc:290] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:09.272981  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:09.274040  5237 leader_election.cc:304] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:09.313608  5200 raft_consensus.cc:3060] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:09.185314  7805 raft_consensus.cc:515] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:09.237299  7777 raft_consensus.cc:2749] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:09.282891  7858 leader_election.cc:290] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:09.284209  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:09.327405  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 53454.2us
I20260709 12:14:09.276997  7802 raft_consensus.cc:515] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:09.289969  7980 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:09.289023  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:09.288235  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:09.341663  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:09.291083  5123 raft_consensus.cc:1275] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
W20260709 12:14:09.293035  7959 log.cc:927] Time spent T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.603s	user 0.000s	sys 0.003s
I20260709 12:14:09.294827  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:09.295518  5120 raft_consensus.cc:1275] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 12:14:09.340382  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 47411.1us
I20260709 12:14:09.342229  5123 pending_rounds.cc:85] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting all ops after (but not including) 3
I20260709 12:14:09.343511  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:09.297595  7989 log.cc:927] Time spent T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:14:09.300892  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
W20260709 12:14:09.291379  5804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:09.306411  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:09.278545  7957 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:09.315564  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:09.320190  5163 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:09.350803  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:09.351698  5192 raft_consensus.cc:2468] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 7.
I20260709 12:14:09.344038  5123 pending_rounds.cc:107] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:14:09.352262  5123 raft_consensus.cc:2889] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:09.352618  5273 raft_consensus.cc:2393] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 6: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:09.296247  7808 leader_election.cc:290] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:09.347560  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:09.349973  5831 raft_consensus.cc:2468] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:14:09.336884  5196 raft_consensus.cc:2468] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 5.
I20260709 12:14:09.365953  5121 raft_consensus.cc:2393] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 7: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:09.351698  5195 raft_consensus.cc:2468] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 7.
I20260709 12:14:09.374652  5197 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 7.
I20260709 12:14:09.385638  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:09.386557  5193 raft_consensus.cc:2393] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 5: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:09.386726  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:09.389746  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:09.390381  5120 raft_consensus.cc:2468] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 6.
I20260709 12:14:09.391418  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:09.397159  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:09.397420  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:09.398022  5123 raft_consensus.cc:3060] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:09.379252  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:09.400369  5273 raft_consensus.cc:2468] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 8.
I20260709 12:14:09.403852  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:09.339936  7729 raft_consensus.cc:2749] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:09.405063  5240 leader_election.cc:304] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:09.405666  5801 leader_election.cc:304] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:09.406337  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:09.406986  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:09.404624  5121 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 4.
I20260709 12:14:09.350769  7953 raft_consensus.cc:3060] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:09.412735  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:14:09.413861  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 63847.4us
I20260709 12:14:09.412652  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:09.345937  7768 consensus_queue.cc:1059] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:14:09.417269  5192 raft_consensus.cc:2468] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 5.
I20260709 12:14:09.420589  5197 raft_consensus.cc:1240] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:14:09.327363  7618 consensus_queue.cc:1048] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 12:14:09.424983  5193 raft_consensus.cc:1240] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 7. Current term is 8. Ops: [5.5-7.6]
I20260709 12:14:09.327564  7910 consensus_queue.cc:1059] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 12:14:09.431003  5125 raft_consensus.cc:1240] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 7. Current term is 8. Ops: [5.5-7.6]
I20260709 12:14:09.433694  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:09.404058  7808 consensus_queue.cc:1048] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:14:09.436250  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:09.437469  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:09.438192  5274 raft_consensus.cc:2393] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 6: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:09.439271  7802 leader_election.cc:290] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:09.442734  5272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34674 (request call id 1977) took 1061 ms. Trace:
I20260709 12:14:09.443713  5123 raft_consensus.cc:2468] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 8.
I20260709 12:14:09.412091  8004 consensus_queue.cc:1048] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 12:14:09.447468  5196 raft_consensus.cc:1275] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:14:09.435321  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:09.448935  5200 raft_consensus.cc:2468] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:14:09.448732  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:09.453154  5273 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 7.
I20260709 12:14:09.381140  7858 consensus_queue.cc:1059] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:14:09.459471  5268 raft_consensus.cc:2410] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:14:09.454785  5088 leader_election.cc:304] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:09.443121  5272 rpcz_store.cc:276] 0709 12:14:08.381588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:08.381747 (+   159us) service_pool.cc:224] Handling call
0709 12:14:08.382036 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:08.603876 (+221840us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:14:08.949097 (+345221us) log.cc:844] Serialized 14 byte log entry
0709 12:14:09.082038 (+132941us) spinlock_profiling.cc:243] Waited 6.71 ms on lock 0x7b18003d42c0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3ad63f3 00007f84e3ad87c1 00007f84e3ad8779 00007f84e3ad8709 00007f84e3ad86d1 00007f84e3ad79cd 0000000000388634 0000000000388479 00007f84e3ab983a
0709 12:14:09.085328 (+  3290us) log.cc:844] Serialized 14 byte log entry
0709 12:14:09.096042 (+ 10714us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:09.096101 (+    59us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:09.096150 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:09.442399 (+346249us) spinlock_profiling.cc:243] Waited 78 ms on lock 0x7b5400256cd4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:09.442444 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:09.442576 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":179020,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":61,"raft.queue_time_us":26909,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":198,"spinlock_wait_cycles":194895488,"thread_start_us":403327,"threads_started":2,"wal-append.queue_time_us":313584}
I20260709 12:14:09.466624  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:09.450596  7729 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:09.396925  7859 consensus_queue.cc:1048] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 12:14:09.468621  5200 raft_consensus.cc:1275] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:14:09.470165  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 231551us
I20260709 12:14:09.474716  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:09.456923  7728 raft_consensus.cc:2804] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:14:09.474632  5802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:09.659354  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 433916us
W20260709 12:14:09.654116  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 334005us
I20260709 12:14:09.654877  5191 raft_consensus.cc:1240] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 6. Current term is 7. Ops: []
W20260709 12:14:09.659550  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 187593us
I20260709 12:14:09.669148  5164 leader_election.cc:304] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:09.672361  5200 raft_consensus.cc:1275] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:14:09.673332  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 218624us
I20260709 12:14:09.567349  5267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34674 (request call id 1975) took 1277 ms. Trace:
I20260709 12:14:09.674557  5267 rpcz_store.cc:276] 0709 12:14:08.380782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:08.380953 (+   171us) service_pool.cc:224] Handling call
0709 12:14:08.381398 (+   445us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:09.158033 (+776635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:09.567042 (+409009us) spinlock_profiling.cc:243] Waited 776 ms on lock 0x7b54000f9454. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:09.567271 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1784629120}
I20260709 12:14:09.464253  8005 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:09.671475  5164 leader_election.cc:304] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:09.729568  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:09.675637  5166 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
W20260709 12:14:09.731798  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 56237.9us
I20260709 12:14:09.679445  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:09.473327  7910 raft_consensus.cc:2804] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:14:09.733562  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 328586us
W20260709 12:14:09.732687  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 61302.2us
W20260709 12:14:09.671363  5270 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.000s	sys 0.030s
W20260709 12:14:09.765426  5270 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.000s	sys 0.031s
I20260709 12:14:09.516069  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:09.756717  5274 raft_consensus.cc:2410] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:14:09.737421  5088 leader_election.cc:304] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:14:09.666005  7886 raft_consensus.cc:2749] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:09.602126  7976 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:09.784222  5164 leader_election.cc:400] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 election: Vote denied by peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539) with higher term. Message: Invalid argument: T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 4. Current term is 5.
I20260709 12:14:09.784605  5164 leader_election.cc:403] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:14:09.643432  7777 raft_consensus.cc:2749] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:09.755059  8010 raft_consensus.cc:2804] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:09.468606  7871 leader_election.cc:290] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:09.733322  7647 raft_consensus.cc:2749] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:09.778182  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:09.494027  8004 raft_consensus.cc:493] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
W20260709 12:14:09.769897  7888 consensus_meta.cc:287] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.653s	user 0.011s	sys 0.000s
I20260709 12:14:09.737850  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:09.680872  8008 raft_consensus.cc:2804] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:09.486356  7665 consensus_queue.cc:1059] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.290s
I20260709 12:14:09.797282  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:14:09.756800  5237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:09.770030  7728 raft_consensus.cc:493] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:09.798604  5194 raft_consensus.cc:1240] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 4. Current term is 5. Ops: []
W20260709 12:14:09.799504  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 62152.7us
I20260709 12:14:09.771436  7910 raft_consensus.cc:493] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:09.735893  8005 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:09.655691  7878 consensus_queue.cc:260] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:09.788087  7805 leader_election.cc:290] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:09.472281  7729 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:09.602458  7869 raft_consensus.cc:2955] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 6 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:14:09.900982  5836 raft_consensus.cc:1240] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:14:09.937100  5267 raft_consensus.cc:2393] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 7: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:09.952579  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:09.826120  5831 raft_consensus.cc:1240] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:14:10.213546  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:10.217602  5197 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 4.
I20260709 12:14:10.094054  5118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40386 (request call id 1741) took 1399 ms. Trace:
I20260709 12:14:10.213649  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:10.091780  7980 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:09.859148  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:10.057422  8015 log.cc:927] Time spent T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.287s	user 0.000s	sys 0.001s
I20260709 12:14:10.056542  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:10.219528  5118 rpcz_store.cc:276] 0709 12:14:08.695028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:08.695173 (+   145us) service_pool.cc:224] Handling call
0709 12:14:08.702141 (+  6968us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:08.706829 (+  4688us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:14:08.712623 (+  5794us) log.cc:844] Serialized 14 byte log entry
0709 12:14:09.603888 (+891265us) spinlock_profiling.cc:243] Waited 1.06 ms on lock 0x7b1800408880. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3ab8e07 00007f84ec9139a9 00007f84e3ad569b 00007f84e3ad393f 00007f84e3ad5c02 00007f84e675d20b 00007f84e6762d23 00007f84e676323a 00007f84e6bcda2a
0709 12:14:10.093672 (+489784us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:10.093730 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:10.093779 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:10.093851 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:10.093984 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":6626,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":2968,"raft.queue_time_us":85,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":103,"spinlock_wait_cycles":2442496,"thread_start_us":489516,"threads_started":1}
I20260709 12:14:10.082587  8022 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.223307  8022 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:10.226066  8022 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:10.227126  5838 raft_consensus.cc:1240] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:14:10.083210  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:10.091976  7618 raft_consensus.cc:3055] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:10.113334  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:10.090381  5274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50932 (request call id 554) took 1026 ms. Trace:
I20260709 12:14:10.001724  7647 consensus_queue.cc:1048] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.276s
I20260709 12:14:10.000530  5269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34674 (request call id 1983) took 1252 ms. Trace:
I20260709 12:14:10.054589  7886 raft_consensus.cc:2749] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539) with higher term. Message: Invalid argument: T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 4. Current term is 5.
W20260709 12:14:10.186877  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 410788us
W20260709 12:14:10.235284  5801 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.784s	user 0.019s	sys 0.015s
W20260709 12:14:10.362000  5801 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.911s	user 0.019s	sys 0.015s
I20260709 12:14:10.234313  7728 raft_consensus.cc:3060] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:10.242539  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:10.352892  5274 rpcz_store.cc:276] 0709 12:14:09.063834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:09.438744 (+374910us) service_pool.cc:224] Handling call
0709 12:14:10.090051 (+651307us) spinlock_profiling.cc:243] Waited 303 ms on lock 0x7b54002eefd4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:10.090274 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":697699712}
I20260709 12:14:10.243274  5192 raft_consensus.cc:3060] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:10.239436  5266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34672 (request call id 1845) took 1091 ms. Trace:
I20260709 12:14:09.802191  7859 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.244092  5088 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:10.056039  7888 raft_consensus.cc:493] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
W20260709 12:14:09.901563  8002 log.cc:927] Time spent T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.472s	user 0.000s	sys 0.001s
I20260709 12:14:10.239532  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
W20260709 12:14:10.202189  8017 log.cc:927] Time spent T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 12:14:09.818082  7823 raft_consensus.cc:2804] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:10.248862  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:10.375778  5831 raft_consensus.cc:2468] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 6.
I20260709 12:14:10.244716  8008 raft_consensus.cc:697] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:09.826458  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:10.234503  7910 raft_consensus.cc:3060] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:09.796450  7976 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:10.253468  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:10.387573  5267 raft_consensus.cc:2393] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 6: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:10.244256  7866 raft_consensus.cc:493] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.243902  7777 raft_consensus.cc:493] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
W20260709 12:14:10.262909  5163 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.007s	sys 0.016s
W20260709 12:14:10.388228  5163 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.007s	sys 0.016s
W20260709 12:14:10.388550  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 720786us
I20260709 12:14:10.253458  7805 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:10.272799  5802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:09.851962  8004 raft_consensus.cc:515] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:10.268075  7838 raft_consensus.cc:3055] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:10.282116  7729 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:10.284792  7871 raft_consensus.cc:493] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:10.291723  5837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46094 (request call id 797) took 1182 ms. Trace:
W20260709 12:14:09.801481  7999 log.cc:927] Time spent T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.379s	user 0.001s	sys 0.000s
W20260709 12:14:10.233136  5165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:10.220518  7980 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:10.355705  7953 consensus_meta.cc:287] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.908s	user 0.005s	sys 0.005s
I20260709 12:14:10.358827  5269 rpcz_store.cc:276] 0709 12:14:08.684287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:08.684437 (+   150us) service_pool.cc:224] Handling call
0709 12:14:09.901007 (+1216570us) spinlock_profiling.cc:243] Waited 318 ms on lock 0x7b54000d2d54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:09.936338 (+ 35331us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":732406144}
I20260709 12:14:10.364971  5266 rpcz_store.cc:276] 0709 12:14:09.147625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:09.826094 (+678469us) service_pool.cc:224] Handling call
0709 12:14:10.239363 (+413269us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:10.367578  5832 raft_consensus.cc:2468] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 7.
I20260709 12:14:10.363777  8022 raft_consensus.cc:493] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.564013  8022 raft_consensus.cc:515] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:10.373277  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 967585us
I20260709 12:14:10.565909  5801 leader_election.cc:304] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:10.566892  5801 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:14:10.373824  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 129823us
W20260709 12:14:10.567152  8032 log.cc:927] Time spent T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
I20260709 12:14:10.374629  5836 raft_consensus.cc:2368] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 7. Current term is 8.
I20260709 12:14:10.568599  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:10.368855  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:10.568949  8008 consensus_queue.cc:237] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:10.570268  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:10.570890  5835 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 4.
W20260709 12:14:10.361749  5166 connection.cc:256] RPC call timeout handler was delayed by -1.2245558269999037s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1894s for a response
W20260709 12:14:10.572425  5166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:10.351862  7618 raft_consensus.cc:740] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:10.574163  8040 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.574468  7618 consensus_queue.cc:260] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:10.575774  7618 raft_consensus.cc:3060] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:10.576486  7665 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:10.577672  5199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41416 (request call id 497) took 1500 ms. Trace:
I20260709 12:14:10.577301  7665 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:10.578224  5836 raft_consensus.cc:1240] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:10.578397  8040 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:10.428550  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:10.424671  5837 rpcz_store.cc:276] 0709 12:14:09.117839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:09.122782 (+  4943us) service_pool.cc:224] Handling call
0709 12:14:09.140526 (+ 17744us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:09.380164 (+239638us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:09.380191 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:09.419905 (+ 39714us) log.cc:844] Serialized 26 byte log entry
0709 12:14:09.770494 (+350589us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:09.770531 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:09.770595 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:10.291457 (+520862us) raft_consensus.cc:1685] finished
0709 12:14:10.291478 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:10.291651 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":30303,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":32594,"thread_start_us":572777,"threads_started":2,"wal-append.queue_time_us":813281}
I20260709 12:14:10.578081  5199 rpcz_store.cc:276] 0709 12:14:09.077760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:09.166899 (+ 89139us) service_pool.cc:224] Handling call
0709 12:14:09.178139 (+ 11240us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:09.472227 (+294088us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:09.472257 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:09.474924 (+  2667us) log.cc:844] Serialized 52 byte log entry
0709 12:14:09.804691 (+329767us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:09.804731 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:09.804792 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:10.577418 (+772626us) raft_consensus.cc:1685] finished
0709 12:14:10.577441 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:10.577611 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":361935,"raft.queue_time_us":246007,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":21238,"thread_start_us":145557,"threads_started":1,"wal-append.queue_time_us":742145}
W20260709 12:14:10.473181  8034 log.cc:927] Time spent T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 12:14:10.391832  8010 raft_consensus.cc:697] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:10.394290  7838 raft_consensus.cc:740] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:10.393309  5830 raft_consensus.cc:2468] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 7.
I20260709 12:14:10.594216  5273 raft_consensus.cc:2468] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 8.
I20260709 12:14:10.423074  8005 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:10.549063  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:10.374265  7859 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:10.430452  7886 raft_consensus.cc:493] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:10.550432  8038 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:10.425758  7777 raft_consensus.cc:515] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:10.396647  5267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34674 (request call id 2000) took 1283 ms. Trace:
I20260709 12:14:10.390179  8030 consensus_queue.cc:1059] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.231s
I20260709 12:14:10.386973  7888 raft_consensus.cc:515] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:10.390838  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:14:10.528796  7999 log.cc:927] Time spent T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:14:10.393489  7866 raft_consensus.cc:515] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:10.613752  7888 leader_election.cc:290] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:10.614300  7866 leader_election.cc:290] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:10.614957  7866 raft_consensus.cc:2804] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:10.615288  7866 raft_consensus.cc:493] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:10.613790  8036 log.cc:927] Time spent T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.269s	user 0.004s	sys 0.000s
W20260709 12:14:10.617270  8039 log.cc:927] Time spent T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.272s	user 0.000s	sys 0.001s
I20260709 12:14:10.588409  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:10.381588  7801 raft_consensus.cc:2804] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:10.594638  5270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34674 (request call id 1981) took 1960 ms. Trace:
I20260709 12:14:10.593199  5274 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 7.
I20260709 12:14:10.435186  7871 raft_consensus.cc:515] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:10.429606  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:10.605067  5163 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:10.605561  5269 raft_consensus.cc:3060] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:10.609725  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:10.425479  7805 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:10.615617  7866 raft_consensus.cc:3060] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:10.626653  5833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46094 (request call id 807) took 1338 ms. Trace:
I20260709 12:14:10.628859  5274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50932 (request call id 562) took 1355 ms. Trace:
I20260709 12:14:10.650355  5274 rpcz_store.cc:276] 0709 12:14:09.273580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:10.382572 (+1108992us) service_pool.cc:224] Handling call
0709 12:14:10.628803 (+246231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:10.637326  5192 raft_consensus.cc:2468] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
I20260709 12:14:10.631605  5266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50932 (request call id 557) took 1499 ms. Trace:
I20260709 12:14:10.611641  5267 rpcz_store.cc:276] 0709 12:14:09.113258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:10.240167 (+1126909us) service_pool.cc:224] Handling call
0709 12:14:10.396557 (+156390us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:10.647620  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 98637.4us
I20260709 12:14:10.608698  8005 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:10.651432  5266 rpcz_store.cc:276] 0709 12:14:09.132715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:10.458067 (+1325352us) service_pool.cc:224] Handling call
0709 12:14:10.631539 (+173472us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:10.630162  8026 raft_consensus.cc:3055] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:10.655462  5163 leader_election.cc:304] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:10.627468  5270 rpcz_store.cc:276] 0709 12:14:08.634970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:08.639249 (+  4279us) service_pool.cc:224] Handling call
0709 12:14:08.651303 (+ 12054us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:08.658366 (+  7063us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:08.658397 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:09.073034 (+414637us) spinlock_profiling.cc:243] Waited 1.28 ms on lock 0x7b18004635a0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3aa42a6 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e54bca11 00007f84e54cc372 00007f84e6bfea01 00007f84e6bc343a
0709 12:14:09.073611 (+   577us) spinlock_profiling.cc:243] Waited 4.2 ms on lock 0x7b2c000c2038. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e54bca11 00007f84e54cc372 00007f84e6bfea01 00007f84e6bc343a 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2
0709 12:14:09.074183 (+   572us) log.cc:844] Serialized 26 byte log entry
0709 12:14:09.765963 (+691780us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:14:09.766008 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:09.766083 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:10.594370 (+828287us) raft_consensus.cc:1685] finished
0709 12:14:10.594392 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:10.594570 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6683,"raft.queue_time_us":10156,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":5504,"spinlock_wait_cycles":12605568,"thread_start_us":691347,"threads_started":1,"wal-append.queue_time_us":727512}
I20260709 12:14:10.624997  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:10.656970  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:10.691094  5274 raft_consensus.cc:3060] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:10.650238  5833 rpcz_store.cc:276] 0709 12:14:09.287863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:09.290934 (+  3071us) service_pool.cc:224] Handling call
0709 12:14:09.292512 (+  1578us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:09.642996 (+350484us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:09.643034 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:09.731477 (+ 88443us) log.cc:844] Serialized 26 byte log entry
0709 12:14:10.263921 (+532444us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:14:10.263960 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:10.264039 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:10.613203 (+349164us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e675e86e 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221 00007f84e67671d9 00007f84e6767169
0709 12:14:10.617629 (+  4426us) raft_consensus.cc:1685] finished
0709 12:14:10.617651 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:10.626585 (+  8934us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47865,"raft.queue_time_us":136130,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":11676,"spinlock_wait_cycles":26679040,"thread_start_us":790018,"threads_started":2,"wal-append.queue_time_us":585449}
I20260709 12:14:10.651839  5838 raft_consensus.cc:2410] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:14:10.647704  8042 raft_consensus.cc:2749] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:10.623560  8038 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:10.665153  8005 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:10.714627  5164 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.916s	user 0.013s	sys 0.014s
I20260709 12:14:10.666293  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:10.716624  5266 raft_consensus.cc:2410] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:14:10.666424  7980 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:10.626098  7823 raft_consensus.cc:697] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:10.619701  7886 raft_consensus.cc:515] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:10.645908  7801 raft_consensus.cc:697] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:10.724238  5266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34672 (request call id 1840) took 1577 ms. Trace:
I20260709 12:14:10.724749  5266 rpcz_store.cc:276] 0709 12:14:09.146443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:10.665947 (+1519504us) service_pool.cc:224] Handling call
0709 12:14:10.724157 (+ 58210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:10.667006  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:10.726042  5267 raft_consensus.cc:2468] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 7.
I20260709 12:14:10.726610  5267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34672 (request call id 1860) took 1433 ms. Trace:
I20260709 12:14:10.726938  5267 rpcz_store.cc:276] 0709 12:14:09.308544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:10.655863 (+1347319us) service_pool.cc:224] Handling call
0709 12:14:10.726547 (+ 70684us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:10.674654  5269 raft_consensus.cc:2468] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 7.
I20260709 12:14:10.694227  5195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41416 (request call id 499) took 1613 ms. Trace:
W20260709 12:14:10.694198  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 323523us
W20260709 12:14:10.728000  5269 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34672 (request call id 1851) took 1437 ms (client timeout 1848 ms). Trace:
W20260709 12:14:10.728345  5269 rpcz_store.cc:269] 0709 12:14:09.290711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:10.436108 (+1145397us) service_pool.cc:224] Handling call
0709 12:14:10.727948 (+291840us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:10.728060  5195 rpcz_store.cc:276] 0709 12:14:09.080709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:09.375648 (+294939us) service_pool.cc:224] Handling call
0709 12:14:09.382860 (+  7212us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:09.659112 (+276252us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:09.659149 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:09.733860 (+ 74711us) log.cc:844] Serialized 26 byte log entry
0709 12:14:10.248365 (+514505us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:10.248405 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:10.248470 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:10.693973 (+445503us) raft_consensus.cc:1685] finished
0709 12:14:10.693993 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:10.694156 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":270706,"raft.queue_time_us":276076,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"thread_start_us":472444,"threads_started":1,"wal-append.queue_time_us":586273}
I20260709 12:14:10.656257  8037 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.712131  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:10.731225  5834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46094 (request call id 804) took 1490 ms. Trace:
I20260709 12:14:10.665601  5271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50932 (request call id 549) took 1681 ms. Trace:
W20260709 12:14:10.717581  5164 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.919s	user 0.013s	sys 0.014s
I20260709 12:14:10.676990  8026 raft_consensus.cc:740] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:10.731601  5834 rpcz_store.cc:276] 0709 12:14:09.240917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:09.249795 (+  8878us) service_pool.cc:224] Handling call
0709 12:14:09.250149 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:09.525132 (+274983us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:09.525163 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:09.773455 (+248292us) log.cc:844] Serialized 26 byte log entry
0709 12:14:10.244620 (+471165us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:10.244656 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:10.244718 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:10.616689 (+371971us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e675e86e 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221 00007f84e67671d9 00007f84e6767169
0709 12:14:10.721654 (+104965us) raft_consensus.cc:1685] finished
0709 12:14:10.721679 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:10.731160 (+  9481us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12072,"raft.queue_time_us":165929,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":20259,"spinlock_wait_cycles":28592384,"thread_start_us":651306,"threads_started":2,"wal-append.queue_time_us":557845}
I20260709 12:14:10.729795  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:10.738839  5269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34672 (request call id 1858) took 1446 ms. Trace:
W20260709 12:14:10.732131  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 933259us
I20260709 12:14:10.734790  5270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50932 (request call id 559) took 1498 ms. Trace:
I20260709 12:14:10.739501  5269 rpcz_store.cc:276] 0709 12:14:09.292898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:10.729528 (+1436630us) service_pool.cc:224] Handling call
0709 12:14:10.738766 (+  9238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:10.649590  7728 raft_consensus.cc:515] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:10.713092  7849 raft_consensus.cc:2804] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:10.739728  5270 rpcz_store.cc:276] 0709 12:14:09.236553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:10.677776 (+1441223us) service_pool.cc:224] Handling call
0709 12:14:10.734727 (+ 56951us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:10.742307  5164 leader_election.cc:304] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:10.731891  5271 rpcz_store.cc:276] 0709 12:14:08.983977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:09.603273 (+619296us) service_pool.cc:224] Handling call
0709 12:14:09.672324 (+ 69051us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:09.730836 (+ 58512us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:09.730870 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:09.800617 (+ 69747us) log.cc:844] Serialized 52 byte log entry
0709 12:14:10.369609 (+568992us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:10.369655 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:10.369719 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:10.665303 (+295584us) raft_consensus.cc:1685] finished
0709 12:14:10.665328 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:10.665532 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1081,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":56237,"thread_start_us":415658,"threads_started":1,"wal-append.queue_time_us":771598}
I20260709 12:14:10.744010  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:14:10.743525  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 176718us
I20260709 12:14:10.745316  5801 leader_election.cc:304] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:10.748492  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:10.749305  5267 raft_consensus.cc:2468] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
I20260709 12:14:10.749956  5267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34674 (request call id 2005) took 1338 ms. Trace:
W20260709 12:14:10.752295  5804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:10.751920  5267 rpcz_store.cc:276] 0709 12:14:09.411322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:10.727614 (+1316292us) service_pool.cc:224] Handling call
0709 12:14:10.749887 (+ 22273us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:10.750941  5164 leader_election.cc:304] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:10.744789  5266 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 4.
W20260709 12:14:10.761139  5237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:10.715971  5829 raft_consensus.cc:2468] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 6.
I20260709 12:14:10.764135  5266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34672 (request call id 1857) took 1471 ms. Trace:
I20260709 12:14:10.764751  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:10.766338  5266 rpcz_store.cc:276] 0709 12:14:09.292600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:10.725570 (+1432970us) service_pool.cc:224] Handling call
0709 12:14:10.764064 (+ 38494us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:10.766839  5269 raft_consensus.cc:2468] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 7.
W20260709 12:14:10.764828  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 197193us
I20260709 12:14:10.766126  5801 leader_election.cc:304] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:10.771528  5801 leader_election.cc:304] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:10.771795  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:10.772781  5267 raft_consensus.cc:2410] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:14:10.767464  5269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34672 (request call id 1849) took 1555 ms. Trace:
I20260709 12:14:10.805832  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:10.807974  8008 raft_consensus.cc:493] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:10.807240  5266 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 4.
I20260709 12:14:10.809633  5266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34674 (request call id 2006) took 1382 ms. Trace:
I20260709 12:14:10.809973  5266 rpcz_store.cc:276] 0709 12:14:09.426787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:10.767115 (+1340328us) service_pool.cc:224] Handling call
0709 12:14:10.809563 (+ 42448us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:10.811508  5802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:10.760144  7976 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:10.813885  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:10.714403  7838 consensus_queue.cc:260] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:10.821055  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:10.820334  5270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34672 (request call id 1837) took 1674 ms. Trace:
I20260709 12:14:10.823700  5266 raft_consensus.cc:2468] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 4.
I20260709 12:14:10.824348  5266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50932 (request call id 558) took 1654 ms. Trace:
I20260709 12:14:10.824733  5266 rpcz_store.cc:276] 0709 12:14:09.170132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:10.810690 (+1640558us) service_pool.cc:224] Handling call
0709 12:14:10.824285 (+ 13595us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:10.823886  5270 rpcz_store.cc:276] 0709 12:14:09.145710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:10.771407 (+1625697us) service_pool.cc:224] Handling call
0709 12:14:10.820260 (+ 48853us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:10.812798  8004 leader_election.cc:290] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:10.839287  5267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34672 (request call id 1854) took 1547 ms. Trace:
I20260709 12:14:10.840317  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:10.747393  7849 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:10.833541  5269 rpcz_store.cc:276] 0709 12:14:09.212083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:10.740405 (+1528322us) service_pool.cc:224] Handling call
0709 12:14:10.767398 (+ 26993us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:10.808611  8008 raft_consensus.cc:515] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:10.840754  5267 rpcz_store.cc:276] 0709 12:14:09.291629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:10.753439 (+1461810us) service_pool.cc:224] Handling call
0709 12:14:10.839102 (+ 85663us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:10.745479  8042 raft_consensus.cc:493] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:10.714813  8010 consensus_queue.cc:237] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:10.741734  8051 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:10.745981  8049 raft_consensus.cc:493] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:10.740928  8037 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:10.853405  8053 raft_consensus.cc:493] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:10.857018  8042 raft_consensus.cc:515] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:10.859123  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:10.822990  8022 leader_election.cc:290] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:14:10.868475  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 117628us
I20260709 12:14:10.869544  5270 raft_consensus.cc:2410] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:14:10.850556  5266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34672 (request call id 1847) took 1702 ms. Trace:
I20260709 12:14:10.870172  5266 rpcz_store.cc:276] 0709 12:14:09.148164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:10.825417 (+1677253us) service_pool.cc:224] Handling call
0709 12:14:10.850479 (+ 25062us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:10.872306  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:10.873265  5269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34672 (request call id 1835) took 1728 ms. Trace:
I20260709 12:14:10.875042  5270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34674 (request call id 1989) took 1827 ms. Trace:
I20260709 12:14:10.875541  5270 rpcz_store.cc:276] 0709 12:14:09.047670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:10.831095 (+1783425us) service_pool.cc:224] Handling call
0709 12:14:10.874978 (+ 43883us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:10.857105  8045 log.cc:927] Time spent T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 12:14:10.874169  8051 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:10.869313  8031 log.cc:927] Time spent T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.280s	user 0.000s	sys 0.001s
I20260709 12:14:10.850967  7870 raft_consensus.cc:2749] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:10.863214  8004 raft_consensus.cc:2749] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:10.851106  7849 raft_consensus.cc:3060] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:10.873664  5269 rpcz_store.cc:276] 0709 12:14:09.145157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:10.842104 (+1696947us) service_pool.cc:224] Handling call
0709 12:14:10.873195 (+ 31091us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:10.962800  5200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 1944) took 1228 ms. Trace:
I20260709 12:14:11.006194  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:10.847559  8048 raft_consensus.cc:2749] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:10.985798  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:11.017613  5267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34672 (request call id 1836) took 1872 ms. Trace:
I20260709 12:14:11.018020  5267 rpcz_store.cc:276] 0709 12:14:09.145456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:10.843075 (+1697619us) service_pool.cc:224] Handling call
0709 12:14:11.017536 (+174461us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:11.003254  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 231786us
I20260709 12:14:10.979774  5274 raft_consensus.cc:2468] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 8.
I20260709 12:14:11.008795  5200 rpcz_store.cc:276] 0709 12:14:09.734571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:09.734711 (+   140us) service_pool.cc:224] Handling call
0709 12:14:09.771348 (+ 36637us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:10.272481 (+501133us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:10.272515 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:10.274174 (+  1659us) log.cc:844] Serialized 52 byte log entry
0709 12:14:10.485725 (+211551us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:10.736690 (+250965us) log.cc:844] Serialized 14 byte log entry
0709 12:14:10.861728 (+125038us) log.cc:844] Serialized 14 byte log entry
0709 12:14:10.861909 (+   181us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:10.863758 (+  1849us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:10.962591 (+ 98833us) raft_consensus.cc:1685] finished
0709 12:14:10.962612 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:10.962743 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":84915,"prepare.queue_time_us":637074,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":189992,"raft.run_cpu_time_us":408,"raft.run_wall_time_us":61406,"thread_start_us":976989,"threads_started":4,"wal-append.queue_time_us":332920}
I20260709 12:14:10.866647  7823 consensus_queue.cc:237] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:11.010834  5266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34672 (request call id 1852) took 1719 ms. Trace:
W20260709 12:14:11.025827  5274 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50932 (request call id 561) took 1752 ms (client timeout 1966 ms). Trace:
I20260709 12:14:11.026137  5266 rpcz_store.cc:276] 0709 12:14:09.291023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:10.986339 (+1695316us) service_pool.cc:224] Handling call
0709 12:14:11.010775 (+ 24436us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:11.024215  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 161184us
I20260709 12:14:11.027992  5088 leader_election.cc:304] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
W20260709 12:14:11.027146  5274 rpcz_store.cc:269] 0709 12:14:09.273230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:10.654137 (+1380907us) service_pool.cc:224] Handling call
0709 12:14:11.025767 (+371630us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:10.961440  8052 raft_consensus.cc:2804] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:10.961798  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:14:11.031383  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:11.032174  5199 raft_consensus.cc:2468] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 9.
W20260709 12:14:10.903504  8029 log.cc:927] Time spent T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.310s	user 0.001s	sys 0.001s
I20260709 12:14:11.035319  5274 raft_consensus.cc:1275] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:14:11.041996  5122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40386 (request call id 1739) took 2359 ms. Trace:
I20260709 12:14:11.042479  5122 rpcz_store.cc:276] 0709 12:14:08.683017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:08.683207 (+   190us) service_pool.cc:224] Handling call
0709 12:14:08.796342 (+113135us) spinlock_profiling.cc:243] Waited 2.22 ms on lock 0x7b5800002a98. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9eeee 000000000036eb39 00007f84ebb121e0 00007f84ebbdb0c4 00007f84ebbdb131 00007f84ebb9cfc0 00007f84ebb87929 00007f84ebb873d2 00007f84e50febd4
0709 12:14:08.796531 (+   189us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:08.844290 (+ 47759us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:08.844323 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:08.861795 (+ 17472us) log.cc:844] Serialized 26 byte log entry
0709 12:14:09.446191 (+584396us) spinlock_profiling.cc:243] Waited 28.7 ms on lock 0x7b18003a8b20. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3ab8e07 00007f84ec9139a9 00007f84e3ad569b 00007f84e3ad393f 00007f84e3ad5c02 00007f84e675d20b 00007f84e6762d23 00007f84e67630d1 00007f84e6b7ea0f
0709 12:14:09.920945 (+474754us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:09.920990 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:09.921073 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:11.041684 (+1120611us) raft_consensus.cc:1685] finished
0709 12:14:11.041728 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:11.041891 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5831,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":6513,"spinlock_wait_cycles":71061248,"thread_start_us":474516,"threads_started":1,"wal-append.queue_time_us":1499339}
I20260709 12:14:11.046103  5269 raft_consensus.cc:1240] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 9 LEADER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:11.047019  5269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50932 (request call id 551) took 2060 ms. Trace:
I20260709 12:14:11.047343  5269 rpcz_store.cc:276] 0709 12:14:08.986609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:11.014966 (+2028357us) service_pool.cc:224] Handling call
0709 12:14:11.045899 (+ 30933us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:11.046714 (+   815us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:11.046954 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:11.049142  5192 raft_consensus.cc:1240] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:10.902961  7871 leader_election.cc:290] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:11.053670  5274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34674 (request call id 1991) took 1961 ms. Trace:
I20260709 12:14:10.968503  7838 raft_consensus.cc:3060] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:10.904054  8040 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:10.961856  7777 leader_election.cc:290] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:10.969419  8055 raft_consensus.cc:493] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:10.966563  8042 leader_election.cc:290] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:10.976155  7859 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:10.962015  7665 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:10.974802  7805 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:11.065280  5266 raft_consensus.cc:1240] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:14:11.061903  5274 rpcz_store.cc:276] 0709 12:14:09.075497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:11.034695 (+1959198us) service_pool.cc:224] Handling call
0709 12:14:11.035009 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:11.036179 (+  1170us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:11.036425 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:11.067128  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:11.071799  8038 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:11.071319  7886 leader_election.cc:290] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:11.074940  5269 raft_consensus.cc:1240] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 12:14:11.063082  7910 consensus_meta.cc:287] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.639s	user 0.005s	sys 0.005s
I20260709 12:14:11.108367  5269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34674 (request call id 1992) took 2032 ms. Trace:
I20260709 12:14:10.869900  8049 raft_consensus.cc:515] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:11.031297  8052 raft_consensus.cc:493] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:11.081494  8063 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:11.062793  8005 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:11.082158  5124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40402 (request call id 2016) took 1787 ms. Trace:
I20260709 12:14:11.083622  5836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46088 (request call id 516) took 1035 ms. Trace:
I20260709 12:14:10.968724  8057 consensus_queue.cc:1048] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.142s
I20260709 12:14:11.088563  7848 raft_consensus.cc:493] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:11.090194  5801 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:11.091468  7870 raft_consensus.cc:493] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:11.091970  8004 raft_consensus.cc:493] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:11.097220  5268 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34674 (request call id 1993) took 2021 ms (client timeout 1684 ms). Trace:
I20260709 12:14:11.098086  8030 raft_consensus.cc:2749] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:11.070756  8051 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:11.104120  5191 raft_consensus.cc:2410] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for term 8 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:14:11.104139  5266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34674 (request call id 1990) took 2029 ms. Trace:
I20260709 12:14:11.074981  7728 leader_election.cc:290] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:11.307123  5272 raft_consensus.cc:1275] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:14:11.395854  5802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:11.108757  5269 rpcz_store.cc:276] 0709 12:14:09.075820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:11.048167 (+1972347us) service_pool.cc:224] Handling call
0709 12:14:11.074711 (+ 26544us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:11.108090 (+ 33379us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:11.108311 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:11.418723  5266 rpcz_store.cc:276] 0709 12:14:09.075165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:11.034635 (+1959470us) service_pool.cc:224] Handling call
0709 12:14:11.065069 (+ 30434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:11.103844 (+ 38775us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:11.104078 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:11.423849  5272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34674 (request call id 1995) took 2347 ms. Trace:
I20260709 12:14:11.424700  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:11.422717  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 332583us
W20260709 12:14:11.256572  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:11.427500  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:11.418768  5268 rpcz_store.cc:269] 0709 12:14:09.076140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:09.110624 (+ 34484us) service_pool.cc:224] Handling call
0709 12:14:11.096973 (+1986349us) spinlock_profiling.cc:243] Waited 348 ms on lock 0x7b540029fc54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:11.097136 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":799679872}
W20260709 12:14:11.431770  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 403854us
I20260709 12:14:11.432185  5193 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 6.
I20260709 12:14:11.433732  5088 leader_election.cc:304] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:11.109433  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:11.421907  5269 raft_consensus.cc:1275] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:14:11.424355  5272 rpcz_store.cc:276] 0709 12:14:09.076788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:11.306354 (+2229566us) service_pool.cc:224] Handling call
0709 12:14:11.306742 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:11.420017 (+113275us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:11.423796 (+  3779us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:11.418229  5163 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:11.437093  5088 leader_election.cc:304] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:10.904692  8053 raft_consensus.cc:515] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:11.108670  7618 consensus_meta.cc:287] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.532s	user 0.012s	sys 0.001s
I20260709 12:14:11.450995  5269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34674 (request call id 1996) took 2360 ms. Trace:
I20260709 12:14:10.900172  7801 consensus_queue.cc:237] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:11.418637  5836 rpcz_store.cc:276] 0709 12:14:10.048263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:10.586953 (+538690us) service_pool.cc:224] Handling call
0709 12:14:10.606762 (+ 19809us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:10.618494 (+ 11732us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:14:10.618526 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:10.619030 (+   504us) log.cc:844] Serialized 26 byte log entry
0709 12:14:11.083027 (+463997us) spinlock_profiling.cc:243] Waited 24.1 ms on lock 0x7b180006fd60. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e676b4bc 00007f84e3ab948b 00007f84ec9139a9 00007f84e3ad569b 00007f84e3ad393f 00007f84e3ad5c02 00007f84e675d20b 00007f84e6762d23 00007f84e67630d1
0709 12:14:11.083196 (+   169us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:11.083232 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:11.083312 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:11.083352 (+    40us) raft_consensus.cc:1685] finished
0709 12:14:11.083362 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:11.083562 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2878,"raft.queue_time_us":25331,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":29354,"spinlock_wait_cycles":55541120,"thread_start_us":61493,"threads_started":1,"wal-append.queue_time_us":218073}
I20260709 12:14:11.451928  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:11.473611  5192 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 4.
I20260709 12:14:11.105475  8042 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:11.454458  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:11.102113  7777 raft_consensus.cc:493] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:11.454515  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:11.418928  5124 rpcz_store.cc:276] 0709 12:14:09.294752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:09.297016 (+  2264us) service_pool.cc:224] Handling call
0709 12:14:09.297309 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:09.388650 (+ 91341us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:14:09.415482 (+ 26832us) log.cc:844] Serialized 14 byte log entry
0709 12:14:09.785961 (+370479us) log.cc:844] Serialized 14 byte log entry
0709 12:14:09.786153 (+   192us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:09.786199 (+    46us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:09.786245 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:11.081879 (+1295634us) spinlock_profiling.cc:243] Waited 91.1 ms on lock 0x7b5400072454. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:11.081932 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:11.082082 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":190,"prepare.queue_time_us":27414,"prepare.run_cpu_time_us":105,"prepare.run_wall_time_us":106,"raft.queue_time_us":10788,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":187,"spinlock_wait_cycles":209784064,"thread_start_us":358501,"threads_started":1,"wal-append.queue_time_us":887821,"wal-append.run_cpu_time_us":2266,"wal-append.run_wall_time_us":1003647}
I20260709 12:14:11.096706  7866 raft_consensus.cc:515] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:11.471701  5198 raft_consensus.cc:1240] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:11.102903  8060 raft_consensus.cc:2804] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:11.453655  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:11.474074  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 55964.1us
I20260709 12:14:11.477276  5266 raft_consensus.cc:1275] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:14:11.478698  5194 raft_consensus.cc:2410] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:14:11.102276  8055 raft_consensus.cc:515] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:11.286366  7805 raft_consensus.cc:493] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:11.146708  8037 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:11.459314  5269 rpcz_store.cc:276] 0709 12:14:09.077077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:11.421223 (+2344146us) service_pool.cc:224] Handling call
0709 12:14:11.421559 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:11.436802 (+ 15243us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:11.437056 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:11.517928  5269 raft_consensus.cc:1240] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 12:14:11.428192  8052 raft_consensus.cc:3060] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:11.421876  7713 raft_consensus.cc:3055] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:11.447073  8005 raft_consensus.cc:2749] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:11.472621  7973 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.048s	sys 0.042s
W20260709 12:14:11.505324  5273 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34672 (request call id 1842) took 2358 ms (client timeout 1894 ms). Trace:
I20260709 12:14:11.505637  5274 raft_consensus.cc:1275] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:14:11.506892  5163 leader_election.cc:304] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:11.500589  5266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34674 (request call id 1999) took 2387 ms. Trace:
I20260709 12:14:11.601186  5266 rpcz_store.cc:276] 0709 12:14:09.112963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:11.453450 (+2340487us) service_pool.cc:224] Handling call
0709 12:14:11.453721 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:11.500129 (+ 46408us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:11.500523 (+   394us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:11.321249  7849 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:11.429615  7910 raft_consensus.cc:515] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:11.483368  7728 raft_consensus.cc:493] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.483093  7665 raft_consensus.cc:2804] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:11.501431  8060 raft_consensus.cc:697] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:11.595609  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:11.622840  5271 raft_consensus.cc:1275] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:14:11.623615  5271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50932 (request call id 556) took 2505 ms. Trace:
I20260709 12:14:11.623925  5271 rpcz_store.cc:276] 0709 12:14:09.117839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:11.545600 (+2427761us) service_pool.cc:224] Handling call
0709 12:14:11.610202 (+ 64602us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:11.623324 (+ 13122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:11.623551 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:11.596709  5089 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.012s	sys 0.016s
W20260709 12:14:11.484840  7976 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.028s	sys 0.071s
I20260709 12:14:11.431495  8004 raft_consensus.cc:515] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:11.489475  7808 raft_consensus.cc:3055] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:11.432334  7870 raft_consensus.cc:515] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:11.618608  7665 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:11.638051  7665 raft_consensus.cc:3060] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:11.638386  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:11.639624  7870 leader_election.cc:290] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:11.485986  8062 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:11.600353  5273 rpcz_store.cc:269] 0709 12:14:09.146913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:09.785297 (+638384us) service_pool.cc:224] Handling call
0709 12:14:11.505109 (+1719812us) spinlock_profiling.cc:243] Waited 381 ms on lock 0x7b540036c4d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:11.505253 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":875285376}
I20260709 12:14:11.641855  8051 raft_consensus.cc:2804] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:11.642305  8051 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:11.606273  5266 raft_consensus.cc:1275] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:14:11.588986  5237 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.212.130:44455 timed out after 1.574s (SENT) [suppressed 22 similar messages]
I20260709 12:14:11.456311  7848 raft_consensus.cc:515] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:11.643203  5266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34672 (request call id 1853) took 2351 ms. Trace:
I20260709 12:14:11.643615  5266 rpcz_store.cc:276] 0709 12:14:09.291309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:11.602204 (+2310895us) service_pool.cc:224] Handling call
0709 12:14:11.602620 (+   416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:11.642865 (+ 40245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:11.643136 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:11.644462  7838 consensus_meta.cc:287] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.544s	user 0.005s	sys 0.001s
I20260709 12:14:11.640661  8062 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:11.644939  7848 leader_election.cc:290] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:11.627475  7976 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.028s	sys 0.072s
I20260709 12:14:11.642391  5273 raft_consensus.cc:1275] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:14:11.646584  5273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34674 (request call id 2004) took 2235 ms. Trace:
I20260709 12:14:11.646915  5273 rpcz_store.cc:276] 0709 12:14:09.411012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:11.641668 (+2230656us) service_pool.cc:224] Handling call
0709 12:14:11.642010 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:11.646355 (+  4345us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:11.646529 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:11.646593  5274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34674 (request call id 1994) took 2570 ms. Trace:
I20260709 12:14:11.611088  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:11.591949  5269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34672 (request call id 1850) took 2335 ms. Trace:
I20260709 12:14:11.648074  5269 rpcz_store.cc:276] 0709 12:14:09.256554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:11.509233 (+2252679us) service_pool.cc:224] Handling call
0709 12:14:11.517643 (+  8410us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:11.589286 (+ 71643us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:11.591888 (+  2602us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:11.611814  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:11.612054  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:11.649796  5191 raft_consensus.cc:2393] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 5: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:11.615833  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:11.650688  5198 raft_consensus.cc:2468] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 6.
I20260709 12:14:11.649171  5200 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 6.
I20260709 12:14:11.647850  5274 rpcz_store.cc:276] 0709 12:14:09.076493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:11.102199 (+2025706us) service_pool.cc:224] Handling call
0709 12:14:11.505257 (+403058us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:11.600453 (+ 95196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:11.646404 (+ 45951us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x7b540036c4d0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc28ad 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:11.646528 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":508831616}
W20260709 12:14:11.600404  7973 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.048s	sys 0.042s
I20260709 12:14:11.588209  7647 raft_consensus.cc:493] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.619328  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:11.668196  5194 raft_consensus.cc:2410] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:14:11.669166  7910 leader_election.cc:290] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:11.670004  8008 leader_election.cc:290] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:11.642697  8051 raft_consensus.cc:3060] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:11.509497  5192 raft_consensus.cc:2955] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
W20260709 12:14:11.630228  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 142122us
I20260709 12:14:11.681325  5163 leader_election.cc:304] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:11.598834  7713 raft_consensus.cc:740] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
W20260709 12:14:11.604861  8064 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.005s	sys 0.018s
I20260709 12:14:11.632526  5195 raft_consensus.cc:1240] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260709 12:14:11.689199  8064 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.006s	sys 0.019s
I20260709 12:14:11.487478  8042 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:11.651331  5197 raft_consensus.cc:2468] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 6.
I20260709 12:14:11.446724  8063 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:11.673275  5271 raft_consensus.cc:1275] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:14:11.625250  5089 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.012s	sys 0.016s
W20260709 12:14:11.611394  8058 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.000s	sys 0.010s
I20260709 12:14:11.599371  7805 raft_consensus.cc:515] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:11.688017  5267 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.032s	sys 0.121s
I20260709 12:14:11.487637  7777 raft_consensus.cc:515] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:11.696084  5271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34674 (request call id 2003) took 2285 ms. Trace:
I20260709 12:14:11.709846  5271 rpcz_store.cc:276] 0709 12:14:09.410399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:11.624682 (+2214283us) service_pool.cc:224] Handling call
0709 12:14:11.661937 (+ 37255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:11.694830 (+ 32893us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:11.695855 (+  1025us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:11.699225  5089 leader_election.cc:304] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:11.637652  7808 raft_consensus.cc:740] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
W20260709 12:14:11.700611  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 274773us
I20260709 12:14:11.712335  5801 leader_election.cc:304] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:14:11.713132  5267 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.033s	sys 0.122s
I20260709 12:14:11.629114  7728 raft_consensus.cc:515] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:11.670652  7910 raft_consensus.cc:2804] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:11.678778  8061 raft_consensus.cc:2749] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:14:11.698853  8058 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.000s	sys 0.011s
I20260709 12:14:11.733698  7805 leader_election.cc:290] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:11.734880  7866 leader_election.cc:290] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:11.736289  7849 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:11.726768  7808 consensus_queue.cc:260] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:11.737920  7808 raft_consensus.cc:3060] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:11.742352  8062 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:11.727646  8004 leader_election.cc:290] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:11.729470  7777 leader_election.cc:290] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:11.679394  7647 raft_consensus.cc:515] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:11.743408  8063 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:11.745064  7647 leader_election.cc:290] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:11.696041  8008 raft_consensus.cc:2749] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:11.730701  7713 consensus_queue.cc:260] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:11.731760  7728 leader_election.cc:290] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:11.732074  8049 leader_election.cc:290] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:11.732169  7910 raft_consensus.cc:493] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:11.748751  5090 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.771s	user 0.007s	sys 0.035s
W20260709 12:14:11.751456  5090 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.007s	sys 0.035s
W20260709 12:14:11.751925  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:11.716687  7973 raft_consensus.cc:2749] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:11.747326  5801 leader_election.cc:304] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:11.757520  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:11.760504  5834 raft_consensus.cc:3060] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:11.761137  5240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:11.762750  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:11.748324  8057 raft_consensus.cc:493] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.722239  7870 raft_consensus.cc:2749] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:11.765362  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:11.766997  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:11.758564  5804 leader_election.cc:304] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:11.768728  5836 raft_consensus.cc:2410] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:14:11.768229  5833 raft_consensus.cc:3060] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:11.754591  7910 raft_consensus.cc:3060] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:11.772141  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:11.772795  5120 raft_consensus.cc:2468] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 8.
I20260709 12:14:11.782119  5120 raft_consensus.cc:1240] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:14:11.785779  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:11.755823  8063 raft_consensus.cc:493] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:11.789067  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:11.759192  7713 raft_consensus.cc:3060] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:11.826984  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:11.828604  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:11.829320  5122 raft_consensus.cc:2468] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 5.
I20260709 12:14:11.832422  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:11.834388  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:11.765961  8072 raft_consensus.cc:2804] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:11.827962  5835 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 4.
I20260709 12:14:11.790094  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:11.839519  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:11.790567  5124 raft_consensus.cc:1275] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:14:11.832119  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 108331us
I20260709 12:14:11.840507  5829 raft_consensus.cc:2410] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
W20260709 12:14:11.767349  5091 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.008s	sys 0.037s
W20260709 12:14:11.778745  8010 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.015s	sys 0.017s
W20260709 12:14:11.787060  7971 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.013s	sys 0.024s
W20260709 12:14:11.841514  5091 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.008s	sys 0.037s
I20260709 12:14:11.769145  7728 raft_consensus.cc:493] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:11.737299  7665 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:11.818822  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:11.787470  7823 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.009s	sys 0.023s
W20260709 12:14:11.767307  8069 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.017s	sys 0.028s
I20260709 12:14:11.787349  8008 raft_consensus.cc:493] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:11.845755  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:11.787122  8049 raft_consensus.cc:2804] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:11.861130  5834 raft_consensus.cc:2410] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:14:11.842425  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:11.907421  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 66630.6us
W20260709 12:14:11.915637  5240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:11.787495  7777 raft_consensus.cc:2804] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:11.845649  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:11.936779  7728 raft_consensus.cc:515] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:11.850102  8010 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.017s	sys 0.024s
I20260709 12:14:11.967957  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:11.992507  7805 raft_consensus.cc:493] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:11.936837  7823 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.846s	user 0.016s	sys 0.025s
I20260709 12:14:11.994848  5267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34674 (request call id 1988) took 2963 ms. Trace:
I20260709 12:14:11.937089  7870 raft_consensus.cc:493] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.993115  7805 raft_consensus.cc:515] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:11.969936  8069 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.820s	user 0.018s	sys 0.028s
W20260709 12:14:11.851756  7971 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.013s	sys 0.025s
I20260709 12:14:11.968879  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:11.976730  5833 raft_consensus.cc:2468] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 7.
I20260709 12:14:11.839314  8072 raft_consensus.cc:493] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:11.838691  7647 raft_consensus.cc:493] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.850394  8062 raft_consensus.cc:493] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:11.969229  8008 raft_consensus.cc:515] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:11.992475  5834 raft_consensus.cc:2468] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 6.
I20260709 12:14:11.786834  8057 raft_consensus.cc:515] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:11.995286  5267 rpcz_store.cc:276] 0709 12:14:09.031013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:11.021872 (+1990859us) service_pool.cc:224] Handling call
0709 12:14:11.045939 (+ 24067us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:11.064783 (+ 18844us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:11.064819 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:11.067090 (+  2271us) log.cc:844] Serialized 52 byte log entry
0709 12:14:11.713602 (+646512us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:11.713644 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:11.713725 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:11.994623 (+280898us) raft_consensus.cc:1685] finished
0709 12:14:11.994646 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:11.994782 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71,"raft.queue_time_us":3295,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":102,"spinlock_wait_cycles":979840,"thread_start_us":645602,"threads_started":1,"wal-append.queue_time_us":925533}
I20260709 12:14:12.010609  5199 raft_consensus.cc:2393] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 8: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:12.054498  5836 raft_consensus.cc:2410] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:14:12.054776  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:11.835840  8063 raft_consensus.cc:515] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:11.762862  8060 consensus_queue.cc:237] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:11.998560  8053 leader_election.cc:290] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:12.009608  5830 raft_consensus.cc:2468] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
I20260709 12:14:12.059201  8072 raft_consensus.cc:3060] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:12.078033  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:12.078596  8062 raft_consensus.cc:515] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:12.079945  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 136118us
I20260709 12:14:12.054076  8055 leader_election.cc:290] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:12.086701  5238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:12.000442  8049 raft_consensus.cc:697] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 6 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:12.093978  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:12.009656  7777 raft_consensus.cc:697] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 8 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:12.074837  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:11.995561  7870 raft_consensus.cc:515] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:12.100153  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:12.111768  5801 leader_election.cc:304] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:12.099907  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:12.110090  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:12.123586  5801 leader_election.cc:304] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:14:12.085397  7869 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.003s	sys 0.031s
W20260709 12:14:12.109962  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 520950us
W20260709 12:14:12.092437  5088 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.017s	sys 0.018s
I20260709 12:14:12.121661  5118 raft_consensus.cc:2468] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 7.
W20260709 12:14:12.127240  5088 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.018s	sys 0.018s
I20260709 12:14:12.125352  5801 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:12.074450  7647 raft_consensus.cc:515] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:12.147013  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 709964us
I20260709 12:14:12.140393  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:12.092981  8004 consensus_queue.cc:1059] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:14:12.108721  7805 leader_election.cc:290] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:12.153996  5088 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:12.130604  7866 raft_consensus.cc:3060] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:12.161284  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 436132us
I20260709 12:14:12.130674  8005 raft_consensus.cc:2749] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:12.164572  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:12.164170  8074 raft_consensus.cc:2804] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:12.173666  8074 raft_consensus.cc:697] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:12.174677  8074 consensus_queue.cc:237] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:12.177667  8083 raft_consensus.cc:493] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:12.178278  8083 raft_consensus.cc:515] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:12.180678  8083 leader_election.cc:290] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:12.137288  7869 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.004s	sys 0.031s
I20260709 12:14:12.169324  5118 raft_consensus.cc:2468] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 5.
I20260709 12:14:12.195806  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:12.198462  7728 leader_election.cc:290] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:12.200917  7777 consensus_queue.cc:237] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:12.201515  8049 consensus_queue.cc:237] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:12.206809  5240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:12.126188  8055 consensus_queue.cc:1059] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:14:12.181193  8083 raft_consensus.cc:493] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:12.212239  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 49698.7us
I20260709 12:14:12.169836  7805 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:12.276170  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 63149.2us
W20260709 12:14:12.376466  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:12.498833  5240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:12.700153  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 361762us
W20260709 12:14:12.698053  8052 consensus_meta.cc:287] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.712s	user 0.009s	sys 0.001s
I20260709 12:14:12.177250  8051 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:12.771852  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:13.012987  5120 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.885s	user 0.000s	sys 0.010s
W20260709 12:14:13.181474  5120 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.054s	user 0.001s	sys 0.011s
I20260709 12:14:12.841526  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:13.178730  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:12.798913  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:12.894441  5240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:12.799667  5117 raft_consensus.cc:1240] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 4. Current term is 5. Ops: []
W20260709 12:14:12.894749  5836 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.792s	user 0.007s	sys 0.002s
W20260709 12:14:13.203653  5836 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.108s	user 0.007s	sys 0.005s
W20260709 12:14:12.956058  5801 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.819s	user 0.000s	sys 0.009s
W20260709 12:14:13.204416  5801 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.067s	user 0.000s	sys 0.012s
W20260709 12:14:13.205194  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 1.07979e+06us
W20260709 12:14:12.938859  5237 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.811s	user 0.000s	sys 0.009s
W20260709 12:14:13.207006  5237 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.080s	user 0.000s	sys 0.012s
W20260709 12:14:13.207403  5237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:13.209786  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:13.211138  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:13.211863  5273 raft_consensus.cc:2468] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 5.
I20260709 12:14:13.213429  5237 leader_election.cc:304] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:14:13.130023  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:12.922765  5238 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.813s	user 0.007s	sys 0.002s
W20260709 12:14:13.263151  5238 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.154s	user 0.007s	sys 0.005s
I20260709 12:14:13.263381  5119 raft_consensus.cc:2410] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:14:13.183502  5088 leader_election.cc:304] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:13.180218  5124 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 4.
I20260709 12:14:12.284696  8005 raft_consensus.cc:2804] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:14:13.166824  8049 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.962s	user 0.000s	sys 0.010s
I20260709 12:14:13.273698  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:13.256050  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:13.257140  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 54730.3us
I20260709 12:14:13.274942  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
W20260709 12:14:13.044062  7713 consensus_meta.cc:287] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 1.195s	user 0.007s	sys 0.002s
W20260709 12:14:13.166729  7777 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.962s	user 0.005s	sys 0.005s
W20260709 12:14:13.040701  8082 log.cc:927] Time spent T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.827s	user 0.000s	sys 0.001s
W20260709 12:14:12.903478  8069 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.793s	user 0.004s	sys 0.005s
W20260709 12:14:13.039856  8076 log.cc:927] Time spent T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.846s	user 0.000s	sys 0.000s
W20260709 12:14:13.049299  8072 consensus_meta.cc:287] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.943s	user 0.005s	sys 0.003s
W20260709 12:14:13.178828  8004 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.000s	user 0.004s	sys 0.005s
W20260709 12:14:12.701256  8075 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.733s	user 0.021s	sys 0.022s
W20260709 12:14:12.840682  7801 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.099s	user 0.061s	sys 0.128s
W20260709 12:14:13.265223  5163 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.181s	user 0.052s	sys 0.076s
I20260709 12:14:12.903669  8063 leader_election.cc:290] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:13.266295  5271 raft_consensus.cc:1240] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:13.266430  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:13.266485  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:13.267818  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
W20260709 12:14:13.267935  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 54608.6us
I20260709 12:14:13.047547  8008 leader_election.cc:290] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:13.053325  7870 leader_election.cc:290] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:12.843012  7869 raft_consensus.cc:493] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:12.968225  7910 consensus_meta.cc:287] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 1.133s	user 0.007s	sys 0.000s
I20260709 12:14:13.258632  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:14:13.296837  8075 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.329s	user 0.025s	sys 0.023s
I20260709 12:14:13.278766  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:13.280162  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 96768.6us
I20260709 12:14:13.281237  5123 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 6.
I20260709 12:14:13.280185  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:12.720291  8083 raft_consensus.cc:515] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:13.285926  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:12.939597  8081 consensus_queue.cc:1048] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.329s
I20260709 12:14:13.315274  5124 raft_consensus.cc:2468] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 7.
I20260709 12:14:13.316725  5269 raft_consensus.cc:2393] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 5: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:12.772594  8053 consensus_queue.cc:1059] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.500s
I20260709 12:14:12.729961  7805 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:12.840783  7823 consensus_queue.cc:1048] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.476s
W20260709 12:14:13.291916  8004 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.127s	user 0.004s	sys 0.006s
W20260709 12:14:13.277367  7777 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.073s	user 0.005s	sys 0.005s
W20260709 12:14:13.274109  8049 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.069s	user 0.000s	sys 0.011s
W20260709 12:14:13.297186  5163 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.213s	user 0.052s	sys 0.076s
W20260709 12:14:13.338516  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 1.25446e+06us
W20260709 12:14:13.280046  8069 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.174s	user 0.004s	sys 0.005s
W20260709 12:14:13.341749  5803 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.007s	sys 0.022s
W20260709 12:14:13.342235  5803 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.007s	sys 0.022s
I20260709 12:14:13.343161  7870 raft_consensus.cc:493] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:13.343745  7870 raft_consensus.cc:515] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:13.304862  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:13.304435  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:13.307360  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:13.347220  5273 raft_consensus.cc:2468] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 6.
I20260709 12:14:13.345784  5271 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 7.
I20260709 12:14:13.298009  8072 raft_consensus.cc:515] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:13.362501  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:13.363474  5273 raft_consensus.cc:2393] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 7: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:13.270295  8005 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
W20260709 12:14:13.301926  5802 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.020s	sys 0.015s
W20260709 12:14:13.297057  7801 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.626s	user 0.062s	sys 0.133s
W20260709 12:14:13.276098  5240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:13.280280  7859 raft_consensus.cc:493] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:13.296036  7976 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.016s	sys 0.005s
I20260709 12:14:13.296602  7713 raft_consensus.cc:2804] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:14:13.288280  8067 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.059s	user 0.004s	sys 0.012s
I20260709 12:14:13.319305  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:13.296486  8101 raft_consensus.cc:3055] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:13.321727  5088 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:13.323133  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:14:13.401633  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 80006.3us
I20260709 12:14:13.402486  5088 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:13.403371  5088 leader_election.cc:304] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:13.317298  5238 leader_election.cc:304] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:13.302834  8089 raft_consensus.cc:3060] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:13.328181  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:13.304253  7665 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:13.331768  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 125441us
I20260709 12:14:13.349346  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:13.391996  5122 raft_consensus.cc:2955] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:14:13.254055  8052 raft_consensus.cc:515] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:13.395376  7859 raft_consensus.cc:515] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:13.415041  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:13.418413  5269 raft_consensus.cc:2368] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 5. Current term is 6.
I20260709 12:14:13.419577  8052 leader_election.cc:290] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:13.419840  8096 log.cc:927] Time spent T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:14:13.364351  5836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46100 (request call id 900) took 1592 ms. Trace:
I20260709 12:14:13.415443  5801 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:13.364866  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:13.420374  5836 rpcz_store.cc:276] 0709 12:14:11.771446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:12.081481 (+310035us) service_pool.cc:224] Handling call
0709 12:14:12.095612 (+ 14131us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:12.095857 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:14:13.247237 (+1151380us) log.cc:844] Serialized 14 byte log entry
0709 12:14:13.345421 (+ 98184us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:13.364013 (+ 18592us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:13.364074 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:13.364137 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:13.364291 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1321145,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":68,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":3951,"thread_start_us":1205662,"threads_started":2,"wal-append.queue_time_us":159525}
I20260709 12:14:13.421896  5271 raft_consensus.cc:2468] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 4.
I20260709 12:14:13.366552  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:13.317915  7869 raft_consensus.cc:515] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:13.317715  7910 raft_consensus.cc:515] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:13.360194  8062 leader_election.cc:290] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:13.408396  5117 raft_consensus.cc:2393] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 7: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
W20260709 12:14:13.393023  7976 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.054s	user 0.016s	sys 0.006s
W20260709 12:14:13.398021  8067 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.190s	user 0.005s	sys 0.014s
I20260709 12:14:13.431349  5121 raft_consensus.cc:1240] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:14:13.431676  8067 raft_consensus.cc:2804] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:13.429152  7976 raft_consensus.cc:2804] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:13.415125  8112 consensus_queue.cc:1059] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:14:13.361716  5124 raft_consensus.cc:1240] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:13.421972  5120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40402 (request call id 2027) took 1367 ms. Trace:
W20260709 12:14:13.393075  5802 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.020s	sys 0.016s
W20260709 12:14:13.370339  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 56816.2us
I20260709 12:14:13.434331  5237 leader_election.cc:304] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:13.422885  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:13.390179  8005 raft_consensus.cc:3060] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:13.423274  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:13.425554  8063 raft_consensus.cc:2804] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:13.397737  7713 raft_consensus.cc:493] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:13.425998  7777 consensus_queue.cc:1059] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:14:13.429637  8083 leader_election.cc:290] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:13.430874  7910 leader_election.cc:290] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:13.404552  8101 raft_consensus.cc:740] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:13.422593  5273 raft_consensus.cc:2376] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 7. Re-sending same reply.
W20260709 12:14:13.450063  8103 log.cc:927] Time spent T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:14:13.450459  8101 consensus_queue.cc:260] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:13.433435  5089 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.015s	sys 0.005s
I20260709 12:14:13.434902  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:14:13.452199  5089 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.015s	sys 0.005s
I20260709 12:14:13.452407  5274 raft_consensus.cc:2468] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 6.
I20260709 12:14:13.452594  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:13.453274  5273 raft_consensus.cc:3060] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:13.427618  8081 raft_consensus.cc:2749] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:14:13.415469  7866 consensus_meta.cc:287] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 1.248s	user 0.011s	sys 0.000s
I20260709 12:14:13.445852  5237 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:13.437362  5269 raft_consensus.cc:2468] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 8.
I20260709 12:14:13.436339  8051 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:13.457109  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:13.435289  5271 raft_consensus.cc:3060] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:13.434053  7976 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:13.435062  5120 rpcz_store.cc:276] 0709 12:14:12.055085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:12.055210 (+   125us) service_pool.cc:224] Handling call
0709 12:14:12.055534 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:12.080333 (+ 24799us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:12.080363 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:12.088556 (+  8193us) log.cc:844] Serialized 26 byte log entry
0709 12:14:13.182039 (+1093483us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:13.182089 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:13.182163 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:13.421748 (+239585us) raft_consensus.cc:1685] finished
0709 12:14:13.421767 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:13.421915 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40082,"raft.queue_time_us":24918,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":15202,"thread_start_us":1054296,"threads_started":1,"wal-append.queue_time_us":1182884}
I20260709 12:14:13.462736  5269 raft_consensus.cc:2410] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:14:13.443325  8063 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:13.446955  7713 raft_consensus.cc:3060] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:13.437048  8030 raft_consensus.cc:493] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:13.476132  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:13.467269  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:13.465714  5237 leader_election.cc:304] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:13.451784  8101 raft_consensus.cc:3060] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:13.477455  5269 raft_consensus.cc:2468] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 7.
I20260709 12:14:13.480844  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:13.488158  5274 raft_consensus.cc:2410] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:14:13.488534  8108 log.cc:927] Time spent T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:14:13.466831  8063 raft_consensus.cc:3060] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:13.480938  8030 raft_consensus.cc:515] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:13.494328  5266 raft_consensus.cc:2468] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 4.
I20260709 12:14:13.448864  8099 consensus_queue.cc:1048] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:14:13.464133  7866 raft_consensus.cc:2749] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:13.486552  8072 leader_election.cc:290] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:13.498965  8030 leader_election.cc:290] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:13.499778  8110 log.cc:927] Time spent T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:14:13.481681  8117 raft_consensus.cc:2749] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:13.489042  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:13.497074  8005 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:13.487290  5838 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46088 (request call id 522) took 3156 ms (client timeout 1787 ms). Trace:
W20260709 12:14:13.508446  5838 rpcz_store.cc:269] 0709 12:14:10.331260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:10.382720 (+ 51460us) service_pool.cc:224] Handling call
0709 12:14:13.487044 (+3104324us) spinlock_profiling.cc:243] Waited 21.7 ms on lock 0x7b54004542d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:13.487191 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49983744}
I20260709 12:14:13.515466  5271 raft_consensus.cc:2468] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 5.
W20260709 12:14:13.516655  8104 log.cc:927] Time spent T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:14:13.464672  7976 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:13.476553  8067 raft_consensus.cc:697] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
W20260709 12:14:13.562534  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 245311us
I20260709 12:14:13.558326  8117 raft_consensus.cc:2749] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:13.554558  8099 raft_consensus.cc:2804] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:13.568720  8099 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:13.569518  8099 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:13.569912  8102 log.cc:927] Time spent T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
I20260709 12:14:13.568920  5195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41416 (request call id 504) took 2544 ms. Trace:
I20260709 12:14:13.571736  5195 rpcz_store.cc:276] 0709 12:14:11.024592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:11.024791 (+   199us) service_pool.cc:224] Handling call
0709 12:14:11.025188 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:11.689339 (+664151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:13.568495 (+1879156us) spinlock_profiling.cc:243] Waited 607 ms on lock 0x7b54001c98d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:13.568777 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1396199296}
W20260709 12:14:13.600471  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 197153us
W20260709 12:14:13.589809  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 134211us
I20260709 12:14:13.605369  5238 leader_election.cc:304] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:13.606750  8112 raft_consensus.cc:2804] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:13.607137  8112 raft_consensus.cc:493] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:13.607497  8112 raft_consensus.cc:3060] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:13.614024  5238 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
W20260709 12:14:13.616415  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 152881us
I20260709 12:14:13.618113  5238 leader_election.cc:304] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
W20260709 12:14:13.619086  8060 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.446s	user 0.010s	sys 0.018s
W20260709 12:14:13.618438  5801 connection.cc:256] RPC call timeout handler was delayed by -2.030278601999953s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2806s for a response
I20260709 12:14:13.620285  8121 raft_consensus.cc:2749] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:13.623273  5238 leader_election.cc:400] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 election: Vote denied by peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539) with higher term. Message: Invalid argument: T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 7. Current term is 8.
W20260709 12:14:13.625128  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 159490us
I20260709 12:14:13.601447  7878 raft_consensus.cc:3060] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:13.555497  8098 raft_consensus.cc:2749] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:13.571939  7870 leader_election.cc:290] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:13.625455  5238 leader_election.cc:403] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:14:13.572263  7805 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:13.573124  7869 leader_election.cc:290] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:13.620919  8117 consensus_queue.cc:1059] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
W20260709 12:14:13.630872  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 185566us
W20260709 12:14:13.625742  8060 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.451s	user 0.011s	sys 0.018s
I20260709 12:14:13.639117  8112 raft_consensus.cc:515] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:13.642946  7805 raft_consensus.cc:2804] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:13.644246  7805 raft_consensus.cc:493] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:13.644289  5193 raft_consensus.cc:1240] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 LEADER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:14:13.644752  7805 raft_consensus.cc:3060] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:13.649493  5166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:13.650008  5166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:13.634608  5801 leader_election.cc:304] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:13.656755  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:13.659411  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:13.652171  8005 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:13.631263  7713 raft_consensus.cc:515] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:13.783771  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:14:13.841743  5270 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34672 (request call id 1838) took 4695 ms (client timeout 4000 ms). Trace:
I20260709 12:14:13.838692  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:13.783798  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:14:13.842213  5088 connection.cc:256] RPC call timeout handler was delayed by -4.219033612000203s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.166s for a response
I20260709 12:14:13.720481  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:13.842792  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:13.778919  5273 raft_consensus.cc:2468] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 9.
I20260709 12:14:13.831882  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:13.786266  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:13.846799  5267 raft_consensus.cc:2468] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 6.
I20260709 12:14:13.853631  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:13.842476  5274 raft_consensus.cc:2410] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:14:13.763366  5265 raft_consensus.cc:2468] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
W20260709 12:14:13.843922  5237 leader_election.cc:336] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Timed out: RequestConsensusVote RPC to 127.3.212.130:44455 timed out after 1.549s (SENT)
W20260709 12:14:13.844266  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 209748us
I20260709 12:14:13.665530  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:13.663491  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:13.847683  5270 rpcz_store.cc:269] 0709 12:14:09.145960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:13.664089 (+4518129us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:13.841666 (+177577us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:14:13.709022  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 66412.7us
I20260709 12:14:13.849946  5122 raft_consensus.cc:2410] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:14:13.854483  5088 connection.cc:256] RPC call timeout handler was delayed by -3.9637721940000574s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31210000000000004s for a response
I20260709 12:14:13.850128  5271 raft_consensus.cc:2393] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 7: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:13.849362  5269 raft_consensus.cc:3060] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:13.851758  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
W20260709 12:14:13.857774  5088 connection.cc:256] RPC call timeout handler was delayed by -3.4215226430001167s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2s for a response
I20260709 12:14:13.661355  8030 raft_consensus.cc:2804] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:13.851675  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:13.665344  8042 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:13.751543  8089 raft_consensus.cc:2749] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:13.870204  5121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40402 (request call id 2025) took 2018 ms. Trace:
I20260709 12:14:13.870671  5121 rpcz_store.cc:276] 0709 12:14:11.851987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:11.852112 (+   125us) service_pool.cc:224] Handling call
0709 12:14:12.096927 (+244815us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:13.431788 (+1334861us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:13.869909 (+438121us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b54003ee754. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:13.870131 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3068275456}
I20260709 12:14:13.871340  7805 raft_consensus.cc:515] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:13.866313  5801 leader_election.cc:304] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:13.886292  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:13.736034  8098 raft_consensus.cc:2749] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539) with higher term. Message: Invalid argument: T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 7. Current term is 8.
I20260709 12:14:13.858839  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:13.859414  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:13.860576  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:13.982717  5122 raft_consensus.cc:2393] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 8: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:13.860773  5116 raft_consensus.cc:2393] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 3: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:13.697073  8126 raft_consensus.cc:493] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:13.855213  7957 raft_consensus.cc:493] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:13.866194  8005 consensus_queue.cc:1048] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:14:14.013214  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 129537us
I20260709 12:14:14.014478  8100 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:14.015182  5801 leader_election.cc:304] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:14.015069  8100 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:14.017815  7870 raft_consensus.cc:2804] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:14.018366  7870 raft_consensus.cc:493] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:14.018798  7870 raft_consensus.cc:3060] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:13.866982  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:13.858268  5088 connection.cc:256] RPC call timeout handler was delayed by -3.0224562880000576s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1511s for a response
W20260709 12:14:14.021582  5088 connection.cc:256] RPC call timeout handler was delayed by -2.8892562880000696s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16590000000000002s for a response
W20260709 12:14:14.021970  5088 connection.cc:256] RPC call timeout handler was delayed by -2.5535562879999816s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20320000000000002s for a response
W20260709 12:14:14.022262  5088 connection.cc:256] RPC call timeout handler was delayed by -2.1836562880000656s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24430000000000002s for a response
W20260709 12:14:14.001730  5237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:14.013214  7957 raft_consensus.cc:515] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:14.024387  5237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:14.025882  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:14.026638  5268 raft_consensus.cc:2393] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 6: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:14.028208  8112 leader_election.cc:290] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:13.860427  8030 raft_consensus.cc:493] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:14.029780  8030 raft_consensus.cc:3060] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:14.030180  5240 leader_election.cc:304] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:14.017241  8100 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:14.032701  8128 raft_consensus.cc:2804] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:14.033164  8128 raft_consensus.cc:493] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:14.033537  8128 raft_consensus.cc:3060] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:13.665397  8067 consensus_queue.cc:237] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:14.033927  8117 consensus_queue.cc:1059] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:14.034991  7869 raft_consensus.cc:3055] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:14.035382  7869 raft_consensus.cc:740] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:14.036141  7869 consensus_queue.cc:260] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:14.037307  7869 raft_consensus.cc:3060] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:14.038371  7805 leader_election.cc:290] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:14.039093  8101 raft_consensus.cc:2804] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:13.665115  8063 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:14.039597  8101 raft_consensus.cc:493] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:14.040021  8101 raft_consensus.cc:3060] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:14.041301  8063 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:14.037653  8126 raft_consensus.cc:515] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:13.743002  8099 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:13.760704  7976 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:14.043454  8126 leader_election.cc:290] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:13.953190  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:14.044430  5270 raft_consensus.cc:2393] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 8: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:14.055218  8026 consensus_queue.cc:260] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:14.056707  8026 raft_consensus.cc:3060] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:14.058212  5273 raft_consensus.cc:2468] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 7.
W20260709 12:14:14.058732  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 435557us
I20260709 12:14:14.061830  8089 consensus_queue.cc:1059] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:14.064026  8125 raft_consensus.cc:3055] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:14.064489  8125 raft_consensus.cc:740] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:14.065357  8125 consensus_queue.cc:260] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:14.066206  5199 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47728 (request call id 1981) took 2471 ms (client timeout 3087 ms). Trace:
I20260709 12:14:14.066668  8125 raft_consensus.cc:3060] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:14.066601  5199 rpcz_store.cc:269] 0709 12:14:11.595176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:11.595313 (+   137us) service_pool.cc:224] Handling call
0709 12:14:14.065975 (+2470662us) spinlock_profiling.cc:243] Waited 390 ms on lock 0x7b54002fb7d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:14.066120 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":896296704}
I20260709 12:14:14.044497  7976 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:14.044494  8099 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:14.073005  5193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47728 (request call id 1974) took 2621 ms. Trace:
I20260709 12:14:14.074483  5193 rpcz_store.cc:276] 0709 12:14:11.452083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:11.452208 (+   125us) service_pool.cc:224] Handling call
0709 12:14:11.452526 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:13.644858 (+2192332us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:14.072719 (+427861us) spinlock_profiling.cc:243] Waited 2.19 s on lock 0x7b5400377dd4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:14.072938 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5039509888}
I20260709 12:14:14.078812  5238 leader_election.cc:304] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:14.079859  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:14.082120  5238 leader_election.cc:304] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:14.083128  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:14.083844  5274 raft_consensus.cc:3060] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:14.085477  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:14.086773  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:14.091917  5122 raft_consensus.cc:2393] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 5: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:14.092914  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:14.094081  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:14.098114  5238 leader_election.cc:304] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:14.099531  5238 leader_election.cc:304] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:14.101025  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:14.101596  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:14.101282  5088 leader_election.cc:304] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:14.101217  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:14.108335  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:14.109512  5269 raft_consensus.cc:2468] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 6.
I20260709 12:14:14.121188  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:14.122926  5123 raft_consensus.cc:2468] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 5.
I20260709 12:14:14.124292  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:14.082875  8099 raft_consensus.cc:2749] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:14.126368  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:14.121206  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:14.135648  8030 raft_consensus.cc:515] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:14.130417  5266 raft_consensus.cc:3055] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:14.120056  8137 raft_consensus.cc:2749] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:14.136066  7866 raft_consensus.cc:493] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:14.139904  5266 raft_consensus.cc:740] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:14.101755  8106 raft_consensus.cc:493] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:14.109690  8136 raft_consensus.cc:2804] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:14.109869  8121 raft_consensus.cc:3060] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:14.087903  8063 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:14.159844  5196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47728 (request call id 1970) took 2733 ms. Trace:
I20260709 12:14:14.176163  5196 rpcz_store.cc:276] 0709 12:14:11.426217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:11.426409 (+   192us) service_pool.cc:224] Handling call
0709 12:14:11.426762 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:11.427082 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:14:11.477161 (+ 50079us) log.cc:844] Serialized 14 byte log entry
0709 12:14:11.839717 (+362556us) log.cc:844] Serialized 14 byte log entry
0709 12:14:14.148083 (+2308366us) spinlock_profiling.cc:243] Waited 3.86 ms on lock 0x7b180019dfe0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3a50c0a 00007f84ed190219 00007f84e3ad8a40 00007f84e3ad34e4 00007f84e3ad3455 00007f84e6bbb060 00007f84e6bcd716 00007f84e6bde287 00007f84e6bde208
0709 12:14:14.159491 (+ 11408us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:14.159544 (+    53us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:14.159588 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:14.159652 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:14.159784 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2239962,"prepare.queue_time_us":62713,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":65,"raft.queue_time_us":2337158,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":6872,"spinlock_wait_cycles":160651136,"thread_start_us":355824,"threads_started":1,"wal-append.queue_time_us":666964}
W20260709 12:14:14.184429  5164 connection.cc:256] RPC call timeout handler was delayed by -1.9206535640000766s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15280000000000002s for a response
I20260709 12:14:14.185286  5267 raft_consensus.cc:1240] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 8. Current term is 9. Ops: [7.8-8.9]
W20260709 12:14:14.192571  5163 leader_election.cc:336] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 1.503s (SENT)
I20260709 12:14:14.193068  5163 leader_election.cc:304] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:14.168843  8136 raft_consensus.cc:493] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:14.199502  8062 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:14.201834  5166 connection.cc:256] RPC call timeout handler was delayed by -1.9149341270001514s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15280000000000002s for a response
W20260709 12:14:14.202275  5166 connection.cc:256] RPC call timeout handler was delayed by -1.5189341270001933s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1968s for a response
W20260709 12:14:14.202569  5166 connection.cc:256] RPC call timeout handler was delayed by -1.4269485150000492s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1562s for a response
W20260709 12:14:14.202886  5166 connection.cc:256] RPC call timeout handler was delayed by -1.3677341270001762s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2136s for a response
W20260709 12:14:14.203176  5166 connection.cc:256] RPC call timeout handler was delayed by -1.1971729279998726s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17270000000000002s for a response
W20260709 12:14:14.203460  5166 connection.cc:256] RPC call timeout handler was delayed by -1.0867330040000525s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1894s for a response
I20260709 12:14:14.162827  7888 consensus_queue.cc:1048] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:14:14.206494  7888 consensus_queue.cc:1048] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:14.209287  5166 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:14.163017  5274 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 8.
I20260709 12:14:14.121924  7976 raft_consensus.cc:2804] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:14.121934  8005 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:14.164392  7866 raft_consensus.cc:515] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:14.170022  5237 leader_election.cc:304] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:14.160861  5266 consensus_queue.cc:260] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:14.170953  8070 consensus_queue.cc:1059] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:14:14.215257  8062 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:14.216645  8101 raft_consensus.cc:515] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:14.219475  7859 leader_election.cc:290] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:14.211918  7849 raft_consensus.cc:493] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:14.283447  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 74229.7us
I20260709 12:14:14.197714  8052 raft_consensus.cc:493] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:14.223533  7647 leader_election.cc:290] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:14.224311  5163 leader_election.cc:336] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 1.517s (SENT)
I20260709 12:14:14.287721  5163 leader_election.cc:304] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
W20260709 12:14:14.287880  5164 connection.cc:256] RPC call timeout handler was delayed by -1.3734535640001013s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2136s for a response
I20260709 12:14:14.224788  7886 raft_consensus.cc:2749] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:14.182715  8120 consensus_queue.cc:1059] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:14:14.182956  8063 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:14.171242  8106 raft_consensus.cc:515] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:14.208696  8136 raft_consensus.cc:3060] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:14.281705  5238 connection.cc:256] RPC call timeout handler was delayed by -1.8108556530000897s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31560000000000005s for a response
W20260709 12:14:14.299281  5238 connection.cc:256] RPC call timeout handler was delayed by -1.0637636940000448s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 12:14:14.221540  8061 consensus_queue.cc:1059] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:14.286545  5266 raft_consensus.cc:3060] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:14.288322  5164 connection.cc:256] RPC call timeout handler was delayed by -1.3356535640000402s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2178s for a response
W20260709 12:14:14.303013  5164 connection.cc:256] RPC call timeout handler was delayed by -1.0771599030001653s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1665s for a response
I20260709 12:14:14.225227  8042 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:14.224422  8055 raft_consensus.cc:3055] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:14.294920  8010 raft_consensus.cc:493] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:14.292963  8060 raft_consensus.cc:493] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:14.317529  8055 raft_consensus.cc:740] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:14.317987  8060 raft_consensus.cc:515] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:14.318413  8055 consensus_queue.cc:260] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:14.319391  8055 raft_consensus.cc:3060] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:14.320268  8060 leader_election.cc:290] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:14.320873  8063 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:14.226375  7957 leader_election.cc:290] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:14.322077  8042 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:14.213563  7976 raft_consensus.cc:493] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:14.323987  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:14.306864  7647 raft_consensus.cc:2749] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:14:14.300115  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 75831.2us
W20260709 12:14:14.333122  5163 leader_election.cc:336] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 1.520s (SENT)
W20260709 12:14:14.334076  5163 leader_election.cc:336] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 1.528s (SENT)
I20260709 12:14:14.334466  5163 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:14.335398  5196 raft_consensus.cc:1275] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:14:14.335764  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:14.287191  7869 raft_consensus.cc:2749] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:14.212208  8100 consensus_queue.cc:1059] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.080s
I20260709 12:14:14.346194  8100 raft_consensus.cc:3055] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:14.346589  8100 raft_consensus.cc:740] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:14.347201  8062 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:14.347540  8100 consensus_queue.cc:260] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:14.348706  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:14.304876  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:14.349985  5199 raft_consensus.cc:2468] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 4.
I20260709 12:14:14.304615  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:14.295008  7644 raft_consensus.cc:2804] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:14.306572  7888 consensus_queue.cc:1048] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:14:14.351491  7644 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:14.351953  7644 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:14.352090  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:14.353560  8146 raft_consensus.cc:3055] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:14.353947  8146 raft_consensus.cc:740] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:14.309741  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:14.310237  5802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:14.354807  8146 consensus_queue.cc:260] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:14.351184  5193 raft_consensus.cc:2410] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:14:14.356369  8146 raft_consensus.cc:3060] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:14.356894  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:14.310536  5198 raft_consensus.cc:1275] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:14:14.358278  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:14.311153  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:14.358541  5117 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40402 (request call id 2038) took 1635 ms (client timeout 1969 ms). Trace:
I20260709 12:14:14.310842  8101 leader_election.cc:290] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:14.359467  8042 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:14.348762  8100 raft_consensus.cc:3060] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:14.359881  5200 raft_consensus.cc:2468] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 3.
I20260709 12:14:14.361697  5198 raft_consensus.cc:2468] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 6.
I20260709 12:14:14.362386  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:14.349287  5272 raft_consensus.cc:3060] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:14.312304  8008 raft_consensus.cc:3055] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:14:14.310829  5166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:14.313304  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:14.313510  8106 leader_election.cc:290] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:14.289662  7849 raft_consensus.cc:515] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:14.361238  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:14.371093  5200 raft_consensus.cc:2410] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:14:14.290521  8070 consensus_queue.cc:1048] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:14:14.225293  7870 raft_consensus.cc:515] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:14.233708  8005 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:14.330310  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:14.292557  8067 raft_consensus.cc:3055] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:14.382651  8067 raft_consensus.cc:740] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:14.382977  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:14.383958  8067 consensus_queue.cc:260] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:14.384543  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:14.385421  8067 raft_consensus.cc:3060] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:14.388120  7849 leader_election.cc:290] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:14.369932  8008 raft_consensus.cc:740] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:14.390987  8005 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:14.391551  8008 consensus_queue.cc:260] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:14.323580  7976 raft_consensus.cc:3060] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:14.392843  8008 raft_consensus.cc:3060] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:14.336539  5274 raft_consensus.cc:2393] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 7: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:14.338066  5266 raft_consensus.cc:1275] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:14:14.393996  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:14.344672  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:14.317948  8010 raft_consensus.cc:515] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:14.368587  5193 raft_consensus.cc:2468] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 6.
W20260709 12:14:14.298085  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 87988.5us
W20260709 12:14:14.358982  5117 rpcz_store.cc:269] 0709 12:14:12.722895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:13.256905 (+534010us) service_pool.cc:224] Handling call
0709 12:14:14.358341 (+1101436us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b54002d2b54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:14.358457 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":304193792}
I20260709 12:14:16.681747  8055 raft_consensus.cc:493] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.682394  8055 raft_consensus.cc:515] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:16.684785  8055 leader_election.cc:290] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:14.379374  5195 raft_consensus.cc:2393] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 8: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
W20260709 12:14:16.686910  5195 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47728 (request call id 1988) took 2357 ms (client timeout 1574 ms). Trace:
W20260709 12:14:16.687321  5195 rpcz_store.cc:269] 0709 12:14:14.329882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:14.330050 (+   168us) service_pool.cc:224] Handling call
0709 12:14:16.686833 (+2356783us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:16.688427  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:14.369202  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:16.690258  5197 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 6.
W20260709 12:14:16.690785  5197 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47728 (request call id 1995) took 2335 ms (client timeout 2150 ms). Trace:
W20260709 12:14:16.691155  5197 rpcz_store.cc:269] 0709 12:14:14.355195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:14.359296 (+  4101us) service_pool.cc:224] Handling call
0709 12:14:16.690720 (+2331424us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:16.692123  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:16.692727  5197 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 6.
I20260709 12:14:14.394855  5191 raft_consensus.cc:2468] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 7.
W20260709 12:14:16.695173  5191 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47728 (request call id 1989) took 2360 ms (client timeout 1742 ms). Trace:
W20260709 12:14:16.695654  5191 rpcz_store.cc:269] 0709 12:14:14.334682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:14.334872 (+   190us) service_pool.cc:224] Handling call
0709 12:14:16.695097 (+2360225us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:16.696708  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:16.690681  8157 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:14.381433  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
W20260709 12:14:14.282015  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 112109us
I20260709 12:14:14.351068  8128 raft_consensus.cc:515] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:16.703593  8128 leader_election.cc:290] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:14:14.409409  5240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:14.399422  5272 raft_consensus.cc:2468] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 8.
I20260709 12:14:14.394263  5266 pending_rounds.cc:85] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929: Aborting all ops after (but not including) 5
I20260709 12:14:16.709980  5266 pending_rounds.cc:107] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:14:16.710275  5266 raft_consensus.cc:2889] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:16.710376  7980 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.711148  5266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34672 (request call id 1873) took 3440 ms. Trace:
I20260709 12:14:16.710945  7980 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:16.711519  5266 rpcz_store.cc:276] 0709 12:14:13.271180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:13.499746 (+228566us) service_pool.cc:224] Handling call
0709 12:14:13.500136 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:14.130312 (+630176us) spinlock_profiling.cc:243] Waited 57.9 ms on lock 0x7b54003b54a0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6b3adc0 00007f84e6bc51c0 00007f84e6bc6231 00007f84e6bc2d8f 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c
0709 12:14:16.710874 (+2580562us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.711072 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":133100416}
I20260709 12:14:16.712783  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:16.713049  7980 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:14:14.399149  5802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:16.721050  5802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:16.721470  5802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:14.378768  7647 raft_consensus.cc:2749] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:14:16.728135  5863 heartbeater.cc:646] Failed to heartbeat to 127.3.212.190:33295 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.3.212.190:33295 timed out after 15.000s (SENT)
I20260709 12:14:14.426836  7870 leader_election.cc:290] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:14.289768  8052 raft_consensus.cc:515] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:14.448635  8121 raft_consensus.cc:2749] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:14.468585  8136 raft_consensus.cc:515] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:16.735512  8136 leader_election.cc:290] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:15.438884  5054 debug-util.cc:398] Leaking SignalData structure 0x7b08001aeaa0 after lost signal to thread 3925
I20260709 12:14:15.508654  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:14:15.781119  5166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:15.807093  3927 debug-util.cc:398] Leaking SignalData structure 0x7b080000fea0 after lost signal to thread 5163
W20260709 12:14:16.737226  5054 debug-util.cc:398] Leaking SignalData structure 0x7b0800092ba0 after lost signal to thread 5057
W20260709 12:14:16.738476  5054 debug-util.cc:398] Leaking SignalData structure 0x7b0800041fe0 after lost signal to thread 5149
W20260709 12:14:16.739262  5054 debug-util.cc:398] Leaking SignalData structure 0x7b08000d5620 after lost signal to thread 5199
W20260709 12:14:16.739810  5054 debug-util.cc:398] Leaking SignalData structure 0x7b0800359060 after lost signal to thread 5224
W20260709 12:14:16.740442  5054 debug-util.cc:398] Leaking SignalData structure 0x7b0800386280 after lost signal to thread 5267
W20260709 12:14:16.741086  5054 debug-util.cc:398] Leaking SignalData structure 0x7b080033e460 after lost signal to thread 5298
W20260709 12:14:15.999333  5193 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47728 (request call id 1994) took 1644 ms (client timeout 1546 ms). Trace:
W20260709 12:14:16.741545  5193 rpcz_store.cc:269] 0709 12:14:14.354917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:14.356652 (+  1735us) service_pool.cc:224] Handling call
0709 12:14:15.999235 (+1642583us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:16.010576  5124 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.831s	user 0.018s	sys 0.038s
W20260709 12:14:16.358803  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 127104us
I20260709 12:14:16.742540  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:16.743070  5238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:16.743847  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:16.744513  5193 raft_consensus.cc:3060] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:16.747159  7647 raft_consensus.cc:493] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.747359  8128 raft_consensus.cc:493] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.747725  7647 raft_consensus.cc:515] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:16.747865  8128 raft_consensus.cc:515] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:16.749600  5124 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.570s	user 0.019s	sys 0.038s
I20260709 12:14:16.742434  5270 raft_consensus.cc:2393] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 8: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
W20260709 12:14:16.463567  8008 consensus_meta.cc:287] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 2.070s	user 0.020s	sys 0.018s
W20260709 12:14:16.466459  5801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:16.752686  5270 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50932 (request call id 578) took 2671 ms (client timeout 3357 ms). Trace:
I20260709 12:14:16.752828  8055 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.747020  7980 raft_consensus.cc:493] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:16.753610  8055 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:16.754782  8128 leader_election.cc:290] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:16.756177  8052 leader_election.cc:290] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:16.474184  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:16.753667  7980 raft_consensus.cc:515] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:16.757164  7870 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:16.757795  7870 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:16.758956  7980 leader_election.cc:290] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:14:16.477182  5089 connection.cc:256] RPC call timeout handler was delayed by -2.032410395999932s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1896s for a response
I20260709 12:14:16.479696  7866 leader_election.cc:290] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:16.759886  7866 raft_consensus.cc:493] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.489737  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:16.499493  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
W20260709 12:14:16.500079  7976 consensus_meta.cc:287] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 2.107s	user 0.017s	sys 0.014s
I20260709 12:14:16.757820  7886 raft_consensus.cc:493] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.760555  7976 raft_consensus.cc:515] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:16.760668  7886 raft_consensus.cc:515] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:16.509243  8151 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.762617  8151 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:16.764212  5238 leader_election.cc:336] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Timed out: RequestConsensusVote RPC to 127.3.212.132:43539 timed out after 1.548s (SENT)
I20260709 12:14:16.512341  7878 raft_consensus.cc:493] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.516288  8152 raft_consensus.cc:493] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:14.428328  7644 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:16.764700  5238 leader_election.cc:304] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:16.527566  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
W20260709 12:14:16.765442  5270 rpcz_store.cc:269] 0709 12:14:14.081282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:14.089492 (+  8210us) service_pool.cc:224] Handling call
0709 12:14:16.752467 (+2662975us) spinlock_profiling.cc:243] Waited 2.61 s on lock 0x7b54000a6c54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:16.752618 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5996031232}
I20260709 12:14:16.766716  5268 raft_consensus.cc:2410] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:14:16.756706  8055 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:16.767176  5268 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34674 (request call id 2018) took 2457 ms (client timeout 2190 ms). Trace:
W20260709 12:14:16.767540  5268 rpcz_store.cc:269] 0709 12:14:14.338685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:14.406061 (+ 67376us) service_pool.cc:224] Handling call
0709 12:14:16.767112 (+2361051us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:16.534819  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:16.769007  5194 raft_consensus.cc:2468] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
I20260709 12:14:16.536880  8069 raft_consensus.cc:3055] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:16.767306  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:16.770370  8069 raft_consensus.cc:740] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:16.770923  5270 raft_consensus.cc:2410] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:14:16.771363  8069 consensus_queue.cc:260] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:16.772558  8069 raft_consensus.cc:3060] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:16.741322  5054 debug-util.cc:398] Leaking SignalData structure 0x7b08002dd7a0 after lost signal to thread 5299
I20260709 12:14:16.539525  7849 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.541818  8042 raft_consensus.cc:493] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.544845  8030 leader_election.cc:290] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:16.546862  8005 raft_consensus.cc:493] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:16.775292  5274 raft_consensus.cc:2393] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 7: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:16.775027  8005 raft_consensus.cc:515] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:16.775812  5274 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34674 (request call id 2020) took 2436 ms (client timeout 2360 ms). Trace:
W20260709 12:14:16.556681  5265 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34674 (request call id 1985) took 7778 ms (client timeout 1885 ms). Trace:
W20260709 12:14:16.776156  5274 rpcz_store.cc:269] 0709 12:14:14.339297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.499176 (+2159879us) service_pool.cc:224] Handling call
0709 12:14:16.775748 (+276572us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:16.572341  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:16.777233  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:16.777666  7878 raft_consensus.cc:515] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:16.572598  5192 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.260s	user 0.018s	sys 0.029s
I20260709 12:14:16.779829  7878 leader_election.cc:290] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:16.780433  7878 raft_consensus.cc:2749] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:16.781395  5195 raft_consensus.cc:2393] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 5: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:16.782802  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:16.777366  8152 raft_consensus.cc:515] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:16.776424  5265 rpcz_store.cc:269] 0709 12:14:08.780165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:08.862177 (+ 82012us) service_pool.cc:224] Handling call
0709 12:14:16.556447 (+7694270us) spinlock_profiling.cc:243] Waited 4.89 s on lock 0x7b54000f8a54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:16.556573 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11241277696}
I20260709 12:14:16.584456  8024 raft_consensus.cc:493] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.785013  8024 raft_consensus.cc:515] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:16.586166  5196 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.194s	user 0.009s	sys 0.023s
W20260709 12:14:16.786602  5196 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.394s	user 0.009s	sys 0.023s
I20260709 12:14:16.787508  5196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47728 (request call id 1991) took 2433 ms. Trace:
I20260709 12:14:16.787353  7866 raft_consensus.cc:515] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:16.589725  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:16.789980  5123 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40386 (request call id 1774) took 2412 ms (client timeout 1984 ms). Trace:
W20260709 12:14:16.790445  5123 rpcz_store.cc:269] 0709 12:14:14.377067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:14.377483 (+   416us) service_pool.cc:224] Handling call
0709 12:14:16.789866 (+2412383us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:16.591300  5119 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40402 (request call id 2030) took 4516 ms (client timeout 3243 ms). Trace:
W20260709 12:14:16.791399  5119 rpcz_store.cc:269] 0709 12:14:12.075148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:12.075287 (+   139us) service_pool.cc:224] Handling call
0709 12:14:16.591049 (+4515762us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b540009ced4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:16.591206 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2664395136}
I20260709 12:14:16.592247  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:16.792284  7647 leader_election.cc:290] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:16.792835  5121 raft_consensus.cc:2468] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 6.
W20260709 12:14:16.593883  5163 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 2.224s	user 0.025s	sys 0.017s
W20260709 12:14:16.793991  5163 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 2.424s	user 0.026s	sys 0.017s
W20260709 12:14:16.794370  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 2.42417e+06us
W20260709 12:14:16.795627  5163 leader_election.cc:336] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 1.724s (SENT)
I20260709 12:14:16.796088  5163 leader_election.cc:304] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:16.619443  7713 leader_election.cc:290] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:16.627251  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:16.797713  5274 raft_consensus.cc:1240] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:16.798071  5269 raft_consensus.cc:2393] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 6: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:16.798362  5274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34674 (request call id 2014) took 2489 ms. Trace:
W20260709 12:14:16.635558  5804 connection.cc:256] RPC call timeout handler was delayed by -4.2146069200000511s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1877s for a response
I20260709 12:14:16.636633  8010 leader_election.cc:290] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:16.798753  5269 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34674 (request call id 2019) took 2459 ms (client timeout 1967 ms). Trace:
I20260709 12:14:16.799311  8010 raft_consensus.cc:2749] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:16.799495  8030 raft_consensus.cc:493] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:16.647667  5273 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50932 (request call id 572) took 2833 ms (client timeout 1786 ms). Trace:
I20260709 12:14:16.799695  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:16.650573  8053 raft_consensus.cc:493] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:16.665987  8057 leader_election.cc:290] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:16.668066  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:16.670202  8051 consensus_queue.cc:1048] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:16.671659  8118 consensus_queue.cc:1048] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:16.672143  5088 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
W20260709 12:14:16.799237  5804 connection.cc:256] RPC call timeout handler was delayed by -3.4865202529999806s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1569s for a response
W20260709 12:14:16.801165  5804 connection.cc:256] RPC call timeout handler was delayed by -3.3434069200000067s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.28450000000000003s for a response
I20260709 12:14:16.671572  7973 consensus_queue.cc:1048] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 12:14:16.682022  8158 raft_consensus.cc:493] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:14.367923  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:16.697973  8157 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:16.802121  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:16.699115  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:16.803004  5120 raft_consensus.cc:2410] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:14:16.699380  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:16.800724  5271 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34674 (request call id 2016) took 2491 ms (client timeout 1896 ms). Trace:
I20260709 12:14:16.803755  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:16.804214  5191 raft_consensus.cc:2410] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:14:16.699952  8061 raft_consensus.cc:493] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
W20260709 12:14:16.713312  8083 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 12:14:16.804435  8158 raft_consensus.cc:515] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:16.804947  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:16.805794  8061 raft_consensus.cc:515] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:16.714002  5266 raft_consensus.cc:2393] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 8: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:14.394821  5267 raft_consensus.cc:2393] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 6: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
W20260709 12:14:16.807224  5266 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34672 (request call id 1888) took 2466 ms (client timeout 2749 ms). Trace:
W20260709 12:14:16.807334  5267 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34672 (request call id 1884) took 2467 ms (client timeout 1969 ms). Trace:
W20260709 12:14:16.713472  5240 connection.cc:256] RPC call timeout handler was delayed by -1.0770851489999131s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1774s for a response
I20260709 12:14:16.802064  5199 raft_consensus.cc:2468] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 8.
I20260709 12:14:16.701412  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:16.722231  5164 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.212.132:43539 timed out after 1.589s (SENT) [suppressed 27 similar messages]
W20260709 12:14:16.803968  5271 rpcz_store.cc:269] 0709 12:14:14.309018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:14.353186 (+ 44168us) service_pool.cc:224] Handling call
0709 12:14:16.667921 (+2314735us) spinlock_profiling.cc:243] Waited 4.4 ms on lock 0x7b5800190b98. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9ee9c 00007f84e3a9ea5b 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb890a0 00007f84ebb88984 00007f84e51036d4 00007f84e5103662
0709 12:14:16.800655 (+132734us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10123008}
W20260709 12:14:16.808735  5199 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47728 (request call id 1990) took 2455 ms (client timeout 1752 ms). Trace:
I20260709 12:14:16.808157  8051 raft_consensus.cc:2749] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:16.783545  5125 raft_consensus.cc:3060] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:16.808673  5198 raft_consensus.cc:2393] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 6: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:16.800057  8030 raft_consensus.cc:515] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:16.572842  8079 raft_consensus.cc:493] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:16.810143  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
W20260709 12:14:16.809108  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 86893.8us
W20260709 12:14:16.800060  5273 rpcz_store.cc:269] 0709 12:14:13.814524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:13.859187 (+ 44663us) service_pool.cc:224] Handling call
0709 12:14:16.647420 (+2788233us) spinlock_profiling.cc:243] Waited 75.9 ms on lock 0x7b54001036d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:16.647564 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":174630784}
W20260709 12:14:16.800225  5192 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.488s	user 0.019s	sys 0.030s
I20260709 12:14:16.811288  5118 raft_consensus.cc:2468] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 3.
I20260709 12:14:16.811681  5192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47728 (request call id 1975) took 5326 ms. Trace:
W20260709 12:14:16.808001  5240 connection.cc:256] RPC call timeout handler was delayed by -1.0446851490000881s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18100000000000002s for a response
I20260709 12:14:16.808068  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:16.801870  8053 raft_consensus.cc:515] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:16.813441  5240 leader_election.cc:304] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:16.701426  5237 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:14:16.807756  5267 rpcz_store.cc:269] 0709 12:14:14.339987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:14.363336 (+ 23349us) service_pool.cc:224] Handling call
0709 12:14:16.807268 (+2443932us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:16.814800  5271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34674 (request call id 2017) took 2505 ms. Trace:
W20260709 12:14:16.708119  5272 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34672 (request call id 1885) took 2367 ms (client timeout 1590 ms). Trace:
I20260709 12:14:16.815452  5198 raft_consensus.cc:3060] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:16.815474  7713 raft_consensus.cc:2764] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 12:14:16.809222  5199 rpcz_store.cc:269] 0709 12:14:14.353702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:14.367603 (+ 13901us) service_pool.cc:224] Handling call
0709 12:14:16.808653 (+2441050us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:16.810451  8079 raft_consensus.cc:515] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:16.816984  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:16.818120  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:16.818646  5199 raft_consensus.cc:2468] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 7.
I20260709 12:14:16.819427  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
W20260709 12:14:16.801487  5804 connection.cc:256] RPC call timeout handler was delayed by -3.2426253929997984s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1786s for a response
W20260709 12:14:16.820513  5804 connection.cc:256] RPC call timeout handler was delayed by -3.19582539299995s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18380000000000002s for a response
W20260709 12:14:16.820974  5804 connection.cc:256] RPC call timeout handler was delayed by -2.926720252999985s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2191s for a response
W20260709 12:14:16.821262  5804 connection.cc:256] RPC call timeout handler was delayed by -2.9123253929999464s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21530000000000002s for a response
W20260709 12:14:16.807655  5266 rpcz_store.cc:269] 0709 12:14:14.341363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.712524 (+2371161us) service_pool.cc:224] Handling call
0709 12:14:16.807151 (+ 94627us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:16.799175  5269 rpcz_store.cc:269] 0709 12:14:14.339046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:14.356726 (+ 17680us) service_pool.cc:224] Handling call
0709 12:14:16.627071 (+2270345us) spinlock_profiling.cc:243] Waited 5.65 ms on lock 0x7b5800190b98. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb890a0 00007f84ebb88984 00007f84e51036d4 00007f84e5103662
0709 12:14:16.798538 (+171467us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12993792}
I20260709 12:14:16.816432  7713 raft_consensus.cc:2749] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:14:16.820189  5272 rpcz_store.cc:269] 0709 12:14:14.340219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:14.348439 (+  8220us) service_pool.cc:224] Handling call
0709 12:14:16.708028 (+2359589us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:16.815171  5273 raft_consensus.cc:1240] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:16.823544  5273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34674 (request call id 2021) took 2484 ms. Trace:
I20260709 12:14:16.823848  5273 rpcz_store.cc:276] 0709 12:14:14.339523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.814714 (+2475191us) service_pool.cc:224] Handling call
0709 12:14:16.814996 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:16.823311 (+  8315us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.823493 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:16.782820  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:16.828308  5195 raft_consensus.cc:2468] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 7.
I20260709 12:14:16.829241  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:16.829859  5195 raft_consensus.cc:2468] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:14:16.830626  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:16.831167  5195 raft_consensus.cc:2468] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 6.
I20260709 12:14:16.832010  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:16.832535  5195 raft_consensus.cc:2468] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 5.
I20260709 12:14:16.787972  5196 rpcz_store.cc:276] 0709 12:14:14.354052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:14.369114 (+ 15062us) service_pool.cc:224] Handling call
0709 12:14:14.371713 (+  2599us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:14.372055 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:14.372083 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:14.392017 (+ 19934us) log.cc:844] Serialized 26 byte log entry
0709 12:14:16.787120 (+2395103us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:16.787167 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.787242 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:16.787289 (+    47us) raft_consensus.cc:1685] finished
0709 12:14:16.787301 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:16.787447 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2148138,"raft.queue_time_us":2536,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":3315,"thread_start_us":2394651,"threads_started":1,"wal-append.queue_time_us":94379,"wal-append.run_cpu_time_us":1735,"wal-append.run_wall_time_us":1001753}
I20260709 12:14:16.833526  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:16.833602  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:16.834301  5122 raft_consensus.cc:2468] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 4.
I20260709 12:14:16.836230  5122 raft_consensus.cc:1275] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:16.815124  5271 rpcz_store.cc:276] 0709 12:14:14.309250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.813955 (+2504705us) service_pool.cc:224] Handling call
0709 12:14:16.814288 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:16.814486 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:16.814510 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:16.814553 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:16.814586 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.814647 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:16.814749 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:16.812109  5192 rpcz_store.cc:276] 0709 12:14:11.485113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:11.485255 (+   142us) service_pool.cc:224] Handling call
0709 12:14:11.488134 (+  2879us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:11.488325 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:14:11.842146 (+353821us) log.cc:844] Serialized 14 byte log entry
0709 12:14:14.292618 (+2450472us) log.cc:844] Serialized 14 byte log entry
0709 12:14:14.311812 (+ 19194us) log.cc:844] Serialized 14 byte log entry
0709 12:14:16.811277 (+2499465us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:16.811335 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:16.811389 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.811463 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:16.811586 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1979452,"prepare.queue_time_us":214700,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":2000987,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":261,"thread_start_us":2972074,"threads_started":3,"wal-append.queue_time_us":1623333,"wal-append.run_cpu_time_us":2743,"wal-append.run_wall_time_us":1839066}
I20260709 12:14:16.822467  5266 raft_consensus.cc:1275] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:14:16.845800  5266 pending_rounds.cc:85] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929: Aborting all ops after (but not including) 5
I20260709 12:14:16.846069  5266 pending_rounds.cc:107] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:14:16.846292  5266 raft_consensus.cc:2889] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:16.847064  5266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34672 (request call id 1889) took 2505 ms. Trace:
I20260709 12:14:16.847379  5266 rpcz_store.cc:276] 0709 12:14:14.341726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.821882 (+2480156us) service_pool.cc:224] Handling call
0709 12:14:16.822161 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:16.846760 (+ 24599us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.846997 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:16.854230  5804 connection.cc:256] RPC call timeout handler was delayed by -2.9042202529999486s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22160000000000002s for a response
I20260709 12:14:16.855643  5837 raft_consensus.cc:1240] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:16.858023  5835 raft_consensus.cc:1275] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:14:16.860093  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:16.860999  5835 raft_consensus.cc:2410] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:14:16.861765  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:16.862540  5837 raft_consensus.cc:2468] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 7.
I20260709 12:14:16.873260  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:16.874203  5837 raft_consensus.cc:2410] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:14:16.771416  5270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34672 (request call id 1886) took 2431 ms. Trace:
I20260709 12:14:16.878916  5270 rpcz_store.cc:276] 0709 12:14:14.340506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.767023 (+2426517us) service_pool.cc:224] Handling call
0709 12:14:16.771357 (+  4334us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:16.798759  5274 rpcz_store.cc:276] 0709 12:14:14.308535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.797054 (+2488519us) service_pool.cc:224] Handling call
0709 12:14:16.797446 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:16.798105 (+   659us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.798306 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:16.905254  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 163859us
W20260709 12:14:16.917505  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 104151us
I20260709 12:14:16.918207  8079 leader_election.cc:290] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:16.918934  7870 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:16.919261  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 123656us
W20260709 12:14:16.919652  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 155470us
I20260709 12:14:16.768537  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:14:16.921983  5163 leader_election.cc:336] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 1.853s (SENT)
I20260709 12:14:16.922150  5268 raft_consensus.cc:2393] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 5: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:16.922698  5268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34672 (request call id 1887) took 2581 ms. Trace:
I20260709 12:14:16.922624  8010 raft_consensus.cc:493] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:16.923301  5268 rpcz_store.cc:276] 0709 12:14:14.340854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.768275 (+2427421us) service_pool.cc:224] Handling call
0709 12:14:16.922635 (+154360us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:16.923437  8010 raft_consensus.cc:515] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:16.925123  8061 leader_election.cc:290] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:16.774376  8042 raft_consensus.cc:515] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:16.925860  8010 leader_election.cc:290] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:16.926066  8157 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:16.926014  5200 raft_consensus.cc:3060] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:16.926594  8005 leader_election.cc:290] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:16.927016  8158 leader_election.cc:290] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:16.927711  8042 leader_election.cc:290] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:16.928918  8030 leader_election.cc:290] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:16.929570  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:16.930052  8024 leader_election.cc:290] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:16.930233  5122 raft_consensus.cc:2468] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 6.
I20260709 12:14:16.931335  8152 leader_election.cc:290] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:16.931754  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:16.932983  8053 leader_election.cc:290] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:16.933353  5200 raft_consensus.cc:2468] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 7.
I20260709 12:14:16.934185  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:16.936277  5118 raft_consensus.cc:1275] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:14:16.937608  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
W20260709 12:14:16.938120  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 266037us
I20260709 12:14:16.770048  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:16.937762  5267 raft_consensus.cc:1275] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:14:16.939139  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:16.939703  5118 raft_consensus.cc:2468] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 5.
W20260709 12:14:16.939950  5200 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47728 (request call id 1996) took 2564 ms (client timeout 1808 ms). Trace:
W20260709 12:14:16.940899  5200 rpcz_store.cc:269] 0709 12:14:14.375652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:14.375786 (+   134us) service_pool.cc:224] Handling call
0709 12:14:16.939794 (+2564008us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b54001388d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:16.939886 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":521661312}
I20260709 12:14:16.939703  5267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34674 (request call id 2022) took 2600 ms. Trace:
I20260709 12:14:16.943392  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:16.933509  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:16.820120  5199 raft_consensus.cc:2393] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 8: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:16.944175  5834 raft_consensus.cc:2468] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 6.
I20260709 12:14:16.943729  5267 rpcz_store.cc:276] 0709 12:14:14.339757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.815001 (+2475244us) service_pool.cc:224] Handling call
0709 12:14:16.937451 (+122450us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:16.939473 (+  2022us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:16.939646 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:16.918102  5054 debug-util.cc:398] Leaking SignalData structure 0x7b08003b0ce0 after lost signal to thread 5862
W20260709 12:14:16.937659  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 236347us
I20260709 12:14:16.945128  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:14:16.945217  5054 debug-util.cc:398] Leaking SignalData structure 0x7b08003f2e40 after lost signal to thread 7971
I20260709 12:14:16.945734  5834 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 4.
W20260709 12:14:16.946475  5054 debug-util.cc:398] Leaking SignalData structure 0x7b080026aca0 after lost signal to thread 8076
I20260709 12:14:16.951282  5193 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 8.
W20260709 12:14:16.922573  5023 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33896 (request call id 319) took 17354 ms (client timeout 15000 ms). Trace:
I20260709 12:14:16.962268  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:16.773664  7849 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:16.963927  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:16.964547  5197 raft_consensus.cc:3060] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:16.963945  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:16.965883  5830 raft_consensus.cc:2393] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 8: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:16.966742  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:16.967919  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:16.968489  5830 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 6.
I20260709 12:14:16.969781  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:16.970067  5830 raft_consensus.cc:1240] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:16.970911  7849 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:16.971532  7866 leader_election.cc:290] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:16.974068  5197 raft_consensus.cc:2468] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 10.
I20260709 12:14:16.952785  5163 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:16.953944  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:16.955315  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:16.955852  5237 leader_election.cc:304] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:16.976631  5198 raft_consensus.cc:2468] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 8.
I20260709 12:14:16.976917  5237 leader_election.cc:304] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:16.921370  7886 leader_election.cc:290] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:16.957006  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:16.772745  5019 catalog_manager.cc:5697] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 1 to 3, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 3 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:16.938771  7644 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:16.958253  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:16.991460  5829 raft_consensus.cc:2410] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:14:16.958580  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:16.959260  5836 raft_consensus.cc:1275] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:14:16.992166  5237 leader_election.cc:304] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:16.992756  5838 raft_consensus.cc:2410] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:14:16.958168  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:16.959230  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:16.959959  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:16.924993  7976 leader_election.cc:290] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:16.993634  5831 raft_consensus.cc:3060] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:16.994005  5833 raft_consensus.cc:2468] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 7.
I20260709 12:14:16.994097  5837 raft_consensus.cc:2468] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 7.
I20260709 12:14:16.975337  5835 raft_consensus.cc:2468] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 5.
I20260709 12:14:16.982245  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:17.028834  5832 raft_consensus.cc:2468] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 4.
W20260709 12:14:16.962195  5023 rpcz_store.cc:269] 0709 12:13:59.567801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:59.568072 (+   271us) service_pool.cc:224] Handling call
0709 12:14:16.922484 (+17354412us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:10.596620 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:10.665868 (+ 69248us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:10.665926 (+    58us) write_op.cc:435] Acquired schema lock
0709 12:14:10.665954 (+    28us) tablet.cc:662] Decoding operations
0709 12:14:10.667118 (+  1164us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:10.667198 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:10.667224 (+    26us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:14:10.668364 (+  1140us) tablet.cc:701] Row locks acquired
0709 12:14:10.668407 (+    43us) write_op.cc:260] PREPARE: finished
0709 12:14:10.668677 (+   270us) write_op.cc:270] Start()
0709 12:14:10.668829 (+   152us) write_op.cc:276] Timestamp: P: 1783599250668508 usec, L: 0
0709 12:14:10.668845 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 12:14:10.767093 (+ 98248us) log.cc:844] Serialized 5492 byte log entry
0709 12:14:11.967467 (+1200374us) op_driver.cc:464] REPLICATION: finished
0709 12:14:13.345438 (+1377971us) write_op.cc:301] APPLY: starting
0709 12:14:13.372739 (+ 27301us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:13.447819 (+ 75080us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:13.465979 (+ 18160us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:13.580726 (+114747us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:13.581075 (+   349us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 12:14:13.581128 (+    53us) write_op.cc:312] APPLY: finished
0709 12:14:13.624906 (+ 43778us) log.cc:844] Serialized 95 byte log entry
0709 12:14:13.637938 (+ 13032us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:13.638083 (+   145us) write_op.cc:454] Released schema lock
0709 12:14:13.638155 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:13.638578 (+   423us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:13.638614 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":903239,"reported_tablets":31,"spinlock_wait_cycles":1408,"child_traces":[["op",{"apply.queue_time_us":1343760,"apply.run_cpu_time_us":12316,"apply.run_wall_time_us":312482,"num_ops":13,"prepare.queue_time_us":751709,"prepare.run_cpu_time_us":13584,"prepare.run_wall_time_us":497436,"raft.queue_time_us":759255,"raft.run_cpu_time_us":48404,"raft.run_wall_time_us":1466055,"replication_time_us":1298411,"thread_start_us":2599164,"threads_started":5,"wal-append.queue_time_us":675146,"wal-append.run_cpu_time_us":26630,"wal-append.run_wall_time_us":2610869}]]}
I20260709 12:14:16.983016  5193 raft_consensus.cc:1240] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:14:16.987833  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:16.987859  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:16.988926  7980 raft_consensus.cc:2804] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:16.989266  8151 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:16.989946  5019 catalog_manager.cc:5697] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:17.049118  5197 raft_consensus.cc:1240] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:14:16.990661  5195 raft_consensus.cc:1275] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:14:16.938863  5088 leader_election.cc:304] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:17.011866  5240 leader_election.cc:304] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:17.027558  5125 raft_consensus.cc:2468] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 8.
W20260709 12:14:17.006645  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 86218.8us
I20260709 12:14:17.018313  7823 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:17.057660  7823 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:17.019054  5124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40386 (request call id 1763) took 3362 ms. Trace:
I20260709 12:14:17.019722  5191 raft_consensus.cc:2468] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
I20260709 12:14:17.022783  7849 raft_consensus.cc:2749] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:17.062189  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:17.063015  5838 raft_consensus.cc:2410] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:14:17.061230  5124 rpcz_store.cc:276] 0709 12:14:13.656669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:13.656782 (+   113us) service_pool.cc:224] Handling call
0709 12:14:13.664650 (+  7868us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:13.665042 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:13.665071 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:13.847602 (+182531us) log.cc:844] Serialized 26 byte log entry
0709 12:14:14.168456 (+320854us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:16.750017 (+2581561us) log.cc:844] Serialized 14 byte log entry
0709 12:14:17.018190 (+268173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:17.018794 (+   604us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:17.018843 (+    49us) raft_consensus.cc:1685] finished
0709 12:14:17.018853 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:17.018986 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":22650,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":705,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":178,"spinlock_wait_cycles":36096,"thread_start_us":3032506,"threads_started":3,"wal-append.queue_time_us":612296,"wal-append.run_cpu_time_us":1671,"wal-append.run_wall_time_us":1001694}
I20260709 12:14:17.065321  5831 raft_consensus.cc:2468] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 8.
I20260709 12:14:17.024860  7878 raft_consensus.cc:2804] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:14:17.020426  5801 connection.cc:256] RPC call timeout handler was delayed by -1.5639025859998128s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.164s for a response
W20260709 12:14:17.013002  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 91042.7us
I20260709 12:14:16.993561  8024 raft_consensus.cc:2749] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:16.993278  5237 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:17.036454  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:17.072846  5833 raft_consensus.cc:2468] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 5.
I20260709 12:14:17.020188  5194 raft_consensus.cc:2468] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
W20260709 12:14:17.029439  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 269635us
I20260709 12:14:17.045742  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:17.055532  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:14:17.054793  5238 leader_election.cc:336] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Timed out: RequestConsensusVote RPC to 127.3.212.132:43539 timed out after 1.787s (SENT)
I20260709 12:14:17.050285  7976 raft_consensus.cc:2749] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:14:17.056931  7713 raft_consensus.cc:2749] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:17.057099  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 118339us
I20260709 12:14:17.067482  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:14:17.070359  5801 connection.cc:256] RPC call timeout handler was delayed by -1.5486025860000154s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16570000000000001s for a response
W20260709 12:14:17.079377  5801 connection.cc:256] RPC call timeout handler was delayed by -1.4325025859998277s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1786s for a response
W20260709 12:14:17.079704  5801 connection.cc:256] RPC call timeout handler was delayed by -1.3857025859999794s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18380000000000002s for a response
W20260709 12:14:17.070665  5163 leader_election.cc:336] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 1.894s (SENT)
I20260709 12:14:17.074468  5832 raft_consensus.cc:2468] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 6.
W20260709 12:14:17.079975  5801 connection.cc:256] RPC call timeout handler was delayed by -1.2120025859999259s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20310000000000003s for a response
I20260709 12:14:17.074841  5238 leader_election.cc:304] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
W20260709 12:14:17.080298  5801 connection.cc:256] RPC call timeout handler was delayed by -1.2120025859999259s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20310000000000003s for a response
W20260709 12:14:17.073630  5089 connection.cc:256] RPC call timeout handler was delayed by -1.2490062059998763s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17820000000000003s for a response
I20260709 12:14:17.056169  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:17.075706  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 82499us
I20260709 12:14:17.078843  5240 leader_election.cc:304] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:17.081370  5237 leader_election.cc:304] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:17.073833  5837 raft_consensus.cc:2468] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 7.
W20260709 12:14:17.080578  5801 connection.cc:256] RPC call timeout handler was delayed by -1.0680025859999205s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2191s for a response
I20260709 12:14:17.081485  5163 leader_election.cc:304] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:17.082546  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:17.083029  5163 leader_election.cc:336] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 1.957s (SENT)
I20260709 12:14:17.083469  5163 leader_election.cc:304] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:17.085422  5197 raft_consensus.cc:1275] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:14:17.085865  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:17.036607  7980 raft_consensus.cc:493] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:17.091389  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:17.092042  5238 leader_election.cc:336] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Timed out: RequestConsensusVote RPC to 127.3.212.132:43539 timed out after 1.969s (SENT)
I20260709 12:14:16.960471  8152 consensus_queue.cc:1048] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.080s
I20260709 12:14:17.089275  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:17.092484  5238 leader_election.cc:304] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:17.092839  5838 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:17.086647  5195 raft_consensus.cc:2393] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 5: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:17.094806  5163 leader_election.cc:304] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:17.096026  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:17.096705  5124 raft_consensus.cc:2468] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 8.
I20260709 12:14:17.097606  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:17.097736  5237 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:17.098004  8128 raft_consensus.cc:2749] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:17.098361  5118 raft_consensus.cc:2393] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 6: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:17.098878  5237 leader_election.cc:304] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:17.099329  7823 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:17.100417  5237 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:17.098670  8128 raft_consensus.cc:2804] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:17.070150  7878 raft_consensus.cc:493] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:17.108918  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:17.099908  8130 raft_consensus.cc:2804] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:17.110422  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:17.112465  5192 raft_consensus.cc:2468] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 5.
I20260709 12:14:17.107964  7647 raft_consensus.cc:2749] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:17.114935  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:17.115640  5237 leader_election.cc:304] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:17.116118  5837 raft_consensus.cc:1240] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:17.116269  5192 raft_consensus.cc:2468] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 9.
I20260709 12:14:17.114909  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:17.116794  5237 leader_election.cc:304] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:17.117738  5195 raft_consensus.cc:2468] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 5.
I20260709 12:14:17.117885  5835 raft_consensus.cc:2393] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 10: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:17.100142  7980 raft_consensus.cc:3060] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:17.093593  8083 raft_consensus.cc:2804] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:17.107443  7886 raft_consensus.cc:2749] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:17.134833  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:17.125547  8175 raft_consensus.cc:2749] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:17.181356  8175 raft_consensus.cc:2804] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:17.181825  8175 raft_consensus.cc:493] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:17.182152  8175 raft_consensus.cc:3060] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:17.126075  5801 leader_election.cc:336] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 1.966s (SENT)
I20260709 12:14:17.183920  7805 raft_consensus.cc:2804] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:14:17.184242  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 58199.7us
I20260709 12:14:17.131726  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:17.185658  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:17.186269  5192 raft_consensus.cc:2468] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 7.
I20260709 12:14:17.186873  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:17.187239  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:17.187593  5832 raft_consensus.cc:2393] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 7: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:17.188097  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:17.188439  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:17.189025  5831 raft_consensus.cc:3060] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:17.189797  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:14:17.190017  8164 log.cc:927] Time spent T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:14:17.190433  5834 raft_consensus.cc:2468] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 5.
I20260709 12:14:17.191351  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:17.192117  5830 raft_consensus.cc:2393] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 5: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:17.193068  5192 raft_consensus.cc:2393] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 5: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:17.108940  8128 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:17.145845  5802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:17.196635  5802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:17.121394  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:17.112522  7878 raft_consensus.cc:3060] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:17.202006  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:17.204263  5088 connection.cc:256] RPC call timeout handler was delayed by -1.9517657970000073s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16890000000000002s for a response
W20260709 12:14:17.204756  5088 connection.cc:256] RPC call timeout handler was delayed by -1.8662657969998691s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1784s for a response
W20260709 12:14:17.205044  5088 connection.cc:256] RPC call timeout handler was delayed by -1.7654657969999334s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1896s for a response
W20260709 12:14:17.205313  5088 connection.cc:256] RPC call timeout handler was delayed by -1.7015657970000575s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1967s for a response
W20260709 12:14:17.205646  5088 connection.cc:256] RPC call timeout handler was delayed by -1.7015657970000575s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1967s for a response
W20260709 12:14:17.206048  5088 connection.cc:256] RPC call timeout handler was delayed by -1.6493657969999731s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2025s for a response
W20260709 12:14:17.206327  5088 connection.cc:256] RPC call timeout handler was delayed by -1.559365797000055s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21250000000000002s for a response
W20260709 12:14:17.206594  5088 connection.cc:256] RPC call timeout handler was delayed by -1.5008657969999604s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.219s for a response
W20260709 12:14:17.206862  5088 connection.cc:256] RPC call timeout handler was delayed by -1.5008657969999604s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.219s for a response
W20260709 12:14:17.207139  5088 connection.cc:256] RPC call timeout handler was delayed by -1.3478657969999404s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.236s for a response
I20260709 12:14:17.211408  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:17.212270  5829 raft_consensus.cc:2393] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 6: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:17.213450  5193 raft_consensus.cc:1240] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:14:17.133005  8083 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:17.110112  8042 raft_consensus.cc:2804] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:17.194087  5832 raft_consensus.cc:2955] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:14:17.225240  5088 leader_election.cc:304] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:14:17.225100  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:17.227182  5836 raft_consensus.cc:2393] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 8: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:17.178005  5122 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
new_leader_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:45628
W20260709 12:14:17.227614  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:17.227752  5122 raft_consensus.cc:606] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Received request to transfer leadership to TS 9e794b72ed7640219f90ec4232363929
I20260709 12:14:17.184393  7805 raft_consensus.cc:493] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:17.109901  7849 consensus_queue.cc:1048] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.083s
I20260709 12:14:17.110414  7644 consensus_queue.cc:1059] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.083s
I20260709 12:14:17.193740  5833 raft_consensus.cc:1240] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 12:14:17.131913  5238 leader_election.cc:336] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Timed out: RequestConsensusVote RPC to 127.3.212.132:43539 timed out after 2.175s (SENT)
I20260709 12:14:17.108254  8121 raft_consensus.cc:2804] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:17.194895  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:17.233248  5238 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:17.233544  5196 raft_consensus.cc:2468] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 4.
I20260709 12:14:17.182170  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:17.233981  5838 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 5.
W20260709 12:14:17.234269  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 102384us
I20260709 12:14:17.234470  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:17.235304  5831 raft_consensus.cc:2468] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 7.
I20260709 12:14:17.236099  5833 raft_consensus.cc:2410] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:14:17.194638  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:17.197767  5195 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 6.
I20260709 12:14:17.107450  5163 leader_election.cc:304] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:17.200551  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:17.212119  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:17.221700  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:17.238586  5192 raft_consensus.cc:2468] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
I20260709 12:14:17.201362  8128 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:17.229401  5802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:17.230180  8130 raft_consensus.cc:697] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 8 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:17.238061  5837 raft_consensus.cc:2410] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:14:17.242470  5835 raft_consensus.cc:2393] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 6: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:17.195617  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:17.243263  7976 raft_consensus.cc:2804] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:17.239008  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:17.212419  8069 raft_consensus.cc:493] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.245002  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:17.246649  8042 raft_consensus.cc:697] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:17.247210  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:17.247759  5804 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:17.248032  8008 raft_consensus.cc:2749] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:17.248205  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:17.248481  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:17.304618  5838 raft_consensus.cc:2468] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 6.
I20260709 12:14:17.232299  7973 raft_consensus.cc:493] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.249325  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:17.306067  5829 raft_consensus.cc:2410] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:14:17.239319  7713 raft_consensus.cc:493] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.232362  8083 raft_consensus.cc:3060] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:17.237205  8151 raft_consensus.cc:2749] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:17.237568  7805 raft_consensus.cc:3060] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:17.260548  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:17.263892  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:17.314073  5836 raft_consensus.cc:3060] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:17.314184  5831 raft_consensus.cc:2468] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 4.
I20260709 12:14:17.243304  8121 raft_consensus.cc:493] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:17.177356  8174 raft_consensus.cc:2749] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:17.242853  5801 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
W20260709 12:14:17.304782  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 57099.2us
I20260709 12:14:17.292351  7647 raft_consensus.cc:3055] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:17.312628  7973 raft_consensus.cc:515] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:17.293131  7976 raft_consensus.cc:493] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:17.321241  7976 raft_consensus.cc:3060] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:17.321808  8042 consensus_queue.cc:237] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:17.317934  7647 raft_consensus.cc:740] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:17.312942  8160 raft_consensus.cc:2804] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:17.315946  8121 raft_consensus.cc:3060] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:17.321205  7866 raft_consensus.cc:2804] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:17.306077  8069 raft_consensus.cc:515] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:17.328081  8130 consensus_queue.cc:237] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:17.335107  8069 leader_election.cc:290] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:17.337852  7980 raft_consensus.cc:515] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:17.340051  7980 leader_election.cc:290] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:17.340265  8128 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:17.341178  8083 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:17.343591  8083 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:17.333280  7973 leader_election.cc:290] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:17.345461  8175 raft_consensus.cc:515] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:17.346180  7976 raft_consensus.cc:515] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:17.347585  8175 leader_election.cc:290] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:17.326787  8160 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:17.348596  8160 raft_consensus.cc:3060] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:17.349220  8121 raft_consensus.cc:515] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:17.351593  8121 leader_election.cc:290] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:17.348093  7976 leader_election.cc:290] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:17.388347  5019 catalog_manager.cc:5697] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:17.394224  5088 leader_election.cc:304] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:14:17.396785  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 156689us
I20260709 12:14:17.398967  5088 leader_election.cc:304] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:17.401026  5088 leader_election.cc:304] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:17.254669  5116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40386 (request call id 1773) took 2885 ms. Trace:
I20260709 12:14:17.404839  5116 rpcz_store.cc:276] 0709 12:14:14.369707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:14.370102 (+   395us) service_pool.cc:224] Handling call
0709 12:14:16.607848 (+2237746us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:16.819677 (+211829us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:14:16.996933 (+177256us) log.cc:844] Serialized 14 byte log entry
0709 12:14:17.236764 (+239831us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:17.236823 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:17.236866 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:17.254438 (+ 17572us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b540039e4d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:17.254485 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:17.254610 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24501,"prepare.queue_time_us":167370,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":27313,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":3075,"spinlock_wait_cycles":486647040,"thread_start_us":377096,"threads_started":2,"wal-append.queue_time_us":297863}
W20260709 12:14:17.414284  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:17.414674  8189 raft_consensus.cc:2749] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:14:17.415035  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:17.416097  8189 raft_consensus.cc:2804] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:14:17.416460  5089 leader_election.cc:336] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Timed out: RequestConsensusVote RPC to 127.3.212.132:43539 timed out after 1.782s (SENT)
I20260709 12:14:17.417212  5089 leader_election.cc:304] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
W20260709 12:14:17.420321  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:17.247717  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 140345us
W20260709 12:14:17.271755  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 171861us
I20260709 12:14:17.273651  5272 raft_consensus.cc:1240] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
W20260709 12:14:17.319766  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 78404.6us
I20260709 12:14:17.318758  5804 leader_election.cc:304] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:14:17.416631  8189 raft_consensus.cc:493] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:17.306118  5830 raft_consensus.cc:2376] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 7. Re-sending same reply.
I20260709 12:14:17.428627  7973 raft_consensus.cc:2804] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:17.431915  8051 consensus_queue.cc:1059] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:17.485488  8051 raft_consensus.cc:3055] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:17.486105  8051 raft_consensus.cc:740] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:17.487782  8051 consensus_queue.cc:260] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:17.432451  7823 consensus_queue.cc:1048] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:14:17.434257  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 317396us
I20260709 12:14:17.434669  8053 raft_consensus.cc:2749] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:17.314015  7713 raft_consensus.cc:515] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:17.451704  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:17.541839  5269 raft_consensus.cc:3060] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:17.542222  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:17.543532  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:17.453141  5272 raft_consensus.cc:1240] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 5. Current term is 6. Ops: []
W20260709 12:14:17.454594  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 50823.4us
I20260709 12:14:17.471792  5267 raft_consensus.cc:2368] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 6. Current term is 7.
I20260709 12:14:17.472458  5197 raft_consensus.cc:1240] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 LEADER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:17.473084  5268 raft_consensus.cc:2368] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 6. Current term is 7.
I20260709 12:14:17.494246  8128 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:17.537827  5116 raft_consensus.cc:1240] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:17.537935  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:17.538341  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:17.538934  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:17.539690  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:17.483844  7973 raft_consensus.cc:697] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:17.540045  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:17.490494  7647 consensus_queue.cc:260] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:17.484110  5274 raft_consensus.cc:2393] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 5: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:17.329878  7878 raft_consensus.cc:515] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:17.329192  7866 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:17.491026  8189 raft_consensus.cc:3060] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:17.547014  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:17.547421  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 83886.6us
I20260709 12:14:17.550436  5088 leader_election.cc:304] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
W20260709 12:14:17.552419  5007 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet c7bb7b814fea4a2488cc39d06fc90483 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica dd62e75bd3ed4ed28f1fb5955d650808 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:14:17.557745  5121 raft_consensus.cc:2468] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 5.
I20260709 12:14:17.558094  5120 raft_consensus.cc:2393] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 3: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:17.558219  7973 consensus_queue.cc:237] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:17.560159  7713 leader_election.cc:290] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:17.561249  7866 raft_consensus.cc:3060] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:17.562718  5270 raft_consensus.cc:1240] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:17.555481  5267 raft_consensus.cc:1240] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:14:17.570776  5123 raft_consensus.cc:2468] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 6.
I20260709 12:14:17.563593  7878 leader_election.cc:290] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:17.575161  8053 raft_consensus.cc:2804] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:17.578289  8053 raft_consensus.cc:697] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:17.579252  5237 leader_election.cc:304] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:17.579733  5088 leader_election.cc:304] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:17.579959  8053 consensus_queue.cc:237] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:17.576931  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 75342.9us
I20260709 12:14:17.583535  5240 leader_election.cc:304] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:17.584322  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:17.585893  8174 raft_consensus.cc:2804] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:17.586396  8174 raft_consensus.cc:493] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:17.586472  8130 raft_consensus.cc:2804] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:17.586810  8174 raft_consensus.cc:3060] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:17.590538  8069 raft_consensus.cc:2804] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:17.591226  8069 raft_consensus.cc:697] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:17.592074  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:17.593992  8136 raft_consensus.cc:2749] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:17.594143  8130 raft_consensus.cc:697] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 7 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:17.592520  8069 consensus_queue.cc:237] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:17.604456  8194 raft_consensus.cc:2804] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:17.605727  8194 raft_consensus.cc:493] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:17.606940  8194 raft_consensus.cc:3060] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:17.607062  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:17.607796  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:17.609741  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:17.607946  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:17.595541  8130 consensus_queue.cc:237] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:17.608970  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:17.609241  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:17.608125  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:17.620319  5122 raft_consensus.cc:2393] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 5: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:17.623541  8160 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:17.629769  8160 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:17.632043  8128 raft_consensus.cc:493] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:17.632674  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:17.633539  5122 raft_consensus.cc:2468] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 3.
I20260709 12:14:17.615115  8051 raft_consensus.cc:3060] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:17.634316  5120 raft_consensus.cc:2468] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 5.
I20260709 12:14:17.632884  8128 raft_consensus.cc:515] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:17.635030  8136 raft_consensus.cc:493] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.635568  8136 raft_consensus.cc:515] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:17.634527  5265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34674 (request call id 2010) took 3307 ms. Trace:
I20260709 12:14:17.637315  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:17.636505  5265 rpcz_store.cc:276] 0709 12:14:14.306882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:16.784628 (+2477746us) service_pool.cc:224] Handling call
0709 12:14:16.785001 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:16.785485 (+   484us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:14:17.061118 (+275633us) log.cc:844] Serialized 14 byte log entry
0709 12:14:17.489609 (+428491us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:17.589664 (+100055us) log.cc:844] Serialized 26 byte log entry
0709 12:14:17.591803 (+  2139us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:17.592144 (+   341us) log.cc:844] Serialized 14 byte log entry
0709 12:14:17.593611 (+  1467us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:17.597100 (+  3489us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:17.597149 (+    49us) raft_consensus.cc:1685] finished
0709 12:14:17.597161 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:17.614126 (+ 16965us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28713,"prepare.queue_time_us":305251,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":86,"raft.queue_time_us":109700,"raft.run_cpu_time_us":354,"raft.run_wall_time_us":4272,"thread_start_us":635599,"threads_started":2,"wal-append.queue_time_us":253783}
I20260709 12:14:17.638962  5121 raft_consensus.cc:1240] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:17.640295  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:17.641238  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:17.646026  5269 raft_consensus.cc:2468] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
W20260709 12:14:17.647500  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 50260.6us
I20260709 12:14:17.658531  8128 leader_election.cc:290] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:17.658916  8191 consensus_queue.cc:1048] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:17.640594  8136 leader_election.cc:290] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:17.651336  5163 leader_election.cc:304] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
W20260709 12:14:17.662302  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 58805.4us
I20260709 12:14:17.663035  7805 raft_consensus.cc:515] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:17.663719  8008 raft_consensus.cc:2804] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:17.664400  8008 raft_consensus.cc:697] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:17.664513  5163 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:17.665664  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:17.665596  8008 consensus_queue.cc:237] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:17.666097  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 348294us
I20260709 12:14:17.668807  5804 leader_election.cc:304] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:17.672640  5836 raft_consensus.cc:2468] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 8.
I20260709 12:14:17.673319  7805 leader_election.cc:290] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:17.671365  8188 raft_consensus.cc:2955] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:14:17.674520  5088 leader_election.cc:304] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:17.675734  8079 consensus_queue.cc:1059] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:17.676820  8079 raft_consensus.cc:2804] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:17.679371  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:17.681111  5125 raft_consensus.cc:2410] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:14:17.682716  8160 raft_consensus.cc:2749] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:17.683486  8042 raft_consensus.cc:2804] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:17.684203  8042 raft_consensus.cc:697] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:17.677219  8079 raft_consensus.cc:493] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:17.685621  8079 raft_consensus.cc:3060] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:17.682771  7849 consensus_queue.cc:1048] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
W20260709 12:14:17.687932  5802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:17.692148  5192 raft_consensus.cc:1275] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:14:17.695312  8191 raft_consensus.cc:3055] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:17.695845  8191 raft_consensus.cc:740] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:17.696933  8191 consensus_queue.cc:260] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:17.698678  8191 raft_consensus.cc:3060] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:17.700867  5166 leader_election.cc:304] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:17.702821  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:17.707471  5192 raft_consensus.cc:2468] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 2.
I20260709 12:14:17.707890  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:17.708593  5197 raft_consensus.cc:3060] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:14:17.708846  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:17.707325  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:17.713323  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:17.714676  5199 raft_consensus.cc:2468] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 8.
I20260709 12:14:17.718194  8010 consensus_queue.cc:1048] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:14:17.718204  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 49536us
I20260709 12:14:17.722476  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:17.723428  5240 leader_election.cc:304] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:17.725725  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:17.726449  5122 raft_consensus.cc:3060] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:17.726756  8136 raft_consensus.cc:2804] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:14:17.727185  8136 raft_consensus.cc:493] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:17.727519  8136 raft_consensus.cc:3060] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:17.728622  5163 leader_election.cc:304] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:17.729301  5119 raft_consensus.cc:2410] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:14:17.730224  5163 leader_election.cc:304] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:17.731050  7849 raft_consensus.cc:2749] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:17.725737  8195 consensus_queue.cc:1048] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:14:17.731982  8042 consensus_queue.cc:237] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:17.728856  5801 leader_election.cc:304] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:17.733669  7647 raft_consensus.cc:3060] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:17.734741  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 193734us
I20260709 12:14:17.731838  7849 raft_consensus.cc:3060] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:17.749003  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:17.734874  7644 raft_consensus.cc:3060] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:17.750155  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:17.728785  8128 consensus_queue.cc:1059] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 12:14:17.753057  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:17.754603  5804 leader_election.cc:304] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:14:17.755188  8197 log.cc:927] Time spent T 00000000000000000000000000000000 P 221aa011207d421b9725197ff8bed389: Append to log took a long time: real 0.143s	user 0.004s	sys 0.000s
I20260709 12:14:17.750809  8174 raft_consensus.cc:515] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:17.761687  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:17.762154  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:17.763154  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:17.764343  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:17.765326  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:17.767339  5270 raft_consensus.cc:1240] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:17.767485  5272 raft_consensus.cc:1240] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:17.773392  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:17.773845  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:17.774451  5200 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:17.716010  7866 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:17.781246  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
W20260709 12:14:17.781490  5237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:17.780803  5195 raft_consensus.cc:3060] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:17.769438  8195 raft_consensus.cc:2749] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:17.786679  5801 leader_election.cc:304] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:17.790689  8160 raft_consensus.cc:2749] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:17.794366  5194 raft_consensus.cc:1275] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:17.795600  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:17.800868  7823 raft_consensus.cc:493] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.787681  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:17.796995  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:17.805908  7976 raft_consensus.cc:493] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.806711  7976 raft_consensus.cc:515] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:17.772670  8051 raft_consensus.cc:493] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:17.817253  5199 raft_consensus.cc:2468] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 4.
I20260709 12:14:17.817831  5269 raft_consensus.cc:2410] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for term 9 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:14:17.813228  5197 raft_consensus.cc:2468] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 8.
I20260709 12:14:17.814230  5191 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 8.
I20260709 12:14:17.809126  7976 leader_election.cc:290] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:17.828660  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 98659us
W20260709 12:14:17.831934  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 77479.3us
I20260709 12:14:17.834096  8051 raft_consensus.cc:515] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:17.819638  8053 consensus_queue.cc:1059] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:14:17.837538  8118 consensus_queue.cc:1048] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 12:14:17.838394  8118 consensus_queue.cc:1243] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer 9e794b72ed7640219f90ec4232363929 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:14:17.839174  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:17.840867  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:17.841913  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:17.842635  5122 raft_consensus.cc:2468] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 8.
I20260709 12:14:17.843366  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:17.827926  7878 raft_consensus.cc:493] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:17.845577  5267 raft_consensus.cc:1240] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:17.846771  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:17.847442  5267 raft_consensus.cc:2468] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 6.
I20260709 12:14:17.848409  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:17.849114  5801 leader_election.cc:304] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:17.849543  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:17.850426  5268 raft_consensus.cc:2393] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 5: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
W20260709 12:14:17.851122  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 61565.5us
I20260709 12:14:17.852191  5240 leader_election.cc:304] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:17.853822  7805 raft_consensus.cc:2804] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:17.854357  7805 raft_consensus.cc:697] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 8 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:17.850256  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:17.844771  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:17.846930  5194 raft_consensus.cc:1240] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 12:14:17.849068  5267 raft_consensus.cc:2468] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 4.
I20260709 12:14:17.785614  8010 consensus_queue.cc:1059] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:14:17.858541  5200 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 7.
I20260709 12:14:17.864426  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:17.844808  7878 raft_consensus.cc:515] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:17.863667  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:17.879231  5272 raft_consensus.cc:2468] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 9.
I20260709 12:14:17.880760  5166 leader_election.cc:304] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:17.881563  7823 raft_consensus.cc:515] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:17.884337  7823 leader_election.cc:290] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:17.885524  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:17.858000  8128 raft_consensus.cc:3055] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:17.888208  5237 leader_election.cc:304] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:17.861320  8160 raft_consensus.cc:2804] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:17.859539  8051 leader_election.cc:290] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:17.906832  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 57901.8us
I20260709 12:14:17.907768  5804 leader_election.cc:304] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:14:17.909672  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:17.831117  8194 raft_consensus.cc:515] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:17.860292  8079 raft_consensus.cc:515] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:17.917423  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:17.919909  5196 raft_consensus.cc:2468] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 6.
I20260709 12:14:17.921079  8118 raft_consensus.cc:993] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821: : Instructing follower 9e794b72ed7640219f90ec4232363929 to start an election
I20260709 12:14:17.921808  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:17.893064  8128 raft_consensus.cc:740] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:17.902354  8160 raft_consensus.cc:493] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:17.855391  7805 consensus_queue.cc:237] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:17.943534  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:17.944810  8053 raft_consensus.cc:1081] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Signalling peer 9e794b72ed7640219f90ec4232363929 to start an election
I20260709 12:14:17.938973  8160 raft_consensus.cc:3060] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:17.946956  8008 raft_consensus.cc:2804] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:17.947430  8008 raft_consensus.cc:493] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:17.947769  8008 raft_consensus.cc:3060] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:17.948093  8128 consensus_queue.cc:260] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:17.949419  8128 raft_consensus.cc:3060] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:17.951216  7644 raft_consensus.cc:2749] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:17.952018  7980 raft_consensus.cc:2749] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:17.952874  5198 raft_consensus.cc:2393] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 5: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:17.892400  7973 consensus_queue.cc:1059] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 12:14:17.954731  5166 leader_election.cc:304] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
W20260709 12:14:17.954905  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 66799.9us
I20260709 12:14:17.955003  8053 raft_consensus.cc:3055] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:17.955466  8053 raft_consensus.cc:740] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:17.955003  8174 leader_election.cc:290] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:17.956452  5237 leader_election.cc:304] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:17.957255  8174 raft_consensus.cc:2749] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:17.953642  5195 raft_consensus.cc:2468] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
W20260709 12:14:17.970350  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 135735us
I20260709 12:14:17.987707  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:17.987924  5266 raft_consensus.cc:2468] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 5.
I20260709 12:14:17.956492  8079 leader_election.cc:290] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:17.994867  8205 log.cc:927] Time spent T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.073s	user 0.000s	sys 0.004s
I20260709 12:14:17.995697  5122 raft_consensus.cc:2468] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 8.
I20260709 12:14:17.993214  5801 leader_election.cc:304] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:18.001446  8053 consensus_queue.cc:260] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:18.002276  8189 raft_consensus.cc:515] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:18.002842  8053 raft_consensus.cc:3060] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:18.004171  8194 leader_election.cc:290] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:17.991060  7878 leader_election.cc:290] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:17.993419  7644 raft_consensus.cc:2804] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:18.011559  5088 leader_election.cc:400] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709) with higher term. Message: Invalid argument: T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 6. Current term is 7.
I20260709 12:14:17.993557  7866 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:18.018838  8209 raft_consensus.cc:2804] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:18.019450  8209 raft_consensus.cc:493] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:18.019810  8209 raft_consensus.cc:3060] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:18.014115  7849 raft_consensus.cc:2749] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:18.026402  8216 raft_consensus.cc:2804] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:18.026986  8216 raft_consensus.cc:493] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:18.027388  8216 raft_consensus.cc:3060] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:18.027148  8008 raft_consensus.cc:515] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:18.018597  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 54056.5us
I20260709 12:14:18.044822  5118 raft_consensus.cc:2393] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 7: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
W20260709 12:14:18.047991  5091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:18.050510  5166 leader_election.cc:304] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:18.052526  7647 raft_consensus.cc:2804] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:18.052955  7647 raft_consensus.cc:493] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:18.053330  7647 raft_consensus.cc:3060] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:18.060607  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:18.061762  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:18.062609  5265 raft_consensus.cc:2393] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 7: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:18.064277  8189 leader_election.cc:290] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:18.013523  7644 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:18.065150  7644 raft_consensus.cc:3060] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:18.066807  8210 log.cc:927] Time spent T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 12:14:18.070405  7976 raft_consensus.cc:3055] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:18.070855  7866 raft_consensus.cc:2804] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:18.071307  7866 raft_consensus.cc:493] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:18.071673  7866 raft_consensus.cc:3060] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:18.061512  5266 raft_consensus.cc:1240] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:18.076206  5240 leader_election.cc:304] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:18.064208  8160 raft_consensus.cc:515] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:18.079558  8160 leader_election.cc:290] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:18.085177  5237 leader_election.cc:304] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:18.085359  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:14:18.098937  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:18.101444  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 108349us
I20260709 12:14:18.102305  5088 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:18.102936  5118 raft_consensus.cc:1240] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:18.087226  8174 raft_consensus.cc:2804] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:18.103902  8174 raft_consensus.cc:493] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:18.104264  8174 raft_consensus.cc:3060] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:18.105518  5119 raft_consensus.cc:1275] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:14:18.107589  8069 raft_consensus.cc:2749] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:18.102173  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:18.112687  5270 raft_consensus.cc:2468] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 4.
W20260709 12:14:18.071334  8203 log.cc:927] Time spent T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.113s	user 0.003s	sys 0.001s
I20260709 12:14:18.114200  5237 leader_election.cc:304] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:18.115499  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:18.116080  8024 raft_consensus.cc:2749] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:14:18.116714  8130 consensus_queue.cc:1048] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:14:18.115895  5164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:18.103426  5088 leader_election.cc:400] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709) with higher term. Message: Invalid argument: T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 6. Current term is 7.
I20260709 12:14:18.115514  5237 leader_election.cc:304] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:18.123793  8136 raft_consensus.cc:515] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:18.126344  8136 leader_election.cc:290] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:18.116799  7980 raft_consensus.cc:2749] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:18.130353  8209 raft_consensus.cc:515] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:18.130709  8218 consensus_queue.cc:1059] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:18.132081  8218 raft_consensus.cc:3055] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:18.132458  8218 raft_consensus.cc:740] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:18.134301  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:18.135635  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:18.136997  5118 raft_consensus.cc:3060] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:18.094441  8008 leader_election.cc:290] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:18.139334  8209 leader_election.cc:290] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:18.140892  8216 raft_consensus.cc:515] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:18.141444  8218 consensus_queue.cc:260] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:18.142830  8218 raft_consensus.cc:3060] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:18.143177  7866 raft_consensus.cc:515] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:18.145700  5266 raft_consensus.cc:2468] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 6.
I20260709 12:14:18.180811  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:18.149242  8216 leader_election.cc:290] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:18.113282  7647 raft_consensus.cc:515] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:18.149683  5118 raft_consensus.cc:2468] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 4.
I20260709 12:14:18.151607  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:18.184805  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:18.185422  5123 raft_consensus.cc:3060] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:18.185629  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:18.186337  7647 leader_election.cc:290] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:18.151800  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:18.187191  5270 raft_consensus.cc:2368] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 3. Current term is 4.
I20260709 12:14:18.152347  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:14:18.153659  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 50370.5us
I20260709 12:14:18.070904  7976 raft_consensus.cc:740] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
W20260709 12:14:18.154512  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 254638us
I20260709 12:14:18.155145  5199 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0"
dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
mode: GRACEFUL
new_leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
 from {username='slave'} at 127.0.0.1:53902
I20260709 12:14:18.155679  5163 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:18.138571  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:18.210517  5122 raft_consensus.cc:2393] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 6: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:18.165782  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:18.158802  7878 raft_consensus.cc:2749] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:14:18.169802  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 54281.1us
I20260709 12:14:18.171129  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:18.222604  5272 raft_consensus.cc:2393] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 8: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:18.171897  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:18.172431  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:18.173748  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:18.223824  5274 raft_consensus.cc:2393] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 4: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:18.174440  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:18.208590  5199 raft_consensus.cc:606] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Received request to transfer leadership to TS ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:18.185457  5266 raft_consensus.cc:2468] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 6.
I20260709 12:14:18.224292  5199 raft_consensus.cc:614] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:18.207854  5240 leader_election.cc:304] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:18.211094  5265 raft_consensus.cc:2468] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 4.
I20260709 12:14:18.228785  8218 raft_consensus.cc:2749] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:18.229147  7866 leader_election.cc:290] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:18.229319  7976 consensus_queue.cc:260] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:18.229990  5273 raft_consensus.cc:1240] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:14:18.229684  8195 consensus_queue.cc:1048] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:18.231355  5267 raft_consensus.cc:2393] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 5: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:18.231073  8174 raft_consensus.cc:515] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:18.233650  5237 leader_election.cc:304] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:18.233968  7976 raft_consensus.cc:3060] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:18.234545  8174 leader_election.cc:290] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:18.234699  5237 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:18.235136  8174 raft_consensus.cc:2804] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:18.235567  7713 raft_consensus.cc:2749] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:18.236038  5237 leader_election.cc:304] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:18.236811  7713 raft_consensus.cc:2749] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:18.237092  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
W20260709 12:14:18.237681  5164 leader_election.cc:336] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Timed out: RequestConsensusVote RPC to 127.3.212.132:43539 timed out after 1.528s (SENT)
I20260709 12:14:18.237500  7713 consensus_queue.cc:1059] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:14:18.238817  7713 raft_consensus.cc:3055] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:18.239390  8189 consensus_queue.cc:1059] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:18.239207  7713 raft_consensus.cc:740] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:18.241107  5088 leader_election.cc:304] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:18.241984  8191 raft_consensus.cc:2804] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:18.242565  8191 raft_consensus.cc:697] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:18.241819  7713 consensus_queue.cc:260] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:18.243866  7713 raft_consensus.cc:3060] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:18.243562  8191 consensus_queue.cc:237] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:18.237776  5122 raft_consensus.cc:3060] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:18.249928  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 94324us
I20260709 12:14:18.251696  5237 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:18.252679  5123 raft_consensus.cc:2468] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 6.
W20260709 12:14:18.253439  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 282608us
W20260709 12:14:18.257890  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:18.257697  5804 leader_election.cc:304] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:14:18.235545  8174 raft_consensus.cc:493] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:18.259369  8174 raft_consensus.cc:3060] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:18.259554  5166 leader_election.cc:304] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:18.259694  5163 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:18.240489  8189 raft_consensus.cc:3055] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:18.261114  5237 leader_election.cc:304] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:18.264038  7878 raft_consensus.cc:2804] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:18.264703  7647 raft_consensus.cc:2804] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:18.268579  7647 raft_consensus.cc:697] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:18.267939  5122 raft_consensus.cc:2468] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 9.
I20260709 12:14:18.269726  7647 consensus_queue.cc:237] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:18.270323  5240 leader_election.cc:304] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:18.271337  8130 raft_consensus.cc:2804] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:18.271888  8130 raft_consensus.cc:697] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 9 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:18.272879  8130 consensus_queue.cc:237] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:18.265512  8128 raft_consensus.cc:3060] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:18.276552  5123 raft_consensus.cc:1275] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 12:14:18.247427  7980 raft_consensus.cc:2804] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:18.277213  5123 pending_rounds.cc:85] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting all ops after (but not including) 3
I20260709 12:14:18.267961  5237 leader_election.cc:304] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:18.264635  8195 raft_consensus.cc:2804] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:18.277606  5123 pending_rounds.cc:107] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:14:18.281168  5801 leader_election.cc:304] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:18.282284  5123 raft_consensus.cc:2889] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:18.263434  8189 raft_consensus.cc:740] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:18.264652  7878 raft_consensus.cc:697] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 7 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:18.281069  8217 raft_consensus.cc:2749] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:18.292125  5163 leader_election.cc:304] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:18.298166  5199 raft_consensus.cc:1240] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:18.282115  8195 raft_consensus.cc:493] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:18.302362  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:18.304168  7644 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:18.318614  5200 raft_consensus.cc:3060] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:18.308763  5197 raft_consensus.cc:1275] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:14:18.312642  5237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:18.287703  7980 raft_consensus.cc:697] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [term 4 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:18.327522  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:18.328176  5196 raft_consensus.cc:3060] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:14:18.330564  5194 raft_consensus.cc:1275] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:18.287374  8079 consensus_queue.cc:1059] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
W20260709 12:14:18.334375  5237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:18.319660  8195 raft_consensus.cc:3060] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:18.342459  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 57487.1us
I20260709 12:14:18.325970  8008 raft_consensus.cc:2749] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:18.344349  5269 raft_consensus.cc:1240] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 8 LEADER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:18.343812  7805 consensus_queue.cc:1048] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:14:18.347395  5163 leader_election.cc:304] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:18.319725  8218 consensus_queue.cc:1059] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:14:18.364073  5163 leader_election.cc:304] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:18.349519  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:18.365191  5265 raft_consensus.cc:2393] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 6: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:18.355376  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:18.355593  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:18.356235  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:18.357811  7980 consensus_queue.cc:237] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:18.359759  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:18.362953  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:18.360217  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:18.360896  5836 raft_consensus.cc:1240] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:18.361934  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:18.361714  8189 consensus_queue.cc:260] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:18.362542  8042 raft_consensus.cc:3055] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:18.371114  5266 raft_consensus.cc:2368] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 8. Current term is 9.
I20260709 12:14:18.371495  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:18.335542  7849 consensus_queue.cc:1048] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:14:18.337574  7866 consensus_queue.cc:1048] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:14:18.376754  5801 leader_election.cc:304] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:18.347190  8079 consensus_queue.cc:1243] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer 9e794b72ed7640219f90ec4232363929 log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:14:18.374866  5194 raft_consensus.cc:2393] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 6: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
W20260709 12:14:18.375450  5088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:18.379822  5199 raft_consensus.cc:2468] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
I20260709 12:14:18.380460  5191 raft_consensus.cc:1240] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:18.382306  5200 raft_consensus.cc:2468] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 9.
I20260709 12:14:18.383008  5195 raft_consensus.cc:1240] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:18.376206  5267 raft_consensus.cc:2468] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 7.
I20260709 12:14:18.379602  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:18.384199  5274 raft_consensus.cc:2468] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
I20260709 12:14:18.385154  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:18.386307  5164 leader_election.cc:336] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Timed out: RequestConsensusVote RPC to 127.3.212.132:43539 timed out after 1.665s (SENT)
I20260709 12:14:18.386754  5164 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:18.369204  8010 raft_consensus.cc:2804] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:18.385735  5193 raft_consensus.cc:2468] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
I20260709 12:14:18.393054  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:18.370702  8042 raft_consensus.cc:740] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:18.395864  5272 raft_consensus.cc:2393] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 7: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:18.376001  8212 consensus_queue.cc:1059] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.101s
I20260709 12:14:18.394699  5832 raft_consensus.cc:2468] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:14:18.376051  8223 raft_consensus.cc:2804] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:18.392652  8010 raft_consensus.cc:493] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:18.410717  5272 raft_consensus.cc:1240] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:18.398518  5273 raft_consensus.cc:2468] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
I20260709 12:14:18.370895  8024 consensus_queue.cc:1048] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:14:18.415259  5274 raft_consensus.cc:1275] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:14:18.394887  8008 raft_consensus.cc:2764] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:14:18.396503  8178 raft_consensus.cc:2804] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:18.362778  7878 consensus_queue.cc:237] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:18.399080  8218 raft_consensus.cc:2749] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:18.412499  8212 consensus_queue.cc:1243] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer 9e794b72ed7640219f90ec4232363929 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:14:18.398895  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:18.411691  8223 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:18.408699  5267 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:34674
W20260709 12:14:18.427392  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 63421.4us
I20260709 12:14:18.419668  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:18.424494  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:18.412452  8189 raft_consensus.cc:3060] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:18.436709  5267 raft_consensus.cc:493] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:18.437189  5267 raft_consensus.cc:3060] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:18.416090  8010 raft_consensus.cc:3060] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:18.426704  5237 leader_election.cc:304] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:18.434773  5163 leader_election.cc:304] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:18.421479  8178 raft_consensus.cc:493] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:18.503726  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 51694.6us
W20260709 12:14:18.504242  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 82437.4us
I20260709 12:14:18.421818  8188 consensus_queue.cc:1048] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.024s
W20260709 12:14:18.511518  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:18.433007  7644 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:18.437878  8223 raft_consensus.cc:3060] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:18.510778  5801 leader_election.cc:304] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:18.547341  5088 leader_election.cc:304] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:14:18.519109  5829 raft_consensus.cc:1240] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:18.519325  5832 raft_consensus.cc:1240] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:18.445236  7805 raft_consensus.cc:2804] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:18.446233  8218 raft_consensus.cc:2749] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:18.433915  8191 consensus_queue.cc:1048] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
W20260709 12:14:18.557583  5091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:18.561689  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:18.575014  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 148063us
I20260709 12:14:18.510918  8178 raft_consensus.cc:3060] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:18.581616  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 146892us
W20260709 12:14:18.583401  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 72704.6us
I20260709 12:14:18.570420  7805 raft_consensus.cc:697] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 9 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:18.606357  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:18.607883  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:18.575529  8118 raft_consensus.cc:2804] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:18.616022  5163 leader_election.cc:400] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709) with higher term. Message: Invalid argument: T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 3. Current term is 4.
I20260709 12:14:18.616844  5163 leader_election.cc:403] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:14:18.626407  5829 raft_consensus.cc:2393] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 7: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:18.625618  8221 raft_consensus.cc:2804] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:18.629293  8221 raft_consensus.cc:493] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:18.629719  8221 raft_consensus.cc:3060] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:18.630177  8069 raft_consensus.cc:3055] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:18.630577  8069 raft_consensus.cc:740] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:18.633095  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
W20260709 12:14:18.635001  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 48254.6us
I20260709 12:14:18.621668  7866 raft_consensus.cc:2804] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:18.651914  5163 leader_election.cc:304] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:18.658378  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:18.658571  8211 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
W20260709 12:14:18.661813  5164 leader_election.cc:336] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Timed out: RequestConsensusVote RPC to 127.3.212.132:43539 timed out after 1.589s (SENT)
I20260709 12:14:18.663866  5832 raft_consensus.cc:2393] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 5: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:18.669986  5829 raft_consensus.cc:1240] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:18.651273  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:14:18.684105  8230 log.cc:927] Time spent T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
W20260709 12:14:18.685913  8228 log.cc:927] Time spent T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 12:14:18.651108  7866 raft_consensus.cc:493] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:18.690244  5166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:18.691655  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:18.695936  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:18.653843  8118 raft_consensus.cc:697] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:18.695192  5196 raft_consensus.cc:2468] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 4.
I20260709 12:14:18.663273  7647 raft_consensus.cc:2749] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:18.660742  8211 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:18.710270  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:18.692713  8130 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:18.711619  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 75225.9us
I20260709 12:14:18.698874  7866 raft_consensus.cc:3060] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:18.720949  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:18.714797  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 53015.8us
I20260709 12:14:18.716400  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:18.629293  7805 consensus_queue.cc:237] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:18.726114  5830 raft_consensus.cc:2393] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 6: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:18.725359  5163 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:18.733227  5836 raft_consensus.cc:1275] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:14:18.736331  5836 raft_consensus.cc:1240] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:18.706715  8218 raft_consensus.cc:2749] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709) with higher term. Message: Invalid argument: T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 3. Current term is 4.
W20260709 12:14:18.737905  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 155038us
I20260709 12:14:18.742702  7647 raft_consensus.cc:2749] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:18.742791  5163 leader_election.cc:304] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:18.745558  5835 raft_consensus.cc:1240] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:18.747910  8118 consensus_queue.cc:237] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:18.749516  8227 log.cc:927] Time spent T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.285s	user 0.001s	sys 0.000s
W20260709 12:14:18.751030  8233 log.cc:927] Time spent T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 12:14:18.752640  8174 raft_consensus.cc:515] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:18.753083  8211 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:18.761483  8226 log.cc:927] Time spent T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.263s	user 0.000s	sys 0.001s
I20260709 12:14:18.761510  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:18.712378  8069 consensus_queue.cc:260] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:18.766928  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:18.767524  7644 raft_consensus.cc:3060] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:18.765645  5267 raft_consensus.cc:515] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:18.771533  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:18.770278  5838 raft_consensus.cc:2468] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
I20260709 12:14:18.774529  5088 leader_election.cc:304] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:18.774776  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:18.772148  5265 raft_consensus.cc:2376] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 8. Re-sending same reply.
I20260709 12:14:18.723964  8130 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:18.777451  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:18.776037  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:18.783514  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:18.783977  5088 leader_election.cc:304] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:18.786190  8053 consensus_queue.cc:1059] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:14:18.787173  8237 raft_consensus.cc:2804] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:18.787678  8237 raft_consensus.cc:493] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:18.788005  8237 raft_consensus.cc:3060] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:18.776268  8236 log.cc:927] Time spent T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:14:18.790261  5831 raft_consensus.cc:1240] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:18.790170  5838 raft_consensus.cc:2393] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 7: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:18.793987  8224 raft_consensus.cc:3055] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:18.794449  8224 raft_consensus.cc:740] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:18.795357  8224 consensus_queue.cc:260] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:18.796639  8224 raft_consensus.cc:3060] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:18.796872  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:18.797547  5833 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:14:18.797724  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:18.798236  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:18.797075  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:18.799129  5195 raft_consensus.cc:2376] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 10. Re-sending same reply.
I20260709 12:14:18.799614  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:18.800647  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:18.802038  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:18.803272  5268 raft_consensus.cc:1240] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 7 LEADER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 6. Current term is 7. Ops: [4.4-6.5]
I20260709 12:14:18.804550  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:18.805189  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:18.805857  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:18.806519  5838 raft_consensus.cc:2468] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 7.
I20260709 12:14:18.806924  8174 leader_election.cc:290] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:18.807384  7644 raft_consensus.cc:2749] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:18.808266  5836 raft_consensus.cc:2468] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 2.
I20260709 12:14:18.808960  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:18.809477  8221 raft_consensus.cc:515] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:18.811556  8221 leader_election.cc:290] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:18.806034  5830 raft_consensus.cc:1240] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:18.809569  5832 raft_consensus.cc:2468] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:14:18.827622  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:18.799084  5191 raft_consensus.cc:2468] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 7.
I20260709 12:14:18.854389  5265 raft_consensus.cc:2410] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:14:18.807327  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:14:18.799434  8231 log.cc:927] Time spent T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.278s	user 0.001s	sys 0.000s
I20260709 12:14:18.856158  5829 raft_consensus.cc:2393] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 9: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:18.808156  7973 raft_consensus.cc:3055] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:14:18.858338  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 74453.4us
I20260709 12:14:18.857416  7878 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:18.865844  5837 raft_consensus.cc:1240] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:18.866119  8189 raft_consensus.cc:2804] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:18.866622  8189 raft_consensus.cc:493] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:18.866959  8189 raft_consensus.cc:3060] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:18.867451  8188 raft_consensus.cc:493] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:18.867956  8188 raft_consensus.cc:515] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:18.866117  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 123557us
I20260709 12:14:18.866892  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:18.813836  7866 raft_consensus.cc:515] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:18.861836  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:18.872139  5273 raft_consensus.cc:3060] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:18.861399  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:18.864846  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:18.873191  5196 raft_consensus.cc:2376] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 8. Re-sending same reply.
I20260709 12:14:18.863732  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:18.889102  5831 raft_consensus.cc:2393] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 6: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:18.899564  8053 raft_consensus.cc:3055] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:18.899905  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:18.900660  8178 raft_consensus.cc:515] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:18.902951  8178 leader_election.cc:290] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:18.905474  5268 raft_consensus.cc:2376] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 6. Re-sending same reply.
W20260709 12:14:18.906767  8128 consensus_meta.cc:287] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.632s	user 0.009s	sys 0.003s
I20260709 12:14:18.907215  8128 raft_consensus.cc:2749] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:18.908133  5272 raft_consensus.cc:1275] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:14:18.884236  7878 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:18.911733  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:18.912525  5119 raft_consensus.cc:2393] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 5: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:18.913450  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:18.914125  5191 raft_consensus.cc:1275] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:14:18.916886  8195 consensus_meta.cc:287] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.572s	user 0.009s	sys 0.000s
I20260709 12:14:18.859882  7973 raft_consensus.cc:740] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:18.900049  8053 raft_consensus.cc:740] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:18.900782  5199 raft_consensus.cc:2393] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 6: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:18.909683  8130 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:14:18.921847  5089 leader_election.cc:336] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Timed out: RequestConsensusVote RPC to 127.3.212.132:43539 timed out after 1.784s (SENT)
I20260709 12:14:18.939484  5089 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:14:19.005762  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 83945.2us
W20260709 12:14:19.005601  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 131127us
I20260709 12:14:18.932848  5274 raft_consensus.cc:1240] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 9 LEADER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:19.008164  5088 leader_election.cc:400] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 election: Vote denied by peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709) with higher term. Message: Invalid argument: T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 8. Current term is 9.
I20260709 12:14:19.007463  5273 raft_consensus.cc:2468] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 6.
W20260709 12:14:19.008705  5238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:19.009100  5088 leader_election.cc:304] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:18.925807  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:18.919972  7866 leader_election.cc:290] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:19.010231  5119 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 6.
W20260709 12:14:18.951444  5166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:18.931345  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:19.008363  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:19.011088  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:19.013401  5196 raft_consensus.cc:3060] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:18.927145  8237 raft_consensus.cc:515] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:19.015756  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:19.016141  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:19.016491  5265 raft_consensus.cc:3060] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:19.017403  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 237790us
I20260709 12:14:19.018671  5197 raft_consensus.cc:2410] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:14:19.019133  5237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:19.027678  5163 leader_election.cc:304] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:19.006163  8211 raft_consensus.cc:3060] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:19.029052  5196 raft_consensus.cc:2468] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 6.
I20260709 12:14:19.031104  5192 raft_consensus.cc:1240] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 6. Current term is 7. Ops: [4.4-6.5]
I20260709 12:14:19.044389  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:19.045117  5199 raft_consensus.cc:3060] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:18.931854  8188 leader_election.cc:290] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:19.021130  8234 raft_consensus.cc:2804] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:14:19.053895  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 44228.4us
I20260709 12:14:19.055876  7849 raft_consensus.cc:2804] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:19.061676  5269 raft_consensus.cc:1240] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:18.933804  8010 raft_consensus.cc:515] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:19.065836  5801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:19.060510  7849 raft_consensus.cc:493] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:19.071134  5164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:19.069352  7849 raft_consensus.cc:3060] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:19.074074  7878 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:18.917325  8223 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:19.074923  5801 leader_election.cc:304] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:19.076696  8223 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:18.933682  8195 raft_consensus.cc:515] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:19.077683  8216 raft_consensus.cc:2749] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:19.079066  8195 leader_election.cc:290] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:19.080442  5091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:19.056888  8234 raft_consensus.cc:493] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:18.923050  8053 consensus_queue.cc:260] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:18.921432  8042 consensus_queue.cc:260] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:19.085224  5801 leader_election.cc:304] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:14:19.086774  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 68550.6us
W20260709 12:14:19.089318  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 60975.3us
I20260709 12:14:19.091542  5801 leader_election.cc:304] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:19.092814  5801 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:19.084800  8247 consensus_queue.cc:1059] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 12:14:19.094075  8247 consensus_queue.cc:1243] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer 9e794b72ed7640219f90ec4232363929 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:14:19.094560  8247 raft_consensus.cc:3055] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:19.094898  8247 raft_consensus.cc:740] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:19.095808  8247 consensus_queue.cc:260] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:19.096953  8247 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:19.092686  8217 consensus_queue.cc:1175] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9e794b72ed7640219f90ec4232363929" responder_term: 6 status { last_received { term: 4 index: 3 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 5. Current term is 6. Ops: [5.4-5.4]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:14:19.087216  8234 raft_consensus.cc:3060] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:19.069804  8130 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:19.110562  5199 raft_consensus.cc:2468] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 6.
I20260709 12:14:19.110749  7866 raft_consensus.cc:2749] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:19.114403  8194 raft_consensus.cc:2749] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:14:19.130302  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 64546us
I20260709 12:14:19.117054  8195 raft_consensus.cc:2804] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:19.114413  8216 consensus_queue.cc:1059] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 12:14:19.105360  8130 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:19.126581  8128 raft_consensus.cc:493] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:19.146672  5238 leader_election.cc:336] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Timed out: RequestConsensusVote RPC to 127.3.212.132:43539 timed out after 1.549s (SENT)
W20260709 12:14:19.113211  8212 consensus_queue.cc:1175] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9e794b72ed7640219f90ec4232363929" responder_term: 6 status { last_received { term: 4 index: 4 } last_committed_idx: 4 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:14:19.137086  8195 raft_consensus.cc:493] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:19.136657  8174 raft_consensus.cc:493] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:19.163097  8195 raft_consensus.cc:3060] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:19.151942  8128 raft_consensus.cc:515] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:19.315977  8128 leader_election.cc:290] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:19.168424  8189 raft_consensus.cc:515] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:19.318046  8189 leader_election.cc:290] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:19.235184  8249 log.cc:927] Time spent T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 12:14:19.200467  8243 consensus_queue.cc:1059] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.089s
I20260709 12:14:19.320024  8243 raft_consensus.cc:3055] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:19.320756  8243 raft_consensus.cc:740] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:19.321635  8243 consensus_queue.cc:260] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:19.322098  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:19.322865  8243 raft_consensus.cc:3060] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:19.324016  8130 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:19.324280  5272 raft_consensus.cc:2955] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:14:19.331907  8069 raft_consensus.cc:3060] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:19.339484  8229 log.cc:927] Time spent T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.820s	user 0.000s	sys 0.003s
I20260709 12:14:19.343802  5271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34672 (request call id 1909) took 1170 ms. Trace:
I20260709 12:14:19.299855  8234 raft_consensus.cc:515] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:19.344235  5271 rpcz_store.cc:276] 0709 12:14:18.173352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.187969 (+ 14617us) service_pool.cc:224] Handling call
0709 12:14:18.188245 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:18.188585 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:18.188611 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:18.188968 (+   357us) log.cc:844] Serialized 26 byte log entry
0709 12:14:18.366293 (+177325us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:18.366333 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:18.366400 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:19.338848 (+972448us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e675e86e 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221 00007f84e67671d9 00007f84e6767169
0709 12:14:19.343378 (+  4530us) raft_consensus.cc:1685] finished
0709 12:14:19.343402 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:19.343682 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":305,"raft.run_cpu_time_us":47,"raft.run_wall_time_us":47,"spinlock_wait_cycles":27055360,"thread_start_us":176958,"threads_started":1,"wal-append.queue_time_us":261174}
I20260709 12:14:19.303929  8211 raft_consensus.cc:2749] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:14:19.305627  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 149817us
I20260709 12:14:19.306627  5265 raft_consensus.cc:2468] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 6.
I20260709 12:14:19.344307  7973 consensus_queue.cc:260] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:19.306736  8174 raft_consensus.cc:515] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:19.307884  7849 raft_consensus.cc:515] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:19.308828  8237 leader_election.cc:290] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:19.312026  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 170905us
W20260709 12:14:19.312515  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 203687us
I20260709 12:14:19.138280  8118 consensus_queue.cc:1048] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 12:14:19.313141  8010 leader_election.cc:290] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:19.316166  5164 leader_election.cc:336] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Timed out: RequestConsensusVote RPC to 127.3.212.132:43539 timed out after 1.937s (SENT)
I20260709 12:14:19.348512  5119 raft_consensus.cc:1275] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:14:19.357342  5163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:19.361981  5164 leader_election.cc:304] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:19.366080  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:19.366784  5199 raft_consensus.cc:3060] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:19.368284  5088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:19.368744  5194 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c"
dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
mode: GRACEFUL
new_leader_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:53902
I20260709 12:14:19.348009  8053 raft_consensus.cc:3060] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:19.371803  5194 raft_consensus.cc:606] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Received request to transfer leadership to TS 9e794b72ed7640219f90ec4232363929
I20260709 12:14:19.376662  5194 raft_consensus.cc:614] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:19.347209  8234 leader_election.cc:290] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:19.371865  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
W20260709 12:14:19.394809  5088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:19.392747  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 76602.6us
I20260709 12:14:19.393620  5192 raft_consensus.cc:3060] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:19.405743  5238 leader_election.cc:336] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Timed out: RequestConsensusVote RPC to 127.3.212.132:43539 timed out after 1.560s (SENT)
I20260709 12:14:19.407723  8010 consensus_queue.cc:1048] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:19.409888  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:19.410528  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:19.412146  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:19.412276  8174 leader_election.cc:290] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:19.414417  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:19.415132  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:19.415866  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:19.417999  5836 raft_consensus.cc:1240] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:19.418648  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:19.443446  5833 raft_consensus.cc:2468] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 7.
W20260709 12:14:19.420816  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:19.446452  8247 raft_consensus.cc:493] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.423605  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:19.446975  8247 raft_consensus.cc:515] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:19.448320  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:19.449128  5837 raft_consensus.cc:2393] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 7: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:19.424717  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
W20260709 12:14:19.425457  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 56019.6us
I20260709 12:14:19.391427  8257 raft_consensus.cc:2749] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:19.417090  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:19.454592  5832 raft_consensus.cc:2393] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 6: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:19.433604  5199 raft_consensus.cc:2468] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:14:19.407665  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:19.438247  5834 raft_consensus.cc:2393] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 6: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:19.455685  5829 raft_consensus.cc:2410] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:14:19.450416  5801 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:19.437219  5831 raft_consensus.cc:2376] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 8. Re-sending same reply.
I20260709 12:14:19.391382  8266 raft_consensus.cc:493] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:19.461738  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:19.461863  8266 raft_consensus.cc:515] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:19.438077  8212 consensus_queue.cc:1059] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:14:19.463100  8195 raft_consensus.cc:515] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:19.435367  7647 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:19.379925  8211 consensus_queue.cc:1048] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 12:14:19.464118  7647 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:19.464633  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:19.465283  5834 raft_consensus.cc:2468] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 5.
I20260709 12:14:19.466008  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:19.466187  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:19.467072  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:19.459175  5122 raft_consensus.cc:1240] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 5. Current term is 6. Ops: [3.6-5.7]
I20260709 12:14:19.459790  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:19.461136  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:19.471853  8195 leader_election.cc:290] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:19.472082  5124 raft_consensus.cc:2393] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 6: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:19.472460  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:19.474047  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:19.474787  5833 raft_consensus.cc:2376] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 7. Re-sending same reply.
I20260709 12:14:19.475630  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:19.476464  5837 raft_consensus.cc:2410] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:14:19.464227  8266 leader_election.cc:290] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:19.450651  8069 consensus_queue.cc:1059] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:14:19.478271  8069 raft_consensus.cc:3055] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:19.478514  5117 raft_consensus.cc:1275] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:14:19.478984  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:19.459424  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:19.463518  8212 raft_consensus.cc:3055] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:19.480675  5830 raft_consensus.cc:2393] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 5: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:19.481086  5118 raft_consensus.cc:1240] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 8. Current term is 9. Ops: [6.8-8.9]
I20260709 12:14:19.484284  5801 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:19.482575  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:19.482818  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:19.483180  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:19.482875  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:19.483866  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:19.492061  5125 raft_consensus.cc:1275] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:19.492540  5831 raft_consensus.cc:2393] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 8: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:19.495042  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:19.495054  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:14:19.495421  5164 leader_election.cc:336] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Timed out: RequestConsensusVote RPC to 127.3.212.132:43539 timed out after 2.136s (SENT)
I20260709 12:14:19.496346  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:19.449131  8247 leader_election.cc:290] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:19.499069  5835 raft_consensus.cc:2468] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 5.
I20260709 12:14:19.501220  5123 raft_consensus.cc:1275] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:14:19.484683  8069 raft_consensus.cc:740] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:19.504493  5124 raft_consensus.cc:1240] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:14:19.506646  5120 raft_consensus.cc:1275] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:14:19.491416  7976 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.507630  7976 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:19.509029  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:19.505301  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:19.505649  5117 raft_consensus.cc:2468] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 7.
I20260709 12:14:19.487201  8212 raft_consensus.cc:740] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:19.506436  7647 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:19.518745  7976 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:19.520900  5274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34674 (request call id 2053) took 1139 ms. Trace:
I20260709 12:14:19.521338  5274 rpcz_store.cc:276] 0709 12:14:18.381164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.439674 (+ 58510us) service_pool.cc:224] Handling call
0709 12:14:18.449405 (+  9731us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:19.013501 (+564096us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:19.520632 (+507131us) spinlock_profiling.cc:243] Waited 483 ms on lock 0x7b54000f8054. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:19.520834 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1111305088}
I20260709 12:14:19.521553  8244 consensus_queue.cc:1048] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:14:19.492265  8195 raft_consensus.cc:2749] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:19.526650  5089 leader_election.cc:304] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:19.527894  5089 leader_election.cc:304] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:19.506300  5831 raft_consensus.cc:1275] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:19.529083  8053 consensus_queue.cc:1059] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:19.513873  7973 raft_consensus.cc:3060] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:19.530014  8053 consensus_queue.cc:1243] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer bce73265e27d4b30a4dcc1e491305088 log is divergent from this leader: its last log entry 4.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:14:19.530964  8191 raft_consensus.cc:2804] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:19.530718  8212 consensus_queue.cc:260] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:19.531350  8191 raft_consensus.cc:493] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:19.531777  8191 raft_consensus.cc:3060] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:19.532058  8212 raft_consensus.cc:3060] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:19.530572  8053 raft_consensus.cc:2749] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:19.533553  8247 raft_consensus.cc:3055] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:19.533965  8247 raft_consensus.cc:740] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:19.534785  8247 consensus_queue.cc:260] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:19.536023  8247 raft_consensus.cc:3060] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:19.536924  8130 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.513581  8069 consensus_queue.cc:260] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:19.537478  8130 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:19.537953  8069 raft_consensus.cc:3060] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:19.538571  8042 raft_consensus.cc:3060] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:19.539320  5237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:19.539767  8130 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:19.544327  8174 consensus_queue.cc:1048] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:19.544840  7878 consensus_queue.cc:1048] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:19.544871  8191 raft_consensus.cc:515] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:19.546037  8178 consensus_queue.cc:1048] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:19.546449  7878 consensus_queue.cc:1048] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:19.547057  7878 consensus_queue.cc:1243] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer ad2f9a1e2f7a45429fa69fd23d09f821 log is divergent from this leader: its last log entry 8.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:14:19.499722  8209 raft_consensus.cc:2749] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:14:19.514689  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 125968us
I20260709 12:14:19.529057  5089 leader_election.cc:304] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:19.557515  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:19.552961  5238 leader_election.cc:336] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Timed out: RequestConsensusVote RPC to 127.3.212.132:43539 timed out after 1.808s (SENT)
I20260709 12:14:19.558202  5196 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 8.
I20260709 12:14:19.560303  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:19.560961  5200 raft_consensus.cc:2468] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:14:19.563623  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:19.564822  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:19.565450  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:19.554968  8191 leader_election.cc:290] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:19.566668  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:19.566290  5194 raft_consensus.cc:1275] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:14:19.553853  5801 leader_election.cc:304] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:19.568431  5267 leader_election.cc:290] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:19.568938  5267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:34674 (request call id 2049) took 1214 ms. Trace:
I20260709 12:14:19.569813  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:19.570171  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:19.570411  5829 raft_consensus.cc:2376] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 8. Re-sending same reply.
I20260709 12:14:19.570602  5831 raft_consensus.cc:3055] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:19.568849  5801 leader_election.cc:304] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:19.570837  5837 raft_consensus.cc:2468] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 7.
I20260709 12:14:19.569664  8278 raft_consensus.cc:2804] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:19.572180  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:19.572420  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:19.572863  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:19.573144  5829 raft_consensus.cc:2393] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 5: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:19.569341  5267 rpcz_store.cc:276] 0709 12:14:18.367698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.390114 (+ 22416us) service_pool.cc:224] Handling call
0709 12:14:19.567293 (+1177179us) spinlock_profiling.cc:243] Waited 3.07 ms on lock 0x7b5400110b54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bbaa3d 00007f84ebb8acd0 00007f84e510f254 00007f84e510f1e2 00007f84e510f111 00007f84e510f08c 00007f84e510e342 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:19.568839 (+  1546us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7060864}
I20260709 12:14:19.574106  5833 raft_consensus.cc:2468] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 10.
W20260709 12:14:19.574213  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 45226.2us
I20260709 12:14:19.574440  5240 leader_election.cc:304] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:19.575838  5801 leader_election.cc:304] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:19.576401  8278 raft_consensus.cc:697] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 6 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:19.576686  8130 raft_consensus.cc:2804] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:19.577086  8130 raft_consensus.cc:493] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:19.577788  8130 raft_consensus.cc:3060] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:19.579195  5195 raft_consensus.cc:1240] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:14:19.577361  8221 raft_consensus.cc:2804] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:19.581692  8221 raft_consensus.cc:697] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 6 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:19.582187  5088 leader_election.cc:304] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:19.582981  8188 raft_consensus.cc:2804] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:19.581588  8211 raft_consensus.cc:2749] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:19.576958  8209 raft_consensus.cc:2804] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:19.584115  8209 raft_consensus.cc:697] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 6 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:19.584456  5089 leader_election.cc:304] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:19.582763  8221 consensus_queue.cc:237] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:19.585098  8209 consensus_queue.cc:237] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:19.585722  5830 raft_consensus.cc:2393] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 5: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:19.569854  8194 raft_consensus.cc:3055] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:19.586889  8194 raft_consensus.cc:740] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:19.583514  8188 raft_consensus.cc:697] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:19.590215  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:19.588620  5838 raft_consensus.cc:2393] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 7: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:19.590981  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:19.591503  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:19.591535  5274 raft_consensus.cc:2393] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 6: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:19.592475  5272 raft_consensus.cc:3060] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:19.593725  8053 consensus_queue.cc:1059] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:19.570947  5831 raft_consensus.cc:740] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:19.594213  8188 consensus_queue.cc:237] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:19.595101  8053 raft_consensus.cc:3055] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:19.595474  8053 raft_consensus.cc:740] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:19.596391  8053 consensus_queue.cc:260] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:19.597503  5266 raft_consensus.cc:2393] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 8: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:19.599488  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:19.602679  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:19.603809  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:19.604660  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:19.605685  5267 raft_consensus.cc:2393] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 5: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:19.607007  5192 raft_consensus.cc:2468] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:14:19.607861  5124 raft_consensus.cc:1217] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[3.2-9.5]   Dedup: 5.3->[7.4-9.5]
I20260709 12:14:19.608358  5124 pending_rounds.cc:85] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting all ops after (but not including) 3
I20260709 12:14:19.608562  5124 pending_rounds.cc:107] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 12:14:19.608783  5124 raft_consensus.cc:2889] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:19.609730  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:19.610332  5119 raft_consensus.cc:3055] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:14:19.610954  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 120753us
I20260709 12:14:19.605495  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:19.610633  5119 raft_consensus.cc:740] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:19.613292  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:19.614171  5830 raft_consensus.cc:2393] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 9: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:19.615142  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:14:19.616132  5166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:19.616539  5801 leader_election.cc:304] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:19.617880  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:19.615823  5088 leader_election.cc:304] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:19.619477  5089 leader_election.cc:304] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:19.621874  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:19.622328  5804 leader_election.cc:304] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:19.619941  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:19.622479  5833 raft_consensus.cc:3060] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:19.623445  5838 raft_consensus.cc:2468] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:14:19.595417  5831 consensus_queue.cc:260] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:19.622285  5198 raft_consensus.cc:1240] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 LEADER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:19.625595  5191 raft_consensus.cc:2393] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 5: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:19.628719  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:19.622862  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:19.549324  7849 leader_election.cc:290] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:19.630147  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 77215.2us
I20260709 12:14:19.587910  8194 consensus_queue.cc:260] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:19.635725  5831 raft_consensus.cc:3060] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:19.642136  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
W20260709 12:14:19.642701  5164 leader_election.cc:336] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Timed out: RequestConsensusVote RPC to 127.3.212.132:43539 timed out after 2.178s (SENT)
I20260709 12:14:19.642949  5197 raft_consensus.cc:3060] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:19.643814  5164 leader_election.cc:304] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:19.629212  5119 consensus_queue.cc:260] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:19.647233  5119 raft_consensus.cc:3060] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:19.650739  5272 raft_consensus.cc:2468] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 10.
I20260709 12:14:19.651875  5089 leader_election.cc:304] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:14:19.647163  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:19.669114  5804 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:14:19.617921  8118 raft_consensus.cc:2749] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:19.685487  5267 raft_consensus.cc:2393] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 7: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:19.684044  5088 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:19.642242  8053 raft_consensus.cc:3060] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:19.693217  7973 consensus_queue.cc:1048] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:14:19.695504  8238 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.696134  8238 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:19.697542  7866 raft_consensus.cc:2804] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:19.698066  7866 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:19.698447  7866 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:19.649550  8216 raft_consensus.cc:2749] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:19.701264  5804 leader_election.cc:304] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:19.668431  5023 catalog_manager.cc:5697] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 5 to 7, leader changed from bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 7 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:14:19.701037  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 79944.4us
W20260709 12:14:19.702309  5164 leader_election.cc:336] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Timed out: RequestConsensusVote RPC to 127.3.212.132:43539 timed out after 2.204s (SENT)
I20260709 12:14:19.702701  5164 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:19.702894  5804 leader_election.cc:304] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:14:19.703809  5019 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50918 (request call id 226) took 19972 ms (client timeout 15000 ms). Trace:
I20260709 12:14:19.649894  8244 raft_consensus.cc:2804] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:14:19.708102  5238 leader_election.cc:336] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Timed out: RequestConsensusVote RPC to 127.3.212.132:43539 timed out after 1.924s (SENT)
I20260709 12:14:19.709734  5238 leader_election.cc:304] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:19.681669  8217 raft_consensus.cc:2749] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:14:19.711210  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 59390.3us
I20260709 12:14:19.713161  8243 raft_consensus.cc:493] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.713742  8243 raft_consensus.cc:515] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:19.715886  8243 leader_election.cc:290] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:19.704270  5019 rpcz_store.cc:269] 0709 12:13:59.731653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:59.731928 (+   275us) service_pool.cc:224] Handling call
0709 12:14:19.703714 (+19971786us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:17.490873 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:17.545344 (+ 54471us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:17.545425 (+    81us) write_op.cc:435] Acquired schema lock
0709 12:14:17.545461 (+    36us) tablet.cc:662] Decoding operations
0709 12:14:17.547296 (+  1835us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:17.547389 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:17.547416 (+    27us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:14:17.547931 (+   515us) tablet.cc:701] Row locks acquired
0709 12:14:17.547984 (+    53us) write_op.cc:260] PREPARE: finished
0709 12:14:17.548221 (+   237us) write_op.cc:270] Start()
0709 12:14:17.548432 (+   211us) write_op.cc:276] Timestamp: P: 1783599257548122 usec, L: 0
0709 12:14:17.548461 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 12:14:17.552028 (+  3567us) log.cc:844] Serialized 1302 byte log entry
0709 12:14:18.005920 (+453892us) op_driver.cc:464] REPLICATION: finished
0709 12:14:18.259450 (+253530us) write_op.cc:301] APPLY: starting
0709 12:14:18.259552 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:18.259712 (+   160us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:18.281021 (+ 21309us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:18.367374 (+ 86353us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:18.408534 (+ 41160us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:14:18.412710 (+  4176us) write_op.cc:312] APPLY: finished
0709 12:14:18.512031 (+ 99321us) log.cc:844] Serialized 35 byte log entry
0709 12:14:18.570860 (+ 58829us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:18.582252 (+ 11392us) write_op.cc:454] Released schema lock
0709 12:14:18.589846 (+  7594us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:18.659585 (+ 69739us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:18.659614 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":120889,"reported_tablets":25,"child_traces":[["op",{"apply.queue_time_us":246208,"apply.run_cpu_time_us":16109,"apply.run_wall_time_us":395020,"num_ops":3,"prepare.queue_time_us":58647,"prepare.run_cpu_time_us":14937,"prepare.run_wall_time_us":179653,"raft.queue_time_us":129252,"raft.run_cpu_time_us":5844,"raft.run_wall_time_us":139779,"replication_time_us":439096,"thread_start_us":226811,"threads_started":4,"wal-append.queue_time_us":57536,"wal-append.run_cpu_time_us":44549,"wal-append.run_wall_time_us":2018813}]]}
I20260709 12:14:19.702615  5023 catalog_manager.cc:5697] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:19.687253  8195 raft_consensus.cc:2749] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:19.723810  5117 raft_consensus.cc:2468] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 6.
I20260709 12:14:19.726830  5119 raft_consensus.cc:2468] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 7.
I20260709 12:14:19.729590  5197 raft_consensus.cc:2468] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 7.
I20260709 12:14:19.729997  5089 leader_election.cc:304] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:19.730756  5088 leader_election.cc:304] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:19.700671  8191 raft_consensus.cc:2749] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:19.731698  5023 catalog_manager.cc:5697] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:19.704663  8221 raft_consensus.cc:2749] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:19.708873  8194 raft_consensus.cc:3060] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:19.743661  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 139783us
I20260709 12:14:19.747977  5801 leader_election.cc:304] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:19.734783  5197 raft_consensus.cc:1240] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:14:19.726910  7849 raft_consensus.cc:2749] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:19.727072  7973 raft_consensus.cc:2749] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:19.709280  8244 raft_consensus.cc:493] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:19.724555  8237 raft_consensus.cc:2804] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:19.776069  8237 raft_consensus.cc:493] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
W20260709 12:14:19.764644  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 62361.7us
I20260709 12:14:19.709025  8223 raft_consensus.cc:2749] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:14:19.766316  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 65612.1us
I20260709 12:14:19.765892  5023 catalog_manager.cc:5697] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 3 to 6, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 6 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:19.733927  8174 raft_consensus.cc:493] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.769905  5193 raft_consensus.cc:1275] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:14:19.772109  8221 raft_consensus.cc:2749] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:19.782799  5833 raft_consensus.cc:2468] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 8.
W20260709 12:14:19.791036  5238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:19.791980  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:19.746109  8256 raft_consensus.cc:2804] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:19.745918  8234 raft_consensus.cc:2749] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:19.792675  5119 raft_consensus.cc:2468] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 9.
I20260709 12:14:19.794242  5023 catalog_manager.cc:5697] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 5 to 6, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 6 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:19.784112  5831 raft_consensus.cc:1275] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 12:14:19.731599  7878 raft_consensus.cc:2749] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:19.796573  5831 pending_rounds.cc:85] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088: Aborting all ops after (but not including) 8
I20260709 12:14:19.797619  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:19.818289  5831 pending_rounds.cc:107] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:14:19.798753  5240 leader_election.cc:304] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:19.786479  8211 raft_consensus.cc:493] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.801748  5120 raft_consensus.cc:1240] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:19.776574  8237 raft_consensus.cc:3060] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:19.776813  8244 raft_consensus.cc:3060] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:19.793831  8174 raft_consensus.cc:515] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:19.767274  8130 raft_consensus.cc:515] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:19.812134  5023 catalog_manager.cc:5697] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: config changed from index 3 to 2, term changed from 4 to 6, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from VOTER to NON_VOTER, now has a pending config: VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129), VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130), VOTER 9e794b72ed7640219f90ec4232363929 (127.3.212.131), VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 6 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } health_report { overall_health: HEALTHY } } } pending_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:14:19.815732  8256 raft_consensus.cc:697] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:19.815865  5166 leader_election.cc:304] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
W20260709 12:14:19.816038  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:19.818643  5831 raft_consensus.cc:2889] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:19.818475  5122 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 5.
I20260709 12:14:19.801661  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:19.833936  5119 raft_consensus.cc:2468] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 7.
I20260709 12:14:19.721609  8278 consensus_queue.cc:237] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:19.822067  8211 raft_consensus.cc:515] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:19.838682  8174 leader_election.cc:290] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:19.785763  8243 consensus_queue.cc:1059] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 12:14:19.831398  5023 catalog_manager.cc:5697] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:14:19.732959  8209 consensus_queue.cc:1059] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 12:14:19.836844  5238 leader_election.cc:304] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:19.838404  7866 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:19.828259  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 80353.5us
I20260709 12:14:19.843776  5801 leader_election.cc:304] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:19.844946  5120 raft_consensus.cc:1275] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:14:19.845337  5120 pending_rounds.cc:85] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting all ops after (but not including) 4
I20260709 12:14:19.845618  5120 pending_rounds.cc:107] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:14:19.845968  5120 raft_consensus.cc:2889] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:19.846587  7866 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:19.841832  5023 catalog_manager.cc:5697] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:19.848541  5023 catalog_manager.cc:5697] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:19.830871  8191 consensus_queue.cc:1059] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:14:19.850286  8118 raft_consensus.cc:3055] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:19.835103  7878 raft_consensus.cc:493] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:19.850684  8118 raft_consensus.cc:740] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:19.851910  8238 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:19.851967  8118 consensus_queue.cc:260] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:19.852943  8130 leader_election.cc:290] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:19.853318  8118 raft_consensus.cc:3060] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:19.840207  8178 raft_consensus.cc:2804] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:19.854393  8223 raft_consensus.cc:2749] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:19.843225  7849 raft_consensus.cc:2804] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:19.855893  7849 raft_consensus.cc:493] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:19.856348  7849 raft_consensus.cc:3060] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:19.858034  8221 raft_consensus.cc:3055] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:19.858136  8224 consensus_queue.cc:1048] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:19.858536  8221 raft_consensus.cc:740] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:19.859489  8221 consensus_queue.cc:260] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:19.819806  8217 consensus_queue.cc:1048] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:14:19.855611  7878 raft_consensus.cc:515] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:19.862766  7878 leader_election.cc:290] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:19.863023  8256 consensus_queue.cc:237] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:19.850436  5023 catalog_manager.cc:5697] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 2 to 6, leader changed from bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 6 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:19.853968  5801 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:14:19.866186  5166 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:19.867599  5023 catalog_manager.cc:5697] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 3 to 5, leader changed from bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 5 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:14:19.878574  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:19.868901  5801 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:19.869625  8042 consensus_queue.cc:1059] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 12:14:19.884123  8042 raft_consensus.cc:3055] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:19.869083  7866 raft_consensus.cc:2804] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:19.845189  8243 raft_consensus.cc:3055] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:19.891898  7866 raft_consensus.cc:697] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 10 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:19.892068  8243 raft_consensus.cc:740] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:19.892976  8243 consensus_queue.cc:260] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:19.893044  7866 consensus_queue.cc:237] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:19.894351  8243 raft_consensus.cc:3060] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:19.890928  8194 raft_consensus.cc:2749] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:19.890005  5801 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:19.900094  5801 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:19.878649  8178 raft_consensus.cc:697] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 7 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:19.890794  8024 raft_consensus.cc:2749] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:19.881047  8217 raft_consensus.cc:2804] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:19.901482  8178 consensus_queue.cc:237] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:19.906482  8217 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:19.906896  8217 raft_consensus.cc:3060] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:19.909632  8194 raft_consensus.cc:2804] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:19.910511  8194 raft_consensus.cc:697] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 8 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:19.911451  8194 consensus_queue.cc:237] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:19.909139  8223 raft_consensus.cc:2804] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:19.914379  8223 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:19.914788  8223 raft_consensus.cc:3060] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:19.909229  8244 raft_consensus.cc:515] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:19.919924  8244 leader_election.cc:290] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:19.924667  8237 raft_consensus.cc:515] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:19.926061  5801 leader_election.cc:304] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:19.884486  8042 raft_consensus.cc:740] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:19.870226  8191 consensus_queue.cc:1048] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 12:14:19.909752  8211 leader_election.cc:290] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:19.928191  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:19.948951  5193 raft_consensus.cc:3060] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:19.928675  5023 catalog_manager.cc:5697] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 5 to 7, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 7 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:19.870939  5164 leader_election.cc:304] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
W20260709 12:14:19.980206  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 109335us
I20260709 12:14:19.865337  7849 raft_consensus.cc:515] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:19.960131  5023 catalog_manager.cc:5697] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: config changed from index 3 to 4, term changed from 4 to 6, leader changed from bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129), VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130), VOTER 9e794b72ed7640219f90ec4232363929 (127.3.212.131), VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 6 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:14:19.998472  5164 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:19.998728  5801 leader_election.cc:304] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
W20260709 12:14:20.013873  5802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:19.950184  8195 raft_consensus.cc:2804] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:14:20.025718  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 193704us
I20260709 12:14:20.002306  5023 catalog_manager.cc:5697] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 6 to 7, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 7 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:20.031215  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:20.031915  5118 raft_consensus.cc:3060] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:20.031297  5023 catalog_manager.cc:5697] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:19.959084  8238 raft_consensus.cc:493] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:20.032960  5023 catalog_manager.cc:5697] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 4 to 5, leader changed from bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 5 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:14:19.995932  8224 raft_consensus.cc:2764] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:14:20.036825  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:20.034144  7644 raft_consensus.cc:2804] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:20.052699  5118 raft_consensus.cc:2468] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 8.
I20260709 12:14:20.038829  5119 raft_consensus.cc:2410] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
W20260709 12:14:20.040465  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:20.042776  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:20.040057  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:20.042147  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 43760.7us
I20260709 12:14:20.059363  5120 raft_consensus.cc:2393] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 7: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:20.037232  5023 catalog_manager.cc:5697] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:14:20.064268  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 360055us
I20260709 12:14:20.059945  5240 leader_election.cc:304] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:20.060880  5023 catalog_manager.cc:5697] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:20.065232  5804 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:20.068427  5023 catalog_manager.cc:5697] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:20.071704  5023 catalog_manager.cc:5697] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:20.074447  5804 leader_election.cc:304] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:20.073149  5023 catalog_manager.cc:5697] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:20.056419  7644 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:20.087976  5023 catalog_manager.cc:5697] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 3 to 4, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 4 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:20.066147  8224 raft_consensus.cc:493] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.070531  8278 raft_consensus.cc:2804] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:20.095161  5023 catalog_manager.cc:5697] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 3 to 4, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 4 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:20.037366  8238 raft_consensus.cc:515] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:20.103596  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 266816us
I20260709 12:14:20.101940  5023 catalog_manager.cc:5697] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 2 to 4, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 4 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } }
I20260709 12:14:20.069621  8128 consensus_queue.cc:1048] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:14:20.092191  7644 raft_consensus.cc:3060] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:20.055932  8042 consensus_queue.cc:260] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:20.098667  8136 raft_consensus.cc:2804] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:20.109731  7849 leader_election.cc:290] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:20.111812  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:20.100981  7647 consensus_queue.cc:1059] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:14:20.091969  8223 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:20.141245  5023 catalog_manager.cc:5697] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
W20260709 12:14:20.148743  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 149238us
I20260709 12:14:20.150606  5193 raft_consensus.cc:2468] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 7.
I20260709 12:14:20.152505  5088 leader_election.cc:304] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:20.153237  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:20.144622  8128 consensus_queue.cc:1243] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer ad2f9a1e2f7a45429fa69fd23d09f821 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:14:20.156483  5191 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:20.150059  5023 catalog_manager.cc:5697] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: config changed from index 6 to 4, term changed from 6 to 7, leader changed from <none> to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from VOTER to NON_VOTER, now has a pending config: VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129), VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130), VOTER 9e794b72ed7640219f90ec4232363929 (127.3.212.131), VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 7 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:14:20.158231  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
W20260709 12:14:20.159149  5801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:20.159463  5023 catalog_manager.cc:5697] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 4 to 5, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 5 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } }
I20260709 12:14:20.160207  5801 leader_election.cc:304] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:20.160840  5023 catalog_manager.cc:5697] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 2 to 4, leader changed from bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 4 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:14:20.164387  5267 raft_consensus.cc:1240] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 9 LEADER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:14:20.102000  8224 raft_consensus.cc:515] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:20.176599  8284 log.cc:927] Time spent T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 12:14:20.178654  5803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:20.181447  5801 leader_election.cc:304] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:20.181948  8305 raft_consensus.cc:2749] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:20.186373  8194 raft_consensus.cc:2749] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:20.186868  8223 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:20.187963  8194 raft_consensus.cc:2749] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:20.188726  8223 raft_consensus.cc:2749] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:20.189349  8237 leader_election.cc:290] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:20.194420  5803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:20.204236  8217 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:20.210740  8224 leader_election.cc:290] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:20.211027  5118 pending_rounds.cc:85] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting all ops after (but not including) 3
I20260709 12:14:20.211406  5118 pending_rounds.cc:107] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:14:20.211658  5118 raft_consensus.cc:2889] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:20.155439  8136 raft_consensus.cc:697] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 8 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:20.217909  5124 raft_consensus.cc:1240] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 2. Current term is 3. Ops: []
I20260709 12:14:20.217662  8136 consensus_queue.cc:237] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:20.218677  8221 raft_consensus.cc:3060] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:20.162969  7849 raft_consensus.cc:493] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:20.221592  7849 raft_consensus.cc:515] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:20.222381  8042 raft_consensus.cc:3060] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:20.223517  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:20.224678  7849 leader_election.cc:290] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:20.229440  5120 raft_consensus.cc:2468] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 9.
I20260709 12:14:20.233811  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:20.238595  7644 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:20.236757  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 84355.6us
I20260709 12:14:20.244452  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:20.235549  8178 consensus_queue.cc:1059] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:20.246420  8178 raft_consensus.cc:3055] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:20.208021  8217 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:20.242746  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:20.246810  8178 raft_consensus.cc:740] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:20.250141  8178 consensus_queue.cc:260] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:20.251482  8178 raft_consensus.cc:3060] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:20.237282  8191 raft_consensus.cc:2804] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:20.252688  8191 raft_consensus.cc:697] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
W20260709 12:14:20.252815  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:20.253595  8191 consensus_queue.cc:237] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:20.178730  5191 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 7.
I20260709 12:14:20.259001  5166 leader_election.cc:304] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:20.264099  5119 raft_consensus.cc:2468] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 7.
I20260709 12:14:20.265697  5166 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:20.268181  5193 raft_consensus.cc:1275] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:14:20.267489  8174 raft_consensus.cc:493] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.272826  8174 raft_consensus.cc:515] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:20.308164  8174 leader_election.cc:290] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:20.221071  8238 leader_election.cc:290] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:20.269528  8217 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.309659  8266 raft_consensus.cc:2804] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:20.309563  8217 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:20.310271  8266 raft_consensus.cc:697] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:20.311308  8266 consensus_queue.cc:237] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:20.312117  8217 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:20.312741  8217 raft_consensus.cc:493] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.277241  7849 raft_consensus.cc:2804] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:14:20.331954  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 61987.7us
W20260709 12:14:20.334005  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 92128.6us
I20260709 12:14:20.345312  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:20.314150  7849 raft_consensus.cc:697] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
W20260709 12:14:20.353681  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 264081us
W20260709 12:14:20.356349  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 281954us
I20260709 12:14:20.313146  8217 raft_consensus.cc:515] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:20.359652  5164 leader_election.cc:304] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:20.360267  5804 leader_election.cc:304] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:20.335582  8195 raft_consensus.cc:697] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 6 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
W20260709 12:14:20.363847  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 182468us
I20260709 12:14:20.365346  5801 leader_election.cc:304] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:20.366418  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:20.371573  5124 raft_consensus.cc:2468] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 4.
I20260709 12:14:20.359189  7647 consensus_queue.cc:1243] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer bce73265e27d4b30a4dcc1e491305088 log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:14:20.379907  8311 raft_consensus.cc:2804] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:20.352073  8053 consensus_queue.cc:1048] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:14:20.387400  5238 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:20.387976  5804 leader_election.cc:304] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:14:20.399596  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:20.402343  5272 raft_consensus.cc:1240] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:20.405470  5267 raft_consensus.cc:1275] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:20.405210  5193 raft_consensus.cc:1275] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:14:20.395027  8278 raft_consensus.cc:697] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 7 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:20.398087  8304 raft_consensus.cc:2804] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:20.407666  8278 consensus_queue.cc:237] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:20.407994  8224 raft_consensus.cc:3055] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:20.408631  8224 raft_consensus.cc:740] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:20.409669  8224 consensus_queue.cc:260] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:20.410965  8224 raft_consensus.cc:3060] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:20.411252  7849 consensus_queue.cc:237] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:20.414866  8217 leader_election.cc:290] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:20.416246  5191 raft_consensus.cc:1240] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:20.396492  8216 raft_consensus.cc:2749] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:20.405311  8195 consensus_queue.cc:237] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:20.419090  7644 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:20.421015  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:20.422781  5240 leader_election.cc:304] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:20.423019  5191 raft_consensus.cc:1275] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:14:20.424465  8174 raft_consensus.cc:2749] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:20.424911  8211 consensus_queue.cc:1059] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:14:20.425910  8174 raft_consensus.cc:2804] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:20.426393  8174 raft_consensus.cc:493] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:20.426095  8211 raft_consensus.cc:3055] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:20.427024  8211 raft_consensus.cc:740] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:20.427420  8304 raft_consensus.cc:697] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 10 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:20.427977  8211 consensus_queue.cc:260] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:20.366022  8221 consensus_queue.cc:1059] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:14:20.430434  8174 raft_consensus.cc:3060] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:20.435360  5191 raft_consensus.cc:1275] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:14:20.436787  5191 pending_rounds.cc:85] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808: Aborting all ops after (but not including) 6
I20260709 12:14:20.451391  5191 pending_rounds.cc:107] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:14:20.451704  5191 raft_consensus.cc:2889] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:20.389834  8311 raft_consensus.cc:493] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:20.453207  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:20.452869  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 65523.7us
I20260709 12:14:20.466730  5193 raft_consensus.cc:1275] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:14:20.428715  8304 consensus_queue.cc:237] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:20.427227  8238 raft_consensus.cc:493] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:20.453207  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 65424.4us
I20260709 12:14:20.471576  5089 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:20.474673  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:20.476449  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:20.445868  8136 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.452641  8256 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.492239  8302 consensus_queue.cc:1048] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:14:20.455529  8306 raft_consensus.cc:2804] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:20.454864  8311 raft_consensus.cc:3060] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:20.493597  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:20.453126  8211 raft_consensus.cc:3060] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:20.499855  5830 raft_consensus.cc:1240] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 7. Current term is 8. Ops: []
W20260709 12:14:20.508970  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 153112us
I20260709 12:14:20.488472  7644 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.513762  5238 leader_election.cc:304] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:20.455034  8303 consensus_queue.cc:1048] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:14:20.455672  8221 consensus_queue.cc:1048] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:14:20.500597  5804 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:20.503484  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:20.503602  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:20.515995  5837 raft_consensus.cc:3060] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:20.516321  8296 raft_consensus.cc:2804] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:20.516739  8296 raft_consensus.cc:493] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:20.517068  8296 raft_consensus.cc:3060] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:20.504098  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:20.521751  5838 raft_consensus.cc:2468] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 8.
I20260709 12:14:20.522863  5835 raft_consensus.cc:3060] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:20.524523  8296 raft_consensus.cc:515] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:20.453649  8216 consensus_queue.cc:1059] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:14:20.526021  5238 leader_election.cc:304] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:20.527007  5164 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:20.493060  8247 raft_consensus.cc:3060] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:20.529551  5119 raft_consensus.cc:2468] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 8.
I20260709 12:14:20.501446  5089 leader_election.cc:304] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
W20260709 12:14:20.507149  8319 log.cc:927] Time spent T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:14:20.453488  8188 consensus_queue.cc:1048] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 12:14:20.543635  5089 leader_election.cc:304] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:20.546341  5193 raft_consensus.cc:1275] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:14:20.546460  8237 raft_consensus.cc:2804] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:20.547005  8237 raft_consensus.cc:493] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:20.547344  8237 raft_consensus.cc:3060] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:20.548310  8313 consensus_queue.cc:1048] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:20.514686  8306 raft_consensus.cc:697] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 6 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:20.550261  8306 consensus_queue.cc:237] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:20.489244  8238 raft_consensus.cc:515] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:20.554494  8216 raft_consensus.cc:3055] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:20.554925  8216 raft_consensus.cc:740] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:20.555801  8216 consensus_queue.cc:260] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:20.556378  8238 leader_election.cc:290] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:20.493150  8294 consensus_queue.cc:1048] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 12:14:20.562144  5089 leader_election.cc:304] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:20.562455  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:20.566366  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:20.567938  5837 raft_consensus.cc:2468] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
I20260709 12:14:20.568096  5835 raft_consensus.cc:2468] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:14:20.567910  5118 raft_consensus.cc:1275] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:14:20.557224  8216 raft_consensus.cc:3060] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:20.579849  5089 leader_election.cc:304] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
W20260709 12:14:20.598263  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 71328.3us
I20260709 12:14:20.598949  5089 leader_election.cc:304] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:14:20.599846  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 73910.3us
I20260709 12:14:20.600920  5238 leader_election.cc:304] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:20.496944  8136 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:20.536810  8312 raft_consensus.cc:2749] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:20.617432  8211 raft_consensus.cc:2804] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:20.618008  8211 raft_consensus.cc:697] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:20.619133  8211 consensus_queue.cc:237] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:20.615453  8243 raft_consensus.cc:2804] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:20.615336  5164 leader_election.cc:304] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:14:20.500123  8256 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:20.563469  8191 raft_consensus.cc:2804] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:20.616976  8296 leader_election.cc:290] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:20.605825  5804 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:20.623909  5238 leader_election.cc:304] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:20.569958  8238 raft_consensus.cc:493] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:20.581239  8053 raft_consensus.cc:2804] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:20.564085  8307 raft_consensus.cc:2749] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:20.537467  7644 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:20.611944  7805 raft_consensus.cc:2749] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:20.644955  5238 leader_election.cc:304] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:20.627934  8302 raft_consensus.cc:493] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.626953  7878 raft_consensus.cc:2749] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:20.660327  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 45094.1us
I20260709 12:14:20.591130  8221 consensus_queue.cc:1048] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 12:14:20.639839  8053 raft_consensus.cc:493] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:20.670127  5164 leader_election.cc:304] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:20.645548  8291 raft_consensus.cc:2749] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:20.659397  7647 raft_consensus.cc:2804] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:20.699347  5164 leader_election.cc:304] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:20.671211  5238 leader_election.cc:304] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:20.646296  8278 raft_consensus.cc:2804] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:14:20.689371  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 156418us
I20260709 12:14:20.706589  5238 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:20.708210  5238 leader_election.cc:304] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:14:20.687219  8314 log.cc:927] Time spent T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 12:14:20.674752  8053 raft_consensus.cc:3060] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:20.757279  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 58033us
I20260709 12:14:20.655337  8238 raft_consensus.cc:515] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:20.758426  5164 leader_election.cc:304] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:20.687644  8296 raft_consensus.cc:2749] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:20.698451  8217 raft_consensus.cc:2749] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:20.762209  5164 leader_election.cc:304] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:20.762787  7849 raft_consensus.cc:2749] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:20.703657  8312 raft_consensus.cc:3055] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:20.665810  8302 raft_consensus.cc:515] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:20.719079  8291 raft_consensus.cc:2804] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:20.753502  8304 raft_consensus.cc:493] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.756621  8042 raft_consensus.cc:3060] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:20.758119  7647 raft_consensus.cc:697] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:20.759922  8191 raft_consensus.cc:697] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:20.791939  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:20.771023  8130 raft_consensus.cc:2804] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:20.760339  8290 raft_consensus.cc:2749] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:20.795732  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:20.807788  5196 raft_consensus.cc:2393] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 7: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
W20260709 12:14:20.808511  5163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:20.752929  7805 consensus_queue.cc:1048] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:14:20.776289  8312 raft_consensus.cc:740] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:20.775276  8278 raft_consensus.cc:697] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 8 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:20.809461  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:20.809950  5200 raft_consensus.cc:2393] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 5: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:20.810353  5119 raft_consensus.cc:1240] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:14:20.787261  8308 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.794018  8304 raft_consensus.cc:515] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:20.828696  8304 leader_election.cc:290] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:20.781646  8291 raft_consensus.cc:493] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:20.783572  8322 raft_consensus.cc:493] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:20.787389  8224 raft_consensus.cc:3060] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:20.834450  5200 raft_consensus.cc:1275] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:20.837267  5196 raft_consensus.cc:1275] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:14:20.837695  5196 pending_rounds.cc:85] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808: Aborting all ops after (but not including) 4
I20260709 12:14:20.837903  5196 pending_rounds.cc:107] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:14:20.838125  5196 raft_consensus.cc:2889] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:20.838712  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:20.839861  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:20.793568  8243 raft_consensus.cc:697] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:20.853215  5196 raft_consensus.cc:1240] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 6. Current term is 7. Ops: []
W20260709 12:14:20.854629  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 99899us
I20260709 12:14:20.836448  8291 raft_consensus.cc:3060] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:20.873216  5196 raft_consensus.cc:1275] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:14:20.836567  8130 raft_consensus.cc:697] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 8 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:20.874452  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:20.851406  8118 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:20.882696  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:20.883445  5196 raft_consensus.cc:2468] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 7.
I20260709 12:14:20.889684  5088 leader_election.cc:304] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:20.838299  8308 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:20.841957  8322 raft_consensus.cc:515] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:20.878350  8256 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:20.889919  8178 consensus_meta.cc:287] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.638s	user 0.007s	sys 0.005s
I20260709 12:14:20.922467  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:20.883934  7647 consensus_queue.cc:237] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:20.929117  8338 raft_consensus.cc:2804] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:14:20.925997  8326 log.cc:927] Time spent T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 12:14:20.889499  8118 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:20.897846  8312 consensus_queue.cc:260] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:20.929651  8238 leader_election.cc:290] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:14:20.969998  8329 log.cc:927] Time spent T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:14:20.955399  8338 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:20.971017  8338 raft_consensus.cc:3060] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:20.971185  8345 raft_consensus.cc:493] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.971565  8302 leader_election.cc:290] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:20.971772  8345 raft_consensus.cc:515] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:20.973600  8174 consensus_meta.cc:287] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.542s	user 0.006s	sys 0.005s
I20260709 12:14:20.974711  8312 raft_consensus.cc:3060] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:20.975679  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:20.975914  8237 raft_consensus.cc:515] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:20.974089  8174 raft_consensus.cc:515] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:20.977036  5193 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 5.
I20260709 12:14:20.978282  8053 raft_consensus.cc:515] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:20.907927  8278 consensus_queue.cc:237] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:20.981444  5237 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:20.967002  8130 consensus_queue.cc:237] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:20.970578  8308 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:20.988525  8247 raft_consensus.cc:2749] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:20.947501  8178 raft_consensus.cc:493] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:20.990738  8311 raft_consensus.cc:515] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:20.992436  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:21.041901  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
W20260709 12:14:20.995865  8328 log.cc:927] Time spent T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 12:14:21.022187  8345 leader_election.cc:290] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:20.888609  8191 consensus_queue.cc:237] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:21.008736  8332 log.cc:927] Time spent T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 12:14:21.012432  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:21.013939  8344 log.cc:927] Time spent T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 12:14:20.933873  8243 consensus_queue.cc:237] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:20.990659  7644 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:21.013834  8343 log.cc:927] Time spent T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:14:21.027453  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:21.034994  8291 raft_consensus.cc:515] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:21.036509  8053 leader_election.cc:290] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:21.038960  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:21.040199  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 58845.9us
I20260709 12:14:20.995369  8118 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:21.042758  5193 raft_consensus.cc:2393] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 5: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
W20260709 12:14:21.001575  8323 log.cc:927] Time spent T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
W20260709 12:14:21.047297  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 339118us
I20260709 12:14:21.033486  8010 raft_consensus.cc:493] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.049584  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:21.033257  7849 raft_consensus.cc:493] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.061942  5198 raft_consensus.cc:1240] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 7. Current term is 8. Ops: []
W20260709 12:14:21.065897  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:21.068213  5801 leader_election.cc:304] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:21.073957  5237 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:21.143353  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:21.049072  8128 raft_consensus.cc:2749] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:21.101514  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:21.153036  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:21.154032  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:21.157898  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:21.158592  5803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:21.158949  5117 raft_consensus.cc:1275] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:14:21.211519  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 137644us
I20260709 12:14:21.050153  8178 raft_consensus.cc:515] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:21.146849  8053 raft_consensus.cc:493] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.145431  8302 raft_consensus.cc:493] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.145964  8024 consensus_queue.cc:1048] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.087s
I20260709 12:14:21.286365  5196 raft_consensus.cc:2468] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 6.
W20260709 12:14:21.318048  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 44085.6us
I20260709 12:14:21.148799  7644 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
W20260709 12:14:21.310523  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 242365us
W20260709 12:14:21.468307  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 317253us
I20260709 12:14:21.213753  5124 raft_consensus.cc:1240] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:21.481817  5238 leader_election.cc:304] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:21.274886  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:21.484575  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:21.485507  5196 raft_consensus.cc:2393] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 7: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:21.212471  5122 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 5.
I20260709 12:14:21.300493  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:21.447572  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:21.278138  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:21.214123  5119 raft_consensus.cc:2410] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 12:14:21.298372  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 70377.2us
I20260709 12:14:21.490821  5237 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
W20260709 12:14:21.150547  8344 log.cc:927] Time spent T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 12:14:21.435984  8335 log.cc:927] Time spent T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
W20260709 12:14:21.323834  8328 log.cc:927] Time spent T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 12:14:21.271852  8238 consensus_queue.cc:1059] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.254s
I20260709 12:14:21.232259  8010 raft_consensus.cc:515] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:21.303681  8174 leader_election.cc:290] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:21.307399  8291 leader_election.cc:290] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:21.212687  7647 raft_consensus.cc:493] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:21.303948  8308 raft_consensus.cc:2749] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:21.352454  8337 raft_consensus.cc:493] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:21.535317  5193 raft_consensus.cc:1275] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:14:21.303532  8256 raft_consensus.cc:493] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.323678  8224 raft_consensus.cc:2749] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:21.495971  8237 leader_election.cc:290] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:21.479935  8053 raft_consensus.cc:515] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:21.328670  8349 consensus_queue.cc:1048] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.239s
I20260709 12:14:21.529367  8195 raft_consensus.cc:493] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.527386  8290 raft_consensus.cc:493] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.232800  7849 raft_consensus.cc:515] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:21.303982  8350 consensus_queue.cc:1048] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.394s
W20260709 12:14:21.303792  8346 log.cc:927] Time spent T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:14:21.340858  8338 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:21.533612  8336 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.581107  8290 raft_consensus.cc:515] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:21.582039  8336 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:21.584092  8290 leader_election.cc:290] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:21.586608  7849 leader_election.cc:290] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:21.555492  8311 leader_election.cc:290] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:21.530989  8340 raft_consensus.cc:493] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:21.537649  7878 raft_consensus.cc:3060] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:21.559247  5192 raft_consensus.cc:2468] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 4.
I20260709 12:14:21.484097  8302 raft_consensus.cc:515] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:21.501770  7644 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:21.539319  8296 raft_consensus.cc:2804] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:14:21.570745  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 89000.8us
I20260709 12:14:21.556758  8354 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:21.579851  8333 log.cc:927] Time spent T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.350s	user 0.001s	sys 0.000s
I20260709 12:14:21.580188  8195 raft_consensus.cc:515] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:21.581490  8338 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:21.586874  8363 log.cc:927] Time spent T 00000000000000000000000000000000 P 221aa011207d421b9725197ff8bed389: Append to log took a long time: real 0.059s	user 0.002s	sys 0.000s
I20260709 12:14:21.605221  5238 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:21.584367  8336 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:21.606980  5191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 2036) took 1025 ms. Trace:
W20260709 12:14:21.611680  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:21.591688  8362 raft_consensus.cc:3055] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:21.613883  5191 rpcz_store.cc:276] 0709 12:14:20.582165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.582415 (+   250us) service_pool.cc:224] Handling call
0709 12:14:20.582783 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:20.617688 (+ 34905us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:20.617715 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:20.618194 (+   479us) log.cc:844] Serialized 26 byte log entry
0709 12:14:20.756921 (+138727us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:20.756965 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:20.757032 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:21.606747 (+849715us) raft_consensus.cc:1685] finished
0709 12:14:21.606768 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:21.606918 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30084,"raft.queue_time_us":35990,"raft.run_cpu_time_us":69,"raft.run_wall_time_us":69,"thread_start_us":138008,"threads_started":1,"wal-append.queue_time_us":434946}
I20260709 12:14:21.615433  5238 leader_election.cc:304] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:21.558063  8337 raft_consensus.cc:515] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:21.617977  5238 leader_election.cc:304] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:21.555765  7647 raft_consensus.cc:515] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:21.621869  5833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46094 (request call id 851) took 1124 ms. Trace:
I20260709 12:14:21.622296  5833 rpcz_store.cc:276] 0709 12:14:20.498310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.503288 (+  4978us) service_pool.cc:224] Handling call
0709 12:14:20.503667 (+   379us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:20.504005 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:20.504032 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:20.504761 (+   729us) log.cc:844] Serialized 52 byte log entry
0709 12:14:20.622598 (+117837us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:20.661828 (+ 39230us) log.cc:844] Serialized 14 byte log entry
0709 12:14:20.697646 (+ 35818us) log.cc:844] Serialized 14 byte log entry
0709 12:14:20.770073 (+ 72427us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:20.770153 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:21.305882 (+535729us) spinlock_profiling.cc:243] Waited 47.7 ms on lock 0x7b18003d7800. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3ad6522 00007f84e3ad87c1 00007f84e3ad8779 00007f84e3ad8709 00007f84e3ad86d1 00007f84e3ad79cd 0000000000388634 0000000000388479 00007f84e3ab983a
0709 12:14:21.621573 (+315691us) raft_consensus.cc:1685] finished
0709 12:14:21.621603 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:21.621778 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":102174,"prepare.queue_time_us":113158,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":77,"raft.queue_time_us":110110,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":7523,"spinlock_wait_cycles":116590464,"thread_start_us":117408,"threads_started":1,"wal-append.queue_time_us":197693}
I20260709 12:14:21.620872  7647 leader_election.cc:290] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:21.635179  5832 raft_consensus.cc:1275] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:14:21.641439  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:21.642222  5837 raft_consensus.cc:3060] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:21.612676  8360 log.cc:927] Time spent T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.279s	user 0.000s	sys 0.001s
I20260709 12:14:21.645817  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:21.646262  5838 raft_consensus.cc:1275] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:14:21.623884  8349 raft_consensus.cc:2749] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:21.647706  5838 raft_consensus.cc:1240] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:21.616446  8362 raft_consensus.cc:740] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:21.648833  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:21.649221  8362 consensus_queue.cc:260] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:21.649950  8322 leader_election.cc:290] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:21.612939  8354 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:21.650894  8362 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:21.599514  8340 raft_consensus.cc:515] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:21.653167  8340 leader_election.cc:290] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:21.604229  8296 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:21.653813  8296 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:21.655897  8308 raft_consensus.cc:493] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.656499  8308 raft_consensus.cc:515] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:21.657287  5837 raft_consensus.cc:2468] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 9.
I20260709 12:14:21.655956  7878 raft_consensus.cc:2749] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:21.659969  8337 leader_election.cc:290] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:21.660943  5829 raft_consensus.cc:2468] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:14:21.661267  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:21.661996  8361 raft_consensus.cc:2749] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:21.663259  8178 leader_election.cc:290] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:21.664908  8010 leader_election.cc:290] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:21.667470  8354 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:21.641678  8195 leader_election.cc:290] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:21.565573  8256 raft_consensus.cc:515] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:21.671605  8330 log.cc:927] Time spent T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.856s	user 0.003s	sys 0.009s
W20260709 12:14:21.674572  8365 log.cc:927] Time spent T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.109s	user 0.003s	sys 0.000s
I20260709 12:14:21.677947  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:21.678896  5832 raft_consensus.cc:2393] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 5: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:21.679629  8053 leader_election.cc:290] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:21.680011  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:21.680684  5124 raft_consensus.cc:2468] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 6.
I20260709 12:14:21.679473  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:21.681941  5122 raft_consensus.cc:2468] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 7.
I20260709 12:14:21.623960  8174 raft_consensus.cc:2804] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:21.683265  8174 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:21.683732  8042 consensus_meta.cc:287] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.890s	user 0.007s	sys 0.003s
I20260709 12:14:21.684821  8042 raft_consensus.cc:2749] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:14:21.687721  8352 log.cc:927] Time spent T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
I20260709 12:14:21.689067  8308 leader_election.cc:290] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:21.684005  7644 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:21.612418  8237 raft_consensus.cc:493] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:21.690529  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 475882us
I20260709 12:14:21.692481  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:21.694435  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:21.692637  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:21.695127  5118 raft_consensus.cc:3060] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:21.695031  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:21.691520  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:21.695690  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:21.696632  5124 raft_consensus.cc:2410] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:14:21.697830  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:21.699168  5831 raft_consensus.cc:2393] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 8: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:21.683666  8174 raft_consensus.cc:3060] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:21.717079  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:21.718230  5199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41416 (request call id 566) took 1066 ms. Trace:
I20260709 12:14:21.718510  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:21.721354  5836 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 5.
I20260709 12:14:21.718966  5124 raft_consensus.cc:1275] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:14:21.721860  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 573654us
W20260709 12:14:21.724834  5163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:21.725664  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:21.725553  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:21.730103  5200 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d"
dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
mode: GRACEFUL
new_leader_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:53902
I20260709 12:14:21.730670  5200 raft_consensus.cc:606] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Received request to transfer leadership to TS 9e794b72ed7640219f90ec4232363929
I20260709 12:14:21.730998  5200 raft_consensus.cc:614] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:21.678557  8302 leader_election.cc:290] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:21.726650  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:21.719983  5199 rpcz_store.cc:276] 0709 12:14:20.631036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.631211 (+   175us) service_pool.cc:224] Handling call
0709 12:14:20.631647 (+   436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:20.644008 (+ 12361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:20.644038 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:20.661158 (+ 17120us) log.cc:844] Serialized 26 byte log entry
0709 12:14:21.045642 (+384484us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:14:21.045692 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:21.045760 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:21.686855 (+641095us) spinlock_profiling.cc:243] Waited 28.3 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e675e86e 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221 00007f84e67671d9 00007f84e6767169
0709 12:14:21.692957 (+  6102us) raft_consensus.cc:1685] finished
0709 12:14:21.692979 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:21.696961 (+  3982us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19140,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":6067,"spinlock_wait_cycles":64996096,"thread_start_us":325538,"threads_started":1,"wal-append.queue_time_us":584530}
I20260709 12:14:21.735049  5831 raft_consensus.cc:1275] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:14:21.746837  5118 raft_consensus.cc:2468] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 5.
W20260709 12:14:21.744359  5088 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 1.644s (SENT) [suppressed 66 similar messages]
I20260709 12:14:21.753147  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:21.754088  5831 raft_consensus.cc:2393] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 7: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
W20260709 12:14:21.754045  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 136146us
W20260709 12:14:21.758106  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 267360us
I20260709 12:14:21.718520  8354 raft_consensus.cc:493] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.748832  8349 raft_consensus.cc:2749] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:21.762964  5804 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:21.753170  8340 raft_consensus.cc:493] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.755055  8337 raft_consensus.cc:493] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.783799  5237 leader_election.cc:304] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:21.709971  8237 raft_consensus.cc:515] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:21.787322  5117 raft_consensus.cc:1240] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:21.785696  5804 leader_election.cc:304] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:21.792032  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:21.793184  8256 leader_election.cc:290] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:21.769935  8354 raft_consensus.cc:515] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:21.799024  8237 leader_election.cc:290] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:21.799438  8354 leader_election.cc:290] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:21.800681  8302 raft_consensus.cc:2955] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 8 LEADER]: Committing config change with OpId 4.6: config changed from index 4 to 6, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:14:21.805677  5122 raft_consensus.cc:2468] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 8.
W20260709 12:14:21.807060  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 52267us
I20260709 12:14:21.811280  5274 raft_consensus.cc:1240] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:21.809064  5237 leader_election.cc:304] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:21.811676  5265 raft_consensus.cc:1240] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:21.810909  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:21.813050  5272 raft_consensus.cc:1275] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:14:21.814302  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:21.782683  8216 raft_consensus.cc:2804] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:21.815991  5273 raft_consensus.cc:1240] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:21.814810  5266 raft_consensus.cc:2393] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 5: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:21.818163  5271 raft_consensus.cc:2393] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 7: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:21.814277  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:21.819290  5274 raft_consensus.cc:2393] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 9: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:21.814429  5240 leader_election.cc:304] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:21.785300  8128 raft_consensus.cc:493] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.830132  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:21.788733  8370 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:21.789032  8340 raft_consensus.cc:515] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:21.789407  8224 consensus_queue.cc:1048] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 12:14:22.022465  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:22.254025  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:21.830724  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:21.858197  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:21.838069  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:21.858049  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:14:22.206811  5163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:22.111305  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:21.832335  5117 raft_consensus.cc:1275] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:22.253684  5267 raft_consensus.cc:3060] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:22.172958  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:22.058460  5198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 2033) took 1643 ms. Trace:
I20260709 12:14:22.258864  5119 raft_consensus.cc:1240] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:21.849443  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:21.857192  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:14:22.249931  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 440880us
I20260709 12:14:22.263167  5237 leader_election.cc:304] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:22.264575  5237 leader_election.cc:304] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:14:21.858340  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 44027.4us
I20260709 12:14:22.261240  5273 raft_consensus.cc:2393] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 7: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:22.260033  5194 raft_consensus.cc:2468] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:14:22.270388  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:22.269318  5118 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
new_leader_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:45628
I20260709 12:14:22.271015  5200 raft_consensus.cc:3060] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:22.271399  5118 raft_consensus.cc:606] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Received request to transfer leadership to TS 9e794b72ed7640219f90ec4232363929
I20260709 12:14:22.259306  5198 rpcz_store.cc:276] 0709 12:14:20.414667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.424649 (+  9982us) service_pool.cc:224] Handling call
0709 12:14:20.424956 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:21.159821 (+734865us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:22.058174 (+898353us) spinlock_profiling.cc:243] Waited 637 ms on lock 0x7b54002ad854. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:22.058390 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1464422784}
I20260709 12:14:22.254935  5272 raft_consensus.cc:2468] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 6.
I20260709 12:14:21.916143  8042 raft_consensus.cc:493] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.265064  8188 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:21.808507  8178 raft_consensus.cc:2749] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:21.935725  8375 raft_consensus.cc:2804] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:22.273936  8128 raft_consensus.cc:515] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:21.813553  8322 raft_consensus.cc:493] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:21.812641  7647 raft_consensus.cc:493] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:22.288470  8322 raft_consensus.cc:515] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:21.807142  8337 raft_consensus.cc:515] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:22.291849  5120 raft_consensus.cc:1275] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:14:22.293517  5265 raft_consensus.cc:3060] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:22.293884  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
W20260709 12:14:22.225451  8365 log.cc:927] Time spent T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:14:22.282770  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:22.266255  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:21.822278  8216 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:22.284963  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:22.286449  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:21.939704  8358 log.cc:927] Time spent T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.615s	user 0.000s	sys 0.001s
I20260709 12:14:21.821163  8195 raft_consensus.cc:2804] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:21.857594  8374 raft_consensus.cc:2749] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:22.307813  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:22.273948  8361 raft_consensus.cc:2749] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:22.308506  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
W20260709 12:14:22.308641  5240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:22.300833  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:22.309194  5198 raft_consensus.cc:2468] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:14:22.311158  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:22.312083  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:21.999788  8369 raft_consensus.cc:493] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.935648  8372 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:21.812748  8371 consensus_queue.cc:1059] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.491s
I20260709 12:14:22.331230  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:21.854152  8311 consensus_queue.cc:1048] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.450s
I20260709 12:14:22.303041  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:21.815759  8010 consensus_queue.cc:1048] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.470s
I20260709 12:14:22.183223  8380 raft_consensus.cc:493] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.021524  8376 raft_consensus.cc:493] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:22.306495  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:22.306917  5267 raft_consensus.cc:2468] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 7.
I20260709 12:14:21.985096  8174 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:22.297454  5194 raft_consensus.cc:2468] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 4.
I20260709 12:14:22.308965  5118 raft_consensus.cc:2955] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 4 to 6, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:14:21.996913  8296 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:22.323244  5266 raft_consensus.cc:1275] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:14:22.345913  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:22.325639  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:22.346962  5120 raft_consensus.cc:2410] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:14:22.325875  5200 raft_consensus.cc:2468] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 8.
I20260709 12:14:22.293555  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:22.280980  8370 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:21.983884  8237 raft_consensus.cc:493] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.336534  5199 raft_consensus.cc:2468] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 8.
I20260709 12:14:22.288487  7647 raft_consensus.cc:515] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:21.853653  8373 consensus_queue.cc:1048] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.509s
I20260709 12:14:22.298869  8216 raft_consensus.cc:3060] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:22.304935  8375 raft_consensus.cc:697] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 5 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:22.341023  5269 raft_consensus.cc:1275] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:14:22.359622  5269 pending_rounds.cc:85] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929: Aborting all ops after (but not including) 5
I20260709 12:14:22.359874  5269 pending_rounds.cc:107] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:14:22.360098  5269 raft_consensus.cc:2889] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:22.340521  5265 raft_consensus.cc:2468] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 6.
I20260709 12:14:22.304584  8195 raft_consensus.cc:493] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:22.330704  8369 raft_consensus.cc:515] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:22.341858  5272 raft_consensus.cc:2468] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 6.
I20260709 12:14:22.307945  8128 leader_election.cc:290] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:14:22.340026  5834 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.009s	sys 0.018s
I20260709 12:14:22.280730  8136 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:22.351254  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:22.366734  5198 raft_consensus.cc:2468] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:14:22.361841  8195 raft_consensus.cc:3060] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:22.349270  5271 raft_consensus.cc:2468] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 6.
I20260709 12:14:22.308385  8349 consensus_queue.cc:1059] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:14:22.280834  8188 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:22.361196  5195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47728 (request call id 2029) took 1577 ms. Trace:
I20260709 12:14:22.273545  8042 raft_consensus.cc:515] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:22.363235  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:22.343580  8361 raft_consensus.cc:2749] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:22.330300  8308 consensus_queue.cc:1059] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
W20260709 12:14:22.365276  5834 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.009s	sys 0.019s
I20260709 12:14:22.376895  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:22.354650  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:22.367880  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:22.369311  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:22.359313  8224 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:22.336534  8372 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:22.371182  5195 rpcz_store.cc:276] 0709 12:14:20.783830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.783965 (+   135us) service_pool.cc:224] Handling call
0709 12:14:20.815269 (+ 31304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:20.838554 (+ 23285us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:14:20.870080 (+ 31526us) log.cc:844] Serialized 14 byte log entry
0709 12:14:21.016307 (+146227us) spinlock_profiling.cc:243] Waited 1.33 ms on lock 0x7b1800401860. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3ab8e07 00007f84ec9139a9 00007f84e3ad569b 00007f84e3ad393f 00007f84e3ad5c02 00007f84e675d20b 00007f84e6762d23 00007f84e676323a 00007f84e6bcda2a
0709 12:14:21.065791 (+ 49484us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:21.674104 (+608313us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b24002c19f8. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e395c9c4 00007f84e395aacb 00007f84e3b15dc9 00007f84e3b15a55 00007f84e3b1509d 00007f84e674710e 00007f84e675e88c 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221
0709 12:14:22.034536 (+360432us) spinlock_profiling.cc:243] Waited 4.52 ms on lock 0x7b1800401860. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3ad63f3 00007f84e3ad87c1 00007f84e3ad8779 00007f84e3ad8709 00007f84e3ad86d1 00007f84e3ad79cd 0000000000388634 0000000000388479 00007f84e3ab983a
0709 12:14:22.036229 (+  1693us) spinlock_profiling.cc:243] Waited 3.14 ms on lock 0x7b2c00010828. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e54bca11 00007f84e54cc372 00007f84e6bfea01 00007f84e6bc343a 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2
0709 12:14:22.048960 (+ 12731us) log.cc:844] Serialized 26 byte log entry
0709 12:14:22.049123 (+   163us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:22.049165 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:22.049241 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:22.360982 (+311741us) raft_consensus.cc:1685] finished
0709 12:14:22.361005 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:22.361127 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22891,"prepare.queue_time_us":34382,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":27281,"raft.run_cpu_time_us":320,"raft.run_wall_time_us":72175,"spinlock_wait_cycles":44922624,"thread_start_us":49273,"threads_started":1,"wal-append.queue_time_us":641924}
I20260709 12:14:22.377882  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:22.379026  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:22.380095  5199 raft_consensus.cc:2410] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:14:22.380180  5192 raft_consensus.cc:2468] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 7.
I20260709 12:14:22.380335  5272 raft_consensus.cc:2468] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:14:22.380519  5266 raft_consensus.cc:2393] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 7: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:22.378958  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:22.358882  8237 raft_consensus.cc:515] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:22.343008  8380 raft_consensus.cc:515] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:22.381366  5267 raft_consensus.cc:2393] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 5: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:22.383512  5272 raft_consensus.cc:1275] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:14:22.387756  5191 raft_consensus.cc:1275] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:14:22.390394  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:22.391175  8372 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:22.392551  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:22.393203  5271 raft_consensus.cc:3060] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:22.395283  8296 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:22.395773  8224 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:22.396184  8375 consensus_queue.cc:237] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:22.398593  8224 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:22.357820  8376 raft_consensus.cc:515] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:22.389231  5831 raft_consensus.cc:2468] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 7.
I20260709 12:14:22.400697  5271 raft_consensus.cc:2468] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 8.
I20260709 12:14:22.389816  5166 leader_election.cc:304] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:22.402508  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:22.403221  5271 raft_consensus.cc:2468] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:14:22.404143  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:22.404757  5271 raft_consensus.cc:3060] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:22.400779  7647 leader_election.cc:290] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:22.411847  5270 raft_consensus.cc:1275] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:14:22.417238  8394 raft_consensus.cc:493] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.418023  8394 raft_consensus.cc:515] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:22.420624  8394 leader_election.cc:290] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:22.421257  8394 raft_consensus.cc:2804] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:22.421628  8394 raft_consensus.cc:493] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:22.422006  8394 raft_consensus.cc:3060] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:22.427984  5270 raft_consensus.cc:1217] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Deduplicated request from leader. Original: 3.2->[4.3-6.4]   Dedup: 4.3->[6.4-6.4]
I20260709 12:14:22.428751  5270 raft_consensus.cc:1240] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 12:14:22.430428  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:22.431320  5272 raft_consensus.cc:3060] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:22.432205  5270 raft_consensus.cc:1240] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 7 LEADER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:22.434823  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:22.435469  5266 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 8.
I20260709 12:14:22.400995  8376 leader_election.cc:290] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:22.401858  8256 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.406263  8010 raft_consensus.cc:493] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:22.459183  8174 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:22.433555  8370 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:22.425715  8313 consensus_queue.cc:1048] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:14:22.469728  8354 consensus_queue.cc:1048] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:22.427693  7647 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:22.484936  8256 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:22.490351  7647 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:22.470990  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:22.491549  8010 raft_consensus.cc:515] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:22.492264  8256 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:22.494441  8385 log.cc:927] Time spent T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 12:14:22.471520  8376 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.474062  5267 raft_consensus.cc:1275] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:14:22.473779  8312 raft_consensus.cc:493] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:22.472280  8357 log.cc:927] Time spent T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 1.174s	user 0.005s	sys 0.016s
W20260709 12:14:22.504356  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 239838us
I20260709 12:14:22.506162  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:22.506222  5271 raft_consensus.cc:2468] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:14:22.508024  5124 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:22.509442  5237 leader_election.cc:304] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:22.445444  8369 leader_election.cc:290] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:22.512784  5237 leader_election.cc:304] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:22.520609  5197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41416 (request call id 567) took 1874 ms. Trace:
I20260709 12:14:22.521057  8380 leader_election.cc:290] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:22.521086  5197 rpcz_store.cc:276] 0709 12:14:20.645897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:20.646056 (+   159us) service_pool.cc:224] Handling call
0709 12:14:20.646424 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:20.666132 (+ 19708us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:20.666163 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:20.676611 (+ 10448us) log.cc:844] Serialized 26 byte log entry
0709 12:14:21.033681 (+357070us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:21.033724 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:21.033791 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:22.471664 (+1437873us) spinlock_profiling.cc:243] Waited 22.7 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e675e86e 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221 00007f84e67671d9 00007f84e6767169
0709 12:14:22.520287 (+ 48623us) raft_consensus.cc:1685] finished
0709 12:14:22.520310 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:22.520535 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14393,"raft.queue_time_us":19817,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":5657,"spinlock_wait_cycles":52170112,"thread_start_us":331555,"threads_started":1,"wal-append.queue_time_us":444077}
I20260709 12:14:22.522804  8337 leader_election.cc:290] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:22.513641  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:14:22.524921  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 50376us
W20260709 12:14:22.600725  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 75599.7us
W20260709 12:14:22.598848  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 196543us
I20260709 12:14:22.523882  8290 raft_consensus.cc:2749] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:22.586298  8174 raft_consensus.cc:3060] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:22.604688  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 188853us
I20260709 12:14:22.587523  8380 raft_consensus.cc:493] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.586644  8237 leader_election.cc:290] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:22.510563  8312 raft_consensus.cc:515] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:22.602454  5089 leader_election.cc:304] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:22.610893  5272 raft_consensus.cc:2468] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:14:22.612236  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:14:22.613348  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 288057us
I20260709 12:14:22.512123  8376 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:22.625854  5272 raft_consensus.cc:1275] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:22.608587  8308 raft_consensus.cc:493] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.628716  5272 raft_consensus.cc:1275] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:14:22.632560  5267 raft_consensus.cc:1240] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:22.633369  5272 raft_consensus.cc:1275] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:14:22.633603  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:22.635509  5164 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:22.641134  5089 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:22.632144  8370 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:22.642113  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:22.635624  8395 raft_consensus.cc:2804] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:14:22.643731  8378 log.cc:927] Time spent T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.437s	user 0.004s	sys 0.002s
I20260709 12:14:22.635398  7849 consensus_queue.cc:1059] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 12:14:22.617937  8350 consensus_queue.cc:1048] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:14:22.649843  8322 leader_election.cc:290] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:22.656695  8313 raft_consensus.cc:493] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.625216  8188 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:22.658010  8401 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
W20260709 12:14:22.731148  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 116984us
I20260709 12:14:22.662817  8312 leader_election.cc:290] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:22.629987  7644 raft_consensus.cc:493] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.666791  8337 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:22.668359  8256 raft_consensus.cc:493] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.672013  5124 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 6.
I20260709 12:14:22.617551  8290 raft_consensus.cc:493] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:22.675310  8375 raft_consensus.cc:493] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:22.676036  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 44877.3us
I20260709 12:14:22.675604  8396 raft_consensus.cc:2749] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:22.677871  5272 raft_consensus.cc:1275] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:14:22.828748  5164 leader_election.cc:304] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:22.679239  5267 raft_consensus.cc:1275] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:14:22.681121  8376 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:22.834830  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:22.835220  5195 raft_consensus.cc:1275] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:22.835549  5272 raft_consensus.cc:2468] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 7.
W20260709 12:14:22.684278  5163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:22.685992  8136 raft_consensus.cc:3055] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:22.612767  8380 raft_consensus.cc:515] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:22.690279  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:22.692962  8388 raft_consensus.cc:3055] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:22.694133  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:22.725502  8370 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:22.842206  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:22.674381  8243 raft_consensus.cc:493] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:22.696744  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:22.842948  5271 raft_consensus.cc:2468] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 8.
I20260709 12:14:22.699007  5274 raft_consensus.cc:1275] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:14:22.842938  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 108743us
I20260709 12:14:22.701967  8394 raft_consensus.cc:515] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:22.638705  8308 raft_consensus.cc:515] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:22.668373  8216 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:22.726778  5266 raft_consensus.cc:1240] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 12:14:22.728446  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 79074us
I20260709 12:14:22.850124  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:22.850751  5270 raft_consensus.cc:2468] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:14:22.851521  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:22.728931  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:22.852108  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:22.727499  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 62533.4us
I20260709 12:14:22.658989  8372 raft_consensus.cc:3055] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:22.743376  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:22.853188  5265 raft_consensus.cc:2410] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:14:22.853402  5196 raft_consensus.cc:2468] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:14:22.745074  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:22.746279  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:22.855301  5191 raft_consensus.cc:2393] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 7: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:22.731554  8322 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.866330  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:22.867151  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:22.827160  8290 raft_consensus.cc:515] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:22.741048  8188 raft_consensus.cc:2804] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:22.760165  5192 raft_consensus.cc:1275] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:14:22.760501  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:22.760535  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:22.827801  5240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:22.852926  8372 raft_consensus.cc:740] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:22.831921  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:22.872547  5193 raft_consensus.cc:2468] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 8.
I20260709 12:14:22.831902  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:22.836969  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:22.841872  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:22.687315  8010 leader_election.cc:290] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:22.846556  5274 raft_consensus.cc:1275] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:14:22.847501  5164 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
W20260709 12:14:22.878299  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 150231us
I20260709 12:14:22.849048  5271 raft_consensus.cc:1275] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:14:22.852061  5270 raft_consensus.cc:2376] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 8. Re-sending same reply.
I20260709 12:14:22.834167  8398 raft_consensus.cc:2749] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:22.760070  8337 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:22.733814  8313 raft_consensus.cc:515] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:22.884959  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:22.867936  5088 leader_election.cc:304] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:22.874365  5272 raft_consensus.cc:2468] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 5.
I20260709 12:14:22.875020  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:22.836566  8136 raft_consensus.cc:740] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:22.876091  5195 raft_consensus.cc:1275] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:14:22.761740  7644 raft_consensus.cc:515] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:22.841848  8395 raft_consensus.cc:697] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:22.880019  5164 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:22.841238  8388 raft_consensus.cc:740] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:22.765625  7647 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:22.882712  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:22.912254  5267 raft_consensus.cc:2468] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3.
I20260709 12:14:22.884595  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:22.913267  5274 raft_consensus.cc:3060] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:22.867127  5124 raft_consensus.cc:2468] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 7.
I20260709 12:14:22.872820  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:22.913288  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:22.914865  5197 raft_consensus.cc:2468] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 6.
I20260709 12:14:22.853631  8404 consensus_queue.cc:1048] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:14:22.850134  8243 raft_consensus.cc:515] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:22.891049  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:22.875761  8188 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:22.834715  8375 raft_consensus.cc:515] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:22.897512  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:22.898172  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:22.900564  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:22.902554  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:22.915191  5268 raft_consensus.cc:2393] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 6: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:22.888330  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:22.917351  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:22.918045  8414 raft_consensus.cc:2804] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:22.919875  8216 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:22.922554  8313 leader_election.cc:290] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:22.923031  8195 consensus_meta.cc:287] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.551s	user 0.012s	sys 0.005s
I20260709 12:14:22.923504  8136 consensus_queue.cc:260] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:22.925745  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:22.926604  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:22.884433  8415 raft_consensus.cc:493] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.740990  8401 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:22.836453  8256 raft_consensus.cc:515] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:22.869104  8302 consensus_queue.cc:1048] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:14:22.872306  8322 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:23.257145  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:23.258656  5266 raft_consensus.cc:2410] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:14:22.888428  8396 raft_consensus.cc:2749] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:23.053310  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:23.234861  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 355304us
I20260709 12:14:22.888794  8174 raft_consensus.cc:2749] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:23.117759  5274 raft_consensus.cc:2468] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 7.
I20260709 12:14:23.275854  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:23.276773  5270 raft_consensus.cc:2468] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
I20260709 12:14:23.000196  5267 raft_consensus.cc:1275] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:14:23.277232  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:23.277978  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:23.262741  5265 raft_consensus.cc:3060] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:23.257193  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:23.260885  5199 raft_consensus.cc:3060] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:23.269613  5124 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 6.
I20260709 12:14:23.275854  5268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34672 (request call id 1927) took 1262 ms. Trace:
I20260709 12:14:22.940614  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:23.279837  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:23.280072  5267 raft_consensus.cc:2376] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6. Re-sending same reply.
W20260709 12:14:23.270557  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 402655us
W20260709 12:14:23.286540  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 391057us
I20260709 12:14:23.276674  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:23.275426  5119 raft_consensus.cc:1240] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:23.278546  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:23.287866  5194 raft_consensus.cc:2393] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 6: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
W20260709 12:14:23.282006  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 436839us
I20260709 12:14:23.312934  5273 raft_consensus.cc:2468] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 8.
I20260709 12:14:23.283748  5268 rpcz_store.cc:276] 0709 12:14:21.998043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:21.998225 (+   182us) service_pool.cc:224] Handling call
0709 12:14:22.913145 (+914920us) spinlock_profiling.cc:243] Waited 4.21 ms on lock 0x7b5800190b98. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb890a0 00007f84ebb88984 00007f84e51036d4 00007f84e5103662
0709 12:14:23.260427 (+347282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9682176}
I20260709 12:14:23.325460  5195 raft_consensus.cc:1275] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:14:22.928318  8010 raft_consensus.cc:2804] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:23.332332  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:23.050810  7644 leader_election.cc:290] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:23.206748  8400 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:23.268484  8403 raft_consensus.cc:493] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.275467  8313 raft_consensus.cc:493] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:23.259989  8188 raft_consensus.cc:3060] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:23.340242  5199 raft_consensus.cc:2468] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 5.
I20260709 12:14:23.268937  8414 raft_consensus.cc:493] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:23.045915  8405 consensus_queue.cc:1048] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.316s
I20260709 12:14:23.333662  5266 raft_consensus.cc:2468] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 9.
I20260709 12:14:23.303323  8380 leader_election.cc:290] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:23.304004  8136 raft_consensus.cc:3060] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:23.270614  8302 consensus_queue.cc:1243] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer ad2f9a1e2f7a45429fa69fd23d09f821 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:14:23.275025  8195 raft_consensus.cc:515] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:23.311857  8354 consensus_queue.cc:1059] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.108s
I20260709 12:14:22.999007  8372 consensus_queue.cc:260] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:23.444022  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 157277us
I20260709 12:14:23.059087  8395 consensus_queue.cc:237] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:23.460031  5088 leader_election.cc:304] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:23.463109  5269 raft_consensus.cc:2468] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 7.
I20260709 12:14:23.443454  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:23.333123  8010 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:23.451107  8340 leader_election.cc:290] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:23.275331  8415 raft_consensus.cc:515] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:23.059584  8388 consensus_queue.cc:260] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:23.513450  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:23.456099  8419 raft_consensus.cc:493] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.532928  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:23.331570  8370 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:23.546849  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 86802.5us
I20260709 12:14:23.551203  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:23.566844  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:23.456336  5265 raft_consensus.cc:2468] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 8.
I20260709 12:14:23.586850  5267 raft_consensus.cc:2376] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6. Re-sending same reply.
W20260709 12:14:23.546903  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:23.589349  5270 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 7.
I20260709 12:14:23.585714  5088 leader_election.cc:304] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:23.488678  8354 raft_consensus.cc:2804] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:23.451426  8216 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.451880  8406 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.456674  8337 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:23.465562  8414 raft_consensus.cc:3060] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:23.420547  8313 raft_consensus.cc:515] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:23.694478  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:23.608973  8308 leader_election.cc:290] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:23.611673  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:23.618021  8290 leader_election.cc:290] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:23.623080  8256 leader_election.cc:290] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:23.625079  8415 leader_election.cc:290] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:23.630149  8322 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:23.630797  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:23.631762  8401 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:23.636159  5163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:23.692531  8340 raft_consensus.cc:2804] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:23.601446  5088 leader_election.cc:304] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:23.690061  8354 raft_consensus.cc:493] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:23.636212  5272 raft_consensus.cc:2410] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
W20260709 12:14:23.683753  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:23.684175  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 43680.6us
I20260709 12:14:23.684482  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:23.417636  8394 leader_election.cc:290] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:23.365805  8416 raft_consensus.cc:493] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:23.592630  8372 raft_consensus.cc:3060] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:23.546262  8195 leader_election.cc:290] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:23.435350  8369 consensus_queue.cc:1059] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.165s
I20260709 12:14:23.515657  8010 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:22.927369  8398 consensus_queue.cc:1048] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.437s
I20260709 12:14:23.689481  5237 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:23.728888  8042 leader_election.cc:290] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:23.472865  8411 consensus_queue.cc:1048] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.227s
W20260709 12:14:23.696225  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 405433us
I20260709 12:14:23.732569  8354 raft_consensus.cc:3060] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:23.697754  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:23.765486  5164 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:23.765689  5833 raft_consensus.cc:2468] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 5.
W20260709 12:14:23.695959  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 394011us
I20260709 12:14:23.665469  8388 raft_consensus.cc:3060] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:23.766726  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:23.698478  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:23.768221  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:23.716133  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:23.769212  5829 raft_consensus.cc:2468] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
I20260709 12:14:23.770154  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:23.770831  5829 raft_consensus.cc:2468] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 7.
I20260709 12:14:23.664626  7849 raft_consensus.cc:493] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:23.717481  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:23.717775  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:23.772285  7849 raft_consensus.cc:515] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:23.774794  7849 leader_election.cc:290] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:23.717291  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:23.718061  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:23.776737  5835 raft_consensus.cc:1275] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:14:23.686934  8392 raft_consensus.cc:493] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.725946  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:23.691956  8408 raft_consensus.cc:493] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:23.727501  5163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:23.636775  8375 leader_election.cc:290] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:23.729760  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 128408us
I20260709 12:14:23.473557  8404 raft_consensus.cc:493] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.719066  8431 raft_consensus.cc:493] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.732623  5089 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
W20260709 12:14:23.759362  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 69985.7us
I20260709 12:14:23.691220  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:23.734421  8243 leader_election.cc:290] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:23.732018  8256 raft_consensus.cc:2804] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:23.696033  8216 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:23.772552  5837 raft_consensus.cc:2468] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 7.
I20260709 12:14:23.384488  8403 raft_consensus.cc:515] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:23.723965  5804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:23.788964  5191 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.777s	user 0.014s	sys 0.015s
W20260709 12:14:23.807349  5191 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.795s	user 0.014s	sys 0.015s
I20260709 12:14:23.782677  5237 leader_election.cc:304] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:14:23.841081  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 58465.4us
W20260709 12:14:23.781607  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 49040.2us
I20260709 12:14:23.782191  5088 leader_election.cc:304] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:23.746315  8340 raft_consensus.cc:697] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:23.762178  8369 consensus_queue.cc:1243] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer 9e794b72ed7640219f90ec4232363929 log is divergent from this leader: its last log entry 9.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:14:23.808274  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:23.760699  5123 raft_consensus.cc:2468] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 8.
I20260709 12:14:23.761849  8024 raft_consensus.cc:2749] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:14:23.839118  5163 leader_election.cc:336] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 1.537s (SENT)
I20260709 12:14:23.865103  5163 leader_election.cc:304] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:14:23.866405  5163 leader_election.cc:336] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 1.564s (SENT)
W20260709 12:14:23.868127  5163 leader_election.cc:336] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 1.811s (SENT)
I20260709 12:14:23.868366  5166 leader_election.cc:304] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:23.868517  5163 leader_election.cc:304] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:23.787994  8418 raft_consensus.cc:2804] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:23.879030  5118 raft_consensus.cc:1240] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 LEADER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 12:14:23.890969  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:23.890482  5834 raft_consensus.cc:2393] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 7: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:23.788327  8256 raft_consensus.cc:493] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
W20260709 12:14:23.844527  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 62403.2us
I20260709 12:14:23.789317  8042 raft_consensus.cc:2749] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:23.845738  8388 raft_consensus.cc:493] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.847255  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:23.898308  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:23.845654  8290 raft_consensus.cc:2749] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:23.850247  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:23.852255  8340 consensus_queue.cc:237] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:23.914736  8427 log.cc:927] Time spent T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 12:14:23.755543  8416 raft_consensus.cc:515] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:23.916225  8403 leader_election.cc:290] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:23.365872  8400 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:23.858152  8423 log.cc:927] Time spent T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:14:23.916805  8311 consensus_queue.cc:1059] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:23.917277  8416 leader_election.cc:290] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:23.873353  8322 raft_consensus.cc:2749] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:23.918596  8400 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:23.895486  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:23.897164  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:23.919337  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:23.919724  5192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47728 (request call id 2053) took 1020 ms. Trace:
I20260709 12:14:23.919850  5274 raft_consensus.cc:2468] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 6.
I20260709 12:14:23.848385  5199 raft_consensus.cc:1275] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:14:23.873497  8394 raft_consensus.cc:2749] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:23.870335  8337 raft_consensus.cc:2804] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:23.878296  7849 raft_consensus.cc:2804] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:23.901580  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:23.903020  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
W20260709 12:14:23.924926  5240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:23.920161  5192 rpcz_store.cc:276] 0709 12:14:22.898878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:22.898993 (+   115us) service_pool.cc:224] Handling call
0709 12:14:22.917746 (+ 18753us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:23.000718 (+ 82972us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:23.000752 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:23.001251 (+   499us) log.cc:844] Serialized 26 byte log entry
0709 12:14:23.327462 (+326211us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:23.686790 (+359328us) log.cc:844] Serialized 14 byte log entry
0709 12:14:23.687069 (+   279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:23.687138 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:23.919494 (+232356us) raft_consensus.cc:1685] finished
0709 12:14:23.919513 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:23.919670 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":88739,"prepare.queue_time_us":481491,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":83699,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":11911,"thread_start_us":518621,"threads_started":2,"wal-append.queue_time_us":700008}
I20260709 12:14:23.925487  5837 raft_consensus.cc:2368] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 7. Current term is 8.
I20260709 12:14:23.907253  5164 leader_election.cc:304] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:23.909314  5089 leader_election.cc:304] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:23.899538  5163 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:23.781453  8431 raft_consensus.cc:515] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:23.905326  5194 raft_consensus.cc:2468] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 8.
I20260709 12:14:23.898542  8237 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:23.903473  7647 consensus_queue.cc:1048] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 12:14:23.927793  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:23.928231  8237 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:23.930347  8237 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:23.931042  8431 leader_election.cc:290] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:23.932010  5838 raft_consensus.cc:1275] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:23.807237  5801 leader_election.cc:304] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:23.919380  5836 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 5.
W20260709 12:14:23.933905  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 126773us
I20260709 12:14:23.923571  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:23.935158  5125 raft_consensus.cc:2468] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 5.
I20260709 12:14:23.935851  5801 leader_election.cc:304] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:23.936232  8417 raft_consensus.cc:2804] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:23.934160  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:23.936643  8416 raft_consensus.cc:2804] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:23.936714  8417 raft_consensus.cc:493] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:23.936002  8400 consensus_queue.cc:1048] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:23.937515  8417 raft_consensus.cc:3060] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:23.938982  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:23.939309  8434 log.cc:927] Time spent T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:14:23.939936  5266 raft_consensus.cc:2468] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 7.
I20260709 12:14:23.597409  8419 raft_consensus.cc:515] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:23.940371  5117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40386 (request call id 1834) took 1089 ms. Trace:
I20260709 12:14:23.936038  5089 leader_election.cc:304] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:23.940853  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:23.937162  8416 raft_consensus.cc:493] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:23.934410  8431 raft_consensus.cc:2749] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:23.929292  8216 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:23.940991  5831 raft_consensus.cc:2393] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 5: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:23.942508  8416 raft_consensus.cc:3060] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:23.940764  5117 rpcz_store.cc:276] 0709 12:14:22.851417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:22.852406 (+   989us) service_pool.cc:224] Handling call
0709 12:14:22.878199 (+ 25793us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:23.236444 (+358245us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:14:23.236480 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:23.237009 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 12:14:23.684899 (+447890us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:23.684934 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:23.684997 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:23.940152 (+255155us) raft_consensus.cc:1685] finished
0709 12:14:23.940171 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:23.940292 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":34329,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":24195,"thread_start_us":696733,"threads_started":2,"wal-append.queue_time_us":486175}
I20260709 12:14:23.940284  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:23.945963  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
W20260709 12:14:23.859359  8426 log.cc:927] Time spent T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 12:14:23.881709  8418 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:23.711807  8406 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:23.781347  8404 raft_consensus.cc:515] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:23.992365  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 92905.9us
I20260709 12:14:23.900444  8256 raft_consensus.cc:3060] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:24.009716  5163 leader_election.cc:304] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
W20260709 12:14:24.008906  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 101739us
I20260709 12:14:23.951093  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:14:23.968781  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:23.942446  5274 raft_consensus.cc:2468] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 5.
I20260709 12:14:24.013913  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:24.015147  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:24.015733  5274 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 8.
I20260709 12:14:24.016582  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:23.948514  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:14:23.981810  5801 connection.cc:256] RPC call timeout handler was delayed by -1.0619584080000095s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1532s for a response
I20260709 12:14:23.778415  8392 raft_consensus.cc:515] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:23.779680  8408 raft_consensus.cc:515] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:24.017933  5801 connection.cc:256] RPC call timeout handler was delayed by -1.0619584080000095s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1532s for a response
I20260709 12:14:23.946687  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:24.031806  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:24.018219  5268 raft_consensus.cc:1275] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:14:24.029736  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:24.019379  5164 leader_election.cc:304] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:24.017976  5267 raft_consensus.cc:2468] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 3.
I20260709 12:14:24.012771  8418 raft_consensus.cc:3060] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:24.065515  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:24.060065  8313 leader_election.cc:290] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:24.066234  5267 raft_consensus.cc:2393] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 6: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:24.001546  5125 raft_consensus.cc:2410] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:14:24.032907  5268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34674 (request call id 2096) took 1108 ms. Trace:
I20260709 12:14:23.918731  8388 raft_consensus.cc:515] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:24.044407  5273 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50932 (request call id 624) took 1354 ms (client timeout 1532 ms). Trace:
I20260709 12:14:24.034015  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:24.034488  5163 leader_election.cc:304] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:24.037177  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:24.074023  5265 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 7.
I20260709 12:14:24.042941  5274 raft_consensus.cc:2468] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 7.
I20260709 12:14:23.890468  8432 consensus_queue.cc:1048] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.158s
W20260709 12:14:24.078325  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 43898.9us
I20260709 12:14:24.040406  8290 consensus_queue.cc:1048] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:14:24.037118  8431 consensus_queue.cc:1048] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 12:14:24.055596  5200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47728 (request call id 2056) took 1154 ms. Trace:
I20260709 12:14:24.055917  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:24.038044  5830 raft_consensus.cc:2468] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 8.
I20260709 12:14:24.034420  5801 leader_election.cc:304] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:24.082371  5266 raft_consensus.cc:2393] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 6: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
W20260709 12:14:24.082597  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 48251.1us
I20260709 12:14:24.083283  5801 leader_election.cc:304] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:24.057062  8337 raft_consensus.cc:493] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:24.056764  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:24.083824  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:24.030001  8217 raft_consensus.cc:2804] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:23.992028  8237 raft_consensus.cc:493] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:23.942013  8419 leader_election.cc:290] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:24.066045  8340 raft_consensus.cc:2804] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:24.042536  8216 consensus_queue.cc:1048] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:14:24.058815  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:24.060648  5237 leader_election.cc:304] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:24.061604  5833 raft_consensus.cc:2468] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:14:24.059532  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:24.008792  7849 raft_consensus.cc:697] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:24.063014  5832 raft_consensus.cc:2410] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:14:23.903928  8376 consensus_queue.cc:1059] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.134s
I20260709 12:14:24.060534  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:23.993772  8243 consensus_queue.cc:1048] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.089s
I20260709 12:14:23.903736  8429 raft_consensus.cc:493] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:24.066962  5268 rpcz_store.cc:276] 0709 12:14:22.924670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:23.924529 (+999859us) service_pool.cc:224] Handling call
0709 12:14:24.017917 (+ 93388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:24.032625 (+ 14708us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:24.032843 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:24.067745  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 121699us
I20260709 12:14:24.075681  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:14:24.069532  5273 rpcz_store.cc:269] 0709 12:14:22.689847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:22.690007 (+   160us) service_pool.cc:224] Handling call
0709 12:14:24.044208 (+1354201us) spinlock_profiling.cc:243] Waited 474 ms on lock 0x7b54000d2354. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:24.044341 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1089443584}
I20260709 12:14:24.077064  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:24.042775  8403 raft_consensus.cc:2804] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:24.078203  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:24.044334  5238 leader_election.cc:400] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 election: Vote denied by peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539) with higher term. Message: Invalid argument: T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 7. Current term is 8.
W20260709 12:14:24.070016  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 149021us
W20260709 12:14:24.066789  8420 log.cc:927] Time spent T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:14:24.084524  5121 raft_consensus.cc:2410] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
W20260709 12:14:24.076994  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 57691.1us
I20260709 12:14:24.085505  5163 leader_election.cc:304] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:24.084712  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:24.197016  5164 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:24.197173  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:24.085557  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:24.081885  8322 raft_consensus.cc:2749] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:24.036561  8394 consensus_queue.cc:1048] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:14:24.081964  5200 rpcz_store.cc:276] 0709 12:14:22.901263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:22.901397 (+   134us) service_pool.cc:224] Handling call
0709 12:14:22.901677 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:22.935697 (+ 34020us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:22.935739 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:22.999257 (+ 63518us) log.cc:844] Serialized 26 byte log entry
0709 12:14:23.443214 (+443957us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:23.638958 (+195744us) spinlock_profiling.cc:243] Waited 1.69 ms on lock 0x7b4800061ed8. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ebaecaa1 00007f84ebae3b37 00007f84ebae39ca 00007f84ebbdb26f 00007f84ebbdaf37 00007f84ebbef55c 00007f84ebbef508 00007f84ebbef488 00007f84ebbef443 00007f84ebbee6ec 00007f84eab18a96
0709 12:14:23.733064 (+ 94106us) log.cc:844] Serialized 14 byte log entry
0709 12:14:23.733305 (+   241us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:23.733399 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:24.055251 (+321852us) raft_consensus.cc:1685] finished
0709 12:14:24.055376 (+   125us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:24.055526 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37701,"prepare.queue_time_us":433047,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":101940,"raft.run_cpu_time_us":21068,"raft.run_wall_time_us":683927,"spinlock_wait_cycles":3891456,"thread_start_us":477804,"threads_started":2,"wal-append.queue_time_us":621937}
I20260709 12:14:24.062723  8136 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:24.166672  5836 raft_consensus.cc:3060] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:24.168509  5837 raft_consensus.cc:3060] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:24.114073  5804 leader_election.cc:304] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:24.188578  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:24.166602  8340 raft_consensus.cc:493] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:24.090965  8313 raft_consensus.cc:2749] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:24.190155  5267 raft_consensus.cc:2468] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 8.
W20260709 12:14:24.191156  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:24.190975  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:24.079566  7647 raft_consensus.cc:2749] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:24.089201  8400 raft_consensus.cc:2804] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:24.192373  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:24.210799  5273 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 7.
I20260709 12:14:24.211018  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:14:24.194139  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 149972us
I20260709 12:14:24.089512  8217 raft_consensus.cc:493] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:24.195737  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:24.086206  5801 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:24.198241  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:24.087039  8337 raft_consensus.cc:3060] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:24.203244  5119 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 6.
I20260709 12:14:24.189465  5274 raft_consensus.cc:2468] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 10.
I20260709 12:14:24.090610  8369 consensus_queue.cc:1048] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.102s
I20260709 12:14:24.204705  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:24.240984  5116 raft_consensus.cc:3060] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:24.205984  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:24.205824  5266 raft_consensus.cc:2468] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 6.
W20260709 12:14:24.176452  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 115870us
I20260709 12:14:24.242551  5267 raft_consensus.cc:2468] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 7.
W20260709 12:14:24.210062  8407 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.190s	user 0.009s	sys 0.015s
W20260709 12:14:24.219058  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 132915us
I20260709 12:14:24.165004  8237 raft_consensus.cc:515] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:24.194729  8403 raft_consensus.cc:493] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:24.202060  8390 raft_consensus.cc:2804] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:24.217705  8400 raft_consensus.cc:493] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:24.273708  8400 raft_consensus.cc:3060] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:24.275019  8388 leader_election.cc:290] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:24.276620  8416 raft_consensus.cc:515] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:24.207249  8340 raft_consensus.cc:3060] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:24.278548  8452 raft_consensus.cc:3055] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:24.279016  8452 raft_consensus.cc:740] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
W20260709 12:14:24.280318  8188 consensus_meta.cc:287] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.807s	user 0.009s	sys 0.000s
W20260709 12:14:24.245136  8407 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.240s	user 0.010s	sys 0.015s
I20260709 12:14:24.211911  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:24.256289  5267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34668
I20260709 12:14:24.238806  8424 raft_consensus.cc:493] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:24.279845  8452 consensus_queue.cc:260] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:24.248958  5119 raft_consensus.cc:1275] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:14:24.201496  8429 raft_consensus.cc:515] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:24.274016  8448 log.cc:927] Time spent T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 12:14:24.265400  5268 raft_consensus.cc:2955] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 4 to 6, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
W20260709 12:14:24.272477  8440 log.cc:927] Time spent T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 12:14:24.272991  8438 log.cc:927] Time spent T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.210s	user 0.000s	sys 0.001s
I20260709 12:14:24.266259  8403 raft_consensus.cc:3060] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:24.239421  8217 raft_consensus.cc:3060] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:24.219280  8419 raft_consensus.cc:2749] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:24.282653  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 70566us
I20260709 12:14:24.282907  5116 raft_consensus.cc:2468] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 8.
I20260709 12:14:24.280768  8188 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:24.245216  8431 raft_consensus.cc:2804] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:24.290942  5837 raft_consensus.cc:2468] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 6.
I20260709 12:14:24.092450  8410 consensus_queue.cc:1048] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.130s
I20260709 12:14:24.281706  5267 raft_consensus.cc:606] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Received request to transfer leadership
I20260709 12:14:24.265334  8390 raft_consensus.cc:493] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:24.207053  8136 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:24.293324  8439 log.cc:927] Time spent T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
W20260709 12:14:24.268373  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 154511us
I20260709 12:14:24.330209  5267 raft_consensus.cc:614] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:24.341624  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:24.329530  5836 raft_consensus.cc:2468] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 6.
W20260709 12:14:24.336980  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 142759us
I20260709 12:14:24.334496  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:24.301528  8428 consensus_queue.cc:1048] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:14:24.295220  8424 raft_consensus.cc:515] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:24.365638  5837 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:24.366219  5088 leader_election.cc:304] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:24.368413  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:24.369115  5122 raft_consensus.cc:2468] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 9.
I20260709 12:14:24.324024  8375 raft_consensus.cc:493] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:24.370357  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:24.370996  5122 raft_consensus.cc:2468] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 6.
I20260709 12:14:24.370926  8375 raft_consensus.cc:515] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:24.327175  8431 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:24.374713  5238 leader_election.cc:304] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:24.372083  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:24.368445  5117 raft_consensus.cc:2393] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 7: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:24.373795  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:14:24.366012  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 176922us
I20260709 12:14:24.380478  5804 leader_election.cc:304] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:24.375974  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:24.341248  8390 raft_consensus.cc:3060] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:24.383514  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:24.383546  5804 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:24.383819  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:24.292553  7849 consensus_queue.cc:237] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:24.390131  5088 connection.cc:256] RPC call timeout handler was delayed by -1.6968736610001542s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1995s for a response
I20260709 12:14:24.390738  5837 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 6.
I20260709 12:14:24.391337  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:24.392117  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:24.394201  5124 raft_consensus.cc:2468] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 7.
I20260709 12:14:24.395360  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:24.396014  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:24.375183  8431 raft_consensus.cc:3060] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:24.397066  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:24.397666  5836 raft_consensus.cc:2468] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 9.
I20260709 12:14:24.398440  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:24.399501  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:24.400557  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:24.401253  5838 raft_consensus.cc:3060] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:24.405721  8431 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:24.408195  8431 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:24.410997  5838 raft_consensus.cc:2468] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 8.
I20260709 12:14:24.412094  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:24.412819  8188 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:24.413578  5838 raft_consensus.cc:1240] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 4. Current term is 5. Ops: []
W20260709 12:14:24.415599  5088 connection.cc:256] RPC call timeout handler was delayed by -1.2743725860000268s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15610000000000002s for a response
W20260709 12:14:24.416009  5088 connection.cc:256] RPC call timeout handler was delayed by -1.229372585999954s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16110000000000002s for a response
W20260709 12:14:24.416296  5088 connection.cc:256] RPC call timeout handler was delayed by -1.2248725859999468s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16160000000000002s for a response
W20260709 12:14:24.416535  5088 connection.cc:256] RPC call timeout handler was delayed by -1.1754542549999769s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15990000000000001s for a response
W20260709 12:14:24.416764  5088 connection.cc:256] RPC call timeout handler was delayed by -1.1753725860000941s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16710000000000003s for a response
W20260709 12:14:24.417001  5088 connection.cc:256] RPC call timeout handler was delayed by -1.1294725860000199s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17220000000000002s for a response
W20260709 12:14:24.419335  5088 connection.cc:256] RPC call timeout handler was delayed by -1.076372585999934s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1781s for a response
W20260709 12:14:24.419668  5088 connection.cc:256] RPC call timeout handler was delayed by -1.0356584820001444s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1644s for a response
I20260709 12:14:24.421173  8457 consensus_queue.cc:1048] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:24.422780  8431 raft_consensus.cc:2804] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:24.373037  8408 leader_election.cc:290] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:24.428843  5834 raft_consensus.cc:1240] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:24.433923  8400 raft_consensus.cc:515] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:24.434441  5834 raft_consensus.cc:1240] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:24.435325  8417 raft_consensus.cc:515] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:24.435892  5269 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34674 (request call id 2078) took 1796 ms (client timeout 1919 ms). Trace:
W20260709 12:14:24.436268  5269 rpcz_store.cc:269] 0709 12:14:22.639675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:22.639832 (+   157us) service_pool.cc:224] Handling call
0709 12:14:24.435690 (+1795858us) spinlock_profiling.cc:243] Waited 595 ms on lock 0x7b5400256cd4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:24.435821 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1369584384}
I20260709 12:14:24.437049  8421 raft_consensus.cc:3055] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:14:24.437515  8421 raft_consensus.cc:740] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
W20260709 12:14:24.437781  5272 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34674 (request call id 2098) took 1512 ms (client timeout 1644 ms). Trace:
I20260709 12:14:24.438169  8237 leader_election.cc:290] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:24.438341  8421 consensus_queue.cc:260] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:24.439373  8421 raft_consensus.cc:3060] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:24.432750  5831 raft_consensus.cc:1275] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:14:24.423496  8042 raft_consensus.cc:3055] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:24.440975  8042 raft_consensus.cc:740] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:24.441045  8136 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:24.393954  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:24.335980  8406 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:24.477150  8452 raft_consensus.cc:3060] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:24.438194  5272 rpcz_store.cc:269] 0709 12:14:22.925193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:23.276963 (+351770us) service_pool.cc:224] Handling call
0709 12:14:24.437580 (+1160617us) spinlock_profiling.cc:243] Waited 358 ms on lock 0x7b54000a6c54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:24.437719 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":823334144}
I20260709 12:14:24.423249  8431 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:24.427248  8178 raft_consensus.cc:2804] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:24.544615  5836 raft_consensus.cc:2393] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 9: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
W20260709 12:14:24.430598  8010 consensus_meta.cc:287] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.648s	user 0.008s	sys 0.010s
I20260709 12:14:24.470340  8410 consensus_queue.cc:1048] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:24.441787  5271 raft_consensus.cc:1275] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:14:24.460026  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:24.441848  8042 consensus_queue.cc:260] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:24.475927  5088 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:24.479349  5118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40402 (request call id 2155) took 1806 ms. Trace:
I20260709 12:14:24.490693  5274 raft_consensus.cc:2376] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 3. Re-sending same reply.
W20260709 12:14:24.562889  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 87024.7us
I20260709 12:14:24.457801  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:24.563809  5266 raft_consensus.cc:2468] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
W20260709 12:14:24.462585  8453 log.cc:927] Time spent T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
I20260709 12:14:24.564445  8237 raft_consensus.cc:2804] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:24.564920  8237 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:24.458405  8313 raft_consensus.cc:2804] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:24.459992  8429 leader_election.cc:290] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:24.463372  8454 log.cc:927] Time spent T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
I20260709 12:14:24.565315  8237 raft_consensus.cc:3060] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:24.482686  8424 leader_election.cc:290] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:24.375896  8243 raft_consensus.cc:2804] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:24.574098  8243 raft_consensus.cc:493] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:24.574514  8243 raft_consensus.cc:3060] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:24.575510  8217 raft_consensus.cc:515] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:24.449626  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:24.578538  8313 raft_consensus.cc:697] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 8 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:24.579677  8313 consensus_queue.cc:237] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:24.580215  8237 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:24.581598  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:24.473003  8404 leader_election.cc:290] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:24.582448  8237 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:24.461817  8456 log.cc:927] Time spent T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
W20260709 12:14:24.511439  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:24.510012  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 213233us
W20260709 12:14:24.585180  5240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:24.454196  8417 leader_election.cc:290] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:24.393414  8392 leader_election.cc:290] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:24.426602  8416 leader_election.cc:290] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:24.562472  5118 rpcz_store.cc:276] 0709 12:14:22.672606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:22.672798 (+   192us) service_pool.cc:224] Handling call
0709 12:14:22.673185 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:23.879478 (+1206293us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:24.479016 (+599538us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54003ef654. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:24.479274 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2772486528}
I20260709 12:14:24.430192  8375 leader_election.cc:290] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:24.571204  5088 leader_election.cc:304] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:24.546258  8431 raft_consensus.cc:3060] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:24.559868  8136 raft_consensus.cc:493] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
W20260709 12:14:24.594529  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 211046us
W20260709 12:14:24.592970  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 345652us
I20260709 12:14:24.605042  5801 leader_election.cc:304] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:24.606097  5804 leader_election.cc:304] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:24.566274  8178 raft_consensus.cc:697] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 6 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:24.527355  8340 raft_consensus.cc:515] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:24.617959  5804 leader_election.cc:304] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:24.614300  5801 leader_election.cc:304] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:24.624003  5238 leader_election.cc:304] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:24.622514  8217 leader_election.cc:290] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:24.603917  8042 raft_consensus.cc:3060] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:24.585215  8188 consensus_queue.cc:1048] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.031s
W20260709 12:14:24.631531  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:24.632164  5238 leader_election.cc:304] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:24.566431  8010 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:24.638015  5238 leader_election.cc:304] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:24.627070  8411 raft_consensus.cc:2804] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:24.593803  8459 consensus_queue.cc:1048] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:14:24.628487  8416 raft_consensus.cc:2804] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:14:24.649876  8372 consensus_meta.cc:287] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.891s	user 0.008s	sys 0.012s
I20260709 12:14:24.633603  8216 raft_consensus.cc:2804] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:24.614037  8136 raft_consensus.cc:515] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:24.637451  8428 raft_consensus.cc:2804] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:24.654796  5197 raft_consensus.cc:2393] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 6: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:24.652731  5801 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:24.642211  8450 raft_consensus.cc:2804] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:24.660374  5089 leader_election.cc:304] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:24.659385  5191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47728 (request call id 2054) took 1760 ms. Trace:
I20260709 12:14:24.665309  8237 consensus_queue.cc:1048] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:24.666069  8178 consensus_queue.cc:237] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:24.667292  8394 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:24.665874  5191 rpcz_store.cc:276] 0709 12:14:22.899267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:22.899370 (+   103us) service_pool.cc:224] Handling call
0709 12:14:22.899685 (+   315us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:22.915825 (+ 16140us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:22.915856 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:22.916409 (+   553us) log.cc:844] Serialized 52 byte log entry
0709 12:14:23.607443 (+691034us) spinlock_profiling.cc:243] Waited 5.18 ms on lock 0x7b4800061ed8. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ebaecaa1 00007f84ebae3b37 00007f84ebae39ca 00007f84ebbdb26f 00007f84ebbdaf37 00007f84ebbef55c 00007f84ebbef508 00007f84ebbef488 00007f84ebbef443 00007f84ebbee6ec 00007f84eab18a96
0709 12:14:23.850119 (+242676us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:24.065804 (+215685us) log.cc:844] Serialized 14 byte log entry
0709 12:14:24.627857 (+562053us) spinlock_profiling.cc:243] Waited 5.39 ms on lock 0x7b18003ee960. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3a50c0a 00007f84ed190219 00007f84e3ad8a40 00007f84e3ad34e4 00007f84e3ad3455 00007f84e6bbb060 00007f84e6bcd716 00007f84e6bde287 00007f84e6bde208
0709 12:14:24.632898 (+  5041us) log.cc:844] Serialized 14 byte log entry
0709 12:14:24.659029 (+ 26131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:24.659116 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:24.659159 (+    43us) raft_consensus.cc:1685] finished
0709 12:14:24.659170 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:24.659314 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73526,"prepare.queue_time_us":49420,"prepare.run_cpu_time_us":124,"prepare.run_wall_time_us":5438,"raft.queue_time_us":687445,"raft.run_cpu_time_us":17081,"raft.run_wall_time_us":601658,"spinlock_wait_cycles":38431488,"thread_start_us":1051370,"threads_started":2,"wal-append.queue_time_us":1140734}
I20260709 12:14:24.667768  8394 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:24.669550  8428 raft_consensus.cc:697] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 6 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:24.644308  8322 raft_consensus.cc:2749] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:24.652570  8416 raft_consensus.cc:493] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:24.643281  8174 raft_consensus.cc:2749] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:24.650964  8398 raft_consensus.cc:2749] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:24.645984  8414 consensus_meta.cc:287] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.932s	user 0.011s	sys 0.000s
W20260709 12:14:24.671452  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 125786us
I20260709 12:14:24.662142  5801 leader_election.cc:304] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:24.672001  5238 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:24.697293  5238 leader_election.cc:304] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:14:24.663120  8256 consensus_meta.cc:287] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.627s	user 0.015s	sys 0.005s
I20260709 12:14:24.684510  5089 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:24.701192  5801 leader_election.cc:304] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:24.691452  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:24.692898  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:24.702023  5837 raft_consensus.cc:2468] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 5.
I20260709 12:14:24.703117  5830 raft_consensus.cc:1240] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:24.661427  7644 raft_consensus.cc:2749] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:24.653414  8411 raft_consensus.cc:493] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:24.657087  8216 raft_consensus.cc:493] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:24.699378  5166 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
W20260709 12:14:24.737762  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 166620us
I20260709 12:14:24.692566  8416 raft_consensus.cc:3060] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:24.704864  8399 raft_consensus.cc:493] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:24.698755  8417 raft_consensus.cc:2804] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:14:24.706962  5197 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47728 (request call id 2060) took 1803 ms (client timeout 1812 ms). Trace:
I20260709 12:14:24.708333  5193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41416 (request call id 578) took 1780 ms. Trace:
I20260709 12:14:24.702471  8414 raft_consensus.cc:515] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:24.695114  8450 raft_consensus.cc:697] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:24.747997  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:24.710807  5271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34674 (request call id 2084) took 1936 ms. Trace:
I20260709 12:14:24.712389  8463 raft_consensus.cc:2749] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:24.715217  8375 raft_consensus.cc:2749] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:24.702899  8432 raft_consensus.cc:2749] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:24.717156  8428 consensus_queue.cc:237] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:24.718079  5071 auto_rebalancer.cc:893] Removing replace marker failed: Replica 9e794b72ed7640219f90ec4232363929 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:14:24.757984  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:24.720504  8390 raft_consensus.cc:515] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:24.743010  8216 raft_consensus.cc:3060] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:24.721999  8465 raft_consensus.cc:493] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:24.670693  8372 raft_consensus.cc:2749] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:24.723384  5803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:24.723585  5801 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:24.723742  5089 leader_election.cc:304] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:14:24.767428  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 43923.1us
W20260709 12:14:24.768332  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 44676.6us
I20260709 12:14:24.670624  8392 raft_consensus.cc:2749] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:24.729794  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:14:24.728645  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 647003us
I20260709 12:14:24.768489  5801 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:24.724153  8256 raft_consensus.cc:515] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:24.732815  5238 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:24.735069  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:24.735708  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:24.774159  5163 leader_election.cc:304] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:24.774533  5118 raft_consensus.cc:2393] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 6: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:24.775125  5801 leader_election.cc:304] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:24.776261  5163 leader_election.cc:304] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:24.777184  5163 leader_election.cc:304] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:24.778789  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:24.779538  5836 raft_consensus.cc:2393] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 7: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:24.779876  5163 leader_election.cc:304] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:14:24.741712  5197 rpcz_store.cc:269] 0709 12:14:22.903713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:22.940293 (+ 36580us) service_pool.cc:224] Handling call
0709 12:14:24.706752 (+1766459us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b54001950d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:24.706891 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3152805248}
I20260709 12:14:24.780797  8388 raft_consensus.cc:2749] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:24.744879  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:24.781080  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:24.781370  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:24.781774  5837 raft_consensus.cc:2393] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 6: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:24.746448  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:24.783329  5163 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:24.783623  5194 raft_consensus.cc:2468] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 5.
I20260709 12:14:24.783753  5197 raft_consensus.cc:2468] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:14:24.749040  5271 rpcz_store.cc:276] 0709 12:14:22.774116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:22.880135 (+106019us) service_pool.cc:224] Handling call
0709 12:14:24.441468 (+1561333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:24.561861 (+120393us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:24.710408 (+148547us) spinlock_profiling.cc:243] Waited 1.56 s on lock 0x7b5400256cd0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc28ad 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:24.710597 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3590095104}
I20260709 12:14:24.746999  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:24.701082  8350 raft_consensus.cc:2749] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:14:24.739974  8418 consensus_meta.cc:287] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.660s	user 0.010s	sys 0.000s
I20260709 12:14:24.785547  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:24.740091  8354 consensus_meta.cc:287] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.940s	user 0.007s	sys 0.004s
I20260709 12:14:24.785635  5163 leader_election.cc:304] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:14:24.745857  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 548854us
I20260709 12:14:24.786362  5197 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 7.
I20260709 12:14:24.786994  5163 leader_election.cc:304] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:24.787319  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:24.787698  5164 leader_election.cc:304] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:24.755163  5088 leader_election.cc:304] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:24.787985  5197 raft_consensus.cc:2468] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 5.
I20260709 12:14:24.789899  5088 leader_election.cc:304] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:14:24.758380  5071 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 12:14:24.739214  8411 raft_consensus.cc:3060] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:24.793866  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:24.737069  8395 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:24.742679  5193 rpcz_store.cc:276] 0709 12:14:22.927600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:23.281648 (+354048us) service_pool.cc:224] Handling call
0709 12:14:23.281896 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:23.282083 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:14:23.466810 (+184727us) log.cc:844] Serialized 14 byte log entry
0709 12:14:24.707755 (+1240945us) spinlock_profiling.cc:243] Waited 17.7 ms on lock 0x7b180042e380. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e676b4bc 00007f84e3ab948b 00007f84ec9139a9 00007f84e3ad569b 00007f84e3ad393f 00007f84e3ad5c02 00007f84e675d20b 00007f84e6762d23 00007f84e676323a
0709 12:14:24.707968 (+   213us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:24.708020 (+    52us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:14:24.708073 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:24.708140 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:24.708274 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":453958,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":5311,"raft.queue_time_us":827,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":95,"spinlock_wait_cycles":40742784,"thread_start_us":411580,"threads_started":2,"wal-append.queue_time_us":454413}
I20260709 12:14:24.797662  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:24.721621  8400 leader_election.cc:290] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:24.762418  5121 raft_consensus.cc:1240] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 6. Current term is 7. Ops: [4.7-6.8]
I20260709 12:14:24.762691  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:24.745203  7849 raft_consensus.cc:3060] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:24.744577  8417 raft_consensus.cc:493] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:24.780278  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:24.781664  5265 raft_consensus.cc:2468] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 5.
I20260709 12:14:24.745857  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:24.807482  5200 raft_consensus.cc:3060] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:24.782378  8451 raft_consensus.cc:2749] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:24.782965  8473 raft_consensus.cc:493] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:24.784521  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:24.794911  8429 raft_consensus.cc:2804] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:24.796399  5801 leader_election.cc:304] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:24.758662  5195 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 7.
I20260709 12:14:24.741307  8404 raft_consensus.cc:2804] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:14:24.792979  5071 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 12:14:24.799139  5192 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 6.
I20260709 12:14:24.798470  5197 raft_consensus.cc:2468] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 6.
I20260709 12:14:24.800300  8475 raft_consensus.cc:2749] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:24.794775  8376 consensus_queue.cc:1048] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:14:24.786983  8350 raft_consensus.cc:2804] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:24.803045  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:24.802534  5088 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:24.808939  5836 raft_consensus.cc:2393] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 6: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:24.749611  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:24.807751  5118 raft_consensus.cc:1240] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:24.809975  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:24.810464  5837 raft_consensus.cc:1275] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:14:24.803747  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 55820us
I20260709 12:14:24.758018  8188 consensus_queue.cc:1048] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:14:24.742722  8024 consensus_queue.cc:1059] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:14:24.817895  5119 raft_consensus.cc:1240] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:24.895572  5125 raft_consensus.cc:2468] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 9.
I20260709 12:14:24.896247  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:24.901768  5116 raft_consensus.cc:2468] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 7.
I20260709 12:14:24.898706  5194 raft_consensus.cc:1275] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:24.796324  8432 raft_consensus.cc:2804] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:24.791270  8407 raft_consensus.cc:2804] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:14:24.900477  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 98000.7us
I20260709 12:14:24.792688  8370 raft_consensus.cc:2749] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:24.902509  5166 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:24.898098  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
W20260709 12:14:24.906039  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 109800us
I20260709 12:14:24.792218  8217 raft_consensus.cc:2749] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:24.867951  5200 raft_consensus.cc:2468] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 7.
I20260709 12:14:24.944356  5166 leader_election.cc:304] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:24.953625  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:24.748328  8399 raft_consensus.cc:515] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:24.786377  8354 raft_consensus.cc:515] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:24.801096  8419 raft_consensus.cc:2749] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:24.801694  8394 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:24.920297  5088 leader_election.cc:304] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:24.945154  5124 raft_consensus.cc:1240] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:24.919627  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:24.956915  5801 leader_election.cc:304] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:24.825343  8322 raft_consensus.cc:2804] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:24.954282  5200 raft_consensus.cc:2468] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 7.
I20260709 12:14:24.958210  5801 leader_election.cc:304] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:24.961915  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:24.962514  5200 raft_consensus.cc:2468] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 9.
I20260709 12:14:24.819410  8417 raft_consensus.cc:3060] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:24.902295  8376 consensus_queue.cc:1243] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer 9e794b72ed7640219f90ec4232363929 log is divergent from this leader: its last log entry 5.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:14:24.958921  5088 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:24.963266  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:24.790153  8398 consensus_queue.cc:1048] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.122s
I20260709 12:14:24.905491  8404 raft_consensus.cc:493] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:24.786078  8418 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:24.965656  5801 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:24.914250  8388 raft_consensus.cc:2804] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:24.907434  8429 raft_consensus.cc:493] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:24.798147  8403 raft_consensus.cc:515] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:24.968202  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:24.994637  5200 raft_consensus.cc:3060] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:24.960837  8322 raft_consensus.cc:493] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:24.971547  5088 leader_election.cc:304] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:24.813102  8408 consensus_queue.cc:1048] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.147s
I20260709 12:14:24.915719  8421 raft_consensus.cc:2749] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:24.915915  8451 raft_consensus.cc:2804] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:24.919348  8340 leader_election.cc:290] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:24.988476  5118 raft_consensus.cc:1240] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:24.984936  8398 consensus_queue.cc:1243] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer 9e794b72ed7640219f90ec4232363929 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:14:24.773036  8465 raft_consensus.cc:515] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:24.964709  8380 raft_consensus.cc:2804] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:24.907101  8432 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:24.830138  8479 raft_consensus.cc:2804] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:24.975131  8400 raft_consensus.cc:2804] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:14:24.999678  5804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:24.953038  8459 consensus_queue.cc:1048] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:14:24.946802  8407 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:25.007903  5123 raft_consensus.cc:2393] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 8: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:24.973483  8370 raft_consensus.cc:493] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:24.998116  8136 leader_election.cc:290] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:25.011426  8188 raft_consensus.cc:2804] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:24.989850  8404 raft_consensus.cc:3060] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:24.994577  8429 raft_consensus.cc:3060] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:25.012993  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:24.993999  8457 raft_consensus.cc:2749] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:25.013778  5196 raft_consensus.cc:1240] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:25.018625  8479 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:24.906819  8473 raft_consensus.cc:515] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:25.052049  8473 leader_election.cc:290] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:25.052397  8481 log.cc:927] Time spent T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 12:14:25.009328  8451 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:24.996049  8217 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:25.053718  8217 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:25.054378  8480 log.cc:927] Time spent T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:14:25.054890  8465 leader_election.cc:290] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:25.007516  8322 raft_consensus.cc:3060] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:25.037398  8407 raft_consensus.cc:3060] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:25.053144  8390 leader_election.cc:290] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:24.943831  8410 consensus_queue.cc:1048] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:14:25.009202  8408 consensus_queue.cc:1243] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer dd62e75bd3ed4ed28f1fb5955d650808 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:14:25.012462  8380 raft_consensus.cc:493] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:25.014240  8432 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:25.043565  5192 raft_consensus.cc:2468] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 6.
I20260709 12:14:24.993603  8462 consensus_queue.cc:1048] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.296s
I20260709 12:14:25.019012  8400 raft_consensus.cc:493] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:25.014699  5838 raft_consensus.cc:1240] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 8 LEADER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:25.050024  8479 raft_consensus.cc:3060] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:25.054324  8399 leader_election.cc:290] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:25.056345  5199 raft_consensus.cc:2468] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 6.
I20260709 12:14:25.049290  5088 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
W20260709 12:14:25.060397  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 116109us
W20260709 12:14:25.069801  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:25.024044  5200 raft_consensus.cc:2468] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 9.
W20260709 12:14:25.045454  8467 log.cc:927] Time spent T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.286s	user 0.000s	sys 0.001s
I20260709 12:14:25.153435  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:25.154192  5200 raft_consensus.cc:2393] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 7: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:25.154989  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
W20260709 12:14:25.027086  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 226202us
I20260709 12:14:25.058575  8010 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:24.956481  8450 consensus_queue.cc:237] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:25.039414  8188 raft_consensus.cc:493] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:25.044926  8350 raft_consensus.cc:697] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 6 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:25.040263  8414 leader_election.cc:290] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:25.053249  8451 raft_consensus.cc:3060] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:25.100551  8477 raft_consensus.cc:2749] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:25.055805  8217 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:25.053349  8436 raft_consensus.cc:2804] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:25.013262  8485 raft_consensus.cc:2804] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:25.045313  8487 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.051434  8476 raft_consensus.cc:2804] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:25.120831  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:25.182739  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:25.183128  5830 raft_consensus.cc:3060] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:25.136864  8337 consensus_meta.cc:287] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.885s	user 0.011s	sys 0.000s
I20260709 12:14:25.137076  8463 raft_consensus.cc:493] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.056058  8474 raft_consensus.cc:2804] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:25.040867  8370 raft_consensus.cc:515] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:25.140805  8452 consensus_meta.cc:287] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.595s	user 0.008s	sys 0.000s
I20260709 12:14:25.118252  8380 raft_consensus.cc:3060] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:25.142517  8478 raft_consensus.cc:493] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:25.142987  8482 raft_consensus.cc:3055] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:25.245585  8482 raft_consensus.cc:740] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:25.246588  8482 consensus_queue.cc:260] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:25.247967  8482 raft_consensus.cc:3060] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:25.157549  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 108347us
I20260709 12:14:25.160028  5835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46088 (request call id 583) took 1263 ms. Trace:
I20260709 12:14:25.115386  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:25.249294  5088 leader_election.cc:304] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:25.249859  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:25.165748  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:25.167917  5271 raft_consensus.cc:1240] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:14:25.168227  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:25.276575  5272 raft_consensus.cc:3060] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:25.169790  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:25.151512  8400 raft_consensus.cc:3060] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:25.186498  8476 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:25.159590  8431 consensus_meta.cc:287] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.546s	user 0.010s	sys 0.000s
I20260709 12:14:25.159099  8237 raft_consensus.cc:2749] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:25.162374  5238 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:25.136516  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:25.249040  5835 rpcz_store.cc:276] 0709 12:14:23.896756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.430035 (+533279us) service_pool.cc:224] Handling call
0709 12:14:24.712914 (+282879us) spinlock_profiling.cc:243] Waited 42.8 ms on lock 0x7b58000b0498. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb9cfc0 00007f84ebb87929 00007f84ebb873d2 00007f84e50febd4
0709 12:14:24.713149 (+   235us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:24.713660 (+   511us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:24.713690 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:24.714370 (+   680us) log.cc:844] Serialized 52 byte log entry
0709 12:14:24.763698 (+ 49328us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:24.796610 (+ 32912us) log.cc:844] Serialized 14 byte log entry
0709 12:14:24.801808 (+  5198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:24.801925 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:25.150378 (+348453us) raft_consensus.cc:1685] finished
0709 12:14:25.159771 (+  9393us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:25.159958 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4847,"prepare.queue_time_us":30653,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":60,"raft.queue_time_us":6690,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":87601,"spinlock_wait_cycles":98378112,"thread_start_us":48911,"threads_started":1,"wal-append.queue_time_us":179333}
I20260709 12:14:25.291487  5192 raft_consensus.cc:3060] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:25.184108  5267 raft_consensus.cc:2468] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 7.
I20260709 12:14:25.162989  8495 raft_consensus.cc:493] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.176136  8354 leader_election.cc:290] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:25.161506  8459 raft_consensus.cc:2804] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:25.161144  8256 leader_election.cc:290] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:25.163050  8188 raft_consensus.cc:3060] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:25.317655  5272 raft_consensus.cc:2468] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 6.
I20260709 12:14:25.243983  8487 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:25.317842  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 155562us
W20260709 12:14:25.255898  8469 log.cc:927] Time spent T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.705s	user 0.000s	sys 0.004s
W20260709 12:14:25.263159  8243 consensus_meta.cc:287] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.688s	user 0.010s	sys 0.001s
I20260709 12:14:25.263670  8418 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:25.265296  7849 raft_consensus.cc:2749] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:25.265947  8350 consensus_queue.cc:237] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:25.268947  8403 leader_election.cc:290] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:25.186823  8436 raft_consensus.cc:697] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 7 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:25.855896  8436 consensus_queue.cc:237] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:25.271449  8396 raft_consensus.cc:3055] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:25.857620  8396 raft_consensus.cc:740] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:25.858672  8396 consensus_queue.cc:260] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:25.232975  8337 raft_consensus.cc:515] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:25.272338  8478 raft_consensus.cc:515] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:25.273123  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:25.862756  5193 raft_consensus.cc:2468] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 6.
I20260709 12:14:25.863775  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:25.864496  5193 raft_consensus.cc:2393] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 6: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:25.049291  8024 consensus_queue.cc:1059] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.102s
I20260709 12:14:25.272208  5829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46094 (request call id 872) took 1551 ms. Trace:
I20260709 12:14:25.275319  5191 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 6.
I20260709 12:14:25.866724  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:25.865808  5829 rpcz_store.cc:276] 0709 12:14:23.720493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:23.771409 (+ 50916us) service_pool.cc:224] Handling call
0709 12:14:23.771798 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:23.891508 (+119710us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:23.891541 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:23.892031 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 12:14:24.431192 (+539161us) spinlock_profiling.cc:243] Waited 59.9 ms on lock 0x7b18001c29a0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3ab8e07 00007f84ec9139a9 00007f84e3ad569b 00007f84e3ad393f 00007f84e3ad5c02 00007f84e675d20b 00007f84e6762d23 00007f84e67630d1 00007f84e6b7ea0f
0709 12:14:24.610011 (+178819us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:24.610056 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:24.610130 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:25.271899 (+661769us) raft_consensus.cc:1685] finished
0709 12:14:25.271921 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:25.272145 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":119334,"raft.queue_time_us":119765,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":30392,"spinlock_wait_cycles":137833216,"thread_start_us":178603,"threads_started":1,"wal-append.queue_time_us":737385}
I20260709 12:14:25.180377  8485 raft_consensus.cc:493] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:25.867833  8485 raft_consensus.cc:3060] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:25.868130  5120 raft_consensus.cc:2393] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 9: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:25.271631  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:25.162397  8395 raft_consensus.cc:2749] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:25.285109  5273 raft_consensus.cc:2393] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 9: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:25.256909  8411 raft_consensus.cc:515] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:25.872756  8411 leader_election.cc:290] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:25.297537  8495 raft_consensus.cc:515] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:25.301360  8370 leader_election.cc:290] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:25.293295  8431 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:25.302817  8216 consensus_meta.cc:287] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.528s	user 0.007s	sys 0.003s
I20260709 12:14:25.876505  8216 raft_consensus.cc:515] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:25.878886  8216 leader_election.cc:290] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:25.311158  5192 raft_consensus.cc:2468] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 7.
I20260709 12:14:25.880234  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:25.880927  5192 raft_consensus.cc:2468] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 5.
I20260709 12:14:25.881804  5836 raft_consensus.cc:2368] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 5. Current term is 6.
I20260709 12:14:25.252811  8340 raft_consensus.cc:2749] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:25.318728  5238 leader_election.cc:304] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:25.284672  8421 raft_consensus.cc:493] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.233938  8474 raft_consensus.cc:493] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:25.882966  8474 raft_consensus.cc:3060] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:25.883039  8502 raft_consensus.cc:2804] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:25.883481  8502 raft_consensus.cc:493] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:25.883803  8502 raft_consensus.cc:3060] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:25.882715  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 564036us
I20260709 12:14:25.304487  8322 raft_consensus.cc:515] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:25.329512  8407 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:25.321856  8243 raft_consensus.cc:515] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:25.253083  8432 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:25.291795  8476 raft_consensus.cc:3060] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:25.887132  8421 raft_consensus.cc:515] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:25.887132  8407 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:25.331498  5200 raft_consensus.cc:3060] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:25.304894  8459 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:25.892880  8459 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:25.895746  8421 leader_election.cc:290] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:25.896786  8432 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:25.322374  8178 raft_consensus.cc:2749] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:25.897878  8178 consensus_queue.cc:1059] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:25.899005  8178 raft_consensus.cc:3055] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:25.899374  8178 raft_consensus.cc:740] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:25.900158  8178 consensus_queue.cc:260] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:25.265184  8479 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:25.903177  8479 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:25.381609  5198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47728 (request call id 2065) took 1534 ms. Trace:
I20260709 12:14:25.903834  5200 raft_consensus.cc:2468] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 8.
I20260709 12:14:25.903779  5198 rpcz_store.cc:276] 0709 12:14:23.847552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:23.849420 (+  1868us) service_pool.cc:224] Handling call
0709 12:14:23.849806 (+   386us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 12:14:23.878339 (+ 28533us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:23.878369 (+    30us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 12:14:23.898276 (+ 19907us) log.cc:844] Serialized 104 byte log entry
0709 12:14:24.711410 (+813134us) spinlock_profiling.cc:243] Waited 7.05 ms on lock 0x7b1800326680. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3ab8e07 00007f84ec9139a9 00007f84e3ad569b 00007f84e3ad393f 00007f84e3ad5c02 00007f84e675d20b 00007f84e6762d23 00007f84e67630d1 00007f84e6b7ea0f
0709 12:14:24.751528 (+ 40118us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:25.104254 (+352726us) log.cc:844] Serialized 14 byte log entry
0709 12:14:25.104679 (+   425us) log.cc:844] Serialized 14 byte log entry
0709 12:14:25.111304 (+  6625us) log.cc:844] Serialized 14 byte log entry
0709 12:14:25.114918 (+  3614us) log.cc:844] Serialized 14 byte log entry
0709 12:14:25.116834 (+  1916us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:25.381137 (+264303us) spinlock_profiling.cc:243] Waited 28 ms on lock 0x7b5400364554. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:25.381197 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:25.381255 (+    58us) raft_consensus.cc:1685] finished
0709 12:14:25.381277 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:25.381524 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3841,"prepare.queue_time_us":16380,"prepare.run_cpu_time_us":159,"prepare.run_wall_time_us":5165,"raft.queue_time_us":21180,"raft.run_cpu_time_us":490,"raft.run_wall_time_us":19367,"spinlock_wait_cycles":80632576,"thread_start_us":379778,"threads_started":2,"wal-append.queue_time_us":873501}
I20260709 12:14:25.493285  8400 raft_consensus.cc:515] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:25.906663  8485 raft_consensus.cc:515] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:25.287307  8463 raft_consensus.cc:515] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:25.907512  8476 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:25.909438  8463 leader_election.cc:290] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:25.910297  5835 raft_consensus.cc:1240] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 12:14:25.498692  8416 consensus_meta.cc:287] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.745s	user 0.007s	sys 0.003s
I20260709 12:14:25.911499  8416 raft_consensus.cc:515] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:25.913722  8416 leader_election.cc:290] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:25.501101  8217 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.914542  8217 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:25.916993  5837 raft_consensus.cc:2393] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 8: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:25.502977  5834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46088 (request call id 591) took 1596 ms. Trace:
I20260709 12:14:25.917621  5834 rpcz_store.cc:276] 0709 12:14:23.906463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.435151 (+528688us) service_pool.cc:224] Handling call
0709 12:14:24.482804 (+ 47653us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:24.483612 (+   808us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:24.483642 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:24.484093 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 12:14:24.550012 (+ 65919us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:14:24.662914 (+112902us) log.cc:844] Serialized 14 byte log entry
0709 12:14:24.663813 (+   899us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:24.663901 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:25.255160 (+591259us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e675e86e 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221 00007f84e67671d9 00007f84e6767169
0709 12:14:25.502619 (+247459us) raft_consensus.cc:1685] finished
0709 12:14:25.502730 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:25.502905 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":22021,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":820,"raft.run_cpu_time_us":312,"raft.run_wall_time_us":311,"spinlock_wait_cycles":28833152,"thread_start_us":178011,"threads_started":2,"wal-append.queue_time_us":65883}
I20260709 12:14:25.916913  8502 raft_consensus.cc:515] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:25.538888  8487 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:25.909276  8474 raft_consensus.cc:515] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:25.936975  5119 raft_consensus.cc:1240] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:25.945705  8474 leader_election.cc:290] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:25.546224  8188 raft_consensus.cc:515] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:25.547137  8503 log.cc:927] Time spent T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.175s	user 0.002s	sys 0.000s
I20260709 12:14:25.554049  8380 raft_consensus.cc:515] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:25.998761  8188 leader_election.cc:290] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:25.999107  8380 leader_election.cc:290] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:25.564652  8429 consensus_meta.cc:287] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.508s	user 0.006s	sys 0.002s
W20260709 12:14:25.571563  8404 consensus_meta.cc:287] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.523s	user 0.002s	sys 0.006s
I20260709 12:14:25.612921  8501 raft_consensus.cc:493] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:26.001585  8501 raft_consensus.cc:515] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:26.003898  8501 leader_election.cc:290] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:26.000770  8404 raft_consensus.cc:515] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:26.006253  8404 leader_election.cc:290] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:25.537088  5830 raft_consensus.cc:2468] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 9.
I20260709 12:14:25.664001  8361 raft_consensus.cc:493] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:26.007109  8361 raft_consensus.cc:515] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:26.010000  5830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46094 (request call id 885) took 1093 ms. Trace:
I20260709 12:14:26.010403  5830 rpcz_store.cc:276] 0709 12:14:24.916960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.076837 (+159877us) service_pool.cc:224] Handling call
0709 12:14:26.009929 (+933092us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:25.675834  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:25.732120  5270 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.091s	sys 0.124s
W20260709 12:14:26.011917  5270 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.832s	user 0.092s	sys 0.125s
I20260709 12:14:25.752467  8465 raft_consensus.cc:493] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.801992  8410 raft_consensus.cc:493] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:26.012799  8465 raft_consensus.cc:515] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:26.012887  8410 raft_consensus.cc:515] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:25.819250  8408 raft_consensus.cc:493] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:26.015244  8465 leader_election.cc:290] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:26.015235  8408 raft_consensus.cc:515] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:26.018025  8408 leader_election.cc:290] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:25.545583  8451 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:26.021049  8451 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:26.000234  8429 raft_consensus.cc:515] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:26.025473  5197 raft_consensus.cc:1240] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:26.033811  8429 leader_election.cc:290] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:26.040269  8479 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:26.060235  5833 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.005s	sys 0.005s
W20260709 12:14:26.160372  5833 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.868s	user 0.005s	sys 0.005s
I20260709 12:14:26.131959  8243 leader_election.cc:290] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:26.134091  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:26.138320  5273 raft_consensus.cc:1275] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:14:26.168094  5273 pending_rounds.cc:85] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929: Aborting all ops after (but not including) 7
I20260709 12:14:26.139370  5832 raft_consensus.cc:1240] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:26.168367  5273 pending_rounds.cc:107] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:14:26.168699  5273 raft_consensus.cc:2889] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:26.169941  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:26.170550  5273 raft_consensus.cc:3060] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:26.171456  8337 leader_election.cc:290] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:26.137604  8396 raft_consensus.cc:3060] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:26.140668  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
W20260709 12:14:26.145655  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 1.3574e+06us
I20260709 12:14:25.994719  8459 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:26.173838  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:26.174562  8485 leader_election.cc:290] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:26.175252  5271 raft_consensus.cc:2393] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 6: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:26.175369  5193 raft_consensus.cc:2393] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 9: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:26.173887  5163 leader_election.cc:304] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:14:26.163141  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 75037us
I20260709 12:14:26.166357  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:26.178150  5122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59390 (request call id 617) took 1025 ms. Trace:
I20260709 12:14:26.162437  5191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 2067) took 1391 ms. Trace:
I20260709 12:14:26.177320  5163 leader_election.cc:304] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:26.179314  5191 rpcz_store.cc:276] 0709 12:14:24.770640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.161558 (+1390918us) service_pool.cc:224] Handling call
0709 12:14:26.161862 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:26.162034 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:26.162060 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:26.162099 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:26.162136 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:26.162220 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:26.162371 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:26.178460  5122 rpcz_store.cc:276] 0709 12:14:25.152460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.166040 (+1013580us) service_pool.cc:224] Handling call
0709 12:14:26.178093 (+ 12053us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:26.180603  5832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46100 (request call id 968) took 2179 ms. Trace:
I20260709 12:14:26.181627  5163 leader_election.cc:304] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:26.169032  8431 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:26.183898  5832 rpcz_store.cc:276] 0709 12:14:24.000722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.438721 (+437999us) service_pool.cc:224] Handling call
0709 12:14:26.139000 (+1700279us) spinlock_profiling.cc:243] Waited 43.3 ms on lock 0x7b58000b0498. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb9cfc0 00007f84ebb87929 00007f84ebb873d2 00007f84e50febd4
0709 12:14:26.139193 (+   193us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:26.180351 (+ 41158us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:26.180546 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":99547392}
I20260709 12:14:26.188082  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:26.190079  5271 raft_consensus.cc:3060] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:26.137857  8178 raft_consensus.cc:3060] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:26.166863  8417 consensus_meta.cc:287] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 1.180s	user 0.004s	sys 0.014s
I20260709 12:14:26.195724  5273 raft_consensus.cc:2468] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 9.
I20260709 12:14:26.188064  5265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50932 (request call id 645) took 1024 ms. Trace:
I20260709 12:14:26.186215  5831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46100 (request call id 969) took 2185 ms. Trace:
W20260709 12:14:26.191717  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 46533.4us
I20260709 12:14:26.196373  5265 rpcz_store.cc:276] 0709 12:14:25.163943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.165639 (+  1696us) service_pool.cc:224] Handling call
0709 12:14:25.179278 (+ 13639us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:14:25.187031 (+  7753us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:25.187063 (+    32us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:14:25.233168 (+ 46105us) log.cc:844] Serialized 78 byte log entry
0709 12:14:25.429769 (+196601us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:25.429817 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:25.429894 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:26.187860 (+757966us) raft_consensus.cc:1685] finished
0709 12:14:26.187879 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:26.188010 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1356,"raft.queue_time_us":20914,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":1391,"thread_start_us":133494,"threads_started":1,"wal-append.queue_time_us":878679}
I20260709 12:14:26.189291  5163 leader_election.cc:304] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:26.194006  5191 raft_consensus.cc:1240] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 6. Current term is 7. Ops: [4.7-6.8]
I20260709 12:14:26.196929  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:26.199167  5273 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:26.158273  8463 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:26.201643  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:26.204854  5163 leader_election.cc:304] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:14:26.184026  8482 consensus_meta.cc:287] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.936s	user 0.008s	sys 0.004s
I20260709 12:14:26.203557  5833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46100 (request call id 966) took 2203 ms. Trace:
I20260709 12:14:26.196702  5831 rpcz_store.cc:276] 0709 12:14:24.000987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.440333 (+439346us) service_pool.cc:224] Handling call
0709 12:14:25.101575 (+661242us) spinlock_profiling.cc:243] Waited 42 ms on lock 0x7b58000b0498. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb9cfc0 00007f84ebb87929 00007f84ebb873d2 00007f84e50febd4
0709 12:14:25.101760 (+   185us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:25.129859 (+ 28099us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:14:25.156184 (+ 26325us) log.cc:844] Serialized 14 byte log entry
0709 12:14:25.325043 (+168859us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:25.325690 (+   647us) log.cc:844] Serialized 52 byte log entry
0709 12:14:25.325847 (+   157us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:25.325877 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:25.325941 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:26.175112 (+849171us) raft_consensus.cc:1685] finished
0709 12:14:26.185985 (+ 10873us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:26.186155 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":27315,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"raft.queue_time_us":1835,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":7816,"spinlock_wait_cycles":97381120,"thread_start_us":140744,"threads_started":1,"wal-append.queue_time_us":997586}
I20260709 12:14:26.187492  8370 raft_consensus.cc:2749] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:26.212436  8410 leader_election.cc:290] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:26.196363  8400 leader_election.cc:290] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:26.212553  8463 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:26.200800  8340 consensus_queue.cc:1048] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:14:26.214985  8463 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:26.215555  8463 raft_consensus.cc:493] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:26.211519  5833 rpcz_store.cc:276] 0709 12:14:24.000032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.436102 (+436070us) service_pool.cc:224] Handling call
0709 12:14:25.269683 (+833581us) spinlock_profiling.cc:243] Waited 46.3 ms on lock 0x7b58000b0498. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb9cfc0 00007f84ebb87929 00007f84ebb873d2 00007f84e50febd4
0709 12:14:25.269919 (+   236us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:25.285897 (+ 15978us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:25.285931 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:25.292352 (+  6421us) log.cc:844] Serialized 26 byte log entry
0709 12:14:26.160895 (+868543us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:26.195073 (+ 34178us) log.cc:844] Serialized 14 byte log entry
0709 12:14:26.195968 (+   895us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:26.196042 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:26.196078 (+    36us) raft_consensus.cc:1685] finished
0709 12:14:26.203346 (+  7268us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:26.203495 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15586,"prepare.queue_time_us":34155,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":15783,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":13192,"spinlock_wait_cycles":106406784,"thread_start_us":901994,"threads_started":2,"wal-append.queue_time_us":869309}
I20260709 12:14:26.216058  8463 raft_consensus.cc:515] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:26.208750  5122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40402 (request call id 2174) took 1223 ms. Trace:
I20260709 12:14:26.216912  5122 rpcz_store.cc:276] 0709 12:14:24.985760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.201330 (+1215570us) service_pool.cc:224] Handling call
0709 12:14:26.208680 (+  7350us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:26.217754  5271 raft_consensus.cc:2468] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 10.
I20260709 12:14:26.217917  5196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41416 (request call id 580) took 1472 ms. Trace:
I20260709 12:14:26.175230  8502 leader_election.cc:290] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:26.218688  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:26.208431  8361 leader_election.cc:290] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:26.219796  5271 raft_consensus.cc:3060] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:26.220257  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:26.221215  5838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46088 (request call id 580) took 2325 ms. Trace:
I20260709 12:14:26.212353  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:26.221733  5274 raft_consensus.cc:3060] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:26.217182  5194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 2062) took 1462 ms. Trace:
I20260709 12:14:26.216255  5121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59390 (request call id 601) took 2153 ms. Trace:
I20260709 12:14:26.222556  5265 raft_consensus.cc:3060] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:26.222157  5838 rpcz_store.cc:276] 0709 12:14:23.896049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.414376 (+518327us) service_pool.cc:224] Handling call
0709 12:14:24.414665 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:25.134289 (+719624us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:26.220997 (+1086708us) spinlock_profiling.cc:243] Waited 600 ms on lock 0x7b540064c3d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:26.221155 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1379515776}
I20260709 12:14:26.227018  5270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50932 (request call id 641) took 1531 ms. Trace:
I20260709 12:14:26.227393  5270 rpcz_store.cc:276] 0709 12:14:24.695635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.726157 (+ 30522us) service_pool.cc:224] Handling call
0709 12:14:24.738669 (+ 12512us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:25.105639 (+366970us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:25.105675 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:25.106079 (+   404us) log.cc:844] Serialized 26 byte log entry
0709 12:14:26.012324 (+906245us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:26.012367 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:26.012445 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:26.226813 (+214368us) raft_consensus.cc:1685] finished
0709 12:14:26.226832 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:26.226962 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22294,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":3317,"thread_start_us":1198499,"threads_started":2,"wal-append.queue_time_us":1008663}
I20260709 12:14:26.229043  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:26.192070  8478 leader_election.cc:290] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:26.230336  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:26.203362  8417 raft_consensus.cc:515] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:26.206197  5191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41416 (request call id 591) took 1256 ms. Trace:
I20260709 12:14:26.232343  8417 leader_election.cc:290] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:26.232945  5116 raft_consensus.cc:1240] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:26.233525  8459 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:26.232561  5191 rpcz_store.cc:276] 0709 12:14:24.949528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.192859 (+1243331us) service_pool.cc:224] Handling call
0709 12:14:26.193273 (+   414us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:26.205876 (+ 12603us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:26.206133 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:26.222273  8429 raft_consensus.cc:2804] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:26.234448  5116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40402 (request call id 2171) took 1493 ms. Trace:
I20260709 12:14:26.234576  8429 raft_consensus.cc:493] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:26.195955  8485 raft_consensus.cc:2804] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:26.235260  8485 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:26.235603  8485 raft_consensus.cc:3060] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:26.175450  8479 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:26.238303  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:26.239840  5270 raft_consensus.cc:2393] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 6: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:26.240681  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:26.238751  5116 rpcz_store.cc:276] 0709 12:14:24.741087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.911819 (+170732us) service_pool.cc:224] Handling call
0709 12:14:24.912120 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:26.233347 (+1321227us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:26.234220 (+   873us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b540008d754. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:26.234393 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3037128448}
I20260709 12:14:26.234942  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:26.242071  5088 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:26.192339  8403 raft_consensus.cc:2804] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:26.218315  5196 rpcz_store.cc:276] 0709 12:14:24.745203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.745559 (+   356us) service_pool.cc:224] Handling call
0709 12:14:24.745785 (+   226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:25.046369 (+300584us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:26.217699 (+1171330us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b54000bde54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:26.217859 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":615924480}
I20260709 12:14:26.255509  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:26.255617  5271 raft_consensus.cc:2468] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 4.
I20260709 12:14:26.258556  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:26.259590  5196 raft_consensus.cc:3060] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:26.196225  8495 leader_election.cc:290] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:26.257560  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:26.263653  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:26.264411  5271 raft_consensus.cc:2468] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 5.
I20260709 12:14:26.271667  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:26.272020  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:26.272310  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:26.273020  5831 raft_consensus.cc:2393] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 8: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:26.274865  5265 raft_consensus.cc:2468] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 8.
W20260709 12:14:26.278728  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 115085us
I20260709 12:14:26.239346  8479 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:26.222854  5194 rpcz_store.cc:276] 0709 12:14:24.754497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.808962 (+ 54465us) service_pool.cc:224] Handling call
0709 12:14:24.898375 (+ 89413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:24.902527 (+  4152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:26.216987 (+1314460us) spinlock_profiling.cc:243] Waited 89.1 ms on lock 0x7b54002035d0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc28ad 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:26.217120 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":204950912}
I20260709 12:14:26.287928  5834 raft_consensus.cc:1240] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 8. Current term is 9. Ops: [5.7-8.8]
I20260709 12:14:26.214022  8388 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:26.224253  5121 rpcz_store.cc:276] 0709 12:14:24.063096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.207254 (+144158us) service_pool.cc:224] Handling call
0709 12:14:24.216955 (+  9701us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:24.801347 (+584392us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:26.215996 (+1414649us) spinlock_profiling.cc:243] Waited 544 ms on lock 0x7b5400071f54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:26.216196 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1250849152}
I20260709 12:14:26.246902  5270 raft_consensus.cc:2468] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 9.
I20260709 12:14:26.246431  5116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40402 (request call id 2173) took 1261 ms. Trace:
I20260709 12:14:26.289002  5116 rpcz_store.cc:276] 0709 12:14:24.985492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.245674 (+1260182us) service_pool.cc:224] Handling call
0709 12:14:26.245969 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:26.246132 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:26.246155 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:26.246196 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:26.246223 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:26.246274 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:26.246377 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:26.290212  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:26.244948  5274 raft_consensus.cc:2468] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 6.
I20260709 12:14:26.283131  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:26.291692  5831 raft_consensus.cc:2393] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 7: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:26.292510  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:26.283608  5833 raft_consensus.cc:1240] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:26.283691  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:26.294560  5838 raft_consensus.cc:3060] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:26.295588  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:26.283957  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
W20260709 12:14:26.296610  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 54630.6us
I20260709 12:14:26.297609  5088 leader_election.cc:304] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:26.281219  5801 leader_election.cc:304] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:14:26.294155  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:26.299371  5801 leader_election.cc:304] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:26.254370  8403 raft_consensus.cc:493] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:26.285344  5829 raft_consensus.cc:1240] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:26.255345  8429 raft_consensus.cc:3060] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:26.300453  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:26.226500  7644 consensus_queue.cc:1059] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 12:14:26.295873  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:26.305061  5273 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 8.
I20260709 12:14:26.305954  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:26.246315  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:26.324497  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:26.324846  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:26.259827  8410 raft_consensus.cc:493] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:26.296973  8388 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:26.299397  5088 leader_election.cc:304] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:26.308220  8417 raft_consensus.cc:2804] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:26.254839  8451 raft_consensus.cc:493] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:26.326843  8451 raft_consensus.cc:515] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:26.311787  5194 raft_consensus.cc:3060] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:26.329824  8520 consensus_queue.cc:1059] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:14:26.330858  8520 raft_consensus.cc:3055] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:26.331207  8520 raft_consensus.cc:740] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:26.332037  8520 consensus_queue.cc:260] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:26.296878  5196 raft_consensus.cc:2468] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 9.
I20260709 12:14:26.334228  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:26.334820  5196 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:26.302027  8459 raft_consensus.cc:493] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:26.336131  8459 raft_consensus.cc:515] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:26.312839  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:26.315150  5838 raft_consensus.cc:2468] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 9.
I20260709 12:14:26.266886  8400 raft_consensus.cc:493] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:26.320129  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:26.293852  8431 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:26.315972  5089 leader_election.cc:304] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:26.307968  8188 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:26.300239  8337 raft_consensus.cc:2749] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:26.347479  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:26.348132  5269 raft_consensus.cc:2468] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:14:26.305608  8350 consensus_queue.cc:1059] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:14:26.308979  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:26.311409  8403 raft_consensus.cc:3060] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:26.303841  8243 raft_consensus.cc:493] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:26.308113  8380 raft_consensus.cc:2804] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:26.337774  5121 raft_consensus.cc:3060] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:26.325080  5273 raft_consensus.cc:3060] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:26.339226  5271 raft_consensus.cc:3060] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:26.342466  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:26.318463  8474 consensus_queue.cc:1048] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:14:26.322403  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:26.340924  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
W20260709 12:14:26.518422  5240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:26.524194  5834 raft_consensus.cc:2468] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 7.
I20260709 12:14:26.517148  5123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59390 (request call id 593) took 2605 ms. Trace:
I20260709 12:14:26.525029  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
W20260709 12:14:26.460917  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 161569us
I20260709 12:14:26.499838  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:26.319854  8478 raft_consensus.cc:2749] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:14:26.486181  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 186613us
I20260709 12:14:26.370833  5194 raft_consensus.cc:2468] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 7.
I20260709 12:14:26.564559  5801 leader_election.cc:304] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:26.564847  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:26.466579  8413 raft_consensus.cc:2804] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:26.529332  5088 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:26.538367  5271 raft_consensus.cc:2468] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 8.
I20260709 12:14:26.368001  5196 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 8.
I20260709 12:14:26.525473  5123 rpcz_store.cc:276] 0709 12:14:23.901010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:23.901213 (+   203us) service_pool.cc:224] Handling call
0709 12:14:26.506552 (+2605339us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54002dc654. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:26.506710 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2489622912}
I20260709 12:14:26.566170  5194 raft_consensus.cc:2393] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 8: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:26.567255  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:26.567513  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:26.568095  5194 raft_consensus.cc:3060] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:26.568291  5196 raft_consensus.cc:2468] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 8.
I20260709 12:14:26.569370  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:26.575098  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:26.341369  8410 raft_consensus.cc:515] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:26.602520  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
W20260709 12:14:26.610013  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 82215.3us
I20260709 12:14:26.609532  5121 raft_consensus.cc:2468] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 10.
I20260709 12:14:26.630626  5273 raft_consensus.cc:2468] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 7.
I20260709 12:14:26.614280  5801 leader_election.cc:304] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:26.631253  5196 raft_consensus.cc:3060] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:26.633787  5123 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:26.614486  5117 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59390 (request call id 596) took 2619 ms (client timeout 1810 ms). Trace:
W20260709 12:14:26.635484  5117 rpcz_store.cc:269] 0709 12:14:23.994814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:23.994952 (+   138us) service_pool.cc:224] Handling call
0709 12:14:26.614253 (+2619301us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x7b540038ccd4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:26.614413 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":764207872}
I20260709 12:14:26.638129  5271 raft_consensus.cc:1240] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:26.632273  5088 leader_election.cc:304] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:26.647480  5194 raft_consensus.cc:2468] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
I20260709 12:14:26.647683  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:26.648573  5088 leader_election.cc:304] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:14:26.648954  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:26.649561  5121 raft_consensus.cc:3060] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:26.647655  5834 raft_consensus.cc:2393] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 6: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
W20260709 12:14:26.651083  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 445810us
I20260709 12:14:26.486960  8392 raft_consensus.cc:2804] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:26.457077  8417 raft_consensus.cc:697] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:26.474915  8459 leader_election.cc:290] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:26.416916  8369 raft_consensus.cc:493] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:26.435563  8340 raft_consensus.cc:2749] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:26.610199  8413 raft_consensus.cc:697] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:26.653183  5088 leader_election.cc:304] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
W20260709 12:14:26.659060  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 454246us
W20260709 12:14:26.656929  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 341031us
I20260709 12:14:26.620700  8479 raft_consensus.cc:3055] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:26.657811  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:26.654088  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:26.679714  5194 raft_consensus.cc:2393] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 10: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:26.613641  8408 raft_consensus.cc:2804] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:26.576174  8350 consensus_queue.cc:1243] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer bce73265e27d4b30a4dcc1e491305088 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:14:26.660195  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:26.640318  8380 raft_consensus.cc:697] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 9 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:26.715763  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:26.716544  5194 raft_consensus.cc:2468] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 8.
I20260709 12:14:26.717455  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:26.717983  5194 raft_consensus.cc:3060] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:26.718394  5121 raft_consensus.cc:2468] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 8.
I20260709 12:14:26.664819  5089 leader_election.cc:304] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:26.668437  8417 consensus_queue.cc:237] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:26.349638  8188 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:26.672382  5196 raft_consensus.cc:2468] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 6.
I20260709 12:14:26.654989  8392 raft_consensus.cc:493] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:26.655753  8370 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:26.583117  8243 raft_consensus.cc:515] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:26.674923  8518 log.cc:927] Time spent T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.188s	user 0.000s	sys 0.000s
I20260709 12:14:26.651319  8510 raft_consensus.cc:2804] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:26.610532  8522 raft_consensus.cc:2804] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:26.687282  5123 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 8.
I20260709 12:14:26.760131  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:26.648639  8396 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:26.345700  8400 raft_consensus.cc:515] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:26.690014  5124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40386 (request call id 1857) took 1879 ms. Trace:
I20260709 12:14:26.723837  8408 raft_consensus.cc:697] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 6 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:26.693725  5270 raft_consensus.cc:2468] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
I20260709 12:14:26.732815  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:26.688596  5088 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:14:26.740995  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:26.748833  8392 raft_consensus.cc:3060] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:26.773228  5835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46094 (request call id 884) took 1993 ms. Trace:
I20260709 12:14:26.676048  8459 raft_consensus.cc:2804] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:26.748410  5194 raft_consensus.cc:2468] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 7.
I20260709 12:14:26.775887  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:26.749437  5266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50932 (request call id 643) took 2022 ms. Trace:
I20260709 12:14:26.773751  5835 rpcz_store.cc:276] 0709 12:14:24.779996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.319301 (+539305us) service_pool.cc:224] Handling call
0709 12:14:25.355907 (+ 36606us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:25.910725 (+554818us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:26.772965 (+862240us) spinlock_profiling.cc:243] Waited 554 ms on lock 0x7b540042a254. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:26.773164 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1274225920}
I20260709 12:14:26.679069  8479 raft_consensus.cc:740] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:26.748322  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:26.691641  8404 raft_consensus.cc:2804] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:26.711186  8523 raft_consensus.cc:2804] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:26.783597  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:26.784294  5270 raft_consensus.cc:2468] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 6.
I20260709 12:14:26.761370  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:26.347626  8431 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:26.788081  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:26.766333  5116 raft_consensus.cc:2410] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:14:26.764390  8340 raft_consensus.cc:2749] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:26.654245  8475 consensus_queue.cc:1048] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
W20260709 12:14:26.771231  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 82712.1us
I20260709 12:14:26.770254  5117 raft_consensus.cc:2468] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 8.
W20260709 12:14:26.776681  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 111909us
I20260709 12:14:26.777632  5122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59390 (request call id 615) took 1966 ms. Trace:
I20260709 12:14:26.778113  5194 raft_consensus.cc:3060] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:26.779951  5196 raft_consensus.cc:2393] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 8: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:26.776458  5266 rpcz_store.cc:276] 0709 12:14:24.726578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.726680 (+   102us) service_pool.cc:224] Handling call
0709 12:14:24.753461 (+ 26781us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:24.777033 (+ 23572us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:24.777070 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:24.796168 (+ 19098us) log.cc:844] Serialized 26 byte log entry
0709 12:14:25.164020 (+367852us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:25.164059 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:26.722463 (+1558404us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b54002558d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:26.722511 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:26.722558 (+    47us) raft_consensus.cc:1685] finished
0709 12:14:26.722569 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:26.749345 (+ 26776us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":20456,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"spinlock_wait_cycles":28752128,"thread_start_us":251185,"threads_started":1,"wal-append.queue_time_us":448991,"wal-append.run_cpu_time_us":1591,"wal-append.run_wall_time_us":1003953}
I20260709 12:14:26.762439  8463 leader_election.cc:290] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:26.679849  8369 raft_consensus.cc:515] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:26.765070  5124 rpcz_store.cc:276] 0709 12:14:24.810605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.983410 (+172805us) service_pool.cc:224] Handling call
0709 12:14:25.001794 (+ 18384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:25.052692 (+ 50898us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:25.052724 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:25.052774 (+    50us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:25.052808 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:26.689706 (+1636898us) spinlock_profiling.cc:243] Waited 50.7 ms on lock 0x7b540038d6d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:26.689777 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:26.689947 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":116549888}
I20260709 12:14:26.806871  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:26.807581  5196 raft_consensus.cc:3060] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:26.791036  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:26.810497  5125 raft_consensus.cc:2393] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 8: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:26.792702  5240 leader_election.cc:304] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:26.793839  8375 consensus_queue.cc:1059] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:26.795264  5200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41416 (request call id 596) took 1840 ms. Trace:
I20260709 12:14:26.822984  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:26.823717  5270 raft_consensus.cc:2468] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 8.
I20260709 12:14:26.781509  8530 raft_consensus.cc:2804] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:26.822566  5200 rpcz_store.cc:276] 0709 12:14:24.955326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.154759 (+199433us) service_pool.cc:224] Handling call
0709 12:14:26.795078 (+1640319us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b54003912d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:26.795200 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":404657536}
I20260709 12:14:26.825523  5829 raft_consensus.cc:2468] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 11.
I20260709 12:14:26.757616  8370 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:26.781002  8522 raft_consensus.cc:697] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:26.799007  5119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40386 (request call id 1855) took 2009 ms. Trace:
I20260709 12:14:26.801985  5089 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:26.801134  5122 rpcz_store.cc:276] 0709 12:14:24.811201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.217641 (+1406440us) service_pool.cc:224] Handling call
0709 12:14:26.217956 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:26.218148 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:14:26.632747 (+414599us) log.cc:844] Serialized 14 byte log entry
0709 12:14:26.777263 (+144516us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:26.777326 (+    63us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:26.777392 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:26.777460 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:26.777578 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16934,"prepare.queue_time_us":523621,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":2256,"raft.queue_time_us":3810,"spinlock_wait_cycles":19088128,"thread_start_us":552104,"threads_started":2}
I20260709 12:14:26.804629  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:26.832211  5117 raft_consensus.cc:2468] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 8.
I20260709 12:14:26.800348  5088 leader_election.cc:304] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:26.820737  5196 raft_consensus.cc:2468] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 7.
I20260709 12:14:26.821458  5194 raft_consensus.cc:2468] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 6.
I20260709 12:14:26.778975  8524 raft_consensus.cc:493] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:26.837430  8524 raft_consensus.cc:515] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:26.823660  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:26.798085  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:26.839802  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:26.828141  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:26.779258  8482 raft_consensus.cc:493] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:26.841714  8482 raft_consensus.cc:515] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:26.844208  8482 leader_election.cc:290] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:26.844936  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 44715.1us
I20260709 12:14:26.845674  5088 leader_election.cc:304] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:14:26.847003  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:26.849882  5088 leader_election.cc:304] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:26.852491  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:26.852763  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:26.853401  5270 raft_consensus.cc:2393] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 11: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:26.852495  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:26.854616  5200 raft_consensus.cc:2393] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 7: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:26.830575  5119 rpcz_store.cc:276] 0709 12:14:24.789331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.981224 (+191893us) service_pool.cc:224] Handling call
0709 12:14:24.981593 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:25.937446 (+955853us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:26.796116 (+858670us) spinlock_profiling.cc:243] Waited 955 ms on lock 0x7b54003edd54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:26.798946 (+  2830us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2196677376}
I20260709 12:14:26.856257  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:26.857033  5119 raft_consensus.cc:2393] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 6: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:26.857890  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:26.859661  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:26.854579  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:26.858508  5119 raft_consensus.cc:2468] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 4.
I20260709 12:14:26.860886  5274 raft_consensus.cc:3060] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:26.862605  5200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 2071) took 1859 ms. Trace:
I20260709 12:14:26.863049  5200 rpcz_store.cc:276] 0709 12:14:25.003367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.861793 (+1858426us) service_pool.cc:224] Handling call
0709 12:14:26.862104 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:26.862287 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:26.862313 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:26.862357 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:26.862387 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:26.862438 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:26.862545 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:26.870646  5274 raft_consensus.cc:2468] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 7.
I20260709 12:14:26.871979  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:26.795729  8510 raft_consensus.cc:697] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:26.770012  8396 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:26.875316  8530 raft_consensus.cc:697] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:26.877028  5119 raft_consensus.cc:1275] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:14:26.874403  5193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 2069) took 2103 ms. Trace:
I20260709 12:14:26.822542  8403 raft_consensus.cc:515] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:26.783277  8413 consensus_queue.cc:237] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:26.799746  8380 consensus_queue.cc:237] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:26.877698  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:26.929453  8340 raft_consensus.cc:2804] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:26.954871  8237 raft_consensus.cc:2804] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:26.945942  8410 leader_election.cc:290] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:27.109746  8237 raft_consensus.cc:697] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:26.945904  8479 consensus_queue.cc:260] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:27.110857  8479 raft_consensus.cc:3060] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:27.110667  8237 consensus_queue.cc:237] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:27.112386  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:27.113128  5833 raft_consensus.cc:2393] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 10: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:27.113512  5163 leader_election.cc:304] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
W20260709 12:14:26.969026  8429 consensus_meta.cc:287] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.649s	user 0.004s	sys 0.005s
I20260709 12:14:26.937208  8408 consensus_queue.cc:237] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:27.114866  5163 leader_election.cc:304] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:26.977979  8545 raft_consensus.cc:2804] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:26.977684  8522 consensus_queue.cc:237] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:27.115720  8545 raft_consensus.cc:493] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:27.116135  8545 raft_consensus.cc:3060] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:27.116605  8217 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:27.117204  8217 raft_consensus.cc:2804] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:27.117583  8217 raft_consensus.cc:493] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
W20260709 12:14:26.995208  8528 log.cc:927] Time spent T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 12:14:26.995420  8370 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:26.995471  8369 leader_election.cc:290] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:26.996269  8431 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:26.996732  8243 leader_election.cc:290] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:27.009558  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
W20260709 12:14:27.107661  5836 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46100 (request call id 971) took 2295 ms (client timeout 1926 ms). Trace:
I20260709 12:14:27.091399  5837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46100 (request call id 970) took 2279 ms. Trace:
I20260709 12:14:26.938575  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
W20260709 12:14:26.980252  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 130340us
I20260709 12:14:27.027352  5121 raft_consensus.cc:1240] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 7. Current term is 8. Ops: []
W20260709 12:14:27.164140  5836 rpcz_store.cc:269] 0709 12:14:24.812055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.897808 (+ 85753us) service_pool.cc:224] Handling call
0709 12:14:27.107376 (+2209568us) spinlock_profiling.cc:243] Waited 937 ms on lock 0x7b5400453654. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:27.107564 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2154077440}
I20260709 12:14:27.165421  5123 raft_consensus.cc:1240] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:14:27.117810  5193 rpcz_store.cc:276] 0709 12:14:24.771174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.176904 (+1405730us) service_pool.cc:224] Handling call
0709 12:14:26.177212 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:26.188225 (+ 11013us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:26.188259 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:26.188737 (+   478us) log.cc:844] Serialized 26 byte log entry
0709 12:14:26.318576 (+129839us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:26.318619 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:26.318710 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:26.874191 (+555481us) raft_consensus.cc:1685] finished
0709 12:14:26.874211 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:26.874339 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3471,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":8116,"thread_start_us":92366,"threads_started":1,"wal-append.queue_time_us":229181}
I20260709 12:14:27.109299  5274 raft_consensus.cc:2368] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 5. Current term is 6.
I20260709 12:14:27.009747  5192 raft_consensus.cc:1240] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 8. Current term is 9. Ops: []
W20260709 12:14:27.118394  5120 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59390 (request call id 607) took 2752 ms (client timeout 2432 ms). Trace:
I20260709 12:14:27.009302  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:26.879995  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:14:26.998092  8388 consensus_meta.cc:287] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.652s	user 0.010s	sys 0.000s
W20260709 12:14:27.015978  8485 consensus_meta.cc:287] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.780s	user 0.010s	sys 0.000s
I20260709 12:14:26.906675  5194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41416 (request call id 597) took 1946 ms. Trace:
I20260709 12:14:27.211473  5194 rpcz_store.cc:276] 0709 12:14:24.960471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.835191 (+1874720us) service_pool.cc:224] Handling call
0709 12:14:26.835549 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:26.835793 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:14:26.848508 (+ 12715us) log.cc:844] Serialized 14 byte log entry
0709 12:14:26.906211 (+ 57703us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:26.906296 (+    85us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:26.906348 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:26.906429 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:26.906588 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7646,"prepare.queue_time_us":142277,"raft.queue_time_us":86939,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":23263,"spinlock_wait_cycles":3472128,"thread_start_us":61957,"threads_started":3,"wal-append.queue_time_us":173489}
I20260709 12:14:27.121824  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:27.164978  5119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59390 (request call id 618) took 1983 ms. Trace:
I20260709 12:14:27.214413  5119 rpcz_store.cc:276] 0709 12:14:25.181949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.876394 (+1694445us) service_pool.cc:224] Handling call
0709 12:14:26.876699 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:27.164700 (+288001us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:27.164921 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:27.215794  5119 raft_consensus.cc:1275] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:14:27.091519  5198 raft_consensus.cc:1275] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:14:27.217242  5198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 2075) took 2182 ms. Trace:
I20260709 12:14:27.217677  5198 rpcz_store.cc:276] 0709 12:14:25.035309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.090815 (+2055506us) service_pool.cc:224] Handling call
0709 12:14:27.091156 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:27.217008 (+125852us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:27.217189 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:26.853554  8350 raft_consensus.cc:3055] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:27.089656  5272 raft_consensus.cc:3055] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:27.222477  5272 raft_consensus.cc:740] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
W20260709 12:14:27.129633  5166 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.212.129:34443 timed out after 1.827s (SENT) [suppressed 24 similar messages]
I20260709 12:14:27.224565  5200 raft_consensus.cc:1240] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:27.203078  5192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 2073) took 2191 ms. Trace:
I20260709 12:14:27.225317  5192 rpcz_store.cc:276] 0709 12:14:25.011303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.009107 (+1997804us) service_pool.cc:224] Handling call
0709 12:14:27.009577 (+   470us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:27.202777 (+193200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:27.203007 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:27.114326  5195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 2076) took 2078 ms. Trace:
I20260709 12:14:27.226408  5195 rpcz_store.cc:276] 0709 12:14:25.035598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.113510 (+2077912us) service_pool.cc:224] Handling call
0709 12:14:27.113837 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:27.114017 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:27.114041 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:27.114081 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:27.114117 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:27.114166 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:27.114260 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:27.221529  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 419584us
I20260709 12:14:27.198768  5088 leader_election.cc:304] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:27.093293  8520 raft_consensus.cc:3060] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:26.879662  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 87051.2us
W20260709 12:14:27.198164  5120 rpcz_store.cc:269] 0709 12:14:24.366439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.366642 (+   203us) service_pool.cc:224] Handling call
0709 12:14:27.118172 (+2751530us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54003449d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:27.118316 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3115147136}
W20260709 12:14:27.206067  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 91301.3us
I20260709 12:14:27.165297  5837 rpcz_store.cc:276] 0709 12:14:24.811749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.919349 (+107600us) service_pool.cc:224] Handling call
0709 12:14:27.091148 (+2171799us) spinlock_profiling.cc:243] Waited 959 ms on lock 0x7b54006e73d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:27.091309 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2206303616}
I20260709 12:14:27.219833  5193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 2077) took 2184 ms. Trace:
W20260709 12:14:27.220719  5801 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.008s	sys 0.006s
W20260709 12:14:27.221450  5265 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.007s	sys 0.007s
I20260709 12:14:27.220009  8459 raft_consensus.cc:697] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:27.202543  5124 raft_consensus.cc:2393] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 7: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:27.090099  8322 leader_election.cc:290] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:27.000552  8400 leader_election.cc:290] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:27.024889  8476 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:27.232172  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:27.223382  5272 consensus_queue.cc:260] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:27.257217  5272 raft_consensus.cc:3060] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:27.257850  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 59848us
W20260709 12:14:27.258862  5267 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.010s	sys 0.012s
W20260709 12:14:27.259267  5267 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.010s	sys 0.012s
I20260709 12:14:27.163095  8501 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.256944  5240 leader_election.cc:304] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
W20260709 12:14:27.235874  5265 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.007s	sys 0.007s
I20260709 12:14:27.235543  5193 rpcz_store.cc:276] 0709 12:14:25.035848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.206756 (+2170908us) service_pool.cc:224] Handling call
0709 12:14:27.207058 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:27.209167 (+  2109us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:27.209222 (+    55us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:27.209302 (+    80us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:27.209360 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:27.219664 (+ 10304us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:27.219776 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:27.235505  5163 leader_election.cc:304] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:27.008361  8188 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:27.113672  8340 raft_consensus.cc:493] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:27.202138  8217 raft_consensus.cc:3060] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:26.880304  8361 raft_consensus.cc:2749] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:27.284212  5197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 2063) took 2507 ms. Trace:
I20260709 12:14:27.161167  8524 leader_election.cc:290] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:26.922820  8474 raft_consensus.cc:2749] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:26.928498  8404 raft_consensus.cc:697] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 4 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:27.290083  8404 consensus_queue.cc:237] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:27.251201  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:14:27.235689  5801 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.008s	sys 0.006s
W20260709 12:14:27.314998  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 700734us
I20260709 12:14:27.315733  5801 leader_election.cc:304] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:27.320466  5801 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:27.250694  8459 consensus_queue.cc:237] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:27.223217  8388 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:27.256376  8391 consensus_queue.cc:1059] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 12:14:27.265309  5193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47728 (request call id 2072) took 2028 ms. Trace:
I20260709 12:14:27.110288  8530 consensus_queue.cc:237] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:27.266999  5089 leader_election.cc:304] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:14:27.266237  5268 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.003s	sys 0.021s
I20260709 12:14:27.232290  8370 raft_consensus.cc:2804] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:27.114387  8429 raft_consensus.cc:515] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:27.222332  8350 raft_consensus.cc:740] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:27.101140  8392 raft_consensus.cc:515] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:27.271034  5272 raft_consensus.cc:1275] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:14:27.273768  5163 leader_election.cc:304] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:27.276584  5265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34674 (request call id 2119) took 1134 ms. Trace:
I20260709 12:14:27.284423  8502 consensus_queue.cc:1048] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.090s
I20260709 12:14:27.272779  8501 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:27.277822  5267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34674 (request call id 2114) took 1140 ms. Trace:
I20260709 12:14:27.284698  5197 rpcz_store.cc:276] 0709 12:14:24.765108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.899382 (+134274us) service_pool.cc:224] Handling call
0709 12:14:24.899679 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:26.025923 (+1126244us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:27.271817 (+1245894us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54002aec54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:27.272042 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2588536064}
I20260709 12:14:27.283424  8340 raft_consensus.cc:3060] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:27.271663  8237 raft_consensus.cc:2804] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:27.275553  8296 raft_consensus.cc:2749] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:27.031520  8451 leader_election.cc:290] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:27.237287  8485 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:27.305584  8510 consensus_queue.cc:237] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:27.307548  8217 raft_consensus.cc:515] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:27.262239  8322 raft_consensus.cc:493] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.312745  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:27.262053  5194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47728 (request call id 2067) took 2079 ms. Trace:
I20260709 12:14:27.330799  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:27.287756  8476 raft_consensus.cc:2804] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:14:27.356714  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 227103us
I20260709 12:14:27.332981  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:27.401109  5116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40386 (request call id 1865) took 1104 ms. Trace:
I20260709 12:14:27.331499  5269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34674 (request call id 2115) took 1193 ms. Trace:
I20260709 12:14:27.468223  5117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59390 (request call id 619) took 2267 ms. Trace:
I20260709 12:14:27.593245  5831 raft_consensus.cc:2393] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 6: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:27.334910  5271 raft_consensus.cc:1240] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:14:27.592805  5269 rpcz_store.cc:276] 0709 12:14:26.138224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.138363 (+   139us) service_pool.cc:224] Handling call
0709 12:14:27.331315 (+1192952us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b54000d3254. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:27.331440 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":399033600}
W20260709 12:14:27.590776  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 323861us
I20260709 12:14:27.381313  5266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34674 (request call id 2126) took 1237 ms. Trace:
I20260709 12:14:27.466017  5838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46088 (request call id 604) took 1130 ms. Trace:
I20260709 12:14:27.592676  5116 rpcz_store.cc:276] 0709 12:14:26.296653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.347142 (+ 50489us) service_pool.cc:224] Handling call
0709 12:14:27.400827 (+1053685us) spinlock_profiling.cc:243] Waited 418 ms on lock 0x7b5400071554. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:27.401010 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":960725248}
I20260709 12:14:27.588829  5272 pending_rounds.cc:85] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929: Aborting all ops after (but not including) 7
I20260709 12:14:27.335311  5200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 2072) took 2331 ms. Trace:
I20260709 12:14:27.593267  5117 rpcz_store.cc:276] 0709 12:14:25.200493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.022910 (+1822417us) service_pool.cc:224] Handling call
0709 12:14:27.407045 (+384135us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:27.407279 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:27.407317 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:27.407366 (+    49us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:14:27.407400 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:27.407460 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:27.468017 (+ 60557us) spinlock_profiling.cc:243] Waited 384 ms on lock 0x7b5400071550. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc28ad 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:27.468152 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":882387712}
I20260709 12:14:27.597467  5272 pending_rounds.cc:107] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:14:27.597352  5266 rpcz_store.cc:276] 0709 12:14:26.143547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.318280 (+1174733us) service_pool.cc:224] Handling call
0709 12:14:27.380715 (+ 62435us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:27.380946 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:27.380974 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:27.381019 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:27.381051 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:27.381105 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:27.381240 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:27.597986  5272 raft_consensus.cc:2889] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:27.598881  5272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50932 (request call id 652) took 1780 ms. Trace:
I20260709 12:14:27.587877  5195 raft_consensus.cc:2468] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 9.
I20260709 12:14:27.586199  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:27.585475  5193 rpcz_store.cc:276] 0709 12:14:25.236832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.264462 (+2027630us) service_pool.cc:224] Handling call
0709 12:14:27.264808 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:27.264986 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:27.265012 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:27.265053 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:27.265082 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:27.265136 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:27.265251 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:27.595800  5838 rpcz_store.cc:276] 0709 12:14:26.335893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.531024 (+195131us) service_pool.cc:224] Handling call
0709 12:14:26.531360 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:26.783450 (+252090us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:14:26.783724 (+   274us) log.cc:844] Serialized 14 byte log entry
0709 12:14:27.140652 (+356928us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:27.140706 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:27.140746 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:27.464995 (+324249us) spinlock_profiling.cc:243] Waited 26.9 ms on lock 0x7b18004872a0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3aa42a6 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419
0709 12:14:27.465615 (+   620us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b54006702d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:27.465670 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:27.465926 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1767,"prepare.queue_time_us":482,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":129,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":33207,"spinlock_wait_cycles":641167360,"thread_start_us":356557,"threads_started":1,"wal-append.queue_time_us":472723}
I20260709 12:14:27.297204  5088 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:27.332522  5196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41416 (request call id 592) took 2382 ms. Trace:
W20260709 12:14:27.585031  5268 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.933s	user 0.012s	sys 0.037s
I20260709 12:14:27.585903  5267 rpcz_store.cc:276] 0709 12:14:26.137847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.137951 (+   104us) service_pool.cc:224] Handling call
0709 12:14:26.170010 (+ 32059us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:26.301047 (+131037us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:26.301102 (+    55us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:26.312527 (+ 11425us) log.cc:844] Serialized 52 byte log entry
0709 12:14:26.514067 (+201540us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:27.266058 (+751991us) log.cc:844] Serialized 14 byte log entry
0709 12:14:27.277065 (+ 11007us) log.cc:844] Serialized 14 byte log entry
0709 12:14:27.277476 (+   411us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:27.277556 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:27.277598 (+    42us) raft_consensus.cc:1685] finished
0709 12:14:27.277611 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:27.277748 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9546,"prepare.queue_time_us":429039,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":6494,"raft.queue_time_us":64426,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":5471,"spinlock_wait_cycles":58708608,"thread_start_us":932528,"threads_started":3,"wal-append.queue_time_us":339662}
I20260709 12:14:27.602044  5166 leader_election.cc:304] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:27.604422  5831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46088 (request call id 602) took 1319 ms. Trace:
I20260709 12:14:27.601953  5193 raft_consensus.cc:1240] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 8. Current term is 9. Ops: []
W20260709 12:14:27.587572  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 267289us
W20260709 12:14:27.606299  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 309151us
W20260709 12:14:27.586102  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 312382us
I20260709 12:14:27.606123  5193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47728 (request call id 2075) took 2278 ms. Trace:
I20260709 12:14:27.602852  5196 rpcz_store.cc:276] 0709 12:14:24.949763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.834239 (+1884476us) service_pool.cc:224] Handling call
0709 12:14:26.834576 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:26.853303 (+ 18727us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:26.853335 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:26.874378 (+ 21043us) log.cc:844] Serialized 26 byte log entry
0709 12:14:27.219759 (+345381us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:27.219798 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:27.219866 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:27.332318 (+112452us) raft_consensus.cc:1685] finished
0709 12:14:27.332339 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:27.332464 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18227,"raft.queue_time_us":24619,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":55167,"thread_start_us":296729,"threads_started":1,"wal-append.queue_time_us":450526}
I20260709 12:14:27.605646  5831 rpcz_store.cc:276] 0709 12:14:26.284942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.332701 (+1047759us) service_pool.cc:224] Handling call
0709 12:14:27.604359 (+271658us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:27.609325  5193 rpcz_store.cc:276] 0709 12:14:25.327972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.601144 (+2273172us) service_pool.cc:224] Handling call
0709 12:14:27.601724 (+   580us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:27.605892 (+  4168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:27.606069 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:27.355041  8528 log.cc:927] Time spent T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:14:27.612020  5193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41416 (request call id 600) took 1252 ms. Trace:
I20260709 12:14:27.587001  5194 rpcz_store.cc:276] 0709 12:14:25.182332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.213575 (+2031243us) service_pool.cc:224] Handling call
0709 12:14:27.261436 (+ 47861us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:27.261652 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:27.261680 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:27.261729 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:27.261762 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:27.261817 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:27.261960 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:27.619563  5088 leader_election.cc:304] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:27.619828  5191 raft_consensus.cc:2393] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 8: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:27.618911  5193 rpcz_store.cc:276] 0709 12:14:26.359602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.611222 (+1251620us) service_pool.cc:224] Handling call
0709 12:14:27.611495 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:27.611653 (+   158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:27.611676 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:27.611715 (+    39us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:27.611812 (+    97us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:27.611865 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:27.611967 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:27.622502  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:27.395807  8403 leader_election.cc:290] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:27.604758  8408 raft_consensus.cc:2804] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:27.618103  5268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50932 (request call id 637) took 3637 ms. Trace:
I20260709 12:14:27.286880  8523 raft_consensus.cc:697] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
W20260709 12:14:27.322342  8466 log.cc:927] Time spent T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 2.771s	user 0.006s	sys 0.030s
I20260709 12:14:27.623224  5196 raft_consensus.cc:1240] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 10. Current term is 11. Ops: [8.9-10.10]
I20260709 12:14:27.625070  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:27.594727  5271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34674 (request call id 2125) took 1451 ms. Trace:
I20260709 12:14:27.605880  5200 rpcz_store.cc:276] 0709 12:14:25.003655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.863967 (+1860312us) service_pool.cc:224] Handling call
0709 12:14:26.864301 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:27.225041 (+360740us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:27.323435 (+ 98394us) spinlock_profiling.cc:243] Waited 360 ms on lock 0x7b54002ae754. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:27.335239 (+ 11804us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":827986816}
I20260709 12:14:27.437842  8482 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:27.355604  8416 raft_consensus.cc:493] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.618964  8555 raft_consensus.cc:2804] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:27.604615  8136 raft_consensus.cc:3055] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:27.628497  8556 raft_consensus.cc:2804] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:14:27.608721  8024 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 12:14:27.599294  5272 rpcz_store.cc:276] 0709 12:14:25.818080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:25.818536 (+   456us) service_pool.cc:224] Handling call
0709 12:14:25.818919 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:27.089552 (+1270633us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b54000c0420. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6b3adc0 00007f84e6bc51c0 00007f84e6bc6231 00007f84e6bc2d8f 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c
0709 12:14:27.598616 (+509064us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:27.598827 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":376875392}
I20260709 12:14:27.590451  8479 raft_consensus.cc:2749] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:27.356326  8559 raft_consensus.cc:2804] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:27.392848  8396 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:27.634640  5266 raft_consensus.cc:1275] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:14:27.603814  8487 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:27.604998  8243 raft_consensus.cc:2804] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:27.619385  8563 raft_consensus.cc:2749] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:27.587723  5265 rpcz_store.cc:276] 0709 12:14:26.141966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.276318 (+134352us) service_pool.cc:224] Handling call
0709 12:14:26.301017 (+ 24699us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:26.301361 (+   344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:26.301413 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:26.301858 (+   445us) log.cc:844] Serialized 26 byte log entry
0709 12:14:26.640475 (+338617us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:27.266663 (+626188us) log.cc:844] Serialized 14 byte log entry
0709 12:14:27.276298 (+  9635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:27.276371 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:27.276407 (+    36us) raft_consensus.cc:1685] finished
0709 12:14:27.276417 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:27.276530 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9351,"prepare.queue_time_us":302560,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":10920,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":7894,"spinlock_wait_cycles":11848960,"thread_start_us":896818,"threads_started":2,"wal-append.queue_time_us":431294}
I20260709 12:14:27.293841  8395 consensus_queue.cc:1059] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.329s
I20260709 12:14:27.602615  8545 raft_consensus.cc:515] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:27.648973  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:27.604959  8237 raft_consensus.cc:697] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:27.617874  8476 raft_consensus.cc:697] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:27.642023  5268 rpcz_store.cc:276] 0709 12:14:23.967672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.213601 (+245929us) service_pool.cc:224] Handling call
0709 12:14:24.254339 (+ 40738us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:24.254821 (+   482us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:14:24.509112 (+254291us) log.cc:844] Serialized 14 byte log entry
0709 12:14:24.672574 (+163462us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:24.702083 (+ 29509us) log.cc:844] Serialized 52 byte log entry
0709 12:14:24.702235 (+   152us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:24.746121 (+ 43886us) log.cc:844] Serialized 14 byte log entry
0709 12:14:26.237574 (+1491453us) spinlock_profiling.cc:243] Waited 5.7 ms on lock 0x7b18001de0c0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3ab8e07 00007f84ec9139a9 00007f84e3ad569b 00007f84e3ad393f 00007f84e3ad3455 00007f84e6bbb060 00007f84e6bcd716 00007f84e6bde287 00007f84e6bde208
0709 12:14:26.505259 (+267685us) spinlock_profiling.cc:243] Waited 3.77 ms on lock 0x7b18001de0c0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3ad63f3 00007f84e3ad87c1 00007f84e3ad8779 00007f84e3ad8709 00007f84e3ad86d1 00007f84e3ad79cd 0000000000388634 0000000000388479 00007f84e3ab983a
0709 12:14:26.651899 (+146640us) log.cc:844] Serialized 14 byte log entry
0709 12:14:26.794202 (+142303us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b4800240258. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ebaecaa1 00007f84ebae3b37 00007f84ebae39ca 00007f84ebbdb26f 00007f84ebbdaf37 00007f84ebbef55c 00007f84ebbef508 00007f84ebbef488 00007f84ebbef443 00007f84ebbee6ec 00007f84eab18a96
0709 12:14:27.603635 (+809433us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:27.603951 (+   316us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:27.604630 (+   679us) raft_consensus.cc:1685] finished
0709 12:14:27.604645 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:27.604834 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31947,"prepare.queue_time_us":674512,"prepare.run_cpu_time_us":117,"prepare.run_wall_time_us":119,"raft.queue_time_us":56108,"raft.run_cpu_time_us":13941,"raft.run_wall_time_us":2145062,"spinlock_wait_cycles":48100992,"thread_start_us":1422122,"threads_started":4,"wal-append.queue_time_us":905710,"wal-append.run_cpu_time_us":3081,"wal-append.run_wall_time_us":1094437}
I20260709 12:14:27.601959  8322 raft_consensus.cc:515] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:27.624302  8361 raft_consensus.cc:493] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.665199  5200 raft_consensus.cc:1240] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:14:27.665494  5198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47728 (request call id 2068) took 2482 ms. Trace:
I20260709 12:14:27.653782  5801 leader_election.cc:304] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:27.664357  5271 rpcz_store.cc:276] 0709 12:14:26.143334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.311818 (+1168484us) service_pool.cc:224] Handling call
0709 12:14:27.334662 (+ 22844us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:27.594342 (+259680us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:27.594671 (+   329us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:27.637809  8524 consensus_queue.cc:1059] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:14:27.638639  8400 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:27.642045  8549 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:27.641528  8380 raft_consensus.cc:493] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:27.655202  8410 consensus_queue.cc:1059] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:14:27.668927  5118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40402 (request call id 2172) took 2910 ms. Trace:
I20260709 12:14:27.669095  5119 raft_consensus.cc:1240] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 LEADER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 8. Current term is 9. Ops: []
W20260709 12:14:28.010599  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 354804us
W20260709 12:14:28.012331  5164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:28.019748  5164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:28.019878  5088 leader_election.cc:304] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
W20260709 12:14:27.720808  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 94564.4us
I20260709 12:14:27.666114  8408 raft_consensus.cc:697] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 8 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
W20260709 12:14:28.029400  8188 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.011s	sys 0.032s
W20260709 12:14:28.030100  8188 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.011s	sys 0.033s
I20260709 12:14:28.028966  8380 raft_consensus.cc:515] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:28.031019  8408 consensus_queue.cc:237] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:27.668653  8350 consensus_queue.cc:260] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:27.652094  8404 consensus_queue.cc:1059] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.382s
I20260709 12:14:27.818688  8392 leader_election.cc:290] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:28.035300  8404 raft_consensus.cc:3055] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:28.035897  8404 raft_consensus.cc:740] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:28.037220  5116 raft_consensus.cc:1240] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 LEADER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:27.664721  8431 consensus_queue.cc:1059] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.374s
I20260709 12:14:28.039345  8451 raft_consensus.cc:2804] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:27.666774  8482 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:28.028385  8337 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:28.040441  8451 raft_consensus.cc:493] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:27.667054  8217 leader_election.cc:290] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:28.017187  5123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40402 (request call id 2181) took 1356 ms. Trace:
I20260709 12:14:28.019886  5119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40402 (request call id 2184) took 1345 ms. Trace:
I20260709 12:14:28.054533  8337 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:28.056952  5118 rpcz_store.cc:276] 0709 12:14:24.747552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.914720 (+167168us) service_pool.cc:224] Handling call
0709 12:14:24.954028 (+ 39308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:25.008845 (+ 54817us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:27.658068 (+2649223us) spinlock_profiling.cc:243] Waited 34.2 ms on lock 0x7b540038dbd4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:27.658312 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":78774656}
I20260709 12:14:28.058130  5266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34674 (request call id 2129) took 1913 ms. Trace:
I20260709 12:14:28.059137  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:28.059911  5196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41416 (request call id 599) took 1721 ms. Trace:
I20260709 12:14:28.060375  5196 rpcz_store.cc:276] 0709 12:14:26.338531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.609896 (+1271365us) service_pool.cc:224] Handling call
0709 12:14:27.610254 (+   358us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:27.653591 (+ 43337us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:28.059153 (+405562us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b54001c98d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:28.059720 (+   567us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29158784}
I20260709 12:14:28.062616  5197 raft_consensus.cc:1275] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:14:28.062958  5200 raft_consensus.cc:1240] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:28.063748  8482 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:28.064616  5197 raft_consensus.cc:1275] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:14:27.651760  8552 consensus_queue.cc:1059] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.414s
I20260709 12:14:28.066645  8552 raft_consensus.cc:3055] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:28.067167  8552 raft_consensus.cc:740] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
W20260709 12:14:28.067589  5199 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41416 (request call id 585) took 3318 ms (client timeout 1934 ms). Trace:
W20260709 12:14:28.068078  5199 rpcz_store.cc:269] 0709 12:14:24.749263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:24.749361 (+    98us) service_pool.cc:224] Handling call
0709 12:14:28.067178 (+3317817us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b5400377dd4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:28.067360 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":364710272}
I20260709 12:14:27.667822  8556 raft_consensus.cc:493] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:28.070282  8556 raft_consensus.cc:3060] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:28.071271  5194 raft_consensus.cc:2393] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 8: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:28.072204  5270 raft_consensus.cc:1240] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 9. Current term is 10. Ops: [8.5-9.6]
I20260709 12:14:27.700093  5272 raft_consensus.cc:1240] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 12:14:27.664458  5193 raft_consensus.cc:2468] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 10.
I20260709 12:14:28.074926  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:28.075769  8404 consensus_queue.cc:260] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:27.656088  8475 consensus_queue.cc:1059] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.422s
I20260709 12:14:28.078492  8404 raft_consensus.cc:3060] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:28.065737  8525 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:28.051388  5119 rpcz_store.cc:276] 0709 12:14:26.674354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.229085 (+554731us) service_pool.cc:224] Handling call
0709 12:14:27.229472 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:28.018279 (+788807us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:28.019348 (+  1069us) spinlock_profiling.cc:243] Waited 439 ms on lock 0x7b54002d2b54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:28.019695 (+   347us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1010605824}
I20260709 12:14:28.064572  8482 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.082563  8525 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:27.667346  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:28.083909  8482 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:28.073699  8559 raft_consensus.cc:493] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:28.078025  5273 raft_consensus.cc:1217] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Deduplicated request from leader. Original: 3.2->[4.3-7.5]   Dedup: 4.3->[6.4-7.5]
I20260709 12:14:28.039371  8431 raft_consensus.cc:3055] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:28.085804  5273 raft_consensus.cc:1240] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 7. Current term is 8. Ops: [4.3-7.5]
I20260709 12:14:28.085852  8431 raft_consensus.cc:740] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:28.070186  8549 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:28.088104  8431 consensus_queue.cc:260] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:28.014299  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:28.065909  5198 rpcz_store.cc:276] 0709 12:14:25.183121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.247797 (+2064676us) service_pool.cc:224] Handling call
0709 12:14:27.267146 (+ 19349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:27.273066 (+  5920us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:27.273099 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:27.284142 (+ 11043us) log.cc:844] Serialized 26 byte log entry
0709 12:14:27.629772 (+345630us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:14:27.629809 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:27.629873 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:27.665253 (+ 35380us) raft_consensus.cc:1685] finished
0709 12:14:27.665275 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:27.665434 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5511,"raft.queue_time_us":26077,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":109,"thread_start_us":257116,"threads_started":1,"wal-append.queue_time_us":344978}
I20260709 12:14:28.099877  8431 raft_consensus.cc:3060] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:28.050437  5123 rpcz_store.cc:276] 0709 12:14:26.660559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.090467 (+429908us) service_pool.cc:224] Handling call
0709 12:14:27.165156 (+ 74689us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:27.200168 (+ 35012us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:28.016553 (+816385us) spinlock_profiling.cc:243] Waited 32.1 ms on lock 0x7b540008dc50. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc28ad 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:28.016901 (+   348us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":73773312}
I20260709 12:14:28.102130  8549 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:28.058261  5195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 2083) took 1822 ms. Trace:
I20260709 12:14:28.073083  5270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34672 (request call id 1964) took 1403 ms. Trace:
I20260709 12:14:28.085497  8559 raft_consensus.cc:3060] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:28.092697  8370 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:28.045122  8451 raft_consensus.cc:3060] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:28.063278  5191 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41416 (request call id 603) took 1587 ms (client timeout 1772 ms). Trace:
I20260709 12:14:28.073623  7644 raft_consensus.cc:493] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.085584  5272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34672 (request call id 1958) took 1421 ms. Trace:
I20260709 12:14:28.086820  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:28.086648  5273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34672 (request call id 1967) took 1412 ms. Trace:
I20260709 12:14:28.058735  5266 rpcz_store.cc:276] 0709 12:14:26.144226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.606095 (+1461869us) service_pool.cc:224] Handling call
0709 12:14:27.634309 (+ 28214us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:28.057287 (+422978us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:28.057808 (+   521us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:28.077073  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:28.045156  8380 leader_election.cc:290] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:28.103242  5195 rpcz_store.cc:276] 0709 12:14:26.235216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.609088 (+1373872us) service_pool.cc:224] Handling call
0709 12:14:27.625207 (+ 16119us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:27.705259 (+ 80052us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:27.705304 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:27.705358 (+    54us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:27.705417 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:28.057718 (+352301us) spinlock_profiling.cc:243] Waited 79.8 ms on lock 0x7b5400038ed4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:28.057782 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:28.058033 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":183525632}
I20260709 12:14:28.103693  5270 rpcz_store.cc:276] 0709 12:14:26.669449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.070484 (+1401035us) service_pool.cc:224] Handling call
0709 12:14:28.071352 (+   868us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:28.072717 (+  1365us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:28.072996 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:28.116539  5272 rpcz_store.cc:276] 0709 12:14:26.663695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.699326 (+1035631us) service_pool.cc:224] Handling call
0709 12:14:27.699810 (+   484us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:28.072931 (+373121us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:28.085423 (+ 12492us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:28.088442  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:27.667475  8136 raft_consensus.cc:740] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:28.116431  5273 rpcz_store.cc:276] 0709 12:14:26.673821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.076569 (+1402748us) service_pool.cc:224] Handling call
0709 12:14:28.077259 (+   690us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:14:28.086316 (+  9057us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:28.086552 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:28.116369  5191 rpcz_store.cc:269] 0709 12:14:26.475389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.524745 (+ 49356us) service_pool.cc:224] Handling call
0709 12:14:28.062776 (+1538031us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400364a54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:28.063034 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2440933632}
I20260709 12:14:28.060216  8337 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:28.118325  7644 raft_consensus.cc:515] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:28.145435  5123 raft_consensus.cc:1240] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:28.123135  8370 raft_consensus.cc:3060] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:28.121915  8417 raft_consensus.cc:3055] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:28.150327  8550 consensus_queue.cc:1059] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:28.150367  8417 raft_consensus.cc:740] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:28.151700  8024 consensus_queue.cc:1059] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:28.152729  8525 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:28.152961  8024 raft_consensus.cc:3055] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:28.153712  8024 raft_consensus.cc:740] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:28.152994  8417 consensus_queue.cc:260] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:28.155122  5119 raft_consensus.cc:2410] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 8 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:14:28.068845  8552 consensus_queue.cc:260] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:27.655130  8474 consensus_queue.cc:1048] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.502s
I20260709 12:14:27.667326  8555 raft_consensus.cc:697] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:28.159551  8417 raft_consensus.cc:3060] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:28.162832  8575 raft_consensus.cc:493] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.163429  8482 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:28.163630  8575 raft_consensus.cc:515] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:28.164871  8552 raft_consensus.cc:3060] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:28.166972  8429 leader_election.cc:290] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:28.167833  8350 raft_consensus.cc:3060] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:28.159626  8487 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:28.170240  8575 leader_election.cc:290] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:28.165501  8555 consensus_queue.cc:237] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:28.175058  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 521135us
I20260709 12:14:28.175225  8580 raft_consensus.cc:2804] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:28.033542  8361 raft_consensus.cc:515] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:28.175992  8580 raft_consensus.cc:697] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 6 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:28.153630  8524 raft_consensus.cc:3055] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:27.880767  8340 raft_consensus.cc:515] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:28.209055  8580 consensus_queue.cc:237] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:28.209847  5269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34674 (request call id 2127) took 2066 ms. Trace:
I20260709 12:14:28.206733  5801 leader_election.cc:304] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:28.211833  5118 raft_consensus.cc:2393] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 9: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:27.722738  8523 consensus_queue.cc:237] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:28.216957  8237 consensus_queue.cc:237] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:28.221144  8545 leader_election.cc:290] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:28.224079  8243 raft_consensus.cc:697] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:28.225484  8243 consensus_queue.cc:237] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:28.229399  8322 leader_election.cc:290] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:28.230182  8501 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:28.229781  8476 consensus_queue.cc:237] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:28.152763  8400 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:27.667009  8416 raft_consensus.cc:515] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:28.242403  8400 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:28.192910  8524 raft_consensus.cc:740] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
W20260709 12:14:28.251111  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 74896.2us
W20260709 12:14:28.252079  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 232573us
I20260709 12:14:28.258468  5123 raft_consensus.cc:1275] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:28.257323  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:28.158356  8024 consensus_queue.cc:260] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:28.210753  5269 rpcz_store.cc:276] 0709 12:14:26.143762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.604867 (+1461105us) service_pool.cc:224] Handling call
0709 12:14:27.626858 (+ 21991us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:27.642085 (+ 15227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:27.642117 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:27.652283 (+ 10166us) log.cc:844] Serialized 52 byte log entry
0709 12:14:28.107521 (+455238us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:28.205563 (+ 98042us) log.cc:844] Serialized 14 byte log entry
0709 12:14:28.209226 (+  3663us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:28.209362 (+   136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:28.209424 (+    62us) raft_consensus.cc:1685] finished
0709 12:14:28.209435 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:28.209648 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2906,"prepare.queue_time_us":67215,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":55,"raft.queue_time_us":5639,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":256,"thread_start_us":437952,"threads_started":2,"wal-append.queue_time_us":367977}
I20260709 12:14:28.287990  5267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34674 (request call id 2135) took 1960 ms. Trace:
W20260709 12:14:28.446602  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 60259.2us
W20260709 12:14:28.457197  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 228443us
I20260709 12:14:28.314256  5119 raft_consensus.cc:1275] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:14:28.297850  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 44062.1us
I20260709 12:14:28.366039  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:28.353876  5120 raft_consensus.cc:1240] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 LEADER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:28.361605  5121 raft_consensus.cc:1240] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 8. Current term is 9. Ops: []
W20260709 12:14:28.314491  5238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:28.519629  5238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:28.354918  5122 raft_consensus.cc:3055] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:28.520309  5122 raft_consensus.cc:740] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:28.357568  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:28.362501  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:28.358533  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:28.470347  5200 raft_consensus.cc:1275] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:14:28.416594  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
W20260709 12:14:28.354655  5237 connection.cc:256] RPC call timeout handler was delayed by -1.1003342569999859s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27s for a response
I20260709 12:14:28.256652  8501 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:28.525853  8501 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:28.526798  5165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:28.292809  8428 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.750s	user 0.039s	sys 0.015s
W20260709 12:14:28.529474  8428 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.026s	user 0.040s	sys 0.028s
I20260709 12:14:28.312901  8340 leader_election.cc:290] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:28.531312  5804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:28.532588  5804 leader_election.cc:336] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Timed out: RequestConsensusVote RPC to 127.3.212.129:34443 timed out after 1.810s (SENT)
W20260709 12:14:28.534654  5091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:28.360572  5164 connection.cc:256] RPC call timeout handler was delayed by -1.4923150519998671s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1926s for a response
W20260709 12:14:28.537714  5164 connection.cc:256] RPC call timeout handler was delayed by -1.019948893999981s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1827s for a response
I20260709 12:14:28.289024  5801 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:28.540531  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:28.541278  5269 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 8.
I20260709 12:14:28.542834  8395 raft_consensus.cc:493] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
W20260709 12:14:28.543220  8595 log.cc:927] Time spent T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.106s	user 0.002s	sys 0.000s
I20260709 12:14:28.544413  8431 raft_consensus.cc:493] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:28.544150  8395 raft_consensus.cc:515] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:28.545049  8431 raft_consensus.cc:515] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:28.472549  8451 raft_consensus.cc:515] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:28.547161  8431 leader_election.cc:290] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:28.547554  8395 leader_election.cc:290] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:28.548413  8552 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:28.548985  8586 log.cc:927] Time spent T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 12:14:28.549011  8322 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.549153  8552 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:28.441568  8510 consensus_queue.cc:1059] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.109s
I20260709 12:14:28.549966  8322 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:28.550529  5116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40402 (request call id 2189) took 1270 ms. Trace:
I20260709 12:14:28.550905  5116 rpcz_store.cc:276] 0709 12:14:27.279985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.596198 (+316213us) service_pool.cc:224] Handling call
0709 12:14:27.596498 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:28.038116 (+441618us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:28.550243 (+512127us) spinlock_profiling.cc:243] Waited 440 ms on lock 0x7b54001b3354. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:28.550472 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1012072704}
I20260709 12:14:28.550920  8510 raft_consensus.cc:3055] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:28.552150  8510 raft_consensus.cc:740] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:28.288488  5267 rpcz_store.cc:276] 0709 12:14:26.289620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.619788 (+1330168us) service_pool.cc:224] Handling call
0709 12:14:27.628968 (+  9180us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:27.641250 (+ 12282us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:27.641280 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:27.641782 (+   502us) log.cc:844] Serialized 26 byte log entry
0709 12:14:28.086039 (+444257us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:28.086134 (+    95us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:28.086243 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:28.238403 (+152160us) raft_consensus.cc:1685] finished
0709 12:14:28.238422 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:28.250128 (+ 11706us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1016,"raft.queue_time_us":9821,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":10972,"thread_start_us":414556,"threads_started":1,"wal-append.queue_time_us":482755}
I20260709 12:14:28.441062  8417 raft_consensus.cc:493] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:28.357630  8400 raft_consensus.cc:2804] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:28.362244  8416 leader_election.cc:290] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:28.547432  8451 leader_election.cc:290] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:28.568408  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:28.355070  8520 raft_consensus.cc:493] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:28.577881  5196 raft_consensus.cc:3060] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:28.562508  8428 raft_consensus.cc:493] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.578725  8431 raft_consensus.cc:493] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:28.578879  5124 raft_consensus.cc:1240] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 LEADER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:28.368109  8556 raft_consensus.cc:515] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:28.579102  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:28.549681  8404 raft_consensus.cc:493] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.575342  5197 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:14:28.553158  8510 consensus_queue.cc:260] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:28.585984  5117 raft_consensus.cc:1240] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:28.586611  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:28.587826  5163 leader_election.cc:304] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:28.589781  5121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40402 (request call id 2182) took 1916 ms. Trace:
W20260709 12:14:28.591545  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 302625us
I20260709 12:14:28.592139  8380 raft_consensus.cc:2804] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:28.368914  8524 consensus_queue.cc:260] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:28.354506  8136 consensus_queue.cc:260] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:28.593901  8322 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:28.596978  8400 raft_consensus.cc:697] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 7 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:28.450904  8559 raft_consensus.cc:515] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:28.598992  5125 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 8.
I20260709 12:14:28.561936  8575 raft_consensus.cc:493] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.597303  5121 rpcz_store.cc:276] 0709 12:14:26.673745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.166332 (+492587us) service_pool.cc:224] Handling call
0709 12:14:27.166636 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:28.559746 (+1393110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:28.589480 (+ 29734us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400071054. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:28.589698 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2476537600}
I20260709 12:14:28.528959  8370 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:28.528986  8501 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:28.615965  5269 raft_consensus.cc:3060] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:28.616009  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:28.567487  8429 raft_consensus.cc:493] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.618430  5119 raft_consensus.cc:2393] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 10: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:28.619958  8431 raft_consensus.cc:515] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:28.620654  5122 consensus_queue.cc:260] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:28.620922  8404 raft_consensus.cc:515] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:28.621507  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:28.621788  5122 raft_consensus.cc:3060] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:28.602125  8380 raft_consensus.cc:697] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 8 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:28.623193  8404 leader_election.cc:290] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:28.622977  8380 consensus_queue.cc:237] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:28.624735  8400 consensus_queue.cc:237] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:28.625844  8510 raft_consensus.cc:3060] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:28.627604  5269 raft_consensus.cc:2468] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 7.
I20260709 12:14:28.633487  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:28.596697  7644 leader_election.cc:290] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:28.601143  8552 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:28.650661  5198 raft_consensus.cc:1240] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 8. Current term is 9. Ops: [6.6-8.7]
I20260709 12:14:28.638103  8559 leader_election.cc:290] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:28.604408  8350 consensus_queue.cc:1059] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 12:14:28.603688  8417 raft_consensus.cc:515] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:28.682390  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 94815.7us
I20260709 12:14:28.666868  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:28.671137  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:28.680397  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:28.679620  5120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40402 (request call id 2188) took 1399 ms. Trace:
I20260709 12:14:28.687402  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:28.659999  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:28.663149  5801 leader_election.cc:304] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
W20260709 12:14:28.669920  5830 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46088 (request call id 597) took 2386 ms (client timeout 2223 ms). Trace:
I20260709 12:14:28.696797  5164 leader_election.cc:304] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:28.696992  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:28.663338  8520 raft_consensus.cc:515] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:28.697909  5267 raft_consensus.cc:3060] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:28.698472  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:28.681171  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:28.699862  8520 leader_election.cc:290] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:28.656510  8575 raft_consensus.cc:515] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:28.701260  5197 raft_consensus.cc:1275] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:14:28.701936  5163 leader_election.cc:304] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:28.702764  8575 leader_election.cc:290] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:28.703377  8575 raft_consensus.cc:2749] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:28.703701  5163 leader_election.cc:400] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 election: Vote denied by peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709) with higher term. Message: Invalid argument: T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 5. Current term is 6.
I20260709 12:14:28.704016  5163 leader_election.cc:403] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:14:28.705972  5192 raft_consensus.cc:1240] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 6. Current term is 7. Ops: []
W20260709 12:14:28.706152  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 62027.4us
I20260709 12:14:28.707180  8322 raft_consensus.cc:2749] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709) with higher term. Message: Invalid argument: T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 5. Current term is 6.
I20260709 12:14:28.697438  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:28.689466  5120 rpcz_store.cc:276] 0709 12:14:27.279722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.471149 (+191427us) service_pool.cc:224] Handling call
0709 12:14:27.471491 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:28.559789 (+1088298us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:28.679300 (+119511us) spinlock_profiling.cc:243] Waited 767 ms on lock 0x7b54003ef154. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:28.679559 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1764349184}
I20260709 12:14:28.709033  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:28.709558  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:28.709749  8436 raft_consensus.cc:2804] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:28.710366  5120 raft_consensus.cc:2393] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 8: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:28.698581  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:28.711905  5125 raft_consensus.cc:2468] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 8.
I20260709 12:14:28.712682  8487 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:28.645535  8428 raft_consensus.cc:515] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:28.664351  8585 log.cc:927] Time spent T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.250s	user 0.002s	sys 0.000s
I20260709 12:14:28.670754  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:28.670104  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:28.714541  5274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34672 (request call id 1960) took 2048 ms. Trace:
I20260709 12:14:28.715790  5270 raft_consensus.cc:2468] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 11.
I20260709 12:14:28.714892  5274 rpcz_store.cc:276] 0709 12:14:26.666023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:27.797302 (+1131279us) service_pool.cc:224] Handling call
0709 12:14:27.797774 (+   472us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:28.066287 (+268513us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:28.066342 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:28.067376 (+  1034us) log.cc:844] Serialized 26 byte log entry
0709 12:14:28.246189 (+178813us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:28.246236 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:28.256874 (+ 10638us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:28.663589 (+406715us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e675e86e 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221 00007f84e67671d9 00007f84e6767169
0709 12:14:28.714140 (+ 50551us) raft_consensus.cc:1685] finished
0709 12:14:28.714160 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:28.714384 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":244019,"raft.run_cpu_time_us":444,"raft.run_wall_time_us":35500,"spinlock_wait_cycles":277901184,"thread_start_us":145951,"threads_started":1,"wal-append.queue_time_us":346451}
I20260709 12:14:28.716310  8417 leader_election.cc:290] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:28.716636  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:28.700313  8388 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:28.717319  5191 raft_consensus.cc:3060] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:28.717795  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:28.716920  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:28.719094  5274 raft_consensus.cc:2468] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 8.
I20260709 12:14:28.719420  5271 raft_consensus.cc:2393] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 8: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:28.705260  5163 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:28.720048  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:28.720248  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:28.708588  5801 leader_election.cc:304] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:28.682361  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:28.722862  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:28.670859  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:28.699880  5268 raft_consensus.cc:3060] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:28.691370  5830 rpcz_store.cc:269] 0709 12:14:26.283637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:26.283751 (+   114us) service_pool.cc:224] Handling call
0709 12:14:28.669360 (+2385609us) spinlock_profiling.cc:243] Waited 921 ms on lock 0x7b54004f1854. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:28.669684 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2118791936}
I20260709 12:14:28.710446  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:28.724759  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:28.667923  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:28.669297  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:28.718461  5272 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 6.
I20260709 12:14:28.721288  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:14:28.659715  8587 log.cc:927] Time spent T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.211s	user 0.002s	sys 0.000s
I20260709 12:14:28.670149  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:28.740242  5122 raft_consensus.cc:1275] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 12:14:28.742498  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:28.724809  5267 raft_consensus.cc:2468] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 7.
I20260709 12:14:28.683658  8370 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:28.681699  8431 leader_election.cc:290] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:28.660741  8556 leader_election.cc:290] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:28.679308  8340 consensus_queue.cc:1048] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 12:14:28.773567  8431 consensus_queue.cc:1048] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:28.776032  5166 leader_election.cc:304] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:28.776754  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:28.752271  5831 raft_consensus.cc:3060] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:28.778239  5166 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:28.779814  8322 raft_consensus.cc:2749] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:28.780520  8322 raft_consensus.cc:2804] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:28.780869  8322 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:28.752626  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:28.753494  5836 raft_consensus.cc:2393] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 10: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:28.714903  8428 leader_election.cc:290] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:28.746667  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:28.783180  5195 raft_consensus.cc:3060] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:28.784998  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:28.785979  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:28.786473  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:28.787089  5830 raft_consensus.cc:3060] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:28.787858  5832 raft_consensus.cc:1240] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:28.790509  5835 raft_consensus.cc:1240] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 4 LEADER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 3. Current term is 4. Ops: []
I20260709 12:14:28.792574  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:28.793292  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:28.794132  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:28.794982  5836 raft_consensus.cc:2368] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 5. Current term is 6.
I20260709 12:14:28.794999  5833 raft_consensus.cc:1240] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:28.798751  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:28.758668  8520 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.799450  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:28.799609  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:28.760411  8487 raft_consensus.cc:493] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.800529  8487 raft_consensus.cc:515] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:28.673519  8577 consensus_queue.cc:1059] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 12:14:28.761590  5274 raft_consensus.cc:1275] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:28.764024  5269 raft_consensus.cc:1240] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:28.764657  5838 raft_consensus.cc:2393] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 8: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:28.728421  8476 raft_consensus.cc:2749] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:28.771015  5163 leader_election.cc:304] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:28.771245  8502 raft_consensus.cc:493] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:28.771601  8388 raft_consensus.cc:2749] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:28.771981  8404 raft_consensus.cc:2749] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:28.772763  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:28.801873  8577 raft_consensus.cc:3055] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:28.796403  5018 catalog_manager.cc:5697] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:28.757689  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:28.758797  5271 raft_consensus.cc:2468] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
W20260709 12:14:28.799928  8581 log.cc:927] Time spent T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.498s	user 0.012s	sys 0.002s
I20260709 12:14:28.763392  5164 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:14:28.805998  5196 raft_consensus.cc:2468] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 9.
I20260709 12:14:28.800498  5837 raft_consensus.cc:2468] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 7.
I20260709 12:14:28.781189  8322 raft_consensus.cc:3060] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:28.846081  5831 raft_consensus.cc:2468] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 8.
I20260709 12:14:28.654044  8429 raft_consensus.cc:515] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:28.820421  5270 raft_consensus.cc:2468] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 9.
I20260709 12:14:28.814256  5195 raft_consensus.cc:2468] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 9.
I20260709 12:14:28.772686  8485 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:28.847947  5835 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:14:28.881578  8485 raft_consensus.cc:2804] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:28.881907  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:28.882290  5124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40386 (request call id 1868) took 1243 ms. Trace:
I20260709 12:14:28.882431  8502 raft_consensus.cc:515] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:28.882933  5833 raft_consensus.cc:1275] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:28.854278  5270 raft_consensus.cc:1240] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:28.884475  8582 raft_consensus.cc:3055] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:28.884698  8502 leader_election.cc:290] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:28.854518  8237 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:28.885799  8592 log.cc:927] Time spent T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.406s	user 0.002s	sys 0.000s
I20260709 12:14:28.885520  8237 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:28.887964  8237 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:28.888423  5804 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:28.884371  5833 raft_consensus.cc:1275] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:14:28.815076  8577 raft_consensus.cc:740] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:28.889627  5837 raft_consensus.cc:2468] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:14:28.882699  5124 rpcz_store.cc:276] 0709 12:14:27.639289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.084892 (+445603us) service_pool.cc:224] Handling call
0709 12:14:28.093965 (+  9073us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:28.596204 (+502239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:28.882069 (+285865us) spinlock_profiling.cc:243] Waited 468 ms on lock 0x7b54003449d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:28.882220 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1075285760}
I20260709 12:14:28.890931  8580 raft_consensus.cc:2804] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:28.880125  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:28.862280  5274 raft_consensus.cc:1275] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:14:28.853781  5193 raft_consensus.cc:1240] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:28.864013  8550 consensus_queue.cc:1048] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:28.866951  8429 leader_election.cc:290] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:28.868108  5018 catalog_manager.cc:5697] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:14:28.870211  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 99308.8us
I20260709 12:14:28.871011  8478 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:28.872243  5271 raft_consensus.cc:1275] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:14:28.867087  5191 raft_consensus.cc:2468] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 10.
I20260709 12:14:28.873883  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:28.799681  8520 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:28.876734  8487 leader_election.cc:290] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:28.877641  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 114404us
I20260709 12:14:28.878113  8370 raft_consensus.cc:493] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:28.848112  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:28.882040  8485 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
W20260709 12:14:28.889051  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:28.891121  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:28.853739  5023 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58198 (request call id 326) took 11146 ms. Trace:
I20260709 12:14:28.919468  8370 raft_consensus.cc:515] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:28.897886  8582 raft_consensus.cc:740] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:28.921253  8582 consensus_queue.cc:260] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:28.881121  8024 raft_consensus.cc:3060] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:28.921833  8478 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:28.922986  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:28.892323  5831 raft_consensus.cc:2368] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 5. Current term is 6.
I20260709 12:14:28.889853  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:28.893879  5830 raft_consensus.cc:2468] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 10.
I20260709 12:14:28.859910  5834 raft_consensus.cc:1275] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:14:28.858378  8510 consensus_queue.cc:1048] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:28.857255  5268 raft_consensus.cc:2468] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 8.
I20260709 12:14:28.821087  8575 raft_consensus.cc:2764] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:14:28.955086  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:28.924026  8478 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:28.946821  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:28.956954  5266 raft_consensus.cc:1240] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:28.921855  8370 leader_election.cc:290] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:28.953541  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:28.954234  5835 raft_consensus.cc:1240] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:28.902822  5271 pending_rounds.cc:85] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929: Aborting all ops after (but not including) 7
W20260709 12:14:28.947137  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 47000.6us
I20260709 12:14:28.953794  5164 leader_election.cc:400] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 election: Vote denied by peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539) with higher term. Message: Invalid argument: T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 5. Current term is 6.
I20260709 12:14:28.891491  8580 raft_consensus.cc:697] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 10 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:28.970187  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:28.952509  8563 raft_consensus.cc:2749] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:28.924294  8485 raft_consensus.cc:3060] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:28.958986  5271 pending_rounds.cc:107] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:14:28.980518  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:28.983065  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:28.981330  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:28.889974  8577 consensus_queue.cc:260] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:28.984030  5271 raft_consensus.cc:2889] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:28.985558  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:28.957350  8361 leader_election.cc:290] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:28.990545  5122 raft_consensus.cc:2468] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 5.
I20260709 12:14:28.992314  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:28.992249  5119 raft_consensus.cc:2468] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 6.
I20260709 12:14:28.995713  5830 raft_consensus.cc:2410] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 12:14:28.994872  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:28.999461  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:28.994553  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:28.915910  5023 rpcz_store.cc:276] 0709 12:14:17.707488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:17.707809 (+   321us) service_pool.cc:224] Handling call
0709 12:14:28.853484 (+11145675us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:20.520139 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:20.520695 (+   556us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:20.520741 (+    46us) write_op.cc:435] Acquired schema lock
0709 12:14:20.520753 (+    12us) tablet.cc:662] Decoding operations
0709 12:14:20.522597 (+  1844us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:20.522978 (+   381us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:20.523025 (+    47us) tablet.cc:685] Acquiring locks for 28 operations
0709 12:14:20.616563 (+ 93538us) tablet.cc:701] Row locks acquired
0709 12:14:20.616592 (+    29us) write_op.cc:260] PREPARE: finished
0709 12:14:20.616790 (+   198us) write_op.cc:270] Start()
0709 12:14:20.616932 (+   142us) write_op.cc:276] Timestamp: P: 1783599260616725 usec, L: 0
0709 12:14:20.616958 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:14:20.775391 (+158433us) log.cc:844] Serialized 11616 byte log entry
0709 12:14:21.011079 (+235688us) spinlock_profiling.cc:243] Waited 4.81 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e3ab90ac 00007f84ec9139a9 00007f84e3ad569b 00007f84e3ad393f 00007f84e3ad5c02 00007f84e675d20b
0709 12:14:22.377305 (+1366226us) op_driver.cc:464] REPLICATION: finished
0709 12:14:22.729538 (+352233us) write_op.cc:301] APPLY: starting
0709 12:14:22.732105 (+  2567us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:22.927561 (+195456us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:22.939111 (+ 11550us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:23.850417 (+911306us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:23.850776 (+   359us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=28
0709 12:14:23.850823 (+    47us) write_op.cc:312] APPLY: finished
0709 12:14:23.851286 (+   463us) log.cc:844] Serialized 188 byte log entry
0709 12:14:23.913916 (+ 62630us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:23.914131 (+   215us) write_op.cc:454] Released schema lock
0709 12:14:23.927118 (+ 12987us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:23.995870 (+ 68752us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:23.995897 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":34160,"reported_tablets":43,"child_traces":[["op",{"apply.queue_time_us":338489,"apply.run_cpu_time_us":29042,"apply.run_wall_time_us":1275185,"num_ops":28,"prepare.queue_time_us":237615,"prepare.run_cpu_time_us":59994,"prepare.run_wall_time_us":635049,"raft.queue_time_us":712626,"raft.run_cpu_time_us":15513,"raft.run_wall_time_us":271022,"replication_time_us":1751669,"spinlock_wait_cycles":11063552,"thread_start_us":961653,"threads_started":5,"wal-append.queue_time_us":796872,"wal-append.run_cpu_time_us":20304,"wal-append.run_wall_time_us":2562865}]]}
I20260709 12:14:28.966837  8429 consensus_queue.cc:1059] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:14:29.007575  5837 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 8.
I20260709 12:14:29.005851  5163 leader_election.cc:304] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:28.994300  8582 raft_consensus.cc:3060] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:28.971804  8322 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:29.017743  5117 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 8.
W20260709 12:14:29.023622  5237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:29.039851  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 48325.7us
I20260709 12:14:29.026235  8478 raft_consensus.cc:2804] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:29.024951  8429 consensus_queue.cc:1243] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer ad2f9a1e2f7a45429fa69fd23d09f821 log is divergent from this leader: its last log entry 9.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:14:29.029538  8577 raft_consensus.cc:3060] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:29.037205  5018 catalog_manager.cc:5697] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 1 to 4, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 4 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:14:29.055385  5163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:29.038457  8436 raft_consensus.cc:697] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 6 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:29.060726  5200 raft_consensus.cc:1240] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 4. Current term is 5. Ops: []
W20260709 12:14:29.062611  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 301299us
I20260709 12:14:29.061297  5804 leader_election.cc:304] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:14:29.068696  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 346077us
I20260709 12:14:29.071468  5836 raft_consensus.cc:1240] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 8 LEADER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:29.075564  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:29.072889  5018 catalog_manager.cc:5697] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 2 to 5, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 5 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:29.077852  5191 raft_consensus.cc:1240] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:29.074921  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:29.080715  5198 raft_consensus.cc:2410] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:14:29.062444  8478 raft_consensus.cc:697] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:29.065245  8520 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:29.100438  5195 raft_consensus.cc:2393] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 6: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:29.103644  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:29.091957  8408 raft_consensus.cc:2804] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:29.106299  8603 consensus_queue.cc:1059] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:29.106729  5801 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:29.107245  8603 consensus_queue.cc:1243] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer ad2f9a1e2f7a45429fa69fd23d09f821 log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:14:29.107822  8603 raft_consensus.cc:3055] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:29.108404  8476 raft_consensus.cc:493] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.108960  8476 raft_consensus.cc:515] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:29.111294  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 54387.4us
I20260709 12:14:29.113224  8603 raft_consensus.cc:740] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:29.114543  8603 consensus_queue.cc:260] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:29.115999  8603 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:29.117540  8404 consensus_queue.cc:1059] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:29.118331  8463 consensus_queue.cc:1059] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 12:14:29.119504  8428 raft_consensus.cc:3055] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:29.119867  8428 raft_consensus.cc:740] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:29.120746  8428 consensus_queue.cc:260] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:29.122000  8428 raft_consensus.cc:3060] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:29.123245  8475 raft_consensus.cc:3055] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:29.123778  8475 raft_consensus.cc:740] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:29.129953  8436 consensus_queue.cc:237] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:29.124778  8475 consensus_queue.cc:260] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:29.134258  8602 log.cc:927] Time spent T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:14:29.135830  8475 raft_consensus.cc:3060] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:29.138197  5193 raft_consensus.cc:1275] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:14:29.140054  5118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40386 (request call id 1873) took 1499 ms (client timeout 1827 ms). Trace:
W20260709 12:14:29.140560  5118 rpcz_store.cc:269] 0709 12:14:27.640539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.058674 (+418135us) service_pool.cc:224] Handling call
0709 12:14:29.139783 (+1081109us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b540038c2d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:29.139930 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":274293632}
W20260709 12:14:29.142345  8601 log.cc:927] Time spent T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:14:29.149392  8322 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:29.149690  5193 raft_consensus.cc:1275] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:14:29.150051  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:29.150691  5119 raft_consensus.cc:3060] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:29.151685  8136 raft_consensus.cc:3060] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:29.073370  8580 consensus_queue.cc:237] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:29.153083  5195 raft_consensus.cc:3055] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:29.153653  5195 raft_consensus.cc:740] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:29.154466  5195 consensus_queue.cc:260] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:29.156396  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 204527us
I20260709 12:14:29.159152  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:29.159894  5196 raft_consensus.cc:2468] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 7.
I20260709 12:14:29.161016  5119 raft_consensus.cc:2468] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 9.
I20260709 12:14:29.163414  5195 raft_consensus.cc:3060] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:29.166527  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 74248.2us
I20260709 12:14:29.168956  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:29.177265  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:29.170895  5240 leader_election.cc:304] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:29.186216  5199 raft_consensus.cc:1275] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:14:29.178869  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 65943.3us
I20260709 12:14:29.153666  8350 raft_consensus.cc:493] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
W20260709 12:14:29.218031  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:29.218452  5193 raft_consensus.cc:1275] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:14:29.220388  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:29.223448  5196 raft_consensus.cc:2393] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 9: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
W20260709 12:14:29.224066  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 53279.1us
I20260709 12:14:29.165932  8408 raft_consensus.cc:697] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 8 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:29.224910  5240 leader_election.cc:304] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:29.233686  5088 leader_election.cc:304] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:29.219810  5163 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:14:29.235277  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:29.236219  5194 raft_consensus.cc:1275] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:14:29.236513  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:29.172400  8520 consensus_queue.cc:1059] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 12:14:29.283154  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:29.284377  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:29.324285  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:29.285966  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 179302us
I20260709 12:14:29.270368  5088 leader_election.cc:304] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:29.232414  5200 raft_consensus.cc:1275] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:29.232722  8431 raft_consensus.cc:3055] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:29.226955  8463 raft_consensus.cc:493] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:29.240056  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:29.355434  5198 raft_consensus.cc:1240] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:29.241166  5804 leader_election.cc:304] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:29.231491  8361 raft_consensus.cc:2804] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:29.284850  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:29.361328  5271 raft_consensus.cc:3060] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:29.236021  8428 raft_consensus.cc:2804] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:14:29.365190  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 191633us
I20260709 12:14:29.365808  5268 raft_consensus.cc:1275] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:29.293557  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:14:29.366971  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 96705.7us
W20260709 12:14:29.290958  8604 log.cc:927] Time spent T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:14:29.293891  8591 raft_consensus.cc:2804] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:29.370749  5195 raft_consensus.cc:1275] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 10. (term mismatch)
I20260709 12:14:29.286391  8416 raft_consensus.cc:2804] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:29.372198  5193 raft_consensus.cc:1275] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:14:29.372830  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 142051us
I20260709 12:14:29.230995  8350 raft_consensus.cc:515] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:29.372047  5273 raft_consensus.cc:2468] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 9.
I20260709 12:14:29.289535  8530 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.292124  8476 leader_election.cc:290] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:29.354777  8431 raft_consensus.cc:740] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:29.371692  5195 pending_rounds.cc:85] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808: Aborting all ops after (but not including) 9
W20260709 12:14:29.510569  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:29.510492  5195 pending_rounds.cc:107] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808: Aborting uncommitted NO_OP operation due to leader change: 8.10
I20260709 12:14:29.511286  5195 raft_consensus.cc:2889] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:29.488346  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:29.417658  5193 raft_consensus.cc:1275] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:14:29.459818  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:29.438382  5166 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:29.514855  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:29.431824  5240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:29.376462  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:29.434340  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:29.407455  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:29.374272  5266 raft_consensus.cc:2468] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 7.
I20260709 12:14:29.376148  5163 leader_election.cc:304] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:29.518154  5120 raft_consensus.cc:1240] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:29.403019  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:29.408555  5018 catalog_manager.cc:5697] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 2 to 7. New cstate: current_term: 7 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:29.488109  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:29.515667  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 77383.3us
I20260709 12:14:29.363303  8361 raft_consensus.cc:493] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:29.377116  5088 leader_election.cc:304] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:29.525767  5198 raft_consensus.cc:2393] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 7: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
W20260709 12:14:29.524873  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 148883us
W20260709 12:14:29.434024  8024 consensus_meta.cc:287] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.511s	user 0.011s	sys 0.000s
I20260709 12:14:29.370290  8428 raft_consensus.cc:493] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:29.527705  5163 leader_election.cc:304] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:29.533625  5163 leader_election.cc:304] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:29.531576  5199 raft_consensus.cc:2393] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 11: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:29.532878  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:29.371631  8243 raft_consensus.cc:2804] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:29.488231  8510 raft_consensus.cc:493] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.368892  8552 raft_consensus.cc:2749] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:29.429762  8524 raft_consensus.cc:3060] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:29.405824  8591 raft_consensus.cc:697] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:29.432078  8610 raft_consensus.cc:493] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.538295  5267 raft_consensus.cc:1275] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:14:29.433904  8424 raft_consensus.cc:493] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.431341  8502 raft_consensus.cc:3055] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:29.412365  8580 raft_consensus.cc:2804] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:14:29.525022  8370 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:14:29.541036  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:29.374867  8416 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:29.543761  5237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:29.545117  5268 raft_consensus.cc:1275] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 12:14:29.545758  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 168721us
I20260709 12:14:29.546938  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:29.548002  8436 consensus_queue.cc:1048] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:29.537464  8428 raft_consensus.cc:3060] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:29.527136  8476 raft_consensus.cc:2804] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:29.521626  8400 raft_consensus.cc:493] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:29.554698  5163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:29.619400  5200 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 8.
I20260709 12:14:29.559324  5274 raft_consensus.cc:1275] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:14:29.506515  8614 consensus_queue.cc:1059] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:14:29.564070  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:29.560338  8610 raft_consensus.cc:515] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:29.434160  8408 consensus_queue.cc:237] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:29.560771  8502 raft_consensus.cc:740] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
W20260709 12:14:29.601657  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 63406.4us
I20260709 12:14:29.562922  8243 raft_consensus.cc:697] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:29.555160  5018 catalog_manager.cc:5697] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: config changed from index 2 to 3, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129), VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130), VOTER 9e794b72ed7640219f90ec4232363929 (127.3.212.131), VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 6 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:14:29.540943  8429 raft_consensus.cc:2804] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:14:29.587620  5091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:29.602035  8416 raft_consensus.cc:3060] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:14:29.604501  8607 log.cc:927] Time spent T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.175s	user 0.000s	sys 0.002s
I20260709 12:14:29.567266  8424 raft_consensus.cc:515] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:29.567788  8580 raft_consensus.cc:493] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:29.603103  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:29.632158  8580 raft_consensus.cc:3060] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:29.633453  8424 leader_election.cc:290] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:29.635531  5273 raft_consensus.cc:1275] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:14:29.637135  8612 log.cc:927] Time spent T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.199s	user 0.002s	sys 0.000s
I20260709 12:14:29.402264  8463 raft_consensus.cc:515] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:29.608295  8622 log.cc:927] Time spent T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 12:14:29.608877  8618 log.cc:927] Time spent T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.233s	user 0.001s	sys 0.000s
W20260709 12:14:29.609743  8606 log.cc:927] Time spent T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 12:14:29.552989  8575 raft_consensus.cc:2804] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:29.529191  8520 consensus_queue.cc:1059] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:14:29.617468  5266 raft_consensus.cc:1275] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:14:29.618775  8620 log.cc:927] Time spent T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 12:14:29.530570  8361 raft_consensus.cc:3060] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:29.640151  8614 consensus_queue.cc:1243] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer dd62e75bd3ed4ed28f1fb5955d650808 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:14:29.434985  8485 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:29.560599  8563 raft_consensus.cc:2804] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:29.402163  8478 consensus_queue.cc:237] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:29.557729  8551 raft_consensus.cc:2804] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:14:29.621918  5237 leader_election.cc:336] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Timed out: RequestConsensusVote RPC to 127.3.212.130:44455 timed out after 1.545s (SENT)
I20260709 12:14:29.554021  8510 raft_consensus.cc:515] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:29.630113  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:29.599494  8619 log.cc:927] Time spent T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.163s	user 0.003s	sys 0.001s
I20260709 12:14:29.682245  8510 leader_election.cc:290] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:29.606905  8388 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.674597  8609 consensus_queue.cc:1048] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:14:29.637929  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:29.643860  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:29.629106  8429 raft_consensus.cc:493] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:29.686414  8429 raft_consensus.cc:3060] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:29.686100  8388 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:29.688364  8388 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:29.644523  8418 consensus_queue.cc:1048] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:14:29.689899  8380 raft_consensus.cc:3055] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:14:29.690297  8380 raft_consensus.cc:740] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:29.691150  8380 consensus_queue.cc:260] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:29.691563  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:29.692471  8380 raft_consensus.cc:3060] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:29.646678  8463 leader_election.cc:290] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:29.647414  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:29.647185  8591 consensus_queue.cc:237] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:29.647758  5272 raft_consensus.cc:1275] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:14:29.695176  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:29.645980  8350 leader_election.cc:290] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:29.649179  8610 leader_election.cc:290] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:29.623346  8476 raft_consensus.cc:697] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:29.696394  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:29.696947  8476 consensus_queue.cc:237] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:29.556150  8530 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:29.405575  8475 consensus_queue.cc:1059] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.137s
I20260709 12:14:29.699460  8530 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:29.624511  8555 consensus_queue.cc:1048] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:14:29.617611  8431 consensus_queue.cc:260] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:29.665521  5163 leader_election.cc:304] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:29.700892  8431 raft_consensus.cc:3060] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:29.670050  8575 raft_consensus.cc:697] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:29.703089  8575 consensus_queue.cc:237] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:29.623054  8400 raft_consensus.cc:515] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:29.666311  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:29.674049  5804 leader_election.cc:304] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:29.645783  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:29.693090  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:29.694093  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:29.694545  5198 raft_consensus.cc:1240] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:29.694557  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:29.697453  8520 raft_consensus.cc:493] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.700069  8530 raft_consensus.cc:3055] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:29.631423  5088 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:29.707033  5195 raft_consensus.cc:2393] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 9: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
W20260709 12:14:29.714218  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 82867.9us
I20260709 12:14:29.678467  5237 leader_election.cc:304] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:29.704964  8429 raft_consensus.cc:515] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:29.711318  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 48225.9us
I20260709 12:14:29.715794  5163 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:29.716869  5163 leader_election.cc:304] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:29.711645  5199 raft_consensus.cc:2410] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 12:14:29.707523  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:29.728180  5191 raft_consensus.cc:2468] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 6.
I20260709 12:14:29.713300  8370 raft_consensus.cc:2804] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:29.661509  8552 consensus_queue.cc:1048] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 12:14:29.707876  8563 raft_consensus.cc:697] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:29.737174  8243 consensus_queue.cc:237] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:29.737943  8436 raft_consensus.cc:2749] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:29.738898  8463 raft_consensus.cc:2749] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:29.740425  8582 consensus_meta.cc:287] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.728s	user 0.008s	sys 0.003s
I20260709 12:14:29.741004  5123 raft_consensus.cc:2468] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 8.
I20260709 12:14:29.741672  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:29.742444  5198 raft_consensus.cc:2393] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 6: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:29.746137  5200 raft_consensus.cc:1240] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 9. Current term is 10. Ops: []
W20260709 12:14:29.747499  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 130231us
W20260709 12:14:29.749146  5237 leader_election.cc:336] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Timed out: RequestConsensusVote RPC to 127.3.212.130:44455 timed out after 1.565s (SENT)
I20260709 12:14:29.761459  5192 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 8.
I20260709 12:14:29.713833  8530 raft_consensus.cc:740] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:29.769979  8530 consensus_queue.cc:260] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:29.770548  8400 leader_election.cc:290] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:29.715456  8551 raft_consensus.cc:697] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:29.731408  8388 raft_consensus.cc:2804] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:29.733644  8370 raft_consensus.cc:493] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:29.770007  5240 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:29.730902  8510 raft_consensus.cc:2804] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:14:29.783576  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 109614us
I20260709 12:14:29.699368  8502 consensus_queue.cc:260] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:29.771440  8621 log.cc:927] Time spent T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.264s	user 0.001s	sys 0.000s
W20260709 12:14:29.821213  5801 connection.cc:256] RPC call timeout handler was delayed by -1.9035275399999136s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17720000000000002s for a response
W20260709 12:14:29.844707  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:29.733906  8475 consensus_queue.cc:1048] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 12:14:29.749331  8428 raft_consensus.cc:515] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:29.781667  8388 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:29.784159  8510 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:29.734530  8520 raft_consensus.cc:515] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:29.819905  8463 raft_consensus.cc:2804] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:29.785351  8530 raft_consensus.cc:3060] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:29.784686  8370 raft_consensus.cc:3060] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:29.843508  8501 raft_consensus.cc:493] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:29.865792  5801 connection.cc:256] RPC call timeout handler was delayed by -1.6425275399999464s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2062s for a response
W20260709 12:14:29.868465  5801 connection.cc:256] RPC call timeout handler was delayed by -1.2384275399999751s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25110000000000005s for a response
W20260709 12:14:29.869764  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 152956us
I20260709 12:14:29.870493  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:29.870807  5163 leader_election.cc:304] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:29.872756  5163 leader_election.cc:304] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:29.874691  8575 raft_consensus.cc:493] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:29.878960  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 129868us
I20260709 12:14:29.781072  8361 raft_consensus.cc:515] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:29.868561  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 144936us
I20260709 12:14:29.883486  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:29.865887  8388 raft_consensus.cc:3060] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:29.885515  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:29.885651  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:29.865046  8463 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:29.864782  8510 raft_consensus.cc:3060] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:29.895517  5801 leader_election.cc:304] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:29.911401  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:29.873003  8502 raft_consensus.cc:3060] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:29.902380  5271 consensus_meta.cc:287] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.530s	user 0.009s	sys 0.001s
I20260709 12:14:29.918486  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:29.918850  5271 raft_consensus.cc:2468] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 9.
W20260709 12:14:29.881291  8577 consensus_meta.cc:287] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.824s	user 0.009s	sys 0.002s
I20260709 12:14:29.923375  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:29.923946  5273 raft_consensus.cc:1240] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 8. Current term is 9. Ops: [5.5-8.7]
I20260709 12:14:29.903362  5194 raft_consensus.cc:1240] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 LEADER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:29.903719  5198 raft_consensus.cc:1240] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 LEADER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:29.783353  8563 consensus_queue.cc:237] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:29.931696  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:29.867107  8552 raft_consensus.cc:2749] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:29.912289  5265 raft_consensus.cc:2393] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 11: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:29.919269  5267 raft_consensus.cc:3060] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:29.885782  8429 leader_election.cc:290] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:29.873363  8501 raft_consensus.cc:515] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:29.930810  5269 raft_consensus.cc:2368] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 5. Current term is 6.
I20260709 12:14:29.932329  5199 raft_consensus.cc:2468] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 7.
I20260709 12:14:29.932745  5163 leader_election.cc:304] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:14:29.933938  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:29.940491  5196 raft_consensus.cc:1275] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:29.930096  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:29.950213  5270 raft_consensus.cc:3060] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:29.943710  5200 raft_consensus.cc:1240] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:14:29.924237  5272 raft_consensus.cc:2468] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 8.
I20260709 12:14:29.929652  8609 raft_consensus.cc:2804] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:29.910905  8476 raft_consensus.cc:2749] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:29.917683  8463 raft_consensus.cc:3060] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:29.890717  8610 consensus_queue.cc:1048] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:14:29.961894  8408 consensus_queue.cc:1048] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:29.952190  8485 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:29.973953  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:29.975296  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:29.975986  5265 raft_consensus.cc:2468] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 6.
I20260709 12:14:29.976852  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:29.978211  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:29.979521  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:29.980671  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:29.948137  8555 consensus_queue.cc:1048] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:14:29.986522  8501 leader_election.cc:290] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:29.990235  8024 consensus_queue.cc:1059] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:14:29.991286  8024 consensus_queue.cc:1048] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:29.992600  8024 consensus_queue.cc:1048] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:29.992779  8350 raft_consensus.cc:3055] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:29.981225  5271 raft_consensus.cc:2468] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 10.
I20260709 12:14:29.902472  8614 consensus_queue.cc:1048] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:14:30.000470  5267 raft_consensus.cc:2468] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 10.
I20260709 12:14:30.003162  5270 raft_consensus.cc:2468] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 8.
I20260709 12:14:29.993191  8520 leader_election.cc:290] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:29.998953  5237 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:29.935949  8575 raft_consensus.cc:515] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:29.955111  8609 raft_consensus.cc:493] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:30.016016  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:30.022161  5123 raft_consensus.cc:3060] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:14:30.023166  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:30.018777  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:30.019325  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:30.020912  5237 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:29.952701  8475 consensus_queue.cc:1048] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 12:14:30.029728  5116 raft_consensus.cc:2410] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:14:30.001683  8350 raft_consensus.cc:740] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:29.912900  8551 consensus_queue.cc:237] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:30.046463  5240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:30.059046  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:30.028277  5118 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
new_leader_uuid: "bce73265e27d4b30a4dcc1e491305088"
 from {username='slave'} at 127.0.0.1:45628
I20260709 12:14:30.061143  5118 raft_consensus.cc:606] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 LEADER]: Received request to transfer leadership to TS bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:30.010191  8627 raft_consensus.cc:2749] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:30.016292  8552 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.065124  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:30.078478  5237 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:30.028683  8136 raft_consensus.cc:2804] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:30.025036  8630 raft_consensus.cc:493] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:30.081580  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:30.081935  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:30.085440  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:30.085886  5116 raft_consensus.cc:3060] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:30.029815  8609 raft_consensus.cc:3060] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:30.043596  8476 raft_consensus.cc:2804] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:30.082270  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:30.082875  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:30.046304  8424 raft_consensus.cc:2749] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:30.092547  5122 raft_consensus.cc:1240] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:30.018535  8416 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:30.004518  8580 raft_consensus.cc:515] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:30.089393  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:30.096710  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:30.098488  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:30.095652  5117 raft_consensus.cc:2468] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 5.
I20260709 12:14:30.098932  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:30.129528  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:30.131656  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:30.134505  5838 raft_consensus.cc:2410] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:14:30.084261  8136 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:30.082675  8552 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:30.141479  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
W20260709 12:14:30.141848  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 52929.4us
I20260709 12:14:30.143234  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:30.145470  5830 raft_consensus.cc:2393] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 8: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:30.146437  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:30.147682  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:30.148442  5830 raft_consensus.cc:2393] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 6: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:30.149662  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:30.144007  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:14:30.150625  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 218648us
I20260709 12:14:30.150830  5835 raft_consensus.cc:2468] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 6.
I20260709 12:14:30.153723  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:30.154832  5831 raft_consensus.cc:2410] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:14:30.154703  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:30.160691  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:14:30.161414  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 282081us
I20260709 12:14:30.100118  8428 leader_election.cc:290] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:30.163759  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:30.155766  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:30.164837  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:30.166388  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:30.167773  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:30.164786  5831 raft_consensus.cc:2368] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 5. Current term is 6.
I20260709 12:14:30.144418  8136 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:30.168412  5834 raft_consensus.cc:2376] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 10. Re-sending same reply.
I20260709 12:14:30.168890  8632 consensus_queue.cc:1059] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:14:30.171200  8632 consensus_queue.cc:1243] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer bce73265e27d4b30a4dcc1e491305088 log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:14:30.171773  8632 raft_consensus.cc:3055] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:30.172134  8632 raft_consensus.cc:740] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:30.172230  8361 leader_election.cc:290] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:30.166642  8555 consensus_queue.cc:1048] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 12:14:30.175710  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:30.177037  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:30.178841  5834 raft_consensus.cc:1275] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:14:30.179227  5834 pending_rounds.cc:85] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088: Aborting all ops after (but not including) 7
I20260709 12:14:30.179452  5834 pending_rounds.cc:107] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:14:30.179682  5834 raft_consensus.cc:2889] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:30.169592  5089 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:30.182521  5089 leader_election.cc:304] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:30.184104  5089 leader_election.cc:400] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 election: Vote denied by peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539) with higher term. Message: Invalid argument: T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 5. Current term is 6.
I20260709 12:14:30.184401  5089 leader_election.cc:403] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:14:30.099752  8630 raft_consensus.cc:515] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:30.185621  8555 raft_consensus.cc:2804] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:30.186076  8555 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:30.186504  8555 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:30.187677  8630 leader_election.cc:290] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:30.173180  8632 consensus_queue.cc:260] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:30.189750  8632 raft_consensus.cc:3060] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:30.190052  8629 log.cc:927] Time spent T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
W20260709 12:14:30.191840  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 113435us
I20260709 12:14:30.192889  5237 leader_election.cc:304] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:30.193646  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:30.194535  5834 raft_consensus.cc:1275] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:14:30.203356  5838 raft_consensus.cc:2468] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 8.
I20260709 12:14:30.210799  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:30.213037  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:30.216435  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:14:30.234400  5091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:30.240386  5835 raft_consensus.cc:2368] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 11. Current term is 12.
I20260709 12:14:30.233219  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:14:30.239341  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 142299us
I20260709 12:14:30.241007  5830 raft_consensus.cc:2468] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 9.
I20260709 12:14:30.239948  5831 raft_consensus.cc:1275] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:14:30.242623  5123 raft_consensus.cc:2468] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 6.
W20260709 12:14:30.242326  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 309655us
I20260709 12:14:30.243818  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:14:30.245168  5163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:30.143826  8476 raft_consensus.cc:697] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:30.244794  5836 raft_consensus.cc:2468] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 11.
I20260709 12:14:30.154131  8647 raft_consensus.cc:2749] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:30.253872  5163 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:30.262553  5163 leader_election.cc:304] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:30.257771  5829 raft_consensus.cc:1240] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 7. Current term is 8. Ops: []
W20260709 12:14:30.239959  8524 consensus_meta.cc:287] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.677s	user 0.010s	sys 0.000s
I20260709 12:14:30.273221  5164 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:30.273780  5197 raft_consensus.cc:1275] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:14:30.275096  8580 leader_election.cc:290] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:30.275223  8636 raft_consensus.cc:2804] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:30.275473  5164 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:30.275795  8636 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:30.276053  5197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 2108) took 1537 ms. Trace:
I20260709 12:14:30.276409  5197 rpcz_store.cc:276] 0709 12:14:28.738632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:28.738819 (+   187us) service_pool.cc:224] Handling call
0709 12:14:28.758354 (+ 19535us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:30.274280 (+1515926us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:30.275796 (+  1516us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b54003903d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:30.275972 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3484029824}
I20260709 12:14:30.277129  8370 raft_consensus.cc:515] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:30.278139  8524 raft_consensus.cc:2749] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:30.278301  8631 raft_consensus.cc:2749] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:30.277172  5164 leader_election.cc:304] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:30.279597  8370 leader_election.cc:290] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:30.280256  8370 raft_consensus.cc:2749] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:30.280660  5164 leader_election.cc:304] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
W20260709 12:14:30.281282  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 88510.1us
I20260709 12:14:30.282351  5237 leader_election.cc:304] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:30.282955  5164 leader_election.cc:304] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:30.283494  5237 leader_election.cc:304] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:30.283706  8631 raft_consensus.cc:2804] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:30.284243  8631 raft_consensus.cc:697] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:30.284494  8643 raft_consensus.cc:2749] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:30.285163  8631 consensus_queue.cc:237] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:30.245821  8428 raft_consensus.cc:2749] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:14:30.264986  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 49296.3us
I20260709 12:14:30.268131  8400 consensus_queue.cc:1059] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:30.268857  8563 raft_consensus.cc:2804] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:30.277637  8322 raft_consensus.cc:493] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.216027  8582 raft_consensus.cc:2804] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:30.289819  5164 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:30.263751  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:30.194051  8591 consensus_queue.cc:1048] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 12:14:30.259977  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
W20260709 12:14:30.299662  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 54035.5us
I20260709 12:14:30.309037  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:30.310076  5238 leader_election.cc:304] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:30.311920  5089 leader_election.cc:304] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:14:30.313601  5164 leader_election.cc:304] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:14:30.313676  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:30.314354  5274 raft_consensus.cc:3060] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:30.308449  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 114143us
I20260709 12:14:30.306186  5831 raft_consensus.cc:2393] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 6: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:30.296671  5832 raft_consensus.cc:2468] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 8.
I20260709 12:14:30.248864  8418 raft_consensus.cc:2749] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539) with higher term. Message: Invalid argument: T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 5. Current term is 6.
I20260709 12:14:30.321137  5268 raft_consensus.cc:1275] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:14:30.298475  5116 raft_consensus.cc:2468] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 7.
I20260709 12:14:30.215600  8424 consensus_queue.cc:1048] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.086s
I20260709 12:14:30.247200  8475 consensus_queue.cc:1048] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.059s
W20260709 12:14:30.331243  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 71987.9us
I20260709 12:14:30.334771  5804 leader_election.cc:304] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:30.335582  5164 leader_election.cc:304] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
W20260709 12:14:30.337028  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 75240.6us
I20260709 12:14:30.215801  8361 consensus_queue.cc:1048] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.088s
I20260709 12:14:30.313066  8322 raft_consensus.cc:515] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:30.314777  8582 raft_consensus.cc:493] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:30.315905  8520 raft_consensus.cc:2749] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:30.246708  8350 consensus_queue.cc:260] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:30.347811  5238 leader_election.cc:304] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:30.301872  8636 raft_consensus.cc:3060] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:30.351794  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 68354.4us
I20260709 12:14:30.341467  8524 raft_consensus.cc:2749] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:30.341799  8655 raft_consensus.cc:2804] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:30.341670  8647 raft_consensus.cc:2749] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:30.349895  5801 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:30.302477  8555 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:30.395960  8637 log.cc:927] Time spent T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.311s	user 0.000s	sys 0.001s
I20260709 12:14:30.341704  8563 raft_consensus.cc:697] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:30.345345  8400 raft_consensus.cc:2749] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:14:30.391346  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 56624.8us
I20260709 12:14:30.404707  5804 leader_election.cc:304] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:30.350054  8643 raft_consensus.cc:493] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.347700  8582 raft_consensus.cc:3060] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:30.345453  8501 raft_consensus.cc:3060] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:30.396765  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 81290.6us
W20260709 12:14:30.400684  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 59592.3us
W20260709 12:14:30.400893  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 53148.9us
W20260709 12:14:30.387177  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 51674.6us
I20260709 12:14:30.408924  5238 leader_election.cc:304] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:30.387713  8485 raft_consensus.cc:2749] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:14:30.391872  8428 raft_consensus.cc:2749] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:14:30.403362  8644 log.cc:927] Time spent T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
W20260709 12:14:30.403431  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 53620.9us
I20260709 12:14:30.408982  5164 leader_election.cc:304] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:30.401849  5237 leader_election.cc:304] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:30.391114  8552 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:30.409907  5089 leader_election.cc:400] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Vote denied by peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539) with higher term. Message: Invalid argument: T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 5. Current term is 6.
I20260709 12:14:30.413442  5238 leader_election.cc:304] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:30.399747  8655 raft_consensus.cc:493] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:30.421759  5088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:30.400274  8657 raft_consensus.cc:2804] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:30.432914  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:30.433202  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:30.434980  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:30.411550  8416 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:30.435395  5193 raft_consensus.cc:2468] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 7.
I20260709 12:14:30.418144  8614 raft_consensus.cc:2804] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:14:30.454960  5804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:30.455394  5804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:30.455858  5804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:30.459024  5240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:30.424695  8361 raft_consensus.cc:2804] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:30.439868  5089 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:30.469857  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:30.448841  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:30.449654  8428 raft_consensus.cc:2749] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:30.450934  8591 consensus_queue.cc:1048] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:30.423839  8655 raft_consensus.cc:3060] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:30.389493  8476 consensus_queue.cc:237] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:30.453716  8400 raft_consensus.cc:2804] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:30.482263  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:30.485054  5273 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 8.
W20260709 12:14:30.489833  8388 consensus_meta.cc:287] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.565s	user 0.009s	sys 0.002s
I20260709 12:14:30.490319  8388 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:30.466815  8361 raft_consensus.cc:493] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:30.492164  8361 raft_consensus.cc:3060] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:30.447147  8510 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:30.495824  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:30.496498  5267 raft_consensus.cc:2468] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 8.
W20260709 12:14:30.497001  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 57213us
I20260709 12:14:30.497026  5120 raft_consensus.cc:1240] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:14:30.412573  8643 raft_consensus.cc:515] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:30.424855  8575 leader_election.cc:290] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:30.469220  5238 leader_election.cc:304] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:30.467851  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:30.433131  8647 raft_consensus.cc:2749] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:30.474852  5270 raft_consensus.cc:2468] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:14:30.433821  8485 raft_consensus.cc:2749] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:30.464684  8639 consensus_queue.cc:1048] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:14:30.485595  8400 raft_consensus.cc:493] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:30.447923  8661 raft_consensus.cc:493] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.465364  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:30.422823  8475 consensus_queue.cc:1048] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:14:30.447531  8552 consensus_queue.cc:1048] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:14:30.496565  8510 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:30.466337  8657 raft_consensus.cc:697] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:30.445623  5164 leader_election.cc:400] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 election: Vote denied by peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539) with higher term. Message: Invalid argument: T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 11. Current term is 12.
W20260709 12:14:30.477710  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 78413.1us
I20260709 12:14:30.497236  8563 consensus_queue.cc:237] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:30.484138  8614 raft_consensus.cc:697] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 8 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:30.542755  5193 raft_consensus.cc:2393] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 7: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:30.500674  8424 raft_consensus.cc:493] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:30.543720  8672 raft_consensus.cc:493] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.544174  5163 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:30.545735  5164 leader_election.cc:403] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
W20260709 12:14:30.572134  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 132223us
I20260709 12:14:30.551558  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:30.552671  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:30.546838  5237 leader_election.cc:304] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:30.574218  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:30.553707  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:30.574862  5193 raft_consensus.cc:1240] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 12:14:30.504772  8631 raft_consensus.cc:493] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:30.549095  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 99556.1us
I20260709 12:14:30.573099  5829 raft_consensus.cc:3055] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:30.520166  8428 raft_consensus.cc:2804] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:30.529191  8400 raft_consensus.cc:3060] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:30.575044  5237 leader_election.cc:304] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:30.581777  5835 raft_consensus.cc:1275] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:30.565527  8662 raft_consensus.cc:2749] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:30.575568  5829 raft_consensus.cc:740] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:30.539909  8475 consensus_queue.cc:1243] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer bce73265e27d4b30a4dcc1e491305088 log is divergent from this leader: its last log entry 4.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 12:14:30.618698  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 118575us
I20260709 12:14:30.619774  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:30.627758  5830 raft_consensus.cc:2468] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 7.
I20260709 12:14:30.630221  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:30.631762  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
W20260709 12:14:30.653028  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 72898.7us
I20260709 12:14:30.580647  8647 raft_consensus.cc:2804] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:30.616590  8485 raft_consensus.cc:3060] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:30.656191  5240 leader_election.cc:304] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:30.579120  8428 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:30.618477  8551 raft_consensus.cc:493] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:30.657588  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 82630.4us
I20260709 12:14:30.666602  5274 raft_consensus.cc:2468] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 8.
W20260709 12:14:30.707237  5091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:30.579402  8627 raft_consensus.cc:2804] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:30.723392  5801 leader_election.cc:304] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:14:30.726547  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:30.739701  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:30.634316  5829 consensus_queue.cc:260] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:30.727471  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 71366.8us
I20260709 12:14:30.740649  5124 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
new_leader_uuid: "bce73265e27d4b30a4dcc1e491305088"
 from {username='slave'} at 127.0.0.1:45628
I20260709 12:14:30.731686  5237 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:30.581036  8591 consensus_queue.cc:1048] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 12:14:30.741339  5124 raft_consensus.cc:606] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 LEADER]: Received request to transfer leadership to TS bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:30.622323  8024 raft_consensus.cc:2749] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:30.743142  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:30.560103  8661 raft_consensus.cc:515] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:30.577158  8424 raft_consensus.cc:515] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:30.745994  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:30.721701  8647 raft_consensus.cc:493] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:30.747566  5240 leader_election.cc:304] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:30.746863  5088 leader_election.cc:304] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:30.584702  8631 raft_consensus.cc:515] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:30.730674  8428 raft_consensus.cc:3060] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:30.758769  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:30.619406  8609 raft_consensus.cc:515] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:30.768157  5117 raft_consensus.cc:1240] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:14:30.738916  8627 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:30.738662  8502 raft_consensus.cc:2804] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:30.766990  5088 leader_election.cc:304] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:30.768181  5123 raft_consensus.cc:1275] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:14:30.766628  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 183671us
W20260709 12:14:30.771107  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 103184us
I20260709 12:14:30.781324  5116 raft_consensus.cc:1275] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:14:30.782801  5164 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:30.792047  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:30.738512  8662 consensus_queue.cc:1048] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 12:14:30.759742  8647 raft_consensus.cc:3060] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:30.794052  8502 raft_consensus.cc:697] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 6 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:30.780212  8627 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:30.743156  8551 raft_consensus.cc:515] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:30.792246  8663 log.cc:927] Time spent T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
W20260709 12:14:30.825874  8677 log.cc:927] Time spent T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:14:30.586194  8672 raft_consensus.cc:515] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:30.916080  5802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:30.782792  8657 consensus_queue.cc:237] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:30.766631  8614 consensus_queue.cc:237] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:31.003113  8478 raft_consensus.cc:2749] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:14:30.782394  8024 raft_consensus.cc:2804] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:30.790568  8577 raft_consensus.cc:2749] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:30.824762  8679 raft_consensus.cc:2749] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:31.005851  8667 log.cc:927] Time spent T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.259s	user 0.000s	sys 0.006s
W20260709 12:14:31.011456  8668 log.cc:927] Time spent T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.436s	user 0.013s	sys 0.011s
I20260709 12:14:30.797109  8666 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:30.758432  8650 raft_consensus.cc:493] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.018877  5801 leader_election.cc:304] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:30.769948  8639 raft_consensus.cc:2749] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:31.069343  5088 leader_election.cc:304] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:31.074330  5122 raft_consensus.cc:1275] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:14:31.025142  8520 raft_consensus.cc:2804] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:14:31.078958  5197 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.002s	sys 0.015s
I20260709 12:14:31.031625  8680 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.043002  8643 leader_election.cc:290] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:31.108202  5166 leader_election.cc:304] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:31.073472  8024 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
W20260709 12:14:31.125347  5199 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.006s	sys 0.015s
W20260709 12:14:31.125799  5199 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.007s	sys 0.015s
W20260709 12:14:31.115017  5197 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.003s	sys 0.015s
I20260709 12:14:31.087527  8661 leader_election.cc:290] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:31.129424  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 110617us
W20260709 12:14:31.107798  8665 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.007s	sys 0.018s
W20260709 12:14:31.132597  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 385093us
W20260709 12:14:31.121454  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 389810us
I20260709 12:14:31.142834  5237 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:14:31.130373  8632 consensus_meta.cc:287] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.937s	user 0.016s	sys 0.000s
I20260709 12:14:31.128901  8024 raft_consensus.cc:3060] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:31.152283  5091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:31.130784  8475 raft_consensus.cc:2804] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:31.127538  8520 raft_consensus.cc:697] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 7 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:31.085357  8502 consensus_queue.cc:237] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:31.169864  8520 consensus_queue.cc:237] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:31.170709  8424 leader_election.cc:290] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:31.171543  8424 raft_consensus.cc:493] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:31.172128  8424 raft_consensus.cc:515] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:31.173615  5089 leader_election.cc:336] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Timed out: RequestConsensusVote RPC to 127.3.212.132:43539 timed out after 1.676s (SENT)
W20260709 12:14:31.174455  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 129990us
W20260709 12:14:31.175076  8681 log.cc:927] Time spent T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:14:31.177029  5801 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:31.135658  8429 raft_consensus.cc:2749] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:14:31.138212  8665 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.007s	sys 0.019s
W20260709 12:14:31.177328  8684 log.cc:927] Time spent T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:14:31.183146  8639 raft_consensus.cc:2749] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:31.184430  5801 leader_election.cc:304] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:31.188098  8632 consensus_queue.cc:1048] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:31.108430  8666 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:31.107396  8650 raft_consensus.cc:515] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:31.161847  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:31.133947  8640 raft_consensus.cc:2749] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:31.201002  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:31.202657  5269 raft_consensus.cc:2468] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 10.
I20260709 12:14:31.131028  8680 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:31.203104  5801 leader_election.cc:304] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:31.206985  5120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59390 (request call id 647) took 1116 ms. Trace:
I20260709 12:14:31.214010  5120 rpcz_store.cc:276] 0709 12:14:30.090516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:30.190325 (+ 99809us) service_pool.cc:224] Handling call
0709 12:14:30.190751 (+   426us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:30.499259 (+308508us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:31.206688 (+707429us) spinlock_profiling.cc:243] Waited 306 ms on lock 0x7b540038ccd4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:31.206918 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":703689984}
W20260709 12:14:31.209619  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:31.141703  8609 leader_election.cc:290] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:31.223233  5801 leader_election.cc:304] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:31.227594  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:31.229362  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:31.208609  8501 consensus_meta.cc:287] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.796s	user 0.010s	sys 0.002s
W20260709 12:14:31.209568  8361 consensus_meta.cc:287] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.717s	user 0.006s	sys 0.009s
W20260709 12:14:31.207808  8636 consensus_meta.cc:287] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.796s	user 0.007s	sys 0.007s
W20260709 12:14:31.210610  8582 consensus_meta.cc:287] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.793s	user 0.008s	sys 0.004s
W20260709 12:14:31.214825  8463 consensus_meta.cc:287] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 1.205s	user 0.011s	sys 0.004s
I20260709 12:14:31.203337  8639 raft_consensus.cc:2749] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:31.202410  8475 raft_consensus.cc:493] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:31.206926  8485 raft_consensus.cc:2749] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539) with higher term. Message: Invalid argument: T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 11. Current term is 12.
I20260709 12:14:31.203502  8688 raft_consensus.cc:493] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.206151  8322 leader_election.cc:290] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:31.248520  5088 leader_election.cc:400] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 election: Vote denied by peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709) with higher term. Message: Invalid argument: T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 5. Current term is 6.
I20260709 12:14:31.229491  8408 raft_consensus.cc:2764] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:14:31.229261  8577 consensus_queue.cc:1048] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:14:31.192832  8632 consensus_queue.cc:1048] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 12:14:31.191766  8661 consensus_queue.cc:1048] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:14:31.243646  8510 consensus_queue.cc:1048] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:14:31.216854  8552 consensus_queue.cc:1048] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:14:31.191642  8428 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:31.189123  8024 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:31.289323  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:31.265018  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:31.236771  8501 raft_consensus.cc:2749] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:14:31.247956  8136 consensus_meta.cc:287] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 1.078s	user 0.010s	sys 0.006s
W20260709 12:14:31.258351  8400 consensus_meta.cc:287] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.598s	user 0.003s	sys 0.007s
I20260709 12:14:31.305518  5801 leader_election.cc:304] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:14:31.401263  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 95813.7us
I20260709 12:14:31.402052  5801 leader_election.cc:304] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:31.243395  8243 consensus_queue.cc:1048] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.064s
W20260709 12:14:31.259369  8530 consensus_meta.cc:287] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 1.382s	user 0.014s	sys 0.004s
I20260709 12:14:31.403072  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:31.306862  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:31.404340  8669 raft_consensus.cc:2749] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:31.405071  8669 raft_consensus.cc:2749] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:31.308030  8686 raft_consensus.cc:2749] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:31.308612  8551 leader_election.cc:290] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:31.242327  8636 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:31.406592  8424 leader_election.cc:290] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:31.233798  8591 consensus_queue.cc:1048] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 12:14:31.324460  8428 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:31.327033  8655 consensus_meta.cc:287] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.837s	user 0.018s	sys 0.015s
I20260709 12:14:31.413770  8655 raft_consensus.cc:515] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:31.416115  8631 leader_election.cc:290] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:31.327519  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:31.416925  5194 raft_consensus.cc:1240] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:14:31.328284  5198 raft_consensus.cc:1275] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:14:31.242497  8361 raft_consensus.cc:515] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:31.294054  8688 raft_consensus.cc:515] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:31.001729  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 225600us
I20260709 12:14:31.421700  5164 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:31.340788  5119 raft_consensus.cc:1240] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:31.327595  5122 raft_consensus.cc:1275] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:14:31.250041  8475 raft_consensus.cc:3060] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:31.352886  5124 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
new_leader_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:45628
I20260709 12:14:31.296875  5199 raft_consensus.cc:1275] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:14:31.426262  5124 raft_consensus.cc:606] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 LEADER]: Received request to transfer leadership to TS 9e794b72ed7640219f90ec4232363929
W20260709 12:14:31.397871  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 255091us
I20260709 12:14:31.306222  5197 raft_consensus.cc:2368] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 8. Current term is 9.
I20260709 12:14:31.403119  5801 leader_election.cc:304] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:31.408187  5196 raft_consensus.cc:1240] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:14:31.216691  8679 consensus_queue.cc:1048] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:14:31.261711  8640 raft_consensus.cc:2804] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:31.411623  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:31.428133  5237 leader_election.cc:304] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:31.418418  5191 raft_consensus.cc:2468] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 12.
I20260709 12:14:31.245071  8582 raft_consensus.cc:515] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:31.437623  5198 raft_consensus.cc:1275] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:31.398869  8632 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.431304  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:31.432288  5834 pending_rounds.cc:85] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088: Aborting all ops after (but not including) 6
I20260709 12:14:31.434903  5801 leader_election.cc:304] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:14:31.412586  5838 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46094 (request call id 915) took 1266 ms (client timeout 1676 ms). Trace:
I20260709 12:14:31.247538  8463 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:31.404912  8024 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:31.446607  8680 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:31.418162  8591 consensus_queue.cc:1243] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer 9e794b72ed7640219f90ec4232363929 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:14:31.449761  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:31.450500  5124 raft_consensus.cc:2468] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 9.
I20260709 12:14:31.446457  8627 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:31.452289  8463 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:31.438793  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:31.416252  8655 leader_election.cc:290] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:31.439780  5834 pending_rounds.cc:107] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 12:14:31.454279  5834 raft_consensus.cc:2889] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:31.454659  5195 raft_consensus.cc:1240] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:14:31.456017  5166 leader_election.cc:304] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:31.456488  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:31.456952  8655 raft_consensus.cc:2804] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:31.457409  8655 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:31.457741  8655 raft_consensus.cc:3060] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:31.460655  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:31.461361  5200 raft_consensus.cc:2468] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 10.
I20260709 12:14:31.461689  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:31.441716  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:31.442873  8632 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:31.463155  8636 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:31.464195  8650 leader_election.cc:290] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:31.464368  8632 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:31.467734  8636 raft_consensus.cc:493] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.468323  8636 raft_consensus.cc:515] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:31.471011  8636 leader_election.cc:290] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:31.474197  8666 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:31.474906  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 44948.7us
I20260709 12:14:31.475695  5164 leader_election.cc:304] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:31.435792  8679 consensus_queue.cc:1243] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer 9e794b72ed7640219f90ec4232363929 log is divergent from this leader: its last log entry 5.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:14:31.478945  8555 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:31.480046  8350 raft_consensus.cc:3060] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:31.439742  8639 consensus_queue.cc:1059] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:14:31.436028  8669 raft_consensus.cc:2749] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:31.445572  5118 raft_consensus.cc:1240] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:31.445724  8582 leader_election.cc:290] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:31.482029  5192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47728 (request call id 2113) took 1045 ms. Trace:
I20260709 12:14:31.446167  5829 raft_consensus.cc:3060] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:31.482419  5192 rpcz_store.cc:276] 0709 12:14:30.436653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:30.436826 (+   173us) service_pool.cc:224] Handling call
0709 12:14:30.467963 (+ 31137us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:30.573768 (+105805us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:30.573803 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:30.580494 (+  6691us) log.cc:844] Serialized 26 byte log entry
0709 12:14:31.074984 (+494490us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:31.075026 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:31.481625 (+406599us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b54001946d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:31.481674 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:31.481717 (+    43us) raft_consensus.cc:1685] finished
0709 12:14:31.481741 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:31.481964 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":242724992,"thread_start_us":350095,"threads_started":1,"wal-append.queue_time_us":525231}
I20260709 12:14:31.448427  5272 raft_consensus.cc:1240] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:31.484552  8688 leader_election.cc:290] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:31.409685  8136 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:31.485783  8575 raft_consensus.cc:493] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:31.486330  8575 raft_consensus.cc:515] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:31.487494  8136 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:31.488516  8575 leader_election.cc:290] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:31.489025  8575 raft_consensus.cc:493] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:31.408056  8400 raft_consensus.cc:515] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:31.440196  5838 rpcz_store.cc:269] 0709 12:14:30.145905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:30.149405 (+  3500us) service_pool.cc:224] Handling call
0709 12:14:31.412348 (+1262943us) spinlock_profiling.cc:243] Waited 52.9 ms on lock 0x7b540046c654. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:31.412488 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":121749248}
I20260709 12:14:31.453004  8627 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:31.461872  5200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47744 (request call id 2131) took 1025 ms. Trace:
I20260709 12:14:31.486631  8388 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:31.436826  8428 consensus_queue.cc:1059] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 12:14:31.449110  5836 raft_consensus.cc:3060] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:31.492419  5122 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
new_leader_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:45628
I20260709 12:14:31.477064  5164 leader_election.cc:304] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:31.499135  5122 raft_consensus.cc:606] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 LEADER]: Received request to transfer leadership to TS 9e794b72ed7640219f90ec4232363929
I20260709 12:14:31.493160  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:31.436556  8524 consensus_queue.cc:1048] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 12:14:31.493597  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:31.494776  5163 leader_election.cc:304] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:14:31.490953  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 56135us
I20260709 12:14:31.497895  5200 rpcz_store.cc:276] 0709 12:14:30.436420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:30.436960 (+   540us) service_pool.cc:224] Handling call
0709 12:14:31.460516 (+1023556us) spinlock_profiling.cc:243] Waited 4.56 ms on lock 0x7b58000b3d98. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9ee9c 00007f84e3a9ea5b 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb890a0 00007f84ebb88984 00007f84e51036d4 00007f84e5103662
0709 12:14:31.461792 (+  1276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10524288}
I20260709 12:14:31.500532  5120 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:31.497085  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 69036.6us
I20260709 12:14:31.433797  8631 raft_consensus.cc:2749] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:31.499986  5125 raft_consensus.cc:3060] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:31.493919  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:31.496161  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:31.506633  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:31.504882  5237 leader_election.cc:304] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:14:31.511083  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 72519.8us
W20260709 12:14:31.498771  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 206316us
I20260709 12:14:31.513520  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:31.513991  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:31.514154  5271 raft_consensus.cc:2468] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 9.
I20260709 12:14:31.489169  8361 leader_election.cc:290] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:31.515924  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:31.512279  5088 leader_election.cc:304] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:31.505565  8682 raft_consensus.cc:2804] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:31.519217  8682 raft_consensus.cc:493] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:31.520344  5237 leader_election.cc:304] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:31.498160  8476 raft_consensus.cc:2749] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:31.521591  5237 leader_election.cc:304] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:31.522574  5088 leader_election.cc:304] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:31.523535  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:31.524035  5271 raft_consensus.cc:2468] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 9.
I20260709 12:14:31.524643  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:31.525036  5271 raft_consensus.cc:3060] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:31.497732  8640 raft_consensus.cc:697] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 8 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:31.526947  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:31.528309  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:31.528787  5270 raft_consensus.cc:2468] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 10.
I20260709 12:14:31.530637  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:31.532033  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:31.501477  8136 raft_consensus.cc:2749] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:31.532656  5267 raft_consensus.cc:2468] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 6.
I20260709 12:14:31.531513  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:31.533735  5265 raft_consensus.cc:1275] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:14:31.519596  8682 raft_consensus.cc:3060] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:31.533437  5835 raft_consensus.cc:2468] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 8.
I20260709 12:14:31.515837  8639 consensus_queue.cc:1243] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer dd62e75bd3ed4ed28f1fb5955d650808 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:14:31.540215  5237 leader_election.cc:304] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:31.515053  8485 raft_consensus.cc:493] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:31.586740  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 46856.4us
I20260709 12:14:31.535010  8679 raft_consensus.cc:2804] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:31.692574  5163 leader_election.cc:304] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:31.601158  5268 raft_consensus.cc:1275] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:14:31.505520  8575 raft_consensus.cc:515] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:31.695807  5833 raft_consensus.cc:1240] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:31.527092  8669 consensus_queue.cc:1059] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.102s
I20260709 12:14:31.704694  5163 leader_election.cc:304] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:31.646731  5836 raft_consensus.cc:1275] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:14:31.600317  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:31.641177  5120 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 9.
I20260709 12:14:31.535406  8647 raft_consensus.cc:515] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:31.625952  8640 consensus_queue.cc:237] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:31.535166  8501 raft_consensus.cc:2749] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:31.501056  8370 consensus_queue.cc:1048] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:14:31.579372  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:31.532173  8706 raft_consensus.cc:2804] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:31.634121  5829 raft_consensus.cc:1275] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:14:31.724920  5829 pending_rounds.cc:85] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088: Aborting all ops after (but not including) 7
I20260709 12:14:31.725327  5829 pending_rounds.cc:107] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:14:31.474929  8655 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:31.684449  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 156740us
I20260709 12:14:31.690260  5125 raft_consensus.cc:2468] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 9.
I20260709 12:14:31.515283  8627 raft_consensus.cc:2804] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:31.533530  8408 consensus_queue.cc:1048] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:14:31.576967  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:31.697997  8136 raft_consensus.cc:493] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.592339  5271 raft_consensus.cc:2468] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 9.
I20260709 12:14:31.506273  8680 consensus_queue.cc:1059] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:14:31.615134  8688 raft_consensus.cc:2749] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:31.712469  5163 leader_election.cc:304] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:31.724370  8636 raft_consensus.cc:2804] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:31.577361  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:31.519944  8024 raft_consensus.cc:2749] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:31.725824  5829 raft_consensus.cc:2889] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:31.730401  5119 raft_consensus.cc:1240] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 8. Current term is 9. Ops: []
W20260709 12:14:31.698963  8707 log.cc:927] Time spent T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 12:14:31.734782  5838 raft_consensus.cc:2468] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 11.
I20260709 12:14:31.759588  5198 raft_consensus.cc:1240] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:31.693320  8524 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
W20260709 12:14:31.738109  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 215617us
I20260709 12:14:31.576318  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:31.740940  5270 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:31.735718  8706 raft_consensus.cc:493] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:31.763720  8631 consensus_queue.cc:1048] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:31.764422  8575 leader_election.cc:290] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:31.764856  8647 leader_election.cc:290] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:31.737689  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:31.760082  8388 raft_consensus.cc:2804] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:31.740120  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:31.766099  8669 raft_consensus.cc:3055] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:31.747798  8627 raft_consensus.cc:697] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:31.753868  8136 raft_consensus.cc:515] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:31.722905  8552 raft_consensus.cc:2804] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:31.767612  8627 consensus_queue.cc:237] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:31.765640  5833 raft_consensus.cc:3060] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:31.741537  8614 raft_consensus.cc:2804] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:31.768844  8136 leader_election.cc:290] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:31.694276  8679 raft_consensus.cc:493] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:31.758770  5273 raft_consensus.cc:2468] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 9.
I20260709 12:14:31.702272  8485 raft_consensus.cc:515] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:31.780660  8485 leader_election.cc:290] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:31.765990  8400 leader_election.cc:290] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:31.766556  8672 leader_election.cc:290] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:31.778600  8431 consensus_queue.cc:1048] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 12:14:31.762748  5267 raft_consensus.cc:3060] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:31.716522  5803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:31.769672  8679 raft_consensus.cc:3060] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:31.771188  8609 raft_consensus.cc:3055] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:31.751535  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:31.789199  5192 raft_consensus.cc:3060] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:31.774061  5829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46100 (request call id 1001) took 1208 ms. Trace:
I20260709 12:14:31.766716  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:31.777920  8408 consensus_queue.cc:1048] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:14:31.778187  8463 raft_consensus.cc:3055] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:31.760499  8636 raft_consensus.cc:493] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:31.766500  8669 raft_consensus.cc:740] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:31.781891  5194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47728 (request call id 2114) took 1345 ms. Trace:
I20260709 12:14:31.765829  8388 raft_consensus.cc:493] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:31.792372  5270 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 9.
I20260709 12:14:31.790086  5829 rpcz_store.cc:276] 0709 12:14:30.550406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:30.550521 (+   115us) service_pool.cc:224] Handling call
0709 12:14:30.572993 (+ 22472us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:31.445997 (+873004us) spinlock_profiling.cc:243] Waited 704 ms on lock 0x7b58007c52d0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6b1f0aa 00007f84e6ba1447 00007f84e6bb9fe7 00007f84e6bbb7de 00007f84e6bc5b49 00007f84e6bc6416 00007f84e6bc2d8f 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4
0709 12:14:31.759008 (+313011us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:31.759194 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1618349824}
I20260709 12:14:31.820062  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:31.758378  8702 raft_consensus.cc:2749] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:31.800696  5195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 2132) took 1364 ms. Trace:
I20260709 12:14:31.812800  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:31.823045  8243 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.825626  8243 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:31.825831  8669 consensus_queue.cc:260] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:31.827315  8669 raft_consensus.cc:3060] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:31.827867  8243 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:31.825083  5198 raft_consensus.cc:2393] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 10: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:31.774843  8706 raft_consensus.cc:3060] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:31.803048  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:31.804193  5196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 2130) took 1368 ms. Trace:
I20260709 12:14:31.838081  5196 rpcz_store.cc:276] 0709 12:14:30.435801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:30.436826 (+  1025us) service_pool.cc:224] Handling call
0709 12:14:30.463494 (+ 26668us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:31.427200 (+963706us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:31.803916 (+376716us) spinlock_profiling.cc:243] Waited 944 ms on lock 0x7b540041f354. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:31.804128 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2171968768}
I20260709 12:14:31.807277  5267 raft_consensus.cc:2468] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 10.
I20260709 12:14:31.808362  5833 raft_consensus.cc:2468] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 10.
W20260709 12:14:31.786274  8610 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:14:31.844446  5192 raft_consensus.cc:2410] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:14:31.821269  5272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50932 (request call id 674) took 1866 ms. Trace:
I20260709 12:14:31.846051  5272 rpcz_store.cc:276] 0709 12:14:29.944007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:29.990862 (+ 46855us) service_pool.cc:224] Handling call
0709 12:14:29.991188 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:31.484800 (+1493612us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:31.809666 (+324866us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b54001036d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:31.809868 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3350803328}
I20260709 12:14:31.788899  8609 raft_consensus.cc:740] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:31.851225  5124 raft_consensus.cc:1240] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:31.851382  5125 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
new_leader_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:45628
I20260709 12:14:31.852051  5125 raft_consensus.cc:606] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Received request to transfer leadership to TS 9e794b72ed7640219f90ec4232363929
I20260709 12:14:31.852406  5125 raft_consensus.cc:614] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:31.853842  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:31.814427  5240 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:31.844574  5832 raft_consensus.cc:1240] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 9. Current term is 10. Ops: [5.7-9.8]
I20260709 12:14:31.855409  8418 consensus_queue.cc:1059] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:31.795534  5193 raft_consensus.cc:2468] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 7.
I20260709 12:14:31.794282  8552 raft_consensus.cc:493] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:31.856684  5197 raft_consensus.cc:1275] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:14:31.856775  8552 raft_consensus.cc:3060] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:31.861603  8662 raft_consensus.cc:3055] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:31.862001  8662 raft_consensus.cc:740] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:31.862660  8662 consensus_queue.cc:260] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:31.815316  5194 rpcz_store.cc:276] 0709 12:14:30.436954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:30.479855 (+ 42901us) service_pool.cc:224] Handling call
0709 12:14:30.480183 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:31.417499 (+937316us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:31.781639 (+364140us) spinlock_profiling.cc:243] Waited 936 ms on lock 0x7b5400377dd4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:31.781834 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2153547008}
I20260709 12:14:31.824388  5195 rpcz_store.cc:276] 0709 12:14:30.436709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:30.466539 (+ 29830us) service_pool.cc:224] Handling call
0709 12:14:31.350153 (+883614us) spinlock_profiling.cc:243] Waited 1.48 ms on lock 0x7b58000b3d98. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb9cfc0 00007f84ebb87929 00007f84ebb873d2 00007f84e50febd4
0709 12:14:31.350382 (+   229us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:31.455075 (+104693us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:31.800424 (+345349us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b54001c93d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:31.800631 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":242644224}
I20260709 12:14:31.864991  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:14:31.866503  8552 raft_consensus.cc:515] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:31.868867  8552 leader_election.cc:290] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:31.870500  5194 raft_consensus.cc:1240] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:31.871562  5801 leader_election.cc:400] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 election: Vote denied by peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455) with higher term. Message: Invalid argument: T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 8. Current term is 9.
I20260709 12:14:31.871927  5801 leader_election.cc:403] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:14:31.872691  5801 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:31.873663  8712 raft_consensus.cc:2749] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455) with higher term. Message: Invalid argument: T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 8. Current term is 9.
I20260709 12:14:31.874449  8712 raft_consensus.cc:2804] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:14:31.874933  8712 raft_consensus.cc:697] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 12 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:31.800176  8463 raft_consensus.cc:740] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:31.813251  8636 raft_consensus.cc:3060] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:31.781952  8400 consensus_queue.cc:1048] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
W20260709 12:14:31.880599  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 66244.4us
I20260709 12:14:31.786770  8524 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:31.887636  5122 raft_consensus.cc:1275] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:31.875694  5192 raft_consensus.cc:1275] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:14:31.823972  8388 raft_consensus.cc:3060] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:31.914710  5266 raft_consensus.cc:1275] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:14:31.887565  8502 raft_consensus.cc:2804] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:31.924163  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:31.926009  5267 raft_consensus.cc:1240] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 9. Current term is 10. Ops: [8.4-9.5]
I20260709 12:14:31.875860  8712 consensus_queue.cc:237] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:31.916755  8631 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.916846  8520 raft_consensus.cc:493] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:31.936636  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 423349us
I20260709 12:14:31.936610  5268 raft_consensus.cc:1240] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:14:31.941666  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:31.895674  8702 consensus_queue.cc:1059] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 12:14:31.901185  8682 raft_consensus.cc:515] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:31.950435  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:31.914727  8501 consensus_queue.cc:1048] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 12:14:31.952606  5273 raft_consensus.cc:1240] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:14:31.929860  8502 raft_consensus.cc:697] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 9 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:31.960641  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:31.967741  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:31.972127  5268 raft_consensus.cc:1240] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 12:14:31.976061  5268 raft_consensus.cc:1217] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Deduplicated request from leader. Original: 3.2->[4.3-8.6]   Dedup: 4.3->[6.4-8.6]
I20260709 12:14:31.976677  5268 raft_consensus.cc:1240] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 8. Current term is 9. Ops: [4.3-8.6]
W20260709 12:14:31.978390  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 101607us
I20260709 12:14:31.984674  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:31.985432  5125 raft_consensus.cc:3060] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:31.985937  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:31.986613  5274 raft_consensus.cc:2468] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 9.
I20260709 12:14:31.926064  8609 consensus_queue.cc:260] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:31.989826  8609 raft_consensus.cc:3060] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:31.994006  8475 consensus_meta.cc:287] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.547s	user 0.004s	sys 0.005s
I20260709 12:14:31.994530  8475 raft_consensus.cc:515] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:31.996766  8475 leader_election.cc:290] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:31.945318  8711 consensus_queue.cc:1059] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 12:14:31.998277  8711 consensus_queue.cc:1059] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:32.001677  5163 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:32.002218  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:14:32.003223  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 460654us
I20260709 12:14:32.005434  5163 leader_election.cc:304] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:31.956940  8575 raft_consensus.cc:493] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:31.968086  8640 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:31.941491  8631 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:32.011425  5274 pending_rounds.cc:85] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929: Aborting all ops after (but not including) 4
I20260709 12:14:32.011745  8502 consensus_queue.cc:237] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:32.017252  8706 raft_consensus.cc:515] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:32.023119  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:32.024324  5274 pending_rounds.cc:107] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 12:14:31.999449  8400 raft_consensus.cc:3055] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:31.972487  8552 raft_consensus.cc:493] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:32.000429  8024 raft_consensus.cc:493] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:32.032612  5125 raft_consensus.cc:2468] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 10.
I20260709 12:14:32.034289  5274 raft_consensus.cc:2889] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:32.034333  5268 raft_consensus.cc:2468] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 6.
I20260709 12:14:32.058630  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:32.059211  5268 raft_consensus.cc:3060] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:32.033876  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 179877us
I20260709 12:14:32.062824  5088 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
W20260709 12:14:32.067705  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 62422.7us
I20260709 12:14:32.034886  8657 raft_consensus.cc:493] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.016197  8388 raft_consensus.cc:515] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:31.999671  8655 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:32.050293  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:32.031883  5237 leader_election.cc:304] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:31.946254  8520 raft_consensus.cc:515] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:32.035588  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 80535.7us
I20260709 12:14:32.050050  8400 raft_consensus.cc:740] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:32.088356  5265 raft_consensus.cc:2468] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 10.
I20260709 12:14:32.031435  8575 raft_consensus.cc:515] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:32.101064  5195 raft_consensus.cc:1240] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 12:14:32.108974  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 87435.8us
I20260709 12:14:32.033839  8640 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:32.056550  8552 raft_consensus.cc:515] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:32.068225  8024 raft_consensus.cc:515] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:32.095001  8724 raft_consensus.cc:2804] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:32.123857  8738 consensus_queue.cc:1048] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:14:32.124238  8682 leader_election.cc:290] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:32.126001  5265 raft_consensus.cc:1275] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:14:32.126282  8388 leader_election.cc:290] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:32.098958  8655 raft_consensus.cc:2804] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:32.119243  8686 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:32.155115  8686 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:32.107895  8702 raft_consensus.cc:3060] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:32.135326  5268 raft_consensus.cc:2468] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 10.
I20260709 12:14:32.126608  8717 raft_consensus.cc:493] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
W20260709 12:14:32.137928  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 75186.8us
I20260709 12:14:32.092072  8712 consensus_queue.cc:1048] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:14:32.109920  8524 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:32.084723  8657 raft_consensus.cc:515] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:32.132218  8709 log.cc:927] Time spent T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
W20260709 12:14:32.171190  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 139387us
I20260709 12:14:32.146342  8724 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:32.155159  8714 log.cc:927] Time spent T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 12:14:32.189097  5125 raft_consensus.cc:1240] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 6. Current term is 7. Ops: []
W20260709 12:14:32.194121  5803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.184544  8388 raft_consensus.cc:493] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:32.199302  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:32.199158  8388 raft_consensus.cc:515] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:32.198513  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:32.200657  5265 raft_consensus.cc:3060] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:32.201017  8524 consensus_queue.cc:1048] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:32.201992  8388 leader_election.cc:290] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:32.202347  8686 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:32.202527  8388 raft_consensus.cc:493] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:32.203071  8388 raft_consensus.cc:515] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:32.203979  8024 leader_election.cc:290] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:32.205070  8388 leader_election.cc:290] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:32.205577  8640 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:32.206204  8388 raft_consensus.cc:493] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:32.207078  8552 leader_election.cc:290] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:32.207599  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:32.207674  8552 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:32.208449  8552 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:32.188707  8724 raft_consensus.cc:3060] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:32.209905  8243 consensus_queue.cc:1059] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:32.211918  8552 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:32.213080  8672 raft_consensus.cc:3055] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:32.213500  8672 raft_consensus.cc:740] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:32.207062  8388 raft_consensus.cc:515] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:32.160068  8400 consensus_queue.cc:260] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:32.215315  8400 raft_consensus.cc:3060] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:32.185338  8655 raft_consensus.cc:697] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:32.218674  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:32.219111  8655 consensus_queue.cc:237] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:32.193462  8501 consensus_queue.cc:1059] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:14:32.221288  8388 leader_election.cc:290] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:32.223165  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:32.224411  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:32.173436  8682 raft_consensus.cc:493] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:32.225517  8682 raft_consensus.cc:515] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:32.227730  8682 leader_election.cc:290] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:32.182610  8717 raft_consensus.cc:515] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:32.227843  8463 consensus_queue.cc:260] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:32.230175  8717 leader_election.cc:290] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:32.202672  8701 raft_consensus.cc:493] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.232095  8701 raft_consensus.cc:515] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:32.233117  5269 raft_consensus.cc:3060] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:32.233979  8706 leader_election.cc:290] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:32.234617  8701 leader_election.cc:290] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:32.219051  8322 raft_consensus.cc:3055] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:32.235531  8322 raft_consensus.cc:740] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:32.236385  8322 consensus_queue.cc:260] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:32.208385  8631 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:32.239341  8657 leader_election.cc:290] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:32.214275  8672 consensus_queue.cc:260] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:32.246374  8672 raft_consensus.cc:3060] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:32.217134  5265 raft_consensus.cc:2468] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 12.
W20260709 12:14:32.244459  8721 log.cc:927] Time spent T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:14:32.252710  5269 raft_consensus.cc:2468] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 7.
I20260709 12:14:32.173295  8669 consensus_queue.cc:1048] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.084s
I20260709 12:14:32.320521  8650 raft_consensus.cc:493] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.321131  8650 raft_consensus.cc:515] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:32.323550  5121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59390 (request call id 648) took 1582 ms. Trace:
I20260709 12:14:32.324126  8650 leader_election.cc:290] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:32.328063  8702 raft_consensus.cc:2749] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:32.328758  8636 raft_consensus.cc:515] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:32.229266  8463 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:32.258781  5265 raft_consensus.cc:1275] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:14:32.207932  8575 leader_election.cc:290] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:32.357246  5265 raft_consensus.cc:1240] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 7 LEADER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 6. Current term is 7. Ops: []
W20260709 12:14:32.360672  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.358829  5265 raft_consensus.cc:1240] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:32.357720  8614 raft_consensus.cc:493] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:32.377607  5199 raft_consensus.cc:1240] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:14:32.337827  5121 rpcz_store.cc:276] 0709 12:14:30.740667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:30.746176 (+  5509us) service_pool.cc:224] Handling call
0709 12:14:30.763912 (+ 17736us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:31.083461 (+319549us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:31.083490 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:31.087066 (+  3576us) log.cc:844] Serialized 26 byte log entry
0709 12:14:31.492340 (+405274us) spinlock_profiling.cc:243] Waited 7.01 ms on lock 0x7b1800227aa0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3ab8e07 00007f84ec9139a9 00007f84e3ad569b 00007f84e3ad393f 00007f84e3ad5c02 00007f84e675d20b 00007f84e6762d23 00007f84e67630d1 00007f84e6b7ea0f
0709 12:14:31.792160 (+299820us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:31.792199 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:32.323193 (+530994us) spinlock_profiling.cc:243] Waited 319 ms on lock 0x7b54003eec54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:32.323268 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:32.323323 (+    55us) raft_consensus.cc:1685] finished
0709 12:14:32.323336 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:32.323485 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7442,"raft.queue_time_us":2088,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":20496,"spinlock_wait_cycles":750007424,"thread_start_us":299631,"threads_started":1,"wal-append.queue_time_us":781457}
W20260709 12:14:32.393498  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 299234us
I20260709 12:14:32.378599  8614 raft_consensus.cc:3060] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:32.339030  8724 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:32.394538  8732 raft_consensus.cc:2804] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:32.416816  5238 leader_election.cc:304] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:32.422482  5238 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
W20260709 12:14:32.423947  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:32.428701  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 316590us
W20260709 12:14:32.432183  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 363529us
I20260709 12:14:32.433079  5163 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:14:32.433980  5802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.437196  5200 raft_consensus.cc:1240] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 LEADER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:32.450490  5163 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:14:32.473093  5801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.473805  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:32.475219  8736 log.cc:927] Time spent T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 12:14:32.468077  8485 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.468077  8682 raft_consensus.cc:493] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:32.475625  8724 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:32.437619  8702 raft_consensus.cc:2749] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:32.449123  5166 leader_election.cc:304] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:32.469935  8575 raft_consensus.cc:2804] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:32.414932  8738 consensus_queue.cc:1059] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 12:14:32.476706  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:32.477166  8679 consensus_meta.cc:287] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.682s	user 0.009s	sys 0.002s
I20260709 12:14:32.431116  8650 raft_consensus.cc:2804] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:32.510838  5191 raft_consensus.cc:2393] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 7: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:32.441610  8418 consensus_queue.cc:1048] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 12:14:32.495790  8636 leader_election.cc:290] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:32.436923  8657 consensus_queue.cc:1059] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 12:14:32.519382  8679 raft_consensus.cc:515] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:32.541064  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 90663.6us
I20260709 12:14:32.542395  5163 leader_election.cc:304] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:32.510865  5801 leader_election.cc:304] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:32.546710  5238 leader_election.cc:304] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
W20260709 12:14:32.580865  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 70079.3us
I20260709 12:14:32.581779  5801 leader_election.cc:304] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:14:32.619444  5116 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.023s	sys 0.024s
W20260709 12:14:32.553452  5804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:32.510073  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 61046.9us
W20260709 12:14:32.620258  5804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:32.620626  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 74006.6us
I20260709 12:14:32.621371  5238 leader_election.cc:304] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:32.622093  5837 raft_consensus.cc:1275] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:14:32.618752  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 455859us
I20260709 12:14:32.625340  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:14:32.619946  5116 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.023s	sys 0.024s
I20260709 12:14:32.626694  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:32.627362  5834 raft_consensus.cc:3060] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:32.627589  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:32.628197  5833 raft_consensus.cc:2468] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 9.
W20260709 12:14:32.628496  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 86187.8us
I20260709 12:14:32.629236  5163 leader_election.cc:304] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:32.630649  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:32.631254  5838 raft_consensus.cc:3060] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:32.631400  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:32.632606  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:32.633276  5836 raft_consensus.cc:2368] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 6. Current term is 7.
I20260709 12:14:32.649350  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:32.508769  8370 raft_consensus.cc:2804] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:32.511493  8388 raft_consensus.cc:2804] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:14:32.653179  5803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.655857  5838 raft_consensus.cc:2468] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 7.
I20260709 12:14:32.656718  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:32.657702  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:32.500635  8436 consensus_queue.cc:1059] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.124s
I20260709 12:14:32.509155  8682 raft_consensus.cc:515] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:32.525507  8575 raft_consensus.cc:697] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:32.561044  8711 raft_consensus.cc:493] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:32.717087  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 92044.1us
I20260709 12:14:32.717288  5831 raft_consensus.cc:1275] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:14:32.718142  5835 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:32.719587  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:32.542558  8650 raft_consensus.cc:493] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:32.661036  8631 raft_consensus.cc:2804] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:32.723573  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:32.618901  8738 raft_consensus.cc:2749] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:32.721565  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:32.619117  8639 raft_consensus.cc:2749] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:14:32.656600  8680 raft_consensus.cc:2804] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:14:32.675781  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 126882us
I20260709 12:14:32.754588  8746 raft_consensus.cc:3055] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:32.726858  8370 raft_consensus.cc:697] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:32.760813  8679 leader_election.cc:290] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:32.732002  8388 raft_consensus.cc:697] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:32.763896  5830 raft_consensus.cc:1275] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:14:32.753943  5088 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:32.657114  8350 raft_consensus.cc:493] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:32.673213  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.649304  8636 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:32.510572  8485 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:32.717562  8702 raft_consensus.cc:2804] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:32.795480  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:14:32.796932  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.650800  8701 raft_consensus.cc:2804] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:32.708185  8552 consensus_queue.cc:1048] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 12:14:32.794286  8680 raft_consensus.cc:493] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:32.770010  8650 raft_consensus.cc:3060] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:32.624850  8640 consensus_queue.cc:1048] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.169s
I20260709 12:14:32.753450  8672 raft_consensus.cc:3055] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:32.761909  8631 raft_consensus.cc:493] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
W20260709 12:14:32.829036  8666 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.009s	sys 0.026s
W20260709 12:14:32.799181  8582 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.041s	sys 0.064s
W20260709 12:14:32.871613  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:32.877283  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 123401us
I20260709 12:14:32.884454  5838 raft_consensus.cc:2468] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 10.
I20260709 12:14:32.885780  5089 leader_election.cc:400] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 election: Vote denied by peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539) with higher term. Message: Invalid argument: T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 6. Current term is 7.
I20260709 12:14:32.799158  8746 raft_consensus.cc:740] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:32.772162  8657 consensus_queue.cc:1059] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.115s
I20260709 12:14:32.938439  5089 leader_election.cc:403] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 12:14:32.835909  8655 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.019s	sys 0.010s
I20260709 12:14:32.778297  8711 raft_consensus.cc:515] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:32.940598  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:32.940806  5088 leader_election.cc:304] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
W20260709 12:14:32.939175  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 53508.4us
I20260709 12:14:32.884399  8679 raft_consensus.cc:2749] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:32.902940  8680 raft_consensus.cc:3060] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:14:32.914515  8666 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.850s	user 0.009s	sys 0.027s
W20260709 12:14:32.979466  5164 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.866s	user 0.022s	sys 0.013s
I20260709 12:14:32.983052  5834 raft_consensus.cc:2410] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:14:32.896564  8702 raft_consensus.cc:697] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 10 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:32.907905  8672 raft_consensus.cc:740] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
W20260709 12:14:32.949901  8582 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.790s	user 0.041s	sys 0.068s
I20260709 12:14:32.941599  8631 raft_consensus.cc:3060] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:32.990548  5164 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.878s	user 0.022s	sys 0.014s
W20260709 12:14:32.945962  8655 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.020s	sys 0.010s
I20260709 12:14:32.884375  8636 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:32.884487  8350 raft_consensus.cc:515] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:33.002364  5833 raft_consensus.cc:1275] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:14:33.004177  8657 raft_consensus.cc:2804] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:14:32.962890  8530 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.003s	sys 0.027s
I20260709 12:14:32.952972  8756 raft_consensus.cc:3060] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:32.910444  8370 consensus_queue.cc:237] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:33.118098  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 177353us
W20260709 12:14:33.119061  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 181571us
I20260709 12:14:32.952369  8502 consensus_queue.cc:1048] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 12:14:33.019033  8679 raft_consensus.cc:3055] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:33.025808  8520 leader_election.cc:290] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:33.100805  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:33.135455  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:33.102280  5832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46094 (request call id 921) took 1671 ms. Trace:
I20260709 12:14:33.102152  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:14:33.103773  8755 log.cc:927] Time spent T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
W20260709 12:14:33.104573  8744 log.cc:927] Time spent T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
I20260709 12:14:33.134321  8669 raft_consensus.cc:3055] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:33.145852  8669 raft_consensus.cc:740] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
W20260709 12:14:33.087654  8530 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.758s	user 0.004s	sys 0.028s
I20260709 12:14:33.146834  8669 consensus_queue.cc:260] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:33.148023  5267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34674 (request call id 2177) took 1206 ms. Trace:
I20260709 12:14:33.148509  5267 rpcz_store.cc:276] 0709 12:14:31.946561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.946810 (+   249us) service_pool.cc:224] Handling call
0709 12:14:31.979064 (+ 32254us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:32.001415 (+ 22351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:32.001447 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:32.021043 (+ 19596us) log.cc:844] Serialized 26 byte log entry
0709 12:14:32.377193 (+356150us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:14:32.377237 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:32.377317 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:33.147776 (+770459us) raft_consensus.cc:1685] finished
0709 12:14:33.147799 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:33.147955 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21931,"raft.queue_time_us":22458,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":15293,"thread_start_us":293546,"threads_started":1,"wal-append.queue_time_us":673210}
I20260709 12:14:33.149546  8636 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:33.150624  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:14:33.106130  8748 log.cc:927] Time spent T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.198s	user 0.000s	sys 0.000s
I20260709 12:14:33.151295  8711 leader_election.cc:290] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:33.152014  8732 raft_consensus.cc:493] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:33.152514  8732 raft_consensus.cc:3060] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:33.154085  5274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34674 (request call id 2183) took 1153 ms. Trace:
W20260709 12:14:33.155021  8753 log.cc:927] Time spent T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:14:33.156023  5197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41416 (request call id 633) took 1317 ms. Trace:
I20260709 12:14:33.156481  5197 rpcz_store.cc:276] 0709 12:14:31.839058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.842669 (+  3611us) service_pool.cc:224] Handling call
0709 12:14:31.856386 (+ 13717us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:31.857039 (+   653us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:33.155802 (+1298763us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b54002035d0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc28ad 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:33.155961 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30598016}
W20260709 12:14:33.004675  5273 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.021s	sys 0.010s
I20260709 12:14:33.109730  8136 raft_consensus.cc:493] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:33.110339  8552 raft_consensus.cc:493] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:33.111791  8662 raft_consensus.cc:3060] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:33.114989  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:33.094060  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
W20260709 12:14:33.008052  8734 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.031s	sys 0.027s
I20260709 12:14:32.958122  8575 consensus_queue.cc:237] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:33.119633  8673 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.013s	sys 0.018s
I20260709 12:14:33.140555  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:33.136224  5832 rpcz_store.cc:276] 0709 12:14:31.430691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.430798 (+   107us) service_pool.cc:224] Handling call
0709 12:14:31.773262 (+342464us) spinlock_profiling.cc:243] Waited 6.25 ms on lock 0x7b58000b0498. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb9cfc0 00007f84ebb87929 00007f84ebb873d2 00007f84e50febd4
0709 12:14:31.844296 (+ 71034us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:31.856005 (+ 11709us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:33.102085 (+1246080us) spinlock_profiling.cc:243] Waited 70.8 ms on lock 0x7b54007b6e50. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc28ad 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:33.102225 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":177167488}
I20260709 12:14:33.151343  5267 raft_consensus.cc:2468] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 7.
I20260709 12:14:33.011117  8388 consensus_queue.cc:237] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:33.154502  5274 rpcz_store.cc:276] 0709 12:14:32.000727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.000876 (+   149us) service_pool.cc:224] Handling call
0709 12:14:32.011185 (+ 10309us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:14:32.056513 (+ 45328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:32.056546 (+    33us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:14:32.057162 (+   616us) log.cc:844] Serialized 78 byte log entry
0709 12:14:32.379517 (+322355us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:32.379553 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:32.379612 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:33.153836 (+774224us) raft_consensus.cc:1685] finished
0709 12:14:33.153857 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:33.154024 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11123,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":8708,"thread_start_us":272217,"threads_started":1,"wal-append.queue_time_us":666173}
I20260709 12:14:33.163920  5838 raft_consensus.cc:1275] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 12:14:33.120282  8657 raft_consensus.cc:493] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:33.179085  5838 pending_rounds.cc:85] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088: Aborting all ops after (but not including) 7
I20260709 12:14:33.179400  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:33.183923  5838 pending_rounds.cc:107] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 12:14:33.184276  5838 raft_consensus.cc:2889] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:14:33.181133  5804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:33.186249  5164 leader_election.cc:304] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:14:33.186264  5088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:33.132167  8679 raft_consensus.cc:740] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:33.191514  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:33.195416  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:33.196177  5274 raft_consensus.cc:2468] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 6.
I20260709 12:14:33.148216  8669 raft_consensus.cc:3060] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:33.178791  8734 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.863s	user 0.032s	sys 0.027s
I20260709 12:14:33.199458  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:14:33.181311  8673 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.116s	user 0.013s	sys 0.018s
I20260709 12:14:33.259027  8756 raft_consensus.cc:2749] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539) with higher term. Message: Invalid argument: T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 6. Current term is 7.
I20260709 12:14:33.203282  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:33.188170  8657 raft_consensus.cc:3060] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:33.198472  8642 consensus_queue.cc:1048] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:14:33.131428  8706 consensus_queue.cc:1059] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:14:33.152329  8520 raft_consensus.cc:493] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:33.188498  8476 consensus_queue.cc:1048] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:14:33.221892  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:33.176062  8682 leader_election.cc:290] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:33.199098  8636 raft_consensus.cc:2804] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:33.129079  8672 consensus_queue.cc:260] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:33.158308  8702 consensus_queue.cc:237] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:33.245429  5088 leader_election.cc:304] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:33.188781  8552 raft_consensus.cc:515] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:33.250973  5835 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 7.
I20260709 12:14:33.229154  8475 raft_consensus.cc:493] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:33.188472  8136 raft_consensus.cc:515] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:33.254127  8485 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:33.259101  5273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50932 (request call id 681) took 1079 ms. Trace:
I20260709 12:14:33.243798  8679 consensus_queue.cc:260] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:33.202462  5164 leader_election.cc:304] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
W20260709 12:14:33.326508  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 124163us
W20260709 12:14:33.269758  5200 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.001s	sys 0.031s
I20260709 12:14:33.237744  8510 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:33.329905  8510 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:33.331025  8136 leader_election.cc:290] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:33.332026  8510 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:33.299909  5274 raft_consensus.cc:2468] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 6.
I20260709 12:14:33.333145  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:33.334205  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:33.334725  5274 raft_consensus.cc:3060] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:33.302098  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:33.337674  5267 raft_consensus.cc:3060] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:33.224699  8740 consensus_queue.cc:1048] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.101s
I20260709 12:14:33.247516  8551 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:33.342900  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:33.343747  5191 raft_consensus.cc:2393] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 11: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
W20260709 12:14:33.306638  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 414760us
I20260709 12:14:33.312332  8636 raft_consensus.cc:493] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:33.314447  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:33.352415  5268 raft_consensus.cc:2468] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 8.
I20260709 12:14:33.353569  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:33.320861  5836 raft_consensus.cc:1240] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 6. Current term is 7. Ops: []
W20260709 12:14:33.323208  8754 log.cc:927] Time spent T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.289s	user 0.000s	sys 0.001s
W20260709 12:14:33.321596  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 76271.2us
I20260709 12:14:33.242240  8759 raft_consensus.cc:493] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:33.322799  5273 rpcz_store.cc:276] 0709 12:14:32.179800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.414779 (+234979us) service_pool.cc:224] Handling call
0709 12:14:32.432153 (+ 17374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:32.432647 (+   494us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:32.432672 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:32.433181 (+   509us) log.cc:844] Serialized 26 byte log entry
0709 12:14:33.109422 (+676241us) spinlock_profiling.cc:243] Waited 1.31 ms on lock 0x7b4800240258. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ebaecaa1 00007f84ebae3b37 00007f84ebae39ca 00007f84ebbdb26f 00007f84ebbdaf37 00007f84ebbef55c 00007f84ebbef508 00007f84ebbef488 00007f84ebbef443 00007f84ebbee6ec 00007f84eab18a96
0709 12:14:33.159209 (+ 49787us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:33.159258 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:33.159333 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:33.258768 (+ 99435us) raft_consensus.cc:1685] finished
0709 12:14:33.258789 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:33.259035 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":113,"raft.run_cpu_time_us":7257,"raft.run_wall_time_us":672188,"spinlock_wait_cycles":3014016,"thread_start_us":662900,"threads_started":1,"wal-append.queue_time_us":772394}
W20260709 12:14:33.337723  8749 log.cc:927] Time spent T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
W20260709 12:14:33.328864  5200 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.002s	sys 0.031s
I20260709 12:14:33.355404  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:33.329392  8485 raft_consensus.cc:2749] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:33.314033  8729 raft_consensus.cc:493] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:33.328274  8672 raft_consensus.cc:3060] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:33.311885  8350 leader_election.cc:290] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:33.328378  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:33.360253  5088 leader_election.cc:304] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:33.358335  5801 leader_election.cc:304] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
W20260709 12:14:33.381054  8614 consensus_meta.cc:287] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.971s	user 0.007s	sys 0.001s
I20260709 12:14:33.364465  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:33.416175  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 55998us
I20260709 12:14:33.326347  8673 raft_consensus.cc:2749] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:33.349790  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:33.426009  5193 raft_consensus.cc:3060] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:33.368460  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
W20260709 12:14:33.368858  8767 log.cc:927] Time spent T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:14:33.369274  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:33.414660  5197 raft_consensus.cc:2468] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 4.
I20260709 12:14:33.342953  8551 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:33.373874  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:33.375062  8732 raft_consensus.cc:515] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:33.365885  8679 raft_consensus.cc:3060] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:33.367076  8510 consensus_queue.cc:1059] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:14:33.386811  8700 raft_consensus.cc:493] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:33.387544  8501 raft_consensus.cc:493] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:33.457029  8501 raft_consensus.cc:515] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:33.459405  8501 leader_election.cc:290] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:33.391247  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:33.460093  5200 raft_consensus.cc:2468] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 6.
I20260709 12:14:33.461721  8731 raft_consensus.cc:493] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:33.462268  8731 raft_consensus.cc:515] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:33.464056  8657 raft_consensus.cc:515] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:33.464533  8731 leader_election.cc:290] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:33.397010  5237 leader_election.cc:304] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:33.398049  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:33.472988  5191 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 6.
I20260709 12:14:33.463989  8669 raft_consensus.cc:493] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:33.473117  8243 raft_consensus.cc:3055] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:33.363971  8759 raft_consensus.cc:515] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:33.400862  8715 raft_consensus.cc:493] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:33.473649  8243 raft_consensus.cc:740] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:33.410828  8552 leader_election.cc:290] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:33.470896  8485 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:33.319180  8661 consensus_queue.cc:1059] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:14:33.409224  5274 raft_consensus.cc:2468] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 7.
I20260709 12:14:33.474606  8243 consensus_queue.cc:260] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:33.414930  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 56702.5us
I20260709 12:14:33.360318  5267 raft_consensus.cc:2468] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 10.
I20260709 12:14:33.475529  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:33.476089  8759 leader_election.cc:290] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:33.476380  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:33.355049  8636 raft_consensus.cc:3060] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:33.476682  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:33.426468  5238 leader_election.cc:304] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:33.427497  5088 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:33.329284  8475 raft_consensus.cc:515] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:33.360908  8664 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.295s	user 0.012s	sys 0.018s
I20260709 12:14:33.376247  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:33.505050  5273 raft_consensus.cc:2468] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 9.
I20260709 12:14:33.454033  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:33.507403  5268 raft_consensus.cc:3060] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:33.425113  8662 raft_consensus.cc:2764] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:14:33.455968  5195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41416 (request call id 635) took 1585 ms. Trace:
I20260709 12:14:33.425252  8350 raft_consensus.cc:493] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:33.395480  8650 raft_consensus.cc:515] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:33.461021  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:33.461723  5163 leader_election.cc:304] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:33.471129  5193 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 9.
I20260709 12:14:33.471468  5116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40402 (request call id 2234) took 1487 ms. Trace:
W20260709 12:14:33.398519  8463 consensus_meta.cc:287] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 1.039s	user 0.010s	sys 0.003s
I20260709 12:14:33.309458  8520 raft_consensus.cc:515] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:33.473553  8669 raft_consensus.cc:515] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:33.474058  8715 raft_consensus.cc:515] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:33.451298  8614 raft_consensus.cc:515] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:33.478432  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:33.479779  5267 raft_consensus.cc:2468] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 4.
W20260709 12:14:33.473891  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 76957.1us
W20260709 12:14:33.481319  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 55008.7us
I20260709 12:14:33.424340  8609 raft_consensus.cc:2804] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:14:33.500918  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:33.413642  8729 raft_consensus.cc:515] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:33.508574  5273 raft_consensus.cc:1240] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:33.530366  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:34.004990  5273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50932 (request call id 683) took 1824 ms. Trace:
I20260709 12:14:33.590659  5271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34672 (request call id 2016) took 1567 ms. Trace:
I20260709 12:14:34.005398  5273 rpcz_store.cc:276] 0709 12:14:32.180337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.507522 (+1327185us) service_pool.cc:224] Handling call
0709 12:14:33.507825 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:34.004681 (+496856us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.004925 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:33.550994  5089 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.003s	sys 0.009s
W20260709 12:14:34.008301  5089 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.052s	user 0.008s	sys 0.024s
I20260709 12:14:34.003800  5195 rpcz_store.cc:276] 0709 12:14:31.870234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.873521 (+  3287us) service_pool.cc:224] Handling call
0709 12:14:31.873867 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:32.101752 (+227885us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:33.455652 (+1353900us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b5400391cd4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:33.455896 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":521681280}
W20260709 12:14:34.004266  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 578267us
W20260709 12:14:34.016738  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 1.0688e+06us
I20260709 12:14:33.590744  5265 raft_consensus.cc:1240] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:33.594748  5268 raft_consensus.cc:2468] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 8.
W20260709 12:14:33.658797  5802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:34.005596  5116 rpcz_store.cc:276] 0709 12:14:31.983663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.983792 (+   129us) service_pool.cc:224] Handling call
0709 12:14:32.021462 (+ 37670us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:32.036676 (+ 15214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:32.036706 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:32.066198 (+ 29492us) log.cc:844] Serialized 26 byte log entry
0709 12:14:32.627063 (+560865us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:32.627109 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:32.627232 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:33.471247 (+844015us) raft_consensus.cc:1685] finished
0709 12:14:33.471268 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:33.471406 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9469,"raft.queue_time_us":11926,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":31413,"thread_start_us":517378,"threads_started":1,"wal-append.queue_time_us":915479}
I20260709 12:14:34.019586  5089 leader_election.cc:304] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:14:34.045240  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 583549us
I20260709 12:14:34.039130  5199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 2142) took 2282 ms. Trace:
I20260709 12:14:34.040220  5273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50932 (request call id 685) took 1859 ms. Trace:
I20260709 12:14:34.006580  5271 rpcz_store.cc:276] 0709 12:14:32.023044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.023174 (+   130us) service_pool.cc:224] Handling call
0709 12:14:32.023455 (+   281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:32.033429 (+  9974us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:14:32.073812 (+ 40383us) log.cc:844] Serialized 14 byte log entry
0709 12:14:32.434027 (+360215us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:32.494281 (+ 60254us) log.cc:844] Serialized 26 byte log entry
0709 12:14:32.494479 (+   198us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:32.494515 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:32.494592 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:33.590353 (+1095761us) raft_consensus.cc:1685] finished
0709 12:14:33.590382 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:33.590584 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":287,"prepare.queue_time_us":26935,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":3715,"raft.queue_time_us":10262,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":22024,"spinlock_wait_cycles":1119104,"thread_start_us":325952,"threads_started":1,"wal-append.queue_time_us":861381}
W20260709 12:14:33.504047  8664 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.439s	user 0.012s	sys 0.019s
W20260709 12:14:34.001148  8775 log.cc:927] Time spent T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.470s	user 0.000s	sys 0.000s
W20260709 12:14:33.584498  8631 consensus_meta.cc:287] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.501s	user 0.006s	sys 0.002s
W20260709 12:14:33.573764  8424 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.222s	user 0.019s	sys 0.021s
I20260709 12:14:33.474594  8485 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:33.471279  8700 raft_consensus.cc:515] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:33.883982  8759 raft_consensus.cc:493] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.626271  8650 leader_election.cc:290] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:33.572227  8640 raft_consensus.cc:493] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:34.189177  5829 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.012s	sys 0.007s
I20260709 12:14:34.119614  5268 raft_consensus.cc:1240] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:34.733208  8729 leader_election.cc:290] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:33.508473  8501 raft_consensus.cc:2804] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:34.619438  8669 leader_election.cc:290] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:33.905503  8436 raft_consensus.cc:493] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:33.580785  8776 raft_consensus.cc:2749] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:34.468765  8781 raft_consensus.cc:2804] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:14:34.654248  8787 log.cc:927] Time spent T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
W20260709 12:14:34.017486  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:34.794024  5802 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.007s	sys 0.025s
I20260709 12:14:34.087505  5266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34672 (request call id 2008) took 2506 ms. Trace:
I20260709 12:14:34.053308  5267 raft_consensus.cc:1240] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 6. Current term is 7. Ops: []
W20260709 12:14:34.438863  8735 log.cc:927] Time spent T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.532s	user 0.001s	sys 0.001s
I20260709 12:14:33.580736  8243 raft_consensus.cc:3060] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:34.129979  8388 raft_consensus.cc:2804] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:33.581916  8475 leader_election.cc:290] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:34.145713  5196 raft_consensus.cc:1240] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:14:34.628203  8614 leader_election.cc:290] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:14:34.776576  5801 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.000s	sys 0.000s
I20260709 12:14:34.809446  8650 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:33.966459  8711 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.017s	sys 0.014s
W20260709 12:14:33.989424  8370 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.013s	sys 0.018s
W20260709 12:14:34.823927  8370 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.425s	user 0.014s	sys 0.044s
I20260709 12:14:34.810264  8715 leader_election.cc:290] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:34.646673  8782 log.cc:927] Time spent T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.421s	user 0.001s	sys 0.000s
W20260709 12:14:34.647152  8783 log.cc:927] Time spent T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
W20260709 12:14:34.710006  5164 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.212.132:43539 timed out after 1.615s (SENT) [suppressed 26 similar messages]
W20260709 12:14:34.740579  8679 consensus_meta.cc:287] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 1.288s	user 0.005s	sys 0.005s
W20260709 12:14:34.165084  8672 consensus_meta.cc:287] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.751s	user 0.008s	sys 0.001s
W20260709 12:14:34.738720  8636 consensus_meta.cc:287] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 1.262s	user 0.007s	sys 0.003s
W20260709 12:14:34.822001  5801 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.000s	sys 0.008s
I20260709 12:14:34.435791  8773 raft_consensus.cc:493] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:34.826650  5196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47728 (request call id 2130) took 1433 ms. Trace:
I20260709 12:14:34.046582  5273 rpcz_store.cc:276] 0709 12:14:32.181162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.021910 (+1840748us) service_pool.cc:224] Handling call
0709 12:14:34.039655 (+ 17745us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:34.039861 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:34.039890 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:34.039933 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:34.039965 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.040019 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:34.040153 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:34.827222  5196 rpcz_store.cc:276] 0709 12:14:33.393114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.038699 (+645585us) service_pool.cc:224] Handling call
0709 12:14:34.145356 (+106657us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:34.826334 (+680978us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.826583 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47616}
W20260709 12:14:34.823477  5237 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.010s	sys 0.008s
W20260709 12:14:34.479913  8701 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.534s	user 0.023s	sys 0.023s
W20260709 12:14:34.761224  5195 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.000s	sys 0.010s
W20260709 12:14:34.812063  8424 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.485s	user 0.020s	sys 0.048s
I20260709 12:14:34.827080  8773 raft_consensus.cc:515] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:34.210718  8551 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:34.808030  5836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46088 (request call id 641) took 2007 ms. Trace:
W20260709 12:14:34.823104  8711 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.433s	user 0.040s	sys 0.024s
W20260709 12:14:34.054845  5830 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.008s	sys 0.043s
I20260709 12:14:34.046510  5199 rpcz_store.cc:276] 0709 12:14:31.734452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.734800 (+   348us) service_pool.cc:224] Handling call
0709 12:14:31.735168 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:32.379629 (+644461us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.016168 (+1636539us) spinlock_profiling.cc:243] Waited 631 ms on lock 0x7b54003903d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:34.016368 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1451363584}
I20260709 12:14:33.506201  8361 raft_consensus.cc:2749] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:34.003717  8609 raft_consensus.cc:493] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:34.677021  8680 consensus_meta.cc:287] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 1.673s	user 0.009s	sys 0.002s
I20260709 12:14:34.822633  8485 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:34.814703  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:14:34.814949  5802 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.008s	sys 0.026s
W20260709 12:14:34.816231  5829 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.194s	user 0.027s	sys 0.018s
I20260709 12:14:34.816603  5267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50932 (request call id 684) took 2636 ms. Trace:
W20260709 12:14:34.830904  5237 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.010s	sys 0.008s
I20260709 12:14:34.845569  5194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41416 (request call id 642) took 2398 ms. Trace:
W20260709 12:14:34.818427  5089 connection.cc:256] RPC call timeout handler was delayed by -1.987760592000086s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15000000000000002s for a response
I20260709 12:14:34.850688  5124 raft_consensus.cc:1240] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:34.815404  5266 rpcz_store.cc:276] 0709 12:14:31.514303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.514408 (+   105us) service_pool.cc:224] Handling call
0709 12:14:31.538967 (+ 24559us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:31.915325 (+376358us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.020618 (+2105293us) spinlock_profiling.cc:243] Waited 356 ms on lock 0x7b54003c0354. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:34.020850 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":819177856}
I20260709 12:14:34.405748  8463 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.851011  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:34.854918  5119 raft_consensus.cc:1240] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:34.855821  5120 raft_consensus.cc:1240] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:34.858098  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:34.818928  5268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50932 (request call id 686) took 2637 ms. Trace:
W20260709 12:14:34.872416  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 64807.5us
I20260709 12:14:34.902168  5271 raft_consensus.cc:2393] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 8: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:34.902050  5163 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:34.866055  5833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46100 (request call id 1013) took 2194 ms. Trace:
W20260709 12:14:34.814299  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:34.863890  5836 rpcz_store.cc:276] 0709 12:14:32.800687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.800806 (+   119us) service_pool.cc:224] Handling call
0709 12:14:33.320667 (+519861us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:33.354326 (+ 33659us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.807820 (+1453494us) spinlock_profiling.cc:243] Waited 519 ms on lock 0x7b540045a1d0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc28ad 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:34.807964 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1194840960}
I20260709 12:14:34.900662  5267 rpcz_store.cc:276] 0709 12:14:32.180864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.036657 (+1855793us) service_pool.cc:224] Handling call
0709 12:14:34.037073 (+   416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:34.816297 (+779224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.816529 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:34.903476  5833 rpcz_store.cc:276] 0709 12:14:32.629253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.629687 (+   434us) service_pool.cc:224] Handling call
0709 12:14:32.657507 (+ 27820us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:33.031035 (+373528us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.823083 (+1792048us) spinlock_profiling.cc:243] Waited 337 ms on lock 0x7b540056ead4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:34.823294 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":775480192}
I20260709 12:14:34.905256  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:34.905920  5267 raft_consensus.cc:2468] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 8.
W20260709 12:14:34.728801  5272 consensus_meta.cc:287] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.706s	user 0.005s	sys 0.002s
I20260709 12:14:34.906658  5272 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 7.
W20260709 12:14:34.646245  8785 log.cc:927] Time spent T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 12:14:33.548405  8510 raft_consensus.cc:493] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:34.437625  8772 log.cc:927] Time spent T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 12:14:34.865528  5121 raft_consensus.cc:1240] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:14:34.830651  5270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34674 (request call id 2174) took 2896 ms. Trace:
W20260709 12:14:34.864671  5830 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.401s	user 0.008s	sys 0.062s
W20260709 12:14:34.831372  5195 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.000s	sys 0.012s
I20260709 12:14:34.829339  5801 leader_election.cc:304] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:34.829535  8669 raft_consensus.cc:493] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:34.818586  8733 log.cc:927] Time spent T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 2.578s	user 0.004s	sys 0.030s
I20260709 12:14:34.903172  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:34.924031  5271 raft_consensus.cc:2468] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 10.
I20260709 12:14:34.632939  8520 leader_election.cc:290] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:34.901177  5268 rpcz_store.cc:276] 0709 12:14:32.181442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.119086 (+1937644us) service_pool.cc:224] Handling call
0709 12:14:34.119425 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:34.818679 (+699254us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.818873 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:34.917960  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:34.903048  5163 leader_election.cc:304] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:34.858817  8636 raft_consensus.cc:515] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:34.854310  8664 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:34.927095  8794 raft_consensus.cc:493] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:34.912091  8463 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:34.864315  8631 raft_consensus.cc:515] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:34.920864  8738 raft_consensus.cc:493] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.812498  8436 raft_consensus.cc:515] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:34.816294  8732 leader_election.cc:290] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:34.819060  8700 leader_election.cc:290] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:34.914057  5802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:34.830186  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:34.848809  8773 leader_election.cc:290] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:34.831146  8701 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.920s	user 0.025s	sys 0.030s
I20260709 12:14:34.811929  8501 raft_consensus.cc:493] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:34.842243  8655 raft_consensus.cc:493] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
W20260709 12:14:34.917673  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 88396.4us
I20260709 12:14:34.020537  8350 raft_consensus.cc:515] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:34.879347  8609 raft_consensus.cc:3060] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:34.917598  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:34.913614  8475 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.865589  8640 raft_consensus.cc:515] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:34.822733  8650 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:34.809051  8759 raft_consensus.cc:515] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:34.833812  8712 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.898578  5237 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:34.926671  5163 leader_election.cc:304] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:34.899367  8361 raft_consensus.cc:493] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:34.929219  8664 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:34.899128  8680 raft_consensus.cc:515] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:34.972060  5200 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.036s	sys 0.071s
W20260709 12:14:34.972579  5200 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.036s	sys 0.071s
I20260709 12:14:34.946108  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:34.882457  8781 raft_consensus.cc:697] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:34.908943  8784 raft_consensus.cc:493] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.951877  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:34.911610  5270 rpcz_store.cc:276] 0709 12:14:31.934807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.934945 (+   138us) service_pool.cc:224] Handling call
0709 12:14:31.935311 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:31.935662 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:31.935689 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:31.947155 (+ 11466us) log.cc:844] Serialized 26 byte log entry
0709 12:14:32.078301 (+131146us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:32.378587 (+300286us) log.cc:844] Serialized 14 byte log entry
0709 12:14:32.378862 (+   275us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:32.379300 (+   438us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:33.625558 (+1246258us) spinlock_profiling.cc:243] Waited 8.35 ms on lock 0x7b18003df720. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3ad63f3 00007f84e3ad87c1 00007f84e3ad8779 00007f84e3ad8709 00007f84e3ad86d1 00007f84e3ad79cd 0000000000388634 0000000000388479 00007f84e3ab983a
0709 12:14:34.830327 (+1204769us) raft_consensus.cc:1685] finished
0709 12:14:34.830448 (+   121us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:34.830584 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18194,"prepare.queue_time_us":32345,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":594,"raft.run_cpu_time_us":342,"raft.run_wall_time_us":28308,"spinlock_wait_cycles":19200896,"thread_start_us":359824,"threads_started":2,"wal-append.queue_time_us":150243}
I20260709 12:14:34.935869  5266 raft_consensus.cc:1240] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:34.985849  5266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50932 (request call id 687) took 2804 ms. Trace:
I20260709 12:14:34.986214  5266 rpcz_store.cc:276] 0709 12:14:32.181702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.935259 (+2753557us) service_pool.cc:224] Handling call
0709 12:14:34.935669 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:34.985558 (+ 49889us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.985786 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:34.938701  5269 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50932 (request call id 688) took 2756 ms (client timeout 2786 ms). Trace:
W20260709 12:14:34.987079  5269 rpcz_store.cc:269] 0709 12:14:32.181951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.224142 (+ 42191us) service_pool.cc:224] Handling call
0709 12:14:34.938519 (+2714377us) spinlock_profiling.cc:243] Waited 8.16 ms on lock 0x7b54000d3254. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:34.938621 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18766208}
I20260709 12:14:34.928864  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:34.930904  8636 leader_election.cc:290] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:34.958557  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:34.931443  8463 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:34.940240  8701 raft_consensus.cc:697] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 11 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:34.998204  5119 raft_consensus.cc:2468] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 8.
I20260709 12:14:34.962474  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:34.821516  8614 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:34.896760  5194 rpcz_store.cc:276] 0709 12:14:32.447336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.470105 (+ 22769us) service_pool.cc:224] Handling call
0709 12:14:32.470471 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:32.905642 (+435171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:32.905669 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:32.909713 (+  4044us) log.cc:844] Serialized 26 byte log entry
0709 12:14:33.148163 (+238450us) spinlock_profiling.cc:243] Waited 37.1 ms on lock 0x7b18003beb40. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3ab8e07 00007f84ec9139a9 00007f84e3ad569b 00007f84e3ad393f 00007f84e3ad5c02 00007f84e675d20b 00007f84e6762d23 00007f84e67630d1 00007f84e6b7ea0f
0709 12:14:33.232227 (+ 84064us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:33.232267 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.845215 (+1612948us) spinlock_profiling.cc:243] Waited 435 ms on lock 0x7b5400364a54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:34.845267 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:34.845312 (+    45us) raft_consensus.cc:1685] finished
0709 12:14:34.845325 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:34.845502 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":146,"raft.queue_time_us":264,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":42802,"spinlock_wait_cycles":1084937472,"thread_start_us":83879,"threads_started":1,"wal-append.queue_time_us":383259,"wal-append.run_cpu_time_us":2004,"wal-append.run_wall_time_us":1051735}
I20260709 12:14:34.919173  8672 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:34.932761  8631 leader_election.cc:290] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:34.969789  5268 raft_consensus.cc:1275] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:14:35.060217  5192 raft_consensus.cc:2393] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 11: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:34.945330  5117 raft_consensus.cc:1275] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:14:35.061039  5122 raft_consensus.cc:2410] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:14:34.974407  5116 raft_consensus.cc:2468] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 7.
I20260709 12:14:34.975029  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:34.950742  5271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34672 (request call id 2020) took 2296 ms. Trace:
I20260709 12:14:34.979806  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
W20260709 12:14:34.972321  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 73819.8us
I20260709 12:14:35.060410  5268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34672 (request call id 2029) took 2347 ms. Trace:
I20260709 12:14:35.064016  5268 rpcz_store.cc:276] 0709 12:14:32.713200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.942272 (+2229072us) service_pool.cc:224] Handling call
0709 12:14:34.969430 (+ 27158us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:35.060117 (+ 90687us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:35.060347 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:34.969615  5163 leader_election.cc:304] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:34.941630  8501 raft_consensus.cc:3060] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:34.982983  5274 raft_consensus.cc:2468] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 8.
I20260709 12:14:34.952209  8520 raft_consensus.cc:493] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:34.937884  8732 raft_consensus.cc:2804] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:35.001938  5198 raft_consensus.cc:1240] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:34.919494  8510 raft_consensus.cc:515] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:35.001241  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
W20260709 12:14:35.076867  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 366883us
I20260709 12:14:34.933327  8738 raft_consensus.cc:515] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:35.056077  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:35.056859  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:34.923494  8639 raft_consensus.cc:2749] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:35.086630  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:35.058277  5270 raft_consensus.cc:1240] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 9 LEADER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:14:35.067338  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:35.067338  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 97785.6us
I20260709 12:14:35.063333  5193 raft_consensus.cc:3060] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:34.934437  8746 consensus_queue.cc:260] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:35.072234  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:34.926900  8669 raft_consensus.cc:515] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:35.073686  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:34.994766  8700 raft_consensus.cc:2749] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:35.081157  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:35.078817  5194 raft_consensus.cc:3060] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:35.090464  5195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47728 (request call id 2127) took 1698 ms. Trace:
I20260709 12:14:35.082424  8388 raft_consensus.cc:697] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
W20260709 12:14:34.957130  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 147174us
I20260709 12:14:34.965173  8655 raft_consensus.cc:515] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:35.063131  5271 rpcz_store.cc:276] 0709 12:14:32.654166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.949816 (+2295650us) service_pool.cc:224] Handling call
0709 12:14:34.950201 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:34.950397 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:34.950424 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:34.950464 (+    40us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:34.950494 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.950544 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:34.950665 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:35.106257  5271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34674 (request call id 2185) took 1758 ms. Trace:
I20260709 12:14:34.995486  8712 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:35.088429  5270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50932 (request call id 693) took 1787 ms. Trace:
I20260709 12:14:35.110425  5270 rpcz_store.cc:276] 0709 12:14:33.300502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.057652 (+1757150us) service_pool.cc:224] Handling call
0709 12:14:35.057999 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:35.088097 (+ 30098us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:35.088367 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:35.087921  8796 raft_consensus.cc:2804] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:35.092720  5124 raft_consensus.cc:2393] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 7: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:35.116254  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:35.093796  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:35.099169  5193 raft_consensus.cc:2410] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:14:35.002897  8784 raft_consensus.cc:515] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:35.100329  5116 raft_consensus.cc:2393] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 7: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:34.995333  8361 raft_consensus.cc:515] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:34.929340  8794 raft_consensus.cc:515] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:35.106598  5271 rpcz_store.cc:276] 0709 12:14:33.347690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.105468 (+1757778us) service_pool.cc:224] Handling call
0709 12:14:35.105779 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:35.105956 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:35.105979 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:35.106019 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:35.106047 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:35.106096 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:35.106204 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:35.106901  5123 raft_consensus.cc:1275] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:35.107772  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:35.108284  5088 leader_election.cc:304] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:35.149259  5199 raft_consensus.cc:2393] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 8: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:34.972368  8475 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:35.112076  5270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34674 (request call id 2187) took 1764 ms. Trace:
I20260709 12:14:35.103502  5121 raft_consensus.cc:2468] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 5.
I20260709 12:14:35.079764  8732 raft_consensus.cc:493] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:35.089396  5163 leader_election.cc:304] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:35.084014  8436 leader_election.cc:290] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:35.118438  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:35.163272  5270 rpcz_store.cc:276] 0709 12:14:33.347998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.111216 (+1763218us) service_pool.cc:224] Handling call
0709 12:14:35.111560 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:35.111751 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:35.111780 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:35.111823 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:35.111861 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:35.111912 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:35.112020 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:35.138600  8737 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.831s	user 0.023s	sys 0.051s
I20260709 12:14:35.119010  8796 raft_consensus.cc:493] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
W20260709 12:14:35.119200  5164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:35.139153  8791 raft_consensus.cc:493] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:35.067715  8672 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:35.143373  5117 raft_consensus.cc:2393] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 8: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
W20260709 12:14:35.145130  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 192295us
I20260709 12:14:35.141553  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:35.059423  8614 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:35.089080  8711 raft_consensus.cc:493] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:35.150385  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:35.160043  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:35.189034  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:35.173367  8737 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.866s	user 0.023s	sys 0.052s
I20260709 12:14:35.114166  8631 raft_consensus.cc:2804] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:35.114688  8746 raft_consensus.cc:3060] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:35.085937  8520 raft_consensus.cc:515] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:35.170342  5270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34674 (request call id 2190) took 1821 ms. Trace:
I20260709 12:14:35.089459  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:35.161092  5088 leader_election.cc:304] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
W20260709 12:14:35.146361  8785 log.cc:927] Time spent T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:14:35.137456  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:35.174562  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:35.182219  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 92927.8us
I20260709 12:14:35.143754  8424 raft_consensus.cc:3055] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:35.149348  5166 leader_election.cc:304] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
W20260709 12:14:35.175446  5007 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet c7bb7b814fea4a2488cc39d06fc90483 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica dd62e75bd3ed4ed28f1fb5955d650808 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:14:35.162473  8797 raft_consensus.cc:2749] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:35.146528  8639 consensus_queue.cc:1048] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:14:35.195166  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
W20260709 12:14:35.196149  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 129526us
W20260709 12:14:35.223399  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 74144.2us
I20260709 12:14:35.224253  5166 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:35.166565  8732 raft_consensus.cc:3060] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:35.191203  8627 raft_consensus.cc:2804] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:35.195752  8711 raft_consensus.cc:515] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:35.200583  5270 rpcz_store.cc:276] 0709 12:14:33.348444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.169436 (+1820992us) service_pool.cc:224] Handling call
0709 12:14:35.169771 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:35.169980 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:35.170008 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:35.170060 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:35.170091 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:35.170148 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:35.170275 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:35.253458  5270 raft_consensus.cc:1240] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:35.175930  8485 raft_consensus.cc:2749] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:35.202461  5118 raft_consensus.cc:2468] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 7.
I20260709 12:14:35.195200  8631 raft_consensus.cc:493] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
W20260709 12:14:35.216316  5007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 66175.1us
I20260709 12:14:35.176555  8796 raft_consensus.cc:3060] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:35.226790  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:35.228189  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:35.228511  8664 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:35.217128  8350 leader_election.cc:290] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:35.228893  8322 raft_consensus.cc:3060] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:35.201234  5088 leader_election.cc:304] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:35.262153  8609 raft_consensus.cc:515] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:35.263311  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 62151.7us
I20260709 12:14:35.264047  5088 leader_election.cc:304] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:35.264498  8609 leader_election.cc:290] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:35.237162  8702 raft_consensus.cc:493] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
W20260709 12:14:35.240070  8723 log.cc:927] Time spent T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 3.131s	user 0.009s	sys 0.022s
I20260709 12:14:35.265666  8702 raft_consensus.cc:515] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:35.267590  8614 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:35.268090  8702 leader_election.cc:290] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:35.215894  8424 raft_consensus.cc:740] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:35.186537  8436 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:35.270331  8797 raft_consensus.cc:2804] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:35.270182  8436 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:35.270744  8797 raft_consensus.cc:493] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:35.271226  8797 raft_consensus.cc:3060] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:35.272516  8436 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:35.240816  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:35.238819  8463 consensus_queue.cc:1059] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:35.112300  8388 consensus_queue.cc:237] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:35.232075  8789 log.cc:927] Time spent T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:14:35.235679  5267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34672 (request call id 2032) took 2501 ms. Trace:
I20260709 12:14:35.173863  8701 consensus_queue.cc:237] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:35.176487  8799 consensus_queue.cc:1048] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.086s
I20260709 12:14:35.277455  8664 raft_consensus.cc:2804] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:35.278443  8664 raft_consensus.cc:697] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:35.277673  5267 rpcz_store.cc:276] 0709 12:14:32.734492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.967923 (+2233431us) service_pool.cc:224] Handling call
0709 12:14:34.968304 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:34.968676 (+   372us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:14:34.968703 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:34.983907 (+ 15204us) log.cc:844] Serialized 26 byte log entry
0709 12:14:35.180490 (+196583us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:35.180565 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:35.180633 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:35.235419 (+ 54786us) raft_consensus.cc:1685] finished
0709 12:14:35.235443 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:35.235604 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":916,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":20768,"thread_start_us":97639,"threads_started":1,"wal-append.queue_time_us":166096}
I20260709 12:14:35.279333  8664 consensus_queue.cc:237] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:35.280649  5267 raft_consensus.cc:1275] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:14:35.281023  8650 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:35.243790  8712 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:35.147202  8781 consensus_queue.cc:237] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:35.237744  8759 leader_election.cc:290] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:35.245350  8672 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:35.246959  8520 leader_election.cc:290] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:35.249890  5124 raft_consensus.cc:2393] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 9: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:35.237809  8475 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:35.215579  8551 raft_consensus.cc:2804] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:35.256791  5270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34674 (request call id 2191) took 1908 ms. Trace:
W20260709 12:14:35.289016  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 109301us
I20260709 12:14:35.265501  8361 leader_election.cc:290] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:35.218472  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:35.298261  8551 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:35.298832  8551 raft_consensus.cc:3060] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:35.299091  8799 raft_consensus.cc:2749] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:35.281236  5267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34674 (request call id 2192) took 1932 ms. Trace:
I20260709 12:14:35.283385  5117 raft_consensus.cc:2393] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 9: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
W20260709 12:14:35.288367  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 86983.8us
I20260709 12:14:35.289803  5270 rpcz_store.cc:276] 0709 12:14:33.348583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.252869 (+1904286us) service_pool.cc:224] Handling call
0709 12:14:35.253235 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:35.253884 (+   649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:35.256727 (+  2843us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:35.301420  5270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34674 (request call id 2193) took 1949 ms. Trace:
I20260709 12:14:35.300415  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:35.301764  5270 rpcz_store.cc:276] 0709 12:14:33.351673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.300602 (+1948929us) service_pool.cc:224] Handling call
0709 12:14:35.300892 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:35.301066 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:35.301088 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:35.301126 (+    38us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:35.301153 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:35.301201 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:35.301330 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:35.303107  5270 raft_consensus.cc:1240] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:35.303459  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
W20260709 12:14:35.290459  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:35.304121  5199 raft_consensus.cc:3060] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:35.297509  8627 raft_consensus.cc:697] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:35.299785  8799 raft_consensus.cc:2804] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:35.306231  5267 rpcz_store.cc:276] 0709 12:14:33.348740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.280019 (+1931279us) service_pool.cc:224] Handling call
0709 12:14:35.280312 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:35.280995 (+   683us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:35.281186 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:35.303673  5270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34674 (request call id 2194) took 1947 ms. Trace:
I20260709 12:14:35.185567  8791 raft_consensus.cc:515] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:35.284078  8631 raft_consensus.cc:3060] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:35.307698  5270 rpcz_store.cc:276] 0709 12:14:33.356175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.302670 (+1946495us) service_pool.cc:224] Handling call
0709 12:14:35.302939 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:35.303431 (+   492us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:35.303617 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:35.276875  8510 leader_election.cc:290] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:35.276310  8669 leader_election.cc:290] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:35.275617  8738 leader_election.cc:290] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:35.318684  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:35.333820  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 127108us
I20260709 12:14:35.298202  8752 raft_consensus.cc:493] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
W20260709 12:14:35.349970  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 59446.1us
I20260709 12:14:35.353118  5830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46094 (request call id 939) took 2461 ms. Trace:
I20260709 12:14:35.308166  8640 leader_election.cc:290] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:35.300707  8680 leader_election.cc:290] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:35.309841  8799 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:35.358760  5830 rpcz_store.cc:276] 0709 12:14:32.891360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.903361 (+ 12001us) service_pool.cc:224] Handling call
0709 12:14:32.903769 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:32.904152 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:32.904181 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:33.463060 (+558879us) spinlock_profiling.cc:243] Waited 3.86 ms on lock 0x7b2c00047568. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e54bca11 00007f84e54cc372 00007f84e6bfea01 00007f84e6bc343a 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2
0709 12:14:33.463451 (+   391us) log.cc:844] Serialized 26 byte log entry
0709 12:14:34.912413 (+1448962us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:34.912452 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:34.912516 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:35.341958 (+429442us) raft_consensus.cc:1685] finished
0709 12:14:35.341978 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:35.353044 (+ 11066us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1205,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":29142,"spinlock_wait_cycles":9740544,"thread_start_us":1448600,"threads_started":1,"wal-append.queue_time_us":1638962}
I20260709 12:14:35.356232  5198 raft_consensus.cc:2393] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 7: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:35.362517  5269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50932 (request call id 691) took 2064 ms. Trace:
I20260709 12:14:35.363261  8712 consensus_queue.cc:1059] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:35.364045  8627 consensus_queue.cc:237] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:35.367439  5269 rpcz_store.cc:276] 0709 12:14:33.299886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.000531 (+1700645us) service_pool.cc:224] Handling call
0709 12:14:35.000916 (+   385us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:35.002293 (+  1377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:35.002325 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:35.002936 (+   611us) log.cc:844] Serialized 52 byte log entry
0709 12:14:35.171321 (+168385us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:35.171369 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:35.171445 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:35.362289 (+190844us) raft_consensus.cc:1685] finished
0709 12:14:35.362310 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:35.362456 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1181,"raft.queue_time_us":56162,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":13654,"thread_start_us":80709,"threads_started":1,"wal-append.queue_time_us":199568}
I20260709 12:14:35.364989  8510 raft_consensus.cc:493] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:35.378062  5194 raft_consensus.cc:2468] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 8.
W20260709 12:14:35.378171  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 57389.7us
I20260709 12:14:35.379343  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:35.384555  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:35.385438  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:35.386092  5198 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 6.
I20260709 12:14:35.383406  8408 consensus_queue.cc:1059] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 12:14:35.377331  8510 raft_consensus.cc:515] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:35.389092  8243 consensus_meta.cc:287] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.570s	user 0.007s	sys 0.003s
I20260709 12:14:35.389755  8243 consensus_queue.cc:1059] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:35.390259  8510 leader_election.cc:290] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:35.390810  8510 raft_consensus.cc:3055] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:35.391137  8510 raft_consensus.cc:740] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:35.365095  8752 raft_consensus.cc:515] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:35.391971  8510 consensus_queue.cc:260] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:35.265800  8808 raft_consensus.cc:493] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:35.372176  8672 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:35.373443  8799 raft_consensus.cc:3060] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:35.402284  5265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50932 (request call id 680) took 3222 ms. Trace:
I20260709 12:14:35.365108  8380 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:35.384723  8806 log.cc:927] Time spent T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 12:14:35.372215  8669 raft_consensus.cc:493] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:35.402753  5265 rpcz_store.cc:276] 0709 12:14:32.179556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.391450 (+211894us) service_pool.cc:224] Handling call
0709 12:14:33.590553 (+1199103us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:34.044197 (+453644us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:35.402081 (+1357884us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54002558d0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc28ad 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:35.402222 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2756770560}
I20260709 12:14:35.408628  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:35.273334  8816 consensus_queue.cc:1059] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.129s
I20260709 12:14:35.410964  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:35.414597  5265 raft_consensus.cc:2410] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:14:35.374022  8759 consensus_queue.cc:1059] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:14:35.417183  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:35.396620  8655 leader_election.cc:290] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:35.418403  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:35.403807  8752 leader_election.cc:290] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:35.372704  8818 consensus_queue.cc:1059] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.049s
W20260709 12:14:35.422869  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:35.426335  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:14:35.426226  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 105789us
I20260709 12:14:35.431175  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:35.431773  5265 raft_consensus.cc:2468] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 8.
I20260709 12:14:35.395071  8821 consensus_queue.cc:1048] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:14:35.435810  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:35.437439  5269 raft_consensus.cc:1275] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:14:35.439139  8818 raft_consensus.cc:3055] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:35.439558  8818 raft_consensus.cc:740] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:35.440397  8818 consensus_queue.cc:260] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:35.439633  8742 raft_consensus.cc:493] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:35.413950  8669 raft_consensus.cc:515] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:35.442763  8742 raft_consensus.cc:515] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:35.443776  5829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46100 (request call id 1014) took 2813 ms. Trace:
I20260709 12:14:35.445134  8669 leader_election.cc:290] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:35.444190  5829 rpcz_store.cc:276] 0709 12:14:32.629990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:32.630089 (+    99us) service_pool.cc:224] Handling call
0709 12:14:32.630397 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:32.875302 (+244905us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:32.875333 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:32.875797 (+   464us) log.cc:844] Serialized 26 byte log entry
0709 12:14:33.264192 (+388395us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:33.621603 (+357411us) log.cc:844] Serialized 14 byte log entry
0709 12:14:34.835663 (+1214060us) spinlock_profiling.cc:243] Waited 2.48 ms on lock 0x7b48000621d8. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ebaecaa1 00007f84ebae3b37 00007f84ebae39ca 00007f84ebbdb26f 00007f84ebbdaf37 00007f84ebbef55c 00007f84ebbef508 00007f84ebbef488 00007f84ebbef443 00007f84ebbee6ec 00007f84eab18a96
0709 12:14:34.901279 (+ 65616us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:35.443473 (+542194us) spinlock_profiling.cc:243] Waited 238 ms on lock 0x7b54004303d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:35.443523 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:35.443569 (+    46us) raft_consensus.cc:1685] finished
0709 12:14:35.443580 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:35.443718 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6084,"prepare.queue_time_us":358665,"prepare.run_wall_time_us":34467,"raft.queue_time_us":216695,"raft.run_cpu_time_us":30438,"raft.run_wall_time_us":1991958,"spinlock_wait_cycles":562010368,"thread_start_us":1932464,"threads_started":3,"wal-append.queue_time_us":503546}
W20260709 12:14:35.445708  8807 log.cc:927] Time spent T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 12:14:35.404861  8808 raft_consensus.cc:515] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:35.412236  8380 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:35.447533  5270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34672 (request call id 2034) took 1400 ms. Trace:
I20260709 12:14:35.450764  8551 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:35.452940  8657 leader_election.cc:290] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:35.455154  8424 consensus_queue.cc:260] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:35.409195  8672 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:35.458498  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:35.420567  8794 leader_election.cc:290] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:14:35.458549  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:35.461648  5804 leader_election.cc:304] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:35.424122  8816 consensus_queue.cc:1243] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer ad2f9a1e2f7a45429fa69fd23d09f821 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 12:14:35.467514  5802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:35.473783  5199 raft_consensus.cc:2410] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:14:35.464098  5240 connection.cc:256] RPC call timeout handler was delayed by -1.794352981999964s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16090000000000002s for a response
I20260709 12:14:35.446885  8742 leader_election.cc:290] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:35.623612  5240 connection.cc:256] RPC call timeout handler was delayed by -1.6140680949999933s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18180000000000002s for a response
W20260709 12:14:35.649184  5802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:35.665496  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:35.666404  5199 raft_consensus.cc:2468] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
I20260709 12:14:35.667484  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
W20260709 12:14:35.661394  5240 connection.cc:256] RPC call timeout handler was delayed by -1.3588843170000473s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.196s for a response
W20260709 12:14:35.669596  5240 connection.cc:256] RPC call timeout handler was delayed by -1.2186787339999228s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.221s for a response
I20260709 12:14:35.623747  5194 raft_consensus.cc:2468] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 4.
W20260709 12:14:35.649125  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 187521us
I20260709 12:14:35.649827  8408 raft_consensus.cc:3060] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:35.704259  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:14:35.491719  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 112805us
W20260709 12:14:35.624430  8501 consensus_meta.cc:287] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.538s	user 0.006s	sys 0.004s
W20260709 12:14:35.671703  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 447495us
I20260709 12:14:35.474943  8711 leader_election.cc:290] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:35.706665  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:35.707986  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:35.705204  5804 leader_election.cc:304] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:35.668092  5270 rpcz_store.cc:276] 0709 12:14:34.047217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.344872 (+1297655us) service_pool.cc:224] Handling call
0709 12:14:35.345233 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:35.345588 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:35.345615 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:35.357189 (+ 11574us) log.cc:844] Serialized 26 byte log entry
0709 12:14:35.423352 (+ 66163us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:35.423390 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:35.423455 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:35.447331 (+ 23876us) raft_consensus.cc:1685] finished
0709 12:14:35.447351 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:35.447475 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":838,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":5443,"thread_start_us":28580,"threads_started":1,"wal-append.queue_time_us":69136}
I20260709 12:14:35.612375  8808 leader_election.cc:290] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:35.665789  8742 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:35.656543  8818 raft_consensus.cc:3060] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:35.474236  8502 raft_consensus.cc:493] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:35.716542  5119 raft_consensus.cc:1240] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:35.708562  5088 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:35.716720  5166 leader_election.cc:304] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:35.716162  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:35.767396  5199 raft_consensus.cc:2468] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 8.
I20260709 12:14:35.768498  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:35.717095  8501 raft_consensus.cc:515] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:35.723035  8814 raft_consensus.cc:2804] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:35.723547  8711 consensus_queue.cc:1048] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:35.725400  5829 raft_consensus.cc:1240] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:35.726365  5830 raft_consensus.cc:1240] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:35.727588  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:35.728368  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:35.729115  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:35.731112  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:35.733913  5801 leader_election.cc:304] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:35.563917  8796 raft_consensus.cc:515] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:35.744513  8794 consensus_queue.cc:1059] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:35.719537  8746 raft_consensus.cc:3055] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:35.745483  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:35.678821  8631 raft_consensus.cc:515] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:35.708946  8791 leader_election.cc:290] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:35.566831  8732 raft_consensus.cc:515] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:35.830339  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 121857us
I20260709 12:14:36.565212  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:36.565847  5088 leader_election.cc:304] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:35.736696  8799 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:35.916425  8833 log.cc:927] Time spent T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:14:36.568091  5835 raft_consensus.cc:2410] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:14:36.568624  8711 consensus_queue.cc:1243] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer ad2f9a1e2f7a45429fa69fd23d09f821 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:14:36.569155  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:14:36.495045  8832 log.cc:927] Time spent T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.576s	user 0.000s	sys 0.000s
W20260709 12:14:36.075500  8627 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.024s	sys 0.042s
I20260709 12:14:36.571678  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:36.572897  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:36.573515  5831 raft_consensus.cc:2468] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 7.
I20260709 12:14:36.573734  8631 leader_election.cc:290] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:35.928830  8388 raft_consensus.cc:2749] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:14:36.574774  8816 raft_consensus.cc:493] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.575417  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:36.575356  8816 raft_consensus.cc:515] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:36.576263  5830 raft_consensus.cc:3060] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:36.577191  8732 leader_election.cc:290] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:35.994786  8614 raft_consensus.cc:3055] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:36.205274  8551 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:35.836014  8830 raft_consensus.cc:2749] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:14:35.972934  8640 raft_consensus.cc:493] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:35.932540  5267 raft_consensus.cc:1240] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 10. Current term is 11. Ops: []
W20260709 12:14:36.069784  8639 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.785s	user 0.004s	sys 0.007s
W20260709 12:14:36.618291  8639 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.333s	user 0.009s	sys 0.015s
I20260709 12:14:36.617776  8640 raft_consensus.cc:515] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:36.023694  8825 raft_consensus.cc:493] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.619555  8825 raft_consensus.cc:515] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:36.620297  8640 leader_election.cc:290] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:36.622182  8825 leader_election.cc:290] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:36.582437  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:36.490696  8501 leader_election.cc:290] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:36.584154  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:36.623685  5834 raft_consensus.cc:2393] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 10: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:36.624689  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:36.625284  5834 raft_consensus.cc:3060] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:36.495488  5240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:35.853024  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:14:36.630235  5804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.630748  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:36.631497  5837 raft_consensus.cc:2468] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 10.
I20260709 12:14:36.632489  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:36.632972  8830 raft_consensus.cc:2804] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:14:36.585341  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 851427us
W20260709 12:14:36.497488  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:35.759956  8742 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:36.175880  8819 consensus_queue.cc:1048] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.402s
I20260709 12:14:36.586786  8791 raft_consensus.cc:2804] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:36.566886  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:36.570530  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:36.574344  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:35.953258  8814 raft_consensus.cc:697] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 7 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:36.489750  8361 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.597015  5830 raft_consensus.cc:2468] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 9.
I20260709 12:14:36.600329  8799 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:36.670691  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:36.670895  8361 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:36.670656  8814 consensus_queue.cc:237] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:36.673362  5838 raft_consensus.cc:1240] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 6. Current term is 7. Ops: []
W20260709 12:14:36.579589  5273 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34672 (request call id 2035) took 2532 ms (client timeout 2814 ms). Trace:
I20260709 12:14:36.673928  8361 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:36.674566  8361 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:36.631436  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 65767.6us
I20260709 12:14:36.675305  5194 raft_consensus.cc:2393] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 9: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:36.676115  5088 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:36.676852  8846 raft_consensus.cc:2804] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:36.677246  8846 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:36.677632  8846 raft_consensus.cc:3060] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:36.635670  8830 raft_consensus.cc:493] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:36.678345  8742 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:36.678663  8830 raft_consensus.cc:3060] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:36.679396  5801 leader_election.cc:304] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:36.636237  8650 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.680755  8650 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:36.675117  8361 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:36.633308  5837 raft_consensus.cc:2393] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 9: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:36.685429  8361 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:14:36.067093  5802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:36.686787  5802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:36.669406  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:36.636089  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:35.837436  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:36.690078  5199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47728 (request call id 2146) took 1407 ms. Trace:
I20260709 12:14:36.690505  5199 rpcz_store.cc:276] 0709 12:14:35.282351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.837105 (+554754us) service_pool.cc:224] Handling call
0709 12:14:36.689997 (+852892us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:36.058493  8797 consensus_meta.cc:287] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.785s	user 0.011s	sys 0.000s
I20260709 12:14:36.691923  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:36.691869  8797 raft_consensus.cc:515] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:36.692664  5199 raft_consensus.cc:2468] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 7.
I20260709 12:14:36.694370  8797 leader_election.cc:290] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:36.693194  5199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47744 (request call id 2175) took 1257 ms. Trace:
I20260709 12:14:36.696049  5199 rpcz_store.cc:276] 0709 12:14:35.435604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.691616 (+1256012us) service_pool.cc:224] Handling call
0709 12:14:36.693136 (+  1520us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:36.685905  5837 raft_consensus.cc:1275] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:14:36.698606  5837 pending_rounds.cc:85] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088: Aborting all ops after (but not including) 7
I20260709 12:14:36.699044  5837 pending_rounds.cc:107] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:14:36.699337  5837 raft_consensus.cc:2889] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:36.701188  5837 raft_consensus.cc:1275] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:14:36.702679  5837 pending_rounds.cc:85] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088: Aborting all ops after (but not including) 7
I20260709 12:14:36.704638  5837 pending_rounds.cc:107] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:14:36.674589  5838 raft_consensus.cc:1240] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 6. Current term is 7. Ops: []
W20260709 12:14:36.479166  8408 consensus_meta.cc:287] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.766s	user 0.009s	sys 0.001s
I20260709 12:14:36.726886  8408 raft_consensus.cc:2749] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:36.727689  5836 raft_consensus.cc:1240] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:36.710040  8520 raft_consensus.cc:493] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:36.732384  8520 raft_consensus.cc:515] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:36.736017  8520 leader_election.cc:290] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:36.751650  8520 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.752480  8520 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:36.755129  8520 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:36.720217  5834 raft_consensus.cc:2410] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:14:36.698558  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:36.788048  5199 raft_consensus.cc:2393] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 9: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:36.788650  5199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41416 (request call id 655) took 1351 ms. Trace:
I20260709 12:14:36.595546  8614 raft_consensus.cc:740] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
W20260709 12:14:36.758317  5164 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.004s	sys 0.006s
W20260709 12:14:36.790236  5164 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.004s	sys 0.006s
I20260709 12:14:36.712270  8650 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:36.675113  8791 raft_consensus.cc:493] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
W20260709 12:14:36.732810  8781 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.738s	user 0.007s	sys 0.003s
I20260709 12:14:36.586488  8672 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:36.791285  8791 raft_consensus.cc:3060] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:36.791712  8781 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.797s	user 0.007s	sys 0.004s
I20260709 12:14:36.738240  5837 raft_consensus.cc:2889] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:36.790692  5199 rpcz_store.cc:276] 0709 12:14:35.437153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.698269 (+1261116us) service_pool.cc:224] Handling call
0709 12:14:36.788581 (+ 90312us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:36.798565  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:36.757966  8852 raft_consensus.cc:493] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:36.814011  8852 raft_consensus.cc:515] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:36.817790  8852 leader_election.cc:290] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:36.763538  8797 raft_consensus.cc:493] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.821789  8797 raft_consensus.cc:515] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:36.789744  8614 consensus_queue.cc:260] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:36.823141  8614 raft_consensus.cc:3060] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:36.757335  8701 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.004s	sys 0.000s
W20260709 12:14:36.825555  8701 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.783s	user 0.005s	sys 0.000s
W20260709 12:14:36.800853  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 56513.8us
I20260709 12:14:36.827440  8847 raft_consensus.cc:493] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:36.758098  5833 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.002s	sys 0.002s
W20260709 12:14:36.828286  5833 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.826s	user 0.002s	sys 0.002s
I20260709 12:14:36.827960  8847 raft_consensus.cc:515] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:36.829577  8672 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.830376  8847 leader_election.cc:290] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:36.831007  8847 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.831458  8847 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:36.757854  5191 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.000s	sys 0.011s
I20260709 12:14:36.833963  8797 leader_election.cc:290] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:36.834388  5191 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.000s	sys 0.012s
W20260709 12:14:36.758486  8712 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.000s	sys 0.003s
I20260709 12:14:36.722484  8501 raft_consensus.cc:493] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:36.833912  8847 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:36.835485  8501 raft_consensus.cc:515] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:36.674021  5273 rpcz_store.cc:269] 0709 12:14:34.047483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.829919 (+782436us) service_pool.cc:224] Handling call
0709 12:14:36.579351 (+1749432us) spinlock_profiling.cc:243] Waited 412 ms on lock 0x7b54000f8f54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:36.579505 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":947473280}
I20260709 12:14:36.830163  8672 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:36.756002  8846 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:36.840142  8672 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:36.841153  8846 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:36.841449  8501 leader_election.cc:290] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:14:36.842227  8712 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.000s	sys 0.004s
W20260709 12:14:36.842702  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 623392us
I20260709 12:14:36.843628  5164 leader_election.cc:304] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:36.844499  8742 raft_consensus.cc:2749] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:36.820570  5199 raft_consensus.cc:3060] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:36.858086  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 54961.2us
I20260709 12:14:36.867689  8742 raft_consensus.cc:493] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.868492  8742 raft_consensus.cc:515] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:36.871217  8742 leader_election.cc:290] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:35.912744  8502 raft_consensus.cc:515] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:36.876353  8502 leader_election.cc:290] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:36.888713  8711 raft_consensus.cc:493] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.889595  8711 raft_consensus.cc:515] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:36.891736  5804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:36.159456  5200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47728 (request call id 2129) took 2766 ms. Trace:
W20260709 12:14:36.876959  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 1.1602e+06us
W20260709 12:14:38.496055  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:38.144145  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 271844us
I20260709 12:14:38.443994  5196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 2158) took 3464 ms. Trace:
W20260709 12:14:37.282750  5237 leader_election.cc:336] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Timed out: RequestConsensusVote RPC to 127.3.212.130:44455 timed out after 1.593s (SENT)
W20260709 12:14:37.434964  5238 connection.cc:256] RPC call timeout handler was delayed by -2.3219305280001663s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.196s for a response
I20260709 12:14:38.938230  5237 leader_election.cc:304] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:14:38.938614  5238 connection.cc:256] RPC call timeout handler was delayed by -2.2886305280001125s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19970000000000002s for a response
W20260709 12:14:37.586120  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:37.287564  5274 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34674 (request call id 2196) took 3924 ms (client timeout 2156 ms). Trace:
W20260709 12:14:38.450409  5295 debug-util.cc:398] Leaking SignalData structure 0x7b0800325c80 after lost signal to thread 3922
W20260709 12:14:38.967895  5295 debug-util.cc:398] Leaking SignalData structure 0x7b08000a8900 after lost signal to thread 3925
W20260709 12:14:37.266059  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 586689us
W20260709 12:14:37.298846  5802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:38.548605  5200 rpcz_store.cc:276] 0709 12:14:33.392877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.020474 (+627597us) service_pool.cc:224] Handling call
0709 12:14:34.145356 (+124882us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:34.167983 (+ 22627us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:14:34.973146 (+805163us) log.cc:844] Serialized 14 byte log entry
0709 12:14:35.173874 (+200728us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:35.173964 (+    90us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:35.174030 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:36.159181 (+985151us) spinlock_profiling.cc:243] Waited 22.3 ms on lock 0x7b54001950d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:36.159239 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:36.159378 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13095,"prepare.queue_time_us":726944,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":20523,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":13513,"spinlock_wait_cycles":51262464,"thread_start_us":958828,"threads_started":2,"wal-append.queue_time_us":293139,"wal-append.run_cpu_time_us":1014,"wal-append.run_wall_time_us":1001051}
W20260709 12:14:37.161959  5804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:37.309123  5830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46100 (request call id 1027) took 1562 ms. Trace:
I20260709 12:14:39.051023  5830 rpcz_store.cc:276] 0709 12:14:35.746792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.671879 (+925087us) service_pool.cc:224] Handling call
0709 12:14:36.672176 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:37.266680 (+594504us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:37.266736 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:37.267126 (+   390us) log.cc:844] Serialized 26 byte log entry
0709 12:14:37.297311 (+ 30185us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:37.308550 (+ 11239us) log.cc:844] Serialized 14 byte log entry
0709 12:14:37.308786 (+   236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:37.308874 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:37.308915 (+    41us) raft_consensus.cc:1685] finished
0709 12:14:37.308927 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:37.309064 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":219750,"prepare.queue_time_us":11526,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":541881,"raft.run_cpu_time_us":400,"raft.run_wall_time_us":6730,"thread_start_us":414641,"threads_started":3,"wal-append.queue_time_us":34391,"wal-append.run_cpu_time_us":2097,"wal-append.run_wall_time_us":1007816}
I20260709 12:14:36.880275  5832 raft_consensus.cc:2468] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 6.
W20260709 12:14:39.055181  5832 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46100 (request call id 1022) took 3331 ms (client timeout 1756 ms). Trace:
W20260709 12:14:39.055614  5832 rpcz_store.cc:269] 0709 12:14:35.723428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.736460 (+ 13032us) service_pool.cc:224] Handling call
0709 12:14:39.054963 (+3318503us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:37.088980  5833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46094 (request call id 942) took 1367 ms. Trace:
I20260709 12:14:39.070053  5833 rpcz_store.cc:276] 0709 12:14:35.721357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.721490 (+   133us) service_pool.cc:224] Handling call
0709 12:14:35.721810 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:35.722035 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:14:36.002086 (+280051us) log.cc:844] Serialized 14 byte log entry
0709 12:14:37.088431 (+1086345us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:37.088499 (+    68us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:14:37.088554 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:37.088630 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:37.088778 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":261855,"prepare.queue_time_us":916193,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":418522,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":5742,"thread_start_us":1105900,"threads_started":2,"wal-append.queue_time_us":751608,"wal-append.run_cpu_time_us":1010,"wal-append.run_wall_time_us":1001020}
I20260709 12:14:37.274732  5835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46100 (request call id 1025) took 1528 ms. Trace:
I20260709 12:14:37.297276  5836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46094 (request call id 943) took 1575 ms. Trace:
I20260709 12:14:39.078421  5836 rpcz_store.cc:276] 0709 12:14:35.721635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.726764 (+  5129us) service_pool.cc:224] Handling call
0709 12:14:35.727100 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:36.728062 (+1000962us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:37.291080 (+563018us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54007d0d54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:37.297175 (+  6095us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2300650240}
I20260709 12:14:37.305158  5838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46088 (request call id 654) took 1218 ms. Trace:
I20260709 12:14:39.080476  5838 rpcz_store.cc:276] 0709 12:14:36.087113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.725779 (+638666us) service_pool.cc:224] Handling call
0709 12:14:36.726187 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:37.256674 (+530487us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:37.256713 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:37.259746 (+  3033us) log.cc:844] Serialized 26 byte log entry
0709 12:14:37.290939 (+ 31193us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:37.290983 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:37.291054 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:37.304961 (+ 13907us) raft_consensus.cc:1685] finished
0709 12:14:37.304976 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:37.305104 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":187555,"raft.queue_time_us":519087,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":2166,"spinlock_wait_cycles":586112,"thread_start_us":369171,"threads_started":2,"wal-append.queue_time_us":27638,"wal-append.run_cpu_time_us":2012,"wal-append.run_wall_time_us":1013159}
I20260709 12:14:35.712518  8424 raft_consensus.cc:3060] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:37.148164  8582 raft_consensus.cc:3055] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:39.086810  8582 raft_consensus.cc:740] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
W20260709 12:14:37.158073  8639 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.005s	sys 0.012s
I20260709 12:14:37.407509  8662 raft_consensus.cc:3055] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:14:39.094313  8662 raft_consensus.cc:740] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:39.095618  8662 consensus_queue.cc:260] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:39.096910  8662 raft_consensus.cc:3060] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:37.263949  8711 leader_election.cc:290] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:38.611232  8510 raft_consensus.cc:3060] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:37.300145  8712 raft_consensus.cc:3055] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:14:36.879693  8746 raft_consensus.cc:740] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
W20260709 12:14:38.574981  8762 log.cc:927] Time spent T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 5.338s	user 0.045s	sys 0.049s
I20260709 12:14:37.233434  8791 raft_consensus.cc:515] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:36.879279  8796 leader_election.cc:290] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:39.110687  8882 consensus_queue.cc:1059] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
W20260709 12:14:37.254367  8818 consensus_meta.cc:287] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 1.488s	user 0.009s	sys 0.000s
W20260709 12:14:37.259359  8830 consensus_meta.cc:287] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.580s	user 0.009s	sys 0.000s
I20260709 12:14:39.115000  8830 raft_consensus.cc:515] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:37.248346  8858 raft_consensus.cc:493] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.118124  8858 raft_consensus.cc:515] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:38.143317  8869 consensus_queue.cc:1048] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:14:38.583899  5116 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40402 (request call id 2248) took 3120 ms (client timeout 1529 ms). Trace:
W20260709 12:14:38.661670  5118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40386 (request call id 1911) took 3745 ms (client timeout 3297 ms). Trace:
W20260709 12:14:39.121826  5118 rpcz_store.cc:269] 0709 12:14:34.915860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.916018 (+   158us) service_pool.cc:224] Handling call
0709 12:14:38.660961 (+3744943us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b54002d3554. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:38.661294 (+   333us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":492869504}
I20260709 12:14:39.120918  8858 leader_election.cc:290] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:39.123533  5118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40402 (request call id 2246) took 3660 ms (client timeout 1738 ms). Trace:
W20260709 12:14:39.124022  5118 rpcz_store.cc:269] 0709 12:14:35.462640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.123309 (+3660669us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:39.123449 (+   140us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:14:39.124657  8791 leader_election.cc:290] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:39.124986  5118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40402 (request call id 2245) took 3662 ms (client timeout 1929 ms). Trace:
W20260709 12:14:38.672050  5164 connection.cc:256] RPC call timeout handler was delayed by -1.3815860899999279s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.4329s for a response
I20260709 12:14:39.126281  5164 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:38.682569  8871 raft_consensus.cc:493] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
W20260709 12:14:38.692144  5240 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.056s	user 0.013s	sys 0.060s
I20260709 12:14:39.129267  8871 raft_consensus.cc:515] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:39.129884  5240 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.494s	user 0.013s	sys 0.062s
W20260709 12:14:39.132970  5018 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50918 (request call id 227) took 22097 ms (client timeout 15000 ms). Trace:
I20260709 12:14:38.701562  5267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34674 (request call id 2197) took 5288 ms. Trace:
I20260709 12:14:38.703989  5266 raft_consensus.cc:1275] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:14:39.146441  5267 rpcz_store.cc:276] 0709 12:14:33.413023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.308399 (+1895376us) service_pool.cc:224] Handling call
0709 12:14:35.308753 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:36.617827 (+1309074us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:38.700857 (+2083030us) spinlock_profiling.cc:243] Waited 623 ms on lock 0x7b54000a7154. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:38.701236 (+   379us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1434040704}
I20260709 12:14:39.147759  5266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50932 (request call id 690) took 5855 ms. Trace:
W20260709 12:14:38.708247  5272 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34674 (request call id 2171) took 6784 ms (client timeout 1500 ms). Trace:
I20260709 12:14:38.711376  5271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34674 (request call id 2188) took 5363 ms. Trace:
I20260709 12:14:39.153569  5271 rpcz_store.cc:276] 0709 12:14:33.348143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.148225 (+1800082us) service_pool.cc:224] Handling call
0709 12:14:35.148559 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:35.177830 (+ 29271us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:35.177862 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:35.177906 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:35.177938 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:38.710838 (+3532900us) spinlock_profiling.cc:243] Waited 29.1 ms on lock 0x7b5400111054. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:38.710932 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:38.711204 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":66857344}
W20260709 12:14:38.753222  5121 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40402 (request call id 2244) took 3290 ms (client timeout 1534 ms). Trace:
W20260709 12:14:39.154992  5121 rpcz_store.cc:269] 0709 12:14:35.462159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:38.752652 (+3290493us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:38.752944 (+   292us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:14:39.156069  5121 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40402 (request call id 2247) took 3693 ms (client timeout 2151 ms). Trace:
W20260709 12:14:39.156474  5121 rpcz_store.cc:269] 0709 12:14:35.462890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.155863 (+3692973us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:39.156006 (+   143us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:14:38.775655  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:38.783120  5088 connection.cc:256] RPC call timeout handler was delayed by -1.9046250209999016s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17920000000000003s for a response
W20260709 12:14:39.161972  5088 connection.cc:256] RPC call timeout handler was delayed by -1.8317250210000111s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18730000000000002s for a response
W20260709 12:14:39.162357  5088 connection.cc:256] RPC call timeout handler was delayed by -1.7588250210001206s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19540000000000002s for a response
W20260709 12:14:39.162639  5088 connection.cc:256] RPC call timeout handler was delayed by -1.7588250210001206s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19540000000000002s for a response
W20260709 12:14:39.148083  5018 rpcz_store.cc:269] 0709 12:14:17.035753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:17.053444 (+ 17691us) service_pool.cc:224] Handling call
0709 12:14:39.132630 (+22079186us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:29.874298 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:29.874960 (+   662us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:29.875010 (+    50us) write_op.cc:435] Acquired schema lock
0709 12:14:29.875030 (+    20us) tablet.cc:662] Decoding operations
0709 12:14:29.875933 (+   903us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:29.876035 (+   102us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:29.876076 (+    41us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:14:29.876691 (+   615us) tablet.cc:701] Row locks acquired
0709 12:14:29.876743 (+    52us) write_op.cc:260] PREPARE: finished
0709 12:14:29.876916 (+   173us) write_op.cc:270] Start()
0709 12:14:29.877079 (+   163us) write_op.cc:276] Timestamp: P: 1783599269876851 usec, L: 0
0709 12:14:29.877100 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:14:29.956333 (+ 79233us) log.cc:844] Serialized 2515 byte log entry
0709 12:14:30.548119 (+591786us) op_driver.cc:464] REPLICATION: finished
0709 12:14:31.166942 (+618823us) write_op.cc:301] APPLY: starting
0709 12:14:31.167067 (+   125us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:31.167349 (+   282us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:31.167506 (+   157us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:31.168473 (+   967us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:31.168844 (+   371us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:14:31.168890 (+    46us) write_op.cc:312] APPLY: finished
0709 12:14:31.169210 (+   320us) log.cc:844] Serialized 53 byte log entry
0709 12:14:31.228251 (+ 59041us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:31.232401 (+  4150us) write_op.cc:454] Released schema lock
0709 12:14:31.244496 (+ 12095us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:31.325778 (+ 81282us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:31.325811 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":216249,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":613071,"apply.run_cpu_time_us":3764,"apply.run_wall_time_us":158890,"num_ops":6,"prepare.queue_time_us":129353,"prepare.run_cpu_time_us":12458,"prepare.run_wall_time_us":378825,"raft.queue_time_us":152332,"raft.run_cpu_time_us":27436,"raft.run_wall_time_us":631538,"replication_time_us":670748,"thread_start_us":1063983,"threads_started":4,"wal-append.queue_time_us":326472,"wal-append.run_cpu_time_us":18530,"wal-append.run_wall_time_us":1839345}]]}
W20260709 12:14:39.164354  5088 connection.cc:256] RPC call timeout handler was delayed by -1.6265250209999067s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2101s for a response
W20260709 12:14:39.164841  5088 connection.cc:256] RPC call timeout handler was delayed by -1.6265250209999067s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2101s for a response
I20260709 12:14:38.789536  8816 leader_election.cc:290] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:35.103961  5195 rpcz_store.cc:276] 0709 12:14:33.392373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.021002 (+628629us) service_pool.cc:224] Handling call
0709 12:14:34.142922 (+121920us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:34.143123 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:14:34.916675 (+773552us) log.cc:844] Serialized 14 byte log entry
0709 12:14:35.089270 (+172595us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:35.090168 (+   898us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:35.090227 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:35.090288 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:35.090408 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":751542,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":24971,"thread_start_us":930156,"threads_started":2}
W20260709 12:14:39.167084  5195 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47728 (request call id 2135) took 4049 ms (client timeout 2878 ms). Trace:
W20260709 12:14:39.167433  5195 rpcz_store.cc:269] 0709 12:14:35.117752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.166772 (+4049020us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:39.166911 (+   139us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:14:39.137236  5801 leader_election.cc:304] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
W20260709 12:14:39.168450  5195 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41416 (request call id 654) took 3731 ms (client timeout 3031 ms). Trace:
W20260709 12:14:39.168828  5195 rpcz_store.cc:269] 0709 12:14:35.436863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.168259 (+3731396us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:39.168393 (+   134us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:14:38.812951  5194 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47744 (request call id 2165) took 3449 ms (client timeout 1954 ms). Trace:
W20260709 12:14:38.814090  5199 consensus_meta.cc:287] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 1.963s	user 0.009s	sys 0.025s
I20260709 12:14:39.169178  8816 raft_consensus.cc:2804] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:39.169575  5199 raft_consensus.cc:2468] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 8.
I20260709 12:14:38.815987  8784 leader_election.cc:290] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:38.817130  5119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40386 (request call id 1920) took 3813 ms. Trace:
I20260709 12:14:38.828176  8436 raft_consensus.cc:3055] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:14:38.832271  5198 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41416 (request call id 659) took 3393 ms (client timeout 2248 ms). Trace:
I20260709 12:14:38.855926  8380 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:39.169924  8816 raft_consensus.cc:493] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
W20260709 12:14:39.157295  5121 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40402 (request call id 2254) took 3410 ms (client timeout 1960 ms). Trace:
W20260709 12:14:38.864238  5122 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59390 (request call id 662) took 4006 ms (client timeout 2033 ms). Trace:
W20260709 12:14:38.870035  5192 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47728 (request call id 2121) took 5518 ms (client timeout 1672 ms). Trace:
I20260709 12:14:38.871021  5197 raft_consensus.cc:1240] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 10. Current term is 11. Ops: []
W20260709 12:14:39.170543  5199 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47744 (request call id 2167) took 3801 ms (client timeout 2217 ms). Trace:
I20260709 12:14:38.884038  8878 raft_consensus.cc:493] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.170492  8436 raft_consensus.cc:740] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:39.172639  5197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 2154) took 4194 ms. Trace:
I20260709 12:14:38.896214  5191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 2157) took 3916 ms. Trace:
I20260709 12:14:35.719499  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:38.937851  5196 rpcz_store.cc:276] 0709 12:14:34.980083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.001461 (+ 21378us) service_pool.cc:224] Handling call
0709 12:14:35.071707 (+ 70246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:35.076532 (+  4825us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:35.076566 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:35.076614 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:35.076645 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:38.443668 (+3367023us) spinlock_profiling.cc:243] Waited 4.52 ms on lock 0x7b540003a554. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:38.443729 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:38.443915 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10398976}
W20260709 12:14:39.171669  5199 rpcz_store.cc:269] 0709 12:14:35.369444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.798085 (+1428641us) service_pool.cc:224] Handling call
0709 12:14:39.170461 (+2372376us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:38.897169  5831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46100 (request call id 1026) took 3150 ms. Trace:
W20260709 12:14:38.968640  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:38.968199  5123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40402 (request call id 2238) took 4007 ms. Trace:
W20260709 12:14:38.967618  5274 rpcz_store.cc:269] 0709 12:14:33.363476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.476468 (+112992us) service_pool.cc:224] Handling call
0709 12:14:37.287121 (+3810653us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b54000f9454. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:37.287460 (+   339us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3462591744}
W20260709 12:14:39.023674  5120 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40402 (request call id 2251) took 3526 ms (client timeout 1619 ms). Trace:
W20260709 12:14:39.025854  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 93319.2us
I20260709 12:14:39.174731  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:39.170228  5119 rpcz_store.cc:276] 0709 12:14:35.003809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.299140 (+295331us) service_pool.cc:224] Handling call
0709 12:14:35.299452 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:35.829332 (+529880us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:38.809028 (+2979696us) spinlock_profiling.cc:243] Waited 417 ms on lock 0x7b540009ced4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:38.816904 (+  7876us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":958672768}
W20260709 12:14:39.176227  5088 connection.cc:256] RPC call timeout handler was delayed by -1.5221250209999653s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2217s for a response
I20260709 12:14:39.027796  8700 raft_consensus.cc:2749] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:14:39.029757  8731 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 4.827s	user 0.053s	sys 0.053s
W20260709 12:14:39.030215  5829 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46088 (request call id 643) took 3181 ms (client timeout 2210 ms). Trace:
W20260709 12:14:39.021481  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 82064.3us
W20260709 12:14:39.038753  5802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:39.039176  5200 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47744 (request call id 2173) took 3629 ms (client timeout 2311 ms). Trace:
W20260709 12:14:39.173943  5196 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47744 (request call id 2178) took 2300 ms (client timeout 2124 ms). Trace:
I20260709 12:14:39.045091  5117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40386 (request call id 1924) took 3987 ms. Trace:
W20260709 12:14:39.049249  5804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:39.076323  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 46112.8us
W20260709 12:14:39.084259  5295 debug-util.cc:398] Leaking SignalData structure 0x7b080022dbe0 after lost signal to thread 5057
W20260709 12:14:39.180063  5804 connection.cc:256] RPC call timeout handler was delayed by -1.5091737240002203s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1532s for a response
W20260709 12:14:39.180492  5804 connection.cc:256] RPC call timeout handler was delayed by -1.2985737240001072s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1766s for a response
W20260709 12:14:39.180721  5295 debug-util.cc:398] Leaking SignalData structure 0x7b08002813a0 after lost signal to thread 5149
W20260709 12:14:39.182191  5295 debug-util.cc:398] Leaking SignalData structure 0x7b080010d640 after lost signal to thread 5224
W20260709 12:14:39.170526  5195 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47744 (request call id 2176) took 2298 ms (client timeout 2059 ms). Trace:
W20260709 12:14:39.178781  5200 rpcz_store.cc:269] 0709 12:14:35.409755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.038834 (+3629079us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:39.039000 (+   166us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:14:39.178825  8886 raft_consensus.cc:493] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.090394  5835 rpcz_store.cc:276] 0709 12:14:35.746270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.670340 (+924070us) service_pool.cc:224] Handling call
0709 12:14:36.670690 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:36.888862 (+218172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:36.888975 (+   113us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:36.942091 (+ 53116us) log.cc:844] Serialized 26 byte log entry
0709 12:14:37.247005 (+304914us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:37.247050 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:37.247123 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:37.274483 (+ 27360us) raft_consensus.cc:1685] finished
0709 12:14:37.274506 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:37.274662 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":217716,"raft.queue_time_us":411785,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":17951,"thread_start_us":7592,"threads_started":1,"wal-append.queue_time_us":131138,"wal-append.run_cpu_time_us":1952,"wal-append.run_wall_time_us":1003517}
W20260709 12:14:39.184407  5238 connection.cc:256] RPC call timeout handler was delayed by -2.2517305280000528s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20379999999999998s for a response
W20260709 12:14:39.183557  5295 debug-util.cc:398] Leaking SignalData structure 0x7b08003c1f60 after lost signal to thread 5298
I20260709 12:14:39.184612  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:39.184135  5120 rpcz_store.cc:269] 0709 12:14:35.496774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.023366 (+3526592us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:39.023516 (+   150us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:14:39.093225  8639 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.474s	user 0.006s	sys 0.015s
W20260709 12:14:39.186973  5295 debug-util.cc:398] Leaking SignalData structure 0x7b0800360f40 after lost signal to thread 5862
I20260709 12:14:39.088531  8582 consensus_queue.cc:260] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:39.183899  5195 rpcz_store.cc:269] 0709 12:14:36.872545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.170323 (+2297778us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:39.170468 (+   145us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:14:39.098202  8887 consensus_queue.cc:1059] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:39.099329  5125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59390 (request call id 664) took 4224 ms. Trace:
I20260709 12:14:37.239912  8814 raft_consensus.cc:2804] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:39.112313  8882 raft_consensus.cc:3055] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:39.173331  5191 rpcz_store.cc:276] 0709 12:14:34.979631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.979748 (+   117us) service_pool.cc:224] Handling call
0709 12:14:35.056230 (+ 76482us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:35.147517 (+ 91287us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:14:35.180120 (+ 32603us) log.cc:844] Serialized 14 byte log entry
0709 12:14:36.150717 (+970597us) spinlock_profiling.cc:243] Waited 6.62 ms on lock 0x7b18003bea20. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3ab8e07 00007f84ec9139a9 00007f84e3ad569b 00007f84e3ad393f 00007f84e3ad5c02 00007f84e675d20b 00007f84e6762d23 00007f84e676323a 00007f84e6bcda2a
0709 12:14:36.887052 (+736335us) log.cc:844] Serialized 14 byte log entry
0709 12:14:36.887534 (+   482us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:36.887587 (+    53us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:36.887633 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:38.895447 (+2007814us) spinlock_profiling.cc:243] Waited 91 ms on lock 0x7b54003773d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:38.895524 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:38.895945 (+   421us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15266,"prepare.queue_time_us":83147,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":87,"raft.queue_time_us":209,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":195,"spinlock_wait_cycles":224560768,"thread_start_us":735583,"threads_started":2,"wal-append.queue_time_us":1575117,"wal-append.run_cpu_time_us":15995,"wal-append.run_wall_time_us":1212866}
W20260709 12:14:38.696403  5193 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41416 (request call id 660) took 3257 ms (client timeout 2159 ms). Trace:
I20260709 12:14:39.134289  8869 raft_consensus.cc:2749] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:39.125767  8830 leader_election.cc:290] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:39.135253  5240 connection.cc:256] RPC call timeout handler was delayed by -2.3082310050001524s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1529s for a response
I20260709 12:14:39.194667  8816 raft_consensus.cc:3060] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:39.194891  8882 raft_consensus.cc:740] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:39.175196  8784 raft_consensus.cc:493] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:39.121841  5116 rpcz_store.cc:269] 0709 12:14:35.463117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:38.583631 (+3120514us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:38.583788 (+   157us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:14:39.197170  8784 raft_consensus.cc:515] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:39.195103  5193 rpcz_store.cc:269] 0709 12:14:35.438520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:38.695906 (+3257386us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:38.696158 (+   252us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:14:39.198005  5116 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59390 (request call id 670) took 2495 ms (client timeout 1766 ms). Trace:
W20260709 12:14:39.198438  5116 rpcz_store.cc:269] 0709 12:14:36.702686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.197813 (+2495127us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:39.197944 (+   131us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:14:39.198879  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
W20260709 12:14:39.199317  5116 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40402 (request call id 2256) took 2497 ms (client timeout 1807 ms). Trace:
I20260709 12:14:39.139760  8791 consensus_queue.cc:1048] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:14:39.199756  8784 leader_election.cc:290] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:39.143114  8875 raft_consensus.cc:493] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.173084  5197 rpcz_store.cc:276] 0709 12:14:34.978122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.978238 (+   116us) service_pool.cc:224] Handling call
0709 12:14:38.870569 (+3892331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:39.171619 (+301050us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.172406 (+   787us) spinlock_profiling.cc:243] Waited 3.89 s on lock 0x7b5400364550. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc28ad 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:39.172555 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8950397696}
I20260709 12:14:39.197746  8882 consensus_queue.cc:260] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:39.144376  8871 leader_election.cc:290] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:39.145443  8361 raft_consensus.cc:493] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.184722  8886 raft_consensus.cc:515] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:39.201845  8882 raft_consensus.cc:3060] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:39.202127  8791 consensus_queue.cc:1243] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer 9e794b72ed7640219f90ec4232363929 log is divergent from this leader: its last log entry 9.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:14:39.201783  8361 raft_consensus.cc:515] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:39.195585  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:39.199690  5116 rpcz_store.cc:269] 0709 12:14:36.702107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.199134 (+2497027us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:39.199262 (+   128us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:14:39.204290  5191 raft_consensus.cc:2393] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 7: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
W20260709 12:14:39.204797  5116 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59390 (request call id 676) took 2500 ms (client timeout 1953 ms). Trace:
W20260709 12:14:38.861778  5124 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40402 (request call id 2241) took 3767 ms (client timeout 1960 ms). Trace:
I20260709 12:14:39.172185  8878 raft_consensus.cc:515] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:39.200414  5199 raft_consensus.cc:2410] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
W20260709 12:14:38.986730  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 1.70385e+06us
W20260709 12:14:39.169575  5194 rpcz_store.cc:269] 0709 12:14:35.366123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.707726 (+341603us) service_pool.cc:224] Handling call
0709 12:14:38.812396 (+3104670us) spinlock_profiling.cc:243] Waited 960 ms on lock 0x7b5400037fd4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:38.812700 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2207261952}
W20260709 12:14:39.206092  5116 rpcz_store.cc:269] 0709 12:14:36.704724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.204619 (+2499895us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:39.204741 (+   122us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:14:39.101032  8712 raft_consensus.cc:740] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
W20260709 12:14:39.180794  5804 connection.cc:256] RPC call timeout handler was delayed by -1.1302737240000624s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19530000000000003s for a response
W20260709 12:14:39.215901  5804 connection.cc:256] RPC call timeout handler was delayed by -1.0780737240002054s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20110000000000003s for a response
W20260709 12:14:39.179188  5088 connection.cc:256] RPC call timeout handler was delayed by -1.4375250210000559s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2311s for a response
W20260709 12:14:39.178031  8731 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 5.025s	user 0.054s	sys 0.053s
W20260709 12:14:39.183934  5122 rpcz_store.cc:269] 0709 12:14:34.857693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.857815 (+   122us) service_pool.cc:224] Handling call
0709 12:14:38.863685 (+4005870us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b54002dc654. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:38.863986 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":367206656}
I20260709 12:14:39.187155  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:39.187244  5120 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59390 (request call id 674) took 2483 ms (client timeout 1532 ms). Trace:
W20260709 12:14:39.228855  5120 rpcz_store.cc:269] 0709 12:14:36.704221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.187050 (+2482829us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:39.187187 (+   137us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:14:39.178910  5196 rpcz_store.cc:269] 0709 12:14:38.673894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.173769 (+499875us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:39.173887 (+   118us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:14:39.192385  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 55404.4us
I20260709 12:14:39.189193  5125 rpcz_store.cc:276] 0709 12:14:34.874990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.875324 (+   334us) service_pool.cc:224] Handling call
0709 12:14:34.911127 (+ 35803us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:35.080715 (+169588us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:35.080748 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:35.090070 (+  9322us) log.cc:844] Serialized 52 byte log entry
0709 12:14:38.858605 (+3768535us) spinlock_profiling.cc:243] Waited 3.43 ms on lock 0x7b1800041320. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3ab8e07 00007f84ec9139a9 00007f84e3ad569b 00007f84e3ad393f 00007f84e3ad5c02 00007f84e675d20b 00007f84e6762d23 00007f84e67630d1 00007f84e6b7ea0f
0709 12:14:38.889155 (+ 30550us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:38.967095 (+ 77940us) log.cc:844] Serialized 14 byte log entry
0709 12:14:38.987652 (+ 20557us) log.cc:844] Serialized 14 byte log entry
0709 12:14:39.061369 (+ 73717us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.089601 (+ 28232us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b540038e5d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:39.089660 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:39.098932 (+  9272us) raft_consensus.cc:1685] finished
0709 12:14:39.098949 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:39.099161 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":16996,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":1688,"raft.queue_time_us":94429,"raft.run_cpu_time_us":616,"raft.run_wall_time_us":32756,"spinlock_wait_cycles":356215424,"thread_start_us":178436,"threads_started":3,"wal-append.queue_time_us":3795371}
W20260709 12:14:39.194159  5238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:39.178470  5829 rpcz_store.cc:269] 0709 12:14:35.848937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.582109 (+733172us) service_pool.cc:224] Handling call
0709 12:14:39.018144 (+2436035us) spinlock_profiling.cc:243] Waited 503 ms on lock 0x7b540048dd54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:39.029933 (+ 11789us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1156708096}
I20260709 12:14:39.199575  5193 raft_consensus.cc:3060] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:39.198043  5240 connection.cc:256] RPC call timeout handler was delayed by -2.3037310050001452s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1534s for a response
W20260709 12:14:39.171397  5192 rpcz_store.cc:269] 0709 12:14:33.351289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:33.351417 (+   128us) service_pool.cc:224] Handling call
0709 12:14:38.869565 (+5518148us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b5400364554. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:38.869837 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3758515968}
W20260709 12:14:39.140904  5118 rpcz_store.cc:269] 0709 12:14:35.462411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.124787 (+3662376us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:39.124924 (+   137us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:14:39.187954  8582 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:39.174428  5123 rpcz_store.cc:276] 0709 12:14:34.960345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.961337 (+   992us) service_pool.cc:224] Handling call
0709 12:14:34.984179 (+ 22842us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:35.148903 (+164724us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:38.965740 (+3816837us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b540024ac54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:38.968009 (+  2269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":281463040}
I20260709 12:14:39.174090  5831 rpcz_store.cc:276] 0709 12:14:35.746520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:36.671524 (+925004us) service_pool.cc:224] Handling call
0709 12:14:36.671900 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:38.804261 (+2132361us) spinlock_profiling.cc:243] Waited 2.66 ms on lock 0x7b1800495be0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e676b4bc 00007f84e3ab948b 00007f84ec9139a9 00007f84e3ad569b 00007f84e3ad393f 00007f84e3ad3455 00007f84e6bbb060 00007f84e6bbbbfb 00007f84e6bc664b
0709 12:14:38.804684 (+   423us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:38.804711 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:38.805638 (+   927us) log.cc:844] Serialized 26 byte log entry
0709 12:14:38.866443 (+ 60805us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:38.866481 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:38.871559 (+  5078us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:38.896397 (+ 24838us) raft_consensus.cc:1685] finished
0709 12:14:38.896415 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:38.896934 (+   519us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":219402,"raft.queue_time_us":471767,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":71621,"spinlock_wait_cycles":6114048,"thread_start_us":409500,"threads_started":2,"wal-append.queue_time_us":88124}
I20260709 12:14:39.177042  5166 leader_election.cc:304] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:14:39.201962  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:39.171108  5198 rpcz_store.cc:269] 0709 12:14:35.438263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:38.831767 (+3393504us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:38.831996 (+   229us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:14:39.170044  5272 rpcz_store.cc:269] 0709 12:14:31.923724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:31.923857 (+   133us) service_pool.cc:224] Handling call
0709 12:14:38.707679 (+6783822us) spinlock_profiling.cc:243] Waited 2.1 s on lock 0x7b54000d4154. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:38.707958 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4820035328}
I20260709 12:14:39.179032  5117 rpcz_store.cc:276] 0709 12:14:35.057616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.420109 (+362493us) service_pool.cc:224] Handling call
0709 12:14:38.867522 (+3447413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:38.867998 (+   476us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:14:38.888193 (+ 20195us) log.cc:844] Serialized 14 byte log entry
0709 12:14:38.933264 (+ 45071us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:38.933331 (+    67us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:38.933403 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:38.933503 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:39.041338 (+107835us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b18001b0be0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3ad63f3 00007f84e3ad87c1 00007f84e3ad8779 00007f84e3ad8709 00007f84e3ad86d1 00007f84e3ad79cd 0000000000388634 0000000000388479 00007f84e3ab983a
0709 12:14:39.042516 (+  1178us) spinlock_profiling.cc:243] Waited 2.57 ms on lock 0x7b18001b0be0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3aa42a6 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3aa42a6 00007f84e3aa4240
0709 12:14:39.043543 (+  1027us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b18001b0be0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3aa42a6 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc28ad 00007f84ebb87419 00007f84e50febd4
0709 12:14:39.044704 (+  1161us) spinlock_profiling.cc:243] Waited 3.44 s on lock 0x7b54002dc650. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc28ad 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:39.044863 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":37528,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":413,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":217,"spinlock_wait_cycles":7958195072,"thread_start_us":63115,"threads_started":2,"wal-append.queue_time_us":44819}
I20260709 12:14:39.205168  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:39.176981  5119 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40402 (request call id 2252) took 3552 ms (client timeout 2244 ms). Trace:
W20260709 12:14:39.171104  5121 rpcz_store.cc:269] 0709 12:14:35.747326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.157111 (+3409785us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:39.157246 (+   135us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:14:39.169879  5266 rpcz_store.cc:276] 0709 12:14:33.292404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:34.997738 (+1705334us) service_pool.cc:224] Handling call
0709 12:14:38.703086 (+3705348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:39.146777 (+443691us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.147465 (+   688us) spinlock_profiling.cc:243] Waited 3.7 s on lock 0x7b54000f9450. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc28ad 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:39.147658 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8520275328}
I20260709 12:14:39.228225  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:39.235306  5119 rpcz_store.cc:269] 0709 12:14:35.624836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.176774 (+3551938us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:39.176916 (+   142us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:14:39.207660  5124 rpcz_store.cc:269] 0709 12:14:35.093898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:35.141237 (+ 47339us) service_pool.cc:224] Handling call
0709 12:14:38.861232 (+3719995us) spinlock_profiling.cc:243] Waited 70.3 ms on lock 0x7b540008dc54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:38.861563 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":161610624}
W20260709 12:14:39.233912  5238 connection.cc:256] RPC call timeout handler was delayed by -2.09693052800003s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.221s for a response
W20260709 12:14:39.238133  5116 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59390 (request call id 677) took 2527 ms (client timeout 2011 ms). Trace:
W20260709 12:14:39.238597  5116 rpcz_store.cc:269] 0709 12:14:36.704967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.215373 (+2510406us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:39.232542 (+ 17169us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:14:39.205017  8361 leader_election.cc:290] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:39.242460  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:39.243322  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:39.236238  5237 leader_election.cc:336] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Timed out: RequestConsensusVote RPC to 127.3.212.130:44455 timed out after 1.609s (SENT)
I20260709 12:14:39.196560  8746 consensus_queue.cc:260] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:39.245735  5088 leader_election.cc:304] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:39.246152  8878 leader_election.cc:290] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:39.201357  8875 raft_consensus.cc:515] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:39.247231  8746 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:39.245261  5195 raft_consensus.cc:1240] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 LEADER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 9. Current term is 10. Ops: []
W20260709 12:14:39.249763  5122 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59390 (request call id 681) took 2468 ms (client timeout 2033 ms). Trace:
I20260709 12:14:39.250121  5195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 2160) took 4269 ms. Trace:
I20260709 12:14:39.243606  5192 raft_consensus.cc:2410] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 13 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 12:14:39.234256  5197 raft_consensus.cc:2468] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 5.
I20260709 12:14:39.194923  8814 raft_consensus.cc:493] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:39.250720  5238 connection.cc:256] RPC call timeout handler was delayed by -2.0448808060000374s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1534s for a response
W20260709 12:14:39.251305  5125 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59390 (request call id 683) took 2459 ms (client timeout 2029 ms). Trace:
W20260709 12:14:39.253480  5125 rpcz_store.cc:269] 0709 12:14:36.782457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.233854 (+2451397us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:39.241705 (+  7851us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:14:39.251696  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:39.237059  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:39.245839  5237 leader_election.cc:304] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:14:39.250181  5122 rpcz_store.cc:269] 0709 12:14:36.781772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.237579 (+2455807us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:39.249667 (+ 12088us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:14:39.250586  5195 rpcz_store.cc:276] 0709 12:14:34.980665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.244491 (+4263826us) service_pool.cc:224] Handling call
0709 12:14:39.244990 (+   499us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:39.249850 (+  4860us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.250046 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:39.245147  5801 leader_election.cc:304] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:39.257339  8809 consensus_queue.cc:1059] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:14:39.258870  8361 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.259588  8361 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:39.123348  5022 catalog_manager.cc:5697] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 2 to 5, leader changed from bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 5 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:14:39.262735  8712 consensus_queue.cc:260] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:39.264133  8712 raft_consensus.cc:3060] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:39.236488  8784 raft_consensus.cc:493] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:39.266175  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 89289.3us
I20260709 12:14:39.267288  5166 leader_election.cc:304] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:39.268436  5192 raft_consensus.cc:1240] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 7. Current term is 9. Ops: []
I20260709 12:14:39.269359  5192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41416 (request call id 647) took 4269 ms. Trace:
I20260709 12:14:39.269820  5192 rpcz_store.cc:276] 0709 12:14:35.000150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.267668 (+4267518us) service_pool.cc:224] Handling call
0709 12:14:39.268130 (+   462us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:39.268970 (+   840us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.269250 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:39.270944  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:39.271973  5198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47728 (request call id 2138) took 4021 ms. Trace:
I20260709 12:14:39.272631  8869 raft_consensus.cc:2749] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:39.273402  8869 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
W20260709 12:14:39.273854  5089 connection.cc:256] RPC call timeout handler was delayed by -2.6555111960001341s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18730000000000002s for a response
I20260709 12:14:39.274096  8869 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:39.274777  5118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59390 (request call id 675) took 2570 ms (client timeout 2241 ms). Trace:
I20260709 12:14:39.274992  8662 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.275519  8662 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:39.275840  8886 leader_election.cc:290] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:39.275285  5238 connection.cc:256] RPC call timeout handler was delayed by -1.3859305280000171s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30000000000000004s for a response
I20260709 12:14:39.172892  8436 consensus_queue.cc:260] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:39.274657  8878 raft_consensus.cc:493] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:39.255187  8791 raft_consensus.cc:493] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:39.278695  5199 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47744 (request call id 2174) took 3859 ms (client timeout 4332 ms). Trace:
I20260709 12:14:39.278301  8878 raft_consensus.cc:515] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:39.277767  5238 connection.cc:256] RPC call timeout handler was delayed by -1.070760724000138s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16810000000000003s for a response
I20260709 12:14:39.278929  8791 raft_consensus.cc:515] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:39.280822  8878 leader_election.cc:290] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:39.272051  8871 raft_consensus.cc:2804] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:39.277725  8662 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:39.281452  5196 raft_consensus.cc:2393] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 11: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:39.281788  8871 raft_consensus.cc:493] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:39.282217  8871 raft_consensus.cc:3060] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:39.283478  5196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 2161) took 3921 ms. Trace:
I20260709 12:14:39.283906  5196 rpcz_store.cc:276] 0709 12:14:35.362207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.282362 (+3920155us) service_pool.cc:224] Handling call
0709 12:14:39.282734 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:39.283043 (+   309us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:39.283067 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:39.283121 (+    54us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:39.283152 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.283303 (+   151us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:39.283424 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:39.272351  5198 rpcz_store.cc:276] 0709 12:14:35.250709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.241729 (+3991020us) service_pool.cc:224] Handling call
0709 12:14:39.271890 (+ 30161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:39.283433  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:39.286212  5119 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59390 (request call id 684) took 2503 ms (client timeout 2665 ms). Trace:
I20260709 12:14:39.286451  5088 leader_election.cc:304] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:39.286746  8662 raft_consensus.cc:2804] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:39.287163  8662 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
W20260709 12:14:39.287699  5118 rpcz_store.cc:269] 0709 12:14:36.704479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.274551 (+2570072us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:39.274695 (+   144us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:14:39.287763  8662 raft_consensus.cc:3060] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:39.264144  5022 catalog_manager.cc:5697] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 4 to 7, leader changed from bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 7 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:39.289706  8875 leader_election.cc:290] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:39.291021  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:39.280972  5238 leader_election.cc:304] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:39.292846  8700 raft_consensus.cc:2749] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:14:39.293501  5089 connection.cc:256] RPC call timeout handler was delayed by -2.5826111960002436s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19540000000000002s for a response
I20260709 12:14:39.293601  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:14:39.293900  5089 connection.cc:256] RPC call timeout handler was delayed by -2.5403111960001752s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2001s for a response
I20260709 12:14:39.294301  5830 raft_consensus.cc:1275] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:14:39.295167  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:39.295919  5838 raft_consensus.cc:3060] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:39.296478  5238 leader_election.cc:304] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:14:39.287516  5119 rpcz_store.cc:269] 0709 12:14:36.782725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.282919 (+2500194us) service_pool.cc:224] Handling call
0709 12:14:39.286139 (+  3220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:39.257618  5191 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 9.
W20260709 12:14:39.256036  5240 connection.cc:256] RPC call timeout handler was delayed by -2.2272310050000215s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16190000000000002s for a response
I20260709 12:14:39.269755  5166 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:39.265890  8784 raft_consensus.cc:515] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:39.313561  8784 leader_election.cc:290] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:39.313829  5196 raft_consensus.cc:1240] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:39.314392  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:39.314653  5238 leader_election.cc:304] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:39.314683  5196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 2162) took 3952 ms. Trace:
I20260709 12:14:39.317910  8729 raft_consensus.cc:3055] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:39.318336  8729 raft_consensus.cc:740] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:39.319103  8816 raft_consensus.cc:515] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:39.287742  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:39.287369  8361 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:39.302279  5836 raft_consensus.cc:1275] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 12:14:39.303013  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 87854.5us
I20260709 12:14:39.303334  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:39.303675  8424 raft_consensus.cc:2749] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:39.302152  8700 raft_consensus.cc:2804] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:39.310173  8731 raft_consensus.cc:493] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.256538  8814 raft_consensus.cc:3060] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:39.306890  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:39.323611  5191 raft_consensus.cc:1240] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:39.308145  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:39.281262  8791 leader_election.cc:290] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:39.278276  8436 raft_consensus.cc:3060] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:39.333243  8816 leader_election.cc:290] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:39.331539  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:39.334913  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:39.336021  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:39.336625  5119 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 8.
I20260709 12:14:39.337437  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:39.337566  8830 raft_consensus.cc:2804] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:39.338028  5119 raft_consensus.cc:2468] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 10.
I20260709 12:14:39.338157  8830 raft_consensus.cc:697] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:39.338882  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:39.339007  5193 raft_consensus.cc:2468] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 9.
I20260709 12:14:39.339205  8830 consensus_queue.cc:237] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:39.309800  5240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:39.310367  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:39.303011  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:39.341348  8510 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.341989  8510 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:39.282294  5121 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59390 (request call id 672) took 2578 ms (client timeout 2248 ms). Trace:
W20260709 12:14:39.344055  5121 rpcz_store.cc:269] 0709 12:14:36.703491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.282096 (+2578605us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:39.282221 (+   125us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:14:39.344182  8510 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:39.345100  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:39.345425  5123 raft_consensus.cc:2393] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 5: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:39.345808  5121 raft_consensus.cc:2468] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 11.
I20260709 12:14:39.346380  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:39.346760  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:39.347287  5123 raft_consensus.cc:2410] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:14:39.347594  5121 raft_consensus.cc:2410] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:14:39.347730  5123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40402 (request call id 2250) took 3872 ms. Trace:
I20260709 12:14:39.348049  5123 rpcz_store.cc:276] 0709 12:14:35.475596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.346093 (+3870497us) service_pool.cc:224] Handling call
0709 12:14:39.347675 (+  1582us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:39.311244  5194 raft_consensus.cc:1275] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:14:39.348992  5194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41416 (request call id 646) took 4357 ms. Trace:
I20260709 12:14:39.349337  5194 rpcz_store.cc:276] 0709 12:14:34.991229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.299230 (+4308001us) service_pool.cc:224] Handling call
0709 12:14:39.310925 (+ 11695us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:39.348725 (+ 37800us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.348922 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:39.350762  5194 raft_consensus.cc:1240] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 9. Current term is 10. Ops: []
W20260709 12:14:39.350836  5237 leader_election.cc:336] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Timed out: RequestConsensusVote RPC to 127.3.212.130:44455 timed out after 1.672s (SENT)
I20260709 12:14:39.326010  8700 raft_consensus.cc:493] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:39.351099  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:39.351819  8700 raft_consensus.cc:3060] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:39.311674  5200 raft_consensus.cc:1240] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:39.291527  5022 catalog_manager.cc:5697] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:39.352557  5197 raft_consensus.cc:1240] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:39.320632  8875 consensus_queue.cc:1059] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:14:39.299700  5199 rpcz_store.cc:269] 0709 12:14:35.419135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.174216 (+3755081us) service_pool.cc:224] Handling call
0709 12:14:39.278444 (+104228us) spinlock_profiling.cc:243] Waited 24.5 ms on lock 0x7b5400364a54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:39.278612 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":56323456}
W20260709 12:14:39.304369  5120 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59390 (request call id 671) took 2601 ms (client timeout 2149 ms). Trace:
W20260709 12:14:39.356025  5120 rpcz_store.cc:269] 0709 12:14:36.703158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.304141 (+2600983us) service_pool.cc:211] Skipping call since client already timed out
0709 12:14:39.304289 (+   148us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:14:39.330257  5117 raft_consensus.cc:2468] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 9.
I20260709 12:14:39.315337  5122 raft_consensus.cc:2410] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:14:39.317905  5196 rpcz_store.cc:276] 0709 12:14:35.362535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.284893 (+3922358us) service_pool.cc:224] Handling call
0709 12:14:39.285367 (+   474us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:39.314389 (+ 29022us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.314593 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:39.317188  8790 raft_consensus.cc:2749] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:39.325956  5124 raft_consensus.cc:2410] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 12:14:39.330683  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 44394us
I20260709 12:14:39.331394  8883 raft_consensus.cc:2804] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:39.361901  8883 raft_consensus.cc:493] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:39.363245  5191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 2168) took 3986 ms. Trace:
I20260709 12:14:39.352814  5119 raft_consensus.cc:2468] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 10.
I20260709 12:14:39.351384  5194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 2169) took 3974 ms. Trace:
I20260709 12:14:39.351347  5237 leader_election.cc:304] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:39.310573  5166 leader_election.cc:304] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:14:39.361321  5124 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40402 (request call id 2249) took 3895 ms (client timeout 4885 ms). Trace:
I20260709 12:14:39.362432  5199 raft_consensus.cc:1240] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
W20260709 12:14:39.348352  5240 connection.cc:256] RPC call timeout handler was delayed by -2.1201310050000757s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1738s for a response
W20260709 12:14:39.359892  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:39.319567  8729 consensus_queue.cc:260] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:39.363631  5191 rpcz_store.cc:276] 0709 12:14:35.369699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.308741 (+3939042us) service_pool.cc:224] Handling call
0709 12:14:39.309142 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:39.356367 (+ 47225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.356546 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:39.364682  5240 connection.cc:256] RPC call timeout handler was delayed by -1.9482310050000251s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19290000000000002s for a response
I20260709 12:14:39.363832  5194 rpcz_store.cc:276] 0709 12:14:35.376835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.350177 (+3973342us) service_pool.cc:224] Handling call
0709 12:14:39.350536 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:39.351152 (+   616us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.351337 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:39.365662  5240 connection.cc:256] RPC call timeout handler was delayed by -1.7484310050001568s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21509999999999999s for a response
W20260709 12:14:39.366075  5240 connection.cc:256] RPC call timeout handler was delayed by -1.6647310050000215s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22440000000000004s for a response
I20260709 12:14:39.365801  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:14:39.366336  5240 connection.cc:256] RPC call timeout handler was delayed by -1.6257181100002072s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.196s for a response
W20260709 12:14:39.366621  5240 connection.cc:256] RPC call timeout handler was delayed by -1.0093105050002578s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1807s for a response
W20260709 12:14:39.364217  5124 rpcz_store.cc:269] 0709 12:14:35.465510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.287445 (+3821935us) service_pool.cc:224] Handling call
0709 12:14:39.361227 (+ 73782us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:39.368248  5199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41416 (request call id 658) took 3926 ms. Trace:
I20260709 12:14:39.368548  5838 raft_consensus.cc:2468] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 11.
I20260709 12:14:39.368623  5199 rpcz_store.cc:276] 0709 12:14:35.438020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.361643 (+3923623us) service_pool.cc:224] Handling call
0709 12:14:39.362130 (+   487us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:39.364314 (+  2184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.364497 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:39.373968  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 128978us
I20260709 12:14:39.374634  5125 raft_consensus.cc:1240] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:39.374951  5801 leader_election.cc:304] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:39.362751  8582 consensus_queue.cc:1059] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 12:14:39.375877  8796 raft_consensus.cc:2749] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:39.376518  8582 raft_consensus.cc:3055] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:39.376966  8582 raft_consensus.cc:740] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:39.377996  8582 consensus_queue.cc:260] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:39.379283  5195 raft_consensus.cc:1240] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 LEADER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:14:39.379505  8582 raft_consensus.cc:3060] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:39.379961  5803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:39.341316  8731 raft_consensus.cc:515] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:39.384176  8731 leader_election.cc:290] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:14:39.376837  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 62311.1us
I20260709 12:14:39.386341  5116 raft_consensus.cc:1275] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:14:39.386539  5238 leader_election.cc:304] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:39.387224  5116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40402 (request call id 2242) took 3925 ms. Trace:
I20260709 12:14:39.387609  5116 rpcz_store.cc:276] 0709 12:14:35.461650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.358667 (+3897017us) service_pool.cc:224] Handling call
0709 12:14:39.385899 (+ 27232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:39.386801 (+   902us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.387148 (+   347us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:39.390491  5123 raft_consensus.cc:1275] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
W20260709 12:14:39.391384  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 198581us
I20260709 12:14:39.392139  5125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40402 (request call id 2243) took 3930 ms. Trace:
I20260709 12:14:39.392534  5125 rpcz_store.cc:276] 0709 12:14:35.461912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.359647 (+3897735us) service_pool.cc:224] Handling call
0709 12:14:39.374410 (+ 14763us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:39.391903 (+ 17493us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.392088 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:39.393780  5195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 2171) took 4011 ms. Trace:
I20260709 12:14:39.394419  5195 rpcz_store.cc:276] 0709 12:14:35.382526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.362976 (+3980450us) service_pool.cc:224] Handling call
0709 12:14:39.377318 (+ 14342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:39.393491 (+ 16173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.393721 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:39.391062  5123 pending_rounds.cc:85] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting all ops after (but not including) 7
W20260709 12:14:39.396935  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 46191.3us
W20260709 12:14:39.397004  5163 connection.cc:256] RPC call timeout handler was delayed by -1.0194577330000811s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30970000000000003s for a response
I20260709 12:14:39.400194  5200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41416 (request call id 645) took 4416 ms. Trace:
I20260709 12:14:39.400625  5200 rpcz_store.cc:276] 0709 12:14:34.981195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.276906 (+4295711us) service_pool.cc:224] Handling call
0709 12:14:39.299301 (+ 22395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:39.352379 (+ 53078us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.397734 (+ 45355us) spinlock_profiling.cc:243] Waited 22 ms on lock 0x7b5400037fd0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc28ad 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:39.397879 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":50548992}
I20260709 12:14:39.401854  5120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59390 (request call id 678) took 2696 ms. Trace:
I20260709 12:14:39.402232  5120 rpcz_store.cc:276] 0709 12:14:36.705211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.400882 (+2695671us) service_pool.cc:224] Handling call
0709 12:14:39.401255 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:39.401482 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:39.401509 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:39.401553 (+    44us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:39.401580 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.401637 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:39.401777 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:39.367877  8883 raft_consensus.cc:3060] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:39.396859  8738 raft_consensus.cc:2749] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:39.404736  5123 pending_rounds.cc:107] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 12:14:39.412587  5123 raft_consensus.cc:2889] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:39.390477  8869 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:39.414801  5193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 2170) took 4037 ms. Trace:
I20260709 12:14:39.417187  5193 rpcz_store.cc:276] 0709 12:14:35.377163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.354055 (+3976892us) service_pool.cc:224] Handling call
0709 12:14:39.397802 (+ 43747us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:39.409605 (+ 11803us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:39.409637 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:39.414520 (+  4883us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:39.414563 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.414621 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:39.414743 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:39.418888  5193 raft_consensus.cc:1240] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:14:39.403270  8424 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.424819  5125 raft_consensus.cc:1240] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:39.421463  5193 raft_consensus.cc:1275] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:14:39.373986  8662 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:39.424420  8784 raft_consensus.cc:2804] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:39.426120  5197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41416 (request call id 644) took 4445 ms. Trace:
I20260709 12:14:39.438119  5197 rpcz_store.cc:276] 0709 12:14:34.980939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.251483 (+4270544us) service_pool.cc:224] Handling call
0709 12:14:39.349260 (+ 97777us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:39.355669 (+  6409us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.425929 (+ 70260us) spinlock_profiling.cc:243] Waited 71 ms on lock 0x7b54001941d0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc28ad 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:39.426063 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":163305344}
I20260709 12:14:39.426664  5120 raft_consensus.cc:1240] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:14:39.431651  5198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 2163) took 4068 ms. Trace:
I20260709 12:14:39.409749  8361 raft_consensus.cc:2749] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:39.440562  5125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59390 (request call id 673) took 2727 ms. Trace:
W20260709 12:14:39.445015  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 68347.2us
I20260709 12:14:39.448984  5125 rpcz_store.cc:276] 0709 12:14:36.703947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.398948 (+2695001us) service_pool.cc:224] Handling call
0709 12:14:39.424689 (+ 25741us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:39.425228 (+   539us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.431195 (+  5967us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:39.448887  5123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40402 (request call id 2253) took 3755 ms. Trace:
I20260709 12:14:39.448954  5120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59390 (request call id 679) took 2734 ms. Trace:
I20260709 12:14:39.450439  5120 rpcz_store.cc:276] 0709 12:14:36.780844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.403162 (+2622318us) service_pool.cc:224] Handling call
0709 12:14:39.426452 (+ 23290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:39.439293 (+ 12841us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.439499 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:39.450048  5123 rpcz_store.cc:276] 0709 12:14:35.682771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.367966 (+3685195us) service_pool.cc:224] Handling call
0709 12:14:39.390149 (+ 22183us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:39.438353 (+ 48204us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.438558 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:39.453797  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 91403.2us
I20260709 12:14:39.455052  5121 pending_rounds.cc:85] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting all ops after (but not including) 7
I20260709 12:14:39.455406  5121 pending_rounds.cc:107] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:14:39.455663  5121 raft_consensus.cc:2889] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:39.405078  8814 raft_consensus.cc:515] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:39.458053  5118 raft_consensus.cc:1240] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:39.455839  5022 catalog_manager.cc:5697] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 8 to 9, leader changed from bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 9 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:39.460726  5117 raft_consensus.cc:1240] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:14:39.463454  5801 leader_election.cc:304] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:14:39.464314  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 153850us
I20260709 12:14:39.439314  5198 rpcz_store.cc:276] 0709 12:14:35.362788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.285872 (+3923084us) service_pool.cc:224] Handling call
0709 12:14:39.286230 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:39.286455 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:14:39.352092 (+ 65637us) log.cc:844] Serialized 14 byte log entry
0709 12:14:39.424956 (+ 72864us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:39.425006 (+    50us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:39.425046 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.425106 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:39.431581 (+  6475us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36363,"prepare.queue_time_us":72451,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":63,"thread_start_us":71815,"threads_started":1}
I20260709 12:14:39.466310  8881 raft_consensus.cc:2749] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:14:39.467105  5238 leader_election.cc:304] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:39.456203  8729 raft_consensus.cc:3060] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:39.476259  5166 leader_election.cc:304] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:39.476671  8871 raft_consensus.cc:515] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:39.479290  8871 leader_election.cc:290] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:39.481841  5119 raft_consensus.cc:1240] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:39.482249  8883 raft_consensus.cc:515] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:39.482647  5119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59390 (request call id 680) took 2701 ms. Trace:
I20260709 12:14:39.483878  5119 rpcz_store.cc:276] 0709 12:14:36.781285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.429038 (+2647753us) service_pool.cc:224] Handling call
0709 12:14:39.481636 (+ 52598us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:39.482400 (+   764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.482582 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:39.476536  8662 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:39.490792  5240 leader_election.cc:336] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Timed out: RequestConsensusVote RPC to 127.3.212.129:34443 timed out after 1.960s (SENT)
I20260709 12:14:39.491335  5240 leader_election.cc:304] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:39.492353  5195 raft_consensus.cc:1240] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 5. Current term is 6. Ops: []
W20260709 12:14:39.511687  5803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:39.482877  8712 raft_consensus.cc:2749] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:39.516983  5192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41416 (request call id 649) took 4511 ms. Trace:
W20260709 12:14:39.514113  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 45448.3us
I20260709 12:14:39.516912  5833 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 9.
I20260709 12:14:39.519194  5118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40402 (request call id 2240) took 4441 ms. Trace:
I20260709 12:14:39.519569  5118 rpcz_store.cc:276] 0709 12:14:35.072829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.360448 (+4287619us) service_pool.cc:224] Handling call
0709 12:14:39.389707 (+ 29259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:39.458475 (+ 68768us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.513689 (+ 55214us) spinlock_profiling.cc:243] Waited 66.7 ms on lock 0x7b54002d3554. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:39.513899 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":153377536}
I20260709 12:14:39.438661  8424 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:39.516194  8662 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.523813  8662 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:39.524418  8869 raft_consensus.cc:2749] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:14:39.526248  8662 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:39.526938  5195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47728 (request call id 2147) took 2681 ms. Trace:
I20260709 12:14:39.527311  5195 rpcz_store.cc:276] 0709 12:14:38.667059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.397201 (+730142us) service_pool.cc:224] Handling call
0709 12:14:39.414335 (+ 17134us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:39.492778 (+ 78443us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.523215 (+ 30437us) spinlock_profiling.cc:243] Waited 77.8 ms on lock 0x7b54001937d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:39.526875 (+  3660us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":179009408}
I20260709 12:14:39.510916  8738 consensus_queue.cc:1048] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
W20260709 12:14:39.529734  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 53585.8us
I20260709 12:14:39.529986  8700 raft_consensus.cc:515] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:39.531009  8814 leader_election.cc:290] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:39.533118  5116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40402 (request call id 2255) took 3605 ms. Trace:
I20260709 12:14:39.533517  5116 rpcz_store.cc:276] 0709 12:14:35.927509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.388365 (+3460856us) service_pool.cc:224] Handling call
0709 12:14:39.388816 (+   451us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:39.389059 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:14:39.389332 (+   273us) log.cc:844] Serialized 14 byte log entry
0709 12:14:39.532788 (+143456us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:39.532849 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:39.532891 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.532954 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:39.533058 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12187,"prepare.queue_time_us":137,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":68,"raft.queue_time_us":23853,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":90,"thread_start_us":101521,"threads_started":1}
I20260709 12:14:39.513353  5022 catalog_manager.cc:5697] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 5 to 7, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 7 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:39.544145  5022 catalog_manager.cc:5697] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 6 to 8, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 8 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:39.551667  5022 catalog_manager.cc:5697] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:39.555076  8883 leader_election.cc:290] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:39.556299  8700 leader_election.cc:290] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:39.557538  8424 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:39.553193  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:39.517554  5192 rpcz_store.cc:276] 0709 12:14:35.005087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.270807 (+4265720us) service_pool.cc:224] Handling call
0709 12:14:39.271215 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:39.271523 (+   308us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:14:39.321889 (+ 50366us) log.cc:844] Serialized 14 byte log entry
0709 12:14:39.516634 (+194745us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:39.516688 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:39.516728 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.516793 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:39.516927 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":49816,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":38655,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":118,"thread_start_us":189604,"threads_started":2,"wal-append.queue_time_us":142745}
W20260709 12:14:39.559615  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 52295.5us
I20260709 12:14:39.560559  5200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 2177) took 2687 ms. Trace:
I20260709 12:14:39.562836  5166 leader_election.cc:304] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
W20260709 12:14:39.568841  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 141081us
W20260709 12:14:39.571317  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 50568.8us
I20260709 12:14:39.570775  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:39.582190  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:39.565567  5200 rpcz_store.cc:276] 0709 12:14:36.873118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.401473 (+2528355us) service_pool.cc:224] Handling call
0709 12:14:39.401779 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:39.402053 (+   274us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:14:39.402373 (+   320us) log.cc:844] Serialized 14 byte log entry
0709 12:14:39.536006 (+133633us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:39.536052 (+    46us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:14:39.560196 (+ 24144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.560288 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:39.560488 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":201,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":32895,"raft.run_cpu_time_us":68,"raft.run_wall_time_us":68,"thread_start_us":132331,"threads_started":2,"wal-append.queue_time_us":40992}
I20260709 12:14:39.585137  5116 raft_consensus.cc:1275] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:14:39.601521  8900 raft_consensus.cc:2804] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:39.602095  8900 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:39.602504  8900 raft_consensus.cc:3060] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:39.605131  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 147022us
I20260709 12:14:39.584268  8700 raft_consensus.cc:2749] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:39.587335  8883 raft_consensus.cc:2749] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:14:39.610718  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 119989us
W20260709 12:14:39.611949  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 79487.7us
I20260709 12:14:39.608934  8905 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.607005  8712 consensus_queue.cc:1059] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 12:14:39.614833  8712 raft_consensus.cc:3055] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:39.615182  8712 raft_consensus.cc:740] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:39.616163  8712 consensus_queue.cc:260] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:39.617172  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:39.613299  8905 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:39.619859  8871 raft_consensus.cc:493] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.620401  8871 raft_consensus.cc:515] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:39.622789  5237 connection.cc:256] RPC call timeout handler was delayed by -2.2837776049998411s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22440000000000004s for a response
I20260709 12:14:39.625788  8896 consensus_queue.cc:1059] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:39.627286  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:39.628644  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:39.629732  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:39.630966  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:39.631515  5125 raft_consensus.cc:3060] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:39.633756  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:39.635135  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:39.638664  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:39.638978  8886 raft_consensus.cc:3055] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:39.639441  8886 raft_consensus.cc:740] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:39.639897  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:39.640327  8886 consensus_queue.cc:260] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:39.642593  8871 leader_election.cc:290] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:39.644532  8878 consensus_queue.cc:1059] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:39.645462  8878 raft_consensus.cc:3055] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:14:39.645833  8878 raft_consensus.cc:740] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:39.646790  8878 consensus_queue.cc:260] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:39.647953  8878 raft_consensus.cc:3060] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:39.643015  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:39.650130  5118 raft_consensus.cc:2393] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 6: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:39.644356  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:39.640959  5119 raft_consensus.cc:2393] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 10: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:39.644191  5088 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:39.642489  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:39.654599  5125 raft_consensus.cc:2468] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 9.
I20260709 12:14:39.658178  8886 raft_consensus.cc:3060] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:39.659389  5119 raft_consensus.cc:3055] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:14:39.644263  8901 log.cc:927] Time spent T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.089s	user 0.000s	sys 0.003s
I20260709 12:14:39.663676  5121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59390 (request call id 682) took 2881 ms. Trace:
I20260709 12:14:39.673511  5119 raft_consensus.cc:740] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
W20260709 12:14:39.676059  5237 leader_election.cc:336] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Timed out: RequestConsensusVote RPC to 127.3.212.130:44455 timed out after 1.818s (SENT)
I20260709 12:14:39.665792  5123 raft_consensus.cc:1275] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:14:39.644778  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:39.673614  5116 raft_consensus.cc:1275] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:14:39.676493  5237 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:39.681149  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:39.681932  5200 raft_consensus.cc:2468] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 6.
I20260709 12:14:39.686523  5122 raft_consensus.cc:2410] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:14:39.676873  5123 pending_rounds.cc:85] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting all ops after (but not including) 5
I20260709 12:14:39.687172  5123 pending_rounds.cc:107] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:14:39.687373  5123 raft_consensus.cc:2889] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:39.673156  8784 raft_consensus.cc:697] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 9 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
W20260709 12:14:39.693214  5804 leader_election.cc:336] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Timed out: RequestConsensusVote RPC to 127.3.212.129:34443 timed out after 2.033s (SENT)
I20260709 12:14:39.693787  5804 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:39.675644  8712 raft_consensus.cc:3060] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:39.697654  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:39.675191  5121 rpcz_store.cc:276] 0709 12:14:36.782169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.429530 (+2647361us) service_pool.cc:224] Handling call
0709 12:14:39.454752 (+ 25222us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:39.525919 (+ 71167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:39.525956 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:39.526545 (+   589us) log.cc:844] Serialized 52 byte log entry
0709 12:14:39.559047 (+ 32502us) spinlock_profiling.cc:243] Waited 5.87 ms on lock 0x7b1800499ea0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3ab8e07 00007f84ec9139a9 00007f84e3ad569b 00007f84e3ad393f 00007f84e3ad5c02 00007f84e675d20b 00007f84e6762d23 00007f84e67630d1 00007f84e6b7ea0f
0709 12:14:39.607327 (+ 48280us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:39.607365 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:39.607431 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:39.663369 (+ 55938us) raft_consensus.cc:1685] finished
0709 12:14:39.663404 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:39.663613 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5845,"raft.queue_time_us":5582,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":125,"spinlock_wait_cycles":13501312,"thread_start_us":48077,"threads_started":1,"wal-append.queue_time_us":134935}
I20260709 12:14:39.699082  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:39.702190  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:39.698961  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:39.702457  5195 raft_consensus.cc:2468] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 7.
I20260709 12:14:39.703136  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:39.703418  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:39.704334  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:39.704519  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:39.705171  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:39.705770  5198 raft_consensus.cc:2468] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 8.
I20260709 12:14:39.690452  8582 raft_consensus.cc:3060] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:39.706597  5194 raft_consensus.cc:1240] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:39.708261  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:39.708087  5196 raft_consensus.cc:2393] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 7: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:39.709241  5195 raft_consensus.cc:2410] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:14:39.710690  5119 consensus_queue.cc:260] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:39.718354  8896 consensus_queue.cc:1243] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer ad2f9a1e2f7a45429fa69fd23d09f821 log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:14:39.713174  8814 raft_consensus.cc:2749] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:39.721935  5119 raft_consensus.cc:3060] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:39.730696  8700 consensus_queue.cc:1048] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:39.731673  5192 raft_consensus.cc:1240] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:39.730711  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:39.695086  8883 consensus_queue.cc:1048] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:14:39.733249  5238 leader_election.cc:304] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:39.734400  8902 raft_consensus.cc:2749] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:39.734622  5088 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:39.735213  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:39.735498  8662 raft_consensus.cc:2804] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:39.736097  8662 raft_consensus.cc:697] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:39.736698  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:39.737018  8662 consensus_queue.cc:237] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:39.739301  8243 consensus_queue.cc:1059] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:39.740387  8510 raft_consensus.cc:3055] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:39.740778  8510 raft_consensus.cc:740] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:39.736570  8830 consensus_queue.cc:1059] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:39.741756  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:39.742113  8830 raft_consensus.cc:3055] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:39.742547  8830 raft_consensus.cc:740] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:39.743463  8830 consensus_queue.cc:260] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:39.745015  8830 raft_consensus.cc:3060] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:39.742023  8361 consensus_queue.cc:1048] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:14:39.748705  8905 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:39.741710  8510 consensus_queue.cc:260] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:39.749815  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:39.750489  8510 raft_consensus.cc:3060] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:39.752079  5198 raft_consensus.cc:2393] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 10: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:39.753250  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:39.754541  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:39.755769  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 45103.9us
I20260709 12:14:39.755297  5194 raft_consensus.cc:2468] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 7.
W20260709 12:14:39.755798  5801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:39.719946  5237 leader_election.cc:336] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Timed out: RequestConsensusVote RPC to 127.3.212.130:44455 timed out after 1.877s (SENT)
I20260709 12:14:39.766075  5237 leader_election.cc:304] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:39.781337  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:39.781668  5119 raft_consensus.cc:1275] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 12:14:39.782123  5119 pending_rounds.cc:85] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting all ops after (but not including) 6
I20260709 12:14:39.782347  5119 pending_rounds.cc:107] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:14:39.782593  5119 raft_consensus.cc:2889] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:39.783314  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:39.786845  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:39.787520  5198 raft_consensus.cc:2468] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 8.
I20260709 12:14:39.790496  8784 consensus_queue.cc:237] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:39.781565  5804 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.212.129:34443 timed out after 2.149s (SENT) [suppressed 39 similar messages]
I20260709 12:14:39.792380  8881 raft_consensus.cc:3055] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:39.792873  8881 raft_consensus.cc:740] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:39.794596  5804 leader_election.cc:304] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:39.795572  5804 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
W20260709 12:14:39.796622  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 81043.2us
W20260709 12:14:39.797129  5237 connection.cc:256] RPC call timeout handler was delayed by -1.9310053709998556s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2878s for a response
W20260709 12:14:39.797624  5237 connection.cc:256] RPC call timeout handler was delayed by -1.1619373339999584s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1738s for a response
W20260709 12:14:39.797963  5237 connection.cc:256] RPC call timeout handler was delayed by -1.1520373339999423s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17490000000000003s for a response
I20260709 12:14:39.755234  8814 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.801134  5237 leader_election.cc:304] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:39.810627  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:39.813514  5192 raft_consensus.cc:2468] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 8.
I20260709 12:14:39.811875  5240 leader_election.cc:304] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:39.816572  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:39.817354  5801 leader_election.cc:304] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:39.821256  5197 raft_consensus.cc:2468] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 11.
I20260709 12:14:39.822273  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:39.826193  5200 raft_consensus.cc:1240] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:14:39.827901  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:39.828526  5195 raft_consensus.cc:2393] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 6: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:39.819051  8738 raft_consensus.cc:2804] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:39.768988  8902 consensus_queue.cc:1048] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:14:39.810470  8905 raft_consensus.cc:493] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:39.810415  8907 raft_consensus.cc:2749] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:39.831905  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:39.817276  8729 raft_consensus.cc:2804] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:39.834754  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:39.837647  5194 raft_consensus.cc:1240] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:39.832507  8738 raft_consensus.cc:493] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:39.835284  8881 consensus_queue.cc:260] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:39.828783  8424 raft_consensus.cc:3060] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:39.854843  8700 consensus_queue.cc:1048] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:14:39.834208  8906 raft_consensus.cc:2749] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:39.830056  8731 raft_consensus.cc:2804] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:39.841698  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:39.856711  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:39.857255  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:39.857873  5192 raft_consensus.cc:1275] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:14:39.858318  5191 raft_consensus.cc:2468] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 10.
I20260709 12:14:39.865176  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:39.867553  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:39.839236  8883 raft_consensus.cc:2804] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:39.871861  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:39.870260  5088 connection.cc:256] RPC call timeout handler was delayed by -1.0020355589999781s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2171s for a response
I20260709 12:14:39.839429  8582 raft_consensus.cc:2749] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:39.841543  8729 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:39.823177  8814 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:39.856384  8738 raft_consensus.cc:3060] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:39.887387  5119 raft_consensus.cc:1275] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 12:14:39.890013  5119 pending_rounds.cc:85] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting all ops after (but not including) 3
I20260709 12:14:39.890290  5119 pending_rounds.cc:107] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:14:39.890548  5119 raft_consensus.cc:2889] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:39.875088  8883 raft_consensus.cc:493] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:39.877516  8912 raft_consensus.cc:493] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.891995  8883 raft_consensus.cc:3060] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:39.877936  5191 raft_consensus.cc:1240] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:39.892177  8912 raft_consensus.cc:515] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:39.862360  8731 raft_consensus.cc:493] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:39.893401  8731 raft_consensus.cc:3060] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:39.881268  5166 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:39.896495  8796 raft_consensus.cc:2804] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:39.896992  8796 raft_consensus.cc:697] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:39.897740  8881 raft_consensus.cc:3060] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:39.898396  5088 leader_election.cc:336] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 1.500s (SENT)
I20260709 12:14:39.898865  5088 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:39.899179  8898 consensus_queue.cc:1048] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:39.900902  8712 consensus_queue.cc:1048] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:39.901551  8662 raft_consensus.cc:2749] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:39.902894  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:39.903579  5833 raft_consensus.cc:2468] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 9.
I20260709 12:14:39.904659  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:39.898743  8904 consensus_queue.cc:1048] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:14:39.881561  8436 consensus_queue.cc:1059] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:39.887554  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:39.907097  5118 raft_consensus.cc:2468] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 8.
I20260709 12:14:39.888475  5122 raft_consensus.cc:1275] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:14:39.908087  5123 raft_consensus.cc:1275] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:14:39.889150  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:39.876641  5237 leader_election.cc:304] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:39.897903  8796 consensus_queue.cc:237] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:39.908989  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:39.909862  5829 raft_consensus.cc:2410] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:14:39.910284  8912 leader_election.cc:290] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:39.910779  5237 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:39.908458  5123 pending_rounds.cc:85] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting all ops after (but not including) 5
I20260709 12:14:39.911652  5123 pending_rounds.cc:107] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:14:39.911685  8907 raft_consensus.cc:2804] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:39.912011  5123 raft_consensus.cc:2889] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:39.912281  8902 raft_consensus.cc:2804] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:39.912667  8902 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:39.912990  8902 raft_consensus.cc:3060] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:39.908324  5838 raft_consensus.cc:1240] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:39.884845  8814 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:39.890884  5119 pending_rounds.cc:107] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:14:39.919550  5119 raft_consensus.cc:2889] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:39.897573  8871 consensus_queue.cc:1048] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:39.865482  8896 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:39.890022  5801 leader_election.cc:304] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:39.920710  5166 leader_election.cc:304] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:39.842480  8905 raft_consensus.cc:515] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:39.928435  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:39.890394  8729 raft_consensus.cc:3060] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:39.930583  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 111438us
I20260709 12:14:39.933514  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:39.935555  5838 raft_consensus.cc:1240] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:39.937345  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:39.919605  8436 raft_consensus.cc:3055] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:39.942036  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:39.942641  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:39.919382  8907 raft_consensus.cc:493] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:39.943709  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:39.940096  5833 raft_consensus.cc:2468] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 7.
W20260709 12:14:39.946075  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:39.942667  5830 raft_consensus.cc:2468] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 10.
I20260709 12:14:39.947772  5836 raft_consensus.cc:2410] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:14:39.929843  8910 raft_consensus.cc:2804] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:39.874594  8900 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:39.949530  5829 raft_consensus.cc:2468] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:14:39.931293  8712 raft_consensus.cc:2804] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:39.953051  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:39.955281  5801 leader_election.cc:304] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:39.956236  5801 leader_election.cc:304] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:39.959813  5801 leader_election.cc:304] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:14:39.946144  8436 raft_consensus.cc:740] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
W20260709 12:14:39.961472  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 158202us
I20260709 12:14:39.950589  8910 raft_consensus.cc:493] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:39.930115  8904 consensus_queue.cc:1048] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:14:39.931412  8869 consensus_queue.cc:1048] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:14:39.967796  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:39.947031  8907 raft_consensus.cc:3060] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:39.953810  8712 raft_consensus.cc:493] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:39.931900  8896 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:39.956641  8424 raft_consensus.cc:2749] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:39.949116  8871 consensus_queue.cc:1048] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 12:14:39.963824  8814 raft_consensus.cc:2804] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:40.007035  8814 raft_consensus.cc:493] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:40.007472  8814 raft_consensus.cc:3060] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:40.008675  8902 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:40.010694  5088 leader_election.cc:336] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 2.156s (SENT)
I20260709 12:14:40.011209  5088 leader_election.cc:304] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:40.012313  8662 raft_consensus.cc:2749] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:40.015338  8900 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:39.966117  8910 raft_consensus.cc:3060] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:40.016564  8902 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:39.985204  5829 raft_consensus.cc:1275] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:14:39.985776  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:40.019876  5834 raft_consensus.cc:1240] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:14:40.019981  5833 raft_consensus.cc:2468] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 9.
I20260709 12:14:39.986013  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:39.986563  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:39.987200  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:40.021350  5837 raft_consensus.cc:2410] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:14:40.020912  8436 consensus_queue.cc:260] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:39.989192  5237 leader_election.cc:304] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:40.025710  8883 raft_consensus.cc:515] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:40.027057  5237 leader_election.cc:304] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:40.027848  8883 leader_election.cc:290] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:40.028234  5237 leader_election.cc:304] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:40.028494  8883 raft_consensus.cc:2804] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:39.989418  8784 consensus_queue.cc:1048] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:14:40.029124  8784 consensus_queue.cc:1243] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer dd62e75bd3ed4ed28f1fb5955d650808 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:14:40.032424  8424 raft_consensus.cc:2804] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:40.032893  8424 raft_consensus.cc:493] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:40.033242  8424 raft_consensus.cc:3060] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:40.035451  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:40.036194  5274 raft_consensus.cc:3060] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:40.036845  5273 raft_consensus.cc:1275] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:14:40.021204  5838 raft_consensus.cc:2468] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 10.
I20260709 12:14:40.035574  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:40.038076  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:40.038273  5266 raft_consensus.cc:3060] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:40.038705  5267 raft_consensus.cc:3060] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:40.036312  5271 raft_consensus.cc:1240] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:39.990414  8905 leader_election.cc:290] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:39.965260  8790 raft_consensus.cc:2804] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:39.995340  8896 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:39.996791  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:39.997025  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:39.997929  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:39.998999  5197 raft_consensus.cc:2410] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:14:39.980020  8712 raft_consensus.cc:3060] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:39.975244  5240 leader_election.cc:304] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:39.989812  8915 consensus_queue.cc:1059] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:40.029654  8700 raft_consensus.cc:2749] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:40.030213  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:40.031545  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:40.022466  8436 raft_consensus.cc:3060] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:40.037562  5272 raft_consensus.cc:1275] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:14:40.052902  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:40.061915  5123 raft_consensus.cc:2468] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 11.
I20260709 12:14:40.065351  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:40.066308  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:40.067754  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:40.073325  5200 raft_consensus.cc:3060] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:40.048502  5831 raft_consensus.cc:2468] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 9.
I20260709 12:14:40.070696  5124 raft_consensus.cc:2393] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 8: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:40.073796  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:40.074473  5191 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 6.
I20260709 12:14:40.028898  8883 raft_consensus.cc:493] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:40.078080  5199 raft_consensus.cc:2393] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 11: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:40.078653  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:40.079499  5838 raft_consensus.cc:2393] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 8: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:40.082639  5832 raft_consensus.cc:2410] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:14:40.085762  5193 raft_consensus.cc:2393] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 8: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
W20260709 12:14:40.086320  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 119423us
I20260709 12:14:40.087059  5240 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:40.087973  5166 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:40.049110  8790 raft_consensus.cc:493] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:40.092576  5266 raft_consensus.cc:2468] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 10.
I20260709 12:14:40.085667  8902 raft_consensus.cc:3055] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:40.110392  8902 raft_consensus.cc:740] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:40.111357  8902 consensus_queue.cc:260] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:40.111218  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 151468us
I20260709 12:14:40.112758  8902 raft_consensus.cc:3060] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:40.116039  5801 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:40.087110  8910 raft_consensus.cc:515] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:40.122344  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:14:40.123059  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:40.094448  8900 raft_consensus.cc:2804] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:40.123623  5240 leader_election.cc:304] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:40.089639  8883 raft_consensus.cc:3060] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:40.094859  8790 raft_consensus.cc:3060] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:40.097743  8905 raft_consensus.cc:2749] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:40.126632  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:40.142249  5272 raft_consensus.cc:2393] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 8: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:40.138773  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:40.153187  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:40.154080  5830 raft_consensus.cc:2468] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 7.
I20260709 12:14:40.158171  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:40.167392  5195 raft_consensus.cc:2410] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:14:40.170338  5268 raft_consensus.cc:1275] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:14:40.153120  8700 raft_consensus.cc:2804] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:40.176884  8700 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:40.182680  8910 leader_election.cc:290] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:40.185680  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:40.186497  5124 raft_consensus.cc:3060] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:40.190380  8882 raft_consensus.cc:2749] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:40.194522  8922 log.cc:927] Time spent T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:14:40.196635  8907 raft_consensus.cc:515] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:40.198395  5163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:40.199951  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:40.137454  8900 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:40.201175  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:14:40.158473  8921 log.cc:927] Time spent T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:14:40.200640  5830 raft_consensus.cc:3060] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:40.216066  5274 raft_consensus.cc:2468] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 7.
W20260709 12:14:40.206645  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:40.201591  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:40.177253  8700 raft_consensus.cc:3060] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:40.210767  5832 raft_consensus.cc:1240] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260709 12:14:40.212298  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 55432.4us
I20260709 12:14:40.210665  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:40.220345  5838 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 9.
I20260709 12:14:40.204262  5124 raft_consensus.cc:2468] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 9.
I20260709 12:14:40.206153  5267 raft_consensus.cc:2468] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 11.
I20260709 12:14:40.221948  5195 raft_consensus.cc:1240] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:40.222810  5166 leader_election.cc:304] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:40.130673  8918 raft_consensus.cc:2749] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:40.228937  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:40.229624  5273 raft_consensus.cc:3060] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:40.231482  8919 log.cc:927] Time spent T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.054s	user 0.002s	sys 0.000s
I20260709 12:14:40.232857  8907 leader_election.cc:290] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:40.215021  8875 consensus_queue.cc:1059] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:14:40.234529  8582 raft_consensus.cc:3055] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:40.234931  8582 raft_consensus.cc:740] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:40.235836  5198 raft_consensus.cc:1275] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:14:40.236338  8881 raft_consensus.cc:2804] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:40.236876  8881 raft_consensus.cc:697] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:40.237977  8881 consensus_queue.cc:237] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:40.141008  8923 raft_consensus.cc:2804] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:40.217303  5240 leader_election.cc:304] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:40.244326  5200 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 10.
I20260709 12:14:40.250471  5273 raft_consensus.cc:2468] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 7.
I20260709 12:14:40.216058  8900 raft_consensus.cc:3060] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:40.253026  5088 leader_election.cc:304] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:40.267678  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:40.268385  5273 raft_consensus.cc:3060] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:40.267944  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
W20260709 12:14:40.270495  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 157079us
W20260709 12:14:40.274981  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 60576us
I20260709 12:14:40.248855  8923 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:40.271272  5268 raft_consensus.cc:2376] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 7. Re-sending same reply.
I20260709 12:14:40.274971  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:40.281572  5838 raft_consensus.cc:1240] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 8. Current term is 9. Ops: []
W20260709 12:14:40.284894  5801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:40.284749  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:40.285493  5200 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 6.
I20260709 12:14:40.268808  8243 raft_consensus.cc:2804] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:40.287192  5273 raft_consensus.cc:2468] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 8.
I20260709 12:14:40.291640  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:40.297766  5274 raft_consensus.cc:2393] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 11: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:40.278262  8738 raft_consensus.cc:515] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:40.293002  8712 raft_consensus.cc:515] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:40.293781  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:14:40.294813  8932 log.cc:927] Time spent T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:14:40.269745  8907 raft_consensus.cc:2749] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:40.295471  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:40.307129  5267 raft_consensus.cc:2468] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 9.
W20260709 12:14:40.308004  5801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:40.235792  8582 consensus_queue.cc:260] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:40.251226  8731 raft_consensus.cc:515] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:40.313531  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:40.258575  8875 consensus_queue.cc:1048] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:14:40.277617  8923 raft_consensus.cc:3060] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:40.326033  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:40.296396  8243 raft_consensus.cc:493] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:40.277204  8830 consensus_queue.cc:1059] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:14:40.331385  5838 raft_consensus.cc:1240] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:40.333587  5832 raft_consensus.cc:2393] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 8: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:40.334627  5267 raft_consensus.cc:1240] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 12:14:40.340059  5801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:40.341728  5836 raft_consensus.cc:2393] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 11: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:40.347764  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:14:40.352561  8924 log.cc:927] Time spent T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:14:40.353024  8731 leader_election.cc:290] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:40.353937  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:40.354247  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:40.355556  5200 raft_consensus.cc:3060] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:40.298776  8729 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:40.359930  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:40.360761  5265 raft_consensus.cc:2393] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 10: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:40.333912  8243 raft_consensus.cc:3060] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:40.379663  8940 consensus_queue.cc:1059] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 12:14:40.354610  8424 raft_consensus.cc:515] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:40.309456  8814 raft_consensus.cc:515] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:40.348125  8582 raft_consensus.cc:3060] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:40.382958  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:40.386983  5835 raft_consensus.cc:2393] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 10: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:40.396319  5240 leader_election.cc:304] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:40.398468  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:40.400695  5837 raft_consensus.cc:2468] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 7.
I20260709 12:14:40.398813  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:40.404094  5265 raft_consensus.cc:3060] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:40.394682  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:40.381194  8915 consensus_queue.cc:1048] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:14:40.381094  8436 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:40.413731  8361 raft_consensus.cc:3060] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:40.407910  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
W20260709 12:14:40.408435  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:40.331873  8918 consensus_queue.cc:1048] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 12:14:40.408607  5838 raft_consensus.cc:2393] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 9: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:40.359517  8662 consensus_queue.cc:1059] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:14:40.407908  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:40.418913  5829 raft_consensus.cc:2468] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 11.
I20260709 12:14:40.426684  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:40.427912  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:40.429010  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:40.427357  5120 raft_consensus.cc:2468] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 7.
I20260709 12:14:40.431361  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:40.435673  5119 raft_consensus.cc:2393] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 9: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:40.436717  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:40.437292  5198 raft_consensus.cc:3060] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:40.401991  8784 consensus_queue.cc:1059] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:14:40.442655  5117 raft_consensus.cc:1275] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:14:40.407302  8790 raft_consensus.cc:515] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:40.447445  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 64424.2us
I20260709 12:14:40.447970  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:40.449486  5266 raft_consensus.cc:1240] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:40.451663  5834 raft_consensus.cc:1275] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:14:40.453084  5240 leader_election.cc:304] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:40.451488  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:40.456655  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:40.457819  5089 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:40.451982  5834 pending_rounds.cc:85] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088: Aborting all ops after (but not including) 6
I20260709 12:14:40.459563  5834 pending_rounds.cc:107] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:14:40.459743  5834 raft_consensus.cc:2889] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:40.461179  5272 raft_consensus.cc:2393] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 6: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:40.417053  8930 consensus_queue.cc:1048] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.155s
I20260709 12:14:40.461784  5200 raft_consensus.cc:2468] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 7.
I20260709 12:14:40.463938  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:40.467804  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:40.468892  5125 raft_consensus.cc:2468] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 7.
I20260709 12:14:40.470095  5266 pending_rounds.cc:85] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929: Aborting all ops after (but not including) 9
I20260709 12:14:40.470419  5266 pending_rounds.cc:107] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 12:14:40.470664  5266 raft_consensus.cc:2889] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:40.473964  8942 raft_consensus.cc:3055] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:40.474509  8942 raft_consensus.cc:740] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:40.475339  8942 consensus_queue.cc:260] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:40.476701  8942 raft_consensus.cc:3060] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:40.466495  5801 leader_election.cc:304] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:40.425719  8436 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:40.485016  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:40.486030  5089 leader_election.cc:304] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:14:40.488795  5804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:40.497535  5265 raft_consensus.cc:2468] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 9.
I20260709 12:14:40.501878  5164 leader_election.cc:304] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:40.504431  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:40.506494  5265 raft_consensus.cc:1240] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:40.453925  8510 consensus_queue.cc:1048] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 12:14:40.509316  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:40.513510  5272 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 6.
I20260709 12:14:40.511417  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:40.514324  5265 raft_consensus.cc:2376] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 10. Re-sending same reply.
I20260709 12:14:40.489539  8731 raft_consensus.cc:2804] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:40.530936  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:40.513041  8712 leader_election.cc:290] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:40.517874  8886 raft_consensus.cc:2804] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:40.551892  8886 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:40.552415  8886 raft_consensus.cc:3060] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:40.519939  8881 raft_consensus.cc:3060] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:40.534667  5164 leader_election.cc:304] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:40.538769  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:40.526007  8729 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:40.513022  8910 consensus_queue.cc:1059] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
W20260709 12:14:40.552875  8937 log.cc:927] Time spent T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 12:14:40.549535  5270 raft_consensus.cc:1240] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 8. Current term is 10. Ops: []
I20260709 12:14:40.562084  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:40.525317  8915 raft_consensus.cc:2749] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:40.553735  5830 raft_consensus.cc:2468] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 9.
I20260709 12:14:40.554425  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
W20260709 12:14:40.558990  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 73008.4us
I20260709 12:14:40.559737  5272 raft_consensus.cc:2376] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 7. Re-sending same reply.
I20260709 12:14:40.572876  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:40.551767  8830 raft_consensus.cc:3055] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:14:40.590091  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 137094us
I20260709 12:14:40.589936  5089 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:40.591925  5240 leader_election.cc:304] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:40.568353  5125 raft_consensus.cc:2468] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 11.
I20260709 12:14:40.606748  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:40.596942  8869 raft_consensus.cc:3055] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:14:40.587621  8814 leader_election.cc:290] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:40.598012  8830 raft_consensus.cc:740] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:40.600473  8731 raft_consensus.cc:697] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 7 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:40.619563  5240 leader_election.cc:304] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:40.621132  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:40.622510  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:40.618430  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:40.602249  8871 raft_consensus.cc:2749] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:40.625613  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:40.563650  8700 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:40.629029  5116 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 7.
I20260709 12:14:40.629261  5265 raft_consensus.cc:2393] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 11: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:40.630134  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:40.630342  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:40.631318  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:40.631721  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:40.632520  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:40.634690  5089 leader_election.cc:304] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
W20260709 12:14:40.634770  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 141904us
I20260709 12:14:40.632524  5265 raft_consensus.cc:2368] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 9. Current term is 10.
I20260709 12:14:40.633196  5116 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 7.
I20260709 12:14:40.618913  8790 leader_election.cc:290] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:40.639660  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:40.640904  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:14:40.642406  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 107784us
I20260709 12:14:40.644716  5265 raft_consensus.cc:2468] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 7.
I20260709 12:14:40.644944  5164 leader_election.cc:304] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:40.645419  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:40.619364  8869 raft_consensus.cc:740] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:40.647783  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:40.647840  5267 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 7.
I20260709 12:14:40.649619  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:40.650480  5123 raft_consensus.cc:2393] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 9: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:40.646806  5089 leader_election.cc:304] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:40.650221  5116 raft_consensus.cc:2468] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 10.
I20260709 12:14:40.651814  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:40.654117  5265 raft_consensus.cc:2376] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 11. Re-sending same reply.
I20260709 12:14:40.654218  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:40.656978  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:40.660369  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:40.661985  5089 leader_election.cc:304] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
W20260709 12:14:40.651376  8902 consensus_meta.cc:287] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.535s	user 0.005s	sys 0.006s
I20260709 12:14:40.663506  8731 consensus_queue.cc:237] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:40.651515  8961 raft_consensus.cc:2749] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:40.669389  8951 consensus_queue.cc:1059] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 12:14:40.669139  5801 leader_election.cc:304] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:40.671144  8944 raft_consensus.cc:2749] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:40.663512  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:40.665117  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:40.691320  5193 raft_consensus.cc:1275] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:14:40.668285  5237 leader_election.cc:304] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:40.692550  5267 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 9.
I20260709 12:14:40.663789  8871 consensus_queue.cc:1059] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:14:40.664582  8953 log.cc:927] Time spent T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 12:14:40.651254  8784 raft_consensus.cc:2764] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:14:40.666543  5265 raft_consensus.cc:1275] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:14:40.664418  8962 raft_consensus.cc:2749] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:40.692279  5272 raft_consensus.cc:2468] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:14:40.691222  5120 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 9.
I20260709 12:14:40.693652  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:40.695081  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:40.696381  5163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:40.698028  5270 raft_consensus.cc:1275] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:14:40.698482  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:40.669023  8436 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:40.705947  8941 log.cc:927] Time spent T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260709 12:14:40.671882  8662 raft_consensus.cc:2804] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:40.706672  8662 raft_consensus.cc:493] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:40.707029  8662 raft_consensus.cc:3060] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:40.707243  8950 log.cc:927] Time spent T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 12:14:40.710031  8871 raft_consensus.cc:3055] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:40.710541  8871 raft_consensus.cc:740] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:40.711407  8871 consensus_queue.cc:260] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:40.712677  8871 raft_consensus.cc:3060] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:40.713214  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:40.692409  8790 raft_consensus.cc:3060] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:40.713680  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:40.697181  8869 consensus_queue.cc:260] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:40.717844  8869 raft_consensus.cc:3060] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:40.706182  8957 raft_consensus.cc:2804] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:40.747246  5265 raft_consensus.cc:1275] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:14:40.750592  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 45289.7us
W20260709 12:14:40.750887  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 88990.4us
W20260709 12:14:40.751600  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 98964.3us
I20260709 12:14:40.752174  5164 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:40.753815  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:40.756081  5270 raft_consensus.cc:1275] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:14:40.705825  8938 log.cc:927] Time spent T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.223s	user 0.000s	sys 0.001s
I20260709 12:14:40.741230  8957 raft_consensus.cc:493] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:40.758057  8975 raft_consensus.cc:2749] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:40.689852  8910 consensus_queue.cc:1059] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 12:14:40.759227  5164 leader_election.cc:304] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:40.656694  8830 consensus_queue.cc:260] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:40.762619  5268 raft_consensus.cc:2468] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 7.
I20260709 12:14:40.764132  5804 leader_election.cc:304] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:40.764307  5801 leader_election.cc:304] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:40.741839  8898 raft_consensus.cc:2804] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:40.769754  8954 consensus_queue.cc:1048] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:14:40.758680  8796 consensus_queue.cc:1059] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 12:14:40.772967  8738 leader_election.cc:290] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:40.738618  8961 raft_consensus.cc:2804] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:40.789866  5270 raft_consensus.cc:1240] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:40.791201  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:40.790499  5089 leader_election.cc:304] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:40.796332  5089 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:40.777012  8424 leader_election.cc:290] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:40.797554  8944 raft_consensus.cc:2804] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:40.797998  8944 raft_consensus.cc:493] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:40.798367  8944 raft_consensus.cc:3060] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:40.798580  5089 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:40.796384  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:40.741573  8582 consensus_queue.cc:1048] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:14:40.802064  5267 raft_consensus.cc:1275] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:14:40.775094  8361 raft_consensus.cc:2749] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:40.761648  8957 raft_consensus.cc:3060] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:14:40.816946  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 52722.9us
W20260709 12:14:40.824255  5088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:40.893832  5801 leader_election.cc:304] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:14:40.895918  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 104593us
I20260709 12:14:40.899937  5198 raft_consensus.cc:2468] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 8.
I20260709 12:14:40.800033  5265 raft_consensus.cc:2468] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 8.
I20260709 12:14:40.904093  5801 leader_election.cc:304] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:40.905637  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:14:40.912830  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 148716us
I20260709 12:14:40.920822  5804 leader_election.cc:304] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:14:40.921816  5274 raft_consensus.cc:1240] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 9. Current term is 10. Ops: [5.5-9.6]
I20260709 12:14:40.801992  8814 raft_consensus.cc:2749] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:40.802685  8961 raft_consensus.cc:493] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:40.926584  5801 leader_election.cc:304] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:40.891886  8436 raft_consensus.cc:2749] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:40.956089  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:40.905093  8830 raft_consensus.cc:3060] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:40.989668  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:40.992386  8960 raft_consensus.cc:2749] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:40.996114  8966 raft_consensus.cc:2804] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:40.996680  8966 raft_consensus.cc:493] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:40.997061  8966 raft_consensus.cc:3060] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:41.002507  8970 log.cc:927] Time spent T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.197s	user 0.000s	sys 0.000s
W20260709 12:14:41.003549  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 78229.9us
I20260709 12:14:41.004369  5801 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:41.005563  8882 raft_consensus.cc:2749] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:14:41.009922  8243 consensus_meta.cc:287] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.625s	user 0.010s	sys 0.000s
I20260709 12:14:41.010430  8243 raft_consensus.cc:515] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:41.012792  8243 leader_election.cc:290] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:40.958340  8881 raft_consensus.cc:2749] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:41.013561  8886 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:41.005625  8814 raft_consensus.cc:2804] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:14:41.014499  5801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:41.014716  8814 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:41.015105  8814 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:41.015482  8882 raft_consensus.cc:493] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.017416  5117 raft_consensus.cc:2468] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 9.
I20260709 12:14:40.990383  5265 raft_consensus.cc:2376] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 7. Re-sending same reply.
W20260709 12:14:41.019430  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 197800us
I20260709 12:14:41.031414  5123 raft_consensus.cc:2368] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 10. Current term is 11.
I20260709 12:14:40.927659  8731 raft_consensus.cc:2749] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:14:41.033584  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 112859us
I20260709 12:14:40.923847  8738 raft_consensus.cc:2804] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:40.927935  8951 raft_consensus.cc:2749] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:41.036698  8972 raft_consensus.cc:2804] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:40.955597  8961 raft_consensus.cc:3060] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:41.015985  8886 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:41.073676  8963 raft_consensus.cc:493] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.078395  8969 raft_consensus.cc:3055] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:41.081130  8911 raft_consensus.cc:3055] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:14:41.123713  8871 raft_consensus.cc:493] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:41.083243  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:41.083962  8974 raft_consensus.cc:493] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:41.084964  8883 consensus_meta.cc:287] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.941s	user 0.012s	sys 0.000s
I20260709 12:14:41.081878  8662 raft_consensus.cc:515] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:41.089010  8790 raft_consensus.cc:2749] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:41.089762  5120 raft_consensus.cc:1275] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:14:41.099781  8898 raft_consensus.cc:493] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:41.100586  8875 raft_consensus.cc:3055] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:14:41.101925  8942 consensus_meta.cc:287] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.625s	user 0.014s	sys 0.001s
W20260709 12:14:41.103152  8964 log.cc:927] Time spent T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.408s	user 0.004s	sys 0.015s
W20260709 12:14:41.108212  5165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:41.223489  5835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46094 (request call id 958) took 1195 ms. Trace:
I20260709 12:14:41.224013  5835 rpcz_store.cc:276] 0709 12:14:39.939880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.942438 (+  2558us) service_pool.cc:224] Handling call
0709 12:14:41.135281 (+1192843us) spinlock_profiling.cc:243] Waited 431 ms on lock 0x7b5400700154. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:41.135455 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":990354176}
I20260709 12:14:41.225623  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
W20260709 12:14:41.109793  8900 consensus_meta.cc:287] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.839s	user 0.013s	sys 0.000s
I20260709 12:14:41.124836  8969 raft_consensus.cc:740] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:41.111172  5801 leader_election.cc:304] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:41.111933  8436 raft_consensus.cc:493] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.112613  8881 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:41.113857  8738 raft_consensus.cc:697] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 9 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
W20260709 12:14:41.239637  5091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:41.240365  8738 consensus_queue.cc:237] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:41.134003  8883 raft_consensus.cc:515] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:41.081995  5267 raft_consensus.cc:1240] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:41.246435  8662 leader_election.cc:290] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:41.125571  8911 raft_consensus.cc:740] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:41.135234  8875 raft_consensus.cc:740] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:41.247584  8911 consensus_queue.cc:260] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:41.247792  8875 consensus_queue.cc:260] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:41.082484  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:41.015952  8882 raft_consensus.cc:515] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:41.115628  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 217304us
I20260709 12:14:41.246757  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:41.250471  5273 raft_consensus.cc:2393] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 8: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
W20260709 12:14:41.128856  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 60147.5us
I20260709 12:14:41.070171  8972 raft_consensus.cc:493] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:41.135605  5265 raft_consensus.cc:1240] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 5. Current term is 6. Ops: []
I20260709 12:14:41.226244  5193 raft_consensus.cc:3060] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:41.032615  8904 consensus_queue.cc:1048] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 12:14:41.131166  8871 raft_consensus.cc:515] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:41.233237  5118 raft_consensus.cc:2468] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 8.
W20260709 12:14:41.234807  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 123743us
W20260709 12:14:41.238018  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 104785us
W20260709 12:14:41.231016  8923 consensus_meta.cc:287] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.893s	user 0.011s	sys 0.000s
I20260709 12:14:41.237650  8790 raft_consensus.cc:2804] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:41.126040  8963 raft_consensus.cc:515] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:41.126942  5268 raft_consensus.cc:2468] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 10.
W20260709 12:14:41.130013  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 331467us
W20260709 12:14:41.253276  5163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:41.249061  8911 raft_consensus.cc:3060] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:41.232090  5116 raft_consensus.cc:1240] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:14:41.261109  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:41.249114  8875 raft_consensus.cc:3060] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:41.238256  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:41.272018  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:14:41.265583  5164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:41.249414  8436 raft_consensus.cc:515] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:41.274619  8977 log.cc:927] Time spent T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 12:14:41.274909  5835 raft_consensus.cc:1275] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:14:41.135349  8898 raft_consensus.cc:3060] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:41.234702  8900 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:41.256883  8972 raft_consensus.cc:3060] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:41.314409  5193 raft_consensus.cc:2468] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 11.
I20260709 12:14:41.132905  8974 raft_consensus.cc:515] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:41.274688  5265 raft_consensus.cc:1240] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:14:41.254755  8881 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:41.315546  8940 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.837s	user 0.007s	sys 0.022s
I20260709 12:14:41.341014  5270 raft_consensus.cc:2468] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 9.
I20260709 12:14:41.343935  5198 raft_consensus.cc:1240] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:41.340090  5267 raft_consensus.cc:2468] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 8.
I20260709 12:14:41.346599  5195 pending_rounds.cc:85] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808: Aborting all ops after (but not including) 8
I20260709 12:14:41.314244  8883 leader_election.cc:290] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:41.358242  8940 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.880s	user 0.007s	sys 0.022s
I20260709 12:14:41.359681  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:14:41.360298  8869 consensus_meta.cc:287] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.642s	user 0.007s	sys 0.001s
W20260709 12:14:41.355511  5196 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.011s	sys 0.011s
I20260709 12:14:41.357818  5195 pending_rounds.cc:107] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:14:41.360922  5195 raft_consensus.cc:2889] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:41.360423  5267 raft_consensus.cc:2393] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 11: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
W20260709 12:14:41.364537  5196 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.011s	sys 0.011s
W20260709 12:14:41.367816  8979 log.cc:927] Time spent T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:14:41.275415  8923 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:41.356654  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:41.378995  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:41.342319  8912 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
W20260709 12:14:41.391180  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:41.391837  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:41.368608  8900 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:41.398317  5124 raft_consensus.cc:1240] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:41.401206  5831 raft_consensus.cc:2393] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 12: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:41.404891  5829 raft_consensus.cc:1275] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:14:41.406679  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:41.410029  5837 raft_consensus.cc:1240] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 9 LEADER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:41.411010  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:41.413712  5836 raft_consensus.cc:1240] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:41.409355  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:41.422824  5838 raft_consensus.cc:3060] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:41.425019  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:41.425745  5117 raft_consensus.cc:3060] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:41.427026  5125 raft_consensus.cc:1275] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:14:41.429622  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:41.430261  5830 raft_consensus.cc:3060] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:41.396965  8790 raft_consensus.cc:697] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 8 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:41.316210  8969 consensus_queue.cc:260] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:41.401670  8912 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:41.443202  8963 leader_election.cc:290] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:41.443581  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:41.444253  8436 leader_election.cc:290] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:41.444103  8982 consensus_queue.cc:1048] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:14:41.444716  8985 raft_consensus.cc:493] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.476935  5117 raft_consensus.cc:2468] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 12.
I20260709 12:14:41.462523  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:41.455605  8881 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:41.457274  8972 raft_consensus.cc:515] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:41.459089  5838 raft_consensus.cc:2468] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 11.
I20260709 12:14:41.456967  8898 raft_consensus.cc:515] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:41.486112  5833 raft_consensus.cc:2393] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 8: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:41.486948  8898 leader_election.cc:290] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:41.459930  5268 raft_consensus.cc:2468] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:14:41.488426  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:41.489056  5268 raft_consensus.cc:2468] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 10.
I20260709 12:14:41.489907  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:41.490623  5268 raft_consensus.cc:2393] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 11: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:41.491343  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
W20260709 12:14:41.492019  8973 log.cc:927] Time spent T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.370s	user 0.001s	sys 0.000s
I20260709 12:14:41.492386  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:41.462137  5830 raft_consensus.cc:2468] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 12.
I20260709 12:14:41.465101  8912 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:41.466390  8923 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:41.467954  8790 consensus_queue.cc:237] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:41.493433  5268 raft_consensus.cc:2376] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6. Re-sending same reply.
I20260709 12:14:41.494390  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:41.470993  5267 raft_consensus.cc:2468] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 7.
I20260709 12:14:41.462138  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:41.496894  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:41.497045  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:41.497756  5270 raft_consensus.cc:2368] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 9. Current term is 10.
I20260709 12:14:41.498494  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:41.499442  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:41.499935  5270 raft_consensus.cc:2468] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 8.
I20260709 12:14:41.500348  5274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34672 (request call id 2055) took 1066 ms. Trace:
I20260709 12:14:41.500686  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:41.480798  5265 raft_consensus.cc:2468] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 9.
I20260709 12:14:41.483820  8985 raft_consensus.cc:515] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:41.486790  8972 leader_election.cc:290] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:41.500718  5274 rpcz_store.cc:276] 0709 12:14:40.433652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.437966 (+  4314us) service_pool.cc:224] Handling call
0709 12:14:40.445728 (+  7762us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:40.922289 (+476561us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:41.500090 (+577801us) spinlock_profiling.cc:243] Waited 476 ms on lock 0x7b54003b01d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:41.500267 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1094283520}
I20260709 12:14:41.511235  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:41.511548  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
W20260709 12:14:41.542567  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 131083us
I20260709 12:14:41.512295  5199 raft_consensus.cc:1275] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:41.529441  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:14:41.544749  5163 leader_election.cc:336] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 2.045s (SENT)
I20260709 12:14:41.544909  5268 raft_consensus.cc:2468] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 7.
I20260709 12:14:41.535362  5831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46100 (request call id 1039) took 1334 ms. Trace:
I20260709 12:14:41.546556  5831 rpcz_store.cc:276] 0709 12:14:40.200481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.200897 (+   416us) service_pool.cc:224] Handling call
0709 12:14:41.535154 (+1334257us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b5400655ed4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:41.535299 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2729952640}
I20260709 12:14:41.511019  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:41.461357  8944 consensus_meta.cc:287] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.663s	user 0.007s	sys 0.000s
I20260709 12:14:41.545236  5163 leader_election.cc:304] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:41.550705  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:41.551097  8907 raft_consensus.cc:3055] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:41.501333  8961 raft_consensus.cc:515] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:41.505586  8968 consensus_queue.cc:1048] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 12:14:41.553689  8881 consensus_queue.cc:1059] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:14:41.555667  8904 consensus_queue.cc:1048] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:41.556591  5166 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:41.558238  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:41.560109  5266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50932 (request call id 718) took 1105 ms. Trace:
I20260709 12:14:41.561007  8923 consensus_queue.cc:1048] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:41.561831  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
W20260709 12:14:41.533854  8945 log.cc:927] Time spent T 00000000000000000000000000000000 P 221aa011207d421b9725197ff8bed389: Append to log took a long time: real 1.034s	user 0.022s	sys 0.006s
I20260709 12:14:41.534893  5269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50932 (request call id 719) took 1048 ms. Trace:
I20260709 12:14:41.504930  8871 leader_election.cc:290] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:41.548166  5191 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 8.
I20260709 12:14:41.563612  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:41.508641  8814 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:41.522675  8974 leader_election.cc:290] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:41.533038  8985 leader_election.cc:290] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:41.505246  8882 leader_election.cc:290] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:14:41.740602  5164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:41.731247  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
W20260709 12:14:41.743216  8987 log.cc:927] Time spent T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.400s	user 0.001s	sys 0.006s
I20260709 12:14:41.587189  8900 raft_consensus.cc:2749] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:14:41.744340  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 199608us
W20260709 12:14:41.746493  5163 leader_election.cc:336] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 2.247s (SENT)
I20260709 12:14:41.747008  5163 leader_election.cc:304] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:41.747814  8869 raft_consensus.cc:493] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:41.671028  5091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:41.748977  5091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:41.741456  5123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59390 (request call id 702) took 1191 ms. Trace:
I20260709 12:14:41.741775  5197 raft_consensus.cc:2410] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:14:41.740880  5118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40402 (request call id 2278) took 1284 ms. Trace:
W20260709 12:14:41.749868  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 1.08156e+06us
I20260709 12:14:41.751300  5118 rpcz_store.cc:276] 0709 12:14:40.460865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.622251 (+161386us) service_pool.cc:224] Handling call
0709 12:14:41.740673 (+1118422us) spinlock_profiling.cc:243] Waited 609 ms on lock 0x7b54003444d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:41.740784 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1400743296}
I20260709 12:14:41.749792  5123 rpcz_store.cc:276] 0709 12:14:40.550033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.656696 (+106663us) service_pool.cc:224] Handling call
0709 12:14:41.741249 (+1084553us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b540038c2d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:41.741372 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":825254272}
I20260709 12:14:41.740175  5116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40402 (request call id 2277) took 1286 ms. Trace:
I20260709 12:14:41.753108  5116 rpcz_store.cc:276] 0709 12:14:40.455660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.714222 (+258562us) service_pool.cc:224] Handling call
0709 12:14:40.714529 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:41.340815 (+626286us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:41.739843 (+399028us) spinlock_profiling.cc:243] Waited 516 ms on lock 0x7b540024ac54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:41.740100 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1187025152}
I20260709 12:14:41.738286  8700 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:41.587697  8944 raft_consensus.cc:515] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:41.504272  8966 consensus_meta.cc:287] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.507s	user 0.005s	sys 0.005s
I20260709 12:14:41.755409  8875 consensus_queue.cc:1048] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:14:41.755995  8966 raft_consensus.cc:515] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:41.689553  8947 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.757815  5273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34672 (request call id 2052) took 1407 ms. Trace:
W20260709 12:14:41.660194  8996 log.cc:927] Time spent T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 12:14:41.758258  5273 rpcz_store.cc:276] 0709 12:14:40.350214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.361746 (+ 11532us) service_pool.cc:224] Handling call
0709 12:14:41.757593 (+1395847us) spinlock_profiling.cc:243] Waited 855 ms on lock 0x7b54000d3c54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:41.757735 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1967195520}
I20260709 12:14:41.759457  8944 leader_election.cc:290] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:41.759277  8975 consensus_queue.cc:1059] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:14:41.566416  8957 consensus_meta.cc:287] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.644s	user 0.007s	sys 0.003s
I20260709 12:14:41.760232  8975 consensus_queue.cc:1243] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer bce73265e27d4b30a4dcc1e491305088 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:14:41.761255  8900 raft_consensus.cc:2749] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:41.750809  5089 leader_election.cc:304] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:41.760605  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:41.741905  5266 rpcz_store.cc:276] 0709 12:14:40.454608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.454749 (+   141us) service_pool.cc:224] Handling call
0709 12:14:40.469872 (+ 15123us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:40.521125 (+ 51253us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:40.521155 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:40.521731 (+   576us) log.cc:844] Serialized 52 byte log entry
0709 12:14:41.232086 (+710355us) spinlock_profiling.cc:243] Waited 926 us on lock 0x7b18002d8da0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e676b4bc 00007f84e3ab948b 00007f84ec9139a9 00007f84e3ad569b 00007f84e3ad393f 00007f84e3ad5c02 00007f84e675d20b 00007f84e6762d23 00007f84e67630d1
0709 12:14:41.232260 (+   174us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:14:41.342638 (+110378us) log.cc:844] Serialized 14 byte log entry
0709 12:14:41.559714 (+217076us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:41.559788 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:41.559829 (+    41us) raft_consensus.cc:1685] finished
0709 12:14:41.559929 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:41.560053 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":238739,"prepare.queue_time_us":125575,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":288176,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":26885,"spinlock_wait_cycles":2130304,"thread_start_us":175607,"threads_started":2,"wal-append.queue_time_us":164547}
I20260709 12:14:41.604615  5240 leader_election.cc:304] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:41.749143  5274 raft_consensus.cc:2468] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 10.
W20260709 12:14:41.766872  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 162342us
W20260709 12:14:41.771261  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:41.772082  5198 raft_consensus.cc:2468] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 8.
W20260709 12:14:41.764318  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 207919us
W20260709 12:14:41.628032  5165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:41.773761  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:41.588055  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:41.775892  5804 leader_election.cc:304] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:41.778865  5240 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:41.780224  5240 leader_election.cc:304] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:41.783511  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:41.783300  5801 leader_election.cc:304] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
W20260709 12:14:41.785303  5088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:41.783298  8700 raft_consensus.cc:2804] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:41.799021  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:41.799750  5166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:41.799983  5123 raft_consensus.cc:2393] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 9: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:41.760747  8957 raft_consensus.cc:515] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:41.765924  8923 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.804795  5088 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:41.771711  8969 raft_consensus.cc:3060] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:41.770099  5269 rpcz_store.cc:276] 0709 12:14:40.486641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.524146 (+ 37505us) service_pool.cc:224] Handling call
0709 12:14:40.539839 (+ 15693us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:40.559016 (+ 19177us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:14:40.604451 (+ 45435us) log.cc:844] Serialized 14 byte log entry
0709 12:14:41.534405 (+929954us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:41.534460 (+    55us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:41.534503 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:41.534575 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:41.534719 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":877523,"prepare.queue_time_us":34688,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":2653,"raft.queue_time_us":862964,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":87,"thread_start_us":27131,"threads_started":1,"wal-append.queue_time_us":94748,"wal-append.run_cpu_time_us":1262,"wal-append.run_wall_time_us":1001285}
I20260709 12:14:41.776299  8910 raft_consensus.cc:2804] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:14:41.755393  8886 consensus_queue.cc:1059] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:14:41.748335  8869 raft_consensus.cc:515] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:41.783840  8985 raft_consensus.cc:2804] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:41.818038  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:41.818883  5268 raft_consensus.cc:2468] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 9.
I20260709 12:14:41.797315  8918 raft_consensus.cc:2804] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:41.769649  8907 raft_consensus.cc:740] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:41.595775  8361 raft_consensus.cc:493] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
W20260709 12:14:41.816797  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:41.784871  8972 raft_consensus.cc:493] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.809549  5271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34672 (request call id 2054) took 1391 ms. Trace:
I20260709 12:14:41.807727  8882 raft_consensus.cc:2749] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:41.807559  8963 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
W20260709 12:14:41.822878  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 47054.1us
I20260709 12:14:41.757992  8947 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:41.824074  5122 raft_consensus.cc:1240] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:14:41.811375  8881 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.807089  8700 raft_consensus.cc:697] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 11 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
W20260709 12:14:41.828645  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:41.803121  8966 leader_election.cc:290] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:41.859316  5268 raft_consensus.cc:1240] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:41.854247  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
W20260709 12:14:41.868741  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 109705us
I20260709 12:14:41.851519  5274 raft_consensus.cc:1240] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 7. Current term is 8. Ops: []
W20260709 12:14:41.863240  5801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:41.853876  5270 raft_consensus.cc:1240] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:41.857961  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:41.853561  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:41.853039  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:14:41.865015  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 112754us
I20260709 12:14:41.874549  5266 raft_consensus.cc:2468] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 11.
I20260709 12:14:41.874666  5237 leader_election.cc:304] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:14:41.842280  5163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:41.829737  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 49583.8us
I20260709 12:14:41.876235  5804 leader_election.cc:304] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:41.876526  5240 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:14:41.862893  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 46265.4us
I20260709 12:14:41.826205  5271 rpcz_store.cc:276] 0709 12:14:40.418125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.424049 (+  5924us) service_pool.cc:224] Handling call
0709 12:14:40.437012 (+ 12963us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:40.441532 (+  4520us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:14:40.482837 (+ 41305us) log.cc:844] Serialized 14 byte log entry
0709 12:14:41.534705 (+1051868us) log.cc:844] Serialized 14 byte log entry
0709 12:14:41.807577 (+272872us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:41.807627 (+    50us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:14:41.807668 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:41.807736 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:41.809490 (+  1754us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":856860,"prepare.queue_time_us":33240,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":854365,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":175,"spinlock_wait_cycles":25366272,"thread_start_us":449125,"threads_started":2,"wal-append.queue_time_us":242321}
I20260709 12:14:41.853935  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:41.882727  5273 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 9.
W20260709 12:14:41.886413  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:41.822902  8424 raft_consensus.cc:2804] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:41.894300  8424 raft_consensus.cc:493] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:41.820869  8875 raft_consensus.cc:2749] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:14:41.887862  8881 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:41.894977  8700 consensus_queue.cc:237] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:41.870959  8869 leader_election.cc:290] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:41.883117  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:41.894753  8424 raft_consensus.cc:3060] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:41.897642  5121 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
new_leader_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:45628
I20260709 12:14:41.898492  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:41.898718  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:41.899066  5124 raft_consensus.cc:3060] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:41.899267  5120 raft_consensus.cc:3060] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:41.898519  5237 leader_election.cc:304] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:41.900393  9002 consensus_queue.cc:1059] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:41.901576  9002 raft_consensus.cc:2749] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:41.902168  9002 raft_consensus.cc:3055] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:41.902484  9002 raft_consensus.cc:740] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:41.903896  8882 raft_consensus.cc:493] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.903656  8907 consensus_queue.cc:260] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:41.816231  8923 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:41.904400  8882 raft_consensus.cc:515] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:41.887732  8902 raft_consensus.cc:2749] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:41.825064  8886 consensus_queue.cc:1243] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer bce73265e27d4b30a4dcc1e491305088 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:14:41.903245  9002 consensus_queue.cc:260] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:41.881705  8963 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:41.907783  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:41.908463  9002 raft_consensus.cc:3060] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:41.908978  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:41.909998  8963 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:41.910540  8963 consensus_queue.cc:1048] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:41.910811  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:41.911415  5267 raft_consensus.cc:2468] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 10.
I20260709 12:14:41.911726  8796 raft_consensus.cc:3055] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:41.912125  8796 raft_consensus.cc:740] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:41.912348  5124 raft_consensus.cc:2410] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:14:41.912531  5125 raft_consensus.cc:1240] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:41.872056  8972 raft_consensus.cc:515] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:41.913039  8796 consensus_queue.cc:260] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:41.914143  8796 raft_consensus.cc:3060] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:41.914487  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:41.878630  8993 raft_consensus.cc:493] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.915313  8993 raft_consensus.cc:515] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:41.916438  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:41.916589  5197 raft_consensus.cc:1240] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:41.868913  8957 leader_election.cc:290] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:41.917930  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:41.821305  8918 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:41.918648  5191 raft_consensus.cc:2393] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 8: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:41.815449  8934 raft_consensus.cc:2804] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:41.919669  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:41.936985  5125 raft_consensus.cc:2393] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 8: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:41.813277  8956 raft_consensus.cc:3060] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:41.920562  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:41.821820  8952 raft_consensus.cc:493] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.910034  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:41.928663  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:41.906603  8882 leader_election.cc:290] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:41.919159  5121 raft_consensus.cc:606] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Received request to transfer leadership to TS 9e794b72ed7640219f90ec4232363929
I20260709 12:14:41.948786  5121 raft_consensus.cc:614] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:41.928596  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:41.929000  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:41.929177  5270 raft_consensus.cc:1275] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:14:41.929750  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 53584.4us
I20260709 12:14:41.951737  5804 leader_election.cc:304] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:41.930969  8947 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:41.912175  8933 raft_consensus.cc:2749] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:41.856707  8900 raft_consensus.cc:3055] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:41.933681  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:41.956884  5272 raft_consensus.cc:2468] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 7.
I20260709 12:14:41.934325  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:41.943849  8814 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:41.928921  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:41.862516  8985 raft_consensus.cc:697] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
W20260709 12:14:41.922209  5088 leader_election.cc:336] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 1.525s (SENT)
I20260709 12:14:41.829487  8361 raft_consensus.cc:515] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:41.937721  8918 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:41.926077  8993 leader_election.cc:290] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:41.942806  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 66334.4us
I20260709 12:14:41.943511  8905 raft_consensus.cc:2749] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:41.944005  8915 consensus_queue.cc:1059] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:41.969707  5240 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:41.945463  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:41.970541  5271 raft_consensus.cc:2468] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 7.
I20260709 12:14:41.914816  8972 leader_election.cc:290] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:41.897193  8881 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:41.976084  5121 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
new_leader_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:45628
I20260709 12:14:41.946931  5119 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 9.
I20260709 12:14:41.977506  5122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40402 (request call id 2283) took 1386 ms. Trace:
I20260709 12:14:41.977933  5122 rpcz_store.cc:276] 0709 12:14:40.591402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.928733 (+337331us) service_pool.cc:224] Handling call
0709 12:14:40.988361 (+ 59628us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:41.877476 (+889115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:41.977138 (+ 99662us) spinlock_profiling.cc:243] Waited 835 ms on lock 0x7b54002d2b54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:41.977354 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1921331968}
I20260709 12:14:41.978747  5119 raft_consensus.cc:1240] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:41.950973  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:41.945497  8961 leader_election.cc:290] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:41.953087  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:41.955108  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:41.970484  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:41.959784  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:41.982623  5274 raft_consensus.cc:2468] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 4.
I20260709 12:14:41.961187  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:41.986146  5116 raft_consensus.cc:2410] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:14:41.985312  5804 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:41.976841  5121 raft_consensus.cc:606] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Received request to transfer leadership to TS 9e794b72ed7640219f90ec4232363929
I20260709 12:14:41.989108  5121 raft_consensus.cc:614] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:41.935791  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:41.936528  8934 raft_consensus.cc:493] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:41.938572  8966 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:41.962806  5265 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 9.
I20260709 12:14:41.964499  5088 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:41.967043  8869 consensus_queue.cc:1048] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:41.967600  8985 consensus_queue.cc:237] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:41.944931  5237 leader_election.cc:304] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:41.995534  8510 raft_consensus.cc:3055] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:41.956485  8900 raft_consensus.cc:740] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:41.956734  8982 consensus_queue.cc:1059] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:14:42.003310  8907 raft_consensus.cc:3060] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:41.960341  8882 raft_consensus.cc:2749] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:42.005097  8905 raft_consensus.cc:2749] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:41.985258  5125 raft_consensus.cc:2468] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 10.
I20260709 12:14:42.007232  5120 raft_consensus.cc:2468] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 11.
I20260709 12:14:42.005785  8912 raft_consensus.cc:493] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:42.053174  5166 leader_election.cc:304] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
W20260709 12:14:42.012385  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 90199.2us
W20260709 12:14:42.054256  5088 leader_election.cc:336] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 1.579s (SENT)
W20260709 12:14:42.022809  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 77980.1us
I20260709 12:14:42.053812  5804 leader_election.cc:304] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:42.055955  5088 leader_election.cc:304] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:42.010056  5121 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
new_leader_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:45628
I20260709 12:14:42.007827  8934 raft_consensus.cc:3060] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:42.058568  5121 raft_consensus.cc:606] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Received request to transfer leadership to TS 9e794b72ed7640219f90ec4232363929
I20260709 12:14:42.075907  5121 raft_consensus.cc:614] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:41.998927  8361 leader_election.cc:290] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:42.020533  8814 raft_consensus.cc:2749] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:41.955727  8952 raft_consensus.cc:515] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:42.080940  5198 raft_consensus.cc:1240] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:42.082012  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:42.090056  5801 leader_election.cc:304] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:42.033077  8915 raft_consensus.cc:2749] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:42.091427  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:42.010993  8911 raft_consensus.cc:2749] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:14:42.095180  5238 connection.cc:256] RPC call timeout handler was delayed by -3.0967568700000356s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15610000000000002s for a response
I20260709 12:14:42.023200  8510 raft_consensus.cc:740] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:42.107862  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:42.102926  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:42.110751  5191 raft_consensus.cc:2468] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 10.
W20260709 12:14:42.101450  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 66922us
W20260709 12:14:42.103214  5238 connection.cc:256] RPC call timeout handler was delayed by -2.8753568700001324s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1807s for a response
W20260709 12:14:42.111752  5238 connection.cc:256] RPC call timeout handler was delayed by -2.4280568700000913s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2304s for a response
I20260709 12:14:42.108359  5163 leader_election.cc:304] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
W20260709 12:14:42.114383  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 147643us
I20260709 12:14:42.119339  5238 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:42.120496  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:42.122551  5801 leader_election.cc:304] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:42.123565  5801 leader_election.cc:304] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:42.124452  5801 leader_election.cc:304] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:42.125931  5194 raft_consensus.cc:2393] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 10: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:42.126492  5124 raft_consensus.cc:2468] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 8.
I20260709 12:14:42.126905  5801 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:42.098170  8983 raft_consensus.cc:2804] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:42.088313  8961 raft_consensus.cc:2749] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:42.019994  8966 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:42.073863  8910 raft_consensus.cc:697] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:42.049331  8898 consensus_queue.cc:1059] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 12:14:42.097910  8882 raft_consensus.cc:2749] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:42.140069  5200 raft_consensus.cc:2468] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 11.
I20260709 12:14:42.096472  8902 raft_consensus.cc:493] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:42.145598  5238 leader_election.cc:304] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:42.103696  8923 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:42.096836  8975 consensus_queue.cc:1048] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 12:14:42.151335  5121 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
new_leader_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:45628
I20260709 12:14:42.155169  5163 leader_election.cc:304] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:42.114228  8993 raft_consensus.cc:2749] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:14:42.097515  8896 consensus_queue.cc:1048] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 12:14:42.087846  8912 raft_consensus.cc:515] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:42.145231  8790 raft_consensus.cc:2804] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:42.144272  8963 raft_consensus.cc:2804] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:42.177687  5238 leader_election.cc:304] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:42.143021  8983 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:42.144797  8436 raft_consensus.cc:2804] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:42.144939  8962 raft_consensus.cc:2749] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:14:42.162408  5121 raft_consensus.cc:606] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Received request to transfer leadership to TS 9e794b72ed7640219f90ec4232363929
I20260709 12:14:42.149402  8968 raft_consensus.cc:3060] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:42.179275  5120 raft_consensus.cc:1240] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:42.185765  8700 raft_consensus.cc:2804] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:42.144497  8933 consensus_queue.cc:1048] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:14:42.182087  5121 raft_consensus.cc:614] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:42.197613  5163 leader_election.cc:304] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:42.171731  8923 raft_consensus.cc:2804] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:42.172001  8896 consensus_queue.cc:1243] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer 9e794b72ed7640219f90ec4232363929 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 12:14:42.202097  5091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:42.173925  8790 raft_consensus.cc:493] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:42.181186  8963 raft_consensus.cc:493] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:42.161650  8915 consensus_queue.cc:1048] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
W20260709 12:14:42.211987  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:42.185357  8983 raft_consensus.cc:3060] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:42.183988  8436 raft_consensus.cc:493] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:42.168732  8902 raft_consensus.cc:515] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:42.196265  8995 raft_consensus.cc:3060] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:42.212409  8923 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:42.273277  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:42.273226  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 75714.6us
I20260709 12:14:42.221824  8790 raft_consensus.cc:3060] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:42.223836  8963 raft_consensus.cc:3060] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:42.224568  8982 raft_consensus.cc:2804] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:42.294474  5124 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
new_leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
 from {username='slave'} at 127.0.0.1:45628
W20260709 12:14:42.295346  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 70320.5us
I20260709 12:14:42.248111  8436 raft_consensus.cc:3060] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:42.301029  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:42.301731  5270 raft_consensus.cc:2376] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 7. Re-sending same reply.
I20260709 12:14:42.302498  5124 raft_consensus.cc:606] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Received request to transfer leadership to TS dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:42.302922  5124 raft_consensus.cc:614] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:42.304329  5197 raft_consensus.cc:2468] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 9.
I20260709 12:14:42.305047  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:14:42.306943  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:14:42.315093  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:42.294119  8992 log.cc:927] Time spent T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
W20260709 12:14:42.317961  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 242926us
I20260709 12:14:42.292300  8923 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:42.319820  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:42.321110  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:42.322042  5274 raft_consensus.cc:2393] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 10: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:42.323724  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:42.324406  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:42.324399  5265 raft_consensus.cc:2376] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 7. Re-sending same reply.
I20260709 12:14:42.327651  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:42.329187  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:42.330509  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:42.331365  5272 raft_consensus.cc:2393] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 9: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:42.331122  5274 raft_consensus.cc:3060] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:42.333138  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 206274us
W20260709 12:14:42.333750  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 221894us
I20260709 12:14:42.334040  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:14:42.333918  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 190345us
I20260709 12:14:42.339979  5240 leader_election.cc:304] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:42.336396  5270 raft_consensus.cc:2468] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 10.
I20260709 12:14:42.349278  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:42.295348  8898 consensus_queue.cc:1048] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:14:42.352316  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:42.293535  8975 consensus_queue.cc:1048] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:14:42.353560  5270 raft_consensus.cc:2393] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 6: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:42.359002  5804 leader_election.cc:400] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Vote denied by peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443) with higher term. Message: Invalid argument: T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 10. Current term is 11.
I20260709 12:14:42.359583  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:42.360827  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:42.356925  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:42.361924  5272 raft_consensus.cc:2393] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 10: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:42.362766  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:42.363691  5270 raft_consensus.cc:2376] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 8. Re-sending same reply.
I20260709 12:14:42.359602  5804 leader_election.cc:403] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:14:42.365974  5804 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:42.367035  8882 raft_consensus.cc:2749] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443) with higher term. Message: Invalid argument: T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 10. Current term is 11.
I20260709 12:14:42.370635  5804 leader_election.cc:304] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:42.374843  5804 leader_election.cc:304] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:42.266433  8910 consensus_queue.cc:237] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:42.385326  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:42.394491  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:42.346091  8993 raft_consensus.cc:493] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:42.399425  5198 raft_consensus.cc:2393] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 8: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:42.358767  8784 raft_consensus.cc:3060] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:42.335903  8969 consensus_queue.cc:1048] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.043s
W20260709 12:14:42.406386  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 119433us
I20260709 12:14:42.370534  8972 raft_consensus.cc:2749] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:14:42.404788  5274 raft_consensus.cc:2468] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 8.
I20260709 12:14:42.397078  5804 leader_election.cc:304] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:42.411404  5163 leader_election.cc:304] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:42.412024  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:42.416919  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:42.404086  8882 raft_consensus.cc:2749] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:42.421311  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:42.423350  5124 raft_consensus.cc:2393] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 7: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:42.406044  8700 raft_consensus.cc:697] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 11 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:42.397709  8424 raft_consensus.cc:515] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:42.426920  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:42.434736  5198 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:14:42.424803  5163 leader_election.cc:304] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:42.410607  9024 raft_consensus.cc:493] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:42.449819  8424 leader_election.cc:290] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:42.450973  5273 raft_consensus.cc:3060] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:14:42.452016  5091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:42.459002  9007 log.cc:927] Time spent T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 12:14:42.460147  5195 raft_consensus.cc:1275] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:14:42.462177  9013 log.cc:927] Time spent T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 12:14:42.463128  9011 log.cc:927] Time spent T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
W20260709 12:14:42.464865  9019 log.cc:927] Time spent T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 12:14:42.467401  8796 consensus_meta.cc:287] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.553s	user 0.009s	sys 0.001s
I20260709 12:14:42.468248  5191 raft_consensus.cc:1275] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:14:42.469898  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:42.471973  9005 log.cc:927] Time spent T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260709 12:14:42.462946  5801 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:42.484447  5273 raft_consensus.cc:2468] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 11.
W20260709 12:14:42.489989  5164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:42.407141  8993 raft_consensus.cc:515] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:42.439599  8875 raft_consensus.cc:493] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:42.502063  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 77325.6us
I20260709 12:14:42.440003  8972 raft_consensus.cc:2749] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:42.566615  5274 raft_consensus.cc:1240] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:14:42.447248  8912 leader_election.cc:290] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:42.584391  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:42.473080  8947 raft_consensus.cc:493] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.514663  8978 raft_consensus.cc:493] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.585129  5271 raft_consensus.cc:2376] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 8. Re-sending same reply.
I20260709 12:14:42.570506  8961 raft_consensus.cc:493] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.555620  8902 leader_election.cc:290] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:42.541587  9010 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.573136  8933 raft_consensus.cc:2749] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:14:42.606159  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 266268us
I20260709 12:14:42.560282  9034 raft_consensus.cc:493] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.577386  8796 raft_consensus.cc:2749] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:42.611577  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:42.555253  8871 consensus_queue.cc:1048] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:14:42.613075  5198 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 8.
I20260709 12:14:42.592298  8975 raft_consensus.cc:2804] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:42.611052  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:42.591241  9031 raft_consensus.cc:493] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:42.619164  5274 raft_consensus.cc:2393] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 9: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:42.550300  8790 raft_consensus.cc:515] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:42.575398  8911 consensus_queue.cc:1059] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:14:42.601907  8966 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:42.570407  8875 raft_consensus.cc:515] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:42.445856  9024 raft_consensus.cc:515] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:42.628304  8993 leader_election.cc:290] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:42.625067  8975 raft_consensus.cc:697] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:42.630637  8975 consensus_queue.cc:237] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:42.631618  8923 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:42.635118  8875 leader_election.cc:290] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:42.604182  8951 consensus_queue.cc:1059] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 12:14:42.612891  8961 raft_consensus.cc:515] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:42.618772  9034 raft_consensus.cc:515] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:42.638092  8961 leader_election.cc:290] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:42.602674  8947 raft_consensus.cc:515] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:42.640873  8947 leader_election.cc:290] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:42.641055  8907 consensus_meta.cc:287] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.565s	user 0.007s	sys 0.010s
I20260709 12:14:42.617072  9010 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:42.610772  8700 consensus_queue.cc:237] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:42.648028  8968 raft_consensus.cc:2749] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:42.625480  9031 raft_consensus.cc:515] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:42.613497  8881 raft_consensus.cc:493] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.625871  8933 raft_consensus.cc:2749] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:42.655272  5270 raft_consensus.cc:1217] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Deduplicated request from leader. Original: 3.2->[4.3-9.6]   Dedup: 4.3->[6.4-9.6]
I20260709 12:14:42.717748  5270 pending_rounds.cc:85] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929: Aborting all ops after (but not including) 3
I20260709 12:14:42.718048  5270 pending_rounds.cc:107] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:14:42.718303  5270 raft_consensus.cc:2889] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:42.720863  8790 leader_election.cc:290] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:42.724486  8918 consensus_meta.cc:287] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.718s	user 0.004s	sys 0.005s
I20260709 12:14:42.693679  8963 raft_consensus.cc:515] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:42.631453  8784 raft_consensus.cc:2749] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:42.669234  8923 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:42.673985  9025 log.cc:927] Time spent T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.233s	user 0.001s	sys 0.000s
W20260709 12:14:42.674857  9017 log.cc:927] Time spent T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 12:14:42.676680  8436 raft_consensus.cc:515] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:42.642975  5088 leader_election.cc:304] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:42.807446  9053 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
W20260709 12:14:42.891170  5091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:42.733536  5265 raft_consensus.cc:2468] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 8.
W20260709 12:14:42.738163  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 275275us
W20260709 12:14:42.716030  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 319169us
I20260709 12:14:44.030800  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:44.033469  8424 consensus_queue.cc:1059] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:44.035759  8424 raft_consensus.cc:3055] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:44.036163  8424 raft_consensus.cc:740] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:42.726509  8881 raft_consensus.cc:515] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:44.040222  8881 leader_election.cc:290] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:42.768575  8436 leader_election.cc:290] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:42.725003  8918 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:44.045238  5266 raft_consensus.cc:2393] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 8: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:44.046682  8918 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:42.775161  8934 consensus_meta.cc:287] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.675s	user 0.011s	sys 0.010s
I20260709 12:14:44.048841  8934 raft_consensus.cc:515] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:44.051132  8934 leader_election.cc:290] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:14:42.686960  8956 consensus_meta.cc:287] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.724s	user 0.012s	sys 0.008s
I20260709 12:14:44.053198  8956 raft_consensus.cc:2749] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:42.739830  8963 leader_election.cc:290] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:42.610005  8978 raft_consensus.cc:515] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:42.740935  8983 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:44.083164  8983 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:42.665902  8985 raft_consensus.cc:3055] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:44.085930  8985 raft_consensus.cc:740] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:44.086879  8985 consensus_queue.cc:260] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:44.088177  8985 raft_consensus.cc:3060] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:42.743412  8995 raft_consensus.cc:2749] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:14:42.768908  9002 consensus_meta.cc:287] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.860s	user 0.010s	sys 0.003s
I20260709 12:14:42.751374  9010 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:44.093322  5268 raft_consensus.cc:1275] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:44.095616  5268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50932 (request call id 730) took 2176 ms. Trace:
I20260709 12:14:44.095995  5268 rpcz_store.cc:276] 0709 12:14:41.919111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:41.919227 (+   116us) service_pool.cc:224] Handling call
0709 12:14:41.928591 (+  9364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:44.093754 (+2165163us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:44.095306 (+  1552us) spinlock_profiling.cc:243] Waited 2.16 s on lock 0x7b5400172854. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:44.095540 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4977456384}
I20260709 12:14:42.769577  9024 leader_election.cc:290] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:42.951882  9034 leader_election.cc:290] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:42.987967  8900 consensus_queue.cc:260] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:43.012625  5163 leader_election.cc:304] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:14:44.100080  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 1.08741e+06us
I20260709 12:14:44.100505  8896 raft_consensus.cc:2804] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:44.100878  5163 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:44.101068  8896 raft_consensus.cc:697] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:44.102348  5163 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:44.102109  8896 consensus_queue.cc:237] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:43.079370  8961 raft_consensus.cc:3055] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:14:43.091342  8982 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.004s	sys 0.011s
I20260709 12:14:43.099392  8952 leader_election.cc:290] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:43.134477  5164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:43.801934  5166 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.377s	user 0.015s	sys 0.008s
I20260709 12:14:44.104322  8961 raft_consensus.cc:740] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:43.835451  8951 raft_consensus.cc:493] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
W20260709 12:14:44.104803  8982 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.772s	user 0.004s	sys 0.012s
I20260709 12:14:43.902137  9046 raft_consensus.cc:493] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.105269  8982 raft_consensus.cc:697] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:44.105501  9046 raft_consensus.cc:515] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:44.106297  8982 consensus_queue.cc:237] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:44.108270  9046 leader_election.cc:290] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:43.905308  8923 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.108995  8923 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:44.109732  8968 raft_consensus.cc:2749] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:44.110410  8995 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:44.111294  8923 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:43.909408  8947 raft_consensus.cc:493] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.111505  5163 leader_election.cc:304] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:44.111987  8947 raft_consensus.cc:515] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:44.105268  8961 consensus_queue.cc:260] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:44.113483  8961 raft_consensus.cc:3060] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:44.114228  8947 leader_election.cc:290] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:43.912417  9022 raft_consensus.cc:2764] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:14:43.914589  5196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 2215) took 1835 ms. Trace:
I20260709 12:14:44.115326  5196 rpcz_store.cc:276] 0709 12:14:42.078803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:42.078945 (+   142us) service_pool.cc:224] Handling call
0709 12:14:42.103252 (+ 24307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:42.187329 (+ 84077us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:14:42.199621 (+ 12292us) log.cc:844] Serialized 14 byte log entry
0709 12:14:42.410478 (+210857us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:42.410531 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:42.410569 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:43.904386 (+1493817us) spinlock_profiling.cc:243] Waited 2.96 ms on lock 0x7b18004ac3e0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3aa42a6 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419
0709 12:14:43.914283 (+  9897us) spinlock_profiling.cc:243] Waited 83.8 ms on lock 0x7b54002aec54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:43.914332 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:43.914495 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":242465,"prepare.queue_time_us":34832,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":96968,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":34740,"spinlock_wait_cycles":199603712,"thread_start_us":210498,"threads_started":2,"wal-append.queue_time_us":210691,"wal-append.run_cpu_time_us":16923,"wal-append.run_wall_time_us":1489165}
W20260709 12:14:43.926885  8975 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.224s	user 0.012s	sys 0.004s
W20260709 12:14:44.117736  8975 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.417s	user 0.013s	sys 0.004s
I20260709 12:14:43.930686  9053 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:44.118575  8900 raft_consensus.cc:3060] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:44.120136  9053 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:14:43.931766  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 1.28873e+06us
I20260709 12:14:44.121718  5088 leader_election.cc:304] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:44.123665  5088 leader_election.cc:400] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709) with higher term. Message: Invalid argument: T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 9. Current term is 10.
I20260709 12:14:43.937605  9004 raft_consensus.cc:3055] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:44.124836  9004 raft_consensus.cc:740] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:44.125809  9004 consensus_queue.cc:260] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:43.945497  5091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:43.946211  9043 log.cc:927] Time spent T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 1.224s	user 0.005s	sys 0.017s
I20260709 12:14:43.944796  8976 raft_consensus.cc:493] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:43.948764  9057 raft_consensus.cc:2749] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:14:43.971395  9031 leader_election.cc:290] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:43.972692  9020 raft_consensus.cc:493] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
W20260709 12:14:43.973513  5221 debug-util.cc:398] Leaking SignalData structure 0x7b080030c7a0 after lost signal to thread 3925
I20260709 12:14:44.105158  8951 raft_consensus.cc:515] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:44.134335  8976 raft_consensus.cc:515] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:44.134337  9020 raft_consensus.cc:515] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:43.974998  5118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40386 (request call id 1976) took 2190 ms. Trace:
I20260709 12:14:43.983150  8510 consensus_queue.cc:260] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:44.136595  8951 leader_election.cc:290] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:43.995712  5273 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50932 (request call id 729) took 2077 ms (client timeout 1663 ms). Trace:
W20260709 12:14:44.137334  5221 debug-util.cc:398] Leaking SignalData structure 0x7b08003d8ae0 after lost signal to thread 5057
I20260709 12:14:44.115353  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
W20260709 12:14:44.138804  5221 debug-util.cc:398] Leaking SignalData structure 0x7b0800354f60 after lost signal to thread 5149
W20260709 12:14:44.133257  5091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:44.015244  5265 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34672 (request call id 2078) took 1710 ms (client timeout 1618 ms). Trace:
W20260709 12:14:44.139499  5265 rpcz_store.cc:269] 0709 12:14:42.305262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:42.326858 (+ 21596us) service_pool.cc:224] Handling call
0709 12:14:44.015030 (+1688172us) spinlock_profiling.cc:243] Waited 334 ms on lock 0x7b540036bfd4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:44.015168 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":769140480}
W20260709 12:14:44.022401  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 1.40955e+06us
W20260709 12:14:44.047175  5266 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50932 (request call id 743) took 1952 ms (client timeout 2135 ms). Trace:
I20260709 12:14:44.055620  5269 raft_consensus.cc:2410] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:14:44.140864  5240 leader_election.cc:304] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:44.141549  9010 raft_consensus.cc:493] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.141279  8952 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:44.064836  5237 leader_election.cc:304] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:44.072340  9023 raft_consensus.cc:493] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:44.142441  8952 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:44.142999  5269 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50932 (request call id 733) took 2222 ms (client timeout 1669 ms). Trace:
I20260709 12:14:44.142815  9023 raft_consensus.cc:515] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:44.139016  9004 raft_consensus.cc:3060] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:44.144651  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:44.144886  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:44.145426  5121 raft_consensus.cc:1240] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:44.145931  9031 raft_consensus.cc:2749] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:14:44.075440  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:44.074667  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:44.137427  5118 rpcz_store.cc:276] 0709 12:14:41.784978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:41.785154 (+   176us) service_pool.cc:224] Handling call
0709 12:14:41.803349 (+ 18195us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:41.803578 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:14:42.103714 (+300136us) log.cc:844] Serialized 14 byte log entry
0709 12:14:43.974430 (+1870716us) spinlock_profiling.cc:243] Waited 1.06 ms on lock 0x7b1800433e40. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e676b4bc 00007f84e3ab948b 00007f84ec9139a9 00007f84e3ad569b 00007f84e3ad393f 00007f84e3ad5c02 00007f84e675d20b 00007f84e6762d23 00007f84e676323a
0709 12:14:43.974626 (+   196us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:43.974678 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:43.974729 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:43.974800 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:43.974928 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14652,"prepare.queue_time_us":419268,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":19646,"raft.queue_time_us":10324,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"spinlock_wait_cycles":2446208,"thread_start_us":400235,"threads_started":2,"wal-append.queue_time_us":242921,"wal-append.run_cpu_time_us":17373,"wal-append.run_wall_time_us":1482882}
W20260709 12:14:44.104725  5166 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.680s	user 0.015s	sys 0.009s
I20260709 12:14:44.137243  8510 raft_consensus.cc:3060] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:44.147390  5166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:44.141701  9057 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.146687  5117 raft_consensus.cc:2368] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 9. Current term is 10.
W20260709 12:14:44.139185  5221 debug-util.cc:398] Leaking SignalData structure 0x7b08001ecc60 after lost signal to thread 5150
W20260709 12:14:44.147624  5269 rpcz_store.cc:269] 0709 12:14:41.920551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:41.928258 (+  7707us) service_pool.cc:224] Handling call
0709 12:14:44.142757 (+2214499us) spinlock_profiling.cc:243] Waited 2.11 s on lock 0x7b54002567d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:44.142908 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4842519808}
W20260709 12:14:44.140631  5266 rpcz_store.cc:269] 0709 12:14:42.094699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:42.094813 (+   114us) service_pool.cc:224] Handling call
0709 12:14:44.046953 (+1952140us) spinlock_profiling.cc:243] Waited 1.94 s on lock 0x7b54000d4154. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:44.047108 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4453301504}
I20260709 12:14:44.140687  5088 leader_election.cc:304] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:44.097666  8978 leader_election.cc:290] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:44.159919  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:44.153681  5166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:44.145663  5124 raft_consensus.cc:2368] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 10. Current term is 11.
W20260709 12:14:44.149039  5221 debug-util.cc:398] Leaking SignalData structure 0x7b08003fb440 after lost signal to thread 5224
I20260709 12:14:44.164426  8983 raft_consensus.cc:493] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:44.164876  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:44.164999  8983 raft_consensus.cc:515] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:44.165632  5116 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:44.165941  8975 raft_consensus.cc:2749] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:44.166136  8952 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:44.166664  8975 raft_consensus.cc:493] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.146687  9023 leader_election.cc:290] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:44.167243  8975 raft_consensus.cc:515] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:44.167467  9057 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:44.166761  8947 raft_consensus.cc:2804] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:44.169096  9002 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:44.137256  8951 raft_consensus.cc:2804] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:44.136580  8976 leader_election.cc:290] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:44.159590  5194 raft_consensus.cc:2393] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 8: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:44.170377  9023 raft_consensus.cc:493] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:44.170861  9023 raft_consensus.cc:515] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:44.171309  8947 raft_consensus.cc:493] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:44.159765  9022 raft_consensus.cc:493] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.171775  8947 raft_consensus.cc:3060] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:44.170715  8983 leader_election.cc:290] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:44.171994  9022 raft_consensus.cc:515] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:44.172478  8983 raft_consensus.cc:493] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:44.172663  5122 raft_consensus.cc:1275] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:14:44.173735  8975 leader_election.cc:290] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:44.160898  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 49467.9us
I20260709 12:14:44.174304  9022 leader_election.cc:290] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:44.172978  8983 raft_consensus.cc:515] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:44.146592  9031 consensus_queue.cc:1059] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:14:44.184336  8918 raft_consensus.cc:493] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:44.184978  9031 raft_consensus.cc:3055] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:14:44.175040  5163 leader_election.cc:304] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:44.184903  8918 raft_consensus.cc:515] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:44.186098  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 121359us
I20260709 12:14:44.186480  5163 leader_election.cc:304] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:44.186965  8982 raft_consensus.cc:2749] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:44.187126  8918 leader_election.cc:290] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:44.187296  8986 raft_consensus.cc:2804] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:44.185428  9031 raft_consensus.cc:740] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:44.188025  8986 raft_consensus.cc:697] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:44.188547  9031 consensus_queue.cc:260] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:44.169924  8951 raft_consensus.cc:493] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:44.189069  8986 consensus_queue.cc:237] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:44.179939  5121 raft_consensus.cc:1275] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:14:44.190735  9031 raft_consensus.cc:3060] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:44.169983  9002 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:44.179386  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:44.191630  5122 raft_consensus.cc:3060] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:44.191497  8361 consensus_queue.cc:1059] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:44.182878  9023 leader_election.cc:290] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:44.136582  9020 leader_election.cc:290] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:44.183847  5088 leader_election.cc:304] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:44.169785  9057 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:44.203796  8963 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.203862  9052 consensus_queue.cc:1059] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:44.204514  8963 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:44.205536  9034 raft_consensus.cc:3055] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:14:44.205358  5088 leader_election.cc:304] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:44.205960  9034 raft_consensus.cc:740] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:44.206809  9034 consensus_queue.cc:260] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:44.207406  5088 leader_election.cc:304] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:44.208142  9034 raft_consensus.cc:3060] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:44.208770  8956 raft_consensus.cc:3055] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:14:44.139307  5273 rpcz_store.cc:269] 0709 12:14:41.918789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:41.919272 (+   483us) service_pool.cc:224] Handling call
0709 12:14:43.995531 (+2076259us) spinlock_profiling.cc:243] Waited 493 ms on lock 0x7b54000a6c54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:43.995640 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1133928832}
I20260709 12:14:44.189594  8951 raft_consensus.cc:3060] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:44.205798  9057 raft_consensus.cc:2749] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:44.209740  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:44.210358  5265 raft_consensus.cc:3060] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:44.142089  9010 raft_consensus.cc:515] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:44.210446  9057 raft_consensus.cc:2764] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:14:44.194468  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:44.197997  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:44.212960  5266 raft_consensus.cc:2468] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 7.
I20260709 12:14:44.198766  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:44.213511  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:44.213991  5269 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:44.215754  9002 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:44.194466  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:44.216743  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:44.217597  5268 raft_consensus.cc:2393] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 8: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:44.207432  8963 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:44.198017  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:44.187830  8918 raft_consensus.cc:2804] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:44.221647  8918 raft_consensus.cc:493] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
W20260709 12:14:44.163874  5221 debug-util.cc:398] Leaking SignalData structure 0x7b08003fb420 after lost signal to thread 5225
I20260709 12:14:44.221726  5117 raft_consensus.cc:2468] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 8.
I20260709 12:14:44.197273  5116 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 8.
I20260709 12:14:44.180970  9004 raft_consensus.cc:493] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.222086  5121 raft_consensus.cc:2468] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 6.
I20260709 12:14:44.209138  8956 raft_consensus.cc:740] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:44.251274  8956 consensus_queue.cc:260] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:44.252209  9010 leader_election.cc:290] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:44.191124  5240 leader_election.cc:400] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Vote denied by peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443) with higher term. Message: Invalid argument: T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 9. Current term is 10.
I20260709 12:14:44.252955  5240 leader_election.cc:403] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:14:44.253528  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 62580.4us
I20260709 12:14:44.254973  5240 leader_election.cc:400] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 election: Vote denied by peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443) with higher term. Message: Invalid argument: T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 10. Current term is 11.
I20260709 12:14:44.255307  5240 leader_election.cc:403] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:14:44.210987  5163 leader_election.cc:304] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
W20260709 12:14:44.257278  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 46372.4us
W20260709 12:14:44.207695  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 129865us
I20260709 12:14:44.210987  5088 leader_election.cc:304] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:44.258661  5804 leader_election.cc:304] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
W20260709 12:14:44.223521  5221 debug-util.cc:398] Leaking SignalData structure 0x7b08002c8d80 after lost signal to thread 5298
W20260709 12:14:44.261601  5221 debug-util.cc:398] Leaking SignalData structure 0x7b08002cc1a0 after lost signal to thread 5299
I20260709 12:14:42.996531  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:14:44.262933  5221 debug-util.cc:398] Leaking SignalData structure 0x7b080034aa00 after lost signal to thread 5862
W20260709 12:14:44.202970  5801 connection.cc:256] RPC call timeout handler was delayed by -1.0432758050001212s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1663s for a response
I20260709 12:14:44.242390  5265 raft_consensus.cc:2468] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 6.
W20260709 12:14:44.258708  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 49352.6us
I20260709 12:14:44.221237  5269 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 10.
I20260709 12:14:44.276258  5838 raft_consensus.cc:1240] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 9 LEADER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 8. Current term is 9. Ops: []
W20260709 12:14:44.257732  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 56055.6us
W20260709 12:14:44.306967  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 48964.4us
I20260709 12:14:44.308382  5163 leader_election.cc:304] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:44.310923  5240 leader_election.cc:304] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:44.312937  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:44.314636  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:44.316371  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:44.321992  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 216624us
I20260709 12:14:44.323050  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:44.323671  5834 raft_consensus.cc:1275] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:14:44.323936  5830 raft_consensus.cc:2393] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 8: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
W20260709 12:14:44.324292  5164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:44.325317  5119 raft_consensus.cc:2393] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 8: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:44.312165  5240 leader_election.cc:304] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
W20260709 12:14:44.329205  5163 connection.cc:256] RPC call timeout handler was delayed by -1.1071598449998419s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16180000000000003s for a response
I20260709 12:14:44.332633  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:44.333480  5121 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:44.339733  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:44.340438  5119 raft_consensus.cc:3060] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:44.265683  9023 raft_consensus.cc:3060] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:14:44.342849  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:44.343149  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:44.343626  5120 raft_consensus.cc:2393] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 10: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:44.343784  5194 raft_consensus.cc:2468] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 9.
I20260709 12:14:44.344542  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:44.302922  8963 raft_consensus.cc:2804] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:44.345707  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:44.345800  8923 raft_consensus.cc:493] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.346310  5120 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 9.
I20260709 12:14:44.346393  8923 raft_consensus.cc:515] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:44.347330  5194 raft_consensus.cc:1240] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 11. Current term is 12. Ops: []
I20260709 12:14:44.336681  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:44.347374  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:44.323347  8361 consensus_queue.cc:1048] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:14:44.348738  5120 raft_consensus.cc:2468] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 12.
I20260709 12:14:44.335413  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:44.349731  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:44.349985  5837 raft_consensus.cc:2368] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 9. Current term is 10.
I20260709 12:14:44.350423  5120 raft_consensus.cc:2393] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 7: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:44.348829  8923 leader_election.cc:290] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:44.336321  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:44.335952  5835 raft_consensus.cc:1240] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:44.352305  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:44.352841  8923 raft_consensus.cc:493] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.353133  5194 raft_consensus.cc:2393] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 8: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:44.353477  8923 raft_consensus.cc:515] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:44.345925  8963 raft_consensus.cc:697] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 11 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:44.354975  8963 consensus_queue.cc:237] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:44.355805  8923 leader_election.cc:290] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:44.337785  5088 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:44.358276  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:44.358948  5835 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 6.
I20260709 12:14:44.359531  5194 raft_consensus.cc:1275] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:14:44.359910  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:44.361900  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:44.351168  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:44.362725  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:44.363461  5120 raft_consensus.cc:3060] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:44.362725  5837 raft_consensus.cc:2393] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 8: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:44.364943  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:44.366014  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:44.364784  5021 catalog_manager.cc:5697] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:44.367000  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:44.367727  5837 raft_consensus.cc:2393] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 9: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:44.368525  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:44.369184  5837 raft_consensus.cc:2393] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 8: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:44.369891  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:44.265846  9004 raft_consensus.cc:515] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:44.370625  5837 raft_consensus.cc:2393] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 11: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:44.371423  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:44.372149  5837 raft_consensus.cc:2393] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 10: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:44.372916  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:44.373204  9004 leader_election.cc:290] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:44.374238  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:44.363458  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:44.377758  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:44.377972  5832 raft_consensus.cc:1240] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:14:44.378962  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:44.377696  5237 leader_election.cc:304] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:44.382055  8361 raft_consensus.cc:2804] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:44.382539  8361 raft_consensus.cc:493] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:44.382937  8361 raft_consensus.cc:3060] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:44.383037  5237 leader_election.cc:304] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:44.384022  9036 consensus_queue.cc:1059] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:14:44.385576  9037 raft_consensus.cc:2749] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:44.386368  9037 raft_consensus.cc:3055] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:14:44.386691  9037 raft_consensus.cc:740] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:44.387511  9037 consensus_queue.cc:260] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:44.388861  9037 raft_consensus.cc:3060] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:44.390283  5237 leader_election.cc:304] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:44.384943  9036 consensus_queue.cc:1048] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:44.391819  8361 raft_consensus.cc:515] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:44.392719  9060 raft_consensus.cc:2749] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:44.394934  8361 leader_election.cc:290] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:44.377784  5801 connection.cc:256] RPC call timeout handler was delayed by -1.0378758050001125s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16690000000000002s for a response
I20260709 12:14:44.398896  9053 raft_consensus.cc:493] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.399040  5837 raft_consensus.cc:3060] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:44.399509  9053 raft_consensus.cc:515] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:44.400960  5832 raft_consensus.cc:2468] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 9.
I20260709 12:14:44.402026  9053 leader_election.cc:290] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:44.402932  9053 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.403522  9053 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:44.406005  9053 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:44.371584  5021 catalog_manager.cc:5697] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:44.265692  9069 log.cc:927] Time spent T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 12:14:44.411194  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:44.415508  5831 raft_consensus.cc:3060] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:44.402078  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:44.412034  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:44.417021  5830 raft_consensus.cc:2468] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 9.
I20260709 12:14:44.252662  8956 raft_consensus.cc:3060] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:44.222116  8918 raft_consensus.cc:3060] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:44.419486  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 81786.5us
I20260709 12:14:44.419605  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:44.418246  5832 raft_consensus.cc:3060] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:44.420346  5118 raft_consensus.cc:2393] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 10: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:44.036979  8424 consensus_queue.cc:260] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:44.420599  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:44.422271  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:44.415189  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:44.426261  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:44.425501  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:44.303753  9046 raft_consensus.cc:2804] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:44.425572  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:44.424602  5801 leader_election.cc:304] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:44.429525  5120 raft_consensus.cc:2468] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 9.
I20260709 12:14:44.430037  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:44.427127  5191 raft_consensus.cc:2468] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 4.
I20260709 12:14:44.435550  5838 raft_consensus.cc:2468] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 11.
I20260709 12:14:44.431174  5835 raft_consensus.cc:2468] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 8.
I20260709 12:14:44.309119  9002 raft_consensus.cc:2749] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443) with higher term. Message: Invalid argument: T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 10. Current term is 11.
I20260709 12:14:44.302387  8961 raft_consensus.cc:2804] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:44.435920  5198 raft_consensus.cc:3060] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:44.440791  5834 raft_consensus.cc:2368] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 7. Current term is 8.
I20260709 12:14:44.442703  5801 leader_election.cc:304] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:44.336477  9022 raft_consensus.cc:2804] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:44.450030  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:44.450846  5835 raft_consensus.cc:2393] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 9: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:44.455788  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:44.335307  8975 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:44.411535  9039 raft_consensus.cc:2804] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:44.458607  5831 raft_consensus.cc:2468] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 8.
I20260709 12:14:44.414170  8910 raft_consensus.cc:3060] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:44.460122  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:44.467507  5237 leader_election.cc:304] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:44.467697  5836 raft_consensus.cc:3060] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:44.183836  8947 raft_consensus.cc:515] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:44.468936  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:44.469355  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:44.469687  5829 raft_consensus.cc:2393] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 8: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:44.471138  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:44.474347  5088 leader_election.cc:304] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:44.479290  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:14:44.481029  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:44.481671  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:44.482844  5088 leader_election.cc:304] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:44.441948  8923 raft_consensus.cc:493] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.466914  5198 raft_consensus.cc:2468] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 10.
I20260709 12:14:44.466301  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:44.447132  8961 raft_consensus.cc:493] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:44.455534  8934 raft_consensus.cc:2749] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:44.487131  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:44.519001  5200 raft_consensus.cc:2468] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 7.
I20260709 12:14:44.520030  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:44.488490  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:44.488612  5119 raft_consensus.cc:2468] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 6.
I20260709 12:14:44.492784  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:44.522374  5195 raft_consensus.cc:2393] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 8: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:44.495980  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:44.495999  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:44.425834  8968 consensus_queue.cc:1048] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 12:14:44.465903  8436 raft_consensus.cc:2804] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:44.515625  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:44.515892  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:44.455758  9022 raft_consensus.cc:493] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:44.436321  9053 consensus_queue.cc:1048] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 12:14:44.460073  9039 raft_consensus.cc:493] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:44.486793  8424 raft_consensus.cc:3060] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:44.539740  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:44.502782  5021 catalog_manager.cc:5697] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 2 to 5, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 5 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:44.562928  5192 raft_consensus.cc:1275] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:14:44.563644  5834 raft_consensus.cc:1240] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:14:44.567435  5122 raft_consensus.cc:2468] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 11.
I20260709 12:14:44.539944  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:44.541150  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:44.553776  5804 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:44.540819  5835 raft_consensus.cc:2468] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 11.
I20260709 12:14:44.544867  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:44.547539  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:44.568706  5198 raft_consensus.cc:2468] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 10.
I20260709 12:14:44.547964  5089 leader_election.cc:304] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
W20260709 12:14:44.570148  5240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:44.570735  5804 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:44.570834  5200 raft_consensus.cc:2468] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 8.
I20260709 12:14:44.560837  5838 raft_consensus.cc:1240] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:14:44.486406  9052 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:44.485741  9002 raft_consensus.cc:493] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.540536  5831 raft_consensus.cc:3060] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:44.555977  5117 raft_consensus.cc:1275] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 12:14:44.588765  5117 pending_rounds.cc:85] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting all ops after (but not including) 9
I20260709 12:14:44.589064  5117 pending_rounds.cc:107] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 12:14:44.534982  8915 raft_consensus.cc:493] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.514439  8361 raft_consensus.cc:493] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.488936  8976 raft_consensus.cc:2804] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:44.533968  5012 maintenance_manager.cc:419] P 221aa011207d421b9725197ff8bed389: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033351
I20260709 12:14:44.486150  8978 raft_consensus.cc:2749] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:44.568800  5191 raft_consensus.cc:2468] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 8.
I20260709 12:14:44.572140  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:14:44.577209  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 135491us
W20260709 12:14:44.584928  5237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:44.533875  8961 raft_consensus.cc:3060] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:44.586643  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:44.587147  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:44.589303  5117 raft_consensus.cc:2889] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:44.571139  5089 leader_election.cc:304] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:44.534634  9036 raft_consensus.cc:493] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:44.608600  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 64118.5us
I20260709 12:14:44.486869  9066 raft_consensus.cc:2804] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:14:44.608801  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:44.612398  5268 raft_consensus.cc:1240] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:44.555392  8436 raft_consensus.cc:493] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
W20260709 12:14:44.779256  5166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:44.780243  5166 leader_election.cc:304] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:44.539393  9064 raft_consensus.cc:493] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.557062  9039 raft_consensus.cc:3060] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:44.556880  9022 raft_consensus.cc:3060] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:44.614609  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:14:44.617506  5022 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33896 (request call id 320) took 25063 ms (client timeout 15000 ms). Trace:
I20260709 12:14:44.586730  9060 raft_consensus.cc:493] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:44.469094  8975 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:44.573644  8952 raft_consensus.cc:2764] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 12:14:44.587896  8934 raft_consensus.cc:2749] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:44.564595  9010 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:44.628863  5831 raft_consensus.cc:2468] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 10.
I20260709 12:14:44.635066  5837 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 10.
I20260709 12:14:44.514422  8923 raft_consensus.cc:515] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:44.616634  8995 consensus_meta.cc:287] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.506s	user 0.009s	sys 0.000s
I20260709 12:14:44.648805  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:44.618008  8976 raft_consensus.cc:493] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:44.648636  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 78656.4us
I20260709 12:14:44.764469  8510 raft_consensus.cc:2749] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:14:44.856804  5121 consensus_meta.cc:287] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.523s	user 0.008s	sys 0.000s
I20260709 12:14:44.857441  5121 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 10.
I20260709 12:14:44.659581  9066 raft_consensus.cc:493] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:44.629978  8951 raft_consensus.cc:515] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:44.610891  9002 raft_consensus.cc:515] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:44.625166  9063 raft_consensus.cc:493] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:44.623057  8361 raft_consensus.cc:515] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:44.682082  5091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:44.658058  5834 raft_consensus.cc:2468] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 9.
W20260709 12:14:44.766388  5163 leader_election.cc:336] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 1.618s (SENT)
I20260709 12:14:44.877411  5163 leader_election.cc:304] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:44.818575  8993 raft_consensus.cc:2804] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:14:44.878332  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 111974us
I20260709 12:14:44.618290  8915 raft_consensus.cc:515] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:44.660487  5021 catalog_manager.cc:5697] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 2 to 5, leader changed from bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 5 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:44.591028  9052 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:44.781252  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 122998us
I20260709 12:14:44.781543  5269 raft_consensus.cc:2468] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 11.
I20260709 12:14:44.805873  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:44.732040  9046 raft_consensus.cc:697] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
W20260709 12:14:44.885099  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 313991us
I20260709 12:14:44.896561  5089 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
W20260709 12:14:44.782112  9031 consensus_meta.cc:287] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.587s	user 0.012s	sys 0.003s
I20260709 12:14:44.838797  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:44.637224  8986 consensus_queue.cc:1048] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 12:14:44.926862  5837 raft_consensus.cc:2468] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 9.
I20260709 12:14:44.838362  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:14:44.927920  9037 consensus_meta.cc:287] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.539s	user 0.010s	sys 0.013s
I20260709 12:14:44.928821  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:44.930256  5831 raft_consensus.cc:1275] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:14:44.927968  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:44.933660  5837 raft_consensus.cc:2376] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 8. Re-sending same reply.
I20260709 12:14:44.939124  8975 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:44.780805  9036 raft_consensus.cc:515] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:44.940749  8983 leader_election.cc:290] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:44.942569  9036 leader_election.cc:290] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:44.952670  8923 leader_election.cc:290] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:44.953226  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:44.953835  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:44.956154  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:44.956903  5118 raft_consensus.cc:2468] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 7.
I20260709 12:14:44.957929  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:44.958644  5117 raft_consensus.cc:2468] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 6.
W20260709 12:14:44.960376  8985 consensus_meta.cc:287] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.872s	user 0.009s	sys 0.002s
I20260709 12:14:44.961683  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:44.962396  5121 raft_consensus.cc:2468] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 6.
I20260709 12:14:44.840381  5838 raft_consensus.cc:2393] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 8: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:44.840889  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:44.963207  5268 raft_consensus.cc:3060] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:44.841532  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:44.841709  8947 leader_election.cc:290] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:44.840747  8995 raft_consensus.cc:2749] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:14:44.783785  5022 rpcz_store.cc:269] 0709 12:14:19.554390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:19.554988 (+   598us) service_pool.cc:224] Handling call
0709 12:14:44.617407 (+25062419us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:39.875728 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:40.097754 (+222026us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:40.120208 (+ 22454us) write_op.cc:435] Acquired schema lock
0709 12:14:40.120228 (+    20us) tablet.cc:662] Decoding operations
0709 12:14:40.210969 (+ 90741us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:40.211044 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:40.211073 (+    29us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:14:40.211726 (+   653us) tablet.cc:701] Row locks acquired
0709 12:14:40.211779 (+    53us) write_op.cc:260] PREPARE: finished
0709 12:14:40.211961 (+   182us) write_op.cc:270] Start()
0709 12:14:40.251673 (+ 39712us) write_op.cc:276] Timestamp: P: 1783599280211890 usec, L: 0
0709 12:14:40.253666 (+  1993us) op_driver.cc:348] REPLICATION: starting
0709 12:14:40.324202 (+ 70536us) log.cc:844] Serialized 2855 byte log entry
0709 12:14:41.532566 (+1208364us) spinlock_profiling.cc:243] Waited 3.43 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e675e86e 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221 00007f84e67671d9 00007f84e6767169
0709 12:14:42.305859 (+773293us) op_driver.cc:464] REPLICATION: finished
0709 12:14:42.666957 (+361098us) write_op.cc:301] APPLY: starting
0709 12:14:42.670088 (+  3131us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:42.670291 (+   203us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:42.670334 (+    43us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:42.671357 (+  1023us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:42.671660 (+   303us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 12:14:42.671708 (+    48us) write_op.cc:312] APPLY: finished
0709 12:14:42.672036 (+   328us) log.cc:844] Serialized 59 byte log entry
0709 12:14:42.672240 (+   204us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:42.672350 (+   110us) write_op.cc:454] Released schema lock
0709 12:14:42.672410 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:42.672805 (+   395us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:42.672834 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":48777,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":302718,"apply.run_cpu_time_us":2924,"apply.run_wall_time_us":49651,"num_ops":7,"prepare.queue_time_us":42947,"prepare.run_cpu_time_us":40459,"prepare.run_wall_time_us":568874,"raft.queue_time_us":359830,"raft.run_cpu_time_us":32792,"raft.run_wall_time_us":128054,"replication_time_us":2052014,"spinlock_wait_cycles":7891328,"thread_start_us":413401,"threads_started":4,"wal-append.queue_time_us":105360,"wal-append.run_cpu_time_us":93811,"wal-append.run_wall_time_us":3489977}]]}
I20260709 12:14:44.842361  9010 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:44.844134  9077 raft_consensus.cc:2804] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:44.844486  8976 raft_consensus.cc:3060] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:44.845992  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:14:44.847859  5238 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.212.132:43539 timed out after 1.609s (SENT) [suppressed 40 similar messages]
W20260709 12:14:44.849409  9071 log.cc:927] Time spent T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.190s	user 0.000s	sys 0.000s
I20260709 12:14:44.849808  9024 raft_consensus.cc:493] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
W20260709 12:14:44.850225  9074 log.cc:927] Time spent T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.260s	user 0.001s	sys 0.000s
I20260709 12:14:44.852531  5804 leader_election.cc:304] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:44.859992  5832 raft_consensus.cc:2468] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 11.
W20260709 12:14:44.974941  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 122483us
I20260709 12:14:44.975700  5804 leader_election.cc:304] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:44.784118  8436 raft_consensus.cc:3060] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:44.862174  5194 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 6.
I20260709 12:14:44.981539  5829 raft_consensus.cc:1240] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 10. Current term is 11. Ops: [5.7-10.8]
I20260709 12:14:44.783915  8881 raft_consensus.cc:493] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:44.778559  8978 raft_consensus.cc:2749] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:14:44.879134  5163 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:44.876139  9063 raft_consensus.cc:515] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:44.884188  9002 leader_election.cc:290] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:14:45.054509  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 175462us
I20260709 12:14:44.885076  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:45.057837  5834 raft_consensus.cc:2368] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 9. Current term is 10.
I20260709 12:14:44.889650  5273 raft_consensus.cc:2468] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 9.
W20260709 12:14:44.899516  9073 log.cc:927] Time spent T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.254s	user 0.000s	sys 0.001s
I20260709 12:14:44.900451  5274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34672 (request call id 2086) took 2333 ms. Trace:
I20260709 12:14:44.901055  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:44.900425  8510 raft_consensus.cc:3060] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:44.887214  8968 raft_consensus.cc:2749] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:44.818907  9060 raft_consensus.cc:515] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:44.881546  8993 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:44.910118  5164 leader_election.cc:304] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:44.913667  5836 raft_consensus.cc:2468] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 7.
I20260709 12:14:44.809425  9064 raft_consensus.cc:515] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:44.914011  9046 consensus_queue.cc:237] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:45.043864  9020 raft_consensus.cc:2804] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:44.916189  8361 leader_election.cc:290] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:45.208449  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:45.209221  5273 raft_consensus.cc:2393] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 10: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:44.916535  8951 leader_election.cc:290] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:44.918938  9052 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:44.921276  8915 leader_election.cc:290] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:44.872013  9066 raft_consensus.cc:3060] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:14:44.923331  9023 consensus_meta.cc:287] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.581s	user 0.008s	sys 0.000s
W20260709 12:14:44.926090  9034 consensus_meta.cc:287] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.717s	user 0.010s	sys 0.000s
I20260709 12:14:44.964437  5240 leader_election.cc:304] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:44.973800  5197 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:44.976861  5804 leader_election.cc:304] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
W20260709 12:14:45.045189  5166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:45.045776  5833 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.006s	sys 0.057s
W20260709 12:14:45.231567  5833 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.006s	sys 0.057s
I20260709 12:14:45.059715  5269 raft_consensus.cc:2468] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 7.
I20260709 12:14:45.059469  5274 rpcz_store.cc:276] 0709 12:14:42.566787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:42.657147 (+ 90360us) service_pool.cc:224] Handling call
0709 12:14:42.681545 (+ 24398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:44.461065 (+1779520us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:44.461094 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:44.487227 (+ 26133us) log.cc:844] Serialized 26 byte log entry
0709 12:14:44.778787 (+291560us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:44.778827 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:44.778938 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:44.900218 (+121280us) raft_consensus.cc:1685] finished
0709 12:14:44.900240 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:44.900385 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1339715,"raft.queue_time_us":1352742,"raft.run_cpu_time_us":49,"raft.run_wall_time_us":45,"thread_start_us":650870,"threads_started":2,"wal-append.queue_time_us":353930}
W20260709 12:14:45.090305  5237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:45.198135  5268 raft_consensus.cc:2468] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 11.
W20260709 12:14:45.194753  8982 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.033s	sys 0.042s
W20260709 12:14:45.202298  5196 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.000s	sys 0.012s
I20260709 12:14:44.914604  5124 raft_consensus.cc:1240] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 7. Current term is 8. Ops: []
W20260709 12:14:45.204077  5088 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.006s	sys 0.007s
I20260709 12:14:44.981961  9077 raft_consensus.cc:697] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
W20260709 12:14:45.235495  5196 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.001s	sys 0.012s
I20260709 12:14:45.206163  5830 raft_consensus.cc:1240] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:44.967295  9059 consensus_queue.cc:1048] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.092s
W20260709 12:14:45.210148  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 300082us
W20260709 12:14:45.210860  5801 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.763s	user 0.005s	sys 0.008s
W20260709 12:14:45.237123  5801 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.789s	user 0.005s	sys 0.008s
W20260709 12:14:45.237501  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 794786us
I20260709 12:14:44.982239  9024 raft_consensus.cc:515] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:45.045445  8881 raft_consensus.cc:515] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:45.241901  5164 leader_election.cc:400] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Vote denied by peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539) with higher term. Message: Invalid argument: T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 7. Current term is 8.
I20260709 12:14:45.195588  8975 raft_consensus.cc:2749] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:45.246798  5125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40402 (request call id 2293) took 1101 ms. Trace:
I20260709 12:14:45.248044  5237 leader_election.cc:304] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:45.202008  8993 raft_consensus.cc:3060] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:14:45.226527  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 324768us
W20260709 12:14:45.210671  8900 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.888s	user 0.002s	sys 0.011s
I20260709 12:14:45.235767  9077 consensus_queue.cc:237] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:44.985986  8923 raft_consensus.cc:2749] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:14:45.236678  5088 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.006s	sys 0.007s
W20260709 12:14:45.303474  5088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:45.233407  8934 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:45.304395  5088 connection.cc:256] RPC call timeout handler was delayed by -1.3419823159999851s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1534s for a response
W20260709 12:14:45.304759  5088 connection.cc:256] RPC call timeout handler was delayed by -1.1871823159999622s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1706s for a response
I20260709 12:14:45.231611  9023 raft_consensus.cc:2749] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443) with higher term. Message: Invalid argument: T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 9. Current term is 10.
I20260709 12:14:45.218276  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:45.316783  5273 raft_consensus.cc:2410] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:14:44.984167  9039 raft_consensus.cc:515] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:45.222954  8910 consensus_meta.cc:287] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.740s	user 0.009s	sys 0.000s
W20260709 12:14:45.225806  8424 consensus_meta.cc:287] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.651s	user 0.009s	sys 0.000s
I20260709 12:14:45.212410  9084 raft_consensus.cc:493] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.247210  5125 rpcz_store.cc:276] 0709 12:14:44.145466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:44.164158 (+ 18692us) service_pool.cc:224] Handling call
0709 12:14:44.164549 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:44.251830 (+ 87281us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:44.251861 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:44.252371 (+   510us) log.cc:844] Serialized 26 byte log entry
0709 12:14:44.377267 (+124896us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:44.377309 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:44.423848 (+ 46539us) spinlock_profiling.cc:243] Waited 86.9 ms on lock 0x7b54003efb54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:44.423923 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:45.240698 (+816775us) raft_consensus.cc:1685] finished
0709 12:14:45.240719 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:45.246732 (+  6013us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1034,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":38092,"spinlock_wait_cycles":199881984,"thread_start_us":124503,"threads_started":1,"wal-append.queue_time_us":265947}
W20260709 12:14:45.230427  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 266094us
I20260709 12:14:45.251379  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:45.254777  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:45.254266  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:45.213699  5123 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.912s	user 0.000s	sys 0.014s
W20260709 12:14:45.327909  5123 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.026s	user 0.000s	sys 0.014s
W20260709 12:14:45.305727  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 57777us
I20260709 12:14:45.239430  9079 raft_consensus.cc:2804] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:45.311748  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:45.410436  9088 raft_consensus.cc:493] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.312657  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:45.312790  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:45.254540  8900 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.935s	user 0.003s	sys 0.011s
W20260709 12:14:45.314630  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 75826.7us
I20260709 12:14:45.246631  9053 raft_consensus.cc:493] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.241858  8361 raft_consensus.cc:493] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.241838  8915 raft_consensus.cc:2804] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:14:45.391429  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 71081.3us
I20260709 12:14:45.392472  5123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40402 (request call id 2288) took 1248 ms. Trace:
I20260709 12:14:45.324797  5272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34672 (request call id 2084) took 2758 ms. Trace:
I20260709 12:14:45.405818  5240 leader_election.cc:304] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
W20260709 12:14:45.314837  8918 consensus_meta.cc:287] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.861s	user 0.004s	sys 0.009s
I20260709 12:14:45.322985  8910 raft_consensus.cc:2749] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:14:45.421720  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 444884us
I20260709 12:14:45.322625  9078 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.408042  9084 raft_consensus.cc:515] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:45.416517  9083 log.cc:927] Time spent T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.441s	user 0.000s	sys 0.001s
W20260709 12:14:45.447207  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:45.404441  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 70139.9us
W20260709 12:14:45.620394  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:45.449637  5194 raft_consensus.cc:2468] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 6.
I20260709 12:14:45.406711  9062 raft_consensus.cc:2804] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:45.312095  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:45.411116  9057 raft_consensus.cc:3060] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:45.451051  5830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46088 (request call id 675) took 1091 ms. Trace:
I20260709 12:14:45.465117  5122 raft_consensus.cc:1275] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:14:45.323129  8934 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:45.416316  8963 raft_consensus.cc:2804] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:14:45.621137  9090 log.cc:927] Time spent T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.299s	user 0.001s	sys 0.000s
I20260709 12:14:45.593729  9023 raft_consensus.cc:2804] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:45.557292  8896 raft_consensus.cc:493] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.490746  5200 raft_consensus.cc:2468] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 6.
W20260709 12:14:45.589010  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 259759us
I20260709 12:14:45.486726  8968 raft_consensus.cc:493] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.672546  8968 raft_consensus.cc:515] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:45.674826  8968 leader_election.cc:290] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:45.322304  8978 raft_consensus.cc:493] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.675566  8978 raft_consensus.cc:515] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:45.676662  5117 raft_consensus.cc:2468] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 9.
I20260709 12:14:45.677846  8978 leader_election.cc:290] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:45.588197  5804 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:45.587145  5272 rpcz_store.cc:276] 0709 12:14:42.566176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:42.566318 (+   142us) service_pool.cc:224] Handling call
0709 12:14:42.591388 (+ 25070us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:44.348368 (+1756980us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:44.348398 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:44.348890 (+   492us) log.cc:844] Serialized 26 byte log entry
0709 12:14:44.398416 (+ 49526us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:44.406675 (+  8259us) log.cc:844] Serialized 14 byte log entry
0709 12:14:44.406902 (+   227us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:44.406975 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:45.324599 (+917624us) raft_consensus.cc:1685] finished
0709 12:14:45.324619 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:45.324738 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1432562,"prepare.queue_time_us":63326,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":49,"raft.queue_time_us":1444029,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":144,"thread_start_us":380798,"threads_started":3,"wal-append.queue_time_us":130583}
I20260709 12:14:45.598099  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:14:45.634150  9086 log.cc:927] Time spent T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.427s	user 0.000s	sys 0.002s
I20260709 12:14:45.550704  8951 raft_consensus.cc:493] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.558480  8975 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.625587  5191 raft_consensus.cc:2410] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:14:45.628827  5237 leader_election.cc:304] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:45.627676  5830 rpcz_store.cc:276] 0709 12:14:44.359569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:44.489058 (+129489us) service_pool.cc:224] Handling call
0709 12:14:45.197820 (+708762us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:45.238042 (+ 40222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.450841 (+212799us) spinlock_profiling.cc:243] Waited 682 ms on lock 0x7b5400480b50. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc28ad 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:45.450991 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1568417024}
W20260709 12:14:45.687443  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 58698.9us
W20260709 12:14:45.688345  5237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:45.587127  5123 rpcz_store.cc:276] 0709 12:14:44.143886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:44.145812 (+  1926us) service_pool.cc:224] Handling call
0709 12:14:44.146129 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:44.146324 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:14:44.301750 (+155426us) log.cc:844] Serialized 14 byte log entry
0709 12:14:45.392050 (+1090300us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:45.392111 (+    61us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:45.392159 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.392233 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:45.392404 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63692,"prepare.queue_time_us":155366,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":79957,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":5324,"thread_start_us":1181213,"threads_started":2,"wal-append.queue_time_us":1127828}
W20260709 12:14:45.533026  9092 log.cc:927] Time spent T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:14:45.587504  8915 raft_consensus.cc:493] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:45.637240  9037 raft_consensus.cc:493] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:45.552474  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 64386.5us
W20260709 12:14:45.634775  5238 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.002s	sys 0.007s
W20260709 12:14:45.788594  5238 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.816s	user 0.004s	sys 0.008s
W20260709 12:14:45.788923  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 941015us
W20260709 12:14:45.789486  5238 leader_election.cc:336] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Timed out: RequestConsensusVote RPC to 127.3.212.132:43539 timed out after 1.818s (SENT)
I20260709 12:14:45.450873  9079 raft_consensus.cc:493] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:45.790175  9079 raft_consensus.cc:3060] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:45.627715  9096 log.cc:927] Time spent T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
I20260709 12:14:45.594651  9010 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:45.795011  5196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47728 (request call id 2191) took 1365 ms. Trace:
I20260709 12:14:45.795388  5196 rpcz_store.cc:276] 0709 12:14:44.429233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:44.429360 (+   127us) service_pool.cc:224] Handling call
0709 12:14:44.455760 (+ 26400us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:44.485767 (+ 30007us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:44.485797 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:44.504012 (+ 18215us) log.cc:844] Serialized 52 byte log entry
0709 12:14:45.237280 (+733268us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:45.237358 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.237512 (+   154us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:45.794769 (+557257us) raft_consensus.cc:1685] finished
0709 12:14:45.794798 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:45.794950 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60525,"raft.queue_time_us":84843,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":12166,"thread_start_us":647730,"threads_started":1,"wal-append.queue_time_us":690699}
W20260709 12:14:45.682479  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 94343.2us
W20260709 12:14:45.562250  9022 consensus_meta.cc:287] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.741s	user 0.009s	sys 0.000s
W20260709 12:14:45.796978  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 124792us
I20260709 12:14:45.797442  9022 raft_consensus.cc:515] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:45.799398  5240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:45.799510  9022 leader_election.cc:290] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:45.800661  9115 raft_consensus.cc:493] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.624197  8424 raft_consensus.cc:493] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.801118  9115 raft_consensus.cc:515] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:45.801543  8424 raft_consensus.cc:515] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:45.803500  8424 leader_election.cc:290] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:45.803660  9115 leader_election.cc:290] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:45.572942  8361 raft_consensus.cc:515] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:45.804617  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:45.806186  8361 leader_election.cc:290] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:45.806535  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:45.807139  5118 raft_consensus.cc:3060] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:14:45.704114  5265 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.743s	user 0.004s	sys 0.013s
W20260709 12:14:45.807654  5265 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.847s	user 0.004s	sys 0.013s
I20260709 12:14:45.589567  9053 raft_consensus.cc:515] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:45.593951  8947 consensus_queue.cc:1059] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 12:14:45.813338  5837 raft_consensus.cc:1240] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:45.593972  8918 raft_consensus.cc:515] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:45.622048  9078 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:45.819017  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:45.708068  5122 raft_consensus.cc:1240] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:45.819542  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:45.707859  5801 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:45.818400  5164 leader_election.cc:304] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
W20260709 12:14:45.709427  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 116410us
I20260709 12:14:45.681591  8963 raft_consensus.cc:697] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 6 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:45.698045  8923 raft_consensus.cc:2804] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:45.714715  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:45.822691  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:45.714747  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:45.684355  9063 leader_election.cc:290] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:45.671694  8900 consensus_queue.cc:1048] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:14:45.703435  8915 raft_consensus.cc:3060] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:45.619908  9088 raft_consensus.cc:515] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:45.624189  9103 consensus_queue.cc:1048] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.142s
I20260709 12:14:45.732714  5270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34672 (request call id 2085) took 3166 ms. Trace:
I20260709 12:14:45.711030  9037 raft_consensus.cc:515] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:45.735674  9081 log.cc:927] Time spent T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.236s	user 0.001s	sys 0.000s
I20260709 12:14:45.724159  8881 leader_election.cc:290] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:45.738792  9093 log.cc:927] Time spent T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
W20260709 12:14:45.742048  9102 log.cc:927] Time spent T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.289s	user 0.000s	sys 0.001s
W20260709 12:14:45.742929  9097 log.cc:927] Time spent T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:14:45.743566  9084 leader_election.cc:290] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:45.744046  5267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34672 (request call id 2087) took 3177 ms. Trace:
I20260709 12:14:45.748903  5266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34672 (request call id 2093) took 1141 ms. Trace:
I20260709 12:14:45.750437  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:45.751483  5197 consensus_meta.cc:287] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.513s	user 0.005s	sys 0.004s
I20260709 12:14:45.751682  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:45.672549  9060 leader_election.cc:290] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:45.713397  9061 raft_consensus.cc:2804] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:14:45.767827  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 54551.1us
I20260709 12:14:45.715168  9064 leader_election.cc:290] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:45.765774  9039 leader_election.cc:290] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:45.702718  8951 raft_consensus.cc:515] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:45.702962  8975 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:45.683918  8896 raft_consensus.cc:515] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:45.810283  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:46.088213  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:45.775897  8961 consensus_meta.cc:287] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 1.092s	user 0.011s	sys 0.001s
W20260709 12:14:45.789783  8510 consensus_meta.cc:287] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.594s	user 0.009s	sys 0.001s
I20260709 12:14:45.808874  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:45.862097  5166 leader_election.cc:304] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:45.822576  5088 leader_election.cc:304] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
W20260709 12:14:46.875923  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 1.05331e+06us
I20260709 12:14:46.877187  5088 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:46.878365  5088 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:45.829540  5089 leader_election.cc:304] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:45.827118  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:45.781332  5123 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
new_leader_uuid: "bce73265e27d4b30a4dcc1e491305088"
 from {username='slave'} at 127.0.0.1:45628
I20260709 12:14:47.261597  5123 raft_consensus.cc:606] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Received request to transfer leadership to TS bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:47.262019  5123 raft_consensus.cc:614] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:47.262534  5123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:45628 (request call id 40) took 1485 ms. Trace:
I20260709 12:14:47.262842  5123 rpcz_store.cc:276] 0709 12:14:45.776945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.777110 (+   165us) service_pool.cc:224] Handling call
0709 12:14:47.262437 (+1485327us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:47.264223  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:45.863652  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:45.881112  5116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40402 (request call id 2301) took 1524 ms. Trace:
I20260709 12:14:45.824975  5164 leader_election.cc:304] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:45.823633  5191 raft_consensus.cc:2468] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 10.
W20260709 12:14:47.331626  5191 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47728 (request call id 2197) took 1627 ms (client timeout 1510 ms). Trace:
W20260709 12:14:47.331998  5191 rpcz_store.cc:269] 0709 12:14:45.704456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.704616 (+   160us) service_pool.cc:224] Handling call
0709 12:14:47.331523 (+1626907us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:45.823179  5200 raft_consensus.cc:2468] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 7.
I20260709 12:14:45.815590  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:46.078212  5237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:45.831415  5271 raft_consensus.cc:2468] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 9.
I20260709 12:14:45.934108  5265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34672 (request call id 2091) took 1367 ms. Trace:
I20260709 12:14:47.343132  5265 rpcz_store.cc:276] 0709 12:14:44.566511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:44.566626 (+   115us) service_pool.cc:224] Handling call
0709 12:14:44.612252 (+ 45626us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:44.765928 (+153676us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:44.765961 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:44.783335 (+ 17374us) log.cc:844] Serialized 26 byte log entry
0709 12:14:44.961020 (+177685us) spinlock_profiling.cc:243] Waited 1.34 ms on lock 0x7b1800326500. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3ab8e07 00007f84ec9139a9 00007f84e3ad569b 00007f84e3ad393f 00007f84e3ad5c02 00007f84e675d20b 00007f84e6762d23 00007f84e67630d1 00007f84e6b7ea0f
0709 12:14:45.808012 (+846992us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:45.926205 (+118193us) log.cc:844] Serialized 14 byte log entry
0709 12:14:45.927487 (+  1282us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.927580 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:45.927626 (+    46us) raft_consensus.cc:1685] finished
0709 12:14:45.933954 (+  6328us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:45.934059 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":162684,"prepare.queue_time_us":22797,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":186864,"raft.run_cpu_time_us":330,"raft.run_wall_time_us":49946,"spinlock_wait_cycles":3088640,"thread_start_us":943325,"threads_started":2,"wal-append.queue_time_us":997804,"wal-append.run_cpu_time_us":19676,"wal-append.run_wall_time_us":1107102}
I20260709 12:14:45.858533  5267 rpcz_store.cc:276] 0709 12:14:42.567060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:42.747757 (+180697us) service_pool.cc:224] Handling call
0709 12:14:42.748214 (+   457us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:44.448615 (+1700401us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:44.448644 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:44.460861 (+ 12217us) log.cc:844] Serialized 26 byte log entry
0709 12:14:44.688541 (+227680us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:44.762594 (+ 74053us) log.cc:844] Serialized 14 byte log entry
0709 12:14:44.838624 (+ 76030us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:44.838701 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:44.945226 (+106525us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b18003589c0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3ad63f3 00007f84e3ad87c1 00007f84e3ad8779 00007f84e3ad8709 00007f84e3ad86d1 00007f84e3ad79cd 0000000000388634 0000000000388479 00007f84e3ab983a
0709 12:14:44.946255 (+  1029us) spinlock_profiling.cc:243] Waited 6.83 ms on lock 0x7b18003589c0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3aa42a6 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3ad63f3 00007f84e3ad87c1
0709 12:14:44.946658 (+   403us) spinlock_profiling.cc:243] Waited 22.7 ms on lock 0x7b18003589c0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3ad63f3 00007f84e3ad87c1 00007f84e3ad8779 00007f84e3ad8709 00007f84e3ad86d1 00007f84e3ad79cd 0000000000388634 0000000000388479 00007f84e3ab983a
0709 12:14:45.743843 (+797185us) raft_consensus.cc:1685] finished
0709 12:14:45.743864 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:45.743989 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1350528,"prepare.queue_time_us":71071,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":16939,"raft.queue_time_us":1362873,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":150,"spinlock_wait_cycles":94094464,"thread_start_us":577778,"threads_started":2,"wal-append.queue_time_us":363038}
I20260709 12:14:45.859582  5197 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 10.
W20260709 12:14:47.349506  5197 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41416 (request call id 700) took 3276 ms (client timeout 2046 ms). Trace:
W20260709 12:14:47.349924  5197 rpcz_store.cc:269] 0709 12:14:44.073371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:44.109178 (+ 35807us) service_pool.cc:224] Handling call
0709 12:14:47.349283 (+3240105us) spinlock_profiling.cc:243] Waited 835 ms on lock 0x7b5400364a54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:47.349434 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1920085760}
W20260709 12:14:46.085469  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:45.881346  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 91885us
I20260709 12:14:45.858789  5266 rpcz_store.cc:276] 0709 12:14:44.608041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:44.610431 (+  2390us) service_pool.cc:224] Handling call
0709 12:14:44.626311 (+ 15880us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:14:44.841287 (+214976us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:44.841319 (+    32us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:14:44.842013 (+   694us) log.cc:844] Serialized 78 byte log entry
0709 12:14:45.234638 (+392625us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:45.235424 (+   786us) log.cc:844] Serialized 14 byte log entry
0709 12:14:45.244070 (+  8646us) log.cc:844] Serialized 14 byte log entry
0709 12:14:45.244382 (+   312us) log.cc:844] Serialized 14 byte log entry
0709 12:14:45.244521 (+   139us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.244588 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:45.741768 (+497180us) spinlock_profiling.cc:243] Waited 2.88 ms on lock 0x7b180046de60. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3ad63f3 00007f84e3ad87c1 00007f84e3ad8779 00007f84e3ad8709 00007f84e3ad86d1 00007f84e3ad79cd 0000000000388634 0000000000388479 00007f84e3ab983a
0709 12:14:45.748667 (+  6899us) raft_consensus.cc:1685] finished
0709 12:14:45.748689 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:45.748840 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":210429,"prepare.queue_time_us":76491,"prepare.run_cpu_time_us":117,"prepare.run_wall_time_us":60161,"raft.queue_time_us":226056,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":87885,"spinlock_wait_cycles":176101632,"thread_start_us":392175,"threads_started":1,"wal-append.queue_time_us":884838}
I20260709 12:14:45.835098  5270 rpcz_store.cc:276] 0709 12:14:42.566529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:42.654652 (+ 88123us) service_pool.cc:224] Handling call
0709 12:14:42.655048 (+   396us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 12:14:44.486112 (+1831064us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:14:44.971789 (+485677us) log.cc:844] Serialized 14 byte log entry
0709 12:14:45.313243 (+341454us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:14:45.321229 (+  7986us) log.cc:844] Serialized 78 byte log entry
0709 12:14:45.321426 (+   197us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:45.324065 (+  2639us) log.cc:844] Serialized 14 byte log entry
0709 12:14:45.382242 (+ 58177us) log.cc:844] Serialized 14 byte log entry
0709 12:14:45.412788 (+ 30546us) log.cc:844] Serialized 14 byte log entry
0709 12:14:45.423079 (+ 10291us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.423161 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:45.637031 (+213870us) spinlock_profiling.cc:243] Waited 60.8 ms on lock 0x7b18003269e0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3ad6522 00007f84e3ad87c1 00007f84e3ad8779 00007f84e3ad8709 00007f84e3ad86d1 00007f84e3ad79cd 0000000000388634 0000000000388479 00007f84e3ab983a
0709 12:14:45.638998 (+  1967us) spinlock_profiling.cc:243] Waited 82 ms on lock 0x7b18003269e0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3ad63f3 00007f84e3ad87c1 00007f84e3ad8779 00007f84e3ad8709 00007f84e3ad86d1 00007f84e3ad79cd 0000000000388634 0000000000388479 00007f84e3ab983a
0709 12:14:45.732462 (+ 93464us) raft_consensus.cc:1685] finished
0709 12:14:45.732484 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:45.732650 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1343126,"prepare.queue_time_us":174999,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":3292,"raft.queue_time_us":1367051,"raft.run_cpu_time_us":620,"raft.run_wall_time_us":28492,"spinlock_wait_cycles":362889088,"thread_start_us":971361,"threads_started":3,"wal-append.queue_time_us":625832}
W20260709 12:14:45.828408  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 120623us
I20260709 12:14:45.815338  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:45.929926  5833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46100 (request call id 1064) took 1650 ms. Trace:
I20260709 12:14:45.811915  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:45.809084  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:45.811237  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:47.395282  9143 raft_consensus.cc:493] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.395689  5836 raft_consensus.cc:2393] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 8: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
W20260709 12:14:47.396206  5836 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46088 (request call id 685) took 1588 ms (client timeout 1565 ms). Trace:
I20260709 12:14:47.395910  9143 raft_consensus.cc:515] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:45.828243  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:45.813714  5838 raft_consensus.cc:1275] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:14:47.398890  9143 leader_election.cc:290] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:47.399287  5838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46094 (request call id 992) took 1590 ms. Trace:
I20260709 12:14:47.399735  5838 rpcz_store.cc:276] 0709 12:14:45.809359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.812340 (+  2981us) service_pool.cc:224] Handling call
0709 12:14:45.812615 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:47.398968 (+1586353us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:47.399221 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:47.399448  9143 raft_consensus.cc:493] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:47.406241  9143 raft_consensus.cc:515] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:47.408368  9143 leader_election.cc:290] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:45.837764  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:46.089350  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:45.857941  8424 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:47.416239  8424 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:45.816571  8436 consensus_meta.cc:287] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.763s	user 0.009s	sys 0.000s
I20260709 12:14:47.420004  8436 raft_consensus.cc:515] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:46.090466  8510 raft_consensus.cc:2749] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:45.927628  8700 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:47.423326  8700 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:47.424170  8424 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:45.864840  8881 raft_consensus.cc:493] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.426642  8881 raft_consensus.cc:515] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:47.428974  8881 leader_election.cc:290] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:45.891959  8896 leader_election.cc:290] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:45.840425  8923 raft_consensus.cc:697] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 10 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:47.432570  8700 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:47.432410  8923 consensus_queue.cc:237] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:45.945256  8915 raft_consensus.cc:515] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:47.438697  8915 leader_election.cc:290] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:45.912475  8918 leader_election.cc:290] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:45.932540  8956 consensus_meta.cc:287] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 1.500s	user 0.012s	sys 0.000s
I20260709 12:14:45.943755  8951 leader_election.cc:290] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:46.090081  8961 raft_consensus.cc:515] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:47.444525  8961 leader_election.cc:290] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:45.825994  8963 consensus_queue.cc:237] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:45.935185  8976 consensus_meta.cc:287] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.952s	user 0.008s	sys 0.002s
I20260709 12:14:45.938319  8975 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:45.899212  8993 consensus_meta.cc:287] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.594s	user 0.006s	sys 0.002s
I20260709 12:14:45.838744  8934 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:45.780908  9020 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.005s	sys 0.006s
W20260709 12:14:47.455847  9020 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.231s	user 0.007s	sys 0.007s
I20260709 12:14:47.456185  9020 raft_consensus.cc:697] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 9 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:45.671051  9023 raft_consensus.cc:493] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:47.458328  9023 raft_consensus.cc:3060] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:45.916515  9024 leader_election.cc:290] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:45.902351  9037 leader_election.cc:290] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:45.827824  9052 raft_consensus.cc:2749] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:45.893427  9053 leader_election.cc:290] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:45.869566  9057 raft_consensus.cc:2749] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:45.862793  9061 raft_consensus.cc:493] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:47.468266  9061 raft_consensus.cc:3060] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:47.457191  9020 consensus_queue.cc:237] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:45.781795  9062 raft_consensus.cc:697] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 10 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:47.472720  9062 consensus_queue.cc:237] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:45.829248  9063 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.719899  9066 raft_consensus.cc:515] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:47.475976  9063 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:45.922843  9079 raft_consensus.cc:515] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:47.480361  9079 leader_election.cc:290] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:45.910108  9078 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:45.901803  9087 log.cc:927] Time spent T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.491s	user 0.002s	sys 0.008s
I20260709 12:14:45.914146  9088 leader_election.cc:290] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:45.821951  9095 raft_consensus.cc:3055] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:47.501829  9095 raft_consensus.cc:740] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:47.502812  9095 consensus_queue.cc:260] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:45.924788  9099 log.cc:927] Time spent T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.330s	user 0.002s	sys 0.000s
I20260709 12:14:45.974671  9103 raft_consensus.cc:493] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:45.975001  9118 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:45.864316  9119 raft_consensus.cc:2749] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:14:46.103948  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 241920us
I20260709 12:14:46.171304  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:47.509963  5119 raft_consensus.cc:3060] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:47.514042  5831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46094 (request call id 976) took 3135 ms. Trace:
I20260709 12:14:47.514882  9052 consensus_queue.cc:1059] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:46.541527  9004 raft_consensus.cc:2804] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:46.091456  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:46.700959  9104 raft_consensus.cc:493] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:46.785583  5118 consensus_meta.cc:287] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.978s	user 0.016s	sys 0.002s
I20260709 12:14:46.879943  9132 raft_consensus.cc:2804] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:47.523483  5238 leader_election.cc:304] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:46.882170  5088 leader_election.cc:304] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:46.882966  9133 raft_consensus.cc:2749] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:46.893893  9089 consensus_queue.cc:1048] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:46.902415  9135 raft_consensus.cc:2804] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:46.906226  9136 raft_consensus.cc:2804] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:46.908120  9137 raft_consensus.cc:493] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:46.920994  9138 raft_consensus.cc:493] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:47.524089  9004 raft_consensus.cc:493] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:46.941615  5011 maintenance_manager.cc:643] P 221aa011207d421b9725197ff8bed389: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 2.051s	user 0.138s	sys 0.039s Metrics: {"bytes_written":30260,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":1182,"dirs.run_cpu_time_us":424,"dirs.run_wall_time_us":1117,"drs_written":1,"lbm_read_time_us":381,"lbm_reads_lt_1ms":4,"lbm_write_time_us":4490,"lbm_writes_lt_1ms":34,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":785,"threads_started":1,"update_count":4}
W20260709 12:14:47.093659  5163 leader_election.cc:336] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 1.550s (SENT)
W20260709 12:14:47.102934  5146 debug-util.cc:398] Leaking SignalData structure 0x7b08001d0300 after lost signal to thread 3922
I20260709 12:14:47.196902  9010 raft_consensus.cc:493] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.213685  9080 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.225805  9094 raft_consensus.cc:493] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.226276  9106 raft_consensus.cc:493] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:47.228406  8978 raft_consensus.cc:493] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.231559  9105 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:47.245105  9139 raft_consensus.cc:493] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.256460  5124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59390 (request call id 719) took 2940 ms. Trace:
I20260709 12:14:47.269698  5125 raft_consensus.cc:2410] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:14:47.269318  5116 rpcz_store.cc:276] 0709 12:14:44.356599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:44.460192 (+103593us) service_pool.cc:224] Handling call
0709 12:14:44.485658 (+ 25466us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:44.973456 (+487798us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:44.973491 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:45.038998 (+ 65507us) log.cc:844] Serialized 26 byte log entry
0709 12:14:45.237918 (+198920us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:14:45.237954 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.238014 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:45.880794 (+642780us) raft_consensus.cc:1685] finished
0709 12:14:45.880818 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:45.881034 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":802,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":34097,"thread_start_us":501166,"threads_started":2,"wal-append.queue_time_us":184902,"wal-append.run_cpu_time_us":22770,"wal-append.run_wall_time_us":1821519}
W20260709 12:14:47.284288  5240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:47.286314  9140 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:47.289455  8986 raft_consensus.cc:493] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:47.290093  5120 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.475s	user 0.024s	sys 0.041s
I20260709 12:14:47.290768  9036 raft_consensus.cc:493] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:47.330405  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 1.50543e+06us
I20260709 12:14:47.330948  8968 raft_consensus.cc:2804] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:14:47.333750  5200 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47728 (request call id 2198) took 1619 ms (client timeout 2091 ms). Trace:
I20260709 12:14:47.334812  5194 raft_consensus.cc:2410] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 12:14:47.338768  5271 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34672 (request call id 2098) took 2493 ms (client timeout 1511 ms). Trace:
W20260709 12:14:47.361471  5021 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33888 (request call id 335) took 29261 ms (client timeout 15000 ms). Trace:
I20260709 12:14:47.370714  9142 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.377991  5830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46088 (request call id 684) took 1570 ms. Trace:
W20260709 12:14:47.383778  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:47.384514  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 52342.3us
I20260709 12:14:47.385015  5833 rpcz_store.cc:276] 0709 12:14:44.275321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:44.275458 (+   137us) service_pool.cc:224] Handling call
0709 12:14:44.414227 (+138769us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:44.414599 (+   372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:44.414627 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:44.449617 (+ 34990us) log.cc:844] Serialized 26 byte log entry
0709 12:14:45.232179 (+782562us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:45.232223 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.232296 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:45.925457 (+693161us) raft_consensus.cc:1685] finished
0709 12:14:45.925482 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:45.925661 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13479,"raft.queue_time_us":92,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":11954,"thread_start_us":728528,"threads_started":1,"wal-append.queue_time_us":844146,"wal-append.run_cpu_time_us":48370,"wal-append.run_wall_time_us":1937412}
W20260709 12:14:47.394641  5834 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46088 (request call id 686) took 1586 ms (client timeout 2025 ms). Trace:
W20260709 12:14:47.396600  5836 rpcz_store.cc:269] 0709 12:14:45.807936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.811030 (+  3094us) service_pool.cc:224] Handling call
0709 12:14:47.396135 (+1585105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:47.409714  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:47.412981  5835 raft_consensus.cc:2468] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 9.
I20260709 12:14:47.413075  5121 raft_consensus.cc:2468] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 8.
I20260709 12:14:47.409204  9084 raft_consensus.cc:493] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.425441  8436 leader_election.cc:290] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:47.445964  5123 raft_consensus.cc:2393] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 12: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:47.446303  9059 raft_consensus.cc:493] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.448179  9146 consensus_queue.cc:1048] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 12:14:47.452966  8993 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:47.451534  8976 raft_consensus.cc:515] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:47.447161  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 70831.8us
I20260709 12:14:47.528458  9088 raft_consensus.cc:2804] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:47.550300  9004 raft_consensus.cc:3060] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:47.524318  9118 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:47.551069  5801 leader_election.cc:304] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:47.551527  5012 maintenance_manager.cc:419] P 221aa011207d421b9725197ff8bed389: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10166 bytes on disk
I20260709 12:14:47.552284  5801 leader_election.cc:304] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:47.463124  5019 catalog_manager.cc:5697] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 6 to 8, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 8 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:14:47.478118  9063 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:47.503491  9053 raft_consensus.cc:493] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.478051  9066 leader_election.cc:290] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:14:47.555140  5835 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46094 (request call id 996) took 1744 ms (client timeout 2099 ms). Trace:
I20260709 12:14:47.505296  9095 raft_consensus.cc:3060] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:47.505125  9103 raft_consensus.cc:515] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:47.565843  9139 raft_consensus.cc:515] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:47.514513  5831 rpcz_store.cc:276] 0709 12:14:44.378790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:44.930838 (+552048us) service_pool.cc:224] Handling call
0709 12:14:44.931140 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:44.931460 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:44.931485 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:44.931972 (+   487us) log.cc:844] Serialized 26 byte log entry
0709 12:14:45.224567 (+292595us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:14:45.224627 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:45.224731 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:45.917216 (+692485us) spinlock_profiling.cc:243] Waited 4.62 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e675e86e 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221 00007f84e67671d9 00007f84e6767169
0709 12:14:47.513707 (+1596491us) raft_consensus.cc:1685] finished
0709 12:14:47.513732 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:47.513972 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":98,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":78,"spinlock_wait_cycles":10630016,"thread_start_us":292154,"threads_started":1,"wal-append.queue_time_us":512332}
I20260709 12:14:47.520391  5829 raft_consensus.cc:2468] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 11.
W20260709 12:14:47.567406  5829 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46100 (request call id 1081) took 1596 ms (client timeout 1550 ms). Trace:
W20260709 12:14:47.567765  5829 rpcz_store.cc:269] 0709 12:14:45.970843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:46.091209 (+120366us) service_pool.cc:224] Handling call
0709 12:14:47.567335 (+1476126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:47.524137  5118 raft_consensus.cc:2468] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 7.
W20260709 12:14:46.882467  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 1.05291e+06us
I20260709 12:14:47.522755  5119 raft_consensus.cc:2468] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 9.
I20260709 12:14:47.524916  9132 raft_consensus.cc:493] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:47.569315  5194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47728 (request call id 2200) took 1754 ms. Trace:
W20260709 12:14:47.552670  5146 debug-util.cc:398] Leaking SignalData structure 0x7b080027fbe0 after lost signal to thread 3925
I20260709 12:14:47.569689  9132 raft_consensus.cc:3060] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:47.571333  5146 debug-util.cc:398] Leaking SignalData structure 0x7b0800292dc0 after lost signal to thread 5057
I20260709 12:14:47.571020  8986 raft_consensus.cc:515] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:47.572526  5146 debug-util.cc:398] Leaking SignalData structure 0x7b08003320c0 after lost signal to thread 5149
W20260709 12:14:47.572804  5146 debug-util.cc:398] Leaking SignalData structure 0x7b0800320760 after lost signal to thread 5150
I20260709 12:14:47.569705  5194 rpcz_store.cc:276] 0709 12:14:45.814706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.814812 (+   106us) service_pool.cc:224] Handling call
0709 12:14:47.569251 (+1754439us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:47.568979  5118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40402 (request call id 2310) took 1769 ms (client timeout 1820 ms). Trace:
I20260709 12:14:47.574074  9036 raft_consensus.cc:515] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:47.575120  5123 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40402 (request call id 2313) took 1705 ms (client timeout 2154 ms). Trace:
W20260709 12:14:47.527173  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 645039us
W20260709 12:14:47.575519  5123 rpcz_store.cc:269] 0709 12:14:45.870061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:47.263845 (+1393784us) service_pool.cc:224] Handling call
0709 12:14:47.574944 (+311099us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b54003ee754. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:47.575069 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":416097536}
I20260709 12:14:47.576323  9036 leader_election.cc:290] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:47.573823  9133 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.573459  8881 raft_consensus.cc:493] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.577133  9063 raft_consensus.cc:493] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:47.577244  8881 raft_consensus.cc:515] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:47.577731  9063 raft_consensus.cc:515] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:47.549834  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 456204us
I20260709 12:14:47.579849  9063 leader_election.cc:290] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:47.504779  9023 raft_consensus.cc:515] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:47.581478  9053 raft_consensus.cc:515] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:47.556103  5838 raft_consensus.cc:2468] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 11.
I20260709 12:14:47.573850  9010 raft_consensus.cc:515] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:47.584465  8896 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.585080  8896 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:47.585510  8976 leader_election.cc:290] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:47.573928  9140 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:47.576804  9059 raft_consensus.cc:515] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:47.553148  5121 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40402 (request call id 2314) took 1600 ms (client timeout 1683 ms). Trace:
W20260709 12:14:47.587204  5838 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46094 (request call id 998) took 1613 ms (client timeout 1645 ms). Trace:
W20260709 12:14:47.587688  5838 rpcz_store.cc:269] 0709 12:14:45.973578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:47.400721 (+1427143us) service_pool.cc:224] Handling call
0709 12:14:47.587143 (+186422us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:47.531668  9136 raft_consensus.cc:493] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:47.586153  5117 raft_consensus.cc:2393] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 11: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
W20260709 12:14:47.570035  5120 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.755s	user 0.025s	sys 0.041s
W20260709 12:14:47.569644  5119 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40402 (request call id 2311) took 1714 ms (client timeout 1771 ms). Trace:
I20260709 12:14:47.589571  5120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40402 (request call id 2306) took 1790 ms. Trace:
I20260709 12:14:47.525002  9061 raft_consensus.cc:515] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:47.549937  9088 raft_consensus.cc:493] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:47.552225  9118 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:47.562403  9080 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:47.563153  8968 raft_consensus.cc:493] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:47.563469  5830 rpcz_store.cc:276] 0709 12:14:45.807654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.815096 (+  7442us) service_pool.cc:224] Handling call
0709 12:14:47.377917 (+1562821us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:47.563951  5271 rpcz_store.cc:269] 0709 12:14:44.845642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:44.845737 (+    95us) service_pool.cc:224] Handling call
0709 12:14:47.338542 (+2492805us) spinlock_profiling.cc:243] Waited 859 ms on lock 0x7b54003c0354. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:47.338682 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1976203648}
I20260709 12:14:47.564673  9105 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:47.585512  9010 leader_election.cc:290] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:47.567890  9106 raft_consensus.cc:515] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:47.577072  9066 raft_consensus.cc:493] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.583359  9084 raft_consensus.cc:515] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:47.568956  9142 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:47.560921  8978 raft_consensus.cc:515] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:47.552675  5200 rpcz_store.cc:269] 0709 12:14:45.714271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.714400 (+   129us) service_pool.cc:224] Handling call
0709 12:14:47.333691 (+1619291us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:47.561312  9079 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:47.589639  5119 rpcz_store.cc:269] 0709 12:14:45.855192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:46.170969 (+315777us) service_pool.cc:224] Handling call
0709 12:14:47.569589 (+1398620us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:47.573613  5125 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59390 (request call id 735) took 1711 ms (client timeout 1520 ms). Trace:
I20260709 12:14:47.528288  9135 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:47.633949  9135 raft_consensus.cc:3060] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:47.634068  9142 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:47.634577  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:47.634717  8896 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:47.635326  5829 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46100 (request call id 1084) took 1664 ms (client timeout 1775 ms). Trace:
I20260709 12:14:47.635433  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:14:47.635720  5829 rpcz_store.cc:269] 0709 12:14:45.971308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:47.634290 (+1662982us) service_pool.cc:224] Handling call
0709 12:14:47.635268 (+   978us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:47.576076  5088 leader_election.cc:304] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
W20260709 12:14:47.590147  5117 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40402 (request call id 2307) took 1790 ms (client timeout 1510 ms). Trace:
W20260709 12:14:47.591593  5146 debug-util.cc:398] Leaking SignalData structure 0x7b080011f860 after lost signal to thread 5224
W20260709 12:14:47.590957  5121 rpcz_store.cc:269] 0709 12:14:45.953045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:46.089122 (+136077us) service_pool.cc:224] Handling call
0709 12:14:47.553091 (+1463969us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:14:47.555533  5835 rpcz_store.cc:269] 0709 12:14:45.810579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.827740 (+ 17161us) service_pool.cc:224] Handling call
0709 12:14:47.555082 (+1727342us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:47.588603  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:47.554008  5019 catalog_manager.cc:5697] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 4 to 7, leader changed from bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 7 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
W20260709 12:14:47.637871  5146 debug-util.cc:398] Leaking SignalData structure 0x7b080011f880 after lost signal to thread 5225
I20260709 12:14:47.638686  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:47.638597  5019 catalog_manager.cc:5697] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 4 to 10, leader changed from bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 10 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:47.639292  5836 raft_consensus.cc:2376] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 10. Re-sending same reply.
I20260709 12:14:47.637545  9010 raft_consensus.cc:2764] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:14:47.602006  9133 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:47.623682  5125 rpcz_store.cc:269] 0709 12:14:45.861994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.863360 (+  1366us) service_pool.cc:224] Handling call
0709 12:14:47.573540 (+1710180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:47.641005  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:47.589956  5120 rpcz_store.cc:276] 0709 12:14:45.798912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.800100 (+  1188us) service_pool.cc:224] Handling call
0709 12:14:45.800434 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:45.800753 (+   319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:45.800782 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:45.801219 (+   437us) log.cc:844] Serialized 26 byte log entry
0709 12:14:45.902578 (+101359us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b4800080058. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ebaecaa1 00007f84ebae3b37 00007f84ebae39ca 00007f84ebbdb26f 00007f84ebbdaf37 00007f84ebbef55c 00007f84ebbef508 00007f84ebbef488 00007f84ebbef443 00007f84ebbee6ec 00007f84eab18a96
0709 12:14:47.589148 (+1686570us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:14:47.589192 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:47.589269 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:47.589305 (+    36us) raft_consensus.cc:1685] finished
0709 12:14:47.589315 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:47.589516 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":949,"raft.run_cpu_time_us":883,"raft.run_wall_time_us":101042,"spinlock_wait_cycles":28338944,"thread_start_us":1773684,"threads_started":1,"wal-append.queue_time_us":142610,"wal-append.run_cpu_time_us":1552,"wal-append.run_wall_time_us":1001566}
W20260709 12:14:47.560477  5164 connection.cc:256] RPC call timeout handler was delayed by -1.476715798999976s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1896s for a response
I20260709 12:14:47.555555  8934 raft_consensus.cc:2749] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:14:47.553013  5834 rpcz_store.cc:269] 0709 12:14:45.808211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.811681 (+  3470us) service_pool.cc:224] Handling call
0709 12:14:47.394557 (+1582876us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:47.569769  5124 rpcz_store.cc:276] 0709 12:14:44.315989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:44.317528 (+  1539us) service_pool.cc:224] Handling call
0709 12:14:44.317819 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:45.235144 (+917325us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:47.256148 (+2021004us) spinlock_profiling.cc:243] Waited 597 ms on lock 0x7b5400304dd4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:47.256389 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1372024576}
W20260709 12:14:47.639201  5117 rpcz_store.cc:269] 0709 12:14:45.799219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.804286 (+  5067us) service_pool.cc:224] Handling call
0709 12:14:47.589945 (+1785659us) spinlock_profiling.cc:243] Waited 1.78 s on lock 0x7b54001b3354. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:47.590079 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4095014784}
I20260709 12:14:47.642546  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:47.637233  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 61263.1us
I20260709 12:14:47.643352  5124 raft_consensus.cc:2410] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:14:47.643770  5124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40402 (request call id 2315) took 1690 ms. Trace:
I20260709 12:14:47.644055  5124 rpcz_store.cc:276] 0709 12:14:45.953455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:47.642309 (+1688854us) service_pool.cc:224] Handling call
0709 12:14:47.643712 (+  1403us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:47.644907  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:47.645920  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:47.646540  5835 raft_consensus.cc:2468] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 8.
I20260709 12:14:47.647293  9089 consensus_queue.cc:1048] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:14:47.638991  5146 debug-util.cc:398] Leaking SignalData structure 0x7b08000ffa40 after lost signal to thread 5298
I20260709 12:14:47.641464  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:47.648545  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:47.641552  9053 leader_election.cc:290] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:47.647950  5164 connection.cc:256] RPC call timeout handler was delayed by -1.4503454430000602s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1867s for a response
I20260709 12:14:47.650444  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:47.647789  5116 raft_consensus.cc:2468] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 11.
W20260709 12:14:47.651383  5116 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40402 (request call id 2316) took 1697 ms (client timeout 2220 ms). Trace:
I20260709 12:14:47.651762  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:47.652293  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:47.648209  5146 debug-util.cc:398] Leaking SignalData structure 0x7b08003abc80 after lost signal to thread 5299
I20260709 12:14:47.607228  5011 maintenance_manager.cc:643] P 221aa011207d421b9725197ff8bed389: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.048s	user 0.002s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":370,"lbm_reads_lt_1ms":4}
W20260709 12:14:47.653229  5164 connection.cc:256] RPC call timeout handler was delayed by -1.3396454430001086s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.199s for a response
I20260709 12:14:47.616971  8968 raft_consensus.cc:3060] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:47.651721  5116 rpcz_store.cc:269] 0709 12:14:45.953733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:47.588322 (+1634589us) service_pool.cc:224] Handling call
0709 12:14:47.651330 (+ 63008us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:47.654706  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:47.557740  5021 rpcz_store.cc:269] 0709 12:14:18.100219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:18.117149 (+ 16930us) service_pool.cc:224] Handling call
0709 12:14:47.361321 (+29244172us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:45.689772 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:45.816275 (+126503us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:45.818240 (+  1965us) write_op.cc:435] Acquired schema lock
0709 12:14:45.819650 (+  1410us) tablet.cc:662] Decoding operations
0709 12:14:45.885569 (+ 65919us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:45.885636 (+    67us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:45.885666 (+    30us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:14:45.886095 (+   429us) tablet.cc:701] Row locks acquired
0709 12:14:45.886110 (+    15us) write_op.cc:260] PREPARE: finished
0709 12:14:45.886285 (+   175us) write_op.cc:270] Start()
0709 12:14:45.886401 (+   116us) write_op.cc:276] Timestamp: P: 1783599285886228 usec, L: 0
0709 12:14:45.886420 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:14:45.887271 (+   851us) log.cc:844] Serialized 1691 byte log entry
0709 12:14:45.984450 (+ 97179us) op_driver.cc:464] REPLICATION: finished
0709 12:14:45.990848 (+  6398us) write_op.cc:301] APPLY: starting
0709 12:14:45.990935 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:45.991474 (+   539us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:45.991892 (+   418us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:45.992515 (+   623us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:45.992704 (+   189us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:14:45.992747 (+    43us) write_op.cc:312] APPLY: finished
0709 12:14:45.993072 (+   325us) log.cc:844] Serialized 41 byte log entry
0709 12:14:45.993903 (+   831us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:45.994005 (+   102us) write_op.cc:454] Released schema lock
0709 12:14:45.994057 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:45.994442 (+   385us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:45.994467 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":730615,"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":6152,"apply.run_cpu_time_us":2711,"apply.run_wall_time_us":3566,"num_ops":4,"prepare.queue_time_us":688708,"prepare.run_cpu_time_us":17616,"prepare.run_wall_time_us":276531,"raft.queue_time_us":36075,"raft.run_cpu_time_us":3417,"raft.run_wall_time_us":5135,"replication_time_us":97836,"thread_start_us":367416,"threads_started":4,"wal-append.queue_time_us":58247}]]}
I20260709 12:14:47.655260  5116 raft_consensus.cc:2468] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 8.
I20260709 12:14:47.656229  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:47.573197  8986 leader_election.cc:290] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:47.612944  9148 raft_consensus.cc:493] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:47.523940  8975 raft_consensus.cc:3055] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:14:47.574326  5118 rpcz_store.cc:269] 0709 12:14:45.799986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.806240 (+  6254us) service_pool.cc:224] Handling call
0709 12:14:47.568906 (+1762666us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:47.660249  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:47.660638  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:47.660851  5191 raft_consensus.cc:2468] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 9.
I20260709 12:14:47.661207  5118 raft_consensus.cc:3060] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:47.617098  5837 raft_consensus.cc:2468] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 9.
W20260709 12:14:47.662515  5837 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46094 (request call id 995) took 1852 ms (client timeout 1986 ms). Trace:
I20260709 12:14:47.662578  5089 leader_election.cc:304] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:47.663381  9057 raft_consensus.cc:2804] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:47.588570  9136 raft_consensus.cc:3060] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:47.586230  8976 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:47.583248  9023 leader_election.cc:290] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:14:47.664135  5146 debug-util.cc:398] Leaking SignalData structure 0x7b08001bd9a0 after lost signal to thread 5862
I20260709 12:14:47.618990  5832 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 6.
I20260709 12:14:47.526684  9104 raft_consensus.cc:515] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:47.663932  9057 raft_consensus.cc:493] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:47.664915  9057 raft_consensus.cc:3060] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:47.666167  9104 leader_election.cc:290] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:47.669950  8986 raft_consensus.cc:493] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.670565  8986 raft_consensus.cc:515] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:47.662906  5837 rpcz_store.cc:269] 0709 12:14:45.810183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.828006 (+ 17823us) service_pool.cc:224] Handling call
0709 12:14:47.662364 (+1834358us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b540068ef54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:47.662464 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":504422272}
I20260709 12:14:47.672549  5837 raft_consensus.cc:1240] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 12. Current term is 13. Ops: []
I20260709 12:14:47.672744  8986 leader_election.cc:290] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:47.673583  9010 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.674093  9010 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:47.674863  5124 raft_consensus.cc:3060] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:47.664529  5146 debug-util.cc:398] Leaking SignalData structure 0x7b080026ed00 after lost signal to thread 5863
I20260709 12:14:47.640538  5019 catalog_manager.cc:5697] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 7 to 8, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 8 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
W20260709 12:14:47.675758  5832 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46088 (request call id 688) took 1867 ms (client timeout 1572 ms). Trace:
W20260709 12:14:47.601410  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 49167.9us
I20260709 12:14:47.676602  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:47.677165  5198 raft_consensus.cc:3060] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:47.624493  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:47.624379  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:47.568702  9094 raft_consensus.cc:515] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:47.627302  9080 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:47.629458  9139 leader_election.cc:290] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:47.631440  8978 leader_election.cc:290] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:47.632015  9105 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:47.623018  9066 raft_consensus.cc:515] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:47.649546  9133 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:47.696218  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:47.614135  9036 raft_consensus.cc:3060] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:47.697808  9010 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:47.698228  9094 leader_election.cc:290] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:47.659860  9148 raft_consensus.cc:515] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:47.698899  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:47.699738  5266 raft_consensus.cc:2410] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:14:47.625828  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:47.696282  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:47.696205  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:47.602005  8963 raft_consensus.cc:2749] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:47.601756  9063 raft_consensus.cc:493] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:47.629292  9106 leader_election.cc:290] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:47.637281  9061 leader_election.cc:290] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:47.607034  9088 raft_consensus.cc:3060] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:47.641834  5831 raft_consensus.cc:2410] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 12 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:14:47.712450  5274 raft_consensus.cc:1240] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 10 LEADER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:47.642622  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:47.637684  9103 leader_election.cc:290] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:47.637573  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:47.612000  5240 leader_election.cc:304] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:47.713131  5117 raft_consensus.cc:2468] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 7.
I20260709 12:14:47.676084  5019 catalog_manager.cc:5697] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 reported cstate change: config changed from index 4 to 6, term changed from 7 to 10, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to <none>, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129), VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130), VOTER 9e794b72ed7640219f90ec4232363929 (127.3.212.131), VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 10 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
W20260709 12:14:47.656701  5164 connection.cc:256] RPC call timeout handler was delayed by -1.1443454430000202s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2207s for a response
I20260709 12:14:47.648270  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:14:47.714124  5164 connection.cc:256] RPC call timeout handler was delayed by -1.108345442999962s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2247s for a response
I20260709 12:14:47.714474  5838 raft_consensus.cc:2468] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 12.
I20260709 12:14:47.639906  5836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46094 (request call id 997) took 1829 ms. Trace:
I20260709 12:14:47.647512  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:47.715221  5836 rpcz_store.cc:276] 0709 12:14:45.810826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:47.638444 (+1827618us) service_pool.cc:224] Handling call
0709 12:14:47.639814 (+  1370us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:47.649453  8993 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:47.653183  9084 leader_election.cc:290] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:47.658728  8896 raft_consensus.cc:493] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.664237  8976 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:47.726528  8976 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:47.726300  8968 raft_consensus.cc:515] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:47.726974  5266 raft_consensus.cc:1275] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:14:47.728073  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:47.728688  9148 leader_election.cc:290] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:47.658046  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:47.730962  5163 leader_election.cc:336] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 1.511s (SENT)
I20260709 12:14:47.637822  9079 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:47.679476  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:47.733399  5801 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:47.679910  5119 raft_consensus.cc:2410] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:14:47.734090  5270 raft_consensus.cc:2393] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 10: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:47.625903  8881 leader_election.cc:290] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:47.680336  5123 raft_consensus.cc:2410] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:14:47.681598  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:47.683441  5837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46100 (request call id 1083) took 1712 ms. Trace:
W20260709 12:14:47.602561  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 79181.9us
I20260709 12:14:47.737113  5193 raft_consensus.cc:3060] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:47.676151  5832 rpcz_store.cc:269] 0709 12:14:45.808749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.808854 (+   105us) service_pool.cc:224] Handling call
0709 12:14:47.673342 (+1864488us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b5400779cd4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:47.675696 (+  2354us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":515196160}
W20260709 12:14:47.684816  5088 connection.cc:256] RPC call timeout handler was delayed by -1.678203774000167s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1645s for a response
I20260709 12:14:47.685256  5089 leader_election.cc:304] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
W20260709 12:14:47.738729  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 53562.3us
I20260709 12:14:47.712055  9119 raft_consensus.cc:493] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.740960  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:47.741741  5266 raft_consensus.cc:2468] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 8.
I20260709 12:14:47.723619  9061 raft_consensus.cc:3060] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:47.743091  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:47.745748  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:14:47.750906  5163 leader_election.cc:336] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 1.658s (SENT)
I20260709 12:14:47.753170  5119 raft_consensus.cc:2468] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 9.
I20260709 12:14:47.747066  5836 raft_consensus.cc:1240] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:47.754554  5804 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:47.616783  9059 leader_election.cc:290] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:47.659945  5116 raft_consensus.cc:2468] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 6.
I20260709 12:14:47.659011  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:47.689489  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:47.690600  5196 raft_consensus.cc:1240] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:47.703215  5830 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 6.
I20260709 12:14:47.696604  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:47.761421  5199 raft_consensus.cc:2468] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 10.
W20260709 12:14:47.761739  5830 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46100 (request call id 1086) took 1790 ms (client timeout 1743 ms). Trace:
I20260709 12:14:47.762145  5193 raft_consensus.cc:2468] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 9.
I20260709 12:14:47.762595  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:47.762192  5830 rpcz_store.cc:269] 0709 12:14:45.971595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:47.625591 (+1653996us) service_pool.cc:224] Handling call
0709 12:14:47.761664 (+136073us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:47.707638  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:47.764097  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:47.764307  5271 raft_consensus.cc:2468] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 7.
I20260709 12:14:47.764858  5199 raft_consensus.cc:2393] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 10: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:47.713096  5834 raft_consensus.cc:1240] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:47.714663  5019 catalog_manager.cc:5697] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 2 to 4, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 4 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:14:47.639158  9140 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:47.715782  5835 raft_consensus.cc:3060] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:47.713871  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 102043us
I20260709 12:14:47.685693  8975 raft_consensus.cc:740] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:47.720856  5829 raft_consensus.cc:2393] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 9: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:47.701808  9066 leader_election.cc:290] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:47.605500  9137 raft_consensus.cc:515] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:47.649565  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:47.732149  5124 raft_consensus.cc:2468] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 8.
I20260709 12:14:47.782917  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:47.690917  9104 consensus_queue.cc:1059] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:14:47.733459  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:47.737180  5837 rpcz_store.cc:276] 0709 12:14:45.971167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:47.672063 (+1700896us) service_pool.cc:224] Handling call
0709 12:14:47.672370 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:47.683246 (+ 10876us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:47.683388 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:47.739037  5238 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:14:47.791332  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 52364us
I20260709 12:14:47.790477  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:47.685866  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:47.738313  5088 connection.cc:256] RPC call timeout handler was delayed by -1.6602037740001379s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1665s for a response
W20260709 12:14:47.793078  5088 connection.cc:256] RPC call timeout handler was delayed by -1.6413037740001073s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1686s for a response
W20260709 12:14:47.793437  5088 connection.cc:256] RPC call timeout handler was delayed by -1.6026037740000447s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17290000000000003s for a response
W20260709 12:14:47.793733  5088 connection.cc:256] RPC call timeout handler was delayed by -1.5936037740000302s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17390000000000003s for a response
W20260709 12:14:47.794054  5088 connection.cc:256] RPC call timeout handler was delayed by -1.4847037740000815s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18600000000000003s for a response
W20260709 12:14:47.794363  5088 connection.cc:256] RPC call timeout handler was delayed by -1.4757037740000669s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18700000000000003s for a response
W20260709 12:14:47.794646  5088 connection.cc:256] RPC call timeout handler was delayed by -1.4460037740000189s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19030000000000002s for a response
I20260709 12:14:47.740026  5089 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:47.794829  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:47.742198  5270 raft_consensus.cc:1275] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 12:14:47.794901  5088 connection.cc:256] RPC call timeout handler was delayed by -1.3569037740001022s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2002s for a response
I20260709 12:14:47.796185  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:47.796880  8976 raft_consensus.cc:2804] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:47.797339  8976 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:47.797533  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:47.742739  5123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59390 (request call id 736) took 1769 ms. Trace:
I20260709 12:14:47.798147  5123 rpcz_store.cc:276] 0709 12:14:45.973599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:47.614842 (+1641243us) service_pool.cc:224] Handling call
0709 12:14:47.742684 (+127842us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:47.798771  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:47.799140  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:47.799906  5123 raft_consensus.cc:2393] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 11: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:47.799773  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:47.800681  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:47.801560  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:47.741170  9095 raft_consensus.cc:493] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
W20260709 12:14:47.795357  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 55413.6us
I20260709 12:14:47.802403  5199 raft_consensus.cc:2410] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:14:47.801285  5123 raft_consensus.cc:2468] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 11.
I20260709 12:14:47.803082  8968 leader_election.cc:290] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:47.803404  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:47.753525  5163 leader_election.cc:304] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
W20260709 12:14:47.804502  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 53642.1us
W20260709 12:14:47.805096  5163 leader_election.cc:336] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 1.661s (SENT)
I20260709 12:14:47.702620  5267 raft_consensus.cc:2468] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 9.
I20260709 12:14:47.801671  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:47.806783  5089 leader_election.cc:304] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:14:47.758132  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:47.807972  5119 raft_consensus.cc:3060] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:47.618530  9138 raft_consensus.cc:515] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:47.748905  9079 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:47.760063  9103 raft_consensus.cc:2749] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:47.740604  9148 consensus_queue.cc:1059] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:14:47.745682  9119 raft_consensus.cc:515] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:47.743180  9089 raft_consensus.cc:2804] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:47.768796  9057 raft_consensus.cc:515] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:47.710119  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:47.742899  9004 raft_consensus.cc:515] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:47.830760  9089 raft_consensus.cc:493] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:47.765859  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:47.831781  5197 raft_consensus.cc:2468] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 9.
I20260709 12:14:47.769867  9084 raft_consensus.cc:2804] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:47.769516  9136 raft_consensus.cc:515] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:47.733129  8896 raft_consensus.cc:515] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:47.770881  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:47.728767  5117 raft_consensus.cc:2468] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 10.
I20260709 12:14:47.783671  5120 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 9.
I20260709 12:14:47.783640  5193 raft_consensus.cc:2468] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 12.
W20260709 12:14:47.784601  5829 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46100 (request call id 1080) took 1814 ms (client timeout 2095 ms). Trace:
I20260709 12:14:47.773814  5019 catalog_manager.cc:5697] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 7 to 9, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 9 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:47.847734  5270 raft_consensus.cc:1240] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:47.848906  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:47.811147  8968 raft_consensus.cc:2749] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:47.712735  9063 raft_consensus.cc:515] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:47.792670  5125 raft_consensus.cc:2468] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 9.
W20260709 12:14:47.796453  5088 connection.cc:256] RPC call timeout handler was delayed by -1.3452037740000833s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2015s for a response
I20260709 12:14:47.797776  8976 raft_consensus.cc:3060] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:47.754563  5836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46100 (request call id 1087) took 1782 ms. Trace:
I20260709 12:14:47.853710  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:47.853996  5836 rpcz_store.cc:276] 0709 12:14:45.971803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:47.739024 (+1767221us) service_pool.cc:224] Handling call
0709 12:14:47.746865 (+  7841us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:47.754330 (+  7465us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:47.754511 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:47.854369  5267 raft_consensus.cc:2468] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 10.
I20260709 12:14:47.801795  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:47.855260  5266 raft_consensus.cc:2410] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:14:47.584980  9132 raft_consensus.cc:515] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:47.687638  5118 raft_consensus.cc:2468] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 7.
I20260709 12:14:47.857975  5804 leader_election.cc:304] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:47.834721  9142 raft_consensus.cc:3055] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:47.809414  5268 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 6.
I20260709 12:14:47.793792  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:47.810361  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:47.802208  9095 raft_consensus.cc:515] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:47.706604  5198 raft_consensus.cc:2468] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 11.
I20260709 12:14:47.869259  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:47.869611  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:47.870533  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:47.870826  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:47.872042  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:47.816568  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:47.813120  5238 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:14:47.873281  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 60231us
I20260709 12:14:47.815169  5240 leader_election.cc:304] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:47.817596  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:47.874639  5238 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:47.834123  9084 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:47.821638  5166 leader_election.cc:304] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
W20260709 12:14:47.897509  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 75936.8us
I20260709 12:14:47.832227  8436 consensus_queue.cc:1059] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:14:47.827191  5271 raft_consensus.cc:1240] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:47.801848  9062 raft_consensus.cc:2804] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:47.829053  5121 raft_consensus.cc:2468] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 11.
I20260709 12:14:47.830056  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:47.828420  5801 leader_election.cc:304] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:47.790925  9059 raft_consensus.cc:493] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.836969  5196 raft_consensus.cc:2368] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 9. Current term is 10.
I20260709 12:14:47.837949  5833 raft_consensus.cc:2468] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 9.
I20260709 12:14:47.851287  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:47.847756  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:47.848764  5019 catalog_manager.cc:5697] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:14:47.822872  9104 raft_consensus.cc:3055] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:14:47.851820  5829 rpcz_store.cc:269] 0709 12:14:45.970655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:47.636409 (+1665754us) service_pool.cc:224] Handling call
0709 12:14:47.784542 (+148133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:47.800608  5269 raft_consensus.cc:2410] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
W20260709 12:14:47.855618  5088 connection.cc:256] RPC call timeout handler was delayed by -1.2399037740001404s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21320000000000003s for a response
I20260709 12:14:47.868336  9103 raft_consensus.cc:2804] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:47.831262  9089 raft_consensus.cc:3060] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:47.856473  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:47.999529  5117 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 10.
I20260709 12:14:47.797168  9023 consensus_queue.cc:1048] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 12:14:47.805651  9088 raft_consensus.cc:515] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:47.861050  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
W20260709 12:14:47.999009  5088 connection.cc:256] RPC call timeout handler was delayed by -1.2237037740001142s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.215s for a response
I20260709 12:14:47.761745  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:47.867468  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:48.001801  5116 raft_consensus.cc:2468] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 7.
I20260709 12:14:48.001874  5124 raft_consensus.cc:2468] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 9.
I20260709 12:14:47.812434  5834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46100 (request call id 1082) took 1841 ms. Trace:
I20260709 12:14:47.865012  5192 raft_consensus.cc:2468] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:14:47.872413  5120 raft_consensus.cc:2393] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 10: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:47.820924  5835 raft_consensus.cc:2468] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 10.
I20260709 12:14:47.874637  5119 raft_consensus.cc:2410] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:14:47.875645  5199 raft_consensus.cc:2410] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
W20260709 12:14:47.876933  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 61840.2us
I20260709 12:14:47.882541  5125 raft_consensus.cc:2410] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:14:47.875124  5200 raft_consensus.cc:2468] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 8.
I20260709 12:14:47.854983  9010 raft_consensus.cc:2804] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:47.895932  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:48.010169  5194 raft_consensus.cc:2393] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 11: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:48.010605  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:48.011994  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:47.896121  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:47.853211  9036 raft_consensus.cc:2749] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:47.898233  5122 raft_consensus.cc:2393] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 8: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:47.824608  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:47.857154  8975 consensus_queue.cc:260] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:47.826565  9135 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:47.898684  9145 raft_consensus.cc:2804] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:48.023993  5199 raft_consensus.cc:1240] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:14:47.903826  5274 raft_consensus.cc:3060] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:47.904808  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:14:47.918588  5091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:47.901530  9084 raft_consensus.cc:3060] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:47.965667  8436 consensus_queue.cc:1243] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer 9e794b72ed7640219f90ec4232363929 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:14:47.903077  8968 raft_consensus.cc:2804] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:47.987848  9057 leader_election.cc:290] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:47.866107  9142 raft_consensus.cc:740] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:48.056090  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:47.989161  9136 leader_election.cc:290] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:47.990424  5019 catalog_manager.cc:5697] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 3 to 11, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 11 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:48.060454  5019 catalog_manager.cc:5697] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 2 to 8. New cstate: current_term: 8 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:14:48.029309  9145 raft_consensus.cc:493] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:47.994215  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:47.834590  8993 consensus_queue.cc:1048] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 12:14:47.998186  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:48.029577  9010 raft_consensus.cc:697] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:48.000696  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
W20260709 12:14:48.001421  5088 connection.cc:256] RPC call timeout handler was delayed by -1.1553037740000036s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22260000000000002s for a response
W20260709 12:14:48.005045  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 176698us
I20260709 12:14:48.005499  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:48.002772  5834 rpcz_store.cc:276] 0709 12:14:45.971010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:47.650035 (+1679025us) service_pool.cc:224] Handling call
0709 12:14:47.650296 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:47.772549 (+122253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:47.812216 (+ 39667us) spinlock_profiling.cc:243] Waited 62.6 ms on lock 0x7b54004e5a54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:47.812379 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":144008576}
I20260709 12:14:48.004825  5240 leader_election.cc:304] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
W20260709 12:14:48.008354  5833 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46100 (request call id 1088) took 2036 ms (client timeout 1696 ms). Trace:
W20260709 12:14:48.085552  5833 rpcz_store.cc:269] 0709 12:14:45.972047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:47.612801 (+1640754us) service_pool.cc:224] Handling call
0709 12:14:48.008148 (+395347us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b54005cadd4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:48.008274 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":464096000}
I20260709 12:14:47.900053  9118 raft_consensus.cc:2749] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:14:48.085111  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 80386.4us
I20260709 12:14:48.086905  5240 leader_election.cc:304] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:48.014925  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:48.087798  5836 raft_consensus.cc:3060] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:48.016588  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:48.017951  5265 raft_consensus.cc:2410] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:14:48.018883  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:48.021231  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:48.089862  5119 raft_consensus.cc:2410] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for term 12 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:14:47.904672  9037 raft_consensus.cc:2804] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:48.091838  9037 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:48.092253  9037 raft_consensus.cc:3060] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:48.027164  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:48.094575  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:48.027943  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:48.095678  5116 raft_consensus.cc:2393] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 8: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:48.029230  5123 raft_consensus.cc:2393] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 11: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:48.089207  5125 raft_consensus.cc:2468] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 8.
I20260709 12:14:48.031545  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:48.097445  5117 raft_consensus.cc:3060] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:48.035218  9062 raft_consensus.cc:697] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 10 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:48.037429  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:48.098146  5240 leader_election.cc:304] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:48.098512  5118 raft_consensus.cc:2393] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 9: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
W20260709 12:14:48.038367  5122 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40402 (request call id 2308) took 2238 ms (client timeout 2091 ms). Trace:
I20260709 12:14:48.004112  9103 raft_consensus.cc:493] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:48.054375  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:48.099187  5240 leader_election.cc:304] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:48.099864  5270 raft_consensus.cc:2468] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 7.
I20260709 12:14:48.100432  5240 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:48.100865  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:48.101558  5270 raft_consensus.cc:3060] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:47.999331  9104 raft_consensus.cc:740] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:48.038060  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:48.055711  5274 raft_consensus.cc:2468] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 8.
I20260709 12:14:48.059059  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:48.105077  5272 raft_consensus.cc:2468] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 10.
I20260709 12:14:48.024278  9094 raft_consensus.cc:2804] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:48.062609  5019 catalog_manager.cc:5697] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:14:47.992393  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:48.000146  5191 raft_consensus.cc:2468] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 8.
I20260709 12:14:48.108263  5121 raft_consensus.cc:2468] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 8.
I20260709 12:14:48.067873  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:48.109048  5125 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
new_leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
 from {username='slave'} at 127.0.0.1:45628
I20260709 12:14:48.109246  5273 raft_consensus.cc:2468] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 8.
I20260709 12:14:48.070194  9138 leader_election.cc:290] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:48.056257  8968 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:48.109974  9094 raft_consensus.cc:493] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:48.055364  9132 leader_election.cc:290] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:48.110270  8968 raft_consensus.cc:3060] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:48.111279  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:48.112337  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:48.112865  5273 raft_consensus.cc:2468] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 9.
I20260709 12:14:48.079084  5829 raft_consensus.cc:3060] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:48.113219  9037 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:48.114059  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:48.114693  9094 raft_consensus.cc:3060] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:48.077567  5196 raft_consensus.cc:2393] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 10: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:48.089018  5120 raft_consensus.cc:2468] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 8.
I20260709 12:14:48.116307  9037 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:48.090039  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:48.091290  9036 raft_consensus.cc:2804] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:48.117233  9036 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:48.067929  9145 raft_consensus.cc:3060] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:48.109726  5125 raft_consensus.cc:606] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Received request to transfer leadership to TS dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:48.118149  5125 raft_consensus.cc:614] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:48.034762  5164 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
W20260709 12:14:48.118984  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 84381.3us
I20260709 12:14:48.119832  5125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59390 (request call id 732) took 2294 ms. Trace:
I20260709 12:14:48.084669  5801 leader_election.cc:304] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:14:48.099056  5122 rpcz_store.cc:269] 0709 12:14:45.799519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:45.826867 (+ 27348us) service_pool.cc:224] Handling call
0709 12:14:48.038160 (+2211293us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540024a254. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:48.038294 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2336731904}
I20260709 12:14:48.120221  5125 rpcz_store.cc:276] 0709 12:14:45.825284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:48.118951 (+2293667us) service_pool.cc:224] Handling call
0709 12:14:48.119242 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:48.119526 (+   284us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:48.119554 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:48.119596 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:48.119624 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:48.119679 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:48.119781 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:48.121330  5122 raft_consensus.cc:1240] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:48.121940  5122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59390 (request call id 733) took 2288 ms. Trace:
I20260709 12:14:48.104727  5271 raft_consensus.cc:2368] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 6. Current term is 7.
I20260709 12:14:48.068701  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:48.122562  5194 raft_consensus.cc:2468] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 12.
I20260709 12:14:48.122946  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:48.122088  9094 raft_consensus.cc:515] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:48.123682  5271 raft_consensus.cc:2393] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 8: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:48.124411  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:48.116469  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:48.124964  5271 raft_consensus.cc:2468] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 7.
I20260709 12:14:48.109176  5269 raft_consensus.cc:2393] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 8: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:48.125154  9094 leader_election.cc:290] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:48.125674  5196 raft_consensus.cc:3060] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:48.117326  5195 raft_consensus.cc:2368] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 9. Current term is 10.
I20260709 12:14:48.126736  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:48.007583  9059 raft_consensus.cc:515] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:48.127414  5269 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 9.
I20260709 12:14:48.120433  9052 raft_consensus.cc:2749] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:14:48.117655  9036 raft_consensus.cc:3060] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:48.131877  9059 leader_election.cc:290] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:48.133560  5122 rpcz_store.cc:276] 0709 12:14:45.833352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:48.120896 (+2287544us) service_pool.cc:224] Handling call
0709 12:14:48.121173 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:48.121723 (+   550us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:48.121890 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:48.128351  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:48.120007  5164 leader_election.cc:304] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:48.133937  9094 raft_consensus.cc:2764] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:14:48.136489  5164 leader_election.cc:400] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Vote denied by peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539) with higher term. Message: Invalid argument: T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 9. Current term is 10.
I20260709 12:14:48.137589  9052 raft_consensus.cc:2804] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:48.128278  5267 raft_consensus.cc:2410] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 12:14:48.128959  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 44397.1us
I20260709 12:14:48.139024  5801 leader_election.cc:304] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:48.139787  5267 raft_consensus.cc:1240] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 4. Current term is 5. Ops: []
I20260709 12:14:48.140667  5801 leader_election.cc:304] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:48.141812  9139 consensus_queue.cc:1048] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:14:48.143445  9139 raft_consensus.cc:2804] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:48.143862  9139 raft_consensus.cc:493] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:48.144240  9139 raft_consensus.cc:3060] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:48.146514  9053 consensus_queue.cc:1059] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:14:48.148028  9138 raft_consensus.cc:3055] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:48.148474  9138 raft_consensus.cc:740] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:48.149936  5122 raft_consensus.cc:1240] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:48.149434  9138 consensus_queue.cc:260] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:48.150638  5122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40402 (request call id 2312) took 2294 ms. Trace:
I20260709 12:14:48.150997  5122 rpcz_store.cc:276] 0709 12:14:45.856167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:48.134467 (+2278300us) service_pool.cc:224] Handling call
0709 12:14:48.149558 (+ 15091us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b5800002a98. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb9cfc0 00007f84ebb87929 00007f84ebb873d2 00007f84e50febd4
0709 12:14:48.149769 (+   211us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:48.150364 (+   595us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:48.150580 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31767296}
I20260709 12:14:48.152405  5125 raft_consensus.cc:1240] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:48.153259  5125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59390 (request call id 734) took 2319 ms. Trace:
I20260709 12:14:48.153669  5125 rpcz_store.cc:276] 0709 12:14:45.836718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:48.121186 (+2284468us) service_pool.cc:224] Handling call
0709 12:14:48.152236 (+ 31050us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:48.152898 (+   662us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:48.153202 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:48.155282  9138 raft_consensus.cc:3060] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:48.157352  5829 raft_consensus.cc:2468] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 10.
I20260709 12:14:48.141024  5267 raft_consensus.cc:1240] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:48.138221  9052 raft_consensus.cc:697] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:48.160156  9052 consensus_queue.cc:237] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:48.160912  5196 raft_consensus.cc:2468] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 7.
I20260709 12:14:48.162714  8968 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:48.163897  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:48.168367  5274 raft_consensus.cc:2468] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 7.
I20260709 12:14:48.077869  9004 leader_election.cc:290] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:48.164191  5121 raft_consensus.cc:1240] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:48.108705  5019 catalog_manager.cc:5697] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 4 to 7, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 7 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } }
I20260709 12:14:48.173935  5121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59390 (request call id 731) took 2352 ms. Trace:
I20260709 12:14:48.174324  5121 rpcz_store.cc:276] 0709 12:14:45.821057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:48.163749 (+2342692us) service_pool.cc:224] Handling call
0709 12:14:48.164028 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:48.173679 (+  9651us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:48.173879 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:48.174562  5019 catalog_manager.cc:5697] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 5 to 6, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 6 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:14:48.176155  5019 catalog_manager.cc:5697] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 4 to 9, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 9 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:48.177094  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:48.179704  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:48.181217  5836 raft_consensus.cc:2468] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 12.
I20260709 12:14:48.181248  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:48.183099  9094 raft_consensus.cc:2749] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:48.183435  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:48.183701  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:48.184257  5274 raft_consensus.cc:2468] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 11.
I20260709 12:14:48.183061  5265 raft_consensus.cc:3060] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:48.182643  5164 leader_election.cc:304] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
W20260709 12:14:48.185184  9161 log.cc:927] Time spent T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:14:48.105510  9103 raft_consensus.cc:3060] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:48.107743  9024 raft_consensus.cc:2804] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:14:48.107898  9066 raft_consensus.cc:2804] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:48.197921  5121 raft_consensus.cc:1240] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:14:48.186233  5019 catalog_manager.cc:5697] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } }
I20260709 12:14:48.200362  5269 raft_consensus.cc:2468] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:14:48.203410  5801 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:48.173736  9118 raft_consensus.cc:2804] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:48.228235  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:48.235102  5267 raft_consensus.cc:2393] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 7: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:48.208000  5164 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:48.238116  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:48.238834  5274 raft_consensus.cc:2468] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 10.
I20260709 12:14:48.178527  9063 leader_election.cc:290] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:14:48.255836  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 52532.3us
I20260709 12:14:48.205253  9024 raft_consensus.cc:493] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:48.256996  5265 raft_consensus.cc:2468] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 9.
I20260709 12:14:48.201036  5019 catalog_manager.cc:5697] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 2 to 5, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 5 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } }
I20260709 12:14:48.248099  5117 raft_consensus.cc:2468] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 7.
I20260709 12:14:48.064567  9142 consensus_queue.cc:260] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:48.195291  9119 leader_election.cc:290] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:48.258335  5801 leader_election.cc:304] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:48.232771  8986 raft_consensus.cc:2804] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:48.205572  9066 raft_consensus.cc:493] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:48.255224  9061 raft_consensus.cc:2749] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:48.240667  8896 leader_election.cc:290] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:48.232179  9037 raft_consensus.cc:2804] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:48.261795  9142 raft_consensus.cc:3060] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:48.260241  5019 catalog_manager.cc:5697] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:48.259563  8993 raft_consensus.cc:2804] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:48.257663  9118 raft_consensus.cc:697] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 8 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
W20260709 12:14:48.290925  5166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:48.291360  5163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:48.266489  5801 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:48.258882  9106 raft_consensus.cc:2749] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:48.299459  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:14:48.300314  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 199949us
I20260709 12:14:48.301059  5240 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:48.301682  5125 raft_consensus.cc:1275] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:14:48.302028  5240 leader_election.cc:304] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:48.304231  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:48.304940  5274 raft_consensus.cc:3060] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:48.277763  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:48.280289  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:48.282631  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:48.260998  9024 raft_consensus.cc:3060] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:48.284863  5122 raft_consensus.cc:1240] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:48.285656  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:48.285874  5019 catalog_manager.cc:5697] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } }
I20260709 12:14:48.286693  5197 raft_consensus.cc:1275] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:14:48.287137  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:48.310832  5199 raft_consensus.cc:3060] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:48.286762  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:48.287668  5802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:48.298372  5804 leader_election.cc:304] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:48.314694  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:48.314911  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:48.315548  5192 raft_consensus.cc:2468] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 9.
I20260709 12:14:48.315881  5122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40402 (request call id 2318) took 2361 ms. Trace:
I20260709 12:14:48.300239  5271 raft_consensus.cc:2468] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 11.
I20260709 12:14:48.315516  5195 raft_consensus.cc:2393] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 12: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:48.309175  5019 catalog_manager.cc:5697] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 7 to 10, leader changed from bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 10 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:14:48.316278  5240 leader_election.cc:304] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:48.316226  5122 rpcz_store.cc:276] 0709 12:14:45.955493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:48.151887 (+2196394us) service_pool.cc:224] Handling call
0709 12:14:48.284689 (+132802us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:48.307909 (+ 23220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:48.315822 (+  7913us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:48.267498  8986 raft_consensus.cc:493] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:48.320006  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:48.325687  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:48.320485  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:48.327052  5196 raft_consensus.cc:3060] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:48.320711  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:48.328297  5191 raft_consensus.cc:3060] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:48.330358  5240 leader_election.cc:304] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
W20260709 12:14:48.334846  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 68705us
I20260709 12:14:48.337395  5801 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:48.319001  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:48.348107  5122 raft_consensus.cc:2468] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 8.
I20260709 12:14:48.268759  9105 raft_consensus.cc:3055] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:48.269155  9066 raft_consensus.cc:3060] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:48.269408  9020 raft_consensus.cc:2749] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:48.322261  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:48.345489  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:48.317816  5019 catalog_manager.cc:5697] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 4 to 7, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 7 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:48.286963  9052 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.289609  9037 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:48.302942  9088 leader_election.cc:290] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:48.353865  5193 raft_consensus.cc:3060] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:48.352353  5019 catalog_manager.cc:5697] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 5 to 6, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 6 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:48.333530  8986 raft_consensus.cc:3060] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:48.289991  8993 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:48.359179  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:48.329790  9166 raft_consensus.cc:2804] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:48.258837  9010 consensus_queue.cc:237] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:48.351840  5240 leader_election.cc:304] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:48.363324  5196 raft_consensus.cc:2468] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 11.
W20260709 12:14:48.364434  9162 log.cc:927] Time spent T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 12:14:48.361851  9059 raft_consensus.cc:2804] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:48.369880  9037 raft_consensus.cc:3060] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:48.370429  8934 consensus_queue.cc:1059] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:14:48.387475  8993 raft_consensus.cc:3060] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:48.319567  9119 raft_consensus.cc:2804] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:48.374316  5089 leader_election.cc:304] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:48.439757  9119 raft_consensus.cc:493] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:48.440061  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 65855.4us
I20260709 12:14:48.440425  9119 raft_consensus.cc:3060] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:48.440912  5089 leader_election.cc:304] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:48.380623  5125 raft_consensus.cc:1240] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 12. Current term is 13. Ops: []
I20260709 12:14:48.442269  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:48.442976  5125 raft_consensus.cc:2393] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 7: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:48.443917  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:48.444471  5125 raft_consensus.cc:3060] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:48.380988  5270 raft_consensus.cc:2468] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 11.
I20260709 12:14:48.381839  5274 raft_consensus.cc:2468] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 9.
I20260709 12:14:48.446204  5166 leader_election.cc:304] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:48.445572  9132 raft_consensus.cc:2804] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:14:48.351193  9105 raft_consensus.cc:740] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:48.359790  5122 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
new_leader_uuid: "bce73265e27d4b30a4dcc1e491305088"
 from {username='slave'} at 127.0.0.1:45628
I20260709 12:14:48.491797  5122 raft_consensus.cc:606] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Received request to transfer leadership to TS bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:48.492229  5122 raft_consensus.cc:614] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:48.385473  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:48.388522  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:48.494314  5272 raft_consensus.cc:3060] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:48.388576  5838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46100 (request call id 1085) took 2417 ms. Trace:
I20260709 12:14:48.392297  5116 raft_consensus.cc:1275] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:14:48.393337  9137 leader_election.cc:290] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:48.349946  8963 raft_consensus.cc:2749] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:48.402462  5199 raft_consensus.cc:2468] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 7.
W20260709 12:14:48.394487  9164 log.cc:927] Time spent T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:14:48.407080  5118 raft_consensus.cc:1240] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 11. Current term is 12. Ops: []
I20260709 12:14:48.409420  9135 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:48.412861  8975 raft_consensus.cc:3060] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:48.414184  9170 raft_consensus.cc:493] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.383730  9104 consensus_queue.cc:260] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:48.288512  9062 consensus_queue.cc:237] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:48.416632  5121 raft_consensus.cc:1275] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:14:48.514370  9170 raft_consensus.cc:515] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:48.517320  9104 raft_consensus.cc:3060] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:48.497939  9173 raft_consensus.cc:493] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.518118  9173 raft_consensus.cc:515] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:48.358927  9089 raft_consensus.cc:515] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:48.520728  9089 leader_election.cc:290] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:48.380504  9052 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:48.522962  5119 raft_consensus.cc:2368] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 9. Current term is 10.
I20260709 12:14:48.421922  5117 raft_consensus.cc:1275] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:14:48.493813  9004 raft_consensus.cc:2804] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:48.525805  9004 raft_consensus.cc:493] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:48.526266  9004 raft_consensus.cc:3060] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:48.423370  8976 consensus_meta.cc:287] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.547s	user 0.006s	sys 0.002s
I20260709 12:14:48.527408  8976 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:48.493682  9079 consensus_queue.cc:1059] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:14:48.425915  9118 consensus_queue.cc:237] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:48.426620  9095 leader_election.cc:290] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:48.528618  8881 raft_consensus.cc:3055] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:48.429944  8968 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:48.405742  9020 raft_consensus.cc:2749] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:48.406642  9166 raft_consensus.cc:697] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 7 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:48.529160  8881 raft_consensus.cc:740] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:48.499063  9132 raft_consensus.cc:697] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:48.530014  9166 consensus_queue.cc:237] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:48.530289  9132 consensus_queue.cc:237] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:48.437683  9023 raft_consensus.cc:2804] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:48.324872  9061 raft_consensus.cc:2804] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:48.357774  5273 raft_consensus.cc:2468] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 12.
I20260709 12:14:48.533329  9061 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:48.371260  5191 raft_consensus.cc:2468] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 9.
I20260709 12:14:48.533860  9061 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:48.416934  9036 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:48.440213  8978 raft_consensus.cc:2804] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:48.530146  8881 consensus_queue.cc:260] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:48.534538  8978 raft_consensus.cc:697] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:48.534893  8881 raft_consensus.cc:3060] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:48.528721  5123 raft_consensus.cc:1240] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:48.535418  8978 consensus_queue.cc:237] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:48.528939  9105 consensus_queue.cc:260] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:48.536520  5091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:48.495241  5116 pending_rounds.cc:85] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting all ops after (but not including) 6
I20260709 12:14:48.537561  5116 pending_rounds.cc:107] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 12:14:48.439849  9053 raft_consensus.cc:3055] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:48.403908  9059 raft_consensus.cc:493] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:48.538236  9053 raft_consensus.cc:740] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:48.538486  9059 raft_consensus.cc:3060] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:48.537828  5116 raft_consensus.cc:2889] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:48.533236  9023 raft_consensus.cc:493] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:48.495115  5838 rpcz_store.cc:276] 0709 12:14:45.971454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:47.736083 (+1764629us) service_pool.cc:224] Handling call
0709 12:14:47.736374 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:47.736740 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:14:47.743787 (+  7047us) log.cc:844] Serialized 14 byte log entry
0709 12:14:47.748003 (+  4216us) spinlock_profiling.cc:243] Waited 2 ms on lock 0x7b18004cfc00. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3ad63f3 00007f84e3ad87c1 00007f84e3ad8779 00007f84e3ad8709 00007f84e3ad86d1 00007f84e3ad79cd 0000000000388634 0000000000388479 00007f84e3ab983a
0709 12:14:47.749878 (+  1875us) spinlock_profiling.cc:243] Waited 4.46 ms on lock 0x7b18004cfc00. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3ab8e07 00007f84ec9139a9 00007f84e3ad569b 00007f84e3ad393f 00007f84e3ad5c02 00007f84e675d20b 00007f84e6762d23 00007f84e676323a 00007f84e6bcda2a
0709 12:14:47.900862 (+150984us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:47.901618 (+   756us) log.cc:844] Serialized 26 byte log entry
0709 12:14:47.901769 (+   151us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:47.901968 (+   199us) log.cc:844] Serialized 14 byte log entry
0709 12:14:47.903882 (+  1914us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:47.903955 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:47.988101 (+ 84146us) spinlock_profiling.cc:243] Waited 1.08 ms on lock 0x7b18004cfc00. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3ad63f3 00007f84e3ad87c1 00007f84e3ad8779 00007f84e3ad8709 00007f84e3ad86d1 00007f84e3ad79cd 0000000000388634 0000000000388479 00007f84e3ab983a
0709 12:14:48.388326 (+400225us) raft_consensus.cc:1685] finished
0709 12:14:48.388348 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:48.388496 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49644,"prepare.queue_time_us":7525,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":80,"raft.queue_time_us":56331,"raft.run_cpu_time_us":308,"raft.run_wall_time_us":8723,"spinlock_wait_cycles":17343488,"thread_start_us":144154,"threads_started":1,"wal-append.queue_time_us":279853}
I20260709 12:14:48.561169  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:48.561995  5274 raft_consensus.cc:2468] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 11.
I20260709 12:14:48.563009  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:48.589875  5271 raft_consensus.cc:2393] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 7: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:48.597709  5268 raft_consensus.cc:2368] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 8. Current term is 9.
I20260709 12:14:48.588766  9023 raft_consensus.cc:3060] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:48.620951  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 413014us
I20260709 12:14:48.621770  5164 leader_election.cc:304] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:48.624202  5116 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
new_leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
 from {username='slave'} at 127.0.0.1:45628
I20260709 12:14:48.628582  5274 raft_consensus.cc:1240] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 11. Current term is 12. Ops: []
I20260709 12:14:48.632594  5193 raft_consensus.cc:2468] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 8.
I20260709 12:14:48.621317  5166 leader_election.cc:304] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:48.643862  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:48.645049  5274 raft_consensus.cc:2393] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 9: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:48.646833  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:48.647727  5274 raft_consensus.cc:2468] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 12.
W20260709 12:14:48.648759  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 322815us
I20260709 12:14:48.657107  5125 raft_consensus.cc:2468] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 12.
I20260709 12:14:48.658876  5164 leader_election.cc:304] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
W20260709 12:14:48.667001  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 315211us
I20260709 12:14:48.663307  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:48.668349  5274 raft_consensus.cc:2468] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 9.
I20260709 12:14:48.668654  5240 leader_election.cc:304] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:48.662165  5164 leader_election.cc:304] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
W20260709 12:14:48.674669  5088 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.012s	sys 0.004s
I20260709 12:14:48.675596  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:48.676391  5088 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.013s	sys 0.004s
I20260709 12:14:48.676342  5125 raft_consensus.cc:2468] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 8.
I20260709 12:14:48.677431  9184 raft_consensus.cc:2804] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:48.679009  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:48.679675  5123 raft_consensus.cc:2376] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 9. Re-sending same reply.
I20260709 12:14:48.679752  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:48.680512  5117 raft_consensus.cc:2376] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 7. Re-sending same reply.
W20260709 12:14:48.681054  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 597959us
I20260709 12:14:48.682917  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:48.682740  9186 raft_consensus.cc:2804] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:14:48.683698  5117 raft_consensus.cc:2393] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 9: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:48.685067  5240 leader_election.cc:304] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:48.684976  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:48.685334  9189 consensus_queue.cc:1059] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:14:48.685653  5166 leader_election.cc:400] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 election: Vote denied by peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443) with higher term. Message: Invalid argument: T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 9. Current term is 10.
W20260709 12:14:48.688879  5088 leader_election.cc:336] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 1.729s (SENT)
I20260709 12:14:48.689126  5166 leader_election.cc:403] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:14:48.690662  5088 leader_election.cc:304] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:48.662972  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:48.626482  9105 raft_consensus.cc:3060] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:48.696329  5088 leader_election.cc:336] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 1.739s (SENT)
I20260709 12:14:48.696827  5088 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:48.664872  5804 leader_election.cc:304] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:48.699534  5271 raft_consensus.cc:2393] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 11: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:48.701128  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:48.701835  5274 raft_consensus.cc:2468] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 11.
I20260709 12:14:48.686893  9186 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:48.708390  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:48.710867  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:48.711730  5274 raft_consensus.cc:2468] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 9.
I20260709 12:14:48.712216  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:48.714088  5123 raft_consensus.cc:1275] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:14:48.718462  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:48.722870  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:48.726121  9192 raft_consensus.cc:3055] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:14:48.726619  9192 raft_consensus.cc:740] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:48.727480  9192 consensus_queue.cc:260] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:48.728377  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:48.729074  5834 raft_consensus.cc:3060] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:48.728766  9192 raft_consensus.cc:3060] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:48.733922  9188 raft_consensus.cc:2804] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:48.734416  9188 raft_consensus.cc:493] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:48.734750  9188 raft_consensus.cc:3060] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:48.738530  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 76436.6us
W20260709 12:14:48.741063  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 51092.3us
I20260709 12:14:48.737200  5834 raft_consensus.cc:2468] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 10.
I20260709 12:14:48.742400  5116 raft_consensus.cc:606] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Received request to transfer leadership to TS dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:14:48.740602  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 393053us
I20260709 12:14:48.742842  5116 raft_consensus.cc:614] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:48.742527  5124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40386 (request call id 2024) took 1099 ms. Trace:
I20260709 12:14:48.743392  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:14:48.744315  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 48021.5us
W20260709 12:14:48.745467  5088 leader_election.cc:336] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 1.860s (SENT)
I20260709 12:14:48.745889  5088 leader_election.cc:304] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:48.746201  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:48.746119  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:48.749586  5274 raft_consensus.cc:2376] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 11. Re-sending same reply.
I20260709 12:14:48.661231  9175 raft_consensus.cc:2764] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 12:14:48.759601  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 422265us
I20260709 12:14:48.666788  9174 raft_consensus.cc:2804] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:48.695166  8896 raft_consensus.cc:2749] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:48.738049  9187 raft_consensus.cc:3060] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:48.750538  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
W20260709 12:14:48.743950  9139 consensus_meta.cc:287] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.599s	user 0.019s	sys 0.008s
I20260709 12:14:48.751749  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:48.756479  9133 raft_consensus.cc:2749] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:48.692780  9184 raft_consensus.cc:697] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [term 7 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:48.759262  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:48.760607  5801 leader_election.cc:304] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:48.760164  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:48.694335  9063 consensus_queue.cc:1059] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 12:14:48.804945  5837 raft_consensus.cc:2468] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 11.
I20260709 12:14:48.759922  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:48.806777  9173 leader_election.cc:290] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:48.706894  9148 raft_consensus.cc:2804] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:48.764115  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:48.706583  9095 raft_consensus.cc:2749] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:48.596424  9053 consensus_queue.cc:260] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:48.751271  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:14:48.786072  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 44272.6us
I20260709 12:14:48.712634  9020 raft_consensus.cc:2804] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:48.850209  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:48.851238  5271 raft_consensus.cc:2393] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 7: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:48.789168  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:48.796090  8976 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:48.797222  9106 consensus_queue.cc:1059] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:14:48.799049  9139 raft_consensus.cc:515] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:48.715723  9186 raft_consensus.cc:3060] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:48.800920  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:48.801652  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:48.747112  9135 raft_consensus.cc:2749] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:48.697747  9079 consensus_queue.cc:1048] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 12:14:48.689103  9189 consensus_queue.cc:1059] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 12:14:48.807539  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:48.740871  8963 consensus_queue.cc:1048] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.088s
I20260709 12:14:48.765517  9174 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:48.813288  5274 raft_consensus.cc:3060] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:48.698081  9176 consensus_queue.cc:1059] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.130s
I20260709 12:14:48.740698  9094 consensus_queue.cc:1048] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.066s
W20260709 12:14:48.842764  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 157741us
I20260709 12:14:48.907037  5238 leader_election.cc:304] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:14:48.862130  9179 log.cc:927] Time spent T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
W20260709 12:14:48.865353  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 104804us
I20260709 12:14:48.913175  5801 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:48.864133  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:14:48.880566  9024 consensus_meta.cc:287] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.547s	user 0.006s	sys 0.013s
W20260709 12:14:48.894441  9172 log.cc:927] Time spent T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.483s	user 0.002s	sys 0.002s
I20260709 12:14:48.813334  9175 consensus_queue.cc:1059] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.091s
I20260709 12:14:48.821652  9170 leader_election.cc:290] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:48.931576  9190 raft_consensus.cc:2749] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:48.930459  9192 raft_consensus.cc:3055] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:48.932284  9192 raft_consensus.cc:740] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:48.933521  9036 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:48.933188  9192 consensus_queue.cc:260] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:48.931716  9139 leader_election.cc:290] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:48.941345  9053 raft_consensus.cc:3060] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:48.924144  9138 consensus_meta.cc:287] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.768s	user 0.010s	sys 0.009s
W20260709 12:14:48.943289  9119 consensus_meta.cc:287] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.502s	user 0.008s	sys 0.000s
I20260709 12:14:48.943746  9119 raft_consensus.cc:515] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:48.944584  9148 raft_consensus.cc:493] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:48.945125  9148 raft_consensus.cc:3060] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:48.926079  8934 consensus_queue.cc:1048] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.020s
W20260709 12:14:48.946199  8986 consensus_meta.cc:287] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.560s	user 0.014s	sys 0.006s
I20260709 12:14:48.946707  8986 raft_consensus.cc:515] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:48.948872  8986 leader_election.cc:290] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:48.950279  9084 consensus_meta.cc:287] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.892s	user 0.008s	sys 0.013s
I20260709 12:14:48.950765  9084 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:48.954846  5273 raft_consensus.cc:1240] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 8 LEADER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:48.927593  9094 raft_consensus.cc:2749] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:14:48.956540  5835 raft_consensus.cc:2393] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 9: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
W20260709 12:14:48.929461  9142 consensus_meta.cc:287] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.630s	user 0.020s	sys 0.008s
I20260709 12:14:48.957731  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:48.928937  9037 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:48.958602  5273 raft_consensus.cc:2393] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 5: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:48.959138  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:48.900621  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:14:48.879410  9103 consensus_meta.cc:287] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.638s	user 0.018s	sys 0.012s
I20260709 12:14:48.850724  9020 raft_consensus.cc:493] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:48.960199  9037 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:48.859668  9052 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:48.911281  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:48.960063  9103 raft_consensus.cc:515] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:48.967502  9066 consensus_meta.cc:287] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.591s	user 0.006s	sys 0.014s
I20260709 12:14:48.968003  9066 raft_consensus.cc:515] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:48.895027  5831 raft_consensus.cc:2368] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 9. Current term is 10.
I20260709 12:14:48.961197  9004 raft_consensus.cc:515] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:48.915829  9189 consensus_queue.cc:1243] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer ad2f9a1e2f7a45429fa69fd23d09f821 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:14:48.921485  9195 raft_consensus.cc:3055] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:48.970731  9195 raft_consensus.cc:740] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:48.970834  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:48.971398  9004 leader_election.cc:290] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:48.971987  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:48.973048  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:48.969098  9103 leader_election.cc:290] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:48.865763  9180 consensus_queue.cc:1048] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.106s
I20260709 12:14:48.915371  9176 raft_consensus.cc:3055] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:48.971599  9195 consensus_queue.cc:260] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:48.960520  9020 raft_consensus.cc:3060] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:48.904289  9174 raft_consensus.cc:3060] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:48.952607  9024 raft_consensus.cc:515] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:48.982172  9180 consensus_queue.cc:1243] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer ad2f9a1e2f7a45429fa69fd23d09f821 log is divergent from this leader: its last log entry 6.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 12:14:48.985706  9145 consensus_meta.cc:287] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.868s	user 0.015s	sys 0.004s
I20260709 12:14:48.982662  9176 raft_consensus.cc:740] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:49.003894  9188 raft_consensus.cc:515] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:48.993904  9106 raft_consensus.cc:3055] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:14:48.934473  9184 consensus_queue.cc:237] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:48.997937  9195 raft_consensus.cc:3060] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:49.014146  9188 leader_election.cc:290] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:49.016999  9176 consensus_queue.cc:260] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:49.018894  9176 raft_consensus.cc:3060] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:49.037788  9187 raft_consensus.cc:2749] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443) with higher term. Message: Invalid argument: T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 9. Current term is 10.
W20260709 12:14:48.756893  5088 leader_election.cc:336] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 1.870s (SENT)
I20260709 12:14:49.077600  5088 leader_election.cc:304] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:14:49.080384  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 323471us
I20260709 12:14:49.089702  5088 leader_election.cc:304] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:49.095515  9210 raft_consensus.cc:2749] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:14:49.098023  5091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:49.101719  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 340392us
I20260709 12:14:49.112176  5163 leader_election.cc:304] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:48.837247  5166 leader_election.cc:304] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:48.907761  5240 leader_election.cc:304] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
W20260709 12:14:49.139984  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 232160us
I20260709 12:14:48.959470  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:48.920259  5274 raft_consensus.cc:2468] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 10.
I20260709 12:14:48.927402  5801 leader_election.cc:304] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:48.857831  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:48.965310  5832 raft_consensus.cc:2468] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 9.
I20260709 12:14:48.967643  5833 raft_consensus.cc:2368] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 8. Current term is 9.
I20260709 12:14:49.170490  9103 raft_consensus.cc:2749] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:14:49.170941  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 243458us
I20260709 12:14:49.171424  5266 raft_consensus.cc:2393] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 10: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:49.171841  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:49.172816  5801 leader_election.cc:304] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:48.960108  5837 raft_consensus.cc:2393] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 10: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
W20260709 12:14:49.115760  5198 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.001s	sys 0.001s
W20260709 12:14:49.203562  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 366280us
W20260709 12:14:49.204025  5198 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.001s	sys 0.001s
I20260709 12:14:49.122713  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:49.205878  5267 raft_consensus.cc:2468] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 9.
W20260709 12:14:49.206910  9208 log.cc:927] Time spent T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 12:14:49.207279  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:49.207613  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:49.208809  5832 raft_consensus.cc:2393] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 8: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
W20260709 12:14:49.124104  8993 consensus_meta.cc:287] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.678s	user 0.000s	sys 0.012s
W20260709 12:14:49.122705  5804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:49.209096  9181 raft_consensus.cc:2749] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:49.209511  8993 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:49.210278  5266 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34674 (request call id 2257) took 1310 ms (client timeout 1739 ms). Trace:
W20260709 12:14:49.210832  5266 rpcz_store.cc:269] 0709 12:14:47.899989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:48.014243 (+114254us) service_pool.cc:224] Handling call
0709 12:14:49.210026 (+1195783us) spinlock_profiling.cc:243] Waited 812 ms on lock 0x7b540029fc54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:49.210175 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1867078912}
I20260709 12:14:49.212725  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:49.213151  5829 raft_consensus.cc:3060] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:14:49.113353  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 373257us
I20260709 12:14:49.215670  5268 raft_consensus.cc:1275] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:14:49.124994  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:49.208962  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:49.218147  5271 raft_consensus.cc:2393] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 9: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:48.973652  9023 raft_consensus.cc:515] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:49.135046  5831 raft_consensus.cc:2468] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 7.
I20260709 12:14:49.220448  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:49.221678  5831 raft_consensus.cc:2393] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 8: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
W20260709 12:14:49.222299  9203 log.cc:927] Time spent T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.208s	user 0.002s	sys 0.000s
I20260709 12:14:49.222965  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:14:49.218220  9201 log.cc:927] Time spent T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.204s	user 0.000s	sys 0.002s
I20260709 12:14:49.224705  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:49.136235  5270 raft_consensus.cc:1240] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:49.220086  9192 raft_consensus.cc:3060] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:49.136757  5125 raft_consensus.cc:1240] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 LEADER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 11. Current term is 12. Ops: []
I20260709 12:14:49.225617  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:14:49.136960  5803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:49.001617  9145 raft_consensus.cc:515] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:49.129490  9210 raft_consensus.cc:2804] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:48.998258  9084 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:14:49.115908  5237 leader_election.cc:336] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Timed out: RequestConsensusVote RPC to 127.3.212.130:44455 timed out after 1.510s (SENT)
W20260709 12:14:49.227123  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 115262us
I20260709 12:14:49.216933  5164 leader_election.cc:304] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:49.029733  9148 raft_consensus.cc:515] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:49.162158  9066 leader_election.cc:290] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:14:49.162667  5802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:49.010828  9106 raft_consensus.cc:740] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:49.142167  5273 raft_consensus.cc:3060] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:49.235217  9148 leader_election.cc:290] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:49.236332  5831 raft_consensus.cc:2393] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 11: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:49.152940  9024 leader_election.cc:290] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:49.141350  5240 leader_election.cc:304] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:49.168591  5265 raft_consensus.cc:1240] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 6. Current term is 7. Ops: []
I20260709 12:14:49.173149  5833 raft_consensus.cc:2368] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 9. Current term is 10.
I20260709 12:14:48.963289  5835 raft_consensus.cc:2393] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 10: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:49.174103  5830 raft_consensus.cc:2468] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 12.
I20260709 12:14:49.176105  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:49.247141  5274 raft_consensus.cc:2393] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 11: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:48.743871  5124 rpcz_store.cc:276] 0709 12:14:47.643568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:48.384409 (+740841us) service_pool.cc:224] Handling call
0709 12:14:48.384697 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:48.384905 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:14:48.650627 (+265722us) log.cc:844] Serialized 14 byte log entry
0709 12:14:48.742199 (+ 91572us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:48.742250 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:48.742291 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:48.742368 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:48.742474 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":15691,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":1659,"thread_start_us":341003,"threads_started":2,"wal-append.queue_time_us":78665}
I20260709 12:14:48.977787  9061 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:49.247713  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:49.249096  5163 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:49.001783  9119 leader_election.cc:290] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:49.250732  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 78114.4us
I20260709 12:14:49.198685  5089 leader_election.cc:304] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:49.227084  9210 raft_consensus.cc:493] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:49.199319  9205 log.cc:927] Time spent T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 12:14:49.200054  9170 raft_consensus.cc:3055] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:49.253901  9170 raft_consensus.cc:740] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:49.255236  9170 consensus_queue.cc:260] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:49.257392  5830 raft_consensus.cc:1240] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:14:49.257570  9170 raft_consensus.cc:3060] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:49.257854  5829 raft_consensus.cc:2468] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 11.
W20260709 12:14:49.259250  9105 consensus_meta.cc:287] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.549s	user 0.000s	sys 0.014s
W20260709 12:14:49.201479  9209 log.cc:927] Time spent T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 12:14:49.201846  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:49.263159  5838 raft_consensus.cc:2410] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:14:49.202392  9204 log.cc:927] Time spent T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.187s	user 0.000s	sys 0.002s
I20260709 12:14:49.265563  5198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41416 (request call id 715) took 1483 ms. Trace:
I20260709 12:14:49.266008  5198 rpcz_store.cc:276] 0709 12:14:47.782149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:48.022825 (+240676us) service_pool.cc:224] Handling call
0709 12:14:48.278896 (+256071us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:48.344334 (+ 65438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:48.344365 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:48.377322 (+ 32957us) log.cc:844] Serialized 52 byte log entry
0709 12:14:49.201212 (+823890us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e675e86e 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221 00007f84e67671d9 00007f84e6767169
0709 12:14:49.204957 (+  3745us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:49.205093 (+   136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:49.205221 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:49.265154 (+ 59933us) raft_consensus.cc:1685] finished
0709 12:14:49.265174 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:49.265435 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11543,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":19046,"spinlock_wait_cycles":281919232,"thread_start_us":678609,"threads_started":2,"wal-append.queue_time_us":604662}
I20260709 12:14:49.203090  9187 raft_consensus.cc:2749] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:49.269838  9197 raft_consensus.cc:2804] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:49.270697  9173 raft_consensus.cc:3060] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:49.248551  5164 leader_election.cc:304] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:49.274492  9197 raft_consensus.cc:697] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:49.275758  5120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40402 (request call id 2331) took 1486 ms. Trace:
I20260709 12:14:49.276535  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:49.277628  5116 raft_consensus.cc:2393] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 10: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:49.279012  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:49.280723  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:49.281646  5119 raft_consensus.cc:3060] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:49.282130  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 148929us
W20260709 12:14:49.286304  5166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:49.226673  5837 raft_consensus.cc:2368] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 9. Current term is 11.
I20260709 12:14:49.148257  9062 raft_consensus.cc:2804] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:49.227610  5269 raft_consensus.cc:1240] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:49.227631  5237 leader_election.cc:304] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:49.212617  8993 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:49.230492  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:49.231487  5266 raft_consensus.cc:2393] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 9: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:49.240914  5268 raft_consensus.cc:1275] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:14:49.241976  9180 raft_consensus.cc:2804] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:14:49.243691  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 102597us
I20260709 12:14:49.244410  9066 raft_consensus.cc:2804] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:49.244978  9145 leader_election.cc:290] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:49.305435  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 56527.9us
I20260709 12:14:49.251029  9119 raft_consensus.cc:2749] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:49.147447  9193 consensus_queue.cc:1059] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
W20260709 12:14:49.306167  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 57829.2us
I20260709 12:14:49.307142  9193 raft_consensus.cc:2804] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:49.307627  9193 raft_consensus.cc:493] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:49.308106  9193 raft_consensus.cc:3060] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:49.250048  9061 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:49.310426  9198 consensus_queue.cc:1059] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:49.310771  5801 leader_election.cc:304] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:49.248142  5835 raft_consensus.cc:1240] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 11. Current term is 12. Ops: []
I20260709 12:14:49.311492  5123 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
new_leader_uuid: "bce73265e27d4b30a4dcc1e491305088"
 from {username='slave'} at 127.0.0.1:45628
I20260709 12:14:49.253700  9210 raft_consensus.cc:3060] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:49.312546  5123 raft_consensus.cc:606] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Received request to transfer leadership to TS bce73265e27d4b30a4dcc1e491305088
W20260709 12:14:49.295728  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 97421.2us
I20260709 12:14:49.311096  5119 raft_consensus.cc:2468] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 9.
I20260709 12:14:49.298022  5088 leader_election.cc:304] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:49.276203  5120 rpcz_store.cc:276] 0709 12:14:47.789423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:48.414288 (+624865us) service_pool.cc:224] Handling call
0709 12:14:48.414624 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:48.414833 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:14:48.748891 (+334058us) log.cc:844] Serialized 14 byte log entry
0709 12:14:49.275079 (+526188us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:49.275190 (+   111us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:49.275279 (+    89us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:49.275378 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:49.275580 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16471,"prepare.queue_time_us":2786,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":56553,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":189,"thread_start_us":779835,"threads_started":2}
W20260709 12:14:49.304111  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 188512us
I20260709 12:14:49.304348  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:49.304792  9024 raft_consensus.cc:2749] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:49.245842  9023 leader_election.cc:290] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:14:49.322741  5163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:49.323357  5273 raft_consensus.cc:2468] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 10.
I20260709 12:14:49.311609  9198 raft_consensus.cc:3055] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:49.334590  9084 raft_consensus.cc:2804] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:49.334897  5801 leader_election.cc:304] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:49.333751  9198 raft_consensus.cc:740] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:49.337577  9211 raft_consensus.cc:2804] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:49.338382  9211 raft_consensus.cc:697] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:49.332779  9181 consensus_queue.cc:1048] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 12:14:49.342811  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:49.344909  5121 raft_consensus.cc:2368] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 10. Current term is 11.
I20260709 12:14:49.345337  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:49.345927  9213 log.cc:927] Time spent T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.149s	user 0.002s	sys 0.000s
I20260709 12:14:49.337678  9119 raft_consensus.cc:2804] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:49.346695  9119 raft_consensus.cc:697] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 9 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:49.347186  9212 raft_consensus.cc:2804] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:49.324206  9062 raft_consensus.cc:697] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 9 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:49.327181  9180 raft_consensus.cc:697] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:49.348080  9084 raft_consensus.cc:493] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:49.348562  9084 raft_consensus.cc:3060] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:49.349153  9180 consensus_queue.cc:237] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:49.350606  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:49.275981  9197 consensus_queue.cc:237] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:49.326298  9066 raft_consensus.cc:697] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 7 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:49.338398  9145 consensus_queue.cc:1059] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 12:14:49.347824  9212 raft_consensus.cc:697] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:49.354476  9145 consensus_queue.cc:1243] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer ad2f9a1e2f7a45429fa69fd23d09f821 log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:14:49.358958  9061 raft_consensus.cc:3055] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:14:49.359431  9061 raft_consensus.cc:740] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:49.359624  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:14:49.360212  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:49.361155  5120 raft_consensus.cc:3060] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:49.361941  9119 consensus_queue.cc:237] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:49.346127  5123 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 8.
I20260709 12:14:49.358901  9212 consensus_queue.cc:237] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:49.369939  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:49.337211  9198 consensus_queue.cc:260] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:49.353835  9066 consensus_queue.cc:237] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:49.373049  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:49.370947  5088 leader_election.cc:304] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:49.374033  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:49.376739  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:49.376488  9061 consensus_queue.cc:260] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:49.377486  5118 raft_consensus.cc:2393] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 9: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:49.378275  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:49.378100  9061 raft_consensus.cc:3060] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:49.386083  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
W20260709 12:14:49.390461  5272 consensus_meta.cc:287] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.896s	user 0.007s	sys 0.019s
I20260709 12:14:49.390971  5272 raft_consensus.cc:2468] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 8.
I20260709 12:14:49.391598  5272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34674 (request call id 2281) took 1070 ms. Trace:
I20260709 12:14:49.391927  5272 rpcz_store.cc:276] 0709 12:14:48.321093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:48.388188 (+ 67095us) service_pool.cc:224] Handling call
0709 12:14:49.391487 (+1003299us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:49.392562  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:49.393796  9132 raft_consensus.cc:2764] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:14:49.394773  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:49.348820  9020 raft_consensus.cc:515] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:49.395501  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 68837us
W20260709 12:14:49.394766  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 60678us
I20260709 12:14:49.393739  5119 raft_consensus.cc:2468] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 7.
I20260709 12:14:49.392702  9193 raft_consensus.cc:515] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:49.406036  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:49.369699  9211 consensus_queue.cc:237] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:49.410396  9215 log.cc:927] Time spent T 00000000000000000000000000000000 P 221aa011207d421b9725197ff8bed389: Append to log took a long time: real 0.073s	user 0.001s	sys 0.002s
I20260709 12:14:49.417073  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:49.425094  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:49.425417  5832 raft_consensus.cc:1275] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:14:49.434080  9198 raft_consensus.cc:3060] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:49.379827  9062 consensus_queue.cc:237] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:49.443219  9020 leader_election.cc:290] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:49.422245  5118 raft_consensus.cc:3060] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:49.465900  5120 raft_consensus.cc:2468] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 9.
I20260709 12:14:49.464823  5122 pending_rounds.cc:85] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting all ops after (but not including) 5
I20260709 12:14:49.464764  8896 raft_consensus.cc:493] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:49.472021  9059 consensus_meta.cc:287] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.857s	user 0.008s	sys 0.023s
I20260709 12:14:49.471915  8896 raft_consensus.cc:515] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:49.472575  9059 raft_consensus.cc:515] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:49.474623  8896 leader_election.cc:290] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:49.474781  9059 leader_election.cc:290] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:49.475975  9186 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:49.478374  9186 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:49.478945  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:49.481061  5198 raft_consensus.cc:1275] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:14:49.468791  5122 pending_rounds.cc:107] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 12:14:49.489856  5122 raft_consensus.cc:2889] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:49.496349  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:49.497229  5835 raft_consensus.cc:2393] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 11: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:49.499318  5089 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:49.502843  5118 raft_consensus.cc:2468] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 12.
I20260709 12:14:49.504807  9173 raft_consensus.cc:2749] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:14:49.505674  5836 raft_consensus.cc:2468] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 9.
I20260709 12:14:49.507851  5125 raft_consensus.cc:1275] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:14:49.511243  5240 leader_election.cc:304] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:49.468461  9106 consensus_queue.cc:260] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:49.515581  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:49.516458  5837 raft_consensus.cc:2393] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 10: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:49.510699  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:49.519325  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:49.523963  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:49.523952  5118 raft_consensus.cc:1275] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:14:49.525899  5123 raft_consensus.cc:3060] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:49.526476  9106 raft_consensus.cc:3060] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:49.529762  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:49.530853  5831 raft_consensus.cc:2368] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 9. Current term is 10.
I20260709 12:14:49.532366  5198 raft_consensus.cc:2393] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 10: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
W20260709 12:14:49.533516  9174 consensus_meta.cc:287] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.539s	user 0.007s	sys 0.009s
I20260709 12:14:49.534019  9174 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:49.536672  9174 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:49.557574  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 75994.1us
W20260709 12:14:49.567149  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 55981.5us
I20260709 12:14:49.557823  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:49.558395  9089 raft_consensus.cc:2804] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:14:49.558602  9218 log.cc:927] Time spent T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.135s	user 0.001s	sys 0.001s
I20260709 12:14:49.550649  5832 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 10.
I20260709 12:14:49.550323  5804 leader_election.cc:304] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:49.551596  5801 leader_election.cc:304] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:14:49.551692  5237 leader_election.cc:336] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Timed out: RequestConsensusVote RPC to 127.3.212.130:44455 timed out after 1.522s (SENT)
I20260709 12:14:49.574882  9059 raft_consensus.cc:2804] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:14:49.551844  9020 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:49.576380  5166 leader_election.cc:304] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:49.546136  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:49.581143  9214 consensus_queue.cc:1048] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:14:49.582957  9104 consensus_meta.cc:287] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 1.065s	user 0.020s	sys 0.008s
I20260709 12:14:49.583386  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:49.594292  5119 raft_consensus.cc:2393] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 9: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
W20260709 12:14:49.541563  9219 log.cc:927] Time spent T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
W20260709 12:14:49.595530  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 45311.7us
W20260709 12:14:49.596189  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 128795us
I20260709 12:14:49.583891  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:49.591144  5237 leader_election.cc:304] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:49.596133  5088 leader_election.cc:304] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:49.583940  9193 leader_election.cc:290] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:49.608423  5804 leader_election.cc:400] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 election: Vote denied by peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443) with higher term. Message: Invalid argument: T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 10. Current term is 11.
I20260709 12:14:49.609166  5804 leader_election.cc:403] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:14:49.611085  9176 raft_consensus.cc:2749] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:49.611951  9176 raft_consensus.cc:2749] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443) with higher term. Message: Invalid argument: T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 10. Current term is 11.
I20260709 12:14:49.617571  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:49.618438  5124 raft_consensus.cc:3060] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:49.590796  9089 raft_consensus.cc:697] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:49.572777  9106 raft_consensus.cc:493] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:49.620395  5125 raft_consensus.cc:2468] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 9.
I20260709 12:14:49.623441  5193 raft_consensus.cc:2368] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 10. Current term is 11.
I20260709 12:14:49.617128  5123 raft_consensus.cc:2468] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 8.
I20260709 12:14:49.594175  9059 raft_consensus.cc:697] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 12 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:49.568332  9084 raft_consensus.cc:515] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:49.606272  5240 leader_election.cc:304] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:49.617712  5834 raft_consensus.cc:2468] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 8.
I20260709 12:14:49.622815  9212 consensus_queue.cc:1048] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 12:14:49.629230  5832 raft_consensus.cc:1275] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:14:49.611842  8978 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:49.635951  5089 leader_election.cc:304] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
W20260709 12:14:49.641638  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 49717.2us
I20260709 12:14:49.646546  9104 raft_consensus.cc:493] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:49.646325  9089 consensus_queue.cc:237] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:49.647323  8976 raft_consensus.cc:2749] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:49.647086  9104 raft_consensus.cc:515] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:49.646363  9135 raft_consensus.cc:993] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821: : Instructing follower bce73265e27d4b30a4dcc1e491305088 to start an election
W20260709 12:14:49.648564  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 97082.5us
I20260709 12:14:49.632521  9119 raft_consensus.cc:2804] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:14:49.649643  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 53721.5us
I20260709 12:14:49.656162  5240 leader_election.cc:304] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:49.639649  9174 raft_consensus.cc:2804] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:49.621191  9020 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:49.663830  8976 raft_consensus.cc:2804] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:49.665886  9095 consensus_queue.cc:1048] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:14:49.648268  9135 raft_consensus.cc:1081] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Signalling peer bce73265e27d4b30a4dcc1e491305088 to start an election
I20260709 12:14:49.642081  9062 raft_consensus.cc:2749] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:49.650684  9186 consensus_queue.cc:1048] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 12:14:49.650291  9145 raft_consensus.cc:2804] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:49.638882  9106 raft_consensus.cc:515] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:49.725023  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 68947.4us
I20260709 12:14:49.731738  5124 raft_consensus.cc:2468] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 9.
W20260709 12:14:49.670612  9220 log.cc:927] Time spent T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:14:49.733884  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:49.739364  5123 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 8.
I20260709 12:14:49.667768  9119 raft_consensus.cc:697] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 9 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
W20260709 12:14:49.742484  9227 log.cc:927] Time spent T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:14:49.741636  9145 raft_consensus.cc:697] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 9 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:49.747195  9145 consensus_queue.cc:237] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:49.750715  5801 leader_election.cc:304] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:49.670914  9174 raft_consensus.cc:493] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:49.756601  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:49.752704  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 99818.5us
W20260709 12:14:49.724164  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 687757us
I20260709 12:14:49.724409  5166 leader_election.cc:304] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
W20260709 12:14:49.758363  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 94814.9us
W20260709 12:14:49.766239  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 214550us
I20260709 12:14:49.694008  9020 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:49.733048  9061 raft_consensus.cc:2804] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:49.760139  9174 raft_consensus.cc:3060] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:49.667088  8978 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:49.759738  8976 raft_consensus.cc:697] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
W20260709 12:14:49.783731  5163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:49.772435  9192 raft_consensus.cc:2804] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:49.725311  9210 raft_consensus.cc:515] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:49.785077  5834 raft_consensus.cc:1240] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:49.787338  9195 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:49.788165  9195 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:49.790153  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:49.792079  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:49.793334  9104 leader_election.cc:290] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:49.793164  9053 raft_consensus.cc:2749] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:49.690982  9059 consensus_queue.cc:237] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:49.790796  5088 leader_election.cc:304] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:49.797978  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:49.802743  5834 raft_consensus.cc:1275] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:14:49.805507  9211 consensus_queue.cc:1059] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:14:49.807296  9211 raft_consensus.cc:2804] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:49.807988  9211 raft_consensus.cc:697] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:49.809664  9010 raft_consensus.cc:3055] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:49.810169  9010 raft_consensus.cc:740] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:49.810542  9195 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:49.811139  5116 raft_consensus.cc:2393] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 10: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:49.812093  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:49.812747  5193 raft_consensus.cc:3060] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:49.783102  9061 raft_consensus.cc:697] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 8 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:49.785605  9192 raft_consensus.cc:493] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:49.821529  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 133280us
I20260709 12:14:49.825461  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:49.827314  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:49.829180  5197 raft_consensus.cc:1240] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:49.830475  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:49.838201  5191 raft_consensus.cc:2468] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 10.
I20260709 12:14:49.848655  9192 raft_consensus.cc:3060] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:49.863658  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:49.823482  9084 leader_election.cc:290] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:49.811175  9010 consensus_queue.cc:260] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:49.865867  9010 raft_consensus.cc:3060] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:49.871376  5197 raft_consensus.cc:1240] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 6. Current term is 7. Ops: []
W20260709 12:14:49.871835  5163 leader_election.cc:336] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 1.888s (SENT)
I20260709 12:14:49.872599  5834 raft_consensus.cc:3060] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:49.891556  5193 raft_consensus.cc:2468] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 9.
I20260709 12:14:49.896013  9210 leader_election.cc:290] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:49.897975  9226 log.cc:927] Time spent T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
W20260709 12:14:49.903163  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 43995.2us
I20260709 12:14:49.903311  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:49.904619  5119 raft_consensus.cc:1275] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:14:49.905591  8978 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:49.904635  5163 leader_election.cc:304] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:49.875119  9193 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:49.809211  9211 consensus_queue.cc:237] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:49.913609  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 53728.8us
I20260709 12:14:49.910920  5804 leader_election.cc:304] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:49.911469  9214 consensus_queue.cc:1048] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:49.913321  5198 raft_consensus.cc:2468] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 10.
I20260709 12:14:49.926163  5801 leader_election.cc:304] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:49.932024  5834 raft_consensus.cc:2468] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 12.
I20260709 12:14:49.927211  8976 consensus_queue.cc:237] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:49.939338  9170 consensus_meta.cc:287] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.681s	user 0.013s	sys 0.000s
I20260709 12:14:49.931799  9193 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:49.941478  9084 raft_consensus.cc:2804] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:49.927147  9197 raft_consensus.cc:3060] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:49.943621  9193 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:49.945371  5238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:49.948868  9023 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:49.949608  9023 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:49.951684  5117 raft_consensus.cc:1275] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:14:49.952368  9023 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:49.953269  5119 raft_consensus.cc:1275] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:14:49.957156  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 52652.5us
I20260709 12:14:49.958927  5163 leader_election.cc:304] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:49.959945  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:49.960896  9234 raft_consensus.cc:493] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:49.878178  9119 consensus_queue.cc:237] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:49.960912  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:49.961519  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:49.962911  9084 raft_consensus.cc:697] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 9 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:49.964071  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:49.962958  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:49.960843  5198 raft_consensus.cc:2393] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 8: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:49.968317  5834 raft_consensus.cc:1240] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:49.968282  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:49.961566  9234 raft_consensus.cc:515] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:49.969484  5836 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 8.
W20260709 12:14:49.970640  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 45445.9us
I20260709 12:14:49.971215  9234 leader_election.cc:290] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:49.972147  9061 consensus_queue.cc:237] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:49.979849  9106 leader_election.cc:290] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:49.989976  9230 log.cc:927] Time spent T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.211s	user 0.000s	sys 0.000s
I20260709 12:14:49.971522  5801 leader_election.cc:304] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:49.997679  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:49.998008  5199 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 7.
I20260709 12:14:49.999078  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:50.000443  5119 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 8.
I20260709 12:14:50.001667  5834 raft_consensus.cc:1275] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:14:50.001832  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:50.003115  5832 raft_consensus.cc:3060] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:50.007186  5836 raft_consensus.cc:3060] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:50.010728  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:50.010751  5163 leader_election.cc:304] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:50.011783  5198 raft_consensus.cc:2393] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 9: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:49.996732  9053 raft_consensus.cc:2749] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:14:50.019362  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:50.004454  8993 raft_consensus.cc:2804] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:50.001744  9186 raft_consensus.cc:2749] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:50.024056  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:50.031339  5801 leader_election.cc:304] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:50.038473  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:50.045274  5197 raft_consensus.cc:1275] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:14:49.999354  9214 consensus_queue.cc:1048] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:14:50.004664  9170 consensus_queue.cc:1048] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:14:50.061966  5831 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4"
dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
 from {username='slave'} at 127.0.0.1:46094
I20260709 12:14:50.062247  5272 raft_consensus.cc:1275] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:14:50.092258  5831 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:50.062739  5273 raft_consensus.cc:2393] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 10: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:50.092738  5831 raft_consensus.cc:3060] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:50.063736  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:50.064337  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:50.066112  5195 raft_consensus.cc:1275] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:14:50.055299  9132 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.068097  9174 raft_consensus.cc:515] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:50.049325  8993 raft_consensus.cc:697] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 8 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:50.062058  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:50.006760  9106 consensus_queue.cc:1048] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:14:49.964093  9084 consensus_queue.cc:237] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:50.114499  5123 raft_consensus.cc:1240] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 12:14:50.141944  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
W20260709 12:14:50.143821  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 121667us
I20260709 12:14:50.144306  5268 raft_consensus.cc:3060] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:50.144541  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:50.145799  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:50.146638  5272 raft_consensus.cc:2393] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 9: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:50.146791  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:50.147527  5835 raft_consensus.cc:2468] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 9.
I20260709 12:14:50.143455  9132 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:50.158615  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:50.140312  5837 raft_consensus.cc:2468] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 10.
I20260709 12:14:50.170311  5122 raft_consensus.cc:2468] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 10.
I20260709 12:14:50.176725  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:50.177508  5835 raft_consensus.cc:3060] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:50.178264  5088 leader_election.cc:304] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:50.183212  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:50.184087  5272 raft_consensus.cc:2468] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 11.
I20260709 12:14:50.187933  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:50.189653  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:50.148523  9198 raft_consensus.cc:2749] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:50.186060  9176 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.013s	sys 0.021s
I20260709 12:14:50.176860  9020 raft_consensus.cc:2749] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:50.209138  5836 raft_consensus.cc:2468] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 8.
I20260709 12:14:50.214093  5200 raft_consensus.cc:1240] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:50.218271  5831 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:50.220419  5833 raft_consensus.cc:1275] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:14:50.223029  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:50.225330  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:50.225461  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:50.226825  5089 leader_election.cc:304] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:50.228849  5197 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 8.
I20260709 12:14:50.214520  9084 consensus_queue.cc:1059] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:14:50.229923  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:50.231074  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:50.231705  5197 raft_consensus.cc:2393] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 10: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:50.232264  5196 raft_consensus.cc:1275] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:14:50.232646  5196 pending_rounds.cc:85] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808: Aborting all ops after (but not including) 4
I20260709 12:14:50.232844  5196 pending_rounds.cc:107] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:14:50.233063  5196 raft_consensus.cc:2889] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:50.237252  5266 raft_consensus.cc:1240] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:50.239938  5804 leader_election.cc:304] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:50.228842  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:50.241658  5273 raft_consensus.cc:3060] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:50.246162  5198 raft_consensus.cc:1275] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:14:50.250669  5273 raft_consensus.cc:2468] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 12.
I20260709 12:14:50.252030  5268 raft_consensus.cc:2468] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 11.
W20260709 12:14:50.215899  9176 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.013s	sys 0.022s
I20260709 12:14:50.255026  9174 leader_election.cc:290] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:50.255903  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 76519.6us
I20260709 12:14:50.258147  5831 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:50.263762  9105 raft_consensus.cc:3055] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:50.264252  9105 raft_consensus.cc:740] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:50.265201  9105 consensus_queue.cc:260] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:50.266269  9105 raft_consensus.cc:3060] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:50.272104  5835 raft_consensus.cc:2468] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 13.
I20260709 12:14:50.241284  9020 raft_consensus.cc:2804] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:14:50.283646  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 56897.2us
W20260709 12:14:50.286068  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 107967us
I20260709 12:14:50.287461  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:50.287699  5089 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:50.295595  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:50.296367  5266 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 8.
W20260709 12:14:50.296700  9250 log.cc:927] Time spent T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 12:14:50.289575  9212 raft_consensus.cc:2804] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:50.314284  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:50.285471  8978 raft_consensus.cc:2804] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:50.285759  9059 raft_consensus.cc:493] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.317924  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
W20260709 12:14:50.318629  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 61899.1us
I20260709 12:14:50.317020  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:50.322825  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:50.327595  8978 raft_consensus.cc:493] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:50.332885  8978 raft_consensus.cc:3060] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:50.241799  8993 consensus_queue.cc:237] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:50.337266  5238 leader_election.cc:400] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 election: Vote denied by peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539) with higher term. Message: Invalid argument: T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 9. Current term is 10.
I20260709 12:14:50.340554  5238 leader_election.cc:403] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:14:50.338645  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:50.338387  9059 raft_consensus.cc:515] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:50.344295  9243 log.cc:927] Time spent T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 12:14:50.344658  9248 raft_consensus.cc:2749] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539) with higher term. Message: Invalid argument: T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 9. Current term is 10.
I20260709 12:14:50.346489  5268 raft_consensus.cc:1240] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:50.347623  5123 raft_consensus.cc:1275] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 12:14:50.347839  9240 log.cc:927] Time spent T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 12:14:50.348654  9192 raft_consensus.cc:515] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:50.346392  5238 leader_election.cc:304] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:50.349807  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:50.350049  9248 raft_consensus.cc:2749] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:50.350497  5274 raft_consensus.cc:3060] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:50.350986  9192 leader_election.cc:290] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:50.297664  9020 raft_consensus.cc:697] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 10 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:50.351559  5238 leader_election.cc:400] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 election: Vote denied by peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539) with higher term. Message: Invalid argument: T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 8. Current term is 9.
I20260709 12:14:50.351895  5193 raft_consensus.cc:2368] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 9. Current term is 10.
I20260709 12:14:50.351929  5272 raft_consensus.cc:3060] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:50.308991  9212 raft_consensus.cc:493] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:50.337800  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:50.331990  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:50.353715  5164 leader_election.cc:304] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:50.338915  5237 leader_election.cc:304] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:50.376122  5238 leader_election.cc:403] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:14:50.375630  5273 raft_consensus.cc:3060] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:50.373876  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 84673.1us
I20260709 12:14:50.308828  9135 raft_consensus.cc:2804] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:50.400271  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:50.400954  5125 raft_consensus.cc:3055] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:50.343536  9059 leader_election.cc:290] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:50.407269  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 409959us
I20260709 12:14:50.377859  9212 raft_consensus.cc:3060] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:50.401248  5125 raft_consensus.cc:740] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:50.326934  9173 consensus_queue.cc:1059] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.076s
I20260709 12:14:50.411301  5163 leader_election.cc:304] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:50.398254  9053 raft_consensus.cc:493] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.414368  9248 raft_consensus.cc:2749] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:14:50.415247  9247 log.cc:927] Time spent T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:14:50.390312  9192 raft_consensus.cc:2749] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:50.379114  9010 consensus_queue.cc:1048] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 12:14:50.423966  9105 consensus_queue.cc:1048] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:50.425628  9020 consensus_queue.cc:237] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:50.426828  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 75145.8us
I20260709 12:14:50.429850  9258 consensus_queue.cc:1059] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:50.388015  9135 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:50.386855  8896 raft_consensus.cc:493] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.431071  9132 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:50.434653  9241 log.cc:927] Time spent T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
W20260709 12:14:50.435801  9251 log.cc:927] Time spent T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
W20260709 12:14:50.437635  9253 log.cc:927] Time spent T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.201s	user 0.000s	sys 0.002s
I20260709 12:14:50.440130  5123 raft_consensus.cc:1275] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:14:50.408378  9061 raft_consensus.cc:2749] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539) with higher term. Message: Invalid argument: T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 8. Current term is 9.
W20260709 12:14:50.414474  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 75674.5us
I20260709 12:14:50.398519  5265 raft_consensus.cc:2468] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 9.
I20260709 12:14:50.450862  5832 raft_consensus.cc:2468] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 12.
I20260709 12:14:50.460845  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:50.462049  5831 raft_consensus.cc:1275] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:14:50.461735  9053 raft_consensus.cc:515] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:50.431186  8978 raft_consensus.cc:515] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:50.461791  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 110395us
I20260709 12:14:50.470557  5273 raft_consensus.cc:2468] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 10.
I20260709 12:14:50.501477  5834 raft_consensus.cc:2468] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 13.
I20260709 12:14:50.465304  5125 consensus_queue.cc:260] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:50.477442  5274 raft_consensus.cc:2468] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 13.
W20260709 12:14:50.471345  9197 consensus_meta.cc:287] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.528s	user 0.010s	sys 0.000s
I20260709 12:14:50.483916  9095 raft_consensus.cc:493] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.484660  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
W20260709 12:14:50.511020  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 99811.5us
I20260709 12:14:50.511508  5117 raft_consensus.cc:3060] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:50.482038  9106 raft_consensus.cc:2749] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:50.487145  9135 raft_consensus.cc:3060] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:50.485221  9010 consensus_queue.cc:1243] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer bce73265e27d4b30a4dcc1e491305088 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 12:14:50.421792  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 101575us
I20260709 12:14:50.476058  9180 consensus_queue.cc:1048] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:14:50.522667  9095 raft_consensus.cc:515] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:50.528792  5272 raft_consensus.cc:2468] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 12.
I20260709 12:14:50.514417  9197 raft_consensus.cc:2749] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:50.515467  9252 raft_consensus.cc:3055] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:50.526798  9259 raft_consensus.cc:3055] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:50.496683  8896 raft_consensus.cc:515] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:50.540809  5164 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
W20260709 12:14:50.545595  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 164638us
I20260709 12:14:50.517588  9214 consensus_queue.cc:1048] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:14:50.553723  5801 leader_election.cc:400] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 election: Vote denied by peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455) with higher term. Message: Invalid argument: T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 10. Current term is 11.
I20260709 12:14:50.555390  5801 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:50.542050  9252 raft_consensus.cc:740] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:50.570477  9212 raft_consensus.cc:515] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:50.572993  9212 leader_election.cc:290] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:50.589633  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 62184.1us
W20260709 12:14:50.590732  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 52387us
I20260709 12:14:50.592496  8896 leader_election.cc:290] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:50.544842  9259 raft_consensus.cc:740] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:50.598181  9252 consensus_queue.cc:260] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:50.539752  9242 consensus_queue.cc:1059] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
W20260709 12:14:50.606950  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 63006.7us
I20260709 12:14:50.534528  8976 consensus_queue.cc:1048] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:14:50.554243  8978 leader_election.cc:290] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:50.610569  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 139034us
W20260709 12:14:50.655774  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 142023us
I20260709 12:14:50.613130  9198 raft_consensus.cc:2749] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:50.667316  9259 consensus_queue.cc:260] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:50.668955  9259 raft_consensus.cc:3060] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:50.659169  5089 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:50.669654  5125 raft_consensus.cc:3060] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:50.670130  9212 raft_consensus.cc:2804] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:14:50.670603  9212 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:50.670974  9212 raft_consensus.cc:3060] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:14:50.663007  9252 raft_consensus.cc:3060] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:50.682104  5838 pending_rounds.cc:85] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088: Aborting all ops after (but not including) 6
I20260709 12:14:50.682539  5838 pending_rounds.cc:107] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 12:14:50.682799  5838 raft_consensus.cc:2889] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:14:50.705788  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 75778.7us
I20260709 12:14:50.708515  5238 leader_election.cc:304] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:14:50.719394  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 164072us
W20260709 12:14:50.661065  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 134600us
I20260709 12:14:50.629684  9084 raft_consensus.cc:2804] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:14:50.726497  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 47955.6us
W20260709 12:14:50.723680  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 219311us
I20260709 12:14:50.720219  5801 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:50.735677  5164 leader_election.cc:400] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 election: Vote denied by peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539) with higher term. Message: Invalid argument: T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 9. Current term is 10.
I20260709 12:14:50.726423  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:50.736894  5831 raft_consensus.cc:3060] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:50.741103  5119 raft_consensus.cc:1240] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 8. Current term is 9. Ops: []
W20260709 12:14:50.746086  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 121548us
I20260709 12:14:50.629571  9193 consensus_queue.cc:1048] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.104s
I20260709 12:14:50.722826  9023 raft_consensus.cc:493] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
W20260709 12:14:50.763796  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 43657.1us
W20260709 12:14:50.771086  5163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:50.772286  5163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:50.771988  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 44262.1us
I20260709 12:14:50.773243  5237 leader_election.cc:400] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 election: Vote denied by peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455) with higher term. Message: Invalid argument: T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 9. Current term is 10.
I20260709 12:14:50.752979  9061 raft_consensus.cc:2749] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:50.779920  5831 raft_consensus.cc:2468] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 10.
I20260709 12:14:50.782945  8896 raft_consensus.cc:493] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.740903  9106 consensus_queue.cc:1059] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:14:50.785986  5164 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:50.772951  9084 raft_consensus.cc:697] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 10 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
W20260709 12:14:50.796038  5802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:50.842338  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:50.796427  5088 leader_election.cc:304] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:50.776258  9104 raft_consensus.cc:2804] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:50.849591  5164 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:50.795230  9053 leader_election.cc:290] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:50.793298  9023 raft_consensus.cc:515] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:50.868196  9234 raft_consensus.cc:3055] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:50.793572  9186 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.868659  9234 raft_consensus.cc:740] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:50.869196  9023 leader_election.cc:290] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:50.869119  9186 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:50.869688  9234 consensus_queue.cc:260] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:50.870728  9234 raft_consensus.cc:3060] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:50.871419  9186 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:50.793715  9180 raft_consensus.cc:493] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.872539  9180 raft_consensus.cc:515] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:50.823791  9095 leader_election.cc:290] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:50.874696  9180 leader_election.cc:290] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:50.845990  9255 log.cc:927] Time spent T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:14:50.865850  5164 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:50.787784  8896 raft_consensus.cc:515] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:50.880928  8896 leader_election.cc:290] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:50.893401  5163 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 1.575s (SENT) [suppressed 45 similar messages]
W20260709 12:14:50.894060  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:50.910127  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 44355.2us
I20260709 12:14:50.911082  5164 leader_election.cc:304] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:50.915093  5117 raft_consensus.cc:2468] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 10.
I20260709 12:14:50.785936  8993 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:50.847848  9197 raft_consensus.cc:2804] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:50.930941  5125 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 7.
I20260709 12:14:50.930018  8896 raft_consensus.cc:2749] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:50.937808  5164 leader_election.cc:304] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:50.940325  5166 leader_election.cc:304] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:50.856256  9254 raft_consensus.cc:493] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:50.937897  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 156880us
I20260709 12:14:50.940810  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:50.946656  5831 raft_consensus.cc:2468] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 7.
I20260709 12:14:50.826691  9195 consensus_queue.cc:1059] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.082s
W20260709 12:14:50.906713  9266 log.cc:927] Time spent T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:14:50.855796  9104 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:50.950086  5125 raft_consensus.cc:1275] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:14:50.941052  5089 leader_election.cc:304] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
W20260709 12:14:50.951422  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 157182us
W20260709 12:14:50.952225  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 186155us
I20260709 12:14:50.948153  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:50.859656  9274 raft_consensus.cc:2804] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:50.953434  5117 raft_consensus.cc:2468] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 7.
I20260709 12:14:50.953636  5836 raft_consensus.cc:1275] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:14:50.942078  9180 raft_consensus.cc:2749] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:14:50.966019  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:50.966820  5194 raft_consensus.cc:2393] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 7: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
W20260709 12:14:50.968129  9280 log.cc:927] Time spent T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:14:50.961792  9095 raft_consensus.cc:2804] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:50.970013  9095 raft_consensus.cc:697] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:50.970969  9095 consensus_queue.cc:237] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:50.962026  9053 consensus_queue.cc:1048] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 12:14:50.974293  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:50.979935  9053 raft_consensus.cc:493] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:50.953171  9254 raft_consensus.cc:515] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:50.980587  9053 raft_consensus.cc:515] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:50.982821  9053 leader_election.cc:290] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:50.983544  9277 log.cc:927] Time spent T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 12:14:50.952325  9104 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:50.937544  9197 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:50.932235  9174 raft_consensus.cc:2804] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:14:50.986965  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 93635.5us
I20260709 12:14:50.986579  5089 leader_election.cc:304] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
W20260709 12:14:50.988477  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 192131us
I20260709 12:14:50.984755  5164 leader_election.cc:304] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:50.955420  9193 raft_consensus.cc:2804] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:14:50.991285  5238 leader_election.cc:304] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:50.987558  9197 raft_consensus.cc:3060] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:50.995085  9132 raft_consensus.cc:2804] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:51.004355  9132 raft_consensus.cc:493] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:51.004731  9132 raft_consensus.cc:3060] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:50.983568  9053 raft_consensus.cc:493] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:51.009327  9053 raft_consensus.cc:515] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:51.009565  9273 consensus_queue.cc:1048] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:14:51.011454  9053 leader_election.cc:290] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:51.012305  9132 raft_consensus.cc:515] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:50.955653  9274 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
W20260709 12:14:51.015800  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 67878.9us
I20260709 12:14:50.985646  9270 raft_consensus.cc:2804] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:51.023973  5088 leader_election.cc:304] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:50.989835  9174 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:51.027431  5833 raft_consensus.cc:1275] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:14:51.026072  5831 raft_consensus.cc:1275] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:14:51.029649  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:50.944720  8993 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:51.032596  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:51.035063  5832 raft_consensus.cc:1240] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 9 LEADER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:50.997637  9254 leader_election.cc:290] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:51.037307  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:51.039273  5837 raft_consensus.cc:2468] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 13.
I20260709 12:14:51.037173  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:51.040053  5829 raft_consensus.cc:2468] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 8.
I20260709 12:14:51.023382  9274 raft_consensus.cc:3060] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:14:51.038434  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 75867.5us
W20260709 12:14:51.044809  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 320285us
I20260709 12:14:51.027776  9023 raft_consensus.cc:2764] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:14:51.029857  9174 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:51.052686  5237 leader_election.cc:304] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:51.051194  5238 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:51.056213  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:51.053603  5125 raft_consensus.cc:2468] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 12.
I20260709 12:14:51.060774  5164 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:51.059224  9258 consensus_queue.cc:1048] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 12:14:51.067338  5237 leader_election.cc:304] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:51.070730  9170 raft_consensus.cc:2749] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:51.071532  9170 raft_consensus.cc:2749] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:51.073487  9286 raft_consensus.cc:2749] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:51.078470  5238 leader_election.cc:400] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Vote denied by peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539) with higher term. Message: Invalid argument: T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 9. Current term is 10.
I20260709 12:14:51.080715  5238 leader_election.cc:304] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:51.081214  9198 raft_consensus.cc:3055] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:51.081614  9271 raft_consensus.cc:2804] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:14:51.082165  9271 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:51.082614  9271 raft_consensus.cc:3060] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:14:51.084436  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:51.086714  5804 leader_election.cc:304] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:51.088246  5123 raft_consensus.cc:1275] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:14:51.089505  9282 consensus_queue.cc:1048] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:51.090016  9053 raft_consensus.cc:2804] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:51.090567  9053 raft_consensus.cc:493] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:51.090932  9053 raft_consensus.cc:3060] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:51.051213  9192 raft_consensus.cc:2804] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:14:51.093142  9192 raft_consensus.cc:697] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:51.049705  9270 raft_consensus.cc:697] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:51.098464  9192 consensus_queue.cc:237] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:51.101009  9254 consensus_queue.cc:1048] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:14:51.035429  9193 raft_consensus.cc:697] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:51.081681  9198 raft_consensus.cc:740] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:51.107489  5164 leader_election.cc:304] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
W20260709 12:14:51.113458  9284 log.cc:927] Time spent T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:14:51.115593  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:51.116292  5193 raft_consensus.cc:2468] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 8.
I20260709 12:14:51.113232  5195 raft_consensus.cc:1275] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 10. (term mismatch)
I20260709 12:14:51.117007  5195 pending_rounds.cc:85] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808: Aborting all ops after (but not including) 9
I20260709 12:14:51.117267  5195 pending_rounds.cc:107] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808: Aborting uncommitted NO_OP operation due to leader change: 8.10
I20260709 12:14:51.117676  5195 raft_consensus.cc:2889] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:14:51.128479  5091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:51.057462  9242 raft_consensus.cc:2749] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:51.057689  9260 raft_consensus.cc:493] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:51.152631  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 155216us
I20260709 12:14:51.094365  8993 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:51.103837  9197 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:51.160734  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 53326.9us
W20260709 12:14:51.175913  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 95289.9us
W20260709 12:14:51.179296  9212 consensus_meta.cc:287] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.508s	user 0.008s	sys 0.000s
W20260709 12:14:51.183815  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 116576us
I20260709 12:14:51.184005  9104 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:51.209313  5237 leader_election.cc:304] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:51.188282  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:51.189635  9252 raft_consensus.cc:493] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:51.024935  9084 consensus_queue.cc:237] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:51.197599  9254 raft_consensus.cc:493] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:51.198273  9195 raft_consensus.cc:2804] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:51.199421  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:51.112182  9170 raft_consensus.cc:2749] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:14:51.207916  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 44786.3us
I20260709 12:14:51.211031  9212 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:51.214967  9104 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:51.217860  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:51.111307  9198 consensus_queue.cc:260] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:51.227288  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:51.232182  5801 leader_election.cc:304] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:51.233888  5238 leader_election.cc:400] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Vote denied by peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539) with higher term. Message: Invalid argument: T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 9. Current term is 11.
W20260709 12:14:51.235261  5802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:51.237406  5237 leader_election.cc:304] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:51.238497  5117 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:51.251183  5088 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:51.162145  9269 consensus_queue.cc:1048] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.076s
I20260709 12:14:51.254724  5124 raft_consensus.cc:2393] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 14: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:51.231079  9195 raft_consensus.cc:493] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:51.223914  9294 raft_consensus.cc:2749] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:51.221159  9260 raft_consensus.cc:515] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:51.267609  9119 raft_consensus.cc:2804] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:51.260064  9195 raft_consensus.cc:3060] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:51.268910  5801 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:14:51.267015  9135 consensus_meta.cc:287] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.738s	user 0.007s	sys 0.004s
I20260709 12:14:51.239030  9252 raft_consensus.cc:515] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:51.261938  9061 raft_consensus.cc:2749] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:51.239477  9254 raft_consensus.cc:515] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:51.285604  5163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:51.290544  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 63850.2us
I20260709 12:14:51.266635  9234 raft_consensus.cc:2804] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:51.297434  9212 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:51.301354  9132 leader_election.cc:290] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:51.301576  5199 raft_consensus.cc:2468] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 10.
I20260709 12:14:51.302268  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:51.290136  9135 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:51.277206  9259 consensus_meta.cc:287] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.552s	user 0.004s	sys 0.007s
I20260709 12:14:51.273046  9119 raft_consensus.cc:493] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:51.307664  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:51.310185  5088 leader_election.cc:304] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:51.300529  5166 leader_election.cc:304] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:51.343052  5836 raft_consensus.cc:2410] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:14:51.339035  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:51.343888  5835 raft_consensus.cc:3060] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:14:51.299932  9053 raft_consensus.cc:515] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:51.340948  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:51.273871  9020 consensus_queue.cc:1048] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 12:14:51.258270  9270 consensus_queue.cc:237] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:51.351001  5830 raft_consensus.cc:2393] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 8: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:51.256690  9193 consensus_queue.cc:237] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:51.358614  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 131057us
I20260709 12:14:51.361539  5117 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 9.
I20260709 12:14:51.358292  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:51.366943  5837 raft_consensus.cc:3060] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:51.300806  9254 leader_election.cc:290] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:51.295291  9234 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:51.299279  9197 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:51.346491  9119 raft_consensus.cc:3060] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:51.351847  8896 raft_consensus.cc:493] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:51.366133  9132 raft_consensus.cc:2764] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
W20260709 12:14:51.381929  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 73358us
W20260709 12:14:51.389547  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 79465us
I20260709 12:14:51.376690  5835 raft_consensus.cc:2468] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 14.
I20260709 12:14:51.360730  9106 raft_consensus.cc:2804] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:14:51.384836  5238 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:51.377362  9234 raft_consensus.cc:3060] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:51.394763  5237 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:51.410633  5088 leader_election.cc:304] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:51.420222  9053 leader_election.cc:290] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:51.420801  9252 leader_election.cc:290] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:51.425277  9299 raft_consensus.cc:2749] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:51.426158  9299 raft_consensus.cc:2749] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:14:51.429605  9289 log.cc:927] Time spent T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
I20260709 12:14:51.406225  9106 raft_consensus.cc:493] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:51.432621  9106 raft_consensus.cc:3060] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:51.391870  9254 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
W20260709 12:14:51.434706  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 91162.1us
W20260709 12:14:51.439157  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 54392.5us
I20260709 12:14:51.440114  5238 leader_election.cc:304] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:51.441604  9214 raft_consensus.cc:2804] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:51.442020  9214 raft_consensus.cc:493] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:51.442373  9214 raft_consensus.cc:3060] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:51.416098  9132 raft_consensus.cc:2764] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:14:51.442476  9260 leader_election.cc:290] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:51.446292  9135 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:51.389529  8896 raft_consensus.cc:515] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:51.451365  8896 leader_election.cc:290] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:51.456693  9119 raft_consensus.cc:515] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:51.458387  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 189559us
I20260709 12:14:51.459200  5238 leader_election.cc:304] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
W20260709 12:14:51.463937  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 75889.8us
W20260709 12:14:51.466873  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 56339.2us
I20260709 12:14:51.466487  9290 raft_consensus.cc:2749] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:51.501493  9174 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:51.502996  5237 leader_election.cc:304] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:51.503576  9301 consensus_queue.cc:1048] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:14:51.504282  5237 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:14:51.505153  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:51.507086  5238 leader_election.cc:304] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:51.509922  5089 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:51.518965  5238 leader_election.cc:304] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
W20260709 12:14:51.521669  9291 log.cc:927] Time spent T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 12:14:51.522406  9059 raft_consensus.cc:2749] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:14:51.522882  5237 leader_election.cc:304] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:51.523098  9059 raft_consensus.cc:2749] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:14:51.472923  9254 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:51.523726  9059 raft_consensus.cc:2749] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:51.527365  9106 raft_consensus.cc:515] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:51.528446  5837 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 11.
I20260709 12:14:51.514114  9061 raft_consensus.cc:2749] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:51.509476  9299 raft_consensus.cc:2749] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:51.520475  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:51.533068  9174 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:51.536671  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:51.558761  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 63361.2us
I20260709 12:14:51.563019  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:51.563637  5831 raft_consensus.cc:3060] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:51.565821  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:51.566484  5123 raft_consensus.cc:3060] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:14:51.566208  5163 leader_election.cc:336] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 2.234s (SENT)
I20260709 12:14:51.566893  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:51.567706  5116 raft_consensus.cc:2393] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 8: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
W20260709 12:14:51.568289  9274 consensus_meta.cc:287] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.508s	user 0.007s	sys 0.003s
I20260709 12:14:51.573479  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:51.574339  5124 raft_consensus.cc:2393] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 9: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:51.519691  9023 consensus_queue.cc:1048] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 12:14:51.573900  9274 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:51.576894  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:51.577740  5833 raft_consensus.cc:2393] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 9: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:51.577847  9119 leader_election.cc:290] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:51.577737  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:51.539566  9299 consensus_queue.cc:1048] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:14:51.535312  9212 raft_consensus.cc:2804] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:14:51.580636  9212 raft_consensus.cc:697] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:51.581579  9212 consensus_queue.cc:237] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:51.583151  5088 leader_election.cc:304] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:51.578913  5120 raft_consensus.cc:1240] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 11. Current term is 12. Ops: []
W20260709 12:14:51.565936  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 47035.1us
I20260709 12:14:51.592008  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:51.485910  9271 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:51.602993  5123 raft_consensus.cc:2468] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 13.
I20260709 12:14:51.603627  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:51.605393  5838 raft_consensus.cc:2393] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 9: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:51.600708  5237 leader_election.cc:400] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Vote denied by peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455) with higher term. Message: Invalid argument: T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 9. Current term is 10.
I20260709 12:14:51.611931  5237 leader_election.cc:403] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:14:51.613147  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:51.613910  5833 raft_consensus.cc:2393] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 9: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:51.616211  5834 raft_consensus.cc:1275] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:14:51.606770  5166 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
W20260709 12:14:51.621083  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 128179us
I20260709 12:14:51.618062  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:51.571312  9061 raft_consensus.cc:2749] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:51.578028  9274 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:51.637458  5166 leader_election.cc:304] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:51.639806  5831 raft_consensus.cc:2468] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 11.
I20260709 12:14:51.598402  9310 raft_consensus.cc:493] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:51.614421  9248 raft_consensus.cc:493] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:51.582793  9301 consensus_queue.cc:1048] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 12:14:51.653630  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:51.599540  9294 consensus_queue.cc:1059] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 12:14:51.662277  9294 raft_consensus.cc:3060] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:51.610370  9299 consensus_queue.cc:1048] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:14:51.618909  9132 raft_consensus.cc:2804] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:14:51.668766  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 104525us
I20260709 12:14:51.629365  9106 leader_election.cc:290] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:51.692884  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:51.642716  9260 raft_consensus.cc:2749] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:51.650355  9193 raft_consensus.cc:2804] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:14:51.694828  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:51.650671  9061 raft_consensus.cc:493] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:51.698037  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:51.699661  5274 raft_consensus.cc:2468] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 10.
I20260709 12:14:51.702008  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:51.702153  5274 raft_consensus.cc:1275] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:14:51.702267  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:51.703496  5270 raft_consensus.cc:2410] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:14:51.703543  5268 raft_consensus.cc:2393] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 8: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:51.706691  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:51.706995  5832 raft_consensus.cc:1275] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 12:14:51.708453  9300 log.cc:927] Time spent T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:14:51.711670  9193 raft_consensus.cc:697] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:51.712638  9193 consensus_queue.cc:237] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:51.704948  9273 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:51.715571  9273 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:51.718242  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:51.720202  9214 raft_consensus.cc:515] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:51.721760  9273 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:51.722752  5088 leader_election.cc:304] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:51.724063  5088 leader_election.cc:304] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:51.722779  5266 raft_consensus.cc:2410] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:14:51.726346  9271 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:51.726567  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:51.727356  5832 raft_consensus.cc:2393] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 11: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:51.729009  9299 raft_consensus.cc:3055] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:51.655323  9310 raft_consensus.cc:515] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:51.738962  9254 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:51.739444  9310 leader_election.cc:290] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:51.740108  9299 raft_consensus.cc:740] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:51.741156  9299 consensus_queue.cc:260] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:51.725703  9309 raft_consensus.cc:2749] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:51.733245  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:51.782393  5266 raft_consensus.cc:2393] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 10: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:51.734390  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:51.734537  9234 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:51.670094  9248 raft_consensus.cc:515] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:51.784767  5270 raft_consensus.cc:2376] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 8. Re-sending same reply.
I20260709 12:14:51.682554  9132 raft_consensus.cc:493] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:51.749200  5273 raft_consensus.cc:1275] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:14:51.751646  5271 raft_consensus.cc:1275] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:14:51.751920  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:51.752744  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:51.788574  5801 leader_election.cc:304] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:51.730059  9273 raft_consensus.cc:2764] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 12:14:51.753728  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:51.790935  5274 raft_consensus.cc:2468] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 12.
W20260709 12:14:51.755247  9261 log.cc:927] Time spent T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.346s	user 0.002s	sys 0.000s
I20260709 12:14:51.703639  9061 raft_consensus.cc:515] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:51.759562  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:51.759822  5089 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:51.815595  5830 raft_consensus.cc:2468] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 9.
I20260709 12:14:51.761080  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:14:51.769215  5091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:51.768415  9195 raft_consensus.cc:515] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:51.760895  5164 leader_election.cc:304] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
W20260709 12:14:51.817356  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 56545.9us
I20260709 12:14:51.774140  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:51.775136  9198 raft_consensus.cc:3060] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:51.778493  9214 leader_election.cc:290] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:51.773156  9294 raft_consensus.cc:2749] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455) with higher term. Message: Invalid argument: T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 9. Current term is 10.
W20260709 12:14:51.815594  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 215009us
I20260709 12:14:51.786273  9132 raft_consensus.cc:3060] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:51.786580  5269 raft_consensus.cc:2376] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 10. Re-sending same reply.
I20260709 12:14:51.793596  5194 raft_consensus.cc:1275] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:14:51.795089  5199 raft_consensus.cc:1275] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:14:51.798260  9267 raft_consensus.cc:493] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:51.798780  9248 leader_election.cc:290] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:51.799501  5272 raft_consensus.cc:2410] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:14:51.805416  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:51.806210  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:51.806933  5163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:51.827313  5192 raft_consensus.cc:1275] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:14:51.809250  9234 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:51.809798  5117 raft_consensus.cc:1240] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 10. Current term is 11. Ops: []
W20260709 12:14:51.809274  9297 log.cc:927] Time spent T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.423s	user 0.004s	sys 0.004s
I20260709 12:14:51.819573  5832 raft_consensus.cc:2393] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 14: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:51.822949  5164 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:51.788136  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:51.825112  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:51.832237  5198 raft_consensus.cc:2393] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 14: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:51.829320  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
W20260709 12:14:51.834337  5088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:51.835039  5163 leader_election.cc:304] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:51.836870  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:51.838855  5193 raft_consensus.cc:1275] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 12:14:51.840703  5802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:51.841200  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:51.837635  5271 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 10.
I20260709 12:14:51.842056  5191 raft_consensus.cc:2393] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 14: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:51.821134  9258 raft_consensus.cc:2749] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:51.850160  5195 raft_consensus.cc:2393] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 10: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:51.851114  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:51.845885  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:51.848033  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 88296.6us
I20260709 12:14:51.851825  5195 raft_consensus.cc:2393] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 9: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:51.853085  5198 raft_consensus.cc:2468] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 12.
I20260709 12:14:51.854233  5198 raft_consensus.cc:1275] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:14:51.849570  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:51.857717  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:51.858206  9274 raft_consensus.cc:2804] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:51.858378  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:51.858772  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:51.859498  5191 raft_consensus.cc:2393] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 11: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:51.860065  5118 raft_consensus.cc:2393] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 8: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:51.860257  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:51.861565  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:51.862238  5191 raft_consensus.cc:2393] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 9: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:51.867542  5088 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:51.861713  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:51.871407  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:51.872216  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:51.872485  5193 raft_consensus.cc:1275] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:14:51.871748  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:51.871832  5194 raft_consensus.cc:1275] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:14:51.838282  9106 raft_consensus.cc:2804] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:51.868597  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:51.877398  5195 raft_consensus.cc:1240] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:14:51.878947  5199 raft_consensus.cc:2393] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 10: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:51.878616  5801 leader_election.cc:304] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:51.883680  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:51.884428  5274 raft_consensus.cc:2468] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 8.
I20260709 12:14:51.885861  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:51.886965  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:51.877167  5196 raft_consensus.cc:2468] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 8.
I20260709 12:14:51.827589  9180 consensus_queue.cc:1048] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:14:51.888473  5273 raft_consensus.cc:1275] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:14:51.887722  5274 raft_consensus.cc:2393] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 7: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:51.841434  8896 raft_consensus.cc:2749] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:51.898177  5270 raft_consensus.cc:1240] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:14:51.898787  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:51.909606  5267 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 8.
I20260709 12:14:51.880739  9106 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:51.902105  5266 raft_consensus.cc:1240] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 11. Current term is 12. Ops: []
I20260709 12:14:51.866871  9214 raft_consensus.cc:493] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:51.915699  9214 raft_consensus.cc:515] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:51.918030  9214 leader_election.cc:290] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:51.903543  9061 leader_election.cc:290] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:14:51.905685  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 70705.3us
I20260709 12:14:51.833756  9267 raft_consensus.cc:515] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:51.881006  9271 consensus_queue.cc:1059] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:14:51.914112  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:51.890169  9104 consensus_queue.cc:1048] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:14:51.876259  9119 raft_consensus.cc:2804] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:51.926142  5018 catalog_manager.cc:5697] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:51.885567  9294 raft_consensus.cc:493] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:51.934582  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:51.934988  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:51.936192  5274 raft_consensus.cc:1275] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:14:51.928884  5200 raft_consensus.cc:1275] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:14:51.932078  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:51.935631  5270 raft_consensus.cc:2468] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 8.
I20260709 12:14:51.940943  5121 raft_consensus.cc:2393] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 13: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
W20260709 12:14:51.942504  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 51821.3us
I20260709 12:14:51.919061  9106 raft_consensus.cc:3060] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:51.942178  9294 raft_consensus.cc:515] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:51.950337  9294 leader_election.cc:290] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:51.951951  9292 consensus_queue.cc:1059] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:51.953336  9292 raft_consensus.cc:3055] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:51.953723  9292 raft_consensus.cc:740] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:51.936546  5274 pending_rounds.cc:85] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929: Aborting all ops after (but not including) 7
I20260709 12:14:51.955786  5274 pending_rounds.cc:107] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:14:51.956032  5274 raft_consensus.cc:2889] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:51.959158  9176 raft_consensus.cc:2749] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:14:51.954519  9292 consensus_queue.cc:260] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:51.965888  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:51.967428  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:51.967916  9195 leader_election.cc:290] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:51.968364  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:51.968947  5266 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:51.976843  9119 raft_consensus.cc:493] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:51.977416  9119 raft_consensus.cc:3060] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:51.977727  9176 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:51.978262  9176 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:51.980985  9176 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:51.983948  9267 leader_election.cc:290] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:51.984354  9331 log.cc:927] Time spent T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:14:51.989102  9309 raft_consensus.cc:2749] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:14:51.989845  5270 raft_consensus.cc:1275] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:14:51.990779  9274 raft_consensus.cc:697] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:51.991861  9274 consensus_queue.cc:237] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:51.994055  9318 log.cc:927] Time spent T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.136s	user 0.002s	sys 0.000s
W20260709 12:14:51.996016  9319 log.cc:927] Time spent T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.089s	user 0.002s	sys 0.000s
I20260709 12:14:51.997530  5265 raft_consensus.cc:1275] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:14:51.998764  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 55563.6us
I20260709 12:14:52.002573  9311 consensus_queue.cc:1048] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:14:52.003669  9324 log.cc:927] Time spent T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.110s	user 0.000s	sys 0.002s
I20260709 12:14:52.004534  9321 consensus_queue.cc:1048] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:14:52.004057  9311 consensus_queue.cc:1048] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:14:52.006769  5166 leader_election.cc:304] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:52.007652  9258 raft_consensus.cc:2749] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:52.004357  9211 consensus_queue.cc:1048] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 12:14:52.017015  5829 raft_consensus.cc:1240] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:52.018090  5166 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:52.019052  9258 raft_consensus.cc:2749] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:14:52.021479  9258 consensus_queue.cc:1059] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:14:52.022805  8896 raft_consensus.cc:3055] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:14:52.023211  8896 raft_consensus.cc:740] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:52.024063  8896 consensus_queue.cc:260] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:52.027313  9174 raft_consensus.cc:3055] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:14:52.027767  9174 raft_consensus.cc:740] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:52.032066  5088 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:52.043310  5266 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 9.
I20260709 12:14:52.044951  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
W20260709 12:14:52.047722  5088 leader_election.cc:336] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 1.645s (SENT)
I20260709 12:14:52.051646  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:52.058943  5192 raft_consensus.cc:2468] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 9.
I20260709 12:14:52.060981  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:52.018023  9292 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:52.057008  9119 raft_consensus.cc:515] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:52.070305  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:52.064239  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:52.065924  5835 raft_consensus.cc:2393] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 9: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:52.063145  9193 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:52.070915  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 192355us
I20260709 12:14:52.072968  5270 raft_consensus.cc:2468] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 8.
W20260709 12:14:52.075160  5166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:52.078446  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:52.079303  5270 raft_consensus.cc:3060] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:52.058512  9311 raft_consensus.cc:3060] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:52.086438  5272 raft_consensus.cc:1240] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:52.035230  9135 consensus_queue.cc:1059] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:14:52.105626  9106 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:52.106379  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:14:52.100832  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 53116.2us
I20260709 12:14:52.115573  5266 raft_consensus.cc:2468] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 10.
I20260709 12:14:52.028705  9174 consensus_queue.cc:260] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:52.121577  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:52.122462  5266 raft_consensus.cc:2376] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 11. Re-sending same reply.
W20260709 12:14:52.127112  5088 leader_election.cc:336] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 1.665s (SENT)
I20260709 12:14:52.127764  5088 leader_election.cc:304] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:52.150763  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:52.151618  5272 raft_consensus.cc:2468] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 9.
I20260709 12:14:52.156466  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:52.080226  9193 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:52.157323  5266 raft_consensus.cc:2468] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 12.
I20260709 12:14:52.157734  5237 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:52.164068  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:52.169220  5272 raft_consensus.cc:2393] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 9: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:52.154438  9212 raft_consensus.cc:3055] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:14:52.170572  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:52.171231  5266 raft_consensus.cc:2376] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 12. Re-sending same reply.
I20260709 12:14:52.162523  9322 raft_consensus.cc:2749] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:52.174007  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:52.174746  5268 raft_consensus.cc:2376] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 10. Re-sending same reply.
I20260709 12:14:52.175520  9301 consensus_queue.cc:1048] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:52.170742  9212 raft_consensus.cc:740] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:52.178736  5237 leader_election.cc:304] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:52.159545  9174 raft_consensus.cc:3060] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:52.156469  9119 leader_election.cc:290] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:52.167296  9023 raft_consensus.cc:2804] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:14:52.195864  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:52.196794  9061 raft_consensus.cc:2749] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:52.187866  9023 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:52.202142  9023 raft_consensus.cc:3060] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:52.183382  9294 consensus_queue.cc:1059] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:14:52.162719  9170 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:52.205838  5270 raft_consensus.cc:2468] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 9.
I20260709 12:14:52.206996  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:52.207300  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:52.207881  5266 raft_consensus.cc:2376] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 9. Re-sending same reply.
I20260709 12:14:52.208647  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:52.209177  5266 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 7.
W20260709 12:14:52.205755  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 84846us
W20260709 12:14:52.210188  5088 leader_election.cc:336] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 1.686s (SENT)
I20260709 12:14:52.211022  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:52.211797  5270 raft_consensus.cc:2468] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 8.
I20260709 12:14:52.217558  5088 leader_election.cc:304] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:52.183296  9301 consensus_queue.cc:1048] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:14:52.218922  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:52.221174  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:52.221874  5200 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 7.
I20260709 12:14:52.222743  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:52.226899  9095 raft_consensus.cc:2749] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:52.229365  9106 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:52.232193  9329 log.cc:927] Time spent T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.339s	user 0.000s	sys 0.003s
I20260709 12:14:52.219247  9170 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:52.235572  9170 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:52.238482  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:52.238775  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:52.239213  5117 raft_consensus.cc:2468] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 10.
I20260709 12:14:52.241091  5837 raft_consensus.cc:1275] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:14:52.242317  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:52.219728  9212 consensus_queue.cc:260] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:52.245247  9212 raft_consensus.cc:3060] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:52.254469  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:52.090788  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:14:52.269160  5166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:52.270131  5166 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:52.274549  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:52.275388  5272 raft_consensus.cc:2376] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 12. Re-sending same reply.
I20260709 12:14:52.303550  5837 raft_consensus.cc:1275] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:14:52.304149  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
W20260709 12:14:52.303658  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 93490.7us
I20260709 12:14:52.320984  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:14:52.305056  5088 leader_election.cc:336] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 1.903s (SENT)
I20260709 12:14:52.324230  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:52.328688  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:52.329495  5125 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 7.
I20260709 12:14:52.330502  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:52.331409  5116 raft_consensus.cc:2468] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 8.
I20260709 12:14:52.332816  5121 raft_consensus.cc:1275] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:14:52.334015  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:52.335626  5122 raft_consensus.cc:1240] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 LEADER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:52.337852  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:52.343643  5088 leader_election.cc:336] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 2.002s (SENT)
I20260709 12:14:52.298928  9299 raft_consensus.cc:3060] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:52.354075  5088 leader_election.cc:336] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 2.015s (SENT)
I20260709 12:14:52.355506  5088 leader_election.cc:304] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:52.303709  9135 raft_consensus.cc:493] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:52.357240  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:52.358667  5117 raft_consensus.cc:1240] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:52.359127  5237 leader_election.cc:304] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:52.360052  5119 raft_consensus.cc:1275] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:14:52.321120  9106 raft_consensus.cc:2804] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:52.358374  5271 raft_consensus.cc:2376] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 13. Re-sending same reply.
I20260709 12:14:52.339792  9254 raft_consensus.cc:493] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:52.340708  9211 raft_consensus.cc:493] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:52.368933  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:52.369604  5271 raft_consensus.cc:2376] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 10. Re-sending same reply.
I20260709 12:14:52.359560  9193 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:52.362949  9106 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:52.390084  5088 leader_election.cc:336] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 2.132s (SENT)
I20260709 12:14:52.390609  5088 leader_election.cc:304] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:52.391347  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:52.373294  9301 consensus_queue.cc:1059] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 12:14:52.372763  9095 raft_consensus.cc:2749] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:52.393857  5271 raft_consensus.cc:2393] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 9: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
W20260709 12:14:52.374141  9132 consensus_meta.cc:287] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.527s	user 0.012s	sys 0.005s
I20260709 12:14:52.362385  9135 raft_consensus.cc:515] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:52.616572  9252 raft_consensus.cc:493] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:52.377522  9211 raft_consensus.cc:515] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:52.392256  9106 raft_consensus.cc:3060] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:52.617152  9252 raft_consensus.cc:515] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:52.619659  9252 leader_election.cc:290] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:52.617165  9135 leader_election.cc:290] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:52.371738  9254 raft_consensus.cc:515] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:52.623004  9254 leader_election.cc:290] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:52.380280  9061 raft_consensus.cc:3060] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:52.627817  8896 raft_consensus.cc:3060] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:52.630950  9211 leader_election.cc:290] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:52.633723  5802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:52.482481  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 176770us
W20260709 12:14:52.534857  5166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:52.636217  5163 leader_election.cc:336] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 1.537s (SENT)
I20260709 12:14:52.637209  5163 leader_election.cc:304] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:52.596791  5196 raft_consensus.cc:1275] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:14:52.598937  9248 raft_consensus.cc:3055] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:14:52.392832  5088 leader_election.cc:336] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 2.150s (SENT)
I20260709 12:14:52.365861  9270 consensus_queue.cc:1048] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
W20260709 12:14:52.600034  9292 consensus_meta.cc:287] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.530s	user 0.003s	sys 0.023s
I20260709 12:14:52.602696  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:52.604383  5273 raft_consensus.cc:1275] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:14:52.380527  9198 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:52.604390  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:52.391628  9234 raft_consensus.cc:2749] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:52.605815  5268 raft_consensus.cc:1275] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:14:52.606204  9301 consensus_queue.cc:1243] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer ad2f9a1e2f7a45429fa69fd23d09f821 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:14:52.611384  5274 raft_consensus.cc:2410] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 12:14:52.611816  9342 log.cc:927] Time spent T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.416s	user 0.001s	sys 0.001s
W20260709 12:14:52.559104  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 197240us
W20260709 12:14:52.641897  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 342651us
I20260709 12:14:52.641774  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:52.651461  5088 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:52.645299  5237 leader_election.cc:304] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:52.655526  5272 raft_consensus.cc:2393] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 9: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:52.654632  9132 raft_consensus.cc:515] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:52.611461  9311 consensus_meta.cc:287] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.521s	user 0.014s	sys 0.007s
I20260709 12:14:52.669049  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:52.641745  9103 raft_consensus.cc:493] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:52.651309  9248 raft_consensus.cc:740] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:52.706455  5193 raft_consensus.cc:1240] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:14:52.730779  5804 leader_election.cc:304] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:52.732191  5123 raft_consensus.cc:2468] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 5.
W20260709 12:14:52.704545  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 68861.8us
I20260709 12:14:52.748981  5801 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
W20260709 12:14:52.750514  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 105326us
I20260709 12:14:52.752133  5238 leader_election.cc:304] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:52.776420  5238 leader_election.cc:304] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:52.777942  9294 raft_consensus.cc:2749] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:52.778788  9294 consensus_queue.cc:1048] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:52.780727  9294 raft_consensus.cc:2749] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:14:52.782279  9310 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.878s	user 0.025s	sys 0.045s
W20260709 12:14:52.782706  9310 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.878s	user 0.025s	sys 0.045s
W20260709 12:14:52.723901  9344 log.cc:927] Time spent T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.498s	user 0.001s	sys 0.001s
I20260709 12:14:52.800125  5119 raft_consensus.cc:1275] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:14:52.797241  5123 raft_consensus.cc:1275] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:14:52.788391  5238 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:52.719986  9320 raft_consensus.cc:3055] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:52.811347  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:52.819288  5265 raft_consensus.cc:2468] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 10.
I20260709 12:14:52.820369  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:52.813150  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:52.814263  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:52.821543  5271 raft_consensus.cc:2393] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 9: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:52.705857  9292 raft_consensus.cc:493] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:52.814458  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:52.816443  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:52.815189  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:52.822896  5832 raft_consensus.cc:2393] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 11: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:52.675223  9270 consensus_queue.cc:1243] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer ad2f9a1e2f7a45429fa69fd23d09f821 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:14:52.824771  9294 raft_consensus.cc:2749] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:52.826349  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:52.826906  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:52.827565  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:52.828042  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:52.828598  5829 raft_consensus.cc:1240] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 9. Current term is 10. Ops: []
W20260709 12:14:52.831658  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 195458us
I20260709 12:14:52.839614  9061 raft_consensus.cc:2749] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:14:52.840780  5269 raft_consensus.cc:1275] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:14:52.841671  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:52.827142  5272 raft_consensus.cc:2393] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 10: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:52.790256  9322 raft_consensus.cc:2749] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:52.743281  9311 raft_consensus.cc:2749] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:52.842888  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:52.845170  9268 consensus_queue.cc:1048] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 12:14:52.846052  5166 leader_election.cc:304] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:52.846498  9286 consensus_queue.cc:1048] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:52.847628  9335 raft_consensus.cc:2804] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:52.848124  9335 raft_consensus.cc:493] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:52.848308  9351 consensus_queue.cc:1048] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:14:52.850535  9339 log.cc:927] Time spent T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.626s	user 0.000s	sys 0.008s
I20260709 12:14:52.844831  5265 raft_consensus.cc:1240] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:52.851486  9132 leader_election.cc:290] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:52.852126  9132 consensus_queue.cc:1048] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:14:52.829178  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:52.819015  9320 raft_consensus.cc:740] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:52.854316  9320 consensus_queue.cc:260] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:52.855543  9320 raft_consensus.cc:3060] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:52.853421  5273 raft_consensus.cc:3060] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:52.858016  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
W20260709 12:14:52.858686  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 465827us
I20260709 12:14:52.858769  5271 raft_consensus.cc:3060] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:52.861799  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:52.862452  5192 raft_consensus.cc:2468] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
I20260709 12:14:52.773581  9103 raft_consensus.cc:515] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:52.844661  5830 raft_consensus.cc:1240] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:14:52.862696  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:52.867758  5193 raft_consensus.cc:2468] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 8.
I20260709 12:14:52.717211  9260 raft_consensus.cc:2749] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:14:52.869199  5271 raft_consensus.cc:2468] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 11.
I20260709 12:14:52.784723  9301 raft_consensus.cc:2749] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:52.676236  9198 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:52.858690  9061 raft_consensus.cc:493] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:52.883941  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:52.798367  8993 raft_consensus.cc:2804] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:52.882709  5018 catalog_manager.cc:5697] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 8 to 9, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 9 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:52.784543  9119 consensus_queue.cc:1048] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.094s
I20260709 12:14:52.874531  9335 raft_consensus.cc:3060] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:52.920928  5273 raft_consensus.cc:2468] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 11.
I20260709 12:14:52.872825  9252 raft_consensus.cc:2804] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:52.808483  9170 consensus_queue.cc:1059] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.093s
I20260709 12:14:52.841105  9106 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:52.928203  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:52.867434  9294 raft_consensus.cc:493] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:52.932823  5830 raft_consensus.cc:1240] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 7. Current term is 8. Ops: []
W20260709 12:14:52.949703  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 49449.6us
I20260709 12:14:52.897801  8993 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:52.900904  9311 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:52.926904  9282 raft_consensus.cc:493] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:52.874248  9292 raft_consensus.cc:515] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:52.967389  5197 raft_consensus.cc:1240] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:52.973994  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:52.959868  8993 raft_consensus.cc:3060] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:52.998571  5830 raft_consensus.cc:1275] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:14:52.956692  9252 raft_consensus.cc:493] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:53.014053  5119 pending_rounds.cc:85] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting all ops after (but not including) 5
I20260709 12:14:53.014415  5119 pending_rounds.cc:107] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:14:52.969563  9363 raft_consensus.cc:493] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:53.014672  5119 raft_consensus.cc:2889] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:52.958294  9294 raft_consensus.cc:515] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:52.957312  9061 raft_consensus.cc:515] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:53.004719  9252 raft_consensus.cc:3060] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:52.972225  9311 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:53.029841  9174 consensus_meta.cc:287] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.843s	user 0.010s	sys 0.018s
I20260709 12:14:53.030987  9311 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:53.031585  5165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:53.025202  9274 consensus_queue.cc:1048] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.008s
W20260709 12:14:53.036265  9023 consensus_meta.cc:287] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.825s	user 0.015s	sys 0.014s
I20260709 12:14:53.036722  9023 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:53.038772  9023 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:53.042841  5829 raft_consensus.cc:2468] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 7.
I20260709 12:14:53.044538  9198 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:53.050786  9294 leader_election.cc:290] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:53.005934  9362 consensus_queue.cc:1048] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:14:53.053098  9103 leader_election.cc:290] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:53.060676  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:53.061414  5118 raft_consensus.cc:2468] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 7.
I20260709 12:14:53.062554  5804 leader_election.cc:304] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:53.063604  9268 raft_consensus.cc:2804] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:53.063987  9268 raft_consensus.cc:493] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:53.064324  9268 raft_consensus.cc:3060] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:52.973182  9282 raft_consensus.cc:515] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:53.067175  5195 raft_consensus.cc:2468] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 11.
I20260709 12:14:53.075208  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:53.078557  5124 raft_consensus.cc:1275] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:14:53.082849  8993 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:53.086483  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:53.087143  5118 raft_consensus.cc:3060] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:53.090893  9061 leader_election.cc:290] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:53.095929  5118 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 8.
W20260709 12:14:53.097113  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 307463us
I20260709 12:14:53.098732  5089 leader_election.cc:304] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:53.115579  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:53.023447  9363 raft_consensus.cc:515] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:53.091908  9292 leader_election.cc:290] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:53.174597  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:53.178299  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:53.183467  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:53.184135  5192 raft_consensus.cc:3060] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:53.160776  9211 raft_consensus.cc:2804] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:53.223160  5192 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 8.
I20260709 12:14:53.233582  5268 raft_consensus.cc:1275] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:14:53.234614  8993 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:53.171813  9103 consensus_queue.cc:1048] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 12:14:53.224326  9211 raft_consensus.cc:697] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
W20260709 12:14:53.246209  5802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:53.249305  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:53.252799  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:53.255067  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:53.255812  5266 raft_consensus.cc:2468] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 5.
I20260709 12:14:53.236357  9106 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:53.262347  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:53.263198  5266 raft_consensus.cc:2393] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 8: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:53.265910  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:53.266950  5266 raft_consensus.cc:2393] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 7: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
W20260709 12:14:53.269035  5238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:53.269810  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 371966us
I20260709 12:14:53.271044  5272 raft_consensus.cc:1275] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 12:14:53.285241  5272 pending_rounds.cc:85] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929: Aborting all ops after (but not including) 9
I20260709 12:14:53.285617  5272 pending_rounds.cc:107] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 12:14:53.272253  5829 raft_consensus.cc:1275] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:14:53.285365  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:53.241706  9290 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.287127  5272 raft_consensus.cc:2889] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:53.290529  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:53.296350  5266 raft_consensus.cc:2468] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 5.
I20260709 12:14:53.309625  5018 catalog_manager.cc:5697] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 5 to 6, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 6 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:53.311934  5018 catalog_manager.cc:5697] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 4 to 7, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 7 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:53.317341  9170 raft_consensus.cc:3055] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:53.318908  9248 consensus_queue.cc:260] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:53.320407  9294 raft_consensus.cc:493] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:53.322147  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 252196us
W20260709 12:14:53.326334  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 375334us
I20260709 12:14:53.336153  5163 leader_election.cc:304] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:53.351858  5238 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:53.321877  9323 raft_consensus.cc:493] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.325697  9023 raft_consensus.cc:493] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.356832  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:53.361323  5240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:53.364950  5238 leader_election.cc:304] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:53.366562  5238 leader_election.cc:304] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:53.333581  9267 raft_consensus.cc:493] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:53.298573  9290 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:53.379520  9267 raft_consensus.cc:515] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:53.380910  9290 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:53.381443  9267 leader_election.cc:290] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:53.368927  5018 catalog_manager.cc:5697] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 6 to 9, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 9 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:14:53.384099  5018 catalog_manager.cc:5697] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 3 to 7, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 7 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:14:53.387259  5197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41416 (request call id 762) took 1281 ms. Trace:
I20260709 12:14:53.387717  5197 rpcz_store.cc:276] 0709 12:14:52.106309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:52.609320 (+503011us) service_pool.cc:224] Handling call
0709 12:14:52.609616 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:52.970843 (+361227us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:53.387007 (+416164us) spinlock_profiling.cc:243] Waited 357 ms on lock 0x7b540032d554. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:53.387195 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":822218624}
I20260709 12:14:53.368824  9095 raft_consensus.cc:493] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:53.390202  9095 raft_consensus.cc:515] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:53.392408  9095 leader_election.cc:290] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:53.371760  9211 consensus_queue.cc:237] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:53.393621  9214 raft_consensus.cc:2749] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:14:53.394380  9214 raft_consensus.cc:2749] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:53.394968  9214 consensus_queue.cc:1059] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:53.398736  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:53.399405  5837 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 9.
I20260709 12:14:53.377076  9320 raft_consensus.cc:2749] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:53.378605  9252 raft_consensus.cc:515] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:53.402745  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:53.350236  9170 raft_consensus.cc:740] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:53.333907  9282 leader_election.cc:290] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:53.356526  9349 raft_consensus.cc:493] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.406813  5164 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:53.349644  9292 consensus_queue.cc:1048] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 12:14:53.418443  5164 leader_election.cc:304] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:53.407266  5018 catalog_manager.cc:5697] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 8 to 10, leader changed from bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 10 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:53.408123  5835 raft_consensus.cc:1275] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:14:53.420490  5163 leader_election.cc:304] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:53.354733  9294 raft_consensus.cc:515] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:53.402154  9363 leader_election.cc:290] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:53.401546  9368 raft_consensus.cc:2749] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:53.426004  5163 leader_election.cc:304] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:53.425016  5018 catalog_manager.cc:5697] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 8 to 9, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 9 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:53.414709  9095 raft_consensus.cc:493] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.369585  9023 raft_consensus.cc:515] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:53.432119  5801 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:53.368348  9323 raft_consensus.cc:515] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:53.421229  9270 raft_consensus.cc:2749] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:14:53.419385  9254 consensus_queue.cc:1048] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 12:14:53.436175  5018 catalog_manager.cc:5697] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 5 to 10, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 10 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:53.460772  9268 raft_consensus.cc:515] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:53.442591  9335 raft_consensus.cc:515] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:53.443204  9294 leader_election.cc:290] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:53.443822  9368 raft_consensus.cc:2804] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:53.435834  9363 raft_consensus.cc:2804] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:53.439636  9286 raft_consensus.cc:493] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:53.444533  5163 leader_election.cc:304] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:53.430405  9084 raft_consensus.cc:493] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.419386  9349 raft_consensus.cc:515] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:53.407068  9356 consensus_queue.cc:1048] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:14:53.427611  9260 raft_consensus.cc:2749] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:53.435950  9282 consensus_queue.cc:1059] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 12:14:53.446326  9290 raft_consensus.cc:2749] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:14:53.482255  9290 raft_consensus.cc:3055] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:14:53.482617  9290 raft_consensus.cc:740] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:53.483477  9290 consensus_queue.cc:260] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:53.484702  9290 raft_consensus.cc:3060] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:53.446424  5195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47744 (request call id 2274) took 1401 ms. Trace:
I20260709 12:14:53.448134  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:53.485472  9084 raft_consensus.cc:515] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:53.486440  5116 raft_consensus.cc:2468] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 5.
I20260709 12:14:53.487632  9084 leader_election.cc:290] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:53.450361  5117 raft_consensus.cc:1240] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:53.453085  9103 consensus_queue.cc:1048] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:53.403118  9059 consensus_queue.cc:1059] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:14:53.436298  9195 consensus_queue.cc:1059] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:14:53.456336  9252 leader_election.cc:290] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:53.436939  9267 consensus_queue.cc:1048] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
W20260709 12:14:53.457075  5088 leader_election.cc:336] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 2.226s (SENT)
I20260709 12:14:53.458524  9323 leader_election.cc:290] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:53.461858  5801 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:53.427356  9299 raft_consensus.cc:493] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.533011  9299 raft_consensus.cc:515] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:53.474005  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:53.468019  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:53.473932  5018 catalog_manager.cc:5697] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 5 to 7, leader changed from bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 7 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:53.477265  5163 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:53.485526  5195 rpcz_store.cc:276] 0709 12:14:52.044526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:52.044681 (+   155us) service_pool.cc:224] Handling call
0709 12:14:53.446249 (+1401568us) spinlock_profiling.cc:243] Waited 986 ms on lock 0x7b54002fb7d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:53.446348 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2268587776}
I20260709 12:14:53.494818  5836 raft_consensus.cc:2368] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 8. Current term is 9.
I20260709 12:14:53.490414  5240 leader_election.cc:304] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
W20260709 12:14:53.538347  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 48026.4us
I20260709 12:14:53.474483  9363 raft_consensus.cc:493] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:53.528549  9269 raft_consensus.cc:493] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:53.552585  9269 raft_consensus.cc:515] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:53.553086  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 96033.6us
I20260709 12:14:53.553454  9363 raft_consensus.cc:3060] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:53.553738  5088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:53.553957  9369 raft_consensus.cc:2804] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:14:53.554399  9369 raft_consensus.cc:493] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:53.440450  9170 consensus_queue.cc:260] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:53.554733  9369 raft_consensus.cc:3060] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:53.528457  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:53.529031  5019 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33896 (request call id 321) took 11153 ms. Trace:
I20260709 12:14:53.488418  9286 raft_consensus.cc:515] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:53.477663  9321 consensus_queue.cc:1048] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.080s
I20260709 12:14:53.554809  9269 leader_election.cc:290] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:53.529670  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:53.558357  9323 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:53.533363  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 71570.1us
I20260709 12:14:53.465701  9119 consensus_queue.cc:1048] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:14:53.558938  9323 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:53.559290  5801 leader_election.cc:304] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:53.428244  9320 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:53.532225  9362 raft_consensus.cc:3055] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:53.440578  9095 raft_consensus.cc:515] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:53.559944  9362 raft_consensus.cc:740] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:53.560022  9320 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:53.560410  5801 leader_election.cc:304] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:53.561595  5801 leader_election.cc:304] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:53.562369  9320 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:14:53.477519  9367 log.cc:927] Time spent T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260709 12:14:53.562721  9095 leader_election.cc:290] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:53.563274  9267 raft_consensus.cc:2749] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:14:53.564656  5118 raft_consensus.cc:2410] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:14:53.481370  9349 leader_election.cc:290] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:53.528925  9103 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:53.565444  5801 leader_election.cc:304] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:53.565435  9103 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:53.565948  5088 leader_election.cc:304] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:53.567706  9274 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:53.567843  9103 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:53.568414  9103 raft_consensus.cc:2749] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:53.568264  9274 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:53.564073  9269 raft_consensus.cc:2804] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:53.569898  9269 raft_consensus.cc:697] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 9 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:53.488634  9364 raft_consensus.cc:2749] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:53.563990  9267 raft_consensus.cc:2804] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:53.571050  9267 raft_consensus.cc:697] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 11 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:53.570928  9269 consensus_queue.cc:237] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:53.571784  9311 consensus_queue.cc:1048] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:14:53.571954  9267 consensus_queue.cc:237] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:53.572629  9286 leader_election.cc:290] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:53.555491  5019 rpcz_store.cc:276] 0709 12:14:42.308474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:42.308725 (+   251us) service_pool.cc:224] Handling call
0709 12:14:53.437343 (+11128618us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:48.847667 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:48.848314 (+   647us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:48.848356 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:14:48.848376 (+    20us) tablet.cc:662] Decoding operations
0709 12:14:48.968090 (+119714us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:48.968161 (+    71us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:48.968188 (+    27us) tablet.cc:685] Acquiring locks for 21 operations
0709 12:14:48.969693 (+  1505us) tablet.cc:701] Row locks acquired
0709 12:14:48.969714 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:14:48.969863 (+   149us) write_op.cc:270] Start()
0709 12:14:48.969997 (+   134us) write_op.cc:276] Timestamp: P: 1783599288969812 usec, L: 0
0709 12:14:48.970020 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:14:49.044135 (+ 74115us) log.cc:844] Serialized 8242 byte log entry
0709 12:14:49.216072 (+171937us) spinlock_profiling.cc:243] Waited 88.7 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e3ab90ac 00007f84ec9139a9 00007f84e3ad569b 00007f84e3ad393f 00007f84e3ad5c02 00007f84e675d20b
0709 12:14:49.693571 (+477499us) op_driver.cc:464] REPLICATION: finished
0709 12:14:49.882247 (+188676us) write_op.cc:301] APPLY: starting
0709 12:14:49.900242 (+ 17995us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:50.140872 (+240630us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:50.141052 (+   180us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:50.439158 (+298106us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:50.439603 (+   445us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=42,mrs_lookups=0
0709 12:14:50.439667 (+    64us) write_op.cc:312] APPLY: finished
0709 12:14:50.440246 (+   579us) log.cc:844] Serialized 188 byte log entry
0709 12:14:50.440459 (+   213us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:50.441773 (+  1314us) write_op.cc:454] Released schema lock
0709 12:14:50.441856 (+    83us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:50.484103 (+ 42247us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:50.484137 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2290,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":183014,"apply.run_cpu_time_us":36803,"apply.run_wall_time_us":594713,"cfile_cache_hit":82,"cfile_cache_hit_bytes":85649,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6216,"cfile_init":2,"lbm_read_time_us":1563,"lbm_reads_lt_1ms":12,"num_ops":21,"prepare.queue_time_us":97993,"prepare.run_cpu_time_us":41609,"prepare.run_wall_time_us":539863,"raft.queue_time_us":226090,"raft.run_cpu_time_us":26058,"raft.run_wall_time_us":135758,"replication_time_us":673870,"spinlock_wait_cycles":204080000,"thread_start_us":623618,"threads_started":4,"wal-append.queue_time_us":281110,"wal-append.run_cpu_time_us":40931,"wal-append.run_wall_time_us":2116215}]]}
I20260709 12:14:53.560951  9362 consensus_queue.cc:260] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:53.527271  9368 raft_consensus.cc:697] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
W20260709 12:14:53.538827  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 61649.7us
I20260709 12:14:53.564188  5267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34672 (request call id 2161) took 1439 ms. Trace:
I20260709 12:14:53.541597  9252 raft_consensus.cc:2749] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:14:53.557629  5018 catalog_manager.cc:5697] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 10 to 8, leader changed from <none> to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 8 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:14:53.576352  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:53.583936  5801 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:53.565815  9378 raft_consensus.cc:2804] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:53.587389  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:53.554628  9023 leader_election.cc:290] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:53.586273  5163 leader_election.cc:304] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:53.570173  9321 raft_consensus.cc:2804] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:53.593680  5163 leader_election.cc:304] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:53.594964  5163 leader_election.cc:304] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:14:53.549439  9377 log.cc:927] Time spent T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:14:53.579895  5267 rpcz_store.cc:276] 0709 12:14:52.125087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:52.126289 (+  1202us) service_pool.cc:224] Handling call
0709 12:14:52.155197 (+ 28908us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:52.168234 (+ 13037us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:52.168268 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:52.795220 (+626952us) spinlock_profiling.cc:243] Waited 5.13 ms on lock 0x7b2c000c2038. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e54bca11 00007f84e54cc372 00007f84e6bfea01 00007f84e6bc343a 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2
0709 12:14:52.830599 (+ 35379us) log.cc:844] Serialized 52 byte log entry
0709 12:14:52.999998 (+169399us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:53.000040 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:53.000101 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:53.563862 (+563761us) raft_consensus.cc:1685] finished
0709 12:14:53.563880 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:53.564112 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3328,"raft.queue_time_us":9523,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":15732,"spinlock_wait_cycles":11799808,"thread_start_us":169017,"threads_started":1,"wal-append.queue_time_us":356790}
W20260709 12:14:53.598688  9379 log.cc:927] Time spent T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:14:53.600868  9368 consensus_queue.cc:237] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:53.596114  9364 raft_consensus.cc:2749] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:53.606575  9299 leader_election.cc:290] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:53.607411  9335 leader_election.cc:290] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:53.589155  5018 catalog_manager.cc:5697] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 5 to 10, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 10 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:53.561017  9323 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:53.597010  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:53.613879  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:53.584168  9286 raft_consensus.cc:493] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:53.623946  5119 raft_consensus.cc:2393] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 12: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:53.624454  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:53.623981  9198 raft_consensus.cc:2749] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:53.585810  9349 consensus_queue.cc:1059] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 12:14:53.635035  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:53.635398  5163 leader_election.cc:304] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:53.635823  5123 raft_consensus.cc:2468] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 7.
I20260709 12:14:53.633911  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:53.617563  9362 raft_consensus.cc:3060] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:53.613031  9299 raft_consensus.cc:493] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.626278  9252 raft_consensus.cc:2749] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:53.645432  5240 leader_election.cc:304] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:53.635129  9366 raft_consensus.cc:2804] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:53.653719  9366 raft_consensus.cc:697] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 8 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:53.637405  9195 consensus_queue.cc:1048] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:14:53.650090  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:53.651705  9349 raft_consensus.cc:2804] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:53.655990  5119 raft_consensus.cc:3060] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:53.654700  9366 consensus_queue.cc:237] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:53.643548  9323 raft_consensus.cc:493] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:53.670460  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 104569us
I20260709 12:14:53.670796  9260 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.671789  9356 raft_consensus.cc:493] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.671360  9260 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:53.672286  9356 raft_consensus.cc:515] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:53.673718  9260 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:53.674389  9356 leader_election.cc:290] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:53.676800  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 260886us
I20260709 12:14:53.680375  9321 raft_consensus.cc:697] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:53.680603  9254 raft_consensus.cc:493] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:53.681099  9254 raft_consensus.cc:515] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:53.681442  9321 consensus_queue.cc:237] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:53.683487  9254 leader_election.cc:290] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:53.684012  9260 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.684514  9260 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:53.686826  9260 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:53.688602  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 104721us
W20260709 12:14:53.671346  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 303521us
I20260709 12:14:53.697271  9282 consensus_queue.cc:1059] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:14:53.698357  9282 raft_consensus.cc:3055] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:14:53.698798  9282 raft_consensus.cc:740] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:53.699906  9282 consensus_queue.cc:260] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:53.701428  9282 raft_consensus.cc:3060] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:53.703630  9269 raft_consensus.cc:493] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:53.704274  9269 raft_consensus.cc:515] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:53.706650  9269 leader_election.cc:290] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:53.641887  9364 consensus_queue.cc:1048] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 12:14:53.708983  5088 leader_election.cc:304] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:53.715269  5238 leader_election.cc:400] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 election: Vote denied by peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539) with higher term. Message: Invalid argument: T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 8. Current term is 9.
I20260709 12:14:53.716650  5238 leader_election.cc:403] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:14:53.719846  5195 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0"
dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
mode: GRACEFUL
new_leader_uuid: "bce73265e27d4b30a4dcc1e491305088"
 from {username='slave'} at 127.0.0.1:53902
I20260709 12:14:53.720444  5195 raft_consensus.cc:606] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Received request to transfer leadership to TS bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:53.720789  5195 raft_consensus.cc:614] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:53.721747  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:53.722558  5123 raft_consensus.cc:3060] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:53.656630  9349 raft_consensus.cc:493] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:53.637858  9286 raft_consensus.cc:515] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:53.722050  5088 leader_election.cc:304] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:53.735808  5837 raft_consensus.cc:1240] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:53.737279  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:53.738204  5834 raft_consensus.cc:2410] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 12:14:53.729892  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:53.662756  9174 raft_consensus.cc:2749] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:53.742717  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:53.743372  5266 raft_consensus.cc:2468] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 8.
I20260709 12:14:53.743651  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:53.744218  5124 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 9.
I20260709 12:14:53.740250  5121 raft_consensus.cc:2468] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 12.
I20260709 12:14:53.726039  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:53.741080  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:53.746399  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:53.746658  5272 raft_consensus.cc:2393] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 13: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:53.741678  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:53.648917  9299 raft_consensus.cc:515] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:53.748708  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:53.749402  5274 raft_consensus.cc:2468] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 8.
I20260709 12:14:53.749024  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:14:53.750929  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 332530us
I20260709 12:14:53.747354  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:53.719230  9274 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:53.719308  9320 raft_consensus.cc:493] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.750058  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:14:53.754431  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 404545us
I20260709 12:14:53.667330  9198 consensus_queue.cc:1048] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 12:14:53.757297  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:53.778234  5265 raft_consensus.cc:2468] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 11.
I20260709 12:14:53.723428  9347 raft_consensus.cc:3060] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:53.756268  5269 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 10.
I20260709 12:14:53.767251  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
W20260709 12:14:53.767524  5240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:53.735294  9349 raft_consensus.cc:3060] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:53.776533  5123 raft_consensus.cc:2468] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 6.
I20260709 12:14:53.779883  5268 raft_consensus.cc:2376] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 10. Re-sending same reply.
I20260709 12:14:53.781625  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:53.784150  5835 raft_consensus.cc:2393] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 8: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:53.742156  9294 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.717823  9301 consensus_queue.cc:1048] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:14:53.723393  9323 raft_consensus.cc:515] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:53.808084  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 71404.8us
I20260709 12:14:53.810055  5163 leader_election.cc:304] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:53.783159  9234 raft_consensus.cc:2764] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:14:53.808980  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:53.786242  9384 raft_consensus.cc:493] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:53.796496  5119 raft_consensus.cc:2468] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 9.
I20260709 12:14:53.845990  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:53.781703  9320 raft_consensus.cc:515] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:53.804997  9368 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.804132  9351 raft_consensus.cc:493] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.798031  9135 raft_consensus.cc:2804] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:14:53.799000  9378 raft_consensus.cc:697] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 9 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:53.873173  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:53.867978  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:53.858780  5272 raft_consensus.cc:2468] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 9.
I20260709 12:14:53.848533  9252 raft_consensus.cc:2804] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:53.871191  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:53.953816  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:53.858022  9384 raft_consensus.cc:515] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:53.868672  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:53.954746  9135 raft_consensus.cc:493] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:53.955224  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:53.817145  5163 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:53.869866  9381 raft_consensus.cc:493] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.884750  9383 raft_consensus.cc:493] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:53.806113  9364 raft_consensus.cc:493] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:53.956418  9252 raft_consensus.cc:493] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:53.956622  9381 raft_consensus.cc:515] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:53.957156  9383 raft_consensus.cc:515] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:53.958175  9252 raft_consensus.cc:3060] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:53.847992  9369 raft_consensus.cc:515] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:53.959456  9383 leader_election.cc:290] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:53.897192  9299 leader_election.cc:290] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:53.932684  9286 leader_election.cc:290] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:14:53.875581  9389 log.cc:927] Time spent T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:14:53.871799  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:53.906890  9195 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:53.871592  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:53.868326  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:53.960769  5271 raft_consensus.cc:2393] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 6: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:53.913733  5088 leader_election.cc:304] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:14:53.965204  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 51540.5us
I20260709 12:14:53.955490  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:53.966544  5088 leader_election.cc:304] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:53.850684  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:53.968125  5192 raft_consensus.cc:2393] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 10: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:53.962164  5196 raft_consensus.cc:2468] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 8.
I20260709 12:14:53.969092  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:53.955896  5193 raft_consensus.cc:2468] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 12.
I20260709 12:14:53.969846  5196 raft_consensus.cc:2410] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:14:53.952478  5199 raft_consensus.cc:2468] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 8.
I20260709 12:14:53.970737  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:53.971114  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:53.971856  5193 raft_consensus.cc:2393] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 6: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:53.954020  5801 leader_election.cc:304] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:53.992354  5088 leader_election.cc:304] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:53.849167  5804 leader_election.cc:304] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
W20260709 12:14:54.001358  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 47426.3us
I20260709 12:14:54.004685  5801 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:54.008721  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:54.009501  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 160413us
W20260709 12:14:54.010617  5237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:53.951525  9351 raft_consensus.cc:515] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:53.952461  9368 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:54.012953  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:53.950732  9378 consensus_queue.cc:237] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:54.025332  5088 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:54.025660  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:54.014139  5274 raft_consensus.cc:1240] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 12. Current term is 13. Ops: []
W20260709 12:14:54.000329  9380 log.cc:927] Time spent T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.214s	user 0.000s	sys 0.002s
W20260709 12:14:54.006631  9385 log.cc:927] Time spent T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.121s	user 0.007s	sys 0.005s
W20260709 12:14:53.999843  9388 log.cc:927] Time spent T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.119s	user 0.005s	sys 0.007s
I20260709 12:14:53.951215  9320 leader_election.cc:290] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:54.027758  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:54.043488  5274 raft_consensus.cc:3060] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:54.013837  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:54.044271  5270 raft_consensus.cc:2468] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 7.
I20260709 12:14:54.007320  9394 raft_consensus.cc:2749] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:14:54.048095  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:53.967412  9381 leader_election.cc:290] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:54.033529  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:54.029371  9119 raft_consensus.cc:2804] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:53.999585  9274 raft_consensus.cc:2749] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:14:53.919216  9132 consensus_queue.cc:1048] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.089s
W20260709 12:14:54.000103  9392 log.cc:927] Time spent T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.198s	user 0.002s	sys 0.000s
I20260709 12:14:54.042028  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:53.880182  9211 consensus_queue.cc:1048] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.146s
I20260709 12:14:54.059566  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:53.955533  9135 raft_consensus.cc:3060] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:14:54.020725  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 203669us
W20260709 12:14:54.000231  9402 log.cc:927] Time spent T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.070s	user 0.001s	sys 0.001s
W20260709 12:14:54.051519  9399 log.cc:927] Time spent T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.113s	user 0.002s	sys 0.000s
I20260709 12:14:54.019383  9103 raft_consensus.cc:2749] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:53.802121  9294 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:54.057133  5269 raft_consensus.cc:2468] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 10.
I20260709 12:14:54.051607  9387 raft_consensus.cc:3060] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:54.075243  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:53.963989  9195 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:54.078306  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:53.970351  9369 leader_election.cc:290] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:54.036855  9393 raft_consensus.cc:2749] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:14:54.047385  9391 log.cc:927] Time spent T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.142s	user 0.002s	sys 0.005s
I20260709 12:14:54.049861  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:54.069633  5163 leader_election.cc:304] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:54.009092  9363 raft_consensus.cc:515] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:53.956821  9364 raft_consensus.cc:515] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:54.069567  9119 raft_consensus.cc:697] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 9 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:54.087322  9349 raft_consensus.cc:515] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:54.086162  5194 raft_consensus.cc:1240] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:54.083737  9198 raft_consensus.cc:2804] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:54.107580  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:54.085680  9363 leader_election.cc:290] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:54.090052  9401 raft_consensus.cc:3060] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:54.090912  9368 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:54.092446  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:54.083180  5163 leader_election.cc:304] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:54.093786  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:54.123733  5163 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:54.094563  5237 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:54.099826  5835 raft_consensus.cc:2410] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:14:54.080544  5125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40402 (request call id 2385) took 1020 ms. Trace:
I20260709 12:14:54.061199  9384 leader_election.cc:290] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:54.083981  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:54.070425  9409 raft_consensus.cc:2804] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:54.115142  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:54.118116  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:54.118202  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:54.103231  9290 consensus_meta.cc:287] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.617s	user 0.006s	sys 0.006s
I20260709 12:14:54.126022  5237 leader_election.cc:304] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:54.126523  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:54.122838  5837 raft_consensus.cc:2468] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 10.
I20260709 12:14:54.127902  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:54.128993  5119 raft_consensus.cc:2393] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 6: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:54.067123  5274 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 8.
I20260709 12:14:54.125171  5125 rpcz_store.cc:276] 0709 12:14:53.059928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:53.063808 (+  3880us) service_pool.cc:224] Handling call
0709 12:14:53.064124 (+   316us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:53.085270 (+ 21146us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:14:53.421930 (+336660us) log.cc:844] Serialized 14 byte log entry
0709 12:14:53.722673 (+300743us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:53.748491 (+ 25818us) log.cc:844] Serialized 52 byte log entry
0709 12:14:53.759276 (+ 10785us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:53.759321 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:53.759398 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:54.080293 (+320895us) raft_consensus.cc:1685] finished
0709 12:14:54.080313 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:54.080485 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72599,"prepare.queue_time_us":292492,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":90911,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":8395,"thread_start_us":583913,"threads_started":2,"wal-append.queue_time_us":310984}
I20260709 12:14:54.145646  9409 raft_consensus.cc:697] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:54.145887  9174 raft_consensus.cc:2804] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:54.146385  9174 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:54.146737  9174 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:54.147352  9195 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:54.148300  9409 consensus_queue.cc:237] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:54.150171  9103 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:54.150779  9103 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:54.109683  9198 raft_consensus.cc:493] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:54.076253  9394 consensus_queue.cc:1048] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 12:14:54.143999  5830 raft_consensus.cc:2468] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 12.
I20260709 12:14:54.156076  5237 leader_election.cc:304] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:54.160697  5237 leader_election.cc:304] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:54.163113  5237 leader_election.cc:304] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:54.127673  9411 raft_consensus.cc:2749] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:14:54.141606  9368 raft_consensus.cc:2804] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:14:54.171991  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:54.155182  9363 raft_consensus.cc:493] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:54.177268  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:54.185801  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:54.178217  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:54.180384  9354 raft_consensus.cc:2749] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:54.187155  5197 raft_consensus.cc:2468] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 8.
I20260709 12:14:54.187259  5196 raft_consensus.cc:2468] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 10.
I20260709 12:14:54.157008  9198 raft_consensus.cc:3060] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:54.189206  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:54.195181  5192 raft_consensus.cc:2393] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 6: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:54.192487  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:54.157230  9384 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:54.196264  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 166060us
I20260709 12:14:54.168241  9381 raft_consensus.cc:2804] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:54.169937  9369 raft_consensus.cc:2804] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:54.200738  5198 raft_consensus.cc:1240] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:54.168488  9320 raft_consensus.cc:2749] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:54.181850  9170 raft_consensus.cc:3060] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:54.182624  9368 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:54.194566  9362 consensus_meta.cc:287] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.549s	user 0.010s	sys 0.000s
I20260709 12:14:54.240258  9132 consensus_queue.cc:1059] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:14:54.241245  5237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:54.242558  9095 raft_consensus.cc:3055] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:54.242995  9095 raft_consensus.cc:740] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:54.243793  9095 consensus_queue.cc:260] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:54.246107  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:54.246245  5166 leader_election.cc:304] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:54.173574  9135 raft_consensus.cc:515] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:54.219306  9407 consensus_queue.cc:1048] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.145s
I20260709 12:14:54.221589  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:54.252262  5267 raft_consensus.cc:2368] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 8. Current term is 9.
I20260709 12:14:54.224136  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:54.254244  5195 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 9.
I20260709 12:14:54.248003  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:54.255443  5088 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
W20260709 12:14:54.212445  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 166935us
I20260709 12:14:54.193641  9363 raft_consensus.cc:515] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:54.249347  9412 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:54.249513  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:54.249418  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:54.246605  5199 raft_consensus.cc:2468] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 10.
I20260709 12:14:54.209690  9369 raft_consensus.cc:493] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:54.209779  9381 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:54.261085  5121 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 10.
I20260709 12:14:54.232940  9347 raft_consensus.cc:2749] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539) with higher term. Message: Invalid argument: T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 8. Current term is 9.
I20260709 12:14:54.235230  9368 raft_consensus.cc:3060] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:54.244974  9095 raft_consensus.cc:3060] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:54.267014  5117 raft_consensus.cc:2468] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 8.
W20260709 12:14:54.250325  9405 log.cc:927] Time spent T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 12:14:54.273541  5801 leader_election.cc:304] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:54.259688  9132 raft_consensus.cc:2804] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:54.248113  9351 leader_election.cc:290] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:54.266054  5237 leader_election.cc:304] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:54.260169  9254 raft_consensus.cc:2804] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:54.250192  9294 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:54.288151  5237 leader_election.cc:304] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:54.292009  5237 leader_election.cc:304] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:54.264454  9369 raft_consensus.cc:3060] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:54.209220  9119 consensus_queue.cc:237] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:54.209827  9384 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:54.264034  9381 raft_consensus.cc:3060] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:54.289042  9132 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:54.308347  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:54.308745  9132 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:14:54.309785  9425 log.cc:927] Time spent T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 12:14:54.311777  9401 raft_consensus.cc:2749] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:54.306780  5801 leader_election.cc:304] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:54.291150  9347 raft_consensus.cc:2804] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:54.298506  9351 raft_consensus.cc:2804] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:54.321636  5198 raft_consensus.cc:1275] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:14:54.323166  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:54.323676  9135 leader_election.cc:290] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:54.323791  5191 raft_consensus.cc:3060] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:54.300504  9294 raft_consensus.cc:2749] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:54.304316  9254 raft_consensus.cc:697] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:54.264889  9412 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:54.328732  5801 leader_election.cc:304] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:54.331400  5801 leader_election.cc:304] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:54.332063  9401 raft_consensus.cc:2749] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:54.316349  9349 leader_election.cc:290] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:54.334828  5801 leader_election.cc:304] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:54.318754  9347 raft_consensus.cc:493] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:54.325266  9351 raft_consensus.cc:493] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:54.317341  9335 consensus_queue.cc:1059] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 12:14:54.329794  9403 raft_consensus.cc:2749] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:14:54.351960  9363 leader_election.cc:290] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:54.353088  9268 leader_election.cc:290] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:54.353904  9252 raft_consensus.cc:515] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:54.355754  9335 raft_consensus.cc:3055] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:14:54.356163  9335 raft_consensus.cc:740] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:54.357043  9335 consensus_queue.cc:260] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:54.357896  9419 raft_consensus.cc:2804] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:54.358237  9335 raft_consensus.cc:3060] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:54.343891  9351 raft_consensus.cc:3060] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:54.351650  9254 consensus_queue.cc:237] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:54.362846  5193 raft_consensus.cc:1275] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:14:54.366940  5238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:54.369946  5163 leader_election.cc:400] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 election: Vote denied by peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709) with higher term. Message: Invalid argument: T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 8. Current term is 9.
I20260709 12:14:54.370375  5163 leader_election.cc:403] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:14:54.385046  5191 raft_consensus.cc:2468] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 9.
I20260709 12:14:54.387503  5193 raft_consensus.cc:1240] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:54.338828  9347 raft_consensus.cc:3060] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:54.343014  9401 raft_consensus.cc:2749] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:14:54.443900  5191 raft_consensus.cc:1275] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:14:54.391129  9363 raft_consensus.cc:2749] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709) with higher term. Message: Invalid argument: T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 8. Current term is 9.
I20260709 12:14:54.366708  9419 raft_consensus.cc:493] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:54.356241  9198 raft_consensus.cc:515] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:54.442801  9394 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:54.462822  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 203589us
I20260709 12:14:54.456365  9248 raft_consensus.cc:3060] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:54.448330  9135 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:54.472028  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:54.485692  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:54.486311  5120 raft_consensus.cc:3060] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:14:54.474253  5121 raft_consensus.cc:1275] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:14:54.461108  9387 raft_consensus.cc:2749] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:14:54.475556  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:54.476637  5273 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.005s	sys 0.013s
W20260709 12:14:54.489648  5273 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.005s	sys 0.013s
I20260709 12:14:54.478798  9132 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:54.480765  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:54.459357  9419 raft_consensus.cc:3060] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:54.472220  9394 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:54.482411  9398 raft_consensus.cc:2749] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:54.474915  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:54.544611  5120 raft_consensus.cc:2468] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 9.
I20260709 12:14:54.549202  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:54.552556  5269 raft_consensus.cc:2468] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 9.
I20260709 12:14:54.553643  5118 raft_consensus.cc:2393] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 10: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:54.514189  9426 raft_consensus.cc:493] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:54.564093  9426 raft_consensus.cc:515] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:54.568296  9424 log.cc:927] Time spent T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:14:54.568851  9198 leader_election.cc:290] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:54.573256  9412 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:54.573949  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:54.515686  9135 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:54.584560  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:54.578127  9384 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:54.567559  9426 leader_election.cc:290] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:54.573628  9174 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:54.592334  9441 log.cc:927] Time spent T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:14:54.592667  9321 raft_consensus.cc:493] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:54.604996  9321 raft_consensus.cc:515] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:54.606917  9369 raft_consensus.cc:515] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:54.601779  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:54.591367  9381 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:54.608100  5267 raft_consensus.cc:2468] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 11.
I20260709 12:14:54.609197  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:54.610178  5267 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 10.
I20260709 12:14:54.611181  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:54.613911  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:54.612339  5163 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:54.617825  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:54.617982  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:54.618178  9387 raft_consensus.cc:2804] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:54.607481  9321 leader_election.cc:290] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:54.616391  9369 leader_election.cc:290] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:54.618721  5265 raft_consensus.cc:2410] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for term 14 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:14:54.618805  9387 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:54.633898  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:54.641274  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:54.638079  5164 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:54.654711  5164 leader_election.cc:304] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:54.641800  5267 raft_consensus.cc:3060] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:54.644027  9384 consensus_queue.cc:1048] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:54.644361  9368 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:54.646677  9401 consensus_queue.cc:1048] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:14:54.639262  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:54.646028  5088 leader_election.cc:304] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088
W20260709 12:14:54.623260  9422 log.cc:927] Time spent T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
I20260709 12:14:54.661183  5088 leader_election.cc:304] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:54.626510  9132 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:54.630637  9234 consensus_queue.cc:1048] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:14:54.618376  9135 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:54.649214  9351 raft_consensus.cc:515] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:54.637848  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:54.645908  9381 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:54.657196  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:54.658259  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:54.663250  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:54.657043  5191 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 11.
I20260709 12:14:54.666139  5164 leader_election.cc:304] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:54.673398  9442 raft_consensus.cc:2749] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:54.669590  9426 raft_consensus.cc:2804] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:54.674321  9426 raft_consensus.cc:493] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:54.674700  9426 raft_consensus.cc:3060] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:54.674533  9419 raft_consensus.cc:515] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:54.676923  9419 leader_election.cc:290] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:54.678368  5195 raft_consensus.cc:1275] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:14:54.679437  9368 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:54.669938  9195 raft_consensus.cc:2749] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:54.622370  9394 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:54.680738  9429 log.cc:927] Time spent T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
I20260709 12:14:54.679350  5164 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:54.684140  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:54.684365  8896 raft_consensus.cc:2749] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:14:54.685338  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:54.685926  5270 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 10.
I20260709 12:14:54.686749  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:54.687700  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
W20260709 12:14:54.690452  9408 log.cc:927] Time spent T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.818s	user 0.001s	sys 0.000s
I20260709 12:14:54.691105  9103 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:54.694646  9174 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:54.695446  9252 leader_election.cc:290] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:54.695766  9347 raft_consensus.cc:515] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:54.697091  9392 log.cc:927] Time spent T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.624s	user 0.001s	sys 0.001s
I20260709 12:14:54.698062  9347 leader_election.cc:290] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:54.698716  9426 raft_consensus.cc:515] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:54.699482  5122 raft_consensus.cc:1275] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:14:54.701220  9426 leader_election.cc:290] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:54.701550  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:54.702207  5274 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 9.
I20260709 12:14:54.703075  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:54.703596  5274 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 9.
I20260709 12:14:54.706216  9351 leader_election.cc:290] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:54.707036  5193 raft_consensus.cc:1240] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 12. Current term is 13. Ops: []
W20260709 12:14:54.707262  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 54250.5us
I20260709 12:14:54.707947  5238 leader_election.cc:304] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:54.698774  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:54.709697  9059 raft_consensus.cc:2749] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:14:54.710130  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:54.710675  5191 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:54.710937  5801 leader_election.cc:304] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:54.712735  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:54.713097  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:54.671876  5265 raft_consensus.cc:2468] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 8.
I20260709 12:14:54.713562  9401 raft_consensus.cc:2749] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:14:54.714484  9214 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:54.714833  5240 leader_election.cc:304] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:54.715214  5195 raft_consensus.cc:2368] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 12. Current term is 13.
I20260709 12:14:54.655678  9387 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:54.726123  5273 raft_consensus.cc:1275] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:14:54.730742  9103 consensus_queue.cc:1048] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:54.732111  5273 raft_consensus.cc:1275] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:14:54.713658  5199 raft_consensus.cc:3060] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:54.734431  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:54.716406  5270 raft_consensus.cc:2368] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 8. Current term is 9.
I20260709 12:14:54.709177  5238 leader_election.cc:304] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:54.740469  5238 leader_election.cc:304] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:54.717840  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:54.715219  5124 raft_consensus.cc:2410] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:14:54.714998  9214 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:54.746872  5238 leader_election.cc:304] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:54.726045  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:54.707854  9299 consensus_queue.cc:1059] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 12:14:54.671353  9321 raft_consensus.cc:2749] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:54.660468  9386 raft_consensus.cc:2749] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:54.741792  5273 raft_consensus.cc:1275] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:14:54.750067  5267 raft_consensus.cc:2468] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 8.
I20260709 12:14:54.750859  5191 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 10.
I20260709 12:14:54.739562  9381 raft_consensus.cc:2804] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:54.755535  5801 leader_election.cc:304] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:54.755555  5273 raft_consensus.cc:1275] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:14:54.758329  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:54.759382  5125 raft_consensus.cc:2393] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 12: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:14:54.760857  5274 raft_consensus.cc:1275] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:14:54.742564  9351 raft_consensus.cc:493] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:54.762130  5199 raft_consensus.cc:2468] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 11.
I20260709 12:14:54.746750  9059 raft_consensus.cc:2749] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:54.764246  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:54.751950  9435 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:54.768520  5238 leader_election.cc:304] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:54.762872  9320 raft_consensus.cc:2749] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:54.755998  9248 raft_consensus.cc:2749] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:54.743211  9419 consensus_queue.cc:1048] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:14:54.769366  9381 raft_consensus.cc:697] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 9 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:54.777361  9381 consensus_queue.cc:237] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:54.780697  5832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46094 (request call id 1069) took 1382 ms. Trace:
I20260709 12:14:54.781140  5832 rpcz_store.cc:276] 0709 12:14:53.398402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:53.398517 (+   115us) service_pool.cc:224] Handling call
0709 12:14:53.398907 (+   390us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:53.403211 (+  4304us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:53.403240 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:53.418294 (+ 15054us) log.cc:844] Serialized 52 byte log entry
0709 12:14:53.716124 (+297830us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:53.731749 (+ 15625us) log.cc:844] Serialized 14 byte log entry
0709 12:14:53.731950 (+   201us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:53.732019 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:54.774165 (+1042146us) spinlock_profiling.cc:243] Waited 2.32 ms on lock 0x7b24002eccb8. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e395c9c4 00007f84e395aacb 00007f84e3b15dc9 00007f84e3b15a55 00007f84e3b14fb0 00007f84e678b488 00007f84e678bbe8 00007f84e6763398 00007f84e675e76a 00007f84e675dbb6
0709 12:14:54.780332 (+  6167us) raft_consensus.cc:1685] finished
0709 12:14:54.780441 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:54.780609 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2865,"prepare.queue_time_us":15806,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":4615,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":11853,"spinlock_wait_cycles":5339008,"thread_start_us":248608,"threads_started":1,"wal-append.queue_time_us":459674}
I20260709 12:14:54.788894  5199 raft_consensus.cc:1240] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:54.761096  9426 consensus_queue.cc:1048] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 12:14:54.790591  5191 raft_consensus.cc:1240] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:54.792275  9214 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:54.792845  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:54.758104  9095 consensus_queue.cc:1048] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:14:54.793622  5198 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 11.
I20260709 12:14:54.794211  5272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34672 (request call id 2189) took 1046 ms. Trace:
I20260709 12:14:54.794982  5274 raft_consensus.cc:1275] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:14:54.797513  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:54.798377  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:54.799295  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:54.799717  5123 raft_consensus.cc:3060] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:54.794601  5272 rpcz_store.cc:276] 0709 12:14:53.748060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:53.749824 (+  1764us) service_pool.cc:224] Handling call
0709 12:14:54.794045 (+1044221us) spinlock_profiling.cc:243] Waited 90.1 ms on lock 0x7b5400256cd4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:54.794153 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":207208192}
I20260709 12:14:54.801100  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:54.804756  5197 raft_consensus.cc:1240] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:54.805063  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:54.808043  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:54.808645  5272 raft_consensus.cc:3060] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:54.809046  5238 leader_election.cc:304] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:54.809322  5089 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:54.812647  5163 leader_election.cc:304] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:54.817904  5272 raft_consensus.cc:2468] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 11.
I20260709 12:14:54.819069  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:54.763823  9119 raft_consensus.cc:2804] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:14:54.819715  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:54.820261  9119 raft_consensus.cc:697] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 8 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:54.821023  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:54.819687  5272 raft_consensus.cc:3060] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:54.822383  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:54.822973  5834 raft_consensus.cc:3060] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:54.820503  5836 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 11.
I20260709 12:14:54.829975  5272 raft_consensus.cc:2468] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 12.
I20260709 12:14:54.832170  5163 leader_election.cc:304] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:54.825196  5801 leader_election.cc:304] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:54.840580  5123 raft_consensus.cc:2468] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 9.
I20260709 12:14:54.841964  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:54.846102  5272 raft_consensus.cc:2393] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 10: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:54.851567  5163 leader_election.cc:304] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:54.806306  9282 consensus_queue.cc:1059] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:14:54.768373  9351 raft_consensus.cc:515] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:54.854238  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:54.822643  9211 raft_consensus.cc:2749] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:54.822398  9320 raft_consensus.cc:2749] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:54.844709  9254 raft_consensus.cc:2804] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:54.860316  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:54.868201  5265 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:54.831221  9059 raft_consensus.cc:2804] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:14:54.847606  9269 raft_consensus.cc:2804] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:54.865195  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:54.832036  9386 raft_consensus.cc:2749] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:14:54.800824  9435 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:54.824702  9419 consensus_queue.cc:1059] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:14:54.878317  5272 raft_consensus.cc:3060] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:54.875165  5804 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:54.878608  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:54.874735  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 52598.1us
I20260709 12:14:54.852519  9214 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:54.859855  9347 raft_consensus.cc:493] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:54.859966  9384 consensus_queue.cc:1048] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:14:54.896836  9214 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:54.897006  9347 raft_consensus.cc:515] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:54.899315  9214 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:54.899487  9347 leader_election.cc:290] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:54.862107  9442 raft_consensus.cc:2804] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:54.900310  9442 raft_consensus.cc:493] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:54.900743  9442 raft_consensus.cc:3060] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:54.882395  5240 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:54.906523  5240 leader_election.cc:304] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:54.848208  9174 consensus_queue.cc:1048] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:14:54.883078  5834 raft_consensus.cc:2468] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 11.
I20260709 12:14:54.892210  5117 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 11.
I20260709 12:14:54.909623  5265 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 11.
I20260709 12:14:54.896232  5196 raft_consensus.cc:2468] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 8.
I20260709 12:14:54.873826  9254 raft_consensus.cc:493] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:54.874008  9059 raft_consensus.cc:493] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:54.918499  5272 raft_consensus.cc:2468] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 13.
I20260709 12:14:54.895327  9269 raft_consensus.cc:697] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 11 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:54.925290  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:54.926247  5272 raft_consensus.cc:2410] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:14:54.926883  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
W20260709 12:14:54.883332  9445 log.cc:927] Time spent T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
I20260709 12:14:54.910895  5163 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:54.931891  5163 leader_election.cc:304] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:54.932067  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:54.932845  5196 raft_consensus.cc:2468] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 11.
I20260709 12:14:54.937037  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:54.937958  5272 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:54.925782  9269 consensus_queue.cc:237] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:54.942538  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 67451.8us
I20260709 12:14:54.944968  5238 leader_election.cc:304] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
W20260709 12:14:54.946424  9454 log.cc:927] Time spent T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:14:54.947739  9282 raft_consensus.cc:2749] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:54.948382  5266 raft_consensus.cc:1240] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:14:54.949684  5266 raft_consensus.cc:1240] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:54.928877  9254 raft_consensus.cc:3060] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:14:54.930202  9450 log.cc:927] Time spent T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 12:14:54.920619  9320 raft_consensus.cc:2749] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:54.967458  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:54.969560  5265 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 11.
I20260709 12:14:54.928719  9059 raft_consensus.cc:3060] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:14:54.966141  9456 log.cc:927] Time spent T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.097s	user 0.001s	sys 0.004s
I20260709 12:14:54.930600  9347 raft_consensus.cc:2804] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:54.978483  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:54.982151  9135 raft_consensus.cc:493] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:54.982792  9135 raft_consensus.cc:515] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:54.936199  9386 raft_consensus.cc:2804] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:54.986289  5089 leader_election.cc:304] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:54.990386  5834 raft_consensus.cc:1240] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:54.991302  5272 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 10.
W20260709 12:14:54.991801  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 84364.5us
I20260709 12:14:54.992727  5266 raft_consensus.cc:1240] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:54.942270  8896 raft_consensus.cc:2804] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:14:54.995328  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:54.997910  9347 raft_consensus.cc:697] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 9 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:55.004252  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:55.004765  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:55.004875  5117 raft_consensus.cc:3060] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:55.005450  5124 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:14:55.002390  5240 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:54.879845  9119 consensus_queue.cc:237] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:54.995072  9354 raft_consensus.cc:2804] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:55.015853  9460 raft_consensus.cc:2749] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:55.010504  9386 raft_consensus.cc:697] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:55.030275  9386 consensus_queue.cc:237] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:55.030961  9351 leader_election.cc:290] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:55.004088  9366 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:55.033252  5237 leader_election.cc:304] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:55.041563  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:55.055393  5265 raft_consensus.cc:1275] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:14:55.058857  5237 leader_election.cc:304] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:55.059489  5117 raft_consensus.cc:2468] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 13.
I20260709 12:14:55.082468  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:55.082744  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:14:55.084296  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 81992.1us
I20260709 12:14:55.085134  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:55.086319  5830 raft_consensus.cc:1240] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 11 LEADER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:55.085183  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:55.081197  5237 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:55.087889  5164 leader_election.cc:304] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:55.088991  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:55.017966  8896 raft_consensus.cc:697] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:55.090128  5164 leader_election.cc:304] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:55.060863  9349 raft_consensus.cc:2804] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:54.998854  9347 consensus_queue.cc:237] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:55.095600  5124 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 11.
I20260709 12:14:55.096882  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:55.105286  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:55.106182  5836 raft_consensus.cc:2468] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 12.
I20260709 12:14:55.097738  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:55.107241  5089 leader_election.cc:304] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:55.099306  9135 leader_election.cc:290] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:55.086299  9248 raft_consensus.cc:2749] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:14:55.088804  9351 raft_consensus.cc:2749] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:14:55.115149  9403 raft_consensus.cc:493] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:55.122543  9403 raft_consensus.cc:515] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:55.123027  9323 leader_election.cc:290] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:55.124320  9323 raft_consensus.cc:2804] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:55.124749  9323 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:55.093640  9195 raft_consensus.cc:2749] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:55.100525  9349 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:55.125649  9468 raft_consensus.cc:2804] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:55.126142  9468 raft_consensus.cc:493] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:55.126560  9468 raft_consensus.cc:3060] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:55.010861  9387 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:55.097436  9198 raft_consensus.cc:2749] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:55.060647  9462 consensus_queue.cc:1059] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 12:14:55.133152  5164 leader_election.cc:304] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:55.134770  9354 raft_consensus.cc:697] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 11 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:55.126032  9349 raft_consensus.cc:3060] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:55.143878  9463 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:55.140280  5194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41416 (request call id 768) took 1334 ms. Trace:
I20260709 12:14:55.065138  9366 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:55.125073  9323 raft_consensus.cc:3060] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:55.158732  5836 raft_consensus.cc:1240] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 8 LEADER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 7. Current term is 8. Ops: []
I20260709 12:14:55.159228  8896 consensus_queue.cc:237] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:55.159569  9354 consensus_queue.cc:237] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:55.162635  5191 raft_consensus.cc:1240] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:55.157207  5194 rpcz_store.cc:276] 0709 12:14:53.805789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:53.805915 (+   126us) service_pool.cc:224] Handling call
0709 12:14:53.806221 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:54.103824 (+297603us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:55.139982 (+1036158us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b54000bde54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:55.140200 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":643398912}
I20260709 12:14:55.123657  9442 raft_consensus.cc:515] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:55.154034  9362 raft_consensus.cc:2749] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:55.127702  9135 consensus_queue.cc:1059] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 12:14:55.150311  9234 consensus_queue.cc:1048] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:14:55.186587  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:55.189222  5088 leader_election.cc:304] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:55.160840  9059 raft_consensus.cc:515] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:55.213842  9469 raft_consensus.cc:2804] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:14:55.214057  5269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50932 (request call id 817) took 1162 ms. Trace:
I20260709 12:14:55.214461  9469 raft_consensus.cc:697] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:55.189709  9460 consensus_queue.cc:1048] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 12:14:55.191967  9135 consensus_queue.cc:1243] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer bce73265e27d4b30a4dcc1e491305088 log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:14:55.214432  5269 rpcz_store.cc:276] 0709 12:14:54.051870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:54.074944 (+ 23074us) service_pool.cc:224] Handling call
0709 12:14:55.213888 (+1138944us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b54000d3254. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:55.213999 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":456641408}
I20260709 12:14:55.180150  9435 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:55.222721  5273 raft_consensus.cc:2368] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 12. Current term is 13.
I20260709 12:14:55.249583  9475 raft_consensus.cc:493] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:55.251739  9475 raft_consensus.cc:515] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:55.166540  9463 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:55.245787  9119 raft_consensus.cc:493] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:55.215497  9469 consensus_queue.cc:237] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:55.276593  9473 log.cc:927] Time spent T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
W20260709 12:14:55.277158  9430 log.cc:927] Time spent T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.823s	user 0.003s	sys 0.000s
I20260709 12:14:55.277859  9366 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:55.280053  9463 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:55.281014  9364 leader_election.cc:290] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:55.281198  9387 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:55.286629  9294 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:55.287243  9294 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:55.290009  9477 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:55.290674  9477 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:55.292965  9477 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:55.293478  9059 leader_election.cc:290] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:55.294345  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:55.295055  5836 raft_consensus.cc:2468] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 11.
I20260709 12:14:55.295943  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:55.296533  5829 raft_consensus.cc:3060] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:55.298024  5835 raft_consensus.cc:1240] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:55.257550  9254 raft_consensus.cc:515] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:55.305459  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:55.306872  5829 raft_consensus.cc:2468] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 13.
I20260709 12:14:55.308836  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:55.312561  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:55.320326  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:55.321059  5835 raft_consensus.cc:2468] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 8.
I20260709 12:14:55.330693  9254 leader_election.cc:290] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:55.332787  9436 consensus_queue.cc:1059] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:14:55.333981  9436 raft_consensus.cc:3055] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:55.334323  9436 raft_consensus.cc:740] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:55.338609  9419 consensus_queue.cc:1059] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:14:55.339464  9463 consensus_queue.cc:1059] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:14:55.340767  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:55.341085  5191 raft_consensus.cc:1240] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:14:55.338522  5089 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:55.343783  9463 consensus_queue.cc:1243] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer bce73265e27d4b30a4dcc1e491305088 log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:14:55.343504  9436 consensus_queue.cc:260] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:55.343643  9269 raft_consensus.cc:3055] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:55.344758  9269 raft_consensus.cc:740] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:55.344889  9436 raft_consensus.cc:3060] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:55.345584  9394 raft_consensus.cc:2804] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:55.346037  9394 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:55.345747  9269 consensus_queue.cc:260] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:55.346450  9394 raft_consensus.cc:3060] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:55.348299  9475 leader_election.cc:290] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:55.271104  9119 raft_consensus.cc:515] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:55.349050  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:55.344967  5274 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "56627990da7d49f7a12669f23294a596"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
mode: GRACEFUL
new_leader_uuid: "bce73265e27d4b30a4dcc1e491305088"
 from {username='slave'} at 127.0.0.1:43644
I20260709 12:14:55.352902  5116 raft_consensus.cc:2468] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 8.
I20260709 12:14:55.353292  5274 raft_consensus.cc:606] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Received request to transfer leadership to TS bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:55.353819  5274 raft_consensus.cc:614] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:55.352385  5121 raft_consensus.cc:1275] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:14:55.353926  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:55.356899  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:55.342644  5238 leader_election.cc:304] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:55.356986  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:55.362787  5199 raft_consensus.cc:1240] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:55.344362  9234 raft_consensus.cc:3055] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:14:55.363807  9234 raft_consensus.cc:740] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:55.364780  9234 consensus_queue.cc:260] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:55.365882  9234 raft_consensus.cc:3060] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:14:55.366420  9442 leader_election.cc:290] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:55.360404  5122 raft_consensus.cc:2468] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 8.
I20260709 12:14:55.371762  9479 consensus_queue.cc:1059] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:14:55.340121  9419 consensus_queue.cc:1059] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:14:55.374053  9419 raft_consensus.cc:3055] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:14:55.374446  9419 raft_consensus.cc:740] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:55.370818  5238 leader_election.cc:304] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:55.390718  5271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34672 (request call id 2187) took 1644 ms. Trace:
I20260709 12:14:55.389788  5166 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:55.391170  5271 rpcz_store.cc:276] 0709 12:14:53.746071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:53.746188 (+   117us) service_pool.cc:224] Handling call
0709 12:14:55.390490 (+1644302us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b5400172d54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:55.390652 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":491063552}
I20260709 12:14:55.341005  9294 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:55.398196  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:55.404237  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:55.408356  5197 raft_consensus.cc:1275] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:14:55.374269  9412 raft_consensus.cc:3055] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:14:55.412967  5271 raft_consensus.cc:1275] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:14:55.416831  9198 consensus_queue.cc:1048] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:14:55.375391  9419 consensus_queue.cc:260] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:55.399318  9269 raft_consensus.cc:3060] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:55.420177  9419 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:55.422250  9323 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:55.423158  9349 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:55.426411  9403 leader_election.cc:290] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:55.405018  9299 raft_consensus.cc:2804] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:55.393962  9286 raft_consensus.cc:2804] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:14:55.425119  9323 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:55.390712  9366 raft_consensus.cc:493] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:55.433144  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:55.463152  5804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:55.437045  9394 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:55.484733  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:55.485440  5125 raft_consensus.cc:3060] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:14:55.490197  9349 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:55.414973  9412 raft_consensus.cc:740] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:55.492138  9412 consensus_queue.cc:260] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:55.492935  9394 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:55.493486  9412 raft_consensus.cc:3060] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:55.494632  5121 raft_consensus.cc:2468] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 11.
I20260709 12:14:55.498955  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:55.503024  5830 raft_consensus.cc:3060] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:14:55.505577  5804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:55.506032  9335 raft_consensus.cc:3055] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:55.506507  9335 raft_consensus.cc:740] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:55.506963  9119 leader_election.cc:290] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:55.508855  5270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34674 (request call id 2322) took 1130 ms. Trace:
I20260709 12:14:55.495540  9468 raft_consensus.cc:515] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:55.427284  9299 raft_consensus.cc:493] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:55.507422  9335 consensus_queue.cc:260] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:55.510733  9254 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:55.510401  9366 raft_consensus.cc:515] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:55.509411  5270 rpcz_store.cc:276] 0709 12:14:54.378135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:54.687479 (+309344us) service_pool.cc:224] Handling call
0709 12:14:55.498362 (+810883us) spinlock_profiling.cc:243] Waited 28 ms on lock 0x7b540040b354. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:55.508768 (+ 10406us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64468224}
W20260709 12:14:55.514731  9448 log.cc:927] Time spent T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.927s	user 0.000s	sys 0.003s
I20260709 12:14:55.523960  5193 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d"
dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
mode: GRACEFUL
new_leader_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:53902
I20260709 12:14:55.533717  5193 raft_consensus.cc:606] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Received request to transfer leadership to TS 9e794b72ed7640219f90ec4232363929
I20260709 12:14:55.534134  5193 raft_consensus.cc:614] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:55.517980  9299 raft_consensus.cc:3060] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:55.547840  5120 raft_consensus.cc:3060] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:14:55.562719  5830 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 12.
W20260709 12:14:55.564440  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 483288us
I20260709 12:14:55.565411  5237 leader_election.cc:400] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 election: Vote denied by peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455) with higher term. Message: Invalid argument: T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 12. Current term is 13.
I20260709 12:14:55.565734  5237 leader_election.cc:403] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:14:55.568742  5120 raft_consensus.cc:2468] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 13.
I20260709 12:14:55.530879  9442 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:55.529778  5125 raft_consensus.cc:2468] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 11.
W20260709 12:14:55.576979  5804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:55.518256  9286 raft_consensus.cc:697] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 13 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:55.578076  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:55.563365  9335 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:55.584367  5237 leader_election.cc:304] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:55.577147  9475 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:55.597034  9475 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:55.584975  9479 raft_consensus.cc:2749] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455) with higher term. Message: Invalid argument: T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 12. Current term is 13.
I20260709 12:14:55.600975  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:55.601475  9378 raft_consensus.cc:3055] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:55.602388  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:55.602841  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:55.603046  5271 raft_consensus.cc:3060] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:55.605700  9475 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:55.606878  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:55.607537  5274 raft_consensus.cc:3060] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:55.607993  5270 raft_consensus.cc:1275] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:14:55.533234  9254 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:55.610344  5163 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:55.611265  5269 raft_consensus.cc:2468] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 11.
I20260709 12:14:55.589316  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:55.617861  5125 raft_consensus.cc:3060] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:55.617110  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:55.620018  5237 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:55.625828  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:55.629004  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:55.629762  5830 raft_consensus.cc:2468] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 10.
I20260709 12:14:55.632212  5271 raft_consensus.cc:2468] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 9.
I20260709 12:14:55.635598  5125 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 12.
I20260709 12:14:55.627949  9254 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:55.638489  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:55.643020  9286 consensus_queue.cc:237] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:55.646301  5838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46088 (request call id 748) took 1198 ms. Trace:
I20260709 12:14:55.646910  5838 rpcz_store.cc:276] 0709 12:14:54.447771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:54.448489 (+   718us) service_pool.cc:224] Handling call
0709 12:14:54.448951 (+   462us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:14:54.457045 (+  8094us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:54.457108 (+    63us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:14:54.470265 (+ 13157us) log.cc:844] Serialized 78 byte log entry
0709 12:14:54.561810 (+ 91545us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:54.583472 (+ 21662us) log.cc:844] Serialized 14 byte log entry
0709 12:14:54.583669 (+   197us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:54.583720 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:55.143139 (+559419us) spinlock_profiling.cc:243] Waited 1.93 ms on lock 0x7b18001fb2e0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3ad63f3 00007f84e3ad87c1 00007f84e3ad8779 00007f84e3ad8709 00007f84e3ad86d1 00007f84e3ad79cd 0000000000388634 0000000000388479 00007f84e3ab983a
0709 12:14:55.513946 (+370807us) spinlock_profiling.cc:243] Waited 3.96 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e675e86e 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221 00007f84e67671d9 00007f84e6767169
0709 12:14:55.646060 (+132114us) raft_consensus.cc:1685] finished
0709 12:14:55.646082 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:55.646235 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20428,"prepare.queue_time_us":22402,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":33,"raft.queue_time_us":7685,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":3477,"spinlock_wait_cycles":13545600,"thread_start_us":41088,"threads_started":1,"wal-append.queue_time_us":71371}
I20260709 12:14:55.601881  9378 raft_consensus.cc:740] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:55.659618  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:55.655812  9378 consensus_queue.cc:260] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:55.678742  9378 raft_consensus.cc:3060] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:55.579885  9442 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:55.688232  5164 leader_election.cc:304] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:55.651051  9198 raft_consensus.cc:2749] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:14:55.651238  9369 raft_consensus.cc:2749] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:55.699990  5831 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 11.
W20260709 12:14:55.701980  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 83772us
I20260709 12:14:55.703802  5163 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:55.703934  5164 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:55.676172  9349 raft_consensus.cc:493] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
W20260709 12:14:55.708841  5804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:55.670177  5835 raft_consensus.cc:2468] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 11.
I20260709 12:14:55.707068  5274 raft_consensus.cc:2468] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 10.
W20260709 12:14:55.717101  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 97148.7us
I20260709 12:14:55.726449  5237 leader_election.cc:304] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:55.733419  9475 raft_consensus.cc:2749] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:55.735587  9442 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:55.737267  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:55.730684  9349 raft_consensus.cc:515] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:55.747750  9349 leader_election.cc:290] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:55.752204  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:55.752948  5831 raft_consensus.cc:2468] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 10.
I20260709 12:14:55.754423  5274 raft_consensus.cc:1240] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:55.759057  5274 raft_consensus.cc:1240] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 11. Current term is 12. Ops: []
I20260709 12:14:55.706549  9363 raft_consensus.cc:2749] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:55.767655  9468 leader_election.cc:290] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:55.726147  9369 raft_consensus.cc:2804] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:55.728819  9384 raft_consensus.cc:2804] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:55.784533  9384 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:55.785032  9384 raft_consensus.cc:3060] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:55.765175  9463 raft_consensus.cc:493] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:55.789430  9463 raft_consensus.cc:515] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:55.790266  9369 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:55.790813  9369 raft_consensus.cc:3060] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:55.797775  5089 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:55.798484  9463 leader_election.cc:290] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:55.799966  9234 raft_consensus.cc:2804] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:55.800540  9234 raft_consensus.cc:697] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:55.800887  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:55.801491  9234 consensus_queue.cc:237] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:55.801956  5123 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
new_leader_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:45628
I20260709 12:14:55.802534  5123 raft_consensus.cc:606] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Received request to transfer leadership to TS 9e794b72ed7640219f90ec4232363929
I20260709 12:14:55.802908  5123 raft_consensus.cc:614] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:55.803143  5238 leader_election.cc:304] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:55.763808  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:55.775867  5803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:55.770491  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:55.807830  5830 raft_consensus.cc:2368] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 12. Current term is 13.
I20260709 12:14:55.809939  5125 raft_consensus.cc:2468] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 10.
I20260709 12:14:55.811371  5118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40386 (request call id 2124) took 1565 ms. Trace:
I20260709 12:14:55.811846  5118 rpcz_store.cc:276] 0709 12:14:54.245582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:54.246849 (+  1267us) service_pool.cc:224] Handling call
0709 12:14:55.811112 (+1564263us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b54003e08d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:55.811269 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":641106176}
I20260709 12:14:55.813670  5117 raft_consensus.cc:1240] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:55.818279  5117 raft_consensus.cc:1275] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 12:14:55.818893  5117 pending_rounds.cc:85] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting all ops after (but not including) 8
I20260709 12:14:55.819205  5117 pending_rounds.cc:107] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 12:14:55.819489  5117 raft_consensus.cc:2889] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:55.823815  5835 raft_consensus.cc:1275] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:14:55.825989  5089 leader_election.cc:400] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 election: Vote denied by peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539) with higher term. Message: Invalid argument: T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 12. Current term is 13.
I20260709 12:14:55.826445  5089 leader_election.cc:403] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:14:55.827431  9384 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:55.830780  9323 raft_consensus.cc:2804] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:55.831257  9323 raft_consensus.cc:493] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:55.831629  9323 raft_consensus.cc:3060] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:55.832623  5268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34674 (request call id 2320) took 1455 ms. Trace:
I20260709 12:14:55.833031  5268 rpcz_store.cc:276] 0709 12:14:54.377631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:54.945239 (+567608us) service_pool.cc:224] Handling call
0709 12:14:54.945584 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:54.984346 (+ 38762us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:54.984380 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:54.999233 (+ 14853us) log.cc:844] Serialized 26 byte log entry
0709 12:14:55.082311 (+ 83078us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:55.815338 (+733027us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b18004c9000. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e676b4bc 00007f84e3ab948b 00007f84ec9139a9 00007f84e3ad569b 00007f84e3ad393f 00007f84e3ad3455 00007f84ea5bb3c7 00007f84e6bcd9a7 00007f84e6bdd0bf
0709 12:14:55.815497 (+   159us) log.cc:844] Serialized 14 byte log entry
0709 12:14:55.832238 (+ 16741us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:55.832309 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:55.832346 (+    37us) raft_consensus.cc:1685] finished
0709 12:14:55.832429 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:55.832553 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":84768,"prepare.queue_time_us":47144,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":39037,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":10433,"spinlock_wait_cycles":29983488,"thread_start_us":73651,"threads_started":2,"wal-append.queue_time_us":102588}
I20260709 12:14:55.835512  9274 raft_consensus.cc:2749] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539) with higher term. Message: Invalid argument: T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 12. Current term is 13.
I20260709 12:14:55.837158  9351 consensus_queue.cc:1048] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:14:55.856364  5240 leader_election.cc:304] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:55.860035  5804 leader_election.cc:304] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:55.864107  9484 raft_consensus.cc:2804] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:14:55.864575  9484 raft_consensus.cc:493] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:55.864938  9484 raft_consensus.cc:3060] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:55.865368  5240 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:55.867170  5240 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:55.868409  5274 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
mode: GRACEFUL
new_leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
 from {username='slave'} at 127.0.0.1:43644
I20260709 12:14:55.870822  9214 raft_consensus.cc:2749] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:55.871620  9214 raft_consensus.cc:2804] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:55.872184  9214 raft_consensus.cc:697] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 11 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:55.873018  9214 consensus_queue.cc:237] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:55.875317  9484 raft_consensus.cc:515] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:55.877452  5804 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:55.878435  5240 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:55.895223  5240 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:55.900655  5125 raft_consensus.cc:1275] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:14:55.897035  9269 raft_consensus.cc:2804] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:55.902906  9269 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:55.903328  9269 raft_consensus.cc:3060] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:14:55.904458  5804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:55.905968  9119 consensus_queue.cc:1048] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:14:55.896979  9396 consensus_queue.cc:1048] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 12:14:55.900900  9349 raft_consensus.cc:2749] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:55.908504  9484 leader_election.cc:290] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:55.909397  9299 raft_consensus.cc:515] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:55.900750  9475 raft_consensus.cc:2804] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:14:55.914784  9475 raft_consensus.cc:697] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 12 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:55.915295  9299 leader_election.cc:290] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:55.841264  9323 raft_consensus.cc:515] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:55.915807  9475 consensus_queue.cc:237] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:55.939781  9323 leader_election.cc:290] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:55.945716  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:55.946391  5121 raft_consensus.cc:3060] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:55.952427  9366 leader_election.cc:290] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:55.965952  9369 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:55.968376  9369 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:14:55.970605  5803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:55.973639  9384 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:55.976330  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:55.975741  9322 raft_consensus.cc:493] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:56.006587  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
W20260709 12:14:55.977463  8896 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.781s	user 0.003s	sys 0.029s
W20260709 12:14:56.019526  9347 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.010s	sys 0.017s
I20260709 12:14:56.017742  9322 raft_consensus.cc:515] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:56.023978  8896 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.003s	sys 0.030s
W20260709 12:14:56.070093  5192 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.730s	user 0.003s	sys 0.018s
W20260709 12:14:56.080302  5192 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.003s	sys 0.018s
W20260709 12:14:56.074833  5272 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.010s	sys 0.012s
W20260709 12:14:56.081061  5272 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.752s	user 0.010s	sys 0.012s
W20260709 12:14:56.076325  5801 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.003s	sys 0.015s
W20260709 12:14:56.082108  5801 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.003s	sys 0.015s
W20260709 12:14:56.082484  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 671466us
W20260709 12:14:56.071964  5194 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.733s	user 0.006s	sys 0.014s
W20260709 12:14:56.083583  5194 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.006s	sys 0.014s
W20260709 12:14:56.021952  9469 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.728s	user 0.010s	sys 0.018s
W20260709 12:14:56.066273  9347 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.011s	sys 0.017s
I20260709 12:14:56.023476  9269 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:56.123713  9369 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:56.124423  9369 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:56.127707  9369 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:56.184532  5265 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.005s	sys 0.006s
W20260709 12:14:56.185137  5265 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.006s	sys 0.007s
I20260709 12:14:56.190536  5121 raft_consensus.cc:2468] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 9.
I20260709 12:14:56.192471  5240 leader_election.cc:304] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:56.204159  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:56.205117  5271 raft_consensus.cc:2393] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 9: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:56.204955  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:14:56.073529  9470 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.011s	sys 0.056s
W20260709 12:14:56.085099  9469 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.792s	user 0.011s	sys 0.019s
I20260709 12:14:56.231333  5273 raft_consensus.cc:1275] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:14:56.213658  5271 raft_consensus.cc:1275] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:14:56.175432  9442 raft_consensus.cc:2804] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:14:56.213868  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 199306us
W20260709 12:14:56.240804  5163 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.004s	sys 0.011s
W20260709 12:14:56.243966  5163 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.004s	sys 0.011s
I20260709 12:14:56.247767  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
W20260709 12:14:56.244326  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 514142us
I20260709 12:14:56.210398  9323 raft_consensus.cc:2804] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:14:56.251279  5804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:56.251437  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:56.258569  5829 raft_consensus.cc:2393] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 9: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
W20260709 12:14:56.251782  5165 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.019s	sys 0.020s
I20260709 12:14:56.252194  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
W20260709 12:14:56.258512  5804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:56.261656  5165 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.019s	sys 0.020s
I20260709 12:14:56.264139  5163 leader_election.cc:304] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:56.253587  5271 raft_consensus.cc:1275] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:14:56.266463  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:14:56.232313  9470 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.883s	user 0.016s	sys 0.060s
I20260709 12:14:56.268582  9384 consensus_queue.cc:1048] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:56.268584  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:56.270306  5833 raft_consensus.cc:2468] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 13.
I20260709 12:14:56.274336  9322 leader_election.cc:290] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:56.275214  5238 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
W20260709 12:14:56.277990  9489 log.cc:927] Time spent T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
I20260709 12:14:56.279271  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
W20260709 12:14:56.279928  9487 log.cc:927] Time spent T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.227s	user 0.000s	sys 0.001s
W20260709 12:14:56.280866  5804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:56.283785  9387 raft_consensus.cc:2804] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:14:56.284396  9387 raft_consensus.cc:697] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:56.285300  9387 consensus_queue.cc:237] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:56.287055  5163 leader_election.cc:304] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:56.287850  9198 raft_consensus.cc:2804] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:56.288379  9198 raft_consensus.cc:697] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:56.289273  9198 consensus_queue.cc:237] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:56.291399  9442 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:56.291873  9442 raft_consensus.cc:3060] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:56.236519  9412 raft_consensus.cc:493] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:56.299710  5270 raft_consensus.cc:1275] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:14:56.300770  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:56.301499  5195 raft_consensus.cc:2468] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 11.
I20260709 12:14:56.300625  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:56.302644  5271 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 8.
I20260709 12:14:56.273913  9269 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:56.305601  5197 raft_consensus.cc:1240] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 8. Current term is 9. Ops: []
I20260709 12:14:56.308867  5269 raft_consensus.cc:1275] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:14:56.309090  5166 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.036s	sys 0.036s
W20260709 12:14:56.309849  5166 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.036s	sys 0.036s
I20260709 12:14:56.309677  5193 raft_consensus.cc:1240] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:14:56.328541  9270 raft_consensus.cc:493] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:56.308199  9323 raft_consensus.cc:697] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 9 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:56.349519  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:56.351405  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 47723.2us
I20260709 12:14:56.351960  5121 raft_consensus.cc:1275] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:14:56.353464  5829 raft_consensus.cc:3055] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:14:56.353892  5829 raft_consensus.cc:740] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
W20260709 12:14:56.354130  5803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:56.354168  5801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:56.256083  9174 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.001s	sys 0.042s
I20260709 12:14:56.366544  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:56.367244  5121 raft_consensus.cc:3060] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:56.329195  9270 raft_consensus.cc:515] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:56.372748  9270 leader_election.cc:290] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:56.308945  9479 raft_consensus.cc:2804] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:14:56.373785  5088 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.175s	user 0.009s	sys 0.019s
W20260709 12:14:56.375890  5088 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.177s	user 0.010s	sys 0.020s
I20260709 12:14:56.395947  9274 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:56.307217  9384 raft_consensus.cc:493] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:56.354739  5829 consensus_queue.cc:260] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:56.403998  5829 raft_consensus.cc:3060] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:14:56.366015  9174 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.750s	user 0.005s	sys 0.042s
I20260709 12:14:56.308480  9477 raft_consensus.cc:493] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:56.310241  9412 raft_consensus.cc:515] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:56.407934  5164 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.012s	sys 0.038s
W20260709 12:14:56.411834  5164 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.012s	sys 0.038s
I20260709 12:14:56.375946  8896 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:56.414415  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 690857us
I20260709 12:14:56.375062  9351 raft_consensus.cc:493] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:56.379562  9479 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:56.400404  9267 raft_consensus.cc:493] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:56.435081  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:56.440725  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:56.441541  5835 raft_consensus.cc:3060] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:56.416507  5801 leader_election.cc:304] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:14:56.404428  9214 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.003s	sys 0.021s
I20260709 12:14:56.429121  5829 raft_consensus.cc:1275] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:14:56.409186  5121 raft_consensus.cc:2468] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 11.
I20260709 12:14:56.486105  5829 pending_rounds.cc:85] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088: Aborting all ops after (but not including) 8
I20260709 12:14:56.486375  5829 pending_rounds.cc:107] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 12:14:56.486625  5829 raft_consensus.cc:2889] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:14:56.486754  5125 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.000s	sys 0.030s
I20260709 12:14:56.413426  9384 raft_consensus.cc:515] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:56.437875  9381 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.504s	user 0.016s	sys 0.018s
W20260709 12:14:56.376504  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 1.18868e+06us
I20260709 12:14:56.421268  8896 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:56.435105  9364 raft_consensus.cc:493] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:56.423887  9477 raft_consensus.cc:515] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:56.452809  9488 log.cc:927] Time spent T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 12:14:56.439057  9363 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:56.411810  9378 consensus_queue.cc:1048] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:14:56.434137  9479 raft_consensus.cc:3060] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:14:56.449188  5119 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.008s	sys 0.016s
W20260709 12:14:56.550391  5119 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.009s	sys 0.016s
W20260709 12:14:56.470515  9492 log.cc:927] Time spent T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.173s	user 0.001s	sys 0.001s
I20260709 12:14:56.436091  9351 raft_consensus.cc:515] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:56.437692  9267 raft_consensus.cc:515] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:56.503686  5088 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:14:56.558714  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 55114.4us
I20260709 12:14:56.559518  5088 leader_election.cc:304] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:56.559692  9267 leader_election.cc:290] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:56.418229  9323 consensus_queue.cc:237] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:56.560902  9510 log.cc:927] Time spent T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 12:14:56.504312  5835 raft_consensus.cc:2468] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 11.
W20260709 12:14:56.504367  5837 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.035s	sys 0.044s
W20260709 12:14:56.563040  5837 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.035s	sys 0.044s
W20260709 12:14:56.457749  9400 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.019s	user 0.034s	sys 0.041s
W20260709 12:14:56.563788  9400 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.149s	user 0.038s	sys 0.045s
W20260709 12:14:56.504581  5125 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.000s	sys 0.031s
W20260709 12:14:56.541699  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 125265us
I20260709 12:14:56.413270  9274 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:56.566165  9494 log.cc:927] Time spent T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:14:56.566888  9274 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:56.567466  5194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 2301) took 1230 ms. Trace:
I20260709 12:14:56.567610  9274 consensus_queue.cc:1048] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:14:56.456013  9234 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.008s	sys 0.017s
W20260709 12:14:56.568763  9234 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.009s	sys 0.017s
I20260709 12:14:56.569451  9234 raft_consensus.cc:2749] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:56.570200  9234 raft_consensus.cc:2749] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:14:56.572736  5801 leader_election.cc:304] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:14:56.573271  9503 log.cc:927] Time spent T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 12:14:56.574071  5124 raft_consensus.cc:1240] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 LEADER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 11. Current term is 12. Ops: []
I20260709 12:14:56.575048  5267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34674 (request call id 2317) took 2198 ms. Trace:
I20260709 12:14:56.576622  5124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59390 (request call id 821) took 1234 ms. Trace:
W20260709 12:14:56.504244  9381 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.574s	user 0.016s	sys 0.018s
I20260709 12:14:56.486563  9483 raft_consensus.cc:493] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
W20260709 12:14:56.505491  9214 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.003s	sys 0.028s
I20260709 12:14:56.485620  9270 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:56.577823  9483 raft_consensus.cc:515] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:56.579559  9384 leader_election.cc:290] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:56.580855  9483 leader_election.cc:290] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:14:56.503799  9475 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.013s	sys 0.026s
I20260709 12:14:56.578136  9366 consensus_queue.cc:1048] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:14:56.485530  9286 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.737s	user 0.004s	sys 0.044s
I20260709 12:14:56.575465  5267 rpcz_store.cc:276] 0709 12:14:54.376824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:54.754944 (+378120us) service_pool.cc:224] Handling call
0709 12:14:54.767281 (+ 12337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:54.805285 (+ 38004us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:54.805316 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:54.805794 (+   478us) log.cc:844] Serialized 26 byte log entry
0709 12:14:55.706268 (+900474us) spinlock_profiling.cc:243] Waited 3.67 ms on lock 0x7b18003589c0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3ab8e07 00007f84ec9139a9 00007f84e3ad569b 00007f84e3ad393f 00007f84e3ad5c02 00007f84e675d20b 00007f84e6762d23 00007f84e67630d1 00007f84e6b7ea0f
0709 12:14:56.079093 (+372825us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:14:56.182852 (+103759us) log.cc:844] Serialized 14 byte log entry
0709 12:14:56.221679 (+ 38827us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:56.221840 (+   161us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:56.574736 (+352896us) raft_consensus.cc:1685] finished
0709 12:14:56.574849 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:56.574985 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57368,"prepare.queue_time_us":166087,"raft.queue_time_us":80844,"raft.run_cpu_time_us":352,"raft.run_wall_time_us":29187,"spinlock_wait_cycles":13938688,"thread_start_us":372590,"threads_started":1,"wal-append.queue_time_us":1603472}
I20260709 12:14:56.545106  9119 raft_consensus.cc:2749] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:14:56.578529  9493 log.cc:927] Time spent T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 12:14:56.577000  5124 rpcz_store.cc:276] 0709 12:14:55.341824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:55.342029 (+   205us) service_pool.cc:224] Handling call
0709 12:14:55.342328 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:56.574491 (+1232163us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:56.576352 (+  1861us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b540008dc54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:56.576529 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2832283904}
I20260709 12:14:56.567991  5838 raft_consensus.cc:2468] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 10.
I20260709 12:14:56.545887  9211 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
W20260709 12:14:56.568908  9491 log.cc:927] Time spent T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
W20260709 12:14:56.602433  9286 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.854s	user 0.004s	sys 0.045s
I20260709 12:14:56.567953  5194 rpcz_store.cc:276] 0709 12:14:55.336892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:55.337022 (+   130us) service_pool.cc:224] Handling call
0709 12:14:55.337363 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:55.337719 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:55.337747 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:55.338161 (+   414us) log.cc:844] Serialized 26 byte log entry
0709 12:14:56.084049 (+745888us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:56.084093 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:56.084176 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:56.567251 (+483075us) raft_consensus.cc:1685] finished
0709 12:14:56.567273 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:56.567403 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8180,"raft.queue_time_us":2688,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":2542,"thread_start_us":745488,"threads_started":1,"wal-append.queue_time_us":1078860}
W20260709 12:14:56.596663  9475 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.013s	sys 0.027s
I20260709 12:14:56.570116  9369 raft_consensus.cc:493] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:56.545887  9364 raft_consensus.cc:515] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:56.618448  9335 raft_consensus.cc:2749] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:14:56.631225  5120 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.023s	sys 0.011s
I20260709 12:14:56.577663  9270 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:56.554281  9363 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:56.637513  5120 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.024s	sys 0.011s
I20260709 12:14:56.594710  9282 consensus_queue.cc:1048] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:14:56.598729  9269 consensus_queue.cc:1048] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 12:14:56.682175  9412 leader_election.cc:290] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:56.731510  5193 raft_consensus.cc:1275] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:14:56.621502  9267 consensus_queue.cc:1048] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:14:56.733196  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:56.627521  9211 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:56.691529  9363 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:56.693097  9270 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:56.729626  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:56.730463  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:56.732503  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:56.738927  5195 raft_consensus.cc:3060] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:56.734293  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:56.740028  5196 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 8.
I20260709 12:14:56.733796  5191 raft_consensus.cc:3060] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:56.741122  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:56.746537  5196 raft_consensus.cc:2393] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 10: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:56.738260  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:56.747666  5193 raft_consensus.cc:2393] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 10: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:56.748674  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:56.750769  5193 raft_consensus.cc:2468] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 13.
W20260709 12:14:56.751827  5265 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.017s	sys 0.012s
W20260709 12:14:56.752184  5265 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.017s	sys 0.012s
I20260709 12:14:56.752058  5193 raft_consensus.cc:3060] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:56.753536  5272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34672 (request call id 2211) took 1730 ms. Trace:
W20260709 12:14:56.755470  5192 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.016s	sys 0.013s
W20260709 12:14:56.755862  5192 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.016s	sys 0.013s
W20260709 12:14:56.776937  5804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:56.634392  9369 raft_consensus.cc:515] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:56.810346  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:56.794651  5274 raft_consensus.cc:606] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Received request to transfer leadership to TS ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:56.753957  5272 rpcz_store.cc:276] 0709 12:14:55.023139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:55.327619 (+304480us) service_pool.cc:224] Handling call
0709 12:14:55.327987 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:55.328357 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:55.328385 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:55.328937 (+   552us) log.cc:844] Serialized 26 byte log entry
0709 12:14:56.081609 (+752672us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:56.752900 (+671291us) log.cc:844] Serialized 14 byte log entry
0709 12:14:56.753195 (+   295us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:56.753264 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:56.753301 (+    37us) raft_consensus.cc:1685] finished
0709 12:14:56.753313 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:56.753476 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":170979,"prepare.queue_time_us":648287,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":11908,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":1657,"thread_start_us":1245493,"threads_started":2,"wal-append.queue_time_us":1070840}
I20260709 12:14:56.816672  5274 raft_consensus.cc:614] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:14:56.835150  5200 raft_consensus.cc:1275] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:14:56.816202  9270 raft_consensus.cc:493] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:56.838585  9270 raft_consensus.cc:515] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:56.731621  9335 raft_consensus.cc:493] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:56.847569  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:56.849004  5191 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 12.
I20260709 12:14:56.854800  5195 raft_consensus.cc:2468] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 11.
I20260709 12:14:56.793810  9366 raft_consensus.cc:493] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:56.797712  9435 raft_consensus.cc:2749] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:14:56.812557  9119 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:56.860584  5164 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:56.829738  9411 raft_consensus.cc:2749] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:56.858120  9475 raft_consensus.cc:493] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:56.881085  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:56.860025  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:56.869570  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:56.875453  5237 leader_election.cc:304] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:56.887892  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:56.868222  9366 raft_consensus.cc:515] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:56.888587  5838 raft_consensus.cc:2468] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 13.
I20260709 12:14:56.855966  9198 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:56.868422  9270 leader_election.cc:290] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:56.893584  5166 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.017s	sys 0.046s
I20260709 12:14:56.880453  9504 raft_consensus.cc:2804] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:56.898186  5237 leader_election.cc:304] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:56.899623  5237 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:56.884349  9351 leader_election.cc:290] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:56.859486  9335 raft_consensus.cc:515] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:56.880234  9412 consensus_queue.cc:1048] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:14:56.883904  9475 raft_consensus.cc:515] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:56.882175  9119 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:56.896123  5266 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.019s	sys 0.045s
I20260709 12:14:56.994199  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:14:57.071225  5089 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.021s	sys 0.040s
I20260709 12:14:56.889621  9286 raft_consensus.cc:2749] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:14:57.141798  5088 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.000s	sys 0.022s
W20260709 12:14:56.982007  5803 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.028s	sys 0.065s
W20260709 12:14:57.149952  5266 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.821s	user 0.019s	sys 0.045s
W20260709 12:14:57.141875  5801 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.009s	sys 0.013s
I20260709 12:14:56.903298  9477 leader_election.cc:290] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:57.136171  9516 log.cc:927] Time spent T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:14:56.997773  5838 raft_consensus.cc:1275] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:14:57.160712  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:56.889845  8896 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:56.901155  5164 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
W20260709 12:14:57.164836  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 263730us
W20260709 12:14:57.141718  9400 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.009s	sys 0.012s
W20260709 12:14:57.141536  5833 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.726s	user 0.015s	sys 0.006s
W20260709 12:14:56.897037  5166 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.018s	sys 0.047s
I20260709 12:14:57.072741  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:14:57.070194  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 44538.1us
W20260709 12:14:57.152325  5088 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.001s	sys 0.023s
W20260709 12:14:57.149250  5089 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.024s	sys 0.046s
W20260709 12:14:57.155064  5803 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.041s	sys 0.102s
W20260709 12:14:57.153362  5801 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.009s	sys 0.013s
I20260709 12:14:57.101992  9211 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:56.996236  5163 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.005s	sys 0.012s
I20260709 12:14:56.898955  9381 raft_consensus.cc:2749] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:57.203837  9270 raft_consensus.cc:493] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
W20260709 12:14:56.901284  9387 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.013s	sys 0.018s
W20260709 12:14:57.204735  9387 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.917s	user 0.014s	sys 0.023s
I20260709 12:14:57.204506  9270 raft_consensus.cc:515] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:57.206552  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:57.206878  9270 leader_election.cc:290] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:57.162500  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:57.162518  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:57.208968  5274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:43644 (request call id 1) took 1340 ms. Trace:
I20260709 12:14:57.209604  5117 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 10.
I20260709 12:14:57.159277  9526 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:57.209422  5274 rpcz_store.cc:276] 0709 12:14:55.868115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:55.868270 (+   155us) service_pool.cc:224] Handling call
0709 12:14:57.208750 (+1340480us) spinlock_profiling.cc:243] Waited 926 ms on lock 0x7b54002ef4d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bbd853 00007f84ebb8b60a 00007f84e51117d4 00007f84e5111762 00007f84e5111691 00007f84e511160c 00007f84e51108c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:57.208873 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2128693504}
W20260709 12:14:57.107473  9517 log.cc:927] Time spent T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
W20260709 12:14:57.088398  9470 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.023s	sys 0.045s
I20260709 12:14:56.920154  9349 raft_consensus.cc:2749] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:14:56.940850  5199 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.022s	sys 0.029s
W20260709 12:14:57.170852  5833 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.752s	user 0.015s	sys 0.006s
W20260709 12:14:57.217298  5199 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.887s	user 0.024s	sys 0.056s
W20260709 12:14:57.184852  9400 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.009s	sys 0.013s
I20260709 12:14:57.127614  9366 leader_election.cc:290] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:57.105261  9294 raft_consensus.cc:493] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:57.076785  9483 raft_consensus.cc:493] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:57.253592  9483 raft_consensus.cc:515] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:57.255784  9483 leader_election.cc:290] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:57.198766  9523 raft_consensus.cc:493] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:57.257552  9523 raft_consensus.cc:515] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:57.259711  9523 leader_election.cc:290] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:57.261639  9294 raft_consensus.cc:515] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:57.264003  5122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59390 (request call id 834) took 1280 ms. Trace:
I20260709 12:14:57.264451  5122 rpcz_store.cc:276] 0709 12:14:55.983557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:55.983739 (+   182us) service_pool.cc:224] Handling call
0709 12:14:56.017473 (+ 33734us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:56.017833 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:14:56.023697 (+  5864us) log.cc:844] Serialized 14 byte log entry
0709 12:14:56.493685 (+469988us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:56.494210 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 12:14:56.494346 (+   136us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:56.494379 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:56.494452 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:57.263755 (+769303us) raft_consensus.cc:1685] finished
0709 12:14:57.263778 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:57.263936 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6099,"prepare.queue_time_us":5913,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":57,"raft.queue_time_us":276,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":9533,"thread_start_us":466715,"threads_started":1,"wal-append.queue_time_us":820043}
I20260709 12:14:57.171435  9534 raft_consensus.cc:2804] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:14:57.276590  9502 log.cc:927] Time spent T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.649s	user 0.001s	sys 0.005s
W20260709 12:14:57.279291  9442 consensus_meta.cc:287] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.987s	user 0.012s	sys 0.001s
I20260709 12:14:56.963165  9504 raft_consensus.cc:697] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:57.194877  5121 raft_consensus.cc:1275] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:57.158907  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:57.192961  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 633455us
I20260709 12:14:57.282907  5088 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
W20260709 12:14:57.196524  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 622475us
I20260709 12:14:57.284298  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:57.194350  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:57.287892  5088 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
W20260709 12:14:57.197247  5803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:57.193169  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 687436us
I20260709 12:14:57.290879  9538 raft_consensus.cc:493] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:57.291544  9538 raft_consensus.cc:515] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:57.292340  9532 consensus_queue.cc:1048] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:56.962153  9214 consensus_queue.cc:1048] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.207s
I20260709 12:14:56.896341  9198 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:57.294915  9538 leader_election.cc:290] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:57.272801  9534 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:57.296325  9135 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:57.296972  9135 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:57.200870  5163 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.006s	sys 0.017s
I20260709 12:14:57.301725  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:57.199564  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:57.203053  9119 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:57.290576  9351 raft_consensus.cc:493] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:57.164227  9364 leader_election.cc:290] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:57.215654  5166 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
W20260709 12:14:57.309033  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 93449.4us
I20260709 12:14:57.310292  5166 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
W20260709 12:14:57.216184  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 76246.7us
I20260709 12:14:57.221344  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:14:57.197526  8896 raft_consensus.cc:493] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:57.218957  5120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59390 (request call id 833) took 1238 ms. Trace:
I20260709 12:14:57.220283  5118 raft_consensus.cc:3055] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:14:57.192222  9286 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:57.224124  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:57.316587  5120 rpcz_store.cc:276] 0709 12:14:55.980809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:55.981121 (+   312us) service_pool.cc:224] Handling call
0709 12:14:55.981512 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:55.982074 (+   562us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:55.982104 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:55.988985 (+  6881us) log.cc:844] Serialized 26 byte log entry
0709 12:14:56.676901 (+687916us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:56.676945 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:56.677019 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:57.218700 (+541681us) raft_consensus.cc:1685] finished
0709 12:14:57.218724 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:57.218889 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72,"raft.queue_time_us":665,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":26466,"thread_start_us":687568,"threads_started":1,"wal-append.queue_time_us":914141}
I20260709 12:14:57.318322  5837 raft_consensus.cc:2393] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 11: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:57.209649  9384 raft_consensus.cc:493] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:57.219430  9479 consensus_meta.cc:287] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.634s	user 0.000s	sys 0.010s
W20260709 12:14:57.216883  9470 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.838s	user 0.032s	sys 0.054s
I20260709 12:14:57.200281  9369 leader_election.cc:290] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:57.226759  9475 leader_election.cc:290] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:57.297950  9411 raft_consensus.cc:493] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:57.202689  9511 log.cc:927] Time spent T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 12:14:57.305984  5838 raft_consensus.cc:2393] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 11: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:57.354125  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:57.296608  9535 raft_consensus.cc:2804] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:57.313369  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:57.313210  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:57.313679  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:57.283514  9349 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:57.316184  5118 raft_consensus.cc:740] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:57.318622  5088 leader_election.cc:400] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 election: Vote denied by peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709) with higher term. Message: Invalid argument: T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 8. Current term is 9.
I20260709 12:14:57.365742  5088 leader_election.cc:403] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
W20260709 12:14:57.366266  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 47805.7us
I20260709 12:14:57.299141  5835 raft_consensus.cc:1240] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 11. Current term is 12. Ops: []
I20260709 12:14:57.288584  9463 raft_consensus.cc:2764] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:14:57.370780  9507 raft_consensus.cc:493] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:57.330572  9501 log.cc:927] Time spent T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.844s	user 0.000s	sys 0.001s
I20260709 12:14:57.319954  9351 raft_consensus.cc:515] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:57.317404  9505 raft_consensus.cc:2749] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:57.373835  5265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34672 (request call id 2208) took 2475 ms. Trace:
I20260709 12:14:57.374377  9351 leader_election.cc:290] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:57.347369  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:57.347992  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:57.350145  9407 raft_consensus.cc:493] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:57.379997  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:57.350852  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:57.351531  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:57.382097  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:57.326702  9270 raft_consensus.cc:2749] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:57.361231  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:57.296320  9534 raft_consensus.cc:3060] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:14:57.364054  5193 raft_consensus.cc:3060] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:57.364111  5191 raft_consensus.cc:2468] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 10.
I20260709 12:14:57.321290  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:57.366330  5116 raft_consensus.cc:3055] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:14:57.317546  5833 raft_consensus.cc:1217] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 11 LEADER]: Deduplicated request from leader. Original: 8.9->[10.10-10.10]   Dedup: 10.10->[]
I20260709 12:14:57.289479  9274 consensus_queue.cc:1059] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:14:57.367564  5240 leader_election.cc:304] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:57.219036  9526 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:57.369854  9533 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:57.365352  9349 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:57.371371  9507 raft_consensus.cc:515] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:57.340893  9198 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:57.286799  9442 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:57.376434  5117 raft_consensus.cc:2468] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 9.
I20260709 12:14:57.360015  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:57.421100  9442 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:57.374190  5265 rpcz_store.cc:276] 0709 12:14:54.898693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:55.092323 (+193630us) service_pool.cc:224] Handling call
0709 12:14:55.108681 (+ 16358us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:55.109060 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:55.109100 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:55.495549 (+386449us) spinlock_profiling.cc:243] Waited 4.06 ms on lock 0x7b2c000c2038. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e54bca11 00007f84e54cc372 00007f84e6bfea01 00007f84e6bc343a 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2
0709 12:14:55.496120 (+   571us) log.cc:844] Serialized 52 byte log entry
0709 12:14:56.185595 (+689475us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:56.794197 (+608602us) log.cc:844] Serialized 14 byte log entry
0709 12:14:56.794445 (+   248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:56.794538 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:57.329924 (+535386us) spinlock_profiling.cc:243] Waited 995 us on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e675e86e 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221 00007f84e67671d9 00007f84e6767169
0709 12:14:57.373583 (+ 43659us) raft_consensus.cc:1685] finished
0709 12:14:57.373607 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:57.373754 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12261,"prepare.queue_time_us":544135,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":40879,"raft.run_cpu_time_us":415,"raft.run_wall_time_us":48755,"spinlock_wait_cycles":11615872,"thread_start_us":1199639,"threads_started":2,"wal-append.queue_time_us":939710}
I20260709 12:14:57.383843  5238 leader_election.cc:304] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:57.426931  5238 leader_election.cc:304] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:57.428403  5238 leader_election.cc:304] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:57.430390  9531 raft_consensus.cc:2804] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:14:57.430948  9531 raft_consensus.cc:697] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 10 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:57.431803  9531 consensus_queue.cc:237] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:57.432744  9475 raft_consensus.cc:2749] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:14:57.433670  9475 consensus_queue.cc:1048] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:14:57.387189  9294 leader_election.cc:290] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:57.387507  9407 raft_consensus.cc:515] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:57.436183  9507 leader_election.cc:290] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:57.437846  9407 leader_election.cc:290] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:57.391000  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:57.438297  5835 raft_consensus.cc:1275] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:14:57.398793  5197 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 10.
I20260709 12:14:57.415783  9533 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:57.399247  5833 raft_consensus.cc:1240] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 11 LEADER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:14:57.398679  5116 raft_consensus.cc:740] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:57.440680  5116 consensus_queue.cc:260] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:57.399794  5801 leader_election.cc:304] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:57.326838  9211 consensus_queue.cc:1048] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 12:14:57.441602  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:57.406607  5240 leader_election.cc:304] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:57.317154  8896 raft_consensus.cc:515] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:57.444134  9475 raft_consensus.cc:493] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:57.444756  8896 leader_election.cc:290] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:57.355912  9363 consensus_queue.cc:1048] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 12:14:57.445472  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:57.381569  9535 raft_consensus.cc:697] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:57.377012  9498 raft_consensus.cc:2749] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709) with higher term. Message: Invalid argument: T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 8. Current term is 9.
I20260709 12:14:57.462927  5268 raft_consensus.cc:1275] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:14:57.463593  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 63896.7us
I20260709 12:14:57.465564  5801 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:57.433871  9540 raft_consensus.cc:2749] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:57.386411  5122 raft_consensus.cc:1275] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:14:57.439410  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:57.444659  9475 raft_consensus.cc:515] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:57.448123  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:57.448470  5198 raft_consensus.cc:2468] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 9.
I20260709 12:14:57.468086  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:57.441633  5116 raft_consensus.cc:3060] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:14:57.356742  9479 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:57.457765  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:57.459828  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:57.328621  9286 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:57.434393  9135 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:57.353704  9384 raft_consensus.cc:515] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:57.471057  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 114661us
I20260709 12:14:57.484683  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:57.472309  5266 raft_consensus.cc:1275] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:14:57.362031  9411 raft_consensus.cc:515] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:57.477448  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:57.407557  9214 raft_consensus.cc:2749] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:14:57.480225  5801 leader_election.cc:304] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:57.503146  9412 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
W20260709 12:14:57.476329  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 69798.4us
I20260709 12:14:57.503705  9477 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:57.503749  9412 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:57.505300  9540 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:57.505832  9540 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:57.506675  9412 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:57.507961  9540 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:57.489229  5274 raft_consensus.cc:2468] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 11.
I20260709 12:14:57.493078  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:57.509768  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:57.438045  9349 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:57.407589  9504 consensus_queue.cc:237] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:57.496927  9479 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:57.440680  9533 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:57.502660  9535 consensus_queue.cc:237] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:57.449869  9335 leader_election.cc:290] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:57.511243  5272 raft_consensus.cc:2393] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 14: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
W20260709 12:14:57.494226  9495 log.cc:927] Time spent T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.990s	user 0.007s	sys 0.002s
I20260709 12:14:57.513206  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:57.516614  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:57.521003  5240 leader_election.cc:304] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:57.414211  9541 consensus_queue.cc:1048] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 12:14:57.478713  9119 raft_consensus.cc:2804] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:57.484640  9539 raft_consensus.cc:2749] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:57.527155  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:57.569757  5122 raft_consensus.cc:2468] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 10.
I20260709 12:14:57.483758  5193 raft_consensus.cc:2468] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 12.
I20260709 12:14:57.533684  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:57.534333  5116 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 11.
W20260709 12:14:57.541819  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 174917us
I20260709 12:14:57.572261  5088 leader_election.cc:400] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709) with higher term. Message: Invalid argument: T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 12. Current term is 13.
I20260709 12:14:57.535337  5119 raft_consensus.cc:1275] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:14:57.488190  9484 raft_consensus.cc:2804] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:57.508641  9378 raft_consensus.cc:2749] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:57.546088  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:57.554870  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:57.556562  5191 raft_consensus.cc:1275] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:14:57.557178  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:57.557054  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:57.534724  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 59247us
I20260709 12:14:57.575737  5274 raft_consensus.cc:1240] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:14:57.590539  5120 raft_consensus.cc:2468] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 10.
I20260709 12:14:57.584426  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:57.592082  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:57.592919  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:57.593287  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:57.578322  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:57.594561  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:57.534507  9323 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.972s	user 0.027s	sys 0.033s
W20260709 12:14:57.595618  9323 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.033s	user 0.027s	sys 0.033s
I20260709 12:14:57.596889  9533 raft_consensus.cc:493] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:57.597592  9533 raft_consensus.cc:515] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:57.591054  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:57.526886  9282 raft_consensus.cc:493] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:57.504225  9477 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:57.600649  5274 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 10.
W20260709 12:14:57.596843  5088 connection.cc:256] RPC call timeout handler was delayed by -1.2458112900001197s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22260000000000002s for a response
I20260709 12:14:57.605330  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:57.539827  9119 raft_consensus.cc:493] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:57.615023  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:57.566177  9294 raft_consensus.cc:2749] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:57.622953  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:14:57.621590  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 242512us
I20260709 12:14:57.623646  5267 raft_consensus.cc:2468] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 11.
I20260709 12:14:57.625429  9282 raft_consensus.cc:515] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:57.637151  9378 raft_consensus.cc:493] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:57.588840  9538 raft_consensus.cc:493] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:57.580308  9484 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:57.540524  9507 consensus_queue.cc:1048] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 12:14:57.662919  9533 leader_election.cc:290] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:57.622038  9119 raft_consensus.cc:3060] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:57.642168  9282 leader_election.cc:290] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:57.667723  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:57.588593  9537 consensus_queue.cc:1048] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 12:14:57.669631  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:57.637753  9378 raft_consensus.cc:515] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:57.678877  5192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 2302) took 2331 ms. Trace:
I20260709 12:14:57.657116  9484 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:57.661403  9538 raft_consensus.cc:515] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:57.609156  9442 consensus_queue.cc:1048] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.057s
W20260709 12:14:57.724409  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 79108.7us
I20260709 12:14:57.694628  5192 rpcz_store.cc:276] 0709 12:14:55.337194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:55.338660 (+  1466us) service_pool.cc:224] Handling call
0709 12:14:55.338980 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:55.339319 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:55.339348 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:55.339793 (+   445us) log.cc:844] Serialized 26 byte log entry
0709 12:14:56.194395 (+854602us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:14:56.756208 (+561813us) log.cc:844] Serialized 14 byte log entry
0709 12:14:56.796989 (+ 40781us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:56.797087 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:57.493506 (+696419us) spinlock_profiling.cc:243] Waited 69.3 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e675e86e 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221 00007f84e67671d9 00007f84e6767169
0709 12:14:57.660620 (+167114us) raft_consensus.cc:1685] finished
0709 12:14:57.668388 (+  7768us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:57.668558 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52703,"prepare.queue_time_us":534444,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":51267,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":33165,"spinlock_wait_cycles":159379328,"thread_start_us":1250212,"threads_started":2,"wal-append.queue_time_us":1099348}
W20260709 12:14:57.730666  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 75595.3us
I20260709 12:14:57.731285  5199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41416 (request call id 795) took 1430 ms. Trace:
I20260709 12:14:57.656579  9407 consensus_queue.cc:1059] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 12:14:57.742038  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:57.746459  5269 raft_consensus.cc:2468] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 9.
W20260709 12:14:57.727893  9512 log.cc:927] Time spent T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 12:14:57.749130  5163 leader_election.cc:304] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:57.733927  5199 rpcz_store.cc:276] 0709 12:14:56.300995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:56.301112 (+   117us) service_pool.cc:224] Handling call
0709 12:14:56.301359 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:56.301550 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:14:57.217797 (+916247us) log.cc:844] Serialized 14 byte log entry
0709 12:14:57.728385 (+510588us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:57.729153 (+   768us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:57.729290 (+   137us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:57.729695 (+   405us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:57.730917 (+  1222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26569,"prepare.queue_time_us":427659,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":52255,"raft.run_cpu_time_us":3545,"raft.run_wall_time_us":40271,"thread_start_us":1375872,"threads_started":3}
I20260709 12:14:57.723951  9294 raft_consensus.cc:493] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
W20260709 12:14:57.756963  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 111641us
W20260709 12:14:57.758435  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 126023us
I20260709 12:14:57.763495  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:57.764348  5267 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 10.
I20260709 12:14:57.765143  5237 leader_election.cc:304] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:57.676057  9551 consensus_queue.cc:1048] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 12:14:57.781442  5166 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:57.789402  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:57.750828  9529 consensus_queue.cc:1048] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:14:57.775472  9546 raft_consensus.cc:2749] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:57.800765  9286 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:57.800889  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:57.822803  5270 raft_consensus.cc:2393] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 12: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:57.805485  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:57.806861  9531 raft_consensus.cc:493] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:57.807533  9545 raft_consensus.cc:493] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:57.810891  5273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50932 (request call id 840) took 1565 ms. Trace:
I20260709 12:14:57.783648  9570 raft_consensus.cc:493] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
W20260709 12:14:57.783100  9550 log.cc:927] Time spent T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.180s	user 0.001s	sys 0.001s
I20260709 12:14:57.820495  9538 leader_election.cc:290] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:57.774154  9475 leader_election.cc:290] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:57.793809  9540 consensus_queue.cc:1048] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:14:57.827242  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:57.782536  9211 raft_consensus.cc:3055] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:14:57.820297  9378 leader_election.cc:290] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:57.825891  5273 rpcz_store.cc:276] 0709 12:14:56.245313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:56.245626 (+   313us) service_pool.cc:224] Handling call
0709 12:14:57.810674 (+1565048us) spinlock_profiling.cc:243] Waited 1.56 s on lock 0x7b54002576d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:57.810811 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3591148928}
I20260709 12:14:57.847416  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:57.791729  9384 leader_election.cc:290] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:57.769908  9294 raft_consensus.cc:515] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:57.851972  9544 log.cc:927] Time spent T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.050s	user 0.001s	sys 0.004s
W20260709 12:14:57.843832  9556 log.cc:927] Time spent T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.113s	user 0.003s	sys 0.000s
I20260709 12:14:57.874572  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:57.886732  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:57.887449  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:57.888167  5267 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 11.
I20260709 12:14:57.889649  5267 raft_consensus.cc:1240] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 9. Current term is 10. Ops: [8.6-9.7]
I20260709 12:14:57.829497  9507 raft_consensus.cc:2804] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:57.872022  9211 raft_consensus.cc:740] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
W20260709 12:14:57.874917  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 93584.6us
W20260709 12:14:57.874372  9574 log.cc:927] Time spent T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.074s	user 0.000s	sys 0.002s
I20260709 12:14:57.894454  5166 leader_election.cc:304] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:57.896160  5273 raft_consensus.cc:1240] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:14:57.897022  5166 leader_election.cc:304] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:57.873744  9411 leader_election.cc:290] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:57.906898  9198 raft_consensus.cc:2749] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:57.890873  9573 consensus_queue.cc:1059] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:14:57.911296  9573 consensus_queue.cc:1243] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer bce73265e27d4b30a4dcc1e491305088 log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:14:57.875398  9551 raft_consensus.cc:2749] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:57.899950  5166 leader_election.cc:304] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:57.900137  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:57.900667  5270 raft_consensus.cc:2468] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 8.
I20260709 12:14:57.901587  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:57.918779  5192 raft_consensus.cc:2468] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 9.
W20260709 12:14:57.903584  9555 log.cc:927] Time spent T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.226s	user 0.001s	sys 0.001s
I20260709 12:14:57.904325  9363 raft_consensus.cc:2749] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:57.865161  9545 raft_consensus.cc:515] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:57.905659  9211 consensus_queue.cc:260] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:57.890185  9507 raft_consensus.cc:493] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:57.921809  5166 leader_election.cc:304] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:14:57.922175  5199 raft_consensus.cc:2393] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 11: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:57.865619  9531 raft_consensus.cc:515] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:57.928333  5166 leader_election.cc:304] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:57.868773  9534 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:57.875666  9498 consensus_queue.cc:1059] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 12:14:57.868536  9570 raft_consensus.cc:515] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:57.949337  9211 raft_consensus.cc:3060] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:57.951920  9531 leader_election.cc:290] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:57.930665  9384 raft_consensus.cc:2804] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:57.926877  9551 raft_consensus.cc:2749] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:57.953980  9584 raft_consensus.cc:493] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:57.954209  9551 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:57.954545  9584 raft_consensus.cc:515] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:57.954664  9551 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:57.929502  9507 raft_consensus.cc:3060] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:57.947217  9363 raft_consensus.cc:493] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:57.966264  9363 raft_consensus.cc:515] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:57.968479  9363 leader_election.cc:290] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:57.969818  9498 raft_consensus.cc:3055] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:14:57.970279  9498 raft_consensus.cc:740] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:57.971125  9498 consensus_queue.cc:260] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:57.974469  5197 raft_consensus.cc:2393] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 14: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:57.979885  9484 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:57.980433  5801 leader_election.cc:304] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:57.945528  9529 raft_consensus.cc:493] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
W20260709 12:14:57.988497  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 60236.8us
I20260709 12:14:57.996006  5166 leader_election.cc:304] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:58.020956  9578 consensus_queue.cc:1048] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:14:58.023857  9578 raft_consensus.cc:493] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:58.025534  9578 raft_consensus.cc:515] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:57.953729  9384 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:58.012317  9396 raft_consensus.cc:2749] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:14:58.043859  9507 raft_consensus.cc:515] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:58.045324  9527 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:58.045979  9527 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:58.046506  9119 raft_consensus.cc:515] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:58.047868  9282 raft_consensus.cc:493] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:58.048471  9282 raft_consensus.cc:515] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:58.051232  9484 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:58.013440  9270 raft_consensus.cc:2749] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:58.052693  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:58.053469  5838 raft_consensus.cc:2468] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 9.
I20260709 12:14:57.990279  9545 leader_election.cc:290] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:58.012428  9363 raft_consensus.cc:2749] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:58.056071  9282 leader_election.cc:290] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:58.054461  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:58.056828  5829 raft_consensus.cc:2468] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 9.
I20260709 12:14:58.035058  9384 raft_consensus.cc:3060] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:58.059870  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:58.060534  5829 raft_consensus.cc:2468] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 10.
I20260709 12:14:57.981900  9529 raft_consensus.cc:515] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:58.063320  9527 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:58.064177  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:58.064808  5837 raft_consensus.cc:3060] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:14:58.065582  9119 leader_election.cc:290] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:58.064195  9529 leader_election.cc:290] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:58.072968  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:58.037755  5238 leader_election.cc:304] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:58.073760  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:58.074286  9507 leader_election.cc:290] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:58.076957  5837 raft_consensus.cc:2468] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 14.
I20260709 12:14:58.085333  9580 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:58.088788  9557 log.cc:927] Time spent T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.131s	user 0.002s	sys 0.000s
I20260709 12:14:58.088652  9580 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:58.090999  9580 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:58.098745  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:58.100282  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:58.100924  5265 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 10.
I20260709 12:14:58.086814  9578 leader_election.cc:290] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:58.102324  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:58.105685  5124 raft_consensus.cc:1275] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 12:14:58.106110  5124 pending_rounds.cc:85] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting all ops after (but not including) 6
I20260709 12:14:58.106331  5124 pending_rounds.cc:107] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:14:58.106572  5124 raft_consensus.cc:2889] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:58.107594  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:58.108210  5124 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 10.
I20260709 12:14:58.108520  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:58.173803  5240 leader_election.cc:304] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:58.181178  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:58.182488  5240 leader_election.cc:304] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:58.183519  5240 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:58.186128  5088 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:58.188032  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:58.188724  5838 raft_consensus.cc:2468] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 9.
I20260709 12:14:58.189730  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:58.189978  5834 raft_consensus.cc:1275] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:14:58.190479  5837 raft_consensus.cc:2393] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 11: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:58.190975  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:58.194676  5163 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:58.196524  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:58.194161  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:58.196250  9540 raft_consensus.cc:2804] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:58.168807  9542 raft_consensus.cc:493] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
W20260709 12:14:58.202378  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:58.205564  5238 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:58.205331  5240 leader_election.cc:304] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:58.212734  5238 leader_election.cc:304] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:58.196451  9369 raft_consensus.cc:2804] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:58.232399  9274 raft_consensus.cc:493] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:58.233037  9274 raft_consensus.cc:515] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:58.234683  5118 consensus_queue.cc:260] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:58.235245  9274 leader_election.cc:290] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:58.244305  9551 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:58.230249  9349 raft_consensus.cc:2749] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:14:58.223462  9411 consensus_queue.cc:1048] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:14:58.266480  5801 leader_election.cc:304] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:58.267552  5801 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:58.268967  9527 raft_consensus.cc:2804] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:58.269366  9527 raft_consensus.cc:493] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:58.269742  9527 raft_consensus.cc:3060] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:58.273615  9269 raft_consensus.cc:2804] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:14:58.274269  9269 raft_consensus.cc:697] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 12 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:58.275110  9269 consensus_queue.cc:237] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:58.279261  9576 log.cc:927] Time spent T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.329s	user 0.000s	sys 0.001s
I20260709 12:14:58.290596  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:58.291318  5121 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 10.
I20260709 12:14:58.293895  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:58.242941  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:58.303272  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:58.303527  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:58.304026  5199 raft_consensus.cc:2468] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 9.
I20260709 12:14:58.304106  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:58.305291  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:58.309214  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:58.229460  5238 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:58.199966  9577 raft_consensus.cc:2749] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:58.203578  9540 raft_consensus.cc:493] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
W20260709 12:14:58.316756  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 87408us
I20260709 12:14:58.316784  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:58.214191  9583 raft_consensus.cc:493] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:58.341005  5273 raft_consensus.cc:2468] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 11.
I20260709 12:14:58.331261  5238 leader_election.cc:304] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:58.228194  9531 raft_consensus.cc:2749] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:58.221314  9567 raft_consensus.cc:2804] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:58.354035  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:58.354909  5199 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:58.227519  9369 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:58.344995  5163 leader_election.cc:304] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:58.351234  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:58.360520  5193 raft_consensus.cc:3060] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:58.220993  9135 consensus_queue.cc:1059] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.113s
I20260709 12:14:58.367316  9135 raft_consensus.cc:3055] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:14:58.367751  9135 raft_consensus.cc:740] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:58.368567  9135 consensus_queue.cc:260] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:58.358785  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:58.358088  9541 consensus_queue.cc:1048] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 12:14:58.364253  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:58.378896  5192 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 11.
I20260709 12:14:58.353968  9567 raft_consensus.cc:493] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:58.381671  9567 raft_consensus.cc:3060] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:58.377485  9135 raft_consensus.cc:3060] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:58.390798  5193 raft_consensus.cc:2468] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 12.
I20260709 12:14:58.318002  9540 raft_consensus.cc:3060] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:58.333513  9475 raft_consensus.cc:2804] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:14:58.316941  9570 leader_election.cc:290] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:58.397992  5199 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 11.
I20260709 12:14:58.214933  9542 raft_consensus.cc:515] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:58.395673  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:58.354527  9349 raft_consensus.cc:2804] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:58.410640  5194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41416 (request call id 804) took 1041 ms. Trace:
W20260709 12:14:58.394256  9589 log.cc:927] Time spent T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 12:14:58.366284  9369 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:58.417703  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:58.421360  5199 raft_consensus.cc:2368] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 11. Current term is 12.
I20260709 12:14:58.414079  5194 rpcz_store.cc:276] 0709 12:14:57.368928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:57.369191 (+   263us) service_pool.cc:224] Handling call
0709 12:14:57.369597 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:57.417179 (+ 47582us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:57.417214 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:57.417733 (+   519us) log.cc:844] Serialized 26 byte log entry
0709 12:14:57.613571 (+195838us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:57.613608 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:58.088180 (+474572us) spinlock_profiling.cc:243] Waited 5.98 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e675e86e 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221 00007f84e67671d9 00007f84e6767169
0709 12:14:58.410220 (+322040us) spinlock_profiling.cc:243] Waited 33.8 ms on lock 0x7b54002af654. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:58.410290 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:58.410347 (+    57us) raft_consensus.cc:1685] finished
0709 12:14:58.410362 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:58.410545 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38517,"raft.queue_time_us":41442,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":13047,"spinlock_wait_cycles":91438720,"thread_start_us":120618,"threads_started":1,"wal-append.queue_time_us":424002}
I20260709 12:14:58.392781  9577 raft_consensus.cc:2764] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 12:14:58.426317  5266 raft_consensus.cc:2468] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 10.
I20260709 12:14:58.401242  9537 raft_consensus.cc:2749] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:58.354615  9583 raft_consensus.cc:515] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:58.435196  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:58.412266  9349 raft_consensus.cc:493] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:58.412827  9475 raft_consensus.cc:697] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 14 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:58.437091  5194 raft_consensus.cc:2368] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 11. Current term is 12.
I20260709 12:14:58.421216  9534 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:58.454505  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:58.438235  9580 raft_consensus.cc:2804] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:58.445323  9349 raft_consensus.cc:3060] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:58.471933  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:58.473501  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:58.474225  5274 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 10.
I20260709 12:14:58.474711  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:58.475126  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:58.476593  5274 raft_consensus.cc:3060] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:58.478675  9526 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:58.482985  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:58.483644  5269 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:58.486219  9542 leader_election.cc:290] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:58.487512  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:58.489101  9477 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:58.486562  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:58.492285  9369 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:58.492508  9540 raft_consensus.cc:515] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:58.494395  9369 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:58.495354  9567 raft_consensus.cc:515] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:58.497529  9567 leader_election.cc:290] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:58.499313  9475 consensus_queue.cc:237] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:58.473327  5237 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:58.487926  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:58.502754  9384 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:58.503733  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:58.504940  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:58.510329  5120 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 10.
I20260709 12:14:58.511474  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:58.512462  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:58.513118  5119 raft_consensus.cc:2468] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 13.
I20260709 12:14:58.522627  5240 leader_election.cc:304] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
W20260709 12:14:58.535312  9597 log.cc:927] Time spent T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:14:58.469901  9583 leader_election.cc:290] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:58.536674  9477 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:58.538487  5240 leader_election.cc:304] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:14:58.539369  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:58.538568  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:58.541109  5240 leader_election.cc:304] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:58.504967  9384 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:58.544421  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:58.545571  5194 raft_consensus.cc:2393] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 11: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:58.545835  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:58.546800  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 73591.6us
I20260709 12:14:58.549137  5269 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 11.
I20260709 12:14:58.550140  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:58.550694  5801 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:58.538648  9567 raft_consensus.cc:2749] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:58.556125  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:58.553419  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:58.553108  9484 raft_consensus.cc:2804] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:58.543238  9369 raft_consensus.cc:2749] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:14:58.571825  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:58.573431  9583 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:58.573730  9558 log.cc:927] Time spent T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.800s	user 0.002s	sys 0.003s
I20260709 12:14:58.575143  5835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46088 (request call id 783) took 1092 ms. Trace:
I20260709 12:14:58.575482  5835 rpcz_store.cc:276] 0709 12:14:57.482319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:57.482475 (+   156us) service_pool.cc:224] Handling call
0709 12:14:57.482815 (+   340us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:57.488010 (+  5195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:57.488041 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:57.497957 (+  9916us) log.cc:844] Serialized 52 byte log entry
0709 12:14:57.612911 (+114954us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:57.612955 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:57.613033 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:58.545444 (+932411us) spinlock_profiling.cc:243] Waited 3.34 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e675e86e 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221 00007f84e67671d9 00007f84e6767169
0709 12:14:58.574863 (+ 29419us) raft_consensus.cc:1685] finished
0709 12:14:58.574884 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:58.575082 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5581,"raft.queue_time_us":1676,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":2892,"spinlock_wait_cycles":7677312,"thread_start_us":114531,"threads_started":1,"wal-append.queue_time_us":230456}
I20260709 12:14:58.582619  9583 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:58.583137  5801 leader_election.cc:304] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:58.584239  9378 raft_consensus.cc:2804] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:14:58.584627  9378 raft_consensus.cc:493] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:58.584996  9378 raft_consensus.cc:3060] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:58.587065  5274 raft_consensus.cc:2468] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 12.
W20260709 12:14:58.590698  5088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:58.592677  9592 log.cc:927] Time spent T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.378s	user 0.003s	sys 0.000s
W20260709 12:14:58.597105  9582 log.cc:927] Time spent T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.649s	user 0.003s	sys 0.000s
I20260709 12:14:58.605304  9378 raft_consensus.cc:515] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:58.606535  5272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34674 (request call id 2331) took 1032 ms. Trace:
I20260709 12:14:58.613013  5191 raft_consensus.cc:1240] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:58.607975  9540 leader_election.cc:290] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:58.609023  9527 raft_consensus.cc:515] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:58.613469  9580 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:58.611014  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:58.617298  9580 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:58.564031  9484 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:58.618425  9484 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:58.611806  5199 raft_consensus.cc:1240] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 11. Current term is 12. Ops: []
I20260709 12:14:58.619554  9527 leader_election.cc:290] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:58.605108  5269 raft_consensus.cc:1275] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:14:58.615669  5272 rpcz_store.cc:276] 0709 12:14:57.574550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:57.575080 (+   530us) service_pool.cc:224] Handling call
0709 12:14:57.603961 (+ 28881us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:57.604308 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:57.604357 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:57.653230 (+ 48873us) log.cc:844] Serialized 26 byte log entry
0709 12:14:57.836652 (+183422us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:14:57.875758 (+ 39106us) log.cc:844] Serialized 14 byte log entry
0709 12:14:57.875971 (+   213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:57.876034 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:58.604283 (+728249us) spinlock_profiling.cc:243] Waited 2.74 ms on lock 0x7b1800345e20. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3ad63f3 00007f84e3ad87c1 00007f84e3ad8779 00007f84e3ad8709 00007f84e3ad86d1 00007f84e3ad79cd 0000000000388634 0000000000388479 00007f84e3ab983a
0709 12:14:58.606217 (+  1934us) raft_consensus.cc:1685] finished
0709 12:14:58.606318 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:58.606463 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":44160,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":969,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":21005,"spinlock_wait_cycles":16336512,"thread_start_us":116974,"threads_started":1,"wal-append.queue_time_us":209881}
I20260709 12:14:58.611907  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:58.612519  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:58.613356  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:58.623044  5125 raft_consensus.cc:3060] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:58.624974  5801 leader_election.cc:304] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:58.626650  9527 raft_consensus.cc:2804] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:14:58.627138  9527 raft_consensus.cc:697] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 12 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:58.621742  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:58.627918  9527 consensus_queue.cc:237] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:58.621677  5269 raft_consensus.cc:1240] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:58.630868  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:58.631445  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:58.632042  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:58.633059  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:58.633528  5125 raft_consensus.cc:2468] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 11.
I20260709 12:14:58.634052  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:58.637964  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:58.643411  5240 leader_election.cc:304] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:14:58.645537  5801 leader_election.cc:304] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:58.651854  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:14:58.653076  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:58.656986  9567 raft_consensus.cc:2804] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:58.657182  9602 raft_consensus.cc:2804] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:14:58.664078  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:58.668809  5267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50932 (request call id 850) took 1066 ms. Trace:
I20260709 12:14:58.669301  5267 rpcz_store.cc:276] 0709 12:14:57.602268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:57.891548 (+289280us) service_pool.cc:224] Handling call
0709 12:14:57.891834 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:57.892240 (+   406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:57.892268 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:57.914136 (+ 21868us) log.cc:844] Serialized 26 byte log entry
0709 12:14:58.083220 (+169084us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:58.083279 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:58.083348 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:58.592306 (+508958us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b240025f0b8. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e395c9c4 00007f84e395aacb 00007f84e3b15dc9 00007f84e3b15a55 00007f84e3b1509d 00007f84e674710e 00007f84e675e88c 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221
0709 12:14:58.663334 (+ 71028us) raft_consensus.cc:1685] finished
0709 12:14:58.663352 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:58.668734 (+  5382us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":85,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":9679,"spinlock_wait_cycles":43531008,"thread_start_us":118905,"threads_started":1,"wal-append.queue_time_us":230647}
I20260709 12:14:58.678397  5166 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:14:58.682111  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:14:58.684463  5166 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:58.685346  5274 raft_consensus.cc:1240] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 11. Current term is 12. Ops: []
I20260709 12:14:58.686996  5831 raft_consensus.cc:2393] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 14: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:58.695881  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:14:58.699309  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:14:58.703364  5832 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.017s	sys 0.007s
I20260709 12:14:58.665601  9567 raft_consensus.cc:697] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 11 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:14:58.709924  5166 leader_election.cc:304] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:58.739562  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:14:58.742659  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:58.688002  9269 raft_consensus.cc:2804] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:14:58.698747  9442 raft_consensus.cc:2804] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:58.746713  5116 raft_consensus.cc:1275] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:14:58.753558  5116 raft_consensus.cc:1240] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 10. Current term is 11. Ops: []
I20260709 12:14:58.698467  9504 raft_consensus.cc:2749] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:14:58.748277  5831 raft_consensus.cc:1240] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 10. Current term is 11. Ops: []
W20260709 12:14:58.711805  9267 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.091s	sys 0.121s
I20260709 12:14:58.687377  9570 consensus_queue.cc:1048] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 12:14:58.712196  9569 raft_consensus.cc:2749] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:14:58.760212  9267 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.091s	sys 0.121s
I20260709 12:14:58.751621  9269 raft_consensus.cc:493] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:58.758495  9442 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:58.776666  9442 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:14:58.764138  9566 log.cc:927] Time spent T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:14:58.774530  9567 consensus_queue.cc:237] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:58.762490  9378 leader_election.cc:290] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:58.785719  9269 raft_consensus.cc:3060] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:58.759779  9523 consensus_queue.cc:1048] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:14:58.770128  9577 consensus_queue.cc:1059] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:14:58.821750  9569 raft_consensus.cc:3055] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:14:58.812352  9349 raft_consensus.cc:515] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:58.838003  9601 log.cc:927] Time spent T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
W20260709 12:14:58.851480  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 95967.5us
I20260709 12:14:58.841831  9505 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:58.842325  9569 raft_consensus.cc:740] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:14:58.861054  5273 raft_consensus.cc:2393] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 10: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:14:58.859730  9378 raft_consensus.cc:493] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:58.864440  9378 raft_consensus.cc:515] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:58.866792  9378 leader_election.cc:290] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:14:58.876535  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 127660us
I20260709 12:14:58.890071  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:58.895408  9583 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:58.906862  5088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:59.081490  5836 raft_consensus.cc:1217] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 11 LEADER]: Deduplicated request from leader. Original: 8.9->[10.10-10.10]   Dedup: 10.10->[]
I20260709 12:14:59.082108  5836 raft_consensus.cc:1240] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 11 LEADER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
W20260709 12:14:59.101747  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 196201us
W20260709 12:14:59.112469  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 203572us
W20260709 12:14:59.153848  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:59.173542  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:14:59.173768  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 71268.9us
I20260709 12:14:59.174444  5833 raft_consensus.cc:2468] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 11.
I20260709 12:14:58.858640  9580 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:59.118817  9607 log.cc:927] Time spent T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.257s	user 0.001s	sys 0.000s
I20260709 12:14:58.870466  9505 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:59.205165  9369 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.205843  9584 leader_election.cc:290] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:59.210347  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:59.222877  9294 leader_election.cc:290] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:59.297463  5269 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.020s	sys 0.019s
W20260709 12:14:59.226401  5270 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50932 (request call id 853) took 1403 ms (client timeout 1563 ms). Trace:
W20260709 12:14:59.229864  9593 log.cc:927] Time spent T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.396s	user 0.000s	sys 0.003s
I20260709 12:14:59.238126  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:59.238875  9609 log.cc:927] Time spent T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:14:59.240334  5268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50932 (request call id 842) took 1659 ms. Trace:
I20260709 12:14:59.117194  9570 raft_consensus.cc:493] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:59.174384  9504 raft_consensus.cc:493] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
W20260709 12:14:59.291832  5117 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.010s	sys 0.030s
W20260709 12:14:59.351222  5801 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.045s	sys 0.081s
W20260709 12:14:59.298273  5270 rpcz_store.cc:269] 0709 12:14:57.822986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:57.826961 (+  3975us) service_pool.cc:224] Handling call
0709 12:14:59.226182 (+1399221us) spinlock_profiling.cc:243] Waited 31.4 ms on lock 0x7b54002558d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:14:59.226323 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":72149888}
W20260709 12:14:59.351627  5117 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.010s	sys 0.030s
I20260709 12:14:59.321663  5118 raft_consensus.cc:3060] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:14:59.344568  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:14:59.202889  9484 consensus_meta.cc:287] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.584s	user 0.011s	sys 0.000s
W20260709 12:14:59.352206  5801 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.045s	sys 0.081s
W20260709 12:14:59.297914  5269 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.020s	sys 0.019s
I20260709 12:14:59.345404  5268 rpcz_store.cc:276] 0709 12:14:57.581338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:57.581497 (+   159us) service_pool.cc:224] Handling call
0709 12:14:57.581819 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:57.582028 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:14:57.620820 (+ 38792us) log.cc:844] Serialized 14 byte log entry
0709 12:14:58.628768 (+1007948us) spinlock_profiling.cc:243] Waited 19.3 ms on lock 0x7b18002c78e0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3ab8e07 00007f84ec9139a9 00007f84e3ad569b 00007f84e3ad393f 00007f84e3ad5c02 00007f84e675d20b 00007f84e6762d23 00007f84e676323a 00007f84e6bcda2a
0709 12:14:59.239810 (+611042us) log.cc:844] Serialized 14 byte log entry
0709 12:14:59.239988 (+   178us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:59.240032 (+    44us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:59.240071 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:59.240140 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:59.240276 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":117350,"prepare.queue_time_us":38663,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":4750,"raft.queue_time_us":21379,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":80328,"spinlock_wait_cycles":44499840,"thread_start_us":610503,"threads_started":2}
W20260709 12:14:59.353343  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 672506us
I20260709 12:14:59.354207  5801 leader_election.cc:304] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:59.360450  5269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34672 (request call id 2261) took 1181 ms. Trace:
I20260709 12:14:59.360855  5269 rpcz_store.cc:276] 0709 12:14:58.179495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:58.630198 (+450703us) service_pool.cc:224] Handling call
0709 12:14:58.630546 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:58.630744 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:14:58.646135 (+ 15391us) log.cc:844] Serialized 14 byte log entry
0709 12:14:59.360120 (+713985us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:59.360169 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:14:59.360210 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:59.360282 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:59.360394 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7241,"prepare.queue_time_us":13327,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"thread_start_us":706396,"threads_started":1}
I20260709 12:14:59.247334  9545 raft_consensus.cc:2749] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:59.366786  5801 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:14:59.359838  9618 log.cc:927] Time spent T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 12:14:59.400813  5118 raft_consensus.cc:1275] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:14:59.410954  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
W20260709 12:14:59.396389  9477 consensus_meta.cc:287] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.859s	user 0.011s	sys 0.000s
I20260709 12:14:59.427448  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:59.359447  9570 raft_consensus.cc:515] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:14:59.398126  9567 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.017s	sys 0.032s
W20260709 12:14:59.433928  9400 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
W20260709 12:14:59.435081  9604 log.cc:927] Time spent T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.576s	user 0.001s	sys 0.000s
I20260709 12:14:59.436383  5832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46088 (request call id 795) took 1248 ms. Trace:
I20260709 12:14:59.436777  5832 rpcz_store.cc:276] 0709 12:14:58.188272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:58.188382 (+   110us) service_pool.cc:224] Handling call
0709 12:14:58.199031 (+ 10649us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:58.199270 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:58.199295 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:58.202289 (+  2994us) log.cc:844] Serialized 26 byte log entry
0709 12:14:58.706446 (+504157us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:58.706490 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:58.706557 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:59.436149 (+729592us) raft_consensus.cc:1685] finished
0709 12:14:59.436171 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:59.436318 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":503833,"threads_started":1,"wal-append.queue_time_us":636285}
I20260709 12:14:59.359625  9504 raft_consensus.cc:515] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:59.445284  9504 leader_election.cc:290] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:59.397266  9554 raft_consensus.cc:493] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.458933  9498 raft_consensus.cc:3060] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:59.459435  9570 leader_election.cc:290] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:59.461858  9527 raft_consensus.cc:2749] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:14:59.462620  9527 raft_consensus.cc:2804] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:14:59.463037  9527 raft_consensus.cc:697] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 11 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:14:59.464037  9527 consensus_queue.cc:237] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:59.426422  9211 raft_consensus.cc:493] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:59.366166  9484 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:59.466338  5266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34672 (request call id 2252) took 1518 ms. Trace:
W20260709 12:14:59.448254  9567 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.018s	sys 0.032s
I20260709 12:14:59.194159  9569 consensus_queue.cc:260] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:59.437696  9463 raft_consensus.cc:493] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.449570  9477 raft_consensus.cc:2749] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:59.478489  5829 raft_consensus.cc:2393] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 12: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:14:59.466987  9554 raft_consensus.cc:515] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:59.311461  9369 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:59.479815  9463 raft_consensus.cc:515] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:59.499199  9505 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:59.500171  9580 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:59.494052  9442 consensus_meta.cc:287] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.717s	user 0.011s	sys 0.000s
I20260709 12:14:59.501323  9442 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:59.503945  9442 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:59.504117  9554 leader_election.cc:290] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:14:59.504840  9612 log.cc:927] Time spent T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
W20260709 12:14:59.534170  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 415737us
I20260709 12:14:59.536608  5088 leader_election.cc:400] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Vote denied by peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455) with higher term. Message: Invalid argument: T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 11. Current term is 12.
I20260709 12:14:59.537075  5117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40386 (request call id 2175) took 1423 ms. Trace:
I20260709 12:14:59.537696  5117 rpcz_store.cc:276] 0709 12:14:58.113625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:58.661550 (+547925us) service_pool.cc:224] Handling call
0709 12:14:58.661869 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:58.662223 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:58.662251 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:58.662690 (+   439us) log.cc:844] Serialized 26 byte log entry
0709 12:14:59.352080 (+689390us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:59.352119 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:59.352188 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:59.536313 (+184125us) raft_consensus.cc:1685] finished
0709 12:14:59.536403 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:59.536814 (+   411us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":933,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":12570,"thread_start_us":689089,"threads_started":1,"wal-append.queue_time_us":833112}
I20260709 12:14:59.544100  5122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40402 (request call id 2479) took 1045 ms. Trace:
I20260709 12:14:59.544521  5088 leader_election.cc:400] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 election: Vote denied by peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455) with higher term. Message: Invalid argument: T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 11. Current term is 12.
I20260709 12:14:59.547981  5088 leader_election.cc:304] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:59.549724  5122 rpcz_store.cc:276] 0709 12:14:58.498397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:58.573053 (+ 74656us) service_pool.cc:224] Handling call
0709 12:14:58.575274 (+  2221us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:58.576965 (+  1691us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:58.576996 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:58.577591 (+   595us) log.cc:844] Serialized 52 byte log entry
0709 12:14:58.823344 (+245753us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:58.823391 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:58.823476 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:59.543470 (+719994us) raft_consensus.cc:1685] finished
0709 12:14:59.543522 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:59.543892 (+   370us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":651,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"thread_start_us":245326,"threads_started":1,"wal-append.queue_time_us":299131}
I20260709 12:14:59.466804  5266 rpcz_store.cc:276] 0709 12:14:57.947612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:58.498260 (+550648us) service_pool.cc:224] Handling call
0709 12:14:58.498650 (+   390us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:58.535690 (+ 37040us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:58.535718 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:58.544591 (+  8873us) log.cc:844] Serialized 52 byte log entry
0709 12:14:58.803822 (+259231us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:58.816416 (+ 12594us) log.cc:844] Serialized 14 byte log entry
0709 12:14:58.818193 (+  1777us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:58.818278 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:59.466057 (+647779us) raft_consensus.cc:1685] finished
0709 12:14:59.466080 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:59.466253 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36355,"prepare.queue_time_us":26747,"raft.queue_time_us":38789,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":7241,"spinlock_wait_cycles":6470400,"thread_start_us":149188,"threads_started":1,"wal-append.queue_time_us":313448}
I20260709 12:14:59.465780  9211 raft_consensus.cc:515] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:59.596444  5088 leader_election.cc:304] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:59.629640  9505 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:59.630846  9505 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:59.633697  9442 raft_consensus.cc:493] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:59.634884  9442 raft_consensus.cc:515] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:14:59.645452  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:59.648276  9498 raft_consensus.cc:2749] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:14:59.655077  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 472252us
I20260709 12:14:59.660400  9643 consensus_queue.cc:1059] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:59.661823  9643 consensus_queue.cc:1243] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer bce73265e27d4b30a4dcc1e491305088 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:14:59.662752  9633 raft_consensus.cc:3055] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:14:59.663316  9633 raft_consensus.cc:740] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:14:59.665669  9633 consensus_queue.cc:260] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:59.666955  9211 leader_election.cc:290] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:59.669988  9505 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:59.671624  5123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40402 (request call id 2478) took 1173 ms. Trace:
I20260709 12:14:59.677090  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:59.678416  5199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47744 (request call id 2324) took 1034 ms. Trace:
I20260709 12:14:59.678947  5199 rpcz_store.cc:276] 0709 12:14:58.644342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:59.676418 (+1032076us) service_pool.cc:224] Handling call
0709 12:14:59.678311 (+  1893us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:14:59.678294  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:59.680022  5192 raft_consensus.cc:3060] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:59.682372  5801 leader_election.cc:304] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:59.677155  5120 raft_consensus.cc:1275] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:14:59.627771  9554 raft_consensus.cc:2749] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:59.691126  9640 raft_consensus.cc:2749] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:14:59.694365  9640 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:59.694496  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:59.695729  5200 raft_consensus.cc:2393] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 9: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:14:59.695353  9640 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:59.697067  9641 raft_consensus.cc:493] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:59.698199  9641 raft_consensus.cc:515] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:59.699720  9640 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:59.704504  5200 raft_consensus.cc:1240] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 9. Current term is 10. Ops: []
I20260709 12:14:59.705914  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:59.716566  9613 log.cc:927] Time spent T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.614s	user 0.003s	sys 0.000s
I20260709 12:14:59.719966  9538 consensus_queue.cc:1048] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:14:59.720741  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:14:59.701296  9641 leader_election.cc:290] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:59.736085  5265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34672 (request call id 2249) took 1843 ms. Trace:
I20260709 12:14:59.738305  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:59.740430  9584 raft_consensus.cc:493] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:59.741636  5196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47728 (request call id 2323) took 1098 ms. Trace:
I20260709 12:14:59.741221  9584 raft_consensus.cc:515] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:14:59.747464  5121 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Advancing to term 12
W20260709 12:14:59.747673  9645 log.cc:927] Time spent T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.117s	user 0.000s	sys 0.002s
I20260709 12:14:59.755662  9584 leader_election.cc:290] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:59.759526  5089 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:14:59.760726  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:59.762338  9442 leader_election.cc:290] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:59.762717  5193 raft_consensus.cc:1275] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:14:59.737808  5265 rpcz_store.cc:276] 0709 12:14:57.892089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:58.111341 (+219252us) service_pool.cc:224] Handling call
0709 12:14:58.167275 (+ 55934us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:58.184065 (+ 16790us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:14:58.191745 (+  7680us) log.cc:844] Serialized 14 byte log entry
0709 12:14:58.491099 (+299354us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b1800205540. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3ab8e07 00007f84ec9139a9 00007f84e3ad569b 00007f84e3ad393f 00007f84e3ad5c02 00007f84e675d20b 00007f84e6762d23 00007f84e676323a 00007f84e6bcda2a
0709 12:14:58.606778 (+115679us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b1800205540. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3ad6522 00007f84e3ad87c1 00007f84e3ad8779 00007f84e3ad8709 00007f84e3ad86d1 00007f84e3ad79cd 0000000000388634 0000000000388479 00007f84e3ab983a
0709 12:14:58.644451 (+ 37673us) log.cc:844] Serialized 14 byte log entry
0709 12:14:58.646817 (+  2366us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:58.652097 (+  5280us) log.cc:844] Serialized 26 byte log entry
0709 12:14:58.652242 (+   145us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:58.652275 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:58.652341 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:59.709479 (+1057138us) spinlock_profiling.cc:243] Waited 3.34 ms on lock 0x7b1800205540. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3ad63f3 00007f84e3ad87c1 00007f84e3ad8779 00007f84e3ad8709 00007f84e3ad86d1 00007f84e3ad79cd 0000000000388634 0000000000388479 00007f84e3ab983a
0709 12:14:59.722307 (+ 12828us) raft_consensus.cc:1685] finished
0709 12:14:59.722326 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:59.735120 (+ 12794us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":92220,"prepare.queue_time_us":90755,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":7664,"raft.queue_time_us":18351,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":35091,"spinlock_wait_cycles":94341120,"thread_start_us":76482,"threads_started":1,"wal-append.queue_time_us":472859}
I20260709 12:14:59.674034  5123 rpcz_store.cc:276] 0709 12:14:58.498138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:58.570877 (+ 72739us) service_pool.cc:224] Handling call
0709 12:14:58.571177 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:58.571412 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:14:58.822854 (+251442us) log.cc:844] Serialized 14 byte log entry
0709 12:14:59.670867 (+848013us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:59.671000 (+   133us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:14:59.671123 (+   123us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:59.671230 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:59.671391 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":22602,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":165040,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"thread_start_us":1069976,"threads_started":3,"wal-append.queue_time_us":645520}
I20260709 12:14:59.766108  9633 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:59.773242  9583 raft_consensus.cc:2804] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:14:59.773828  9583 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:59.774397  9583 raft_consensus.cc:3060] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:14:59.776088  9369 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:14:59.783599  5119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40402 (request call id 2480) took 1282 ms. Trace:
I20260709 12:14:59.786208  5199 raft_consensus.cc:2468] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 7.
W20260709 12:14:59.793213  9611 log.cc:927] Time spent T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.620s	user 0.000s	sys 0.003s
I20260709 12:14:59.784137  5119 rpcz_store.cc:276] 0709 12:14:58.498662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:58.576196 (+ 77534us) service_pool.cc:224] Handling call
0709 12:14:58.578378 (+  2182us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:14:58.580133 (+  1755us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:14:58.580167 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:14:58.580637 (+   470us) log.cc:844] Serialized 26 byte log entry
0709 12:14:58.826980 (+246343us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:14:58.827020 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:58.827086 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:59.715549 (+888463us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e675e86e 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221 00007f84e67671d9 00007f84e6767169
0709 12:14:59.778414 (+ 62865us) raft_consensus.cc:1685] finished
0709 12:14:59.778476 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:59.781179 (+  2703us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1194,"raft.run_cpu_time_us":68,"raft.run_wall_time_us":70,"spinlock_wait_cycles":311537920,"thread_start_us":245951,"threads_started":1,"wal-append.queue_time_us":272075}
W20260709 12:14:59.798230  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 243103us
I20260709 12:14:59.837903  5088 leader_election.cc:304] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:59.840245  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:14:59.839736  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:14:59.824864  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 65581.2us
I20260709 12:14:59.840906  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:59.843068  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:59.840696  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
W20260709 12:14:59.856648  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 43622.2us
I20260709 12:14:59.860481  5164 leader_election.cc:304] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:14:59.861474  5194 raft_consensus.cc:1275] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:14:59.862063  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:59.863351  5123 raft_consensus.cc:2410] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:14:59.864387  5088 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:59.867549  9498 raft_consensus.cc:2749] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:14:59.889621  5121 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 12.
I20260709 12:14:59.893754  9135 raft_consensus.cc:2749] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:59.904839  9621 raft_consensus.cc:2804] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:14:59.906838  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 46827.9us
I20260709 12:14:59.907984  5164 leader_election.cc:304] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:14:59.909129  5271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34672 (request call id 2250) took 2015 ms. Trace:
I20260709 12:14:59.909600  5271 rpcz_store.cc:276] 0709 12:14:57.893573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:58.489194 (+595621us) service_pool.cc:224] Handling call
0709 12:14:58.489521 (+   327us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:14:58.525477 (+ 35956us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:14:58.525513 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:14:58.534754 (+  9241us) log.cc:844] Serialized 52 byte log entry
0709 12:14:58.805193 (+270439us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:14:58.828383 (+ 23190us) log.cc:844] Serialized 14 byte log entry
0709 12:14:58.836056 (+  7673us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:58.836139 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:14:59.792174 (+956035us) spinlock_profiling.cc:243] Waited 60.3 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e675e86e 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221 00007f84e67671d9 00007f84e6767169
0709 12:14:59.899870 (+107696us) raft_consensus.cc:1685] finished
0709 12:14:59.908695 (+  8825us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:59.908964 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33281,"prepare.queue_time_us":672674,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":46200,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":5492,"spinlock_wait_cycles":138802048,"thread_start_us":257123,"threads_started":1,"wal-append.queue_time_us":313276}
I20260709 12:14:59.915019  5163 leader_election.cc:304] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:14:59.742012  5196 rpcz_store.cc:276] 0709 12:14:58.642789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:59.664766 (+1021977us) service_pool.cc:224] Handling call
0709 12:14:59.665669 (+   903us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:59.666247 (+   578us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:14:59.666698 (+   451us) log.cc:844] Serialized 14 byte log entry
0709 12:14:59.741111 (+ 74413us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:14:59.741173 (+    62us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:14:59.741237 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:59.741303 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:14:59.741457 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7086,"prepare.queue_time_us":7337,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":104,"raft.queue_time_us":10156,"thread_start_us":66753,"threads_started":1}
I20260709 12:14:59.917623  9364 raft_consensus.cc:2749] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:14:59.917671  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 53545.4us
I20260709 12:14:59.922181  5088 leader_election.cc:304] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:59.924002  5088 leader_election.cc:304] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:59.925089  9400 raft_consensus.cc:2749] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:14:59.884809  9442 raft_consensus.cc:493] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:14:59.925907  9442 raft_consensus.cc:515] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:59.899613  9584 raft_consensus.cc:493] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:59.928042  9584 raft_consensus.cc:515] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:59.928402  9442 leader_election.cc:290] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:59.930442  9584 leader_election.cc:290] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:59.931813  9498 raft_consensus.cc:2749] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:14:59.921039  9269 consensus_meta.cc:287] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 1.104s	user 0.012s	sys 0.008s
I20260709 12:14:59.934787  9621 raft_consensus.cc:493] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:59.948007  5191 raft_consensus.cc:1275] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:14:59.950788  5088 leader_election.cc:304] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:14:59.954056  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 47307.3us
I20260709 12:14:59.955372  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:59.957351  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:14:59.958153  5801 leader_election.cc:304] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:14:59.957175  9400 raft_consensus.cc:2749] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:14:59.957985  9366 raft_consensus.cc:493] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:59.959869  9366 raft_consensus.cc:515] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:59.961680  9484 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:59.962311  9545 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:14:59.963028  9366 leader_election.cc:290] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:14:59.963034  9545 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:59.966288  9545 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:14:59.967821  9119 raft_consensus.cc:2749] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:14:59.968441  9583 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:59.970639  9526 raft_consensus.cc:493] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:59.970929  9119 raft_consensus.cc:493] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:59.971424  9526 raft_consensus.cc:515] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:59.971829  9119 raft_consensus.cc:515] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:59.959302  5118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59390 (request call id 827) took 4446 ms. Trace:
I20260709 12:14:59.974651  9635 raft_consensus.cc:493] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:59.975477  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:14:59.975275  9635 raft_consensus.cc:515] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:14:59.977491  5125 raft_consensus.cc:1240] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 11. Current term is 12. Ops: []
I20260709 12:14:59.977860  9349 leader_election.cc:290] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:14:59.979080  9649 log.cc:927] Time spent T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.116s	user 0.000s	sys 0.003s
W20260709 12:14:59.979385  9646 log.cc:927] Time spent T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.346s	user 0.002s	sys 0.000s
I20260709 12:14:59.958493  9267 raft_consensus.cc:493] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:59.980983  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:14:59.972892  5118 rpcz_store.cc:276] 0709 12:14:55.512647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:55.812843 (+300196us) service_pool.cc:224] Handling call
0709 12:14:55.813216 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:14:58.234306 (+2421090us) spinlock_profiling.cc:243] Waited 41.9 ms on lock 0x7b54002ac4a0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6b4106f 00007f84e6bb9f60 00007f84e6bbb7de 00007f84e6bc5b49 00007f84e6bc6416 00007f84e6bc2d8f 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62
0709 12:14:58.487962 (+253656us) spinlock_profiling.cc:243] Waited 4.7 ms on lock 0x7b58006593d0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6b1f0aa 00007f84e6ba1447 00007f84e6bb9fe7 00007f84e6bbb7de 00007f84e6bc5b49 00007f84e6bc6416 00007f84e6bc2d8f 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4
0709 12:14:59.321455 (+833493us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b58007fbed0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6b1f0aa 00007f84e6ba1447 00007f84e6bb9fe7 00007f84e6bbb7de 00007f84e6bc5b49 00007f84e6bc6416 00007f84e6bc2d8f 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4
0709 12:14:59.413545 (+ 92090us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:14:59.958833 (+545288us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b54003fd9d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:14:59.959097 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3622077312}
I20260709 12:14:59.949779  9621 raft_consensus.cc:3060] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:14:59.946172  9641 raft_consensus.cc:493] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:14:59.999974  9641 raft_consensus.cc:515] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:00.000797  9463 leader_election.cc:290] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:00.001926  9583 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:00.003693  9602 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:00.004396  9602 raft_consensus.cc:3060] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:00.005705  5196 raft_consensus.cc:1275] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:15:00.005873  9635 leader_election.cc:290] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:00.007565  9569 raft_consensus.cc:3060] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:14:59.991261  9267 raft_consensus.cc:515] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:00.011091  9267 leader_election.cc:290] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:00.012154  9538 raft_consensus.cc:493] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:14:59.955271  9269 raft_consensus.cc:515] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:00.012828  9538 raft_consensus.cc:515] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:00.013324  5829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46100 (request call id 1182) took 1381 ms. Trace:
I20260709 12:15:00.013779  5829 rpcz_store.cc:276] 0709 12:14:58.631369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:58.632817 (+  1448us) service_pool.cc:224] Handling call
0709 12:15:00.012852 (+1380035us) spinlock_profiling.cc:243] Waited 843 ms on lock 0x7b540043e9d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:15:00.013082 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1938380672}
I20260709 12:15:00.015367  9366 consensus_queue.cc:1048] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:15:00.016412  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:00.021010  5192 raft_consensus.cc:2468] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 10.
I20260709 12:15:00.023461  5120 raft_consensus.cc:1240] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:15:00.032218  5192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41416 (request call id 817) took 1367 ms. Trace:
I20260709 12:15:00.038754  5199 raft_consensus.cc:2393] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 12: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:15:00.033398  5192 rpcz_store.cc:276] 0709 12:14:58.655966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:59.677674 (+1021708us) service_pool.cc:224] Handling call
0709 12:15:00.023150 (+345476us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:15:00.038430  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 147456us
I20260709 12:15:00.014535  9269 leader_election.cc:290] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:00.039345  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:00.024447  9584 raft_consensus.cc:2764] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:15:00.045312  9526 leader_election.cc:290] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:00.015378  9538 leader_election.cc:290] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:00.046967  9267 consensus_queue.cc:1048] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:15:00.049531  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:00.050899  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:00.046362  5801 leader_election.cc:304] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:00.064546  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:00.069119  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:00.069662  9641 leader_election.cc:290] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:00.069972  5265 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:00.071899  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:00.072789  5116 raft_consensus.cc:2393] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 12: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
W20260709 12:15:00.074368  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 166650us
I20260709 12:15:00.073747  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:00.075752  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:15:00.077621  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 127078us
I20260709 12:15:00.081786  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:00.084769  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:00.085018  5801 leader_election.cc:304] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:00.088810  5116 raft_consensus.cc:2410] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:15:00.090010  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:00.094393  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:00.096978  9625 raft_consensus.cc:2804] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:00.098342  5088 leader_election.cc:304] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:00.099402  9633 raft_consensus.cc:2749] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:00.099920  9625 raft_consensus.cc:697] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 10 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:15:00.101030  9625 consensus_queue.cc:237] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:00.099943  5088 leader_election.cc:304] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:00.105279  9633 raft_consensus.cc:2749] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:00.099730  9652 raft_consensus.cc:2749] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:15:00.104102  9602 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:00.119932  5266 raft_consensus.cc:1275] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:15:00.121408  5088 leader_election.cc:304] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:00.123333  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:00.130106  5801 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:00.142030  9637 raft_consensus.cc:2749] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:00.147632  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:00.132230  9269 raft_consensus.cc:2749] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:00.184855  5801 leader_election.cc:304] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:00.128031  9384 raft_consensus.cc:493] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:00.192808  5271 raft_consensus.cc:3060] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Advancing to term 10
W20260709 12:15:00.195071  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 80775.6us
I20260709 12:15:00.196455  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:00.197408  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:00.193871  5265 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 12.
I20260709 12:15:00.202746  5164 leader_election.cc:304] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:15:00.195688  9538 raft_consensus.cc:493] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:00.194860  9349 raft_consensus.cc:493] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:00.204954  9635 raft_consensus.cc:493] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:00.221361  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:00.221602  9347 raft_consensus.cc:493] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:00.214432  9526 raft_consensus.cc:493] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
W20260709 12:15:00.222527  9468 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.920s	user 0.021s	sys 0.043s
W20260709 12:15:00.222949  9468 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.009s	user 0.021s	sys 0.043s
I20260709 12:15:00.215626  9364 raft_consensus.cc:2804] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:00.223456  9364 raft_consensus.cc:493] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:00.223800  9364 raft_consensus.cc:3060] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:00.224014  9484 consensus_queue.cc:1048] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:15:00.229430  9620 consensus_queue.cc:1048] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.091s
I20260709 12:15:00.236616  9286 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:00.215204  9631 raft_consensus.cc:2749] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:00.211126  9641 raft_consensus.cc:493] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:00.205899  9545 raft_consensus.cc:493] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:00.212431  9269 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
W20260709 12:15:00.244073  5091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:00.245715  9523 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:00.246493  9523 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:00.222997  9526 raft_consensus.cc:515] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:00.249011  9523 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:00.242472  9543 raft_consensus.cc:493] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
W20260709 12:15:00.258487  5237 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.212.130:44455 timed out after 1.781s (SENT) [suppressed 14 similar messages]
I20260709 12:15:00.259673  9543 raft_consensus.cc:515] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:00.239722  9602 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:00.266881  9639 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
W20260709 12:15:00.271124  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:00.240434  9349 raft_consensus.cc:515] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:00.274224  9349 leader_election.cc:290] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:00.237159  9475 raft_consensus.cc:493] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:00.277846  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:00.279574  9633 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:00.255143  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:00.287405  9286 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:00.290830  9583 consensus_queue.cc:1048] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:15:00.243300  9119 leader_election.cc:290] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:00.214546  9384 raft_consensus.cc:515] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:00.222436  9347 raft_consensus.cc:515] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:00.335511  9477 raft_consensus.cc:493] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:00.297318  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:00.255831  9538 raft_consensus.cc:515] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:00.339810  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:00.270993  9639 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:00.346019  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 180306us
I20260709 12:15:00.347548  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:00.347764  9384 leader_election.cc:290] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:00.336236  9477 raft_consensus.cc:515] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:00.353013  9526 leader_election.cc:290] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:00.355850  9475 raft_consensus.cc:515] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:00.297300  9633 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:00.324627  9286 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:00.364871  5271 raft_consensus.cc:2468] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 10.
I20260709 12:15:00.365485  9442 raft_consensus.cc:493] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:00.367127  9543 leader_election.cc:290] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:00.368916  9347 leader_election.cc:290] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:00.296994  9631 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:00.399143  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 56875.8us
I20260709 12:15:00.398834  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:00.277894  9641 raft_consensus.cc:515] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:00.419623  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:00.420338  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:00.297158  9545 raft_consensus.cc:515] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:00.293151  9269 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:00.426249  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 167938us
I20260709 12:15:00.286252  9635 raft_consensus.cc:515] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:00.370901  9364 raft_consensus.cc:515] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:00.441717  5116 raft_consensus.cc:3060] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:00.443388  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:00.444095  5192 raft_consensus.cc:2468] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 9.
I20260709 12:15:00.445988  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:00.446184  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:00.450235  5122 raft_consensus.cc:1275] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 12:15:00.450978  5122 pending_rounds.cc:85] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting all ops after (but not including) 10
I20260709 12:15:00.450311  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:00.451226  5122 pending_rounds.cc:107] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 12:15:00.458442  5122 raft_consensus.cc:2889] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:00.459131  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:00.460655  5196 raft_consensus.cc:2393] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 11: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:15:00.466135  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:00.467967  9364 leader_election.cc:290] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:00.468578  9639 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:00.470074  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:00.481810  5200 raft_consensus.cc:2468] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 11.
I20260709 12:15:00.486701  9475 leader_election.cc:290] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:00.454108  9662 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:00.488065  5194 raft_consensus.cc:2468] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 9.
I20260709 12:15:00.497430  9641 leader_election.cc:290] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:00.504328  9662 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:00.506673  9584 consensus_queue.cc:1059] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:15:00.511662  9549 raft_consensus.cc:3055] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:00.512089  9549 raft_consensus.cc:740] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:00.454871  9442 raft_consensus.cc:515] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:00.513008  5116 raft_consensus.cc:2468] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 14.
I20260709 12:15:00.516207  9442 leader_election.cc:290] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:00.500509  5164 leader_election.cc:304] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:00.519814  9523 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:00.520438  9523 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:00.499554  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:00.506949  9662 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:00.513072  9549 consensus_queue.cc:260] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:00.503546  9269 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:00.530229  5164 leader_election.cc:304] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:00.528818  9636 raft_consensus.cc:2749] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:00.457355  9631 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:00.532090  9349 raft_consensus.cc:493] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:00.540771  5271 raft_consensus.cc:1240] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:00.524300  9523 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:00.536435  9364 raft_consensus.cc:2749] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:00.548616  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
W20260709 12:15:00.543187  9621 consensus_meta.cc:287] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.510s	user 0.006s	sys 0.005s
I20260709 12:15:00.556849  5164 leader_election.cc:304] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:00.559060  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:00.568241  9538 leader_election.cc:290] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:00.569478  9667 raft_consensus.cc:493] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:00.570101  9549 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:00.570796  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:00.573477  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:00.576930  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:00.583752  5088 leader_election.cc:304] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:00.596478  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:00.543723  9665 raft_consensus.cc:493] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:00.605119  5240 leader_election.cc:304] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:15:00.613526  9523 raft_consensus.cc:2749] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:00.633669  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:00.641232  9468 raft_consensus.cc:2804] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:00.641804  9468 raft_consensus.cc:493] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:00.642234  9468 raft_consensus.cc:3060] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:15:00.646236  9661 log.cc:927] Time spent T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.246s	user 0.002s	sys 0.000s
I20260709 12:15:00.651309  9477 leader_election.cc:290] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:00.652971  9631 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:00.546615  9369 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:00.655217  9369 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:00.667580  5271 raft_consensus.cc:2393] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 12: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:15:00.671214  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:15:00.689594  5091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:00.704474  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 99421.2us
I20260709 12:15:00.708812  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:00.664661  9633 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:00.719491  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:00.726276  5801 leader_election.cc:304] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:00.603014  9621 raft_consensus.cc:515] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:00.605330  9349 raft_consensus.cc:515] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:00.712893  9477 raft_consensus.cc:2804] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:00.741818  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:15:00.769606  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 212897us
I20260709 12:15:00.771705  5801 leader_election.cc:304] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:00.773223  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:00.775703  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:00.777107  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:15:00.777681  9655 log.cc:927] Time spent T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.262s	user 0.000s	sys 0.001s
I20260709 12:15:00.777968  5831 raft_consensus.cc:2368] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 9. Current term is 10.
I20260709 12:15:00.778590  9545 leader_election.cc:290] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:15:00.779125  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 79965.5us
I20260709 12:15:00.770779  9631 raft_consensus.cc:2804] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:00.781176  9631 raft_consensus.cc:493] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:00.781629  9631 raft_consensus.cc:3060] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:00.702759  9665 raft_consensus.cc:515] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:00.785985  5117 raft_consensus.cc:1275] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:15:00.787673  9665 leader_election.cc:290] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:00.730360  9667 raft_consensus.cc:515] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:00.788910  9635 leader_election.cc:290] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:00.791501  5268 raft_consensus.cc:1217] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Deduplicated request from leader. Original: 8.9->[10.10-10.10]   Dedup: 10.10->[]
I20260709 12:15:00.792050  5268 raft_consensus.cc:1240] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:15:00.792906  5195 raft_consensus.cc:2393] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 10: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:15:00.744120  9369 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:00.808079  5801 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:00.816607  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:00.818614  5164 leader_election.cc:304] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:00.820578  5164 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:00.821565  9505 raft_consensus.cc:2749] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:00.791014  9477 raft_consensus.cc:697] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 14 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:00.822800  9505 raft_consensus.cc:2749] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:15:00.823557  9477 consensus_queue.cc:237] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:00.824136  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:00.817575  9635 raft_consensus.cc:3060] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:00.826808  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:00.828439  9349 leader_election.cc:290] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:00.830745  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:00.831525  9667 leader_election.cc:290] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:00.840758  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:00.842255  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:00.843400  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:00.844488  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:00.844933  9635 raft_consensus.cc:2749] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:00.845819  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:00.847121  9641 raft_consensus.cc:2804] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:00.848392  5801 leader_election.cc:304] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:00.855278  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:00.858916  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:00.863348  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:00.864235  5801 leader_election.cc:304] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
W20260709 12:15:00.860971  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 133144us
I20260709 12:15:00.836915  9621 leader_election.cc:290] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:00.873584  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:00.894682  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:15:00.897773  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 77343.6us
I20260709 12:15:00.901579  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:00.887550  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:00.870553  9269 raft_consensus.cc:2749] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:00.918855  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:00.919631  5192 raft_consensus.cc:2468] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 14.
I20260709 12:15:00.921283  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:00.922758  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:15:00.950958  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:00.888765  9620 raft_consensus.cc:2804] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:00.951911  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:15:00.952445  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 48634.7us
W20260709 12:15:00.951562  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 170593us
I20260709 12:15:00.950938  9267 raft_consensus.cc:493] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:00.959956  9267 raft_consensus.cc:515] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:00.962299  9267 leader_election.cc:290] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:00.964145  5274 raft_consensus.cc:1240] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 10. Current term is 11. Ops: []
W20260709 12:15:00.966965  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 61601us
I20260709 12:15:00.968953  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
W20260709 12:15:00.971562  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 50833.5us
I20260709 12:15:00.917698  9641 raft_consensus.cc:697] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 12 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:15:00.978113  5198 raft_consensus.cc:2393] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 10: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:15:00.970943  5804 leader_election.cc:304] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:00.982986  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:00.984190  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:00.985010  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:00.988842  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:00.989817  5193 raft_consensus.cc:2410] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
W20260709 12:15:00.979353  9658 log.cc:927] Time spent T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:15:00.990913  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:00.991524  5804 leader_election.cc:304] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:00.994800  5804 leader_election.cc:304] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:00.992672  5269 raft_consensus.cc:2468] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 12.
I20260709 12:15:00.996120  5268 raft_consensus.cc:1240] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 14 LEADER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:01.003145  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:01.007213  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:01.008659  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:00.979897  9620 raft_consensus.cc:697] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 10 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:15:01.016669  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:00.995386  9269 raft_consensus.cc:2749] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:01.005916  9484 raft_consensus.cc:2749] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:01.017699  9620 consensus_queue.cc:237] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:01.020246  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:01.009498  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:01.011077  9674 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:01.011457  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:01.028594  5273 raft_consensus.cc:2393] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 12: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:15:01.011862  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:01.013236  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:01.009156  5197 raft_consensus.cc:2376] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 11. Re-sending same reply.
I20260709 12:15:01.023595  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:01.039109  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:01.042593  5088 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:01.048583  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:00.984819  9676 consensus_queue.cc:1059] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 12:15:01.068066  5804 leader_election.cc:304] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:01.069743  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:01.069968  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:01.043913  9683 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:01.072942  5272 raft_consensus.cc:2393] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 10: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:15:01.073128  5804 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:01.089951  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:01.090842  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:01.092607  5163 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:01.093864  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:01.084059  9683 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:01.044344  9119 consensus_queue.cc:1048] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 12:15:01.072640  9526 consensus_queue.cc:1048] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:15:01.110147  5804 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:01.111439  5804 leader_election.cc:304] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:01.084240  9633 raft_consensus.cc:2749] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:01.114235  5119 raft_consensus.cc:1240] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:01.114351  5163 leader_election.cc:304] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:01.053910  9347 consensus_queue.cc:1048] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:15:01.099511  9526 consensus_queue.cc:1243] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer ad2f9a1e2f7a45429fa69fd23d09f821 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:15:01.037184  9674 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:01.126856  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:01.118615  9620 raft_consensus.cc:2749] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:01.116976  9484 raft_consensus.cc:2749] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:01.118432  9267 raft_consensus.cc:2749] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:01.118799  9621 raft_consensus.cc:2749] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:01.119381  9662 raft_consensus.cc:2749] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:01.155769  5120 raft_consensus.cc:2468] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 12.
I20260709 12:15:01.158339  5163 leader_election.cc:304] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:01.164409  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:01.165040  5831 raft_consensus.cc:3060] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:01.166563  5163 leader_election.cc:304] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:01.151678  9678 raft_consensus.cc:2749] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:15:01.170593  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 128114us
I20260709 12:15:01.173419  5088 leader_election.cc:304] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:01.178843  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:15:01.171955  9680 log.cc:927] Time spent T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 12:15:01.217046  9545 raft_consensus.cc:3055] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:01.217528  9545 raft_consensus.cc:740] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:01.218578  9545 consensus_queue.cc:260] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:01.218977  9631 raft_consensus.cc:515] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:01.219894  9545 raft_consensus.cc:3060] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:15:01.199837  9671 log.cc:927] Time spent T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.218s	user 0.002s	sys 0.000s
I20260709 12:15:01.179340  9527 raft_consensus.cc:2749] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:01.201249  9674 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:01.180003  9644 raft_consensus.cc:493] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
W20260709 12:15:01.202050  9468 consensus_meta.cc:287] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.559s	user 0.005s	sys 0.007s
I20260709 12:15:01.202739  9683 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:01.170099  9602 consensus_queue.cc:1048] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 12:15:01.092355  9641 consensus_queue.cc:237] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:01.202996  9679 log.cc:927] Time spent T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:15:01.169891  9523 consensus_queue.cc:1059] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 12:15:01.204262  5163 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
W20260709 12:15:01.204761  9684 log.cc:927] Time spent T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:15:01.206084  9569 consensus_queue.cc:1059] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:15:01.152760  9549 consensus_queue.cc:1059] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 12:15:01.168666  9364 raft_consensus.cc:2749] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:01.210528  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:01.169523  9636 raft_consensus.cc:2749] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:15:01.203927  9682 log.cc:927] Time spent T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 12:15:01.212742  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:15:01.294677  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 144156us
I20260709 12:15:01.203883  5194 raft_consensus.cc:1275] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:15:01.251659  5198 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 12.
I20260709 12:15:01.225308  5271 raft_consensus.cc:1275] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:15:01.221864  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 48542.5us
W20260709 12:15:01.221827  5195 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41416 (request call id 833) took 1202 ms (client timeout 1575 ms). Trace:
I20260709 12:15:01.266158  5831 raft_consensus.cc:2468] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 12.
I20260709 12:15:01.222168  9690 raft_consensus.cc:2749] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:01.285527  5238 leader_election.cc:400] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Vote denied by peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539) with higher term. Message: Invalid argument: T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 9. Current term is 10.
I20260709 12:15:01.221290  9631 leader_election.cc:290] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:01.286206  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:01.265516  9468 raft_consensus.cc:515] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:01.290874  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:01.264904  9484 raft_consensus.cc:493] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
W20260709 12:15:01.204293  9681 log.cc:927] Time spent T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
W20260709 12:15:01.296830  5195 rpcz_store.cc:269] 0709 12:15:00.019343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:00.029028 (+  9685us) service_pool.cc:224] Handling call
0709 12:15:01.221612 (+1192584us) spinlock_profiling.cc:243] Waited 728 ms on lock 0x7b5400364054. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:15:01.221742 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1673628928}
I20260709 12:15:01.298789  5238 leader_election.cc:403] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:01.299134  5119 raft_consensus.cc:1217] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Deduplicated request from leader. Original: 3.4->[6.5-11.7]   Dedup: 6.5->[9.6-11.7]
I20260709 12:15:01.306236  5119 pending_rounds.cc:85] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting all ops after (but not including) 5
I20260709 12:15:01.306545  5119 pending_rounds.cc:107] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:15:01.306772  5119 raft_consensus.cc:2889] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:15:01.303659  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 187741us
I20260709 12:15:01.317423  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:01.318192  5832 raft_consensus.cc:2468] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 13.
I20260709 12:15:01.319607  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:01.320806  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:01.322302  9693 raft_consensus.cc:2749] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539) with higher term. Message: Invalid argument: T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 9. Current term is 10.
I20260709 12:15:01.323225  5831 raft_consensus.cc:1275] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:15:01.265908  9644 raft_consensus.cc:515] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:01.325579  5117 raft_consensus.cc:1240] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:01.326483  9644 leader_election.cc:290] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:01.327674  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:01.329149  5123 raft_consensus.cc:2468] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 8.
I20260709 12:15:01.329898  9468 leader_election.cc:290] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:15:01.315121  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 68938us
I20260709 12:15:01.333070  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:01.333738  5271 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 11.
I20260709 12:15:01.303278  9505 raft_consensus.cc:3055] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:01.304013  9523 raft_consensus.cc:2804] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:01.324720  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:15:01.352553  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 148373us
I20260709 12:15:01.350502  9523 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:01.354240  9523 raft_consensus.cc:3060] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:01.348209  9505 raft_consensus.cc:740] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:01.358305  9505 consensus_queue.cc:260] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:01.362231  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:01.362990  5836 raft_consensus.cc:2468] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 8.
I20260709 12:15:01.363039  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:01.363957  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:01.364660  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:01.365092  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:01.365711  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:01.366007  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:01.366680  5830 raft_consensus.cc:1240] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:01.367291  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:01.368266  5836 raft_consensus.cc:1240] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:01.368824  9700 raft_consensus.cc:3055] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:01.369226  9700 raft_consensus.cc:740] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:01.370234  9700 consensus_queue.cc:260] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:01.371691  9700 raft_consensus.cc:3060] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:15:01.373947  5240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:01.365929  5835 raft_consensus.cc:2410] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:15:01.376199  5837 raft_consensus.cc:2468] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 12.
I20260709 12:15:01.383399  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:01.384296  5265 raft_consensus.cc:2468] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 12.
I20260709 12:15:01.385867  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:01.387640  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:01.388863  9384 consensus_queue.cc:1059] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:15:01.389710  9384 consensus_queue.cc:1243] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Peer 9e794b72ed7640219f90ec4232363929 log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:15:01.391425  5088 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:15:01.392226  9674 raft_consensus.cc:2804] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:01.392625  9674 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:01.392957  9674 raft_consensus.cc:3060] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:01.402987  5829 raft_consensus.cc:1240] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:01.312100  9484 raft_consensus.cc:515] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:01.405575  9484 leader_election.cc:290] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:01.407639  9523 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:01.413542  5237 leader_election.cc:304] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:01.414392  9667 raft_consensus.cc:2749] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:01.419159  5237 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:01.425730  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:01.426268  9523 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:01.426965  9697 raft_consensus.cc:2749] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:01.427979  5237 leader_election.cc:304] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:01.429697  9697 raft_consensus.cc:2749] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:01.429800  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:01.431219  5237 leader_election.cc:304] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:01.432541  5237 leader_election.cc:304] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:01.436034  9697 raft_consensus.cc:2749] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:01.436702  9701 raft_consensus.cc:2749] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:15:01.439182  5237 leader_election.cc:304] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:01.441804  5237 leader_election.cc:304] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:01.442587  9697 raft_consensus.cc:2749] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:01.443353  9697 raft_consensus.cc:2749] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:01.444959  5237 leader_election.cc:304] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:01.445719  9697 raft_consensus.cc:2749] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:01.446633  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:01.447016  5237 leader_election.cc:304] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:01.448364  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:01.448884  5237 leader_election.cc:304] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:01.449488  9602 raft_consensus.cc:2749] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:01.449689  9697 raft_consensus.cc:2749] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:15:01.451548  5165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:01.451735  9505 raft_consensus.cc:3060] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:01.452690  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:00.780604  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:01.456377  9636 raft_consensus.cc:3055] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:01.456651  5166 leader_election.cc:304] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:15:01.459604  9584 raft_consensus.cc:2804] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:01.459177  5023 catalog_manager.cc:5697] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 9 to 12, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 12 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:01.460005  9584 raft_consensus.cc:493] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:01.460397  9584 raft_consensus.cc:3060] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:01.462769  9545 consensus_queue.cc:1059] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:15:01.464401  9545 raft_consensus.cc:3055] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:01.464790  9545 raft_consensus.cc:740] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:01.465878  5833 raft_consensus.cc:2410] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:15:01.465893  9545 consensus_queue.cc:260] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:01.468235  9636 raft_consensus.cc:740] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:01.468914  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:01.469683  5835 raft_consensus.cc:2393] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 10: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:15:01.469398  9636 consensus_queue.cc:260] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:01.469700  9643 raft_consensus.cc:493] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:01.470429  9643 raft_consensus.cc:515] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:01.470994  9636 raft_consensus.cc:3060] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:01.471140  9545 raft_consensus.cc:3060] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:01.474502  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:15:01.473173  5018 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58198 (request call id 327) took 21942 ms (client timeout 15000 ms). Trace:
I20260709 12:15:01.489890  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:01.491122  5199 raft_consensus.cc:2393] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 13: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
W20260709 12:15:01.479149  5018 rpcz_store.cc:269] 0709 12:14:39.530530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:39.530732 (+   202us) service_pool.cc:224] Handling call
0709 12:15:01.472937 (+21942205us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:14:54.080114 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:14:54.229994 (+149880us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:14:54.230046 (+    52us) write_op.cc:435] Acquired schema lock
0709 12:14:54.230062 (+    16us) tablet.cc:662] Decoding operations
0709 12:14:54.231185 (+  1123us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:14:54.231269 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 12:14:54.231300 (+    31us) tablet.cc:685] Acquiring locks for 12 operations
0709 12:14:54.321887 (+ 90587us) tablet.cc:701] Row locks acquired
0709 12:14:54.333983 (+ 12096us) write_op.cc:260] PREPARE: finished
0709 12:14:54.346658 (+ 12675us) write_op.cc:270] Start()
0709 12:14:54.443397 (+ 96739us) write_op.cc:276] Timestamp: P: 1783599294339358 usec, L: 0
0709 12:14:54.444230 (+   833us) op_driver.cc:348] REPLICATION: starting
0709 12:14:54.577947 (+133717us) log.cc:844] Serialized 4838 byte log entry
0709 12:14:54.777519 (+199572us) spinlock_profiling.cc:243] Waited 6.72 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e3ab90ac 00007f84ec9139a9 00007f84e3ad569b 00007f84e3ad393f 00007f84e3ad5c02 00007f84e675d20b
0709 12:14:55.127192 (+349673us) op_driver.cc:464] REPLICATION: finished
0709 12:14:56.022999 (+895807us) write_op.cc:301] APPLY: starting
0709 12:14:56.023103 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 12:14:56.710440 (+687337us) tablet.cc:1370] finished BulkCheckPresence
0709 12:14:56.710469 (+    29us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:14:57.228722 (+518253us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:14:57.228982 (+   260us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 12:14:57.229029 (+    47us) write_op.cc:312] APPLY: finished
0709 12:14:57.229364 (+   335us) log.cc:844] Serialized 113 byte log entry
0709 12:14:57.487715 (+258351us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:57.515027 (+ 27312us) write_op.cc:454] Released schema lock
0709 12:14:57.525576 (+ 10549us) write_op.cc:341] FINISH: Updating metrics
0709 12:14:57.605090 (+ 79514us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:14:57.609063 (+  3973us) write_op.cc:454] Released schema lock
0709 12:14:57.967410 (+358347us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b1800355540. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3ad63f3 00007f84e3ad87c1 00007f84e3ad8779 00007f84e3ad8709 00007f84e3ad86d1 00007f84e3ad79cd 0000000000388634 0000000000388479 00007f84e3ab983a
Metrics: {"mutex_wait_us":2056821,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":893319,"apply.run_cpu_time_us":45700,"apply.run_wall_time_us":1543835,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54263,"num_ops":12,"prepare.queue_time_us":397915,"prepare.run_cpu_time_us":23543,"prepare.run_wall_time_us":807999,"raft.queue_time_us":179298,"raft.run_cpu_time_us":82595,"raft.run_wall_time_us":458711,"replication_time_us":682559,"spinlock_wait_cycles":50315392,"thread_start_us":1264955,"threads_started":5,"wal-append.queue_time_us":633982,"wal-append.run_cpu_time_us":17623,"wal-append.run_wall_time_us":2161233}]]}
I20260709 12:15:01.459492  5801 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:15:01.376211  5163 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:01.501857  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:01.501194  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
W20260709 12:15:01.505913  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 46487.2us
I20260709 12:15:01.507187  5801 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:01.514371  5198 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 11.
I20260709 12:15:01.511831  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:15:01.518761  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 142591us
I20260709 12:15:01.522769  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:01.523676  5200 raft_consensus.cc:1275] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:15:01.524058  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:01.524753  5196 raft_consensus.cc:3060] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:01.524921  5193 raft_consensus.cc:1275] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:15:01.535667  5834 raft_consensus.cc:1240] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 10. Current term is 11. Ops: []
W20260709 12:15:01.537020  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 88247.1us
I20260709 12:15:01.537211  5238 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:01.538367  9475 raft_consensus.cc:2749] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:01.515473  9640 raft_consensus.cc:2749] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:01.517666  5023 catalog_manager.cc:5697] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 6 to 9, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 9 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:01.551043  5237 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:01.555846  9665 consensus_queue.cc:1048] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:15:01.557644  5164 leader_election.cc:304] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:01.558398  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:01.527104  9621 raft_consensus.cc:2749] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:01.560669  9665 raft_consensus.cc:2804] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:01.561244  9703 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:01.561861  9505 raft_consensus.cc:2749] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:01.581696  9703 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:01.562681  5164 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:01.563973  9641 consensus_queue.cc:1048] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:15:01.584010  9703 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:01.533607  9674 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:01.585412  5117 raft_consensus.cc:2393] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 13: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:15:01.586264  9674 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:01.587024  9665 raft_consensus.cc:697] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 12 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:01.571220  9378 raft_consensus.cc:2804] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:01.588392  9378 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:01.587972  9665 consensus_queue.cc:237] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:01.588975  9378 raft_consensus.cc:3060] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:01.596050  5195 raft_consensus.cc:1275] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:15:01.597870  9621 raft_consensus.cc:2749] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:01.598871  9686 raft_consensus.cc:493] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:01.599496  9686 raft_consensus.cc:515] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:01.602480  9686 leader_election.cc:290] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:01.581250  5196 raft_consensus.cc:2468] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 10.
I20260709 12:15:01.615931  5199 raft_consensus.cc:1240] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:15:01.617904  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:01.618862  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:01.621721  5269 raft_consensus.cc:3060] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:01.624527  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:01.634384  5266 raft_consensus.cc:2393] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 11: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:15:01.634244  5238 leader_election.cc:304] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:01.641068  5238 leader_election.cc:304] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:01.640333  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:01.642474  5023 catalog_manager.cc:5697] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:01.646493  5238 leader_election.cc:304] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:01.644961  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:01.651687  5199 raft_consensus.cc:1275] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:15:01.654528  9643 leader_election.cc:290] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:01.655243  9484 consensus_queue.cc:1048] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:15:01.656844  5274 raft_consensus.cc:1275] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:15:01.645606  9538 raft_consensus.cc:2804] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:01.661130  9538 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:01.661547  9538 raft_consensus.cc:3060] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:01.643551  9676 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:01.661799  5023 catalog_manager.cc:5697] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 3 to 6, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 6 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:01.662701  9676 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:01.654600  9641 consensus_queue.cc:1048] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:15:01.669396  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:01.671161  5088 leader_election.cc:304] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:01.654762  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:01.672133  5123 raft_consensus.cc:1275] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:15:01.664790  5023 catalog_manager.cc:5697] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:01.682142  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:01.649977  9693 raft_consensus.cc:2749] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:01.684051  9693 raft_consensus.cc:2749] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:15:01.684417  5238 leader_election.cc:304] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:01.684675  9693 consensus_queue.cc:1048] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:15:01.685647  5238 leader_election.cc:304] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:01.641110  9584 raft_consensus.cc:515] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:01.686774  5238 leader_election.cc:304] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:01.686730  9477 raft_consensus.cc:2749] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:01.687816  9477 raft_consensus.cc:2804] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:01.688202  9584 leader_election.cc:290] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:01.689580  9676 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:01.688225  9477 raft_consensus.cc:493] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:01.690847  9477 raft_consensus.cc:3060] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:15:01.690388  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 51818.4us
I20260709 12:15:01.695640  5164 leader_election.cc:304] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:01.696900  5164 leader_election.cc:304] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:01.698246  5164 leader_election.cc:304] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:01.701179  5238 leader_election.cc:304] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:01.704427  5269 raft_consensus.cc:2468] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 13.
I20260709 12:15:01.703919  5088 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:01.706836  5164 leader_election.cc:304] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:01.708019  5801 leader_election.cc:304] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:01.709328  9643 raft_consensus.cc:2749] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:15:01.716601  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:01.716809  5238 leader_election.cc:304] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:01.715507  5088 leader_election.cc:304] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:01.718472  5271 raft_consensus.cc:1275] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:15:01.716214  9703 raft_consensus.cc:2749] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:15:01.721268  9602 raft_consensus.cc:2749] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:01.721805  9633 raft_consensus.cc:2804] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:01.722225  5193 raft_consensus.cc:1240] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:01.723333  9635 raft_consensus.cc:2804] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:01.723871  9635 raft_consensus.cc:697] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 10 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:15:01.724833  9635 consensus_queue.cc:237] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:01.726162  9686 raft_consensus.cc:2749] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:01.722235  9633 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:01.727691  9633 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:01.717360  5089 leader_election.cc:304] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:01.685926  9698 raft_consensus.cc:2749] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:01.715610  5023 catalog_manager.cc:5697] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 2 to 7, leader changed from bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 7 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:15:01.737177  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 84568us
I20260709 12:15:01.740095  5238 leader_election.cc:304] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:01.757714  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:01.777477  5196 raft_consensus.cc:2468] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 11.
I20260709 12:15:01.772091  5164 leader_election.cc:304] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:01.747285  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:01.779130  5198 raft_consensus.cc:2468] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 11.
I20260709 12:15:01.711735  9636 raft_consensus.cc:2749] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:01.710903  9384 raft_consensus.cc:2749] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:15:01.703864  9700 raft_consensus.cc:2749] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:01.757309  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:01.704505  9641 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:01.793089  5801 leader_election.cc:304] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:01.790561  9637 consensus_queue.cc:1059] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 12:15:01.756484  9701 raft_consensus.cc:2749] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:01.796249  9697 raft_consensus.cc:2804] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:01.782321  9686 raft_consensus.cc:2749] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:15:01.796309  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 56314.9us
I20260709 12:15:01.867028  5804 leader_election.cc:304] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:01.798388  9633 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:01.787192  9703 raft_consensus.cc:2749] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:01.757326  9602 consensus_queue.cc:1059] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 12:15:01.802649  5089 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:01.787034  9527 consensus_queue.cc:1048] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
W20260709 12:15:01.803695  9672 log.cc:927] Time spent T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 12:15:01.758184  9708 log.cc:927] Time spent T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 12:15:01.820459  5193 raft_consensus.cc:2393] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 13: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:15:01.821750  5088 leader_election.cc:304] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:01.784808  5164 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
W20260709 12:15:01.863947  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 70945us
W20260709 12:15:01.884629  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 62991.6us
I20260709 12:15:01.759258  9652 consensus_queue.cc:1048] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.107s
I20260709 12:15:01.747412  9349 consensus_queue.cc:1048] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.119s
I20260709 12:15:01.868012  9267 raft_consensus.cc:2749] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:01.876359  5163 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:15:01.884222  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 81649.1us
W20260709 12:15:01.894183  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 109449us
I20260709 12:15:01.901502  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:01.865088  9697 raft_consensus.cc:493] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:01.902575  5199 raft_consensus.cc:1240] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:01.876398  9366 raft_consensus.cc:2749] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:01.907975  5237 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:01.892247  5023 catalog_manager.cc:5697] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 7 to 10, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 10 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:01.891981  9135 raft_consensus.cc:2804] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:01.892349  9674 raft_consensus.cc:2804] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:01.921900  5023 catalog_manager.cc:5697] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 8 to 10, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 10 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:01.896654  9523 raft_consensus.cc:2749] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:01.910090  9697 raft_consensus.cc:3060] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:01.874851  9641 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:01.953295  5023 catalog_manager.cc:5697] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 9 to 10, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 10 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:01.922617  9665 raft_consensus.cc:2749] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:01.911118  9543 consensus_queue.cc:1048] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 12:15:01.924845  9135 raft_consensus.cc:493] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
W20260709 12:15:01.963112  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 93562.5us
I20260709 12:15:01.918952  9637 consensus_queue.cc:1059] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:15:01.963112  5023 catalog_manager.cc:5697] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 3 to 9, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 9 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
W20260709 12:15:01.969686  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 84407.7us
I20260709 12:15:01.970448  5801 leader_election.cc:304] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:01.943311  9667 consensus_queue.cc:1059] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:15:01.977710  5023 catalog_manager.cc:5697] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:01.964707  9135 raft_consensus.cc:3060] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:01.984508  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:01.986496  9527 consensus_queue.cc:1048] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 12:15:01.983702  9484 raft_consensus.cc:2749] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:01.995988  9643 raft_consensus.cc:3055] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:01.996417  9643 raft_consensus.cc:740] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:01.997916  5023 catalog_manager.cc:5697] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 6 to 8, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 8 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
W20260709 12:15:02.001765  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 128853us
I20260709 12:15:02.003051  9442 raft_consensus.cc:2804] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:02.003628  9442 raft_consensus.cc:697] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:02.004475  9442 consensus_queue.cc:237] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:02.004925  9135 raft_consensus.cc:515] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:15:02.010375  9713 log.cc:927] Time spent T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.352s	user 0.011s	sys 0.000s
I20260709 12:15:01.997256  9643 consensus_queue.cc:260] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:02.020763  9505 consensus_queue.cc:1059] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:15:02.023579  9505 raft_consensus.cc:3055] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:02.023981  9505 raft_consensus.cc:740] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:02.032050  9378 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:02.034461  5838 raft_consensus.cc:1240] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
W20260709 12:15:02.034797  5010 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ddd16ccf58f24f6db29e5fc39a06e5c4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica ad2f9a1e2f7a45429fa69fd23d09f821 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
W20260709 12:15:02.025216  9706 log.cc:927] Time spent T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.333s	user 0.006s	sys 0.004s
I20260709 12:15:02.024855  9505 consensus_queue.cc:260] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:02.036582  9636 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:02.037173  9505 raft_consensus.cc:3060] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:02.037149  9636 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:15:02.041172  9718 log.cc:927] Time spent T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
W20260709 12:15:02.040969  9707 log.cc:927] Time spent T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.173s	user 0.002s	sys 0.000s
I20260709 12:15:02.070225  5193 raft_consensus.cc:1275] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:15:02.020875  9643 raft_consensus.cc:3060] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:15:02.074328  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 165356us
I20260709 12:15:02.029215  9538 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:02.095997  9640 raft_consensus.cc:493] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:02.096666  9640 raft_consensus.cc:515] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:02.100785  9640 leader_election.cc:290] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:02.096084  5266 raft_consensus.cc:1275] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:15:02.109333  5122 raft_consensus.cc:1275] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:15:02.109479  9378 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:02.066781  9475 consensus_queue.cc:1059] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 12:15:02.113220  9484 consensus_queue.cc:1048] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:15:02.114610  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
W20260709 12:15:02.086385  9545 consensus_meta.cc:287] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.615s	user 0.008s	sys 0.004s
I20260709 12:15:02.122445  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:02.206632  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:15:02.210228  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 322612us
W20260709 12:15:02.212273  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 85892.4us
I20260709 12:15:02.108824  9477 raft_consensus.cc:515] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:02.211259  5088 leader_election.cc:304] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:02.216456  5088 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:15:02.212643  9715 log.cc:927] Time spent T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:15:02.214650  9674 raft_consensus.cc:697] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:02.253791  9135 leader_election.cc:290] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:15:02.238845  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 339326us
I20260709 12:15:02.270008  9665 raft_consensus.cc:3055] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:15:02.280275  5089 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:02.294765  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:02.295725  5119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59390 (request call id 892) took 1049 ms. Trace:
I20260709 12:15:02.302205  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:02.235770  9637 raft_consensus.cc:2804] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:02.296121  5119 rpcz_store.cc:276] 0709 12:15:01.246813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:01.246966 (+   153us) service_pool.cc:224] Handling call
0709 12:15:01.280271 (+ 33305us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:15:01.313947 (+ 33676us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:15:01.313977 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:01.314419 (+   442us) log.cc:844] Serialized 52 byte log entry
0709 12:15:01.632040 (+317621us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:15:01.632079 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:01.632141 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:02.295519 (+663378us) raft_consensus.cc:1685] finished
0709 12:15:02.295539 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:02.295669 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":778,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":99,"thread_start_us":298250,"threads_started":1,"wal-append.queue_time_us":386768}
I20260709 12:15:02.140357  9484 consensus_queue.cc:1048] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.142s
I20260709 12:15:02.310447  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:02.311792  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
W20260709 12:15:02.366770  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 61378.5us
I20260709 12:15:02.275075  9633 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:02.282344  9636 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:02.286338  9665 raft_consensus.cc:740] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:02.301821  9135 raft_consensus.cc:2749] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:02.395169  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
W20260709 12:15:02.411845  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 131666us
I20260709 12:15:02.309801  9637 raft_consensus.cc:493] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
W20260709 12:15:02.419574  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 269703us
I20260709 12:15:02.418788  9637 raft_consensus.cc:3060] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:15:02.467643  9733 log.cc:927] Time spent T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 12:15:02.493129  9737 log.cc:927] Time spent T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 12:15:02.416632  9674 consensus_queue.cc:237] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:02.530855  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 108447us
W20260709 12:15:02.508586  9736 log.cc:927] Time spent T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:15:02.494524  9728 raft_consensus.cc:2749] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:02.514763  9538 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:02.564134  5166 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:02.556475  9743 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:02.558837  9641 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:15:02.579552  9734 log.cc:927] Time spent T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 12:15:02.577176  9743 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:02.584093  9523 raft_consensus.cc:2749] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:02.595726  9743 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:02.600136  5116 raft_consensus.cc:1275] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:15:02.577630  9477 leader_election.cc:290] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:02.602246  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:02.603524  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
W20260709 12:15:02.604041  9505 consensus_meta.cc:287] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.561s	user 0.004s	sys 0.004s
I20260709 12:15:02.604560  5197 raft_consensus.cc:2468] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 11.
I20260709 12:15:02.608258  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:02.649187  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:02.650192  5121 raft_consensus.cc:1275] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:15:02.649901  5123 raft_consensus.cc:2468] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 9.
I20260709 12:15:02.656204  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:02.655148  5166 leader_election.cc:304] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:02.657363  9621 consensus_queue.cc:1048] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:15:02.664501  9523 raft_consensus.cc:2804] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:02.669554  9523 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:02.735977  5193 raft_consensus.cc:2468] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 11.
I20260709 12:15:02.737916  9523 raft_consensus.cc:3060] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:02.736568  9505 raft_consensus.cc:493] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:02.737356  9750 raft_consensus.cc:493] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:02.746533  9696 raft_consensus.cc:3055] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:02.804991  9696 raft_consensus.cc:740] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:02.806013  9696 consensus_queue.cc:260] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:02.807364  9696 raft_consensus.cc:3060] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:02.786935  9505 raft_consensus.cc:515] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:02.751538  9633 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:02.788556  9747 log.cc:927] Time spent T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:15:02.790400  9700 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:02.818851  9700 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:02.792471  9729 raft_consensus.cc:493] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:02.823118  9505 leader_election.cc:290] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:15:02.793293  9697 consensus_meta.cc:287] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.836s	user 0.011s	sys 0.001s
W20260709 12:15:02.795547  9643 consensus_meta.cc:287] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.714s	user 0.012s	sys 0.006s
I20260709 12:15:02.825799  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:02.823351  9665 consensus_queue.cc:260] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:15:02.835204  9741 log.cc:927] Time spent T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.242s	user 0.003s	sys 0.000s
I20260709 12:15:02.834544  9697 raft_consensus.cc:515] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:02.813092  9750 raft_consensus.cc:515] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:02.826357  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:02.837910  5120 raft_consensus.cc:2393] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 10: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:15:02.838719  9750 leader_election.cc:290] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:02.839231  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
W20260709 12:15:02.839449  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 414598us
I20260709 12:15:02.798620  9637 raft_consensus.cc:515] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:02.803920  9523 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:02.853497  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:02.854295  5195 raft_consensus.cc:2468] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 9.
I20260709 12:15:02.842216  9700 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:02.864638  5237 leader_election.cc:304] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:02.867769  9538 raft_consensus.cc:2804] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:02.867834  9697 leader_election.cc:290] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:02.868268  9538 raft_consensus.cc:493] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:02.868698  9538 raft_consensus.cc:3060] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:02.842945  9750 consensus_queue.cc:1059] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
W20260709 12:15:02.873755  9737 log.cc:927] Time spent T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.126s	user 0.003s	sys 0.000s
I20260709 12:15:02.823330  9729 raft_consensus.cc:515] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:02.876619  9729 leader_election.cc:290] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:02.882107  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:02.882822  5124 raft_consensus.cc:2468] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 10.
W20260709 12:15:02.885018  9735 log.cc:927] Time spent T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.384s	user 0.002s	sys 0.000s
I20260709 12:15:02.888684  9631 consensus_queue.cc:1048] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:15:02.892846  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 424124us
I20260709 12:15:02.893955  5088 leader_election.cc:304] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:02.895385  9729 raft_consensus.cc:2804] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:15:02.896010  9738 log.cc:927] Time spent T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.243s	user 0.001s	sys 0.000s
I20260709 12:15:02.897212  5834 raft_consensus.cc:1240] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:02.897655  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:02.902364  5166 leader_election.cc:304] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:02.910554  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:02.824632  9633 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:02.915277  5117 raft_consensus.cc:1240] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:02.895957  9729 raft_consensus.cc:697] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:02.926256  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:02.931141  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:02.912864  9636 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:02.914609  9477 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:02.938939  9633 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:02.926847  9635 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:02.945252  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:02.949596  5267 raft_consensus.cc:2393] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 11: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:15:02.953477  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:02.954208  5266 raft_consensus.cc:1240] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:02.954557  5269 raft_consensus.cc:1240] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:02.955766  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:15:02.955574  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 72224.2us
I20260709 12:15:02.936252  9678 raft_consensus.cc:2749] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:15:02.966439  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:02.961781  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:02.969408  5271 raft_consensus.cc:1240] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:02.941776  9484 raft_consensus.cc:493] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:02.948263  9640 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:02.941979  9477 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:15:03.013707  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 48641.4us
I20260709 12:15:03.014614  5801 leader_election.cc:304] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:02.940838  9753 consensus_queue.cc:1048] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 12:15:02.940948  9636 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:02.958554  9696 consensus_queue.cc:1059] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
W20260709 12:15:03.022547  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 53527.1us
I20260709 12:15:03.023278  5801 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:03.026090  5121 raft_consensus.cc:1240] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:03.024452  5270 raft_consensus.cc:2468] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 10.
I20260709 12:15:03.027776  5238 leader_election.cc:304] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:02.951751  9635 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:03.030032  5117 raft_consensus.cc:1275] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:15:03.032374  9635 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:03.034343  9696 raft_consensus.cc:3055] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:03.034780  9696 raft_consensus.cc:740] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:03.035686  9696 consensus_queue.cc:260] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:03.037096  9696 raft_consensus.cc:3060] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:03.012751  9484 raft_consensus.cc:515] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:03.076318  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 53103.4us
I20260709 12:15:03.076917  5089 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:15:03.082464  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 167080us
I20260709 12:15:03.084507  9771 raft_consensus.cc:493] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:03.085127  9771 raft_consensus.cc:515] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:03.087402  9771 leader_election.cc:290] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:15:03.091441  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 63733.9us
I20260709 12:15:03.029130  9641 raft_consensus.cc:2804] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:03.101166  9753 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:03.103103  5238 leader_election.cc:304] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:03.014483  9640 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:03.099777  9475 raft_consensus.cc:2749] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:15:03.109664  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
W20260709 12:15:03.090569  5010 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ddd16ccf58f24f6db29e5fc39a06e5c4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica ad2f9a1e2f7a45429fa69fd23d09f821 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:03.090927  9723 raft_consensus.cc:2749] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:15:03.111140  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:15:03.110016  9757 log.cc:927] Time spent T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:15:03.093238  9674 raft_consensus.cc:2749] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:03.093494  9637 leader_election.cc:290] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:03.113873  9347 raft_consensus.cc:2749] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:15:03.099277  9523 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:03.106032  9641 raft_consensus.cc:493] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:03.122951  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:03.136046  5121 raft_consensus.cc:3060] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:15:03.144583  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:03.038038  9729 consensus_queue.cc:237] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:03.153306  5191 raft_consensus.cc:2368] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 10. Current term is 11.
I20260709 12:15:03.151669  9347 raft_consensus.cc:493] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:03.159711  9762 log.cc:927] Time spent T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 12:15:03.138242  9641 raft_consensus.cc:3060] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:03.137437  9761 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:03.164479  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:03.114423  9753 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:03.159621  9347 raft_consensus.cc:515] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:15:03.168980  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 128282us
I20260709 12:15:03.174116  5197 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 12.
I20260709 12:15:03.144656  9770 raft_consensus.cc:493] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:03.208699  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 48004us
I20260709 12:15:03.211665  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:15:03.213613  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 69346.1us
I20260709 12:15:03.155618  9378 consensus_queue.cc:1048] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 12:15:03.163231  9742 raft_consensus.cc:493] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:03.224210  5088 leader_election.cc:400] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Vote denied by peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455) with higher term. Message: Invalid argument: T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 10. Current term is 11.
I20260709 12:15:03.225646  5088 leader_election.cc:403] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:03.223446  5238 leader_election.cc:304] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:03.163172  9538 raft_consensus.cc:515] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:03.225059  9764 consensus_queue.cc:1059] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:15:03.249191  9745 raft_consensus.cc:2749] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:03.251399  9773 consensus_queue.cc:1059] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:15:03.252696  9477 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:03.209583  9637 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:03.209614  9475 raft_consensus.cc:493] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:03.255987  5269 raft_consensus.cc:2368] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 10. Current term is 11.
I20260709 12:15:03.255987  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:03.259442  5122 raft_consensus.cc:3060] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:03.236393  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:03.256739  5121 raft_consensus.cc:2468] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 11.
I20260709 12:15:03.226707  9720 consensus_queue.cc:1059] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 3, Time since last communication: 0.007s
W20260709 12:15:03.232360  9693 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.000s	sys 0.009s
I20260709 12:15:03.263964  9475 raft_consensus.cc:515] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:03.176496  5119 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
new_leader_uuid: "bce73265e27d4b30a4dcc1e491305088"
 from {username='slave'} at 127.0.0.1:45628
I20260709 12:15:03.271817  5119 raft_consensus.cc:606] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Received request to transfer leadership to TS bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:03.272136  5119 raft_consensus.cc:614] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:15:03.263059  9693 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.000s	sys 0.009s
I20260709 12:15:03.262210  9743 raft_consensus.cc:2749] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455) with higher term. Message: Invalid argument: T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 10. Current term is 11.
I20260709 12:15:03.265591  9636 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:15:03.294752  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 83762.8us
I20260709 12:15:03.210788  9761 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:03.298269  9475 leader_election.cc:290] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:03.299348  9640 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:03.273415  9676 raft_consensus.cc:493] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:03.221302  9770 raft_consensus.cc:515] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:03.263034  9637 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:03.346105  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:03.234872  9742 raft_consensus.cc:515] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:03.351598  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:03.353358  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:03.355180  5265 raft_consensus.cc:2468] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 7.
I20260709 12:15:03.350734  9676 raft_consensus.cc:515] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:03.364431  9676 leader_election.cc:290] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:15:03.365664  9768 log.cc:927] Time spent T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 12:15:03.366448  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:03.373311  9584 raft_consensus.cc:493] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:03.373911  9584 raft_consensus.cc:515] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:03.383666  5163 leader_election.cc:304] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:03.387847  5122 raft_consensus.cc:2468] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 11.
I20260709 12:15:03.387506  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:03.347414  9764 raft_consensus.cc:3055] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:03.343848  9484 leader_election.cc:290] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:03.370889  9785 consensus_queue.cc:1059] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:15:03.391758  5240 leader_election.cc:304] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:15:03.369179  9770 leader_election.cc:290] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:03.398844  9475 raft_consensus.cc:2804] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:03.377358  9753 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:03.353904  9678 raft_consensus.cc:493] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:03.403678  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:03.403982  5122 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
new_leader_uuid: "bce73265e27d4b30a4dcc1e491305088"
 from {username='slave'} at 127.0.0.1:45628
I20260709 12:15:03.405486  5122 raft_consensus.cc:606] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 LEADER]: Received request to transfer leadership to TS bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:03.394133  9764 raft_consensus.cc:740] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:03.400887  9636 raft_consensus.cc:2804] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:03.405846  9475 raft_consensus.cc:697] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 11 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:03.409204  9753 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:03.408897  9678 raft_consensus.cc:515] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:03.411104  9636 raft_consensus.cc:493] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:03.434746  9347 leader_election.cc:290] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:15:03.438175  9777 log.cc:927] Time spent T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 12:15:03.410697  5266 raft_consensus.cc:1275] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:15:03.441160  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:03.449498  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:03.450657  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:03.454089  5088 leader_election.cc:304] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:03.462061  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:03.462916  5197 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 12.
I20260709 12:15:03.465829  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:03.468384  9784 raft_consensus.cc:493] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:03.464618  9783 raft_consensus.cc:493] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:03.469934  9783 raft_consensus.cc:515] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:03.472442  9761 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:03.445722  9636 raft_consensus.cc:3060] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:03.474655  5088 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:15:03.470244  9742 leader_election.cc:290] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:03.481462  9631 raft_consensus.cc:493] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:03.482165  9631 raft_consensus.cc:515] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:03.458840  9753 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:03.484216  9631 leader_election.cc:290] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:03.480341  9674 raft_consensus.cc:2804] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:03.485010  9674 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:03.468863  9475 consensus_queue.cc:237] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:03.481438  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:03.474074  9643 raft_consensus.cc:2749] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:03.469008  9784 raft_consensus.cc:515] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:03.485360  9674 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:03.504252  9665 raft_consensus.cc:3060] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:03.507695  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:03.508823  5088 leader_election.cc:304] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:03.490128  5265 raft_consensus.cc:2468] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 12.
I20260709 12:15:03.495563  5119 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
new_leader_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:45628
I20260709 12:15:03.510813  5119 raft_consensus.cc:606] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Received request to transfer leadership to TS 9e794b72ed7640219f90ec4232363929
I20260709 12:15:03.511178  5119 raft_consensus.cc:614] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:03.511351  5088 leader_election.cc:304] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:03.491665  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:03.513696  9743 raft_consensus.cc:2749] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:03.493321  9637 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:03.486799  9764 consensus_queue.cc:260] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:03.499702  9753 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:03.515929  9783 leader_election.cc:290] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:03.486534  9678 leader_election.cc:290] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:03.515584  9764 raft_consensus.cc:3060] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:03.498750  9652 raft_consensus.cc:3055] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:15:03.520630  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 265746us
I20260709 12:15:03.485726  9641 raft_consensus.cc:515] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:03.522437  9637 raft_consensus.cc:2804] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:03.525756  9637 raft_consensus.cc:697] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:03.527038  9584 leader_election.cc:290] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:03.526834  9637 consensus_queue.cc:237] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:03.502642  9784 leader_election.cc:290] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:03.522737  9652 raft_consensus.cc:740] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:15:03.530978  5801 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:03.534183  9761 raft_consensus.cc:2749] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:03.536950  9778 raft_consensus.cc:3055] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:03.537424  9778 raft_consensus.cc:740] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:03.539122  5119 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
new_leader_uuid: "bce73265e27d4b30a4dcc1e491305088"
 from {username='slave'} at 127.0.0.1:45628
I20260709 12:15:03.554792  5191 raft_consensus.cc:1275] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:15:03.543812  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:03.544756  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:03.557358  5199 raft_consensus.cc:3060] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:03.526952  9641 leader_election.cc:290] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:03.539824  5119 raft_consensus.cc:606] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 LEADER]: Received request to transfer leadership to TS bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:03.543224  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:03.530643  9652 consensus_queue.cc:260] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:03.561658  9761 consensus_queue.cc:1175] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" responder_term: 11 status { last_received { term: 11 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 11 index: 7 } }
I20260709 12:15:03.568148  9636 raft_consensus.cc:515] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:03.571722  9674 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:03.573786  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:03.574572  5834 raft_consensus.cc:2468] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 12.
I20260709 12:15:03.556553  9778 consensus_queue.cc:260] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:03.539821  9693 raft_consensus.cc:3055] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:15:03.577924  9793 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:03.580576  9793 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:03.583984  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:03.584367  9773 raft_consensus.cc:3055] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:15:03.585005  9773 raft_consensus.cc:740] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:03.579087  9778 raft_consensus.cc:3060] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:03.585878  9773 consensus_queue.cc:260] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:03.587253  9773 raft_consensus.cc:3060] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:03.588339  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:03.589787  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:03.579559  5200 raft_consensus.cc:1240] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 7. Current term is 8. Ops: []
I20260709 12:15:03.596884  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:03.598608  9701 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:03.599259  9701 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:03.601069  9725 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:03.601665  9725 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:03.604664  5163 leader_election.cc:400] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709) with higher term. Message: Invalid argument: T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 10. Current term is 11.
I20260709 12:15:03.605028  5163 leader_election.cc:403] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:03.610210  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:03.611057  5196 raft_consensus.cc:2393] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 11: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:15:03.611944  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:03.612459  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:03.613003  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:03.615576  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:03.616178  9778 consensus_queue.cc:1048] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:15:03.601572  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:03.617660  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:03.615031  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:03.614130  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:03.618845  5192 raft_consensus.cc:3060] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:15:03.614882  9652 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:03.613197  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:03.621944  5194 raft_consensus.cc:2468] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 11.
I20260709 12:15:03.624612  5196 raft_consensus.cc:1240] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:03.626991  5166 leader_election.cc:304] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
W20260709 12:15:03.627754  5165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:03.637354  5198 raft_consensus.cc:2468] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 14.
W20260709 12:15:03.580014  9765 log.cc:927] Time spent T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.547s	user 0.006s	sys 0.000s
I20260709 12:15:03.641151  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:03.643280  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:03.645298  5200 raft_consensus.cc:1275] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:15:03.647573  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:03.652832  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:03.653584  5125 raft_consensus.cc:2468] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 12.
I20260709 12:15:03.653584  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:03.626529  9793 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:03.655639  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:03.656635  9475 raft_consensus.cc:493] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:03.579824  9693 raft_consensus.cc:740] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:03.633508  9786 raft_consensus.cc:2804] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:03.671387  5199 raft_consensus.cc:2468] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 12.
I20260709 12:15:03.672466  5240 leader_election.cc:304] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:15:03.673440  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:03.685331  5838 raft_consensus.cc:1240] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:15:03.675374  5197 raft_consensus.cc:2468] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 11.
I20260709 12:15:03.685341  5238 leader_election.cc:304] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:03.635790  9753 raft_consensus.cc:493] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:03.657204  9475 raft_consensus.cc:515] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:03.636821  9667 raft_consensus.cc:493] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:03.690187  5164 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:03.691079  9543 raft_consensus.cc:2749] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:03.694805  5125 raft_consensus.cc:1240] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:03.670866  9369 raft_consensus.cc:493] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:03.726302  9369 raft_consensus.cc:515] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:03.727380  9674 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:03.728750  9369 leader_election.cc:290] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:03.698834  5801 leader_election.cc:304] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:03.729566  9636 leader_election.cc:290] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:03.729868  5801 leader_election.cc:304] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:03.731154  9753 raft_consensus.cc:515] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:03.732599  9723 raft_consensus.cc:2804] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:03.733160  9723 raft_consensus.cc:697] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 12 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:15:03.734320  9786 raft_consensus.cc:697] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:03.734119  9723 consensus_queue.cc:237] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:03.735306  9786 consensus_queue.cc:237] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:03.736622  9720 raft_consensus.cc:2804] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:03.737064  9720 raft_consensus.cc:493] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:03.738314  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 48243.6us
I20260709 12:15:03.740008  5164 leader_election.cc:304] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:03.701545  9724 consensus_queue.cc:1059] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 12:15:03.741134  9724 raft_consensus.cc:3055] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:15:03.741523  9724 raft_consensus.cc:740] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:15:03.741628  9505 raft_consensus.cc:2804] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:03.742063  9505 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:03.742415  9505 raft_consensus.cc:3060] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:03.703122  9725 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:03.704001  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:03.704370  9697 raft_consensus.cc:2804] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:03.709702  9475 leader_election.cc:290] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:03.744086  9720 raft_consensus.cc:3060] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:03.749961  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:03.650303  9641 consensus_queue.cc:1048] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.103s
I20260709 12:15:03.743727  9697 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:03.756776  9697 raft_consensus.cc:3060] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:03.757185  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:03.757930  5273 raft_consensus.cc:3060] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:03.760236  5123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40386 (request call id 2226) took 1094 ms. Trace:
I20260709 12:15:03.742475  9724 consensus_queue.cc:260] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:03.760681  5123 rpcz_store.cc:276] 0709 12:15:02.665552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:02.666215 (+   663us) service_pool.cc:224] Handling call
0709 12:15:02.666594 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:02.811590 (+144996us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:02.811623 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:02.816026 (+  4403us) log.cc:844] Serialized 26 byte log entry
0709 12:15:03.020246 (+204220us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:03.020272 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:03.020315 (+    43us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:03.579461 (+559146us) spinlock_profiling.cc:243] Waited 4.98 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e675e86e 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221 00007f84e67671d9 00007f84e6767169
0709 12:15:03.759881 (+180420us) raft_consensus.cc:1685] finished
0709 12:15:03.759906 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:03.760168 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":71426,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":2488,"spinlock_wait_cycles":11444992,"thread_start_us":250302,"threads_started":2,"wal-append.queue_time_us":176772}
I20260709 12:15:03.763499  9667 raft_consensus.cc:515] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:03.766355  9667 leader_election.cc:290] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:03.769016  5192 raft_consensus.cc:2468] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 11.
I20260709 12:15:03.779032  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:03.781391  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:03.785652  5166 leader_election.cc:304] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:03.785961  5238 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:03.788161  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:03.790524  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:03.791203  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:03.770583  9584 raft_consensus.cc:2749] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709) with higher term. Message: Invalid argument: T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 10. Current term is 11.
I20260709 12:15:03.796561  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:03.801347  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:03.802377  9693 consensus_queue.cc:260] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:03.800448  9753 leader_election.cc:290] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:03.810441  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:03.783828  9778 raft_consensus.cc:2749] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:03.796742  9369 raft_consensus.cc:493] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:03.817806  9369 raft_consensus.cc:515] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:03.820153  9369 leader_election.cc:290] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:03.821058  9538 leader_election.cc:290] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:03.808111  9720 raft_consensus.cc:515] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:03.822307  9740 raft_consensus.cc:493] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:03.822917  9740 raft_consensus.cc:515] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:03.796521  9475 raft_consensus.cc:2749] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:15:03.832280  5237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:03.809851  9693 raft_consensus.cc:3060] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:15:03.917235  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 115746us
I20260709 12:15:03.810622  9703 raft_consensus.cc:2749] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:03.824913  9505 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:03.850586  9740 leader_election.cc:290] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:15:03.810350  9667 consensus_queue.cc:1175] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "bce73265e27d4b30a4dcc1e491305088" responder_term: 15 status { last_received { term: 12 index: 11 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 14. Current term is 15. Ops: [14.12-14.12]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:15:04.089310  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:04.097095  5197 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:04.074965  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:04.102948  9665 raft_consensus.cc:493] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:04.080384  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:04.082834  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:04.083540  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:04.084232  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:04.085737  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:04.076853  5273 raft_consensus.cc:2468] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 8.
W20260709 12:15:04.113592  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 190380us
W20260709 12:15:04.115079  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 269250us
I20260709 12:15:04.126482  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:04.134459  5268 raft_consensus.cc:1240] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 7. Current term is 8. Ops: []
I20260709 12:15:04.141592  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:04.143481  5166 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:04.145783  5166 leader_election.cc:304] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:04.150033  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:04.150830  5270 raft_consensus.cc:2468] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 11.
W20260709 12:15:04.137959  9652 consensus_meta.cc:287] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.505s	user 0.010s	sys 0.012s
I20260709 12:15:04.166850  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:04.158705  5197 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 13.
I20260709 12:15:04.117487  9543 raft_consensus.cc:493] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:04.154598  5166 leader_election.cc:304] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:04.159832  5122 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
new_leader_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:45628
I20260709 12:15:04.170496  5122 raft_consensus.cc:606] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Received request to transfer leadership to TS 9e794b72ed7640219f90ec4232363929
I20260709 12:15:04.162066  5801 leader_election.cc:304] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:04.170877  5122 raft_consensus.cc:614] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:04.123597  9725 raft_consensus.cc:493] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:04.179914  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:04.173851  5834 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 12.
I20260709 12:15:04.180860  5268 raft_consensus.cc:2393] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 14: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:15:04.120842  9665 raft_consensus.cc:515] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:04.157307  9764 raft_consensus.cc:2749] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:04.301466  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:04.173277  9790 raft_consensus.cc:2749] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:04.178478  9523 raft_consensus.cc:2749] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:04.316561  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:04.323422  5265 raft_consensus.cc:3060] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:15:04.319386  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:15:04.325433  5088 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.039s	sys 0.088s
W20260709 12:15:04.325970  5088 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.040s	sys 0.088s
I20260709 12:15:04.332307  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:15:04.183697  9725 raft_consensus.cc:515] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:04.182673  9543 raft_consensus.cc:515] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:04.320683  5237 leader_election.cc:304] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:04.417506  9545 raft_consensus.cc:3060] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:04.417538  5804 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:04.326421  9378 raft_consensus.cc:2804] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:15:04.435732  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 115140us
I20260709 12:15:04.436662  5237 leader_election.cc:304] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:15:04.492259  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 74775us
W20260709 12:15:04.482717  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 44770.3us
I20260709 12:15:04.498318  5237 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:15:04.499717  5010 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ddd16ccf58f24f6db29e5fc39a06e5c4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica ad2f9a1e2f7a45429fa69fd23d09f821 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
W20260709 12:15:04.501170  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 339161us
I20260709 12:15:04.501735  5265 raft_consensus.cc:2468] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 12.
I20260709 12:15:04.522784  5088 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:15:04.484617  9378 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:04.496569  9761 raft_consensus.cc:2749] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:04.497349  9369 raft_consensus.cc:2749] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:04.581064  9701 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:04.585440  9505 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:04.567263  9378 raft_consensus.cc:3060] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:04.561968  9698 raft_consensus.cc:493] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
W20260709 12:15:04.577448  9697 consensus_meta.cc:287] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.820s	user 0.019s	sys 0.005s
I20260709 12:15:04.577937  9801 raft_consensus.cc:493] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:04.579571  9720 leader_election.cc:290] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:15:04.604161  5803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:04.605782  5803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:04.590163  9761 raft_consensus.cc:493] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:04.615942  5197 raft_consensus.cc:1275] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:15:04.595173  9805 raft_consensus.cc:2804] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:04.592773  9799 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:04.596309  9775 raft_consensus.cc:493] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:04.594730  9698 raft_consensus.cc:515] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:04.599310  9697 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:04.644466  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
W20260709 12:15:04.643599  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 120717us
I20260709 12:15:04.646863  5237 leader_election.cc:304] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:04.648066  5237 leader_election.cc:304] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:04.648422  9824 raft_consensus.cc:2804] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:04.648916  9824 raft_consensus.cc:493] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:04.649274  9824 raft_consensus.cc:3060] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:04.650892  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:04.651690  5833 raft_consensus.cc:3060] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:04.624289  9665 leader_election.cc:290] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:04.631018  9805 raft_consensus.cc:697] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
W20260709 12:15:04.657509  9693 consensus_meta.cc:287] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.724s	user 0.012s	sys 0.000s
I20260709 12:15:04.637993  9637 raft_consensus.cc:493] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:04.623056  9761 raft_consensus.cc:515] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:04.663633  5833 raft_consensus.cc:2468] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 13.
W20260709 12:15:04.666512  5240 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.000s	sys 0.015s
I20260709 12:15:04.672379  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:04.615489  9801 raft_consensus.cc:515] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:15:04.714777  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 55183us
W20260709 12:15:04.727221  5240 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.000s	sys 0.015s
W20260709 12:15:04.749715  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 75939.4us
I20260709 12:15:04.752797  5164 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:04.791275  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:04.791796  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:04.792372  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:04.792819  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:04.793066  5192 raft_consensus.cc:1275] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:15:04.793862  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:04.794708  5196 raft_consensus.cc:2368] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 11. Current term is 12.
W20260709 12:15:04.829566  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 49797.1us
I20260709 12:15:04.635780  9775 raft_consensus.cc:515] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:15:04.775177  9286 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.005s	sys 0.015s
I20260709 12:15:04.680359  9475 raft_consensus.cc:2749] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:04.671646  9810 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:04.679760  9725 leader_election.cc:290] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:15:04.985167  9286 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.882s	user 0.006s	sys 0.016s
I20260709 12:15:04.989035  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:04.983189  5240 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
W20260709 12:15:04.997116  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 198719us
W20260709 12:15:05.033310  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 50248.2us
I20260709 12:15:05.027025  9819 raft_consensus.cc:493] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:05.037506  9819 raft_consensus.cc:515] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:05.039464  9805 consensus_queue.cc:237] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:05.040108  9819 leader_election.cc:290] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:15:05.041530  9822 log.cc:927] Time spent T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.372s	user 0.001s	sys 0.000s
I20260709 12:15:04.683673  9637 raft_consensus.cc:515] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:05.043859  9637 leader_election.cc:290] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:04.797690  9693 consensus_queue.cc:1048] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.252s
I20260709 12:15:05.053601  9369 consensus_queue.cc:1059] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:15:05.058009  9818 log.cc:927] Time spent T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.401s	user 0.000s	sys 0.001s
I20260709 12:15:05.062108  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:15:05.062695  9807 log.cc:927] Time spent T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.496s	user 0.003s	sys 0.006s
I20260709 12:15:05.070969  9775 leader_election.cc:290] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:04.798224  9786 raft_consensus.cc:493] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:05.071872  9786 raft_consensus.cc:515] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:15:05.073603  5803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:05.074106  9786 leader_election.cc:290] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:05.075775  9697 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:04.962497  9783 raft_consensus.cc:2804] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:04.637614  9799 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:05.034201  5240 leader_election.cc:304] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:05.078950  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:05.089139  9725 raft_consensus.cc:2749] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:05.124202  9701 raft_consensus.cc:2749] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:05.124944  9701 raft_consensus.cc:493] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:05.125442  9701 raft_consensus.cc:515] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:05.115724  9778 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:05.127525  9701 leader_election.cc:290] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:05.127641  9778 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:05.129647  9784 raft_consensus.cc:493] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:05.130270  9784 raft_consensus.cc:515] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:05.133167  9790 raft_consensus.cc:493] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:05.129513  9584 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:05.134253  9584 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:05.132519  9784 leader_election.cc:290] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:05.137593  9543 leader_election.cc:290] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:05.128083  9701 raft_consensus.cc:493] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:05.095377  9475 raft_consensus.cc:493] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:05.094372  9775 raft_consensus.cc:493] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:05.109418  9783 raft_consensus.cc:697] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
W20260709 12:15:05.160926  5803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:05.138422  9743 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:05.122759  9637 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:05.142674  9784 raft_consensus.cc:493] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:05.097405  9810 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:05.153805  9584 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:05.214408  9778 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:05.216205  9810 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:05.154503  9475 raft_consensus.cc:515] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:05.217935  9761 leader_election.cc:290] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:05.218868  9475 leader_election.cc:290] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:05.133817  9790 raft_consensus.cc:515] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:05.223364  9790 leader_election.cc:290] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:05.196005  9775 raft_consensus.cc:515] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:05.225881  5834 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46088 (request call id 840) took 1554 ms (client timeout 1587 ms). Trace:
I20260709 12:15:05.214440  9784 raft_consensus.cc:515] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:05.228893  9784 leader_election.cc:290] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:05.229293  9799 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:05.230101  9799 raft_consensus.cc:993] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821: : Instructing follower bce73265e27d4b30a4dcc1e491305088 to start an election
W20260709 12:15:05.226366  5834 rpcz_store.cc:269] 0709 12:15:03.671653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:03.674000 (+  2347us) service_pool.cc:224] Handling call
0709 12:15:05.225725 (+1551725us) spinlock_profiling.cc:243] Waited 430 ms on lock 0x7b540045a1d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:15:05.225824 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":989339008}
W20260709 12:15:05.221204  9378 consensus_meta.cc:287] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.631s	user 0.010s	sys 0.001s
I20260709 12:15:05.231665  9378 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:05.235653  9800 raft_consensus.cc:493] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:05.236333  9800 raft_consensus.cc:515] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:05.237268  9378 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:05.238914  9800 leader_election.cc:290] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:05.151799  9701 raft_consensus.cc:515] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:05.228999  9698 leader_election.cc:290] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:05.233547  9743 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:05.234639  9827 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:05.198230  5270 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.010s	sys 0.012s
W20260709 12:15:05.264568  5270 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.011s	sys 0.013s
I20260709 12:15:05.149828  9801 leader_election.cc:290] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:05.243434  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:05.267297  5834 raft_consensus.cc:2468] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 8.
I20260709 12:15:05.263829  5163 leader_election.cc:304] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:05.200353  9725 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
W20260709 12:15:05.249294  5268 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.000s	sys 0.027s
I20260709 12:15:05.265328  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:05.266144  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:15:05.275286  5268 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.000s	sys 0.030s
I20260709 12:15:05.268162  5270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50932 (request call id 922) took 1114 ms. Trace:
I20260709 12:15:05.279488  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:05.226218  9775 leader_election.cc:290] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:05.204813  9806 raft_consensus.cc:493] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:05.295224  9743 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:05.240013  9637 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:05.295724  9806 raft_consensus.cc:515] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:05.276005  5270 rpcz_store.cc:276] 0709 12:15:04.154161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:04.154860 (+   699us) service_pool.cc:224] Handling call
0709 12:15:04.155180 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:04.155395 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:15:04.520672 (+365277us) log.cc:844] Serialized 14 byte log entry
0709 12:15:05.267216 (+746544us) log.cc:844] Serialized 14 byte log entry
0709 12:15:05.267434 (+   218us) log.cc:844] Serialized 14 byte log entry
0709 12:15:05.267695 (+   261us) log.cc:844] Serialized 14 byte log entry
0709 12:15:05.267828 (+   133us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:05.267865 (+    37us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:15:05.267914 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:05.267980 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:05.268106 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1934,"prepare.queue_time_us":414058,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":40,"raft.queue_time_us":1475,"spinlock_wait_cycles":6769408,"thread_start_us":1063355,"threads_started":2}
I20260709 12:15:05.274299  9788 raft_consensus.cc:493] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
W20260709 12:15:05.298890  9824 consensus_meta.cc:287] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.649s	user 0.006s	sys 0.004s
I20260709 12:15:05.273708  9783 consensus_queue.cc:237] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:05.280810  9767 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:05.274274  9674 raft_consensus.cc:1081] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 LEADER]: Signalling peer bce73265e27d4b30a4dcc1e491305088 to start an election
I20260709 12:15:05.299407  9824 raft_consensus.cc:515] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:15:05.290278  9545 consensus_meta.cc:287] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.872s	user 0.005s	sys 0.005s
I20260709 12:15:05.299777  9767 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:05.300549  9545 raft_consensus.cc:2749] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:05.300879  9701 leader_election.cc:290] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:05.298480  9788 raft_consensus.cc:515] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:05.301831  9819 raft_consensus.cc:493] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:05.302168  9584 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:05.302512  9767 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:05.272225  9790 raft_consensus.cc:493] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:05.302975  9788 leader_election.cc:290] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:05.271965  9784 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:05.303242  9790 raft_consensus.cc:515] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:05.271240  9827 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:15:05.299428  9796 log.cc:927] Time spent T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.997s	user 0.003s	sys 0.008s
I20260709 12:15:05.271544  9753 raft_consensus.cc:2749] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:05.274187  9636 raft_consensus.cc:2804] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:15:05.273609  9725 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:05.305766  9636 raft_consensus.cc:697] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:05.306177  9827 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:05.303738  9784 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:05.204322  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 214375us
I20260709 12:15:05.266789  9778 raft_consensus.cc:493] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:05.307019  9725 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:15:05.318996  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 284376us
I20260709 12:15:05.298059  9637 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:05.298087  9806 leader_election.cc:290] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:05.324497  9790 leader_election.cc:290] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:05.324375  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:05.325302  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:05.327543  5200 raft_consensus.cc:2468] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 9.
I20260709 12:15:05.302358  9819 raft_consensus.cc:515] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:05.330457  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:05.322800  9824 leader_election.cc:290] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:05.331373  9824 raft_consensus.cc:493] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:05.332090  9824 raft_consensus.cc:515] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:05.334349  9824 leader_election.cc:290] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:05.336284  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:05.339346  5164 leader_election.cc:304] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:05.342830  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:05.343649  5197 raft_consensus.cc:2393] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 9: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:15:05.129477  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:05.350867  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:05.306886  9636 consensus_queue.cc:237] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:05.372563  5270 raft_consensus.cc:1240] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:05.320835  9784 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:05.311154  9584 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:05.379274  5266 raft_consensus.cc:1275] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:15:05.345044  9803 log.cc:927] Time spent T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 1.041s	user 0.000s	sys 0.029s
I20260709 12:15:05.386868  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:05.317435  9778 raft_consensus.cc:515] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:05.382254  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:05.383013  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:05.378054  9824 raft_consensus.cc:493] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:05.384701  9744 raft_consensus.cc:493] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:05.320864  9832 consensus_queue.cc:1048] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:15:05.397351  9824 raft_consensus.cc:515] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:05.347257  9790 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:05.399143  9790 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:05.399811  9824 leader_election.cc:290] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:05.400600  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:05.387717  5193 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 11.
I20260709 12:15:05.402673  9819 leader_election.cc:290] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:05.378403  9769 raft_consensus.cc:2804] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:05.382053  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:05.404099  9769 raft_consensus.cc:493] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:05.345394  9545 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:05.404547  5200 raft_consensus.cc:2468] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 10.
I20260709 12:15:05.404942  9545 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:05.373075  9477 raft_consensus.cc:493] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:05.408748  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:05.408991  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:05.409133  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:05.415549  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:05.421666  5272 raft_consensus.cc:1240] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:05.422434  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:05.388311  9764 raft_consensus.cc:493] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:05.524258  9827 raft_consensus.cc:493] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:05.524976  9827 raft_consensus.cc:515] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:05.527381  9827 leader_election.cc:290] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:15:05.532667  5010 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ddd16ccf58f24f6db29e5fc39a06e5c4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica ad2f9a1e2f7a45429fa69fd23d09f821 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:05.534026  9827 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:05.534811  9827 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:05.538129  9827 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:05.404532  9769 raft_consensus.cc:3060] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:15:05.548667  5164 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.212.132:43539 timed out after 1.680s (SENT) [suppressed 6 similar messages]
W20260709 12:15:05.592803  5089 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.010s	sys 0.026s
W20260709 12:15:05.593168  5089 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.010s	sys 0.026s
I20260709 12:15:05.591802  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:05.591383  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:05.595463  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:05.596168  5837 raft_consensus.cc:2468] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 12.
I20260709 12:15:05.598165  5268 raft_consensus.cc:2393] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 12: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:15:05.401257  9790 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:05.640528  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:05.636207  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:05.641288  5273 raft_consensus.cc:2468] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 12.
W20260709 12:15:05.619549  5803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:05.647073  5803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:05.650424  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:05.666056  9841 raft_consensus.cc:493] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:05.675731  9841 raft_consensus.cc:515] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:05.667670  5802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:05.683369  9584 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:05.685400  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:05.691149  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:05.692701  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:05.691344  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:05.416378  9744 raft_consensus.cc:515] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:05.696601  5267 raft_consensus.cc:2468] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 11.
I20260709 12:15:05.698056  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:05.701930  5272 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 11.
I20260709 12:15:05.542094  9477 raft_consensus.cc:515] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:05.597882  9764 raft_consensus.cc:515] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:05.727243  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:05.728070  5268 raft_consensus.cc:2468] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 9.
W20260709 12:15:05.736541  5237 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.014s	sys 0.010s
W20260709 12:15:05.737005  5237 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.014s	sys 0.010s
W20260709 12:15:05.639034  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 604079us
I20260709 12:15:05.745193  5265 raft_consensus.cc:2468] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 9.
I20260709 12:15:05.699496  9778 leader_election.cc:290] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:15:05.777268  5166 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.046s	sys 0.108s
W20260709 12:15:05.777997  5166 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.047s	sys 0.108s
I20260709 12:15:05.744001  9842 raft_consensus.cc:493] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:05.781594  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 232942us
I20260709 12:15:05.793807  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:05.794672  5123 raft_consensus.cc:2468] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 8.
I20260709 12:15:05.806699  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:05.807255  5197 raft_consensus.cc:1240] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:15:05.808379  9819 raft_consensus.cc:493] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:05.808830  9786 consensus_queue.cc:1048] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:15:05.808996  9819 raft_consensus.cc:515] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:05.809541  9788 consensus_queue.cc:1059] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:15:05.819629  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:05.822196  5120 raft_consensus.cc:1275] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:15:05.827701  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:05.829589  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:05.777645  9840 raft_consensus.cc:493] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:05.833369  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:05.825935  9748 raft_consensus.cc:493] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:05.834662  9748 raft_consensus.cc:515] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:05.836823  9748 leader_election.cc:290] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:05.837265  9743 consensus_queue.cc:1059] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:15:05.834967  9819 leader_election.cc:290] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:05.789261  9798 raft_consensus.cc:493] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:05.838832  5123 raft_consensus.cc:2468] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 6.
I20260709 12:15:05.786171  9806 raft_consensus.cc:493] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:05.839637  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:05.837273  5088 leader_election.cc:304] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:05.841779  5195 raft_consensus.cc:2468] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 9.
I20260709 12:15:05.842259  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:05.842928  5119 raft_consensus.cc:3060] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:05.838199  9843 raft_consensus.cc:3055] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:05.791333  9584 raft_consensus.cc:493] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:05.810498  9786 raft_consensus.cc:3055] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:05.804524  9790 raft_consensus.cc:493] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:05.852229  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:05.853495  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:05.854699  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:05.823702  9805 raft_consensus.cc:493] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:05.790519  9842 raft_consensus.cc:515] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:05.863569  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:05.871279  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:05.872107  5194 raft_consensus.cc:3060] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:05.871268  5121 raft_consensus.cc:2468] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 13.
I20260709 12:15:05.844084  9843 raft_consensus.cc:740] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:05.874270  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:05.875598  5117 raft_consensus.cc:2468] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 10.
I20260709 12:15:05.875751  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:05.880291  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:05.881669  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:05.882315  5121 raft_consensus.cc:2468] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 13.
I20260709 12:15:05.852921  9786 raft_consensus.cc:740] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:05.889791  9764 leader_election.cc:290] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:05.890064  9786 consensus_queue.cc:260] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:05.890787  9744 leader_election.cc:290] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:05.872741  9790 raft_consensus.cc:515] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:05.892244  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:05.893067  9790 leader_election.cc:290] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:05.850612  9806 raft_consensus.cc:515] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:05.909268  9806 leader_election.cc:290] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:05.899664  9726 raft_consensus.cc:493] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:05.909929  5194 raft_consensus.cc:2468] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 12.
I20260709 12:15:05.910123  9726 raft_consensus.cc:515] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:05.912199  9726 leader_election.cc:290] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:05.902730  5199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41416 (request call id 894) took 2146 ms. Trace:
I20260709 12:15:05.852450  9545 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:05.887758  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:05.913213  9769 raft_consensus.cc:515] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:05.913774  5121 raft_consensus.cc:2468] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 9.
I20260709 12:15:05.914696  9477 leader_election.cc:290] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:05.915292  9286 consensus_queue.cc:1048] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:15:05.916343  9808 log.cc:927] Time spent T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 1.502s	user 0.000s	sys 0.034s
I20260709 12:15:05.912873  5199 rpcz_store.cc:276] 0709 12:15:03.755928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:03.756053 (+   125us) service_pool.cc:224] Handling call
0709 12:15:04.157942 (+401889us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b58000b3d98. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb9cfc0 00007f84ebb87929 00007f84ebb873d2 00007f84e50febd4
0709 12:15:04.158154 (+   212us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:04.166530 (+  8376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:04.166563 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:05.390491 (+1223928us) spinlock_profiling.cc:243] Waited 5.69 ms on lock 0x7b2c00010828. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e54bca11 00007f84e54cc372 00007f84e6bfea01 00007f84e6bc343a 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2
0709 12:15:05.406404 (+ 15913us) log.cc:844] Serialized 26 byte log entry
0709 12:15:05.802779 (+396375us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:15:05.802820 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:05.802890 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:05.902380 (+ 99490us) raft_consensus.cc:1685] finished
0709 12:15:05.902400 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:05.902534 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":130,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":4036,"spinlock_wait_cycles":40234112,"thread_start_us":159664,"threads_started":1,"wal-append.queue_time_us":309772}
I20260709 12:15:05.917167  9769 leader_election.cc:290] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:05.915438  5237 leader_election.cc:304] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:05.917896  5240 leader_election.cc:304] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:15:05.918808  9842 leader_election.cc:290] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:05.919402  9842 raft_consensus.cc:2749] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:05.915567  9545 raft_consensus.cc:3055] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:05.919901  9545 raft_consensus.cc:740] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:05.920032  5237 leader_election.cc:400] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Vote denied by peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455) with higher term. Message: Invalid argument: T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 11. Current term is 12.
I20260709 12:15:05.857347  9840 raft_consensus.cc:515] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:05.920399  5237 leader_election.cc:403] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:05.920771  9545 consensus_queue.cc:260] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:05.921865  9545 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:05.857797  9584 raft_consensus.cc:515] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:05.922261  5237 leader_election.cc:304] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:05.923275  9725 raft_consensus.cc:2749] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:05.921168  9842 raft_consensus.cc:2749] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455) with higher term. Message: Invalid argument: T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 11. Current term is 12.
I20260709 12:15:05.924288  9584 leader_election.cc:290] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:05.926180  5088 leader_election.cc:304] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:15:05.927456  5088 leader_election.cc:304] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:05.929172  9748 raft_consensus.cc:2804] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:05.929697  9748 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:05.930083  9748 raft_consensus.cc:3060] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:05.918754  5240 leader_election.cc:304] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:05.934561  9806 raft_consensus.cc:2804] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:05.935104  9806 raft_consensus.cc:493] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:05.935494  9806 raft_consensus.cc:3060] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:05.919631  9744 raft_consensus.cc:2804] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:05.938032  9744 raft_consensus.cc:493] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:05.938439  9744 raft_consensus.cc:3060] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:15:05.940766  5238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:05.941510  5237 leader_election.cc:304] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:05.942596  9845 raft_consensus.cc:2749] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:05.943470  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:05.944058  9845 raft_consensus.cc:2749] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:05.944708  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:05.945036  9843 consensus_queue.cc:260] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:05.945906  5269 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 8.
I20260709 12:15:05.946314  9843 raft_consensus.cc:3060] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:05.855881  9837 raft_consensus.cc:2749] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:05.951428  5237 leader_election.cc:304] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:05.845152  9798 raft_consensus.cc:515] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:05.953701  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:05.954362  5269 raft_consensus.cc:2468] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 6.
I20260709 12:15:05.954741  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:05.955040  5240 leader_election.cc:304] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:15:05.956058  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:05.956645  5269 raft_consensus.cc:2468] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 9.
I20260709 12:15:05.956519  5240 leader_election.cc:304] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:15:05.955339  5266 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 8.
I20260709 12:15:05.958768  5088 leader_election.cc:304] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:15:05.976084  5119 raft_consensus.cc:2468] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 13.
I20260709 12:15:05.979401  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:05.982187  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:05.982409  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:05.982847  5271 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 12.
I20260709 12:15:05.984068  5240 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
W20260709 12:15:05.988418  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 182079us
I20260709 12:15:05.922024  9840 leader_election.cc:290] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:05.876960  9805 raft_consensus.cc:515] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:05.978363  9832 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:05.990321  5268 raft_consensus.cc:2468] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 15.
I20260709 12:15:05.989717  5163 leader_election.cc:304] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:05.980818  9743 raft_consensus.cc:2804] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:15:05.979537  9637 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:05.984958  9726 raft_consensus.cc:2804] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:05.985642  9286 raft_consensus.cc:2804] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:05.984593  9477 raft_consensus.cc:2804] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:05.996354  9743 raft_consensus.cc:493] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:05.978574  9753 consensus_queue.cc:1048] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:15:05.996161  9832 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:06.003584  9477 raft_consensus.cc:493] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:06.008638  9477 raft_consensus.cc:3060] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:06.006026  9743 raft_consensus.cc:3060] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:06.018275  5163 leader_election.cc:304] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:05.999869  9726 raft_consensus.cc:493] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:06.020977  5163 leader_election.cc:304] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:06.006448  9545 raft_consensus.cc:2804] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:06.002640  9286 raft_consensus.cc:493] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:06.022931  9545 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:06.025985  9545 raft_consensus.cc:3060] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:06.026830  9805 leader_election.cc:290] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:06.014936  9836 raft_consensus.cc:493] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:06.033710  5163 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:06.019634  9584 raft_consensus.cc:2749] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:06.022814  9769 raft_consensus.cc:2804] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:06.002274  9637 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:06.023545  9726 raft_consensus.cc:3060] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:06.038828  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:06.047442  5266 raft_consensus.cc:2468] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 13.
I20260709 12:15:06.039489  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:06.048431  5271 raft_consensus.cc:2468] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 10.
I20260709 12:15:06.037748  9846 raft_consensus.cc:2804] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:06.036989  9836 raft_consensus.cc:515] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:06.044588  9652 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:06.029676  9286 raft_consensus.cc:3060] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:06.051687  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:06.053742  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:06.056206  5269 raft_consensus.cc:2468] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 10.
I20260709 12:15:06.060793  9858 raft_consensus.cc:493] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:06.061369  9858 raft_consensus.cc:515] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:06.062803  9836 leader_election.cc:290] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:06.063624  9858 leader_election.cc:290] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:06.064496  9805 raft_consensus.cc:493] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:06.065058  9840 raft_consensus.cc:493] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:06.068409  9840 raft_consensus.cc:515] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:06.036674  9857 raft_consensus.cc:2804] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:06.046402  9769 raft_consensus.cc:493] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:06.058660  5163 leader_election.cc:304] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:06.067198  5122 raft_consensus.cc:1240] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:06.053623  9846 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:06.073937  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:06.074729  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:15:06.075973  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 92008.5us
I20260709 12:15:06.076416  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:15:06.079449  5802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:06.077857  5120 raft_consensus.cc:2468] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 11.
I20260709 12:15:06.080263  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:06.057554  9798 leader_election.cc:290] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:06.081194  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:06.083613  5125 raft_consensus.cc:2468] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 14.
I20260709 12:15:06.091214  9637 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:06.082825  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:06.070751  9857 raft_consensus.cc:493] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:06.078418  9846 raft_consensus.cc:3060] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:06.095134  9840 leader_election.cc:290] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:06.093568  9857 raft_consensus.cc:3060] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:06.081153  9584 raft_consensus.cc:2804] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:06.097287  9584 raft_consensus.cc:493] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:06.097675  9584 raft_consensus.cc:3060] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:06.075742  9769 raft_consensus.cc:3060] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:15:06.097642  5801 connection.cc:256] RPC call timeout handler was delayed by -1.46925443300006s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16890000000000002s for a response
I20260709 12:15:06.103336  9790 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:06.103971  9790 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:06.057240  9652 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:06.078437  5240 leader_election.cc:304] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:15:06.108479  5240 leader_election.cc:304] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:06.108304  9697 raft_consensus.cc:2804] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:06.070708  9805 raft_consensus.cc:515] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:06.111994  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:06.111469  9697 raft_consensus.cc:493] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:06.115680  9697 raft_consensus.cc:3060] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:06.113030  5266 raft_consensus.cc:1275] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:15:06.114387  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:06.117111  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:06.116955  5117 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 12.
I20260709 12:15:06.120265  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:06.112707  9862 raft_consensus.cc:2804] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:06.120786  5270 raft_consensus.cc:2468] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 7.
I20260709 12:15:06.078550  9861 raft_consensus.cc:493] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:06.126008  9861 raft_consensus.cc:515] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:06.128264  9861 leader_election.cc:290] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:15:06.129664  5803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:06.129491  9862 raft_consensus.cc:697] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 13 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:06.125243  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:06.136230  9584 raft_consensus.cc:515] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:06.137964  9862 consensus_queue.cc:237] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:06.138805  9286 raft_consensus.cc:515] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:06.139408  9584 leader_election.cc:290] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:06.140247  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:06.140913  5117 raft_consensus.cc:2468] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 9.
I20260709 12:15:06.144454  9743 raft_consensus.cc:515] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:06.147217  9652 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:06.149883  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:15:06.118237  9811 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.698s	user 0.017s	sys 0.018s
I20260709 12:15:06.152618  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:06.152853  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:06.157976  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:06.158689  5270 raft_consensus.cc:3060] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:06.150774  9652 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:06.154668  9786 raft_consensus.cc:3060] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:06.156497  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:06.121094  9865 raft_consensus.cc:493] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:06.172130  9748 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:06.160295  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:06.173365  5118 raft_consensus.cc:1240] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:06.175125  9748 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:06.173523  9788 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:06.176018  9788 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:06.150876  9806 raft_consensus.cc:515] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:06.149174  9866 raft_consensus.cc:493] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:06.177626  9866 raft_consensus.cc:515] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:06.178906  9806 leader_election.cc:290] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:06.158469  5267 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 12.
I20260709 12:15:06.179790  9866 leader_election.cc:290] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:06.180364  9866 raft_consensus.cc:493] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:06.180729  9286 leader_election.cc:290] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:06.181046  9863 raft_consensus.cc:493] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:06.188041  9857 raft_consensus.cc:515] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:06.183466  9790 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:06.240263  9863 raft_consensus.cc:515] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:06.241855  9868 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:06.242702  9863 leader_election.cc:290] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:06.242472  9868 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:06.243634  9857 leader_election.cc:290] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:06.244139  9832 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:06.245213  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:06.244930  9868 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:15:06.235843  9811 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.816s	user 0.017s	sys 0.021s
I20260709 12:15:06.246603  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:06.199299  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:06.184046  9744 raft_consensus.cc:515] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:06.179183  9788 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:06.173355  9652 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:06.187979  5119 raft_consensus.cc:1240] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 6. Current term is 7. Ops: []
I20260709 12:15:06.189357  9805 leader_election.cc:290] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:06.192740  5240 leader_election.cc:304] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:06.193203  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:06.195061  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:06.270192  5838 raft_consensus.cc:2393] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 15: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
W20260709 12:15:06.189087  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 204952us
I20260709 12:15:06.197557  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:06.197675  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:06.269528  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:06.233930  9865 raft_consensus.cc:515] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:06.150906  9743 leader_election.cc:290] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:15:06.198379  5088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:06.182642  9477 raft_consensus.cc:515] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:06.206862  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:06.273972  5237 leader_election.cc:304] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:06.206993  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:06.235929  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:06.235711  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:06.282862  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:06.198319  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:06.193672  9545 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:06.285210  9545 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:06.236472  5238 leader_election.cc:304] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:06.238193  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:06.285945  5125 raft_consensus.cc:2468] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 9.
W20260709 12:15:06.239634  5803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:06.286146  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 49778.8us
I20260709 12:15:06.182747  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:06.287014  5117 raft_consensus.cc:2468] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 9.
W20260709 12:15:06.213107  5166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:06.289464  5166 leader_election.cc:304] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:06.289923  5267 raft_consensus.cc:1275] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:15:06.290621  5166 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:06.290891  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:06.198980  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:06.248598  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:06.252413  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:06.291211  9790 raft_consensus.cc:3060] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:06.195248  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:06.291569  5268 raft_consensus.cc:3060] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:06.291953  5124 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 12.
I20260709 12:15:06.292356  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:06.292740  5274 raft_consensus.cc:2393] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 10: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
W20260709 12:15:06.270268  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 77622.5us
I20260709 12:15:06.277300  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:06.291949  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:06.294286  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:06.291518  5833 raft_consensus.cc:3060] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:15:06.272701  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:06.292922  5166 leader_election.cc:304] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:15:06.244500  9846 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:06.295881  5838 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 12.
I20260709 12:15:06.298131  5270 raft_consensus.cc:2468] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 7.
I20260709 12:15:06.177088  9769 raft_consensus.cc:515] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:06.299850  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:06.299914  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:06.308055  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:06.308207  5835 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 12.
I20260709 12:15:06.308422  5829 raft_consensus.cc:2468] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 12.
W20260709 12:15:06.301096  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 181985us
I20260709 12:15:06.309525  5166 leader_election.cc:304] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:06.300354  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:06.300535  5836 raft_consensus.cc:2468] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 11.
I20260709 12:15:06.300582  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:06.310561  5830 raft_consensus.cc:2468] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 14.
I20260709 12:15:06.305687  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:06.309283  5835 raft_consensus.cc:1240] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:06.311251  5198 raft_consensus.cc:2468] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 14.
I20260709 12:15:06.306775  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:06.306957  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:06.307410  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:06.304294  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:06.312201  5191 raft_consensus.cc:2393] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 10: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:15:06.312330  5270 raft_consensus.cc:2393] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 9: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:15:06.308218  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:06.313269  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:06.314147  5267 raft_consensus.cc:2393] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 14: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:15:06.309533  5834 raft_consensus.cc:2468] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 9.
I20260709 12:15:06.314280  5270 raft_consensus.cc:3060] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:06.314499  5269 raft_consensus.cc:1275] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:15:06.195101  9697 raft_consensus.cc:515] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:06.280251  9477 leader_election.cc:290] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:06.315286  9286 raft_consensus.cc:2804] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:06.307859  5838 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221"
dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
 from {username='slave'} at 127.0.0.1:46094
I20260709 12:15:06.371313  5838 raft_consensus.cc:493] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:06.371683  5838 raft_consensus.cc:3060] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:06.316427  9788 raft_consensus.cc:2749] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:06.317368  5166 leader_election.cc:304] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:15:06.319773  9841 leader_election.cc:290] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:06.251871  9866 raft_consensus.cc:515] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:06.323812  5270 raft_consensus.cc:2468] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 12.
I20260709 12:15:06.325667  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:06.327579  9865 leader_election.cc:290] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:06.315526  5200 raft_consensus.cc:2393] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 14: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:15:06.329838  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:06.387511  5266 raft_consensus.cc:2393] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 10: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:15:06.387770  5197 raft_consensus.cc:2393] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 10: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:15:06.320616  9769 leader_election.cc:290] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:06.315547  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:06.389459  5269 raft_consensus.cc:2410] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:15:06.337141  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:06.338900  5801 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:06.343468  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:06.388335  9786 raft_consensus.cc:2804] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:06.392295  9786 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:06.392711  9786 raft_consensus.cc:3060] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:06.398759  9866 leader_election.cc:290] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:06.400509  9788 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:06.400707  9584 raft_consensus.cc:493] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:06.401117  9788 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:06.401998  9783 raft_consensus.cc:493] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:06.402527  9783 raft_consensus.cc:515] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:06.403609  9788 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:06.404460  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:06.350244  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:06.350772  5124 raft_consensus.cc:1240] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 LEADER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:06.351509  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:06.339264  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:06.340013  5237 leader_election.cc:304] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
W20260709 12:15:06.407406  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 67483.3us
I20260709 12:15:06.402971  9286 raft_consensus.cc:697] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 12 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
W20260709 12:15:06.408913  5237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:06.408574  9286 consensus_queue.cc:237] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:06.407328  5088 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:06.410494  5088 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:06.354532  9744 leader_election.cc:290] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:06.356267  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:06.411374  5088 leader_election.cc:304] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:06.412078  9805 raft_consensus.cc:2749] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:06.412729  9805 raft_consensus.cc:2804] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:06.413129  9805 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:06.412911  9786 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:06.299804  9667 raft_consensus.cc:2764] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 12:15:06.413923  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 75080.2us
I20260709 12:15:06.414712  5801 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:06.415740  5265 raft_consensus.cc:1240] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 6. Current term is 7. Ops: []
I20260709 12:15:06.416334  5801 leader_election.cc:304] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:06.296461  9778 raft_consensus.cc:2749] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:06.368800  9697 leader_election.cc:290] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:15:06.382661  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 65372.8us
I20260709 12:15:06.426327  5166 leader_election.cc:304] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:06.384698  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:06.427910  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:06.428531  5191 raft_consensus.cc:3060] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:06.428871  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:06.385857  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:06.301779  9545 raft_consensus.cc:2804] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:06.388444  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:06.331453  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:06.401189  9584 raft_consensus.cc:515] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:06.404533  9783 leader_election.cc:290] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:06.349356  9857 raft_consensus.cc:2804] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:06.362735  9652 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:06.413738  9830 raft_consensus.cc:2804] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:06.366003  9726 raft_consensus.cc:515] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:06.420519  5268 raft_consensus.cc:2468] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 14.
I20260709 12:15:06.347366  5833 raft_consensus.cc:2468] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 10.
I20260709 12:15:06.423626  5801 leader_election.cc:304] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:06.451380  9830 raft_consensus.cc:493] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:06.430212  5270 raft_consensus.cc:3060] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:06.451844  9830 raft_consensus.cc:3060] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:06.453173  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:06.413539  9805 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:06.407670  9676 raft_consensus.cc:2804] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:06.433176  5266 raft_consensus.cc:1275] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:15:06.431320  5240 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:06.422266  5838 raft_consensus.cc:515] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:06.434703  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:15:06.454630  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 130025us
I20260709 12:15:06.457271  5268 raft_consensus.cc:1240] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:06.427698  5166 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:06.459668  5269 raft_consensus.cc:2410] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:15:06.460335  5272 raft_consensus.cc:1240] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:06.460635  5240 leader_election.cc:304] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:06.425272  9863 raft_consensus.cc:2749] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:06.449687  9857 raft_consensus.cc:493] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:06.433904  9866 raft_consensus.cc:2749] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:06.433411  9545 raft_consensus.cc:493] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:06.461834  5270 raft_consensus.cc:2468] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 13.
I20260709 12:15:06.435647  9788 raft_consensus.cc:2749] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:06.458841  9676 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:06.464711  5166 leader_election.cc:304] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:06.464932  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:06.451857  5801 leader_election.cc:304] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:06.476248  5240 leader_election.cc:304] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:06.433576  9811 raft_consensus.cc:2749] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:06.454376  9652 raft_consensus.cc:2749] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:06.463380  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:06.477586  5120 raft_consensus.cc:3060] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:06.465663  9693 raft_consensus.cc:2749] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:15:06.466342  5838 leader_election.cc:290] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:06.470470  9857 raft_consensus.cc:3060] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:06.461129  9697 raft_consensus.cc:2749] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:15:06.479736  5166 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:06.492486  5166 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:06.470037  9636 raft_consensus.cc:2804] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:06.518594  5088 leader_election.cc:304] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:15:06.485637  9726 leader_election.cc:290] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:06.487331  9786 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:06.490288  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:06.476040  9783 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:06.490176  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
W20260709 12:15:06.497161  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 45366.7us
I20260709 12:15:06.498274  9771 raft_consensus.cc:2749] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:06.503291  9781 raft_consensus.cc:2749] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:06.528579  5191 raft_consensus.cc:2468] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 10.
I20260709 12:15:06.530599  5266 raft_consensus.cc:1240] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:06.489451  9778 raft_consensus.cc:2804] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:06.483882  9667 raft_consensus.cc:2749] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:15:06.477985  9676 raft_consensus.cc:3060] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:06.471989  9545 raft_consensus.cc:3060] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:06.540745  5237 leader_election.cc:304] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:06.539278  5240 leader_election.cc:304] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:06.533061  9743 raft_consensus.cc:2804] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:06.511411  9636 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:06.557562  5801 leader_election.cc:304] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
W20260709 12:15:06.552955  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 60564.3us
W20260709 12:15:06.552618  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 80286us
I20260709 12:15:06.557487  5088 leader_election.cc:304] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:15:06.532464  9754 consensus_queue.cc:1048] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:15:06.544597  9724 raft_consensus.cc:3060] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:06.543064  9778 raft_consensus.cc:493] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:06.562402  9349 raft_consensus.cc:2804] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:06.547748  9697 raft_consensus.cc:2749] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:15:06.555241  9743 raft_consensus.cc:493] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:06.537696  9799 consensus_queue.cc:1048] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:15:06.554868  9846 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:06.559787  9636 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:06.536921  9783 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:06.567440  9748 raft_consensus.cc:2804] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:15:06.573135  9349 raft_consensus.cc:697] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 10 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:06.572023  9778 raft_consensus.cc:3060] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:06.590950  5191 raft_consensus.cc:1240] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:06.591377  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:06.596853  5193 raft_consensus.cc:3060] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:06.583343  9743 raft_consensus.cc:3060] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:06.587481  5804 leader_election.cc:304] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:15:06.560105  9865 consensus_queue.cc:1048] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 12:15:06.590569  5166 leader_election.cc:304] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:06.598234  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:06.605973  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:06.582271  9876 raft_consensus.cc:2749] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:06.620117  5123 raft_consensus.cc:1275] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:15:06.578480  9877 raft_consensus.cc:2804] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:06.618434  5166 leader_election.cc:304] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:06.621505  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:06.625948  5835 raft_consensus.cc:2468] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 14.
I20260709 12:15:06.622406  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:06.592346  9703 raft_consensus.cc:493] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:06.629065  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:06.629845  5194 raft_consensus.cc:2368] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 9. Current term is 10.
I20260709 12:15:06.623646  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:06.624006  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:06.624575  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:06.631574  5266 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 11.
I20260709 12:15:06.632232  5193 raft_consensus.cc:2468] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 12.
I20260709 12:15:06.632841  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:06.632495  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:06.626788  5834 raft_consensus.cc:2468] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 12.
I20260709 12:15:06.627094  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:06.636234  5838 raft_consensus.cc:2393] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 10: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:15:06.636336  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:06.637194  5200 raft_consensus.cc:2410] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:15:06.601218  9584 leader_election.cc:290] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:06.638868  5274 raft_consensus.cc:2368] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 13. Current term is 14.
I20260709 12:15:06.640916  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:06.639984  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:06.641188  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:06.650246  5200 raft_consensus.cc:1240] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:06.620806  9846 raft_consensus.cc:2749] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:06.652742  5194 raft_consensus.cc:1275] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:15:06.620844  9871 raft_consensus.cc:2804] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:06.622638  9748 raft_consensus.cc:697] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:06.657603  5193 raft_consensus.cc:2468] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 14.
I20260709 12:15:06.635665  9786 raft_consensus.cc:2764] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:15:06.660732  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:06.669013  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:06.670605  5193 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 11.
I20260709 12:15:06.648480  9877 raft_consensus.cc:697] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 12 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:15:06.637951  9769 consensus_queue.cc:1059] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:15:06.655109  9871 raft_consensus.cc:493] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:06.678076  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:06.679044  9877 consensus_queue.cc:237] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:06.679504  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:06.692977  5193 raft_consensus.cc:2468] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 14.
I20260709 12:15:06.681706  9811 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:06.688978  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:06.647410  9845 consensus_queue.cc:1048] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:15:06.643888  9703 raft_consensus.cc:515] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:06.693724  5120 raft_consensus.cc:2468] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 10.
I20260709 12:15:06.689248  9824 raft_consensus.cc:493] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:06.706629  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:06.709241  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:06.696264  5192 raft_consensus.cc:2368] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 13. Current term is 14.
I20260709 12:15:06.702019  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:06.696254  9871 raft_consensus.cc:3060] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:06.711005  5193 raft_consensus.cc:2468] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 11.
I20260709 12:15:06.711436  5164 leader_election.cc:304] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:06.711052  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:06.711342  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:06.713708  5089 leader_election.cc:304] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:06.717016  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:06.719587  5270 raft_consensus.cc:2468] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 15.
I20260709 12:15:06.721640  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:06.723850  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:06.724519  5274 raft_consensus.cc:2468] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 12.
I20260709 12:15:06.726183  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:06.726917  5089 leader_election.cc:304] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:06.730026  5164 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:06.732167  9786 raft_consensus.cc:2749] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:06.736853  9771 raft_consensus.cc:3055] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:15:06.737797  9873 log.cc:927] Time spent T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 12:15:06.738318  9824 raft_consensus.cc:515] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:06.740921  9824 leader_election.cc:290] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:15:06.745502  9875 log.cc:927] Time spent T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
I20260709 12:15:06.746028  9783 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:06.747618  9799 raft_consensus.cc:2749] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:06.748446  9799 raft_consensus.cc:2749] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:06.748026  9805 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:06.700255  9811 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:06.666332  9349 consensus_queue.cc:237] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:06.749872  9834 consensus_queue.cc:1059] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:15:06.751327  9833 raft_consensus.cc:3055] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:06.751752  9833 raft_consensus.cc:740] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:06.752692  9833 consensus_queue.cc:260] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:06.757784  9748 consensus_queue.cc:237] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:06.759112  9790 raft_consensus.cc:2749] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:06.763957  9703 leader_election.cc:290] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:06.774708  9676 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:06.778432  5199 raft_consensus.cc:2468] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 12.
W20260709 12:15:06.782188  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 52233.2us
I20260709 12:15:06.780853  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:06.783432  5196 raft_consensus.cc:2468] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 10.
I20260709 12:15:06.786890  5196 raft_consensus.cc:1240] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:06.795364  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:06.808168  5196 raft_consensus.cc:3060] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:06.823760  5164 leader_election.cc:304] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:06.829665  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:06.830397  5124 raft_consensus.cc:3055] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:06.834127  5164 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:06.835657  5238 leader_election.cc:304] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:06.737365  9771 raft_consensus.cc:740] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:06.840219  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:06.793815  9584 raft_consensus.cc:2804] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:06.843923  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:06.830586  5237 leader_election.cc:304] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:06.840716  5238 leader_election.cc:304] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:06.830683  5124 raft_consensus.cc:740] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:06.842072  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:06.842303  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:06.843647  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:06.848892  5238 leader_election.cc:304] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:06.850247  5837 raft_consensus.cc:2393] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 15: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:15:06.837850  9703 raft_consensus.cc:2804] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:06.854035  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:06.858462  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:06.854512  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:06.846021  5124 consensus_queue.cc:260] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:06.859817  5124 raft_consensus.cc:3060] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:06.842638  9790 raft_consensus.cc:2804] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:06.843034  9665 raft_consensus.cc:2749] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:06.842798  9861 raft_consensus.cc:493] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:06.866036  5238 leader_election.cc:304] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:15:06.868019  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 248819us
I20260709 12:15:06.844349  9584 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:06.868814  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:06.873340  5163 leader_election.cc:304] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:06.876662  5199 raft_consensus.cc:1240] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 LEADER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:06.877224  5196 raft_consensus.cc:2468] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 12.
I20260709 12:15:06.880470  5163 leader_election.cc:304] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
W20260709 12:15:06.881451  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 152870us
I20260709 12:15:06.850003  9744 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:06.853190  9841 raft_consensus.cc:2749] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:06.883548  5238 leader_election.cc:304] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:06.839956  9693 consensus_queue.cc:1059] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 12:15:06.871044  9584 raft_consensus.cc:3060] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:06.842124  9783 consensus_queue.cc:1059] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
W20260709 12:15:06.889670  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 161694us
I20260709 12:15:06.862903  9845 raft_consensus.cc:2764] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:15:06.891631  5192 raft_consensus.cc:1240] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:15:06.889142  5089 leader_election.cc:304] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:15:06.894899  9806 raft_consensus.cc:2804] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:06.897181  5164 leader_election.cc:304] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:06.895370  9806 raft_consensus.cc:493] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:06.898224  9806 raft_consensus.cc:3060] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:06.895756  9744 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:06.903697  9744 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:06.882681  9771 consensus_queue.cc:260] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:06.886847  9769 raft_consensus.cc:2804] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:06.905601  9676 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:06.905875  9584 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:06.877094  9861 raft_consensus.cc:515] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:06.907305  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:15:06.908638  5088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:06.870739  9703 raft_consensus.cc:697] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:06.910073  9703 consensus_queue.cc:237] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:06.896584  9786 raft_consensus.cc:2804] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:06.911216  9786 raft_consensus.cc:493] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:06.911588  9786 raft_consensus.cc:3060] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:06.912906  9584 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:06.870434  9790 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:06.913551  9790 raft_consensus.cc:3060] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:06.913693  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:06.882323  9477 raft_consensus.cc:2804] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:06.916106  9477 raft_consensus.cc:493] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:06.916671  5832 raft_consensus.cc:2468] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 8.
W20260709 12:15:06.921923  9884 consensus_queue.cc:1175] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9e794b72ed7640219f90ec4232363929" responder_term: 11 status { last_received { term: 11 index: 8 } last_committed_idx: 7 last_received_current_leader { term: 11 index: 8 } }
I20260709 12:15:06.922752  9769 raft_consensus.cc:493] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:06.923215  9769 raft_consensus.cc:3060] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:06.923766  5089 leader_election.cc:304] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:06.924594  9754 raft_consensus.cc:2749] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:06.887673  9857 raft_consensus.cc:515] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:06.921131  9790 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:06.927455  9857 leader_election.cc:290] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:06.929190  9790 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:06.929839  5837 raft_consensus.cc:1275] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:15:06.935963  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:06.937726  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:06.938481  9805 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:06.940330  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:06.941095  9545 raft_consensus.cc:515] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:06.941514  5124 raft_consensus.cc:2468] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 12.
I20260709 12:15:06.943454  9545 leader_election.cc:290] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:06.882508  9824 raft_consensus.cc:3060] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:06.945478  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:06.947789  9833 raft_consensus.cc:3060] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:06.949324  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:06.950687  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:06.952066  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:06.940333  9841 raft_consensus.cc:2749] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:15:06.938717  9778 raft_consensus.cc:515] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:06.954795  9783 raft_consensus.cc:3055] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:15:06.955214  9783 raft_consensus.cc:740] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:06.955526  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:06.932526  9743 raft_consensus.cc:515] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:06.955367  9778 leader_election.cc:290] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:06.956001  9783 consensus_queue.cc:260] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:06.955575  5196 raft_consensus.cc:1275] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:15:06.956868  5191 raft_consensus.cc:1240] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:06.959605  9743 leader_election.cc:290] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:06.959101  9778 raft_consensus.cc:2749] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:15:06.958375  9783 raft_consensus.cc:3060] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:15:06.956867  5120 raft_consensus.cc:1240] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 7. Current term is 8. Ops: []
I20260709 12:15:06.961715  5199 raft_consensus.cc:1240] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:06.962675  9771 raft_consensus.cc:3060] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:06.963088  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:06.916556  9477 raft_consensus.cc:3060] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:06.965758  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:06.967072  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:06.967885  5194 raft_consensus.cc:2393] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 10: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:15:06.968719  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:06.969806  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:06.970991  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:06.971832  5191 raft_consensus.cc:1240] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:06.971997  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
W20260709 12:15:06.972295  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 75198.6us
I20260709 12:15:06.973102  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:06.973667  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:06.974386  5191 raft_consensus.cc:2468] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 13.
I20260709 12:15:06.975292  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:06.975991  5194 raft_consensus.cc:2368] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 9. Current term is 10.
W20260709 12:15:06.976212  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 84561.4us
I20260709 12:15:06.976931  5163 leader_election.cc:304] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:06.978797  5163 leader_election.cc:304] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:06.980561  5195 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:15:06.936851  9830 raft_consensus.cc:515] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:06.980211  5088 leader_election.cc:304] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:15:06.920746  5832 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46100 (request call id 1213) took 3078 ms (client timeout 1680 ms). Trace:
I20260709 12:15:06.985008  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:07.004108  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:07.003305  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:15:07.000766  5832 rpcz_store.cc:269] 0709 12:15:03.842430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:03.843333 (+   903us) service_pool.cc:224] Handling call
0709 12:15:04.672216 (+828883us) spinlock_profiling.cc:243] Waited 2.61 ms on lock 0x7b58000b0498. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb890a0 00007f84ebb88984 00007f84e51036d4 00007f84e5103662
0709 12:15:06.920215 (+2247999us) spinlock_profiling.cc:243] Waited 2.22 s on lock 0x7b54005cba54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:15:06.920407 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5113030272}
I20260709 12:15:07.017582  5804 leader_election.cc:304] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:15:07.019426  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:07.022578  5088 leader_election.cc:304] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:06.990217  9788 raft_consensus.cc:2804] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:07.028196  5194 raft_consensus.cc:1275] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:15:06.992363  9884 raft_consensus.cc:2749] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:15:07.024988  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 173142us
I20260709 12:15:07.029830  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:07.030496  5832 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:07.031919  5120 raft_consensus.cc:1240] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:07.032423  5837 raft_consensus.cc:1275] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:15:07.033057  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:07.034152  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
W20260709 12:15:07.035105  5166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:07.036322  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:07.034808  9877 raft_consensus.cc:2804] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:15:07.038908  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 155442us
I20260709 12:15:06.972136  9786 raft_consensus.cc:515] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:07.038260  5163 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:07.039777  5238 leader_election.cc:304] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:07.047876  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:07.010789  9883 raft_consensus.cc:2749] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:07.061600  5832 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 13.
I20260709 12:15:07.008510  9477 raft_consensus.cc:515] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:07.016783  9778 consensus_queue.cc:1059] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:15:07.064872  5088 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:07.036934  9743 raft_consensus.cc:2749] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:07.034808  9636 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:07.057559  9703 consensus_queue.cc:1048] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 12:15:07.079069  9636 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:07.079771  5200 raft_consensus.cc:1240] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:07.081497  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:07.067473  5199 raft_consensus.cc:1240] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:07.072814  5238 leader_election.cc:304] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:07.073509  5163 leader_election.cc:304] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:07.073426  9545 raft_consensus.cc:2749] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:07.037982  9877 raft_consensus.cc:697] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 12 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:15:07.034561  9860 raft_consensus.cc:493] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:07.041951  9788 raft_consensus.cc:697] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:07.062330  9754 consensus_queue.cc:1048] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:15:07.057583  9861 leader_election.cc:290] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:07.143250  5197 raft_consensus.cc:2410] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:15:07.145749  9724 consensus_queue.cc:1059] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:15:07.151331  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 78594.1us
W20260709 12:15:07.152465  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 87695.5us
I20260709 12:15:07.071370  9832 consensus_queue.cc:1059] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.078s
I20260709 12:15:07.089726  9830 leader_election.cc:290] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:07.091797  9786 leader_election.cc:290] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:15:07.145666  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 73168.8us
I20260709 12:15:07.085984  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:07.099781  5124 raft_consensus.cc:1275] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 12:15:07.174796  5124 pending_rounds.cc:85] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting all ops after (but not including) 7
I20260709 12:15:07.148176  5195 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 13.
I20260709 12:15:07.180035  5164 leader_election.cc:304] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
W20260709 12:15:07.154462  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 81039.1us
I20260709 12:15:07.155251  9743 raft_consensus.cc:2749] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:15:07.155416  9890 log.cc:927] Time spent T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.086s	user 0.000s	sys 0.003s
I20260709 12:15:07.162715  9771 raft_consensus.cc:2804] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:07.067289  9584 consensus_queue.cc:1059] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.101s
I20260709 12:15:07.165510  9806 raft_consensus.cc:515] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:07.166469  9857 raft_consensus.cc:3055] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:07.167110  5116 raft_consensus.cc:2410] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 12:15:07.167294  9854 raft_consensus.cc:3055] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:15:07.185575  9854 raft_consensus.cc:740] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:07.170889  5191 raft_consensus.cc:1240] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:07.187268  9806 leader_election.cc:290] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:07.175799  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:07.176849  5198 raft_consensus.cc:2468] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 7.
I20260709 12:15:07.087282  9769 raft_consensus.cc:515] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:07.075186  9876 raft_consensus.cc:2749] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:07.153258  5088 leader_election.cc:304] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:07.181607  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:07.154601  9286 raft_consensus.cc:2749] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:07.198220  9783 raft_consensus.cc:3055] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:15:07.199268  9783 raft_consensus.cc:740] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:07.178676  9788 consensus_queue.cc:237] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:07.200078  9783 consensus_queue.cc:260] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:07.185110  9857 raft_consensus.cc:740] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:07.200516  9769 leader_election.cc:290] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:07.175096  5124 pending_rounds.cc:107] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 12:15:07.201171  5124 raft_consensus.cc:2889] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:07.201531  9857 consensus_queue.cc:260] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:07.202929  9857 raft_consensus.cc:3060] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:07.083973  9477 leader_election.cc:290] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:07.180397  5801 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:07.206326  9879 raft_consensus.cc:2749] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:07.207041  9879 consensus_queue.cc:1059] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:15:07.208271  9868 raft_consensus.cc:3055] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:07.208669  9868 raft_consensus.cc:740] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:15:07.167757  9860 raft_consensus.cc:515] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:07.209518  9868 consensus_queue.cc:260] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:07.210367  5272 raft_consensus.cc:1240] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:07.211015  9860 leader_election.cc:290] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:07.211413  9868 raft_consensus.cc:3060] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:07.087155  9871 raft_consensus.cc:515] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:07.213867  9883 raft_consensus.cc:2749] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:07.214097  5834 raft_consensus.cc:1240] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 9. Current term is 10. Ops: []
W20260709 12:15:07.213634  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 60427.6us
I20260709 12:15:07.215224  9871 leader_election.cc:290] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:07.215564  5088 leader_election.cc:304] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:07.208920  9877 consensus_queue.cc:237] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:07.216706  5196 raft_consensus.cc:1275] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:15:07.196871  9771 raft_consensus.cc:697] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:07.218048  9771 consensus_queue.cc:237] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:07.218937  9748 raft_consensus.cc:3060] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:07.220178  5801 leader_election.cc:304] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:07.217170  5088 leader_election.cc:304] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:07.215664  9781 consensus_queue.cc:1048] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:15:07.222452  9799 raft_consensus.cc:2749] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:07.198871  5195 raft_consensus.cc:3060] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:07.223480  9286 consensus_queue.cc:1048] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:15:07.226416  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:07.227077  5123 raft_consensus.cc:2468] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 8.
I20260709 12:15:07.228921  5163 leader_election.cc:304] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:07.091985  9824 raft_consensus.cc:2749] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:07.229967  9703 raft_consensus.cc:2749] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:15:07.230549  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:07.221508  5801 leader_election.cc:304] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:15:07.232079  9871 raft_consensus.cc:2804] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:07.232832  9871 raft_consensus.cc:697] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 14 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:15:07.188045  5199 raft_consensus.cc:3060] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:07.235855  9871 consensus_queue.cc:237] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:07.238950  9854 consensus_queue.cc:260] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:07.241266  5240 leader_election.cc:304] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:15:07.242115  9891 raft_consensus.cc:2804] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:07.242607  9891 raft_consensus.cc:493] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:07.243033  9891 raft_consensus.cc:3060] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:07.244781  5196 raft_consensus.cc:1275] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:15:07.228900  9876 consensus_queue.cc:1059] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 12:15:07.247615  9811 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:07.262851  9897 raft_consensus.cc:2749] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:07.273928  9861 raft_consensus.cc:3055] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:07.274463  9861 raft_consensus.cc:740] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:15:07.275533  9861 consensus_queue.cc:260] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:07.277954  9861 raft_consensus.cc:3060] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:15:07.288856  9893 log.cc:927] Time spent T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.193s	user 0.008s	sys 0.000s
W20260709 12:15:07.299948  9887 log.cc:927] Time spent T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.210s	user 0.000s	sys 0.002s
I20260709 12:15:07.301573  9729 raft_consensus.cc:3055] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:15:07.301882  9888 log.cc:927] Time spent T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.213s	user 0.002s	sys 0.000s
I20260709 12:15:07.302095  9729 raft_consensus.cc:740] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
W20260709 12:15:07.302507  9881 log.cc:927] Time spent T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.212s	user 0.001s	sys 0.002s
I20260709 12:15:07.302976  9729 consensus_queue.cc:260] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:07.304288  9729 raft_consensus.cc:3060] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:07.304306  9703 raft_consensus.cc:3055] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:07.306628  9703 raft_consensus.cc:740] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:07.307407  9703 consensus_queue.cc:260] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:07.322762  9748 raft_consensus.cc:2749] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:15:07.323097  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 144145us
I20260709 12:15:07.323418  5195 raft_consensus.cc:2468] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 13.
I20260709 12:15:07.324100  5164 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:07.325747  9584 raft_consensus.cc:2749] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:15:07.326628  5023 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33888 (request call id 336) took 27144 ms (client timeout 15000 ms). Trace:
I20260709 12:15:07.326488  9584 consensus_queue.cc:1048] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:15:07.328248  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 111136us
I20260709 12:15:07.329432  5088 leader_election.cc:304] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:15:07.256291  5018 catalog_manager.cc:5697] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:07.330375  9754 consensus_queue.cc:1059] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:15:07.331081  5803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:07.325117  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 96276.4us
I20260709 12:15:07.330858  5018 catalog_manager.cc:5697] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 8 to 11, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 11 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:07.331785  9834 raft_consensus.cc:2804] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:07.332228  9834 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:07.332603  9834 raft_consensus.cc:3060] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:07.332254  5163 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:07.334146  9899 raft_consensus.cc:2804] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:07.334633  9899 raft_consensus.cc:697] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:07.335500  9899 consensus_queue.cc:237] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:07.337864  9833 raft_consensus.cc:3055] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:07.328114  9584 consensus_queue.cc:1048] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 12:15:07.337909  9754 raft_consensus.cc:493] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:07.339172  9754 raft_consensus.cc:515] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:07.340297  9703 raft_consensus.cc:3060] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:07.239377  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:07.346885  5272 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:15:07.338441  9833 raft_consensus.cc:740] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:07.348800  9833 consensus_queue.cc:260] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:07.343489  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 122046us
I20260709 12:15:07.350471  5801 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:07.351289  9865 raft_consensus.cc:2764] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:15:07.352356  5801 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:07.343022  9754 leader_election.cc:290] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:07.353657  9783 raft_consensus.cc:3060] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:15:07.357756  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 309389us
I20260709 12:15:07.358925  5163 leader_election.cc:304] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:07.360405  9833 raft_consensus.cc:3060] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:07.360549  9897 raft_consensus.cc:2804] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:07.361114  9897 raft_consensus.cc:493] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:07.361570  9897 raft_consensus.cc:3060] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:07.363394  9866 raft_consensus.cc:2749] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 12 LEADER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:07.363698  9865 raft_consensus.cc:2804] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:07.364184  9865 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:07.364567  9865 raft_consensus.cc:3060] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:07.370013  5801 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:07.331072  5088 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:07.374058  9832 raft_consensus.cc:493] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:07.395226  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:07.397656  5268 raft_consensus.cc:3060] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:15:07.399084  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 68089us
I20260709 12:15:07.400161  5088 leader_election.cc:400] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 election: Vote denied by peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455) with higher term. Message: Invalid argument: T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 9. Current term is 10.
I20260709 12:15:07.400499  5088 leader_election.cc:403] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 12:15:07.327010  5023 rpcz_store.cc:269] 0709 12:14:40.181945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:40.193644 (+ 11699us) service_pool.cc:224] Handling call
0709 12:15:07.326553 (+27132909us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:15:02.473512 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:15:02.474293 (+   781us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:15:02.474348 (+    55us) write_op.cc:435] Acquired schema lock
0709 12:15:02.474367 (+    19us) tablet.cc:662] Decoding operations
0709 12:15:02.475565 (+  1198us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:15:02.475762 (+   197us) write_op.cc:641] Partition lock acquired for write op
0709 12:15:02.475795 (+    33us) tablet.cc:685] Acquiring locks for 12 operations
0709 12:15:02.520401 (+ 44606us) tablet.cc:701] Row locks acquired
0709 12:15:02.520452 (+    51us) write_op.cc:260] PREPARE: finished
0709 12:15:02.520701 (+   249us) write_op.cc:270] Start()
0709 12:15:02.520875 (+   174us) write_op.cc:276] Timestamp: P: 1783599302520607 usec, L: 0
0709 12:15:02.520911 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 12:15:02.521811 (+   900us) log.cc:844] Serialized 4906 byte log entry
0709 12:15:02.939819 (+418008us) op_driver.cc:464] REPLICATION: finished
0709 12:15:03.101228 (+161409us) write_op.cc:301] APPLY: starting
0709 12:15:03.101336 (+   108us) tablet.cc:1367] starting BulkCheckPresence
0709 12:15:03.489364 (+388028us) tablet.cc:1370] finished BulkCheckPresence
0709 12:15:03.528324 (+ 38960us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:15:03.597519 (+ 69195us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:15:03.597879 (+   360us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 12:15:03.597948 (+    69us) write_op.cc:312] APPLY: finished
0709 12:15:03.598353 (+   405us) log.cc:844] Serialized 113 byte log entry
0709 12:15:03.644930 (+ 46577us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:03.653713 (+  8783us) write_op.cc:454] Released schema lock
0709 12:15:03.653789 (+    76us) write_op.cc:341] FINISH: Updating metrics
0709 12:15:03.654250 (+   461us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:03.654281 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":72039,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":161095,"apply.run_cpu_time_us":20782,"apply.run_wall_time_us":553024,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54263,"num_ops":12,"prepare.queue_time_us":398243,"prepare.run_cpu_time_us":65790,"prepare.run_wall_time_us":335157,"raft.queue_time_us":159058,"raft.run_cpu_time_us":24104,"raft.run_wall_time_us":166936,"replication_time_us":418736,"thread_start_us":665268,"threads_started":4,"wal-append.queue_time_us":254476,"wal-append.run_cpu_time_us":32295,"wal-append.run_wall_time_us":1823443}]]}
I20260709 12:15:07.379281  5120 raft_consensus.cc:1240] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:07.379535  9786 consensus_queue.cc:1059] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:15:07.378849  5018 catalog_manager.cc:5697] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 8 to 12, leader changed from bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 12 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:07.324263  9854 raft_consensus.cc:3060] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:07.381210  5119 raft_consensus.cc:1275] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:15:07.381211  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:07.403594  5088 leader_election.cc:304] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:15:07.385625  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 60117.2us
I20260709 12:15:07.404529  5164 leader_election.cc:304] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:07.405247  9799 raft_consensus.cc:2749] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455) with higher term. Message: Invalid argument: T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 9. Current term is 10.
I20260709 12:15:07.405756  5164 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:07.386507  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
W20260709 12:15:07.387166  5091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:07.388130  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:07.407506  5274 raft_consensus.cc:3060] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:07.388657  5265 raft_consensus.cc:1240] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:07.406194  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:07.391770  5199 raft_consensus.cc:2468] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 15.
I20260709 12:15:07.408805  5266 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:07.405699  9874 consensus_queue.cc:1059] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 12:15:07.416363  5088 leader_election.cc:304] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:07.423416  5268 raft_consensus.cc:2468] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 11.
I20260709 12:15:07.419332  5163 leader_election.cc:304] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:07.384184  9834 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:07.438076  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
W20260709 12:15:07.430886  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 60961.3us
I20260709 12:15:07.438603  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:07.427922  5163 leader_election.cc:304] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:07.433368  9879 raft_consensus.cc:3055] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:07.434584  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:07.408385  9754 raft_consensus.cc:2749] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:07.443342  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:07.435317  9771 raft_consensus.cc:3055] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:07.444245  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:07.444731  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:07.437419  9899 raft_consensus.cc:2749] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:15:07.439116  5801 leader_election.cc:400] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Vote denied by peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455) with higher term. Message: Invalid argument: T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 13. Current term is 14.
I20260709 12:15:07.442499  9865 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:07.463398  5801 leader_election.cc:403] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:07.440281  5088 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:07.437054  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:07.441136  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:07.464745  5801 leader_election.cc:304] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:07.431972  9874 raft_consensus.cc:2804] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:07.437004  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:07.384029  9897 raft_consensus.cc:515] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:07.441883  5837 raft_consensus.cc:2393] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 10: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:15:07.435412  9786 raft_consensus.cc:2749] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:07.406463  9832 raft_consensus.cc:515] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:07.458106  5274 raft_consensus.cc:2468] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 11.
I20260709 12:15:07.426575  5018 catalog_manager.cc:5697] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 5 to 11, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 11 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:07.427711  9883 raft_consensus.cc:2749] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:07.441805  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:07.478250  5018 catalog_manager.cc:5697] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:07.439895  9884 raft_consensus.cc:2749] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:07.466187  5120 raft_consensus.cc:1240] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:07.427791  9885 raft_consensus.cc:2749] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:07.469761  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:07.489825  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:07.440348  9799 consensus_queue.cc:1048] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 12:15:07.493055  5265 raft_consensus.cc:1240] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:07.467604  5238 leader_election.cc:304] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:07.456792  9876 raft_consensus.cc:2804] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:07.478312  5191 raft_consensus.cc:1275] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:15:07.429620  5164 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:07.481154  5018 catalog_manager.cc:5697] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 11 to 13, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 13 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:07.427520  9824 consensus_queue.cc:1059] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 12:15:07.459107  9771 raft_consensus.cc:740] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:07.484809  5833 raft_consensus.cc:1240] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:07.468132  9874 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:07.475478  9781 raft_consensus.cc:2804] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:07.502414  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:07.503142  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:15:07.503352  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 73865.3us
I20260709 12:15:07.440610  9879 raft_consensus.cc:740] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:15:07.495193  5273 raft_consensus.cc:1240] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:07.502425  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:07.504873  5272 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 13.
I20260709 12:15:07.499752  5163 leader_election.cc:304] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:07.506275  9667 raft_consensus.cc:2749] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:07.530303  9832 leader_election.cc:290] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:07.490978  9863 consensus_queue.cc:1059] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 12:15:07.528402  9788 raft_consensus.cc:2804] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:07.531296  9788 raft_consensus.cc:697] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:07.531481  9863 raft_consensus.cc:3055] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:07.531898  9863 raft_consensus.cc:740] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:15:07.532210  9879 consensus_queue.cc:260] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:07.519426  9874 raft_consensus.cc:3060] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:07.489567  9349 consensus_queue.cc:1048] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:15:07.534484  9865 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:15:07.507573  9903 log.cc:927] Time spent T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 12:15:07.506294  9771 consensus_queue.cc:260] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:07.477515  9743 raft_consensus.cc:2804] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:07.513505  9726 consensus_queue.cc:1059] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:15:07.498299  5018 catalog_manager.cc:5697] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 8 to 12, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 12 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:07.514585  9897 leader_election.cc:290] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:07.468592  9902 raft_consensus.cc:3060] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:15:07.456976  9898 consensus_queue.cc:1059] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:15:07.528244  9754 consensus_queue.cc:1059] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:15:07.519033  9876 raft_consensus.cc:697] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:07.528827  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:07.521817  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:07.521286  9584 raft_consensus.cc:2749] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:15:07.538180  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:07.539409  5018 catalog_manager.cc:5697] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 10 to 11, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 11 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:07.546332  5018 catalog_manager.cc:5697] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } }
I20260709 12:15:07.491115  9866 consensus_queue.cc:1059] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 12:15:07.519520  9781 raft_consensus.cc:493] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:07.553633  5193 raft_consensus.cc:1240] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
W20260709 12:15:07.542383  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 68370.6us
I20260709 12:15:07.532711  9863 consensus_queue.cc:260] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:07.554068  5018 catalog_manager.cc:5697] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 7 to 9, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 9 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:07.562893  9889 raft_consensus.cc:3055] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:07.563120  5018 catalog_manager.cc:5697] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 5 to 9, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 9 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:07.564407  9897 raft_consensus.cc:3055] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:07.564889  9897 raft_consensus.cc:740] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:07.564823  5018 catalog_manager.cc:5697] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 6 to 9, leader changed from bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 9 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:07.565977  9897 consensus_queue.cc:260] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:07.567242  9897 raft_consensus.cc:3060] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:07.567139  5018 catalog_manager.cc:5697] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 6 to 8, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 8 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:07.568944  5018 catalog_manager.cc:5697] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 5 to 7, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 7 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:07.573158  9863 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:07.570695  5018 catalog_manager.cc:5697] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 4 to 6, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 6 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } }
I20260709 12:15:07.551064  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:07.552018  5273 raft_consensus.cc:1240] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:07.578560  5193 raft_consensus.cc:1275] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:15:07.579079  5803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:07.556216  9667 consensus_queue.cc:1059] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:15:07.555954  9876 consensus_queue.cc:237] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:07.540822  9349 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:07.581130  9349 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:07.583467  9349 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:07.558197  9806 raft_consensus.cc:3055] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:07.584046  9806 raft_consensus.cc:740] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:07.584860  9806 consensus_queue.cc:260] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:07.559338  5088 leader_election.cc:304] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:07.560801  9781 raft_consensus.cc:3060] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:07.544353  5801 leader_election.cc:304] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:07.552627  5268 raft_consensus.cc:1240] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:07.579020  5018 catalog_manager.cc:5697] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 6 to 7, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 7 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
W20260709 12:15:07.590610  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 46344us
I20260709 12:15:07.591454  5801 leader_election.cc:400] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709) with higher term. Message: Invalid argument: T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 13. Current term is 14.
I20260709 12:15:07.591327  5018 catalog_manager.cc:5697] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 7 to 9, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 9 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:07.580188  5270 raft_consensus.cc:1275] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:15:07.574339  9879 raft_consensus.cc:3060] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:07.594090  5266 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 13.
I20260709 12:15:07.598112  5267 raft_consensus.cc:1240] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:07.595597  5018 catalog_manager.cc:5697] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:07.601845  5801 leader_election.cc:304] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:07.602524  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:07.603263  5200 raft_consensus.cc:2393] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 15: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:15:07.601851  5270 raft_consensus.cc:1275] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:15:07.605269  5193 raft_consensus.cc:1240] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:15:07.599530  5018 catalog_manager.cc:5697] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 6 to 7, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 7 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } }
I20260709 12:15:07.612805  5018 catalog_manager.cc:5697] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 9 to 11, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 11 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:07.613965  5801 leader_election.cc:304] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:15:07.614595  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 129286us
I20260709 12:15:07.616959  9788 consensus_queue.cc:237] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:07.618542  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:07.619192  5199 raft_consensus.cc:3060] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:07.614336  5018 catalog_manager.cc:5697] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 9 to 11, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 11 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:07.621716  5018 catalog_manager.cc:5697] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } }
I20260709 12:15:07.553531  9743 raft_consensus.cc:697] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:07.626747  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:07.627400  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:07.630107  5836 raft_consensus.cc:1275] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:15:07.623389  5018 catalog_manager.cc:5697] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 9 to 13, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 13 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:07.633328  5018 catalog_manager.cc:5697] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 8 to 11, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 11 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:07.578275  9889 raft_consensus.cc:740] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
W20260709 12:15:07.637279  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 84897.2us
I20260709 12:15:07.638885  5238 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:07.637280  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:07.640930  5116 raft_consensus.cc:2393] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 12: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
W20260709 12:15:07.646395  5010 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ddd16ccf58f24f6db29e5fc39a06e5c4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica ad2f9a1e2f7a45429fa69fd23d09f821 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:07.648317  5124 raft_consensus.cc:2468] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 15.
I20260709 12:15:07.649900  5018 catalog_manager.cc:5697] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 7 to 10, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 10 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:07.651926  5018 catalog_manager.cc:5697] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 5 to 10, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 10 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } }
I20260709 12:15:07.653332  5018 catalog_manager.cc:5697] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 7 to 9, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 9 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:07.595259  9754 raft_consensus.cc:2749] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:15:07.596419  9771 raft_consensus.cc:3060] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:07.595867  9527 raft_consensus.cc:2749] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:07.692339  5199 raft_consensus.cc:2468] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 14.
I20260709 12:15:07.692512  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
W20260709 12:15:07.697594  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 59107.6us
W20260709 12:15:07.694130  5091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:07.697983  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 59201.5us
I20260709 12:15:07.620949  9865 raft_consensus.cc:2749] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:07.699402  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:15:07.696944  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 58075.4us
I20260709 12:15:07.710363  5237 leader_election.cc:304] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:07.700248  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:07.700716  9477 consensus_queue.cc:1048] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:15:07.701871  9527 raft_consensus.cc:2749] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:07.706087  9726 consensus_queue.cc:1048] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:15:07.706664  5088 leader_election.cc:304] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:07.634876  9806 raft_consensus.cc:3060] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:07.738560  5237 leader_election.cc:304] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
W20260709 12:15:07.722383  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 82310.3us
I20260709 12:15:07.647238  9834 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:07.727257  5018 catalog_manager.cc:5697] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:07.727998  5164 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:07.742928  5194 raft_consensus.cc:1275] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:15:07.743604  5018 catalog_manager.cc:5697] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 3 to 9, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 9 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
W20260709 12:15:07.737156  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 104037us
I20260709 12:15:07.637253  9799 consensus_queue.cc:1048] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 12:15:07.649844  9885 consensus_queue.cc:1059] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.084s
I20260709 12:15:07.724470  9854 raft_consensus.cc:2749] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:07.746290  5804 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:15:07.749910  5164 leader_election.cc:304] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:07.759159  5018 catalog_manager.cc:5697] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 10 to 13, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 13 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } }
I20260709 12:15:07.740648  9693 raft_consensus.cc:2804] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:07.772279  5018 catalog_manager.cc:5697] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:07.740729  9833 raft_consensus.cc:2804] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:07.783386  5197 raft_consensus.cc:1240] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 LEADER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:07.758095  9899 raft_consensus.cc:2749] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:07.759910  9349 raft_consensus.cc:2804] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:07.787849  5269 raft_consensus.cc:1275] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:15:07.775296  9743 consensus_queue.cc:237] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:07.786972  5018 catalog_manager.cc:5697] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 6 to 8, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 8 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
W20260709 12:15:07.781706  9891 consensus_meta.cc:287] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.538s	user 0.006s	sys 0.009s
I20260709 12:15:07.799407  5123 raft_consensus.cc:1275] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:15:07.762264  9898 consensus_queue.cc:1048] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
W20260709 12:15:07.858458  9783 consensus_meta.cc:287] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.504s	user 0.009s	sys 0.000s
I20260709 12:15:07.858788  9891 raft_consensus.cc:515] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:07.766429  9883 consensus_queue.cc:1048] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:15:07.780073  9693 raft_consensus.cc:697] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 13 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:07.799348  9902 raft_consensus.cc:2749] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455) with higher term. Message: Invalid argument: T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 13. Current term is 14.
I20260709 12:15:07.785748  9833 raft_consensus.cc:697] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:07.790083  9788 raft_consensus.cc:2749] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:07.794453  9865 raft_consensus.cc:2804] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:15:07.823451  5802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:07.865947  5018 catalog_manager.cc:5697] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 5 to 14, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 14 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:07.869519  5018 catalog_manager.cc:5697] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 4 to 8, leader changed from bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 8 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
W20260709 12:15:07.825714  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 211799us
I20260709 12:15:07.771821  9889 consensus_queue.cc:260] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:07.840220  5091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:07.881778  9693 consensus_queue.cc:237] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:07.885957  9833 consensus_queue.cc:237] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:07.811573  9349 raft_consensus.cc:697] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 15 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:07.860839  9811 consensus_queue.cc:1059] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:15:07.862341  5271 raft_consensus.cc:1240] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:07.871440  5018 catalog_manager.cc:5697] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 7 to 10, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 10 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } }
I20260709 12:15:07.861340  9891 leader_election.cc:290] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:07.895169  5018 catalog_manager.cc:5697] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 9 to 10, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 10 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:07.896733  5018 catalog_manager.cc:5697] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 12 to 14, leader changed from bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 14 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:07.897697  9865 raft_consensus.cc:697] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 15 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:15:07.898864  5018 catalog_manager.cc:5697] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:07.900122  9865 consensus_queue.cc:237] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:07.900321  5018 catalog_manager.cc:5697] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 8 to 12, leader changed from bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 12 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:07.901757  5018 catalog_manager.cc:5697] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 6 to 9, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 9 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } }
I20260709 12:15:07.872495  5801 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:07.904028  9781 raft_consensus.cc:515] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:07.907384  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 428427us
I20260709 12:15:07.865438  9863 consensus_queue.cc:1048] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
W20260709 12:15:07.921365  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 48949.6us
I20260709 12:15:07.923854  5089 leader_election.cc:304] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
W20260709 12:15:07.929667  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 179838us
I20260709 12:15:07.932509  5089 leader_election.cc:304] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:07.934754  5089 leader_election.cc:304] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:07.938252  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:07.925807  9868 raft_consensus.cc:2749] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:07.951643  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:07.956059  5193 raft_consensus.cc:1240] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:07.938293  9748 raft_consensus.cc:2749] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:07.938964  9885 raft_consensus.cc:2749] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:15:08.013619  5194 raft_consensus.cc:1275] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:15:07.953588  5200 raft_consensus.cc:2468] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 12.
I20260709 12:15:07.941118  9729 raft_consensus.cc:2749] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:15:08.012576  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 72085.6us
I20260709 12:15:08.044790  5237 leader_election.cc:304] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:15:08.047971  9926 log.cc:927] Time spent T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
W20260709 12:15:08.048897  9915 log.cc:927] Time spent T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.270s	user 0.002s	sys 0.000s
I20260709 12:15:08.032560  9349 consensus_queue.cc:237] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:08.063979  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 119251us
I20260709 12:15:07.952131  9918 consensus_queue.cc:1048] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.102s
I20260709 12:15:07.948588  9925 consensus_queue.cc:1059] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.104s
I20260709 12:15:08.076925  5801 leader_election.cc:304] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:08.089509  5270 raft_consensus.cc:1275] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:15:08.092336  5270 raft_consensus.cc:1275] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:15:08.094506  9771 raft_consensus.cc:493] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:08.098982  5269 raft_consensus.cc:1275] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:15:08.103327  9781 leader_election.cc:290] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:08.098069  9771 raft_consensus.cc:515] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:08.108901  9811 raft_consensus.cc:2749] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:15:08.111274  9477 raft_consensus.cc:2804] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:08.111858  9477 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:08.112259  9477 raft_consensus.cc:3060] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:08.056305  9891 consensus_queue.cc:1048] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
W20260709 12:15:08.115756  9912 log.cc:927] Time spent T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.477s	user 0.001s	sys 0.000s
W20260709 12:15:08.120363  9879 consensus_meta.cc:287] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.520s	user 0.004s	sys 0.006s
W20260709 12:15:08.125734  9874 consensus_meta.cc:287] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.591s	user 0.007s	sys 0.004s
I20260709 12:15:08.129364  9876 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:08.131191  9477 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:08.143644  9876 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:08.111166  9919 consensus_queue.cc:1059] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:15:08.145270  9477 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:08.157699  5120 raft_consensus.cc:1275] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:15:08.161715  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:08.167881  5195 raft_consensus.cc:1240] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:08.170233  5193 raft_consensus.cc:1240] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 LEADER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:08.174599  5120 raft_consensus.cc:2393] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 11: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:15:08.126777  9874 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:08.178959  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 81982.1us
I20260709 12:15:08.176903  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
W20260709 12:15:08.185853  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 242661us
I20260709 12:15:08.200172  5835 raft_consensus.cc:1240] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:08.201540  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:08.202647  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:08.203773  5829 raft_consensus.cc:1240] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 10. Current term is 11. Ops: []
W20260709 12:15:08.205261  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 160551us
I20260709 12:15:08.205768  5838 raft_consensus.cc:1275] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:15:08.206799  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:08.209446  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:08.213668  5194 raft_consensus.cc:1240] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:15:08.173792  9879 consensus_queue.cc:1059] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 12:15:08.223373  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:08.222879  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:08.227092  5123 raft_consensus.cc:2393] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 12: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:15:08.174026  9781 consensus_queue.cc:1059] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 12:15:08.178656  9894 consensus_queue.cc:1048] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 12:15:08.183797  9918 consensus_queue.cc:1048] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 12:15:08.232677  5195 raft_consensus.cc:2468] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 12.
I20260709 12:15:08.234498  5269 raft_consensus.cc:1240] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 15 LEADER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:08.185400  9935 raft_consensus.cc:493] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:08.229915  5832 raft_consensus.cc:1275] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:15:08.178719  9783 consensus_queue.cc:1048] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 12:15:08.243652  5804 leader_election.cc:304] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:08.185365  9902 consensus_queue.cc:1059] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.050s
I20260709 12:15:08.186722  9884 consensus_queue.cc:1048] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 12:15:08.262132  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:08.262959  5834 raft_consensus.cc:2468] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 11.
I20260709 12:15:08.253449  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:08.194133  9899 consensus_queue.cc:1048] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 12:15:08.194425  9897 consensus_queue.cc:1048] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 12:15:08.219503  9790 consensus_queue.cc:1048] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 12:15:08.228982  9891 consensus_queue.cc:1059] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:15:08.250399  9876 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:08.260636  9783 consensus_queue.cc:1243] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer ad2f9a1e2f7a45429fa69fd23d09f821 log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:15:08.302647  9934 raft_consensus.cc:2749] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:15:08.258114  9935 raft_consensus.cc:515] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:08.305855  9935 leader_election.cc:290] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:08.306025  9891 raft_consensus.cc:3055] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:08.306412  9891 raft_consensus.cc:740] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:08.307233  9891 consensus_queue.cc:260] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:08.310483  5164 leader_election.cc:304] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:08.287565  9771 leader_election.cc:290] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:08.271960  9925 consensus_queue.cc:1059] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 12:15:08.316848  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:08.317603  5194 raft_consensus.cc:2468] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 8.
W20260709 12:15:08.319205  5237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:08.312302  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:08.337898  5123 raft_consensus.cc:2393] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 8: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:15:08.348871  5200 raft_consensus.cc:1240] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 9. Current term is 10. Ops: []
W20260709 12:15:08.314081  9881 log.cc:927] Time spent T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:15:08.362288  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:15:08.365584  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 107668us
I20260709 12:15:08.309151  9769 consensus_queue.cc:1048] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 12:15:08.280217  9924 consensus_queue.cc:1059] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.083s
W20260709 12:15:08.369714  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 51964.6us
I20260709 12:15:08.370720  5238 leader_election.cc:304] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:08.371961  9527 raft_consensus.cc:3055] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:08.372397  9527 raft_consensus.cc:740] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:15:08.358448  9925 consensus_queue.cc:1243] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer dd62e75bd3ed4ed28f1fb5955d650808 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:15:08.372114  9941 raft_consensus.cc:2749] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:15:08.377394  5191 raft_consensus.cc:1240] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:15:08.393513  5237 leader_election.cc:304] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:08.395869  5164 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:08.396641  5237 leader_election.cc:304] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:08.393947  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:08.400061  5191 raft_consensus.cc:1275] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:15:08.311393  9945 consensus_queue.cc:1048] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.070s
W20260709 12:15:08.414969  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 46783.6us
W20260709 12:15:08.397070  9584 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.007s	sys 0.006s
I20260709 12:15:08.416096  5089 leader_election.cc:304] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:08.382413  9771 raft_consensus.cc:2804] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:15:08.417516  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 49847.7us
I20260709 12:15:08.434163  5116 pending_rounds.cc:85] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting all ops after (but not including) 10
I20260709 12:15:08.434540  5116 pending_rounds.cc:107] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 12:15:08.429711  9941 raft_consensus.cc:493] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:08.434835  5116 raft_consensus.cc:2889] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:08.405454  9726 raft_consensus.cc:2804] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:15:08.418828  9584 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.802s	user 0.007s	sys 0.006s
I20260709 12:15:08.435181  5124 raft_consensus.cc:2468] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 12.
I20260709 12:15:08.440601  5266 raft_consensus.cc:1275] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:15:08.414480  9924 consensus_queue.cc:1243] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer dd62e75bd3ed4ed28f1fb5955d650808 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:15:08.406775  9743 consensus_queue.cc:1059] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:15:08.452144  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:08.457154  5200 raft_consensus.cc:2393] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 12: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:15:08.429055  9744 raft_consensus.cc:3055] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:08.428941  9729 raft_consensus.cc:2749] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:08.429207  9783 raft_consensus.cc:2749] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:08.429695  9771 raft_consensus.cc:493] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:08.468400  9771 raft_consensus.cc:3060] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:08.469179  9899 consensus_queue.cc:1048] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:15:08.474380  9930 raft_consensus.cc:2804] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:08.474885  9930 raft_consensus.cc:493] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:08.475310  9930 raft_consensus.cc:3060] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:08.486497  9879 raft_consensus.cc:3055] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:15:08.487032  9879 raft_consensus.cc:740] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:15:08.487885  9879 consensus_queue.cc:260] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:08.489111  9879 raft_consensus.cc:3060] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:08.494532  5200 raft_consensus.cc:1275] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:15:08.400648  9937 consensus_queue.cc:1059] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.093s
I20260709 12:15:08.507778  9928 raft_consensus.cc:493] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:08.508380  9928 raft_consensus.cc:515] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:08.449250  9874 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:08.429358  9834 consensus_queue.cc:1048] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:15:08.457999  9726 raft_consensus.cc:697] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 12 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:08.457791  9744 raft_consensus.cc:740] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:08.466045  9806 raft_consensus.cc:493] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:08.464704  9811 consensus_queue.cc:1059] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 12:15:08.473127  9931 consensus_queue.cc:1059] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.086s
I20260709 12:15:08.562122  9883 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:08.450477  9941 raft_consensus.cc:515] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:08.512645  9860 raft_consensus.cc:493] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:08.541632  9919 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:08.568250  9806 raft_consensus.cc:515] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:08.598304  9806 leader_election.cc:290] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:15:08.600132  9953 log.cc:927] Time spent T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:15:08.600560  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:08.601261  5191 raft_consensus.cc:2468] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 14.
I20260709 12:15:08.601621  9754 raft_consensus.cc:493] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:08.602161  9754 raft_consensus.cc:515] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:15:08.602720  9951 log.cc:927] Time spent T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:15:08.604354  9754 leader_election.cc:290] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:08.605121  9729 raft_consensus.cc:493] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:08.605702  9729 raft_consensus.cc:515] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:08.608937  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:08.602262  9726 consensus_queue.cc:237] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:08.610103  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:08.611416  5191 raft_consensus.cc:2468] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 11.
I20260709 12:15:08.612351  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:08.617354  5269 raft_consensus.cc:2393] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 14: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:15:08.629317  9729 leader_election.cc:290] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:08.630721  9928 leader_election.cc:290] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:08.633477  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:08.634241  5274 raft_consensus.cc:2393] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 10: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:15:08.634845  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:08.635560  5191 raft_consensus.cc:2468] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 10.
I20260709 12:15:08.635708  9889 raft_consensus.cc:3060] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:08.638831  5195 raft_consensus.cc:1240] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:15:08.588193  9860 raft_consensus.cc:515] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:08.583885  9883 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:08.590183  9919 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:08.693117  9832 raft_consensus.cc:3055] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:08.693723  9832 raft_consensus.cc:740] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:08.694713  9832 consensus_queue.cc:260] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:08.695916  9832 raft_consensus.cc:3060] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:08.697089  5191 raft_consensus.cc:1240] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:08.698984  5191 raft_consensus.cc:1240] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:15:08.703374  5191 raft_consensus.cc:1240] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 LEADER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:08.704598  9919 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:08.633292  9771 raft_consensus.cc:515] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:08.707365  9771 leader_election.cc:290] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:08.709354  9932 raft_consensus.cc:493] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:08.710103  9932 raft_consensus.cc:515] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:15:08.734026  5238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:08.744488  9932 leader_election.cc:290] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:08.713716  9945 raft_consensus.cc:493] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:08.745651  9945 raft_consensus.cc:515] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:08.748413  9945 leader_election.cc:290] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:08.700476  9527 consensus_queue.cc:260] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:08.759896  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:08.760474  5272 raft_consensus.cc:2393] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 11: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
W20260709 12:15:08.772212  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 70224.7us
I20260709 12:15:08.615294  9744 consensus_queue.cc:260] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:08.788885  9876 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:08.815135  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:08.809006  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:08.820645  5123 raft_consensus.cc:2393] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 11: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:15:08.804117  9924 raft_consensus.cc:493] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:08.817834  9744 raft_consensus.cc:3060] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:15:08.854168  9967 log.cc:927] Time spent T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.194s	user 0.000s	sys 0.000s
I20260709 12:15:08.816787  9876 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:08.860745  9876 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:08.861914  9883 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:08.841557  9924 raft_consensus.cc:515] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:08.862732  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:08.863549  5197 raft_consensus.cc:2468] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 14.
I20260709 12:15:08.864698  9924 leader_election.cc:290] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:08.872339  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:08.873395  5268 raft_consensus.cc:2393] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 14: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:15:08.874500  9860 leader_election.cc:290] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:08.875945  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:08.876704  5124 raft_consensus.cc:2468] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 14.
I20260709 12:15:08.881237  5166 leader_election.cc:304] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:08.883945  9876 raft_consensus.cc:2804] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:08.884487  9876 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:08.884661  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:08.885483  5197 raft_consensus.cc:2468] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 10.
I20260709 12:15:08.884960  9876 raft_consensus.cc:3060] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:15:08.907260  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 501474us
I20260709 12:15:09.080044  9876 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:08.889672  9930 raft_consensus.cc:515] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:15:09.083176  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 129946us
W20260709 12:15:09.090049  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:09.092473  9970 log.cc:927] Time spent T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
W20260709 12:15:09.103015  5238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:09.094919  9786 raft_consensus.cc:493] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:09.095000  9879 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:09.082522  9830 raft_consensus.cc:493] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:09.095242  9937 raft_consensus.cc:493] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:09.096975  9874 raft_consensus.cc:493] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
W20260709 12:15:09.127791  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:09.134997  9959 raft_consensus.cc:476] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 12 LEADER]: Not starting pre-election -- already a leader
I20260709 12:15:09.113054  9954 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:09.114444  9845 raft_consensus.cc:493] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:09.141748  9945 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:09.154699  9860 raft_consensus.cc:493] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:09.155911  9959 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:09.138029  9786 raft_consensus.cc:515] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:09.156409  9937 raft_consensus.cc:515] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:09.157059  9874 raft_consensus.cc:515] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:09.154971  9830 raft_consensus.cc:515] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:09.153942  9879 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:09.202894  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:09.205636  5116 raft_consensus.cc:3060] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:15:09.171569  9921 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
W20260709 12:15:09.199684  9889 consensus_meta.cc:287] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.551s	user 0.008s	sys 0.002s
I20260709 12:15:09.170440  9845 raft_consensus.cc:515] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:09.196008  9883 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:09.173980  9945 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:09.165242  9954 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:09.184051  9860 raft_consensus.cc:515] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:09.216921  9832 consensus_meta.cc:287] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.521s	user 0.013s	sys 0.000s
I20260709 12:15:09.234434  5195 raft_consensus.cc:1275] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:15:09.236425  5116 raft_consensus.cc:2468] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 16.
I20260709 12:15:09.195190  9959 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:09.253927  5238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:09.239415  5166 leader_election.cc:304] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
W20260709 12:15:09.269593  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:09.270359  9369 raft_consensus.cc:493] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:09.268994  9982 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:09.281756  9369 raft_consensus.cc:515] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:09.302320  9982 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:09.303876  9369 leader_election.cc:290] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:09.281243  9861 raft_consensus.cc:3055] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:09.304543  9861 raft_consensus.cc:740] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:15:09.276304  9930 leader_election.cc:290] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:09.225073  9883 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:09.305528  9861 consensus_queue.cc:260] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:09.306726  9938 raft_consensus.cc:493] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:09.307330  9938 raft_consensus.cc:515] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:09.309415  9955 log.cc:927] Time spent T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.800s	user 0.002s	sys 0.012s
I20260709 12:15:09.310035  9938 leader_election.cc:290] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:09.311250  5193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47728 (request call id 2455) took 1103 ms. Trace:
I20260709 12:15:09.311645  5193 rpcz_store.cc:276] 0709 12:15:08.207324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:08.208088 (+   764us) service_pool.cc:224] Handling call
0709 12:15:08.208353 (+   265us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:08.245286 (+ 36933us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:08.245313 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:08.245803 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 12:15:08.403667 (+157864us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:15:08.449916 (+ 46249us) log.cc:844] Serialized 14 byte log entry
0709 12:15:08.450195 (+   279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:08.450278 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:08.491095 (+ 40817us) spinlock_profiling.cc:243] Waited 5.82 ms on lock 0x7b1800117ee0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3ad63f3 00007f84e3ad87c1 00007f84e3ad8779 00007f84e3ad8709 00007f84e3ad86d1 00007f84e3ad79cd 0000000000388634 0000000000388479 00007f84e3ab983a
0709 12:15:09.308819 (+817724us) spinlock_profiling.cc:243] Waited 2.07 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e675e86e 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221 00007f84e67671d9 00007f84e6767169
0709 12:15:09.311011 (+  2192us) raft_consensus.cc:1685] finished
0709 12:15:09.311033 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:09.311172 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8262,"prepare.queue_time_us":38819,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":35107,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":12921,"spinlock_wait_cycles":34244224,"thread_start_us":112026,"threads_started":2,"wal-append.queue_time_us":161618}
I20260709 12:15:09.314575  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:09.303870  5270 raft_consensus.cc:1240] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 13 LEADER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:09.315949  9874 leader_election.cc:290] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:09.295132  9860 leader_election.cc:290] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:09.307879  9883 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:09.295526  9879 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:09.317963  9830 leader_election.cc:290] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:09.282907  9788 raft_consensus.cc:2804] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:15:09.293502  9937 leader_election.cc:290] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:09.318817  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:09.304737  9982 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:09.319231  5195 raft_consensus.cc:2393] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 13: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:15:09.305154  9781 raft_consensus.cc:493] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:09.319790  5197 raft_consensus.cc:2468] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 10.
I20260709 12:15:09.320828  9781 raft_consensus.cc:515] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:09.321851  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:09.322594  5271 raft_consensus.cc:2393] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 9: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:15:09.322929  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:09.323764  5270 raft_consensus.cc:2393] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 13: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:15:09.322966  9781 leader_election.cc:290] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:09.325606  9877 raft_consensus.cc:3055] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:09.300366  9959 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:09.318704  9788 raft_consensus.cc:697] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:09.327355  9788 consensus_queue.cc:237] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:09.331189  9786 leader_election.cc:290] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:09.331897  9584 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:09.332540  9584 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:09.334569  9954 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:09.326184  9845 leader_election.cc:290] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:09.337944  9667 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:09.338534  9667 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:09.343461  9945 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:09.326037  9877 raft_consensus.cc:740] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:15:09.350080  9652 raft_consensus.cc:3055] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:09.350561  9652 raft_consensus.cc:740] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:15:09.351195  9941 leader_election.cc:290] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:09.349231  9877 consensus_queue.cc:260] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:09.351392  9652 consensus_queue.cc:260] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:09.352247  9877 raft_consensus.cc:3060] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:09.352454  9652 raft_consensus.cc:3060] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:09.335989  9891 raft_consensus.cc:3060] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:09.218040  9921 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:09.278833  9876 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 16 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:09.367089  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:09.367358  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:09.368115  5121 raft_consensus.cc:2468] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 10.
I20260709 12:15:09.369134  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:09.369985  5116 raft_consensus.cc:2468] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 12.
I20260709 12:15:09.374137  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:09.376169  5166 leader_election.cc:304] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:09.387274  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:09.377796  5166 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:09.390131  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:09.390810  5270 raft_consensus.cc:3060] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:09.393126  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:09.393810  5116 raft_consensus.cc:2468] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 15.
I20260709 12:15:09.396413  5166 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:09.397372  5163 leader_election.cc:304] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:09.404359  5163 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:09.386314  9909 raft_consensus.cc:493] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:09.389582  9783 raft_consensus.cc:2804] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:15:09.413549  5802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:09.413813  5831 raft_consensus.cc:1240] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:09.416471  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:09.414637  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:09.415535  5829 raft_consensus.cc:1275] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 13. (term mismatch)
I20260709 12:15:09.418602  5829 pending_rounds.cc:85] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088: Aborting all ops after (but not including) 12
I20260709 12:15:09.418888  5829 pending_rounds.cc:107] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 12:15:09.419142  5829 raft_consensus.cc:2889] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:09.419603  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:09.419857  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:09.420487  5838 raft_consensus.cc:2468] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 12.
I20260709 12:15:09.420729  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:09.423290  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:09.426368  5197 raft_consensus.cc:1240] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 LEADER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:09.428476  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:09.429168  5197 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 13.
I20260709 12:15:09.429277  5270 raft_consensus.cc:2468] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 16.
I20260709 12:15:09.431684  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:09.424407  5193 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 13.
I20260709 12:15:09.477039  5835 raft_consensus.cc:1275] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 12:15:09.477625  5801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:09.403920  9743 raft_consensus.cc:493] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:09.433511  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:09.408176  9946 raft_consensus.cc:2804] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:09.433743  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:09.496522  5832 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 13.
I20260709 12:15:09.415426  9945 raft_consensus.cc:2749] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:09.412463  9783 raft_consensus.cc:493] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:09.415904  9876 raft_consensus.cc:2749] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:09.414709  9898 raft_consensus.cc:2804] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:09.486248  5088 leader_election.cc:304] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:15:09.517494  5804 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:09.483007  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:09.497228  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:09.414515  9916 raft_consensus.cc:493] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:09.423687  9910 raft_consensus.cc:493] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:09.423554  9667 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:09.501282  5801 leader_election.cc:304] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:09.520387  5270 raft_consensus.cc:2376] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 16. Re-sending same reply.
I20260709 12:15:09.482908  9584 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:09.479022  9938 raft_consensus.cc:493] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:09.495539  9946 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:09.517799  5088 leader_election.cc:304] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:09.478811  9883 raft_consensus.cc:493] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:09.540656  5197 raft_consensus.cc:1240] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:09.540669  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:09.495719  9918 raft_consensus.cc:3055] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:15:09.543887  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:09.516799  9898 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:09.592257  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:09.543879  5088 leader_election.cc:304] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:15:09.549887  5195 raft_consensus.cc:2468] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 14.
I20260709 12:15:09.536842  9945 raft_consensus.cc:493] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:09.499117  9885 consensus_queue.cc:1048] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:15:09.588081  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:09.612697  5193 raft_consensus.cc:2468] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 10.
W20260709 12:15:09.588872  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 87668.8us
I20260709 12:15:09.525261  9833 raft_consensus.cc:2804] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:09.520794  9783 raft_consensus.cc:3060] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:09.551182  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:09.546345  9726 raft_consensus.cc:493] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:09.523841  9933 consensus_queue.cc:1059] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 12:15:09.629937  5197 raft_consensus.cc:2468] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 14.
I20260709 12:15:09.593997  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:15:09.598425  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:09.609974  9987 raft_consensus.cc:2804] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:09.499622  9743 raft_consensus.cc:515] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:09.544857  9946 raft_consensus.cc:3060] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:09.417593  9909 raft_consensus.cc:515] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:09.587127  9918 raft_consensus.cc:740] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
W20260709 12:15:09.622104  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 104722us
I20260709 12:15:09.632750  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:09.630980  5200 raft_consensus.cc:2468] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 11.
I20260709 12:15:09.634953  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:09.550698  9806 raft_consensus.cc:2804] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:09.595152  9898 raft_consensus.cc:3060] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:15:09.641794  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 97988.7us
I20260709 12:15:09.654865  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:15:09.620842  9962 log.cc:927] Time spent T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:15:09.657178  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:09.545567  9938 raft_consensus.cc:515] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:09.621037  9833 raft_consensus.cc:493] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:09.648452  5265 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 13.
I20260709 12:15:09.629946  9667 raft_consensus.cc:493] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:09.704097  5088 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:15:09.538169  9910 raft_consensus.cc:515] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:09.708082  5835 raft_consensus.cc:2468] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 15.
I20260709 12:15:09.711138  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:09.591688  9883 raft_consensus.cc:515] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:09.717401  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:09.636668  9987 raft_consensus.cc:493] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:09.527431  9916 raft_consensus.cc:515] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:09.713634  5267 raft_consensus.cc:1275] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:15:09.718302  5193 raft_consensus.cc:2393] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 13: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
W20260709 12:15:09.719149  5801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:09.707230  9833 raft_consensus.cc:3060] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:09.765400  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:15:09.768529  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 118848us
I20260709 12:15:09.643373  9959 raft_consensus.cc:2804] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:15:09.762670  5803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:09.630749  9945 raft_consensus.cc:515] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:09.769495  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:09.645169  9726 raft_consensus.cc:515] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:09.772014  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:09.772969  5197 raft_consensus.cc:2468] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 8.
I20260709 12:15:09.676110  9933 consensus_queue.cc:1243] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Peer dd62e75bd3ed4ed28f1fb5955d650808 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:15:09.704157  9806 raft_consensus.cc:493] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:09.755666  5801 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:09.752885  9949 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:09.780419  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:09.751518  9987 raft_consensus.cc:3060] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:09.786474  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:09.806542  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:09.807165  9910 leader_election.cc:290] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:09.807853  9910 raft_consensus.cc:493] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:09.808473  9910 raft_consensus.cc:515] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:09.788760  9999 raft_consensus.cc:493] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:09.809480  9999 raft_consensus.cc:515] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:09.812388  9999 leader_election.cc:290] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:09.789294  9959 raft_consensus.cc:697] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 12 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:15:09.813457  9959 consensus_queue.cc:237] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:09.814576  9909 leader_election.cc:290] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:09.815243  9909 raft_consensus.cc:2804] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:09.815630  9909 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:09.816016  9909 raft_consensus.cc:3060] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:09.817576  9960 raft_consensus.cc:3055] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:09.790218  9986 consensus_queue.cc:1048] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.107s
W20260709 12:15:09.790896  9963 log.cc:927] Time spent T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:15:09.791173  9988 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:09.792142  9902 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:09.762012  9868 raft_consensus.cc:493] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:09.763756  9918 consensus_queue.cc:260] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:09.793848  9832 consensus_queue.cc:1059] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:09.794337 10012 raft_consensus.cc:493] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:09.794519  5272 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34674 (request call id 2443) took 1186 ms (client timeout 1503 ms). Trace:
I20260709 12:15:09.794988  9933 raft_consensus.cc:2804] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:15:09.858968  5272 rpcz_store.cc:269] 0709 12:15:08.608504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:08.608666 (+   162us) service_pool.cc:224] Handling call
0709 12:15:09.794271 (+1185605us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b5400256cd4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:15:09.794426 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":346389376}
W20260709 12:15:09.792166  9992 log.cc:927] Time spent T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 12:15:09.796977  5830 raft_consensus.cc:2468] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 11.
W20260709 12:15:09.797590  9952 log.cc:927] Time spent T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 1.447s	user 0.011s	sys 0.019s
I20260709 12:15:09.808755  5801 leader_election.cc:304] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:09.786691  5265 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 13.
I20260709 12:15:09.826576  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:15:09.832886  9994 log.cc:927] Time spent T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.124s	user 0.001s	sys 0.001s
I20260709 12:15:09.768215  9885 raft_consensus.cc:2804] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:09.807976  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:09.839488  5200 raft_consensus.cc:1275] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:15:09.783447  9806 raft_consensus.cc:3060] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:15:09.841703  5238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:09.832047  5270 raft_consensus.cc:1240] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 8. Current term is 9. Ops: []
W20260709 12:15:09.817739 10002 log.cc:927] Time spent T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:15:09.882711  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:09.883144  5268 raft_consensus.cc:2393] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 13: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
W20260709 12:15:09.854720  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 150701us
I20260709 12:15:09.718084  9667 raft_consensus.cc:515] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:09.862190  5197 raft_consensus.cc:1275] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:15:09.862399  5237 leader_election.cc:304] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:09.864952  5164 leader_election.cc:304] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:15:09.858496  9925 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:09.869240 10006 raft_consensus.cc:493] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:09.892130  9925 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:09.893260  9743 leader_election.cc:290] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:09.893836  9743 raft_consensus.cc:493] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:09.894341  9925 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:09.894275  9743 raft_consensus.cc:515] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:09.894752  9832 raft_consensus.cc:493] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:09.892124  9991 consensus_queue.cc:1048] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 12:15:09.896349  9743 leader_election.cc:290] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:09.859202  9988 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:09.892767  5116 raft_consensus.cc:1275] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:15:09.899747  5837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46100 (request call id 1256) took 1956 ms. Trace:
I20260709 12:15:09.892374  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:15:09.872548  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 64043.4us
I20260709 12:15:09.870654  9918 raft_consensus.cc:3060] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:09.870898 10012 raft_consensus.cc:515] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:09.914024  9667 leader_election.cc:290] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:09.914409  9883 leader_election.cc:290] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:09.915302  9938 leader_election.cc:290] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:09.843298  9960 raft_consensus.cc:740] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:09.916247  5267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34674 (request call id 2440) took 1493 ms. Trace:
I20260709 12:15:09.843019  9949 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:09.906948  5164 leader_election.cc:304] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:09.831461  9898 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:09.874509  5272 raft_consensus.cc:1240] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:09.916507  5269 raft_consensus.cc:2468] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 10.
I20260709 12:15:09.925940  5270 raft_consensus.cc:1275] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:15:09.917701  5267 rpcz_store.cc:276] 0709 12:15:08.423109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:08.423235 (+   126us) service_pool.cc:224] Handling call
0709 12:15:08.423535 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:09.752737 (+1329202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:09.915944 (+163207us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b540036c4d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:15:09.916182 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2966082432}
I20260709 12:15:09.843204 10011 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:09.881518  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:09.881240  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:09.879577  5238 leader_election.cc:304] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:15:09.883431  5123 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 12.
I20260709 12:15:09.888036  5119 raft_consensus.cc:1240] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:09.888773  9943 raft_consensus.cc:2804] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:09.891573  9865 raft_consensus.cc:2749] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:09.860947  9933 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:09.882732  9885 raft_consensus.cc:493] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:09.885455 10009 raft_consensus.cc:493] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
W20260709 12:15:09.907733  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 45400.9us
I20260709 12:15:09.911612  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:09.948305  5237 leader_election.cc:304] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
W20260709 12:15:09.909970  5801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:09.901892  5837 rpcz_store.cc:276] 0709 12:15:07.942956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:07.943507 (+   551us) service_pool.cc:224] Handling call
0709 12:15:07.943805 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:08.187680 (+243875us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:08.221109 (+ 33429us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:08.221936 (+   827us) log.cc:844] Serialized 26 byte log entry
0709 12:15:08.350069 (+128133us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:15:08.350109 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:08.350182 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:09.796822 (+1446640us) spinlock_profiling.cc:243] Waited 1.58 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e675e86e 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221 00007f84e67671d9 00007f84e6767169
0709 12:15:09.899432 (+102610us) raft_consensus.cc:1685] finished
0709 12:15:09.899456 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:09.899660 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40141,"raft.queue_time_us":90091,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":2213,"spinlock_wait_cycles":3623168,"thread_start_us":347975,"threads_started":2,"wal-append.queue_time_us":113810}
W20260709 12:15:09.942396  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 62895.6us
I20260709 12:15:09.941426  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:09.867909  9902 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:09.925577  9725 raft_consensus.cc:493] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:09.868070  9868 raft_consensus.cc:515] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:09.916824  9748 raft_consensus.cc:493] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:09.962255  9980 raft_consensus.cc:493] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:09.962764  9748 raft_consensus.cc:515] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:09.899752  9988 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:09.930341  9876 raft_consensus.cc:2804] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:09.946906  9885 raft_consensus.cc:3060] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:09.934448  9943 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:09.940949  9933 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:09.962523  9998 raft_consensus.cc:2804] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:09.927428  9832 raft_consensus.cc:515] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:09.964550  9941 raft_consensus.cc:2804] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:09.962859  9980 raft_consensus.cc:515] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:09.985541  9924 raft_consensus.cc:493] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:10.000228  9924 raft_consensus.cc:515] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:10.000686 10003 log.cc:927] Time spent T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 12:15:10.002017  9936 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:09.983006  9943 raft_consensus.cc:3060] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:15:10.003278  9652 consensus_meta.cc:287] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.650s	user 0.007s	sys 0.007s
I20260709 12:15:09.962868 10000 raft_consensus.cc:2804] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:09.964432  9725 raft_consensus.cc:515] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:10.014390  5831 raft_consensus.cc:2468] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 13.
I20260709 12:15:09.985733  9876 raft_consensus.cc:697] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:09.904168 10006 raft_consensus.cc:515] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:09.993820  9941 raft_consensus.cc:493] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:09.995085  9998 raft_consensus.cc:493] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:09.942708 10011 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:10.003243  9936 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:15:10.024451  9997 log.cc:927] Time spent T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 12:15:10.027483  9910 leader_election.cc:290] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:10.021180 10000 raft_consensus.cc:493] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:10.031311  9941 raft_consensus.cc:3060] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:09.960839 10009 raft_consensus.cc:515] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:10.046352  9832 leader_election.cc:290] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:10.166726  9832 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:10.168113  9832 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:10.170063  9910 raft_consensus.cc:493] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:10.047220  9916 leader_election.cc:290] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:15:10.114172  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 156995us
I20260709 12:15:09.932996  5121 raft_consensus.cc:2468] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 13.
I20260709 12:15:10.121592  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:10.121996  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:15:10.124362  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:10.126837  5197 raft_consensus.cc:1240] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 12:15:10.128960  5265 raft_consensus.cc:1240] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:10.130713  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:10.130995  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:10.134110  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:10.138214  5119 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "00645b1f1e014de995e4a937f842d909"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
new_leader_uuid: "bce73265e27d4b30a4dcc1e491305088"
 from {username='slave'} at 127.0.0.1:45628
I20260709 12:15:10.136101  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:10.141914  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:15:10.150238  5804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:10.151032  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:10.151217  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:10.050549  9902 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:10.186990  9910 raft_consensus.cc:515] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:10.055207  9861 raft_consensus.cc:3060] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:15:10.042572  9877 consensus_meta.cc:287] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.690s	user 0.008s	sys 0.005s
I20260709 12:15:10.054314  9898 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 16 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:10.213733  9936 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:10.214962 10023 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:10.215338  5834 raft_consensus.cc:1275] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:15:10.161598  9883 raft_consensus.cc:493] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:10.164767  9725 leader_election.cc:290] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:15:10.109203  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 223801us
I20260709 12:15:10.056457  9921 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:10.229054  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:10.229647  9748 leader_election.cc:290] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:10.230192  5120 raft_consensus.cc:2468] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 13.
I20260709 12:15:10.231631  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:10.232828  5120 raft_consensus.cc:2393] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 16: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:15:10.046485  9924 leader_election.cc:290] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:10.064489  9943 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:10.032701  9945 leader_election.cc:290] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:09.991887  9960 consensus_queue.cc:260] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:10.074818  9973 log.cc:927] Time spent T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.802s	user 0.004s	sys 0.000s
I20260709 12:15:10.056583  9987 raft_consensus.cc:515] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:10.242359  9921 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:10.032163  9998 raft_consensus.cc:3060] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:15:10.245368  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 283325us
I20260709 12:15:10.245906  5266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34674 (request call id 2441) took 1711 ms. Trace:
I20260709 12:15:10.044674 10000 raft_consensus.cc:3060] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:10.071887 10006 leader_election.cc:290] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:10.078852 10009 leader_election.cc:290] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:10.074930 10011 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:10.072949 10012 leader_election.cc:290] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:10.048349  9876 consensus_queue.cc:237] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:10.262639  9833 raft_consensus.cc:515] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:15:10.181207  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 224318us
I20260709 12:15:10.185438  5124 raft_consensus.cc:2468] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 13.
I20260709 12:15:10.197875  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:15:10.199774  5801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:10.194483  5119 raft_consensus.cc:606] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Received request to transfer leadership to TS bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:10.201467  9832 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:15:10.218075  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:10.216073 10023 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:10.217917  5194 raft_consensus.cc:2468] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 10.
I20260709 12:15:10.227066  9883 raft_consensus.cc:515] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:10.237346  9949 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:10.220561  5088 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:10.243821  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:10.237174  9943 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 16 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:10.253533  5237 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:10.253858  9987 leader_election.cc:290] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:10.254491  9933 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:10.265969  5804 leader_election.cc:304] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:15:10.267196  5803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:10.195416  9931 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:10.274011  5119 raft_consensus.cc:614] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:10.251538  9910 leader_election.cc:290] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:10.279160  9921 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:15:10.286340  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 66006.3us
I20260709 12:15:10.288197  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:10.279422  9931 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:10.294860  9910 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:10.295794  5240 leader_election.cc:304] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:10.297598  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:10.297979  9725 consensus_queue.cc:1048] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:15:10.299669  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:10.300554  5116 raft_consensus.cc:2468] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 10.
W20260709 12:15:10.301620  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 55206.1us
I20260709 12:15:10.302150  9949 raft_consensus.cc:2804] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:10.302695  9949 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:10.293949  5122 raft_consensus.cc:2468] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 14.
I20260709 12:15:10.308717  9936 raft_consensus.cc:2749] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:10.315282 10022 raft_consensus.cc:493] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:10.305305  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:10.312866  5088 leader_election.cc:304] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:10.303089  9949 raft_consensus.cc:3060] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:10.308164  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:10.318051 10012 consensus_queue.cc:1048] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 12:15:10.246479  5266 rpcz_store.cc:276] 0709 12:15:08.533999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:08.534169 (+   170us) service_pool.cc:224] Handling call
0709 12:15:08.615570 (+ 81401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:08.626263 (+ 10693us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:08.626300 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:08.641183 (+ 14883us) log.cc:844] Serialized 26 byte log entry
0709 12:15:08.845980 (+204797us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:15:08.846051 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:08.846168 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:10.074130 (+1227962us) spinlock_profiling.cc:243] Waited 1.56 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e675e86e 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221 00007f84e67671d9 00007f84e6767169
0709 12:15:10.245269 (+171139us) raft_consensus.cc:1685] finished
0709 12:15:10.245311 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:10.245678 (+   367us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10898,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":5651,"spinlock_wait_cycles":3582336,"thread_start_us":162925,"threads_started":1,"wal-append.queue_time_us":553352}
W20260709 12:15:10.328964  5803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:10.303170  5237 leader_election.cc:304] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:10.331142  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:10.334921  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:10.335610  5123 raft_consensus.cc:2468] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 10.
I20260709 12:15:10.336526  5123 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
new_leader_uuid: "bce73265e27d4b30a4dcc1e491305088"
 from {username='slave'} at 127.0.0.1:45628
I20260709 12:15:10.337105  5123 raft_consensus.cc:606] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Received request to transfer leadership to TS bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:10.343528  5123 raft_consensus.cc:614] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:10.304598 10011 raft_consensus.cc:2749] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:10.338339  9868 leader_election.cc:290] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:10.338919  5121 raft_consensus.cc:1240] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 LEADER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:10.340289  5120 raft_consensus.cc:2393] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 8: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:15:10.340899  5237 leader_election.cc:304] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:10.335899  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:10.341826  9919 raft_consensus.cc:2804] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:10.342229  9883 leader_election.cc:290] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:10.342439  9527 raft_consensus.cc:3060] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:10.311827  9921 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:10.358713  5119 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 12.
I20260709 12:15:10.359375  5123 raft_consensus.cc:1275] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:15:10.369073  5120 raft_consensus.cc:1275] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 12:15:10.349961  9978 log.cc:927] Time spent T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 1.110s	user 0.003s	sys 0.002s
I20260709 12:15:10.355046  9919 raft_consensus.cc:493] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:10.323235 10022 raft_consensus.cc:515] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:10.376317  9833 leader_election.cc:290] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:10.384213  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:10.385061  5195 raft_consensus.cc:2468] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 8.
I20260709 12:15:10.387630  9754 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:10.388481  9754 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:10.390368  9910 raft_consensus.cc:2749] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:10.391477  9898 raft_consensus.cc:493] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:10.392138  9933 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:10.395208  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:15:10.398607  5802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:10.403781  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 63065.7us
W20260709 12:15:10.403949  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 112011us
I20260709 12:15:10.393987  9726 leader_election.cc:290] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:10.395612 10009 raft_consensus.cc:2804] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:10.395442  5804 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:10.403816  9919 raft_consensus.cc:3060] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:10.416936  9369 consensus_queue.cc:1048] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:15:10.417874 10030 consensus_queue.cc:1048] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:15:10.399667  9937 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.007s	sys 0.000s
W20260709 12:15:10.420819  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 44549.8us
I20260709 12:15:10.423784  9744 raft_consensus.cc:2804] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:15:10.423799  9894 raft_consensus.cc:2804] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:10.407763 10023 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:10.395888  9754 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:15:10.422463  9937 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.008s	sys 0.000s
I20260709 12:15:10.408452 10009 raft_consensus.cc:493] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:10.409884  9921 raft_consensus.cc:493] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:10.436269  9744 raft_consensus.cc:697] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 8 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:10.425632  9894 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:10.443931  5240 leader_election.cc:304] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:10.446833  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
W20260709 12:15:10.449186  9806 consensus_meta.cc:287] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.560s	user 0.013s	sys 0.012s
I20260709 12:15:10.449815  5195 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f"
dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
mode: GRACEFUL
new_leader_uuid: "bce73265e27d4b30a4dcc1e491305088"
 from {username='slave'} at 127.0.0.1:53902
I20260709 12:15:10.452687 10009 raft_consensus.cc:3060] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:10.453933  9980 leader_election.cc:290] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:10.454213  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:10.392180  9898 raft_consensus.cc:515] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:10.453119  5801 leader_election.cc:304] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:10.472229  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:10.472606  9754 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:10.473523  9754 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:10.474354  9744 consensus_queue.cc:237] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:10.476406  9754 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:10.399406  9941 raft_consensus.cc:515] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:10.462155  9894 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:10.454170  9933 consensus_queue.cc:1059] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 12:15:10.484272  9981 raft_consensus.cc:2804] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:10.485713  9981 raft_consensus.cc:493] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:10.486088  9954 raft_consensus.cc:493] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:10.482563  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:10.489009  5193 raft_consensus.cc:2468] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 10.
I20260709 12:15:10.489674  9945 raft_consensus.cc:493] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:10.490391  9945 raft_consensus.cc:515] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:10.486119  9981 raft_consensus.cc:3060] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:10.494731  5199 raft_consensus.cc:2410] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:15:10.492965  9945 leader_election.cc:290] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:10.498399  9889 raft_consensus.cc:2749] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:10.486768  9954 raft_consensus.cc:515] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:15:10.498624  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 54808.6us
I20260709 12:15:10.500161  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
W20260709 12:15:10.500653  9783 consensus_meta.cc:287] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.858s	user 0.013s	sys 0.008s
W20260709 12:15:10.502646  9946 consensus_meta.cc:287] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.749s	user 0.011s	sys 0.008s
I20260709 12:15:10.503074  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:10.480690  9938 raft_consensus.cc:493] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
W20260709 12:15:10.506268  9985 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.008s	sys 0.003s
I20260709 12:15:10.478720  9806 raft_consensus.cc:515] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:10.523277  5804 leader_election.cc:304] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:15:10.524871  5804 leader_election.cc:304] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
W20260709 12:15:10.525141  9918 consensus_meta.cc:287] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.612s	user 0.003s	sys 0.011s
I20260709 12:15:10.529625  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:10.511689  9921 raft_consensus.cc:515] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:10.532402  9921 leader_election.cc:290] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:15:10.517522  9985 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.811s	user 0.009s	sys 0.003s
I20260709 12:15:10.544625  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:10.544652  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:10.549937  5199 raft_consensus.cc:1275] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:15:10.552680  5118 raft_consensus.cc:2468] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 11.
I20260709 12:15:10.533595  9918 raft_consensus.cc:2804] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:10.534121  9931 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:10.569515  5240 leader_election.cc:304] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:10.571398  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:10.551434 10030 raft_consensus.cc:493] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:10.572927  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:10.577227  5196 raft_consensus.cc:2393] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 12: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:15:10.520418  9783 raft_consensus.cc:515] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:10.566623  9918 raft_consensus.cc:493] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:10.518424  9946 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:10.586606  9918 raft_consensus.cc:3060] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:10.591924  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:10.583312  9985 raft_consensus.cc:2804] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:10.606200  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:10.606285  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:10.606904  5192 raft_consensus.cc:1240] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:15:10.607649  9960 raft_consensus.cc:3060] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:10.608917  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:10.609794  5195 raft_consensus.cc:606] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Received request to transfer leadership to TS bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:10.610255  5195 raft_consensus.cc:614] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:10.567183 10000 raft_consensus.cc:515] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:15:10.606180  5091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:10.613592  9935 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:10.628180  9935 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:10.614130  9744 raft_consensus.cc:2749] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:10.615214  5266 raft_consensus.cc:1275] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:15:10.615479  9898 leader_election.cc:290] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:10.617885 10022 leader_election.cc:290] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:10.618841  9941 leader_election.cc:290] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:15:10.620428  9909 consensus_meta.cc:287] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.804s	user 0.008s	sys 0.015s
I20260709 12:15:10.621416  5838 raft_consensus.cc:1275] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:15:10.623157  9954 leader_election.cc:290] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:10.647632  9935 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:10.652638  5116 raft_consensus.cc:2468] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 11.
I20260709 12:15:10.605026  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:10.643384  9986 raft_consensus.cc:493] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:10.654399  9986 raft_consensus.cc:515] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:10.644338  9946 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:10.657166  5116 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
new_leader_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:45628
W20260709 12:15:10.659287 10033 log.cc:927] Time spent T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:15:10.663390  9986 leader_election.cc:290] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:10.664120  5838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46100 (request call id 1263) took 1243 ms. Trace:
I20260709 12:15:10.664528  5838 rpcz_store.cc:276] 0709 12:15:09.420340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:09.421083 (+   743us) service_pool.cc:224] Handling call
0709 12:15:09.421358 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:10.642875 (+1221517us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:10.663793 (+ 20918us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54003d2f54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:15:10.664019 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2757537536}
I20260709 12:15:10.666429  9894 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:10.666929  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:10.667165  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:10.667913  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:10.668448  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:10.668670  5274 raft_consensus.cc:2468] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 11.
I20260709 12:15:10.669405  5267 raft_consensus.cc:3060] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:10.669971  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:10.670406  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:10.668663  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:10.670969  5266 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:10.602948  9985 raft_consensus.cc:493] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:10.668000  5272 raft_consensus.cc:2468] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 10.
I20260709 12:15:10.580191  9938 raft_consensus.cc:515] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:15:10.675206  9885 consensus_meta.cc:287] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.560s	user 0.013s	sys 0.003s
I20260709 12:15:10.675352  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:10.665220 10030 raft_consensus.cc:515] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:10.675865 10040 log.cc:927] Time spent T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 12:15:10.676656 10035 log.cc:927] Time spent T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 12:15:10.632874  5804 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:10.681048  9876 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:10.683862 10030 leader_election.cc:290] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:15:10.684248  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 87584.3us
I20260709 12:15:10.606580  9806 leader_election.cc:290] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:10.671121  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:10.664896  9783 leader_election.cc:290] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:10.691133  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:10.681396  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:10.694669  9861 raft_consensus.cc:2804] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:10.698611  9861 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
W20260709 12:15:10.692076  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 141596us
I20260709 12:15:10.699064  9861 raft_consensus.cc:3060] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:10.700999  5240 leader_election.cc:304] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:10.702181  9892 raft_consensus.cc:2749] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:10.702674  5240 leader_election.cc:304] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:15:10.703536  9892 raft_consensus.cc:2804] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:10.704030  9892 raft_consensus.cc:493] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:10.704478  9892 raft_consensus.cc:3060] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:10.706261  9928 raft_consensus.cc:493] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:10.706669  5237 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:10.706844  9928 raft_consensus.cc:515] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:10.709951  9928 leader_election.cc:290] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:10.702612  9938 leader_election.cc:290] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:10.711408  5191 raft_consensus.cc:2468] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 14.
I20260709 12:15:10.693914 10000 leader_election.cc:290] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:10.694509  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:10.694674  5835 raft_consensus.cc:2468] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 10.
I20260709 12:15:10.688800  5270 raft_consensus.cc:2468] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 11.
I20260709 12:15:10.683885  9876 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:10.696168  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:10.682441  9894 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:10.681248  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:10.678974  9985 raft_consensus.cc:3060] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:10.712527  9918 raft_consensus.cc:515] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:10.713418 10036 raft_consensus.cc:3055] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:15:10.680830  9909 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:15:10.714780 10039 log.cc:927] Time spent T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 12:15:10.714278  9861 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:10.738173  5117 raft_consensus.cc:2468] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 14.
I20260709 12:15:10.738790  9861 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:10.719424  5267 raft_consensus.cc:2468] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 11.
I20260709 12:15:10.684059  9885 raft_consensus.cc:515] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:10.734182  9935 consensus_queue.cc:1048] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:15:10.737061  9909 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:10.726588 10034 raft_consensus.cc:493] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:10.727088  9923 raft_consensus.cc:493] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:10.728345  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:10.689916  5089 leader_election.cc:304] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:10.733475  5237 leader_election.cc:304] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:10.687319  9998 raft_consensus.cc:515] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:10.748337  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:10.726040  9960 raft_consensus.cc:493] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:10.755792  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:10.756501  5117 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:10.731424 10036 raft_consensus.cc:740] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:15:10.758733  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:10.734306  9744 raft_consensus.cc:2749] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:10.746313  5266 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 14.
I20260709 12:15:10.762987  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:10.764195  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:10.764519  9885 leader_election.cc:290] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:10.774037  9891 consensus_queue.cc:1048] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:15:10.765020  5125 raft_consensus.cc:2468] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 10.
I20260709 12:15:10.766703  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:10.778967  5116 raft_consensus.cc:606] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Received request to transfer leadership to TS 9e794b72ed7640219f90ec4232363929
I20260709 12:15:10.770835  9876 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:10.779402  5116 raft_consensus.cc:614] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:10.755968  9949 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:10.772002  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:10.762925  5835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46100 (request call id 1271) took 1109 ms. Trace:
I20260709 12:15:10.784024  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:10.783141  5237 leader_election.cc:304] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:10.778991  5199 raft_consensus.cc:3060] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:10.791247  5273 raft_consensus.cc:2393] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 14: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:15:10.791394  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:10.792002  5119 raft_consensus.cc:3060] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:10.785261  5835 rpcz_store.cc:276] 0709 12:15:09.653950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:09.710821 (+ 56871us) service_pool.cc:224] Handling call
0709 12:15:10.762708 (+1051887us) spinlock_profiling.cc:243] Waited 979 ms on lock 0x7b5400457254. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:15:10.762847 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2251552000}
W20260709 12:15:10.794257  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 46431.3us
I20260709 12:15:10.795243  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:10.791082 10006 raft_consensus.cc:3060] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:10.800707  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:10.802055  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:10.802836  5273 raft_consensus.cc:2410] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:15:10.779795  9941 raft_consensus.cc:2764] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
W20260709 12:15:10.809521  5803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:10.768904  9892 raft_consensus.cc:515] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:10.811939  5119 raft_consensus.cc:2468] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 11.
I20260709 12:15:10.814749  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:10.819329  5267 raft_consensus.cc:2468] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 12.
W20260709 12:15:10.821825  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 103987us
I20260709 12:15:10.827505  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:10.829921  9771 raft_consensus.cc:493] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:10.830147 10036 consensus_queue.cc:260] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:10.830641  9771 raft_consensus.cc:515] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:10.831326 10036 raft_consensus.cc:3060] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:10.831705  9892 leader_election.cc:290] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:10.834913  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:10.836772  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:10.839046  9898 raft_consensus.cc:493] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:10.839464  9771 leader_election.cc:290] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:10.839856  9998 leader_election.cc:290] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:15:10.840538  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 47496.7us
I20260709 12:15:10.841149  9935 consensus_queue.cc:1059] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:15:10.841619 10022 consensus_queue.cc:1048] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:15:10.837591  5265 raft_consensus.cc:2468] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 12.
I20260709 12:15:10.842924  9885 consensus_queue.cc:1048] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:15:10.843034  5269 raft_consensus.cc:2393] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 11: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:15:10.841116  9898 raft_consensus.cc:515] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:10.818949  9960 raft_consensus.cc:515] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:10.848290  9898 leader_election.cc:290] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:10.848562  9960 leader_election.cc:290] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:10.848485  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:10.849510  5200 raft_consensus.cc:3060] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:10.850621  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:10.851281  5116 raft_consensus.cc:3060] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:15:10.853902  5802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:10.855759  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:10.858541  5200 raft_consensus.cc:2468] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 15.
I20260709 12:15:10.858753  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:10.862777  5237 leader_election.cc:304] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:10.864740  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:10.868640  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:10.875089  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:10.780215 10034 raft_consensus.cc:515] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:10.797823  9783 consensus_queue.cc:1048] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 12:15:10.919160  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:10.918015  5088 leader_election.cc:304] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:10.921221  5272 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 13.
W20260709 12:15:10.919638  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 402550us
I20260709 12:15:10.861719 10000 raft_consensus.cc:2749] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:10.826479  9891 consensus_queue.cc:1048] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 12:15:10.920337  5124 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
new_leader_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:45628
I20260709 12:15:10.930367  5124 raft_consensus.cc:606] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Received request to transfer leadership to TS 9e794b72ed7640219f90ec4232363929
I20260709 12:15:10.930742  5124 raft_consensus.cc:614] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:10.926183  5267 raft_consensus.cc:1275] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:15:10.928241  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:10.933640  9960 raft_consensus.cc:2804] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:10.934221  9960 raft_consensus.cc:493] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:10.934576  9960 raft_consensus.cc:3060] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:10.810194  9923 raft_consensus.cc:515] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:10.937170  5801 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:10.942209  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:10.944303  5274 raft_consensus.cc:2468] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 14.
I20260709 12:15:10.945750  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:10.946962  9981 raft_consensus.cc:515] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:10.953503  9771 consensus_queue.cc:1048] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:15:10.955063  9981 leader_election.cc:290] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:10.956921  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:10.957859  5835 raft_consensus.cc:2393] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 11: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:15:10.957670  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:10.924611  9744 raft_consensus.cc:3055] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:15:10.964663  9744 raft_consensus.cc:740] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:10.963763  9979 raft_consensus.cc:493] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:10.970480  5197 raft_consensus.cc:2410] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:15:10.970341  5119 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
new_leader_uuid: "bce73265e27d4b30a4dcc1e491305088"
 from {username='slave'} at 127.0.0.1:45628
I20260709 12:15:10.973505  5199 raft_consensus.cc:2468] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 11.
I20260709 12:15:10.974864  5116 raft_consensus.cc:2468] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 15.
I20260709 12:15:10.977600  5119 raft_consensus.cc:606] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Received request to transfer leadership to TS bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:10.978036  5119 raft_consensus.cc:614] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:10.980679  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:15:10.982576  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 123229us
I20260709 12:15:10.985723  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:10.986217  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:10.970136  9744 consensus_queue.cc:260] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:10.986536  5838 raft_consensus.cc:2468] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 13.
I20260709 12:15:10.987387  9744 raft_consensus.cc:3060] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:10.987607  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:10.988787  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:10.989492  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:10.990810  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:10.991182  5832 raft_consensus.cc:1240] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:10.992254  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:10.992836  5123 raft_consensus.cc:3060] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:10.993460  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:10.993654  9988 raft_consensus.cc:2749] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:10.994050  5124 raft_consensus.cc:3060] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:10.994560  9979 raft_consensus.cc:515] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:10.995749  9811 raft_consensus.cc:493] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:10.996258  9811 raft_consensus.cc:515] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:10.988720  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:10.998236  5830 raft_consensus.cc:2468] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 11.
I20260709 12:15:10.991420  5829 raft_consensus.cc:2468] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 9.
I20260709 12:15:10.999218  5118 raft_consensus.cc:3060] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:10.999671  5838 raft_consensus.cc:3060] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:11.003244  5123 raft_consensus.cc:2468] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 11.
I20260709 12:15:10.985136  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:10.998121  9918 leader_election.cc:290] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:10.996790  9979 leader_election.cc:290] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:11.018998  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:11.031076  9811 leader_election.cc:290] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:11.038627  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:11.039459  5197 raft_consensus.cc:2368] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 10. Current term is 11.
I20260709 12:15:11.050078  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:15:11.053848  9928 raft_consensus.cc:2804] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:11.054642  9928 raft_consensus.cc:697] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 15 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:11.005820  9949 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:15:11.053748  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 191066us
W20260709 12:15:11.065573  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 128601us
I20260709 12:15:11.056749  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:11.070482  9799 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:11.070253  9928 consensus_queue.cc:237] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:11.070713  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:11.069412  5088 leader_election.cc:304] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:11.078995  5117 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 14.
I20260709 12:15:11.074618  5801 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:11.084015  5195 raft_consensus.cc:2468] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 11.
I20260709 12:15:11.096153  5124 raft_consensus.cc:2468] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 14.
W20260709 12:15:11.109941  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 125583us
I20260709 12:15:11.083940  9799 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:11.126365  9799 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:11.104096  9918 raft_consensus.cc:2804] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:15:11.139863  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 70579.3us
W20260709 12:15:11.143850  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 77432.4us
I20260709 12:15:11.152348  5838 raft_consensus.cc:2468] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 16.
I20260709 12:15:11.153925  5200 raft_consensus.cc:2468] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 14.
I20260709 12:15:11.152348  5118 raft_consensus.cc:2468] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 15.
I20260709 12:15:11.139992  9918 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:11.149926  9811 raft_consensus.cc:493] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:11.152992  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:11.160960  5238 leader_election.cc:304] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:11.160527  5237 leader_election.cc:304] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:11.120353  9985 raft_consensus.cc:515] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:11.142994  9799 raft_consensus.cc:2764] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 12:15:11.162097  5834 raft_consensus.cc:1240] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:15:11.146742  9898 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:11.172144  9898 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:11.173272  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:11.173673  5801 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:11.174531  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:11.175112  5801 leader_election.cc:304] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:11.176482  5801 leader_election.cc:304] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:15:11.177026  9985 leader_election.cc:290] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:11.169073  9811 raft_consensus.cc:515] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:11.178942  9919 consensus_meta.cc:287] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.762s	user 0.012s	sys 0.002s
I20260709 12:15:11.179409  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:11.179695  9923 leader_election.cc:290] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:11.165210  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:11.184520  5837 raft_consensus.cc:1275] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:15:11.164783  9918 raft_consensus.cc:3060] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:11.185708 10007 raft_consensus.cc:493] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:11.186419 10007 raft_consensus.cc:515] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:11.188777 10007 leader_election.cc:290] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:11.142112 10034 leader_election.cc:290] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:11.166292  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:11.167179  5832 raft_consensus.cc:2410] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:15:11.160001  9892 raft_consensus.cc:493] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:11.190943  9892 raft_consensus.cc:515] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:11.191223  9981 raft_consensus.cc:2749] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:11.192062  9981 raft_consensus.cc:2749] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:11.192786  9981 raft_consensus.cc:2804] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:11.170924 10006 raft_consensus.cc:2749] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:11.193149  9892 leader_election.cc:290] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:11.194209  9892 raft_consensus.cc:2804] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:11.178977  5088 leader_election.cc:400] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 election: Vote denied by peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455) with higher term. Message: Invalid argument: T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 10. Current term is 11.
I20260709 12:15:11.195039  5088 leader_election.cc:403] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:15:11.194993  9892 raft_consensus.cc:697] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 11 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:11.196072  9892 consensus_queue.cc:237] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:11.179451  9919 raft_consensus.cc:515] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:11.197589  9754 raft_consensus.cc:2749] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455) with higher term. Message: Invalid argument: T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 10. Current term is 11.
W20260709 12:15:11.197964 10045 log.cc:927] Time spent T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 12:15:11.198567  9919 leader_election.cc:290] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:11.201334  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:11.193243  9981 raft_consensus.cc:697] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 11 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:15:11.204821  9783 raft_consensus.cc:493] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:11.203509  9981 consensus_queue.cc:237] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:11.205417  9783 raft_consensus.cc:515] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:15:11.206276  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 56327us
I20260709 12:15:11.207547  9783 leader_election.cc:290] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:11.189643  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:11.208398  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:11.209739  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:11.190845  5123 raft_consensus.cc:1275] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:15:11.210192  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:11.191365  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:11.209513  5833 raft_consensus.cc:2410] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 12:15:11.191309  5836 raft_consensus.cc:2393] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 11: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:15:11.228818  5835 raft_consensus.cc:3060] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:11.209214  5196 raft_consensus.cc:1275] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 12:15:11.230795  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 44877.9us
I20260709 12:15:11.196197  5088 leader_election.cc:304] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:11.235760  5240 leader_election.cc:304] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:15:11.238621  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:11.240257  5240 leader_election.cc:304] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:15:11.240341  5804 leader_election.cc:304] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:11.244076  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:11.209033  9930 raft_consensus.cc:2804] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:11.246963  5240 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:11.252272  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:11.253029  5195 raft_consensus.cc:3060] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:11.258987  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:11.243395 10006 raft_consensus.cc:2804] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:11.246367  9923 raft_consensus.cc:2804] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:11.279085  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:11.279124  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:11.279431  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:11.248585  9930 raft_consensus.cc:493] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:11.269454  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:11.258344 10036 raft_consensus.cc:2749] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:11.291167  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:11.292037  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:11.254477 10000 raft_consensus.cc:2804] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:11.297739  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:11.298489  5266 raft_consensus.cc:2468] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 11.
I20260709 12:15:11.245462  9960 raft_consensus.cc:515] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:11.302309  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:11.304469  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:11.305203  5117 raft_consensus.cc:3060] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:11.305936  5801 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:11.278730  9799 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:11.308914  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:11.310989  5270 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:11.264073 10030 raft_consensus.cc:2804] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:11.313580  5118 raft_consensus.cc:2368] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 13. Current term is 14.
I20260709 12:15:11.293145  9930 raft_consensus.cc:3060] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:15:11.316602  5240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:11.264460  9919 consensus_queue.cc:1048] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:15:11.320448 10000 raft_consensus.cc:697] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 14 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:11.320672  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:11.319749  5088 leader_election.cc:304] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:11.302467 10006 raft_consensus.cc:697] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:11.324584  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:11.326470  5163 leader_election.cc:304] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:11.326368  5124 raft_consensus.cc:2468] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 10.
W20260709 12:15:11.327327  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 101176us
I20260709 12:15:11.328015  9898 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:11.328617  9898 raft_consensus.cc:2804] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:11.334223  5122 raft_consensus.cc:2393] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 11: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:15:11.335060  5801 leader_election.cc:304] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:11.328908  5163 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:11.312928  9986 raft_consensus.cc:493] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:11.328987  9898 raft_consensus.cc:493] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:11.335893  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:11.339613  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:11.344794  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:11.339540  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:11.317741  9923 raft_consensus.cc:697] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 11 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:11.348843  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:11.349197  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:11.350020  5837 raft_consensus.cc:2468] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 12.
I20260709 12:15:11.350339  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:11.350937  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:11.351629  5837 raft_consensus.cc:2393] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 11: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:15:11.351488  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:11.352154  5269 raft_consensus.cc:2468] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 7.
I20260709 12:15:11.352416  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:11.353008  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:11.326647 10030 raft_consensus.cc:697] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 15 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:11.353693  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:11.348861  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:11.354768  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:11.380532  5837 raft_consensus.cc:2393] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 14: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
W20260709 12:15:11.381323  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 93895us
I20260709 12:15:11.356056  5117 raft_consensus.cc:2468] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 12.
I20260709 12:15:11.379994  5832 raft_consensus.cc:2468] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 13.
I20260709 12:15:11.363099  5272 raft_consensus.cc:2368] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 11. Current term is 12.
I20260709 12:15:11.363404  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:11.387794  5124 raft_consensus.cc:3060] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:15:11.363512  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 43843.2us
I20260709 12:15:11.364513  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:11.343055 10036 raft_consensus.cc:2749] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:15:11.365135  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:11.368906  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:11.372396  9923 consensus_queue.cc:237] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:11.375120  9876 consensus_queue.cc:1048] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:15:11.348755  9783 raft_consensus.cc:2804] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:11.376344  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:11.321429  9998 raft_consensus.cc:493] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:11.307966  9806 consensus_queue.cc:1048] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:15:11.378391  5163 leader_election.cc:304] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:11.386323  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:11.386329  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:11.391117  5195 raft_consensus.cc:2468] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 12.
I20260709 12:15:11.406355  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:11.403481  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:15:11.409886  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 45942.2us
I20260709 12:15:11.411074  5834 raft_consensus.cc:1240] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:11.358193  5270 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 14.
I20260709 12:15:11.360635  5801 leader_election.cc:304] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:15:11.391764  5164 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:11.354902  9898 raft_consensus.cc:3060] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:11.415637  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:11.366555 10034 raft_consensus.cc:2749] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:11.399601  5088 leader_election.cc:304] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:15:11.417101  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:11.364212 10007 raft_consensus.cc:2749] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:15:11.418430  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 57862.8us
I20260709 12:15:11.420468  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:11.422281  5836 raft_consensus.cc:2393] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 11: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:15:11.423255  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:11.420990  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:11.422425  5269 raft_consensus.cc:2468] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 16.
I20260709 12:15:11.431387  5088 leader_election.cc:304] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:11.432668  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:11.433517  5837 raft_consensus.cc:3060] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:11.401692  9783 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:11.412493  9954 raft_consensus.cc:2804] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:11.365643  9799 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:11.443970  5088 leader_election.cc:304] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:11.450268  5238 leader_election.cc:304] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:11.457998  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:11.459614  5238 leader_election.cc:304] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:11.463193  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:11.402259  9986 raft_consensus.cc:515] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:11.429322  9985 raft_consensus.cc:2804] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:11.438360  9754 raft_consensus.cc:2804] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:11.440258  9783 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:11.474843  5238 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:11.443614  9885 raft_consensus.cc:2749] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:11.476011  5120 raft_consensus.cc:1275] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:15:11.476737  5117 raft_consensus.cc:1275] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:15:11.449015  9954 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:11.485427  9919 raft_consensus.cc:2804] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:11.485906  9919 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:11.486284  9919 raft_consensus.cc:3060] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:11.435050  9998 raft_consensus.cc:515] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:11.489722  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:11.472273  9771 raft_consensus.cc:2749] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:11.494482  5836 raft_consensus.cc:2468] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 12.
I20260709 12:15:11.474160 10007 raft_consensus.cc:2749] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:11.473649  9985 raft_consensus.cc:493] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:11.478013  9754 raft_consensus.cc:493] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:11.490751 10030 consensus_queue.cc:237] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:11.515204  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:15:11.559993  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 60774.5us
I20260709 12:15:11.540320  9918 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:11.439481 10006 consensus_queue.cc:237] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:11.492923  9799 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:11.477172  9941 raft_consensus.cc:2749] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:11.508970  9986 leader_election.cc:290] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:11.483402  9954 raft_consensus.cc:3060] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:11.547827  5801 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:15:11.557992  5835 raft_consensus.cc:2468] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 11.
I20260709 12:15:11.580052  5124 raft_consensus.cc:2468] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 11.
W20260709 12:15:11.503175 10009 consensus_meta.cc:287] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 1.013s	user 0.015s	sys 0.000s
I20260709 12:15:11.535889  9876 consensus_queue.cc:1059] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:15:11.560779  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:11.561815  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:11.563602  9960 leader_election.cc:290] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:11.570693  5804 leader_election.cc:400] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 election: Vote denied by peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443) with higher term. Message: Invalid argument: T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 13. Current term is 14.
W20260709 12:15:11.559098 10051 log.cc:927] Time spent T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.224s	user 0.000s	sys 0.003s
I20260709 12:15:11.499897  9811 leader_election.cc:290] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:11.576035  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:11.598343  5269 raft_consensus.cc:2468] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 12.
I20260709 12:15:11.573364  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:11.578061  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:11.556883  9985 raft_consensus.cc:3060] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:11.587828 10009 raft_consensus.cc:515] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:11.601181  5121 raft_consensus.cc:1240] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:11.602258 10009 leader_election.cc:290] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:11.562356  9754 raft_consensus.cc:3060] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:11.606412  9998 leader_election.cc:290] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:11.614396  5166 leader_election.cc:304] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:11.455221 10000 consensus_queue.cc:237] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:11.585470  5832 raft_consensus.cc:1240] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:11.590740  5804 leader_election.cc:403] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:15:11.599640  5837 raft_consensus.cc:2468] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 14.
W20260709 12:15:11.619616  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 51271.4us
I20260709 12:15:11.622004  5804 leader_election.cc:304] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:15:11.589138  9986 raft_consensus.cc:2804] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:11.626960  5089 leader_election.cc:304] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:15:11.623889  5804 leader_election.cc:304] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
W20260709 12:15:11.638463  5804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:11.645473  5830 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.011s	sys 0.031s
W20260709 12:15:11.645913  5830 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.011s	sys 0.031s
I20260709 12:15:11.627862  9811 raft_consensus.cc:2764] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:15:11.655009  5801 leader_election.cc:304] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:15:11.624734 10034 raft_consensus.cc:2749] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443) with higher term. Message: Invalid argument: T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 13. Current term is 14.
I20260709 12:15:11.662186  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:15:11.661732  9928 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.040s	sys 0.063s
I20260709 12:15:11.653698  9894 raft_consensus.cc:2804] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:15:11.687418  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 60549.3us
I20260709 12:15:11.695220  9898 raft_consensus.cc:515] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:11.698135  9898 leader_election.cc:290] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:11.701746  5121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59390 (request call id 1001) took 1004 ms. Trace:
I20260709 12:15:11.704330  5089 leader_election.cc:304] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:11.677692 10009 raft_consensus.cc:2804] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:11.703297  5121 rpcz_store.cc:276] 0709 12:15:10.689783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:10.692762 (+  2979us) service_pool.cc:224] Handling call
0709 12:15:10.693051 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:11.601604 (+908553us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:11.693971 (+ 92367us) spinlock_profiling.cc:243] Waited 908 ms on lock 0x7b540038e5d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:15:11.694184 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2088055680}
I20260709 12:15:11.708940  5089 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:11.711040  5089 leader_election.cc:304] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:15:11.686448  9928 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.040s	sys 0.063s
I20260709 12:15:11.653887 10036 consensus_queue.cc:1048] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
W20260709 12:15:11.701704  5199 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.021s	sys 0.021s
W20260709 12:15:11.715396  5199 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.021s	sys 0.021s
I20260709 12:15:11.718798  9799 raft_consensus.cc:3060] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:11.708516  9894 raft_consensus.cc:697] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 12 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:15:11.743010  5089 leader_election.cc:304] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929
W20260709 12:15:11.743638  5831 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.023s	sys 0.027s
W20260709 12:15:11.714269  9946 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.004s	sys 0.036s
I20260709 12:15:11.719398  9811 raft_consensus.cc:2804] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:11.712951 10009 raft_consensus.cc:493] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
W20260709 12:15:11.742280  9892 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.016s	sys 0.036s
W20260709 12:15:11.747368  5831 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.023s	sys 0.027s
I20260709 12:15:11.717664  9898 raft_consensus.cc:2749] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:11.714351 10007 raft_consensus.cc:2749] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:11.824995  9985 raft_consensus.cc:515] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:11.747368  9981 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.011s	sys 0.028s
I20260709 12:15:11.720170  9754 raft_consensus.cc:515] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:11.774900  9946 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.004s	sys 0.037s
I20260709 12:15:11.743335  9909 raft_consensus.cc:2749] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:15:11.809702  5165 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.026s	sys 0.018s
W20260709 12:15:11.831374  5165 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.026s	sys 0.018s
I20260709 12:15:11.803757 10009 raft_consensus.cc:3060] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:15:11.804131  9892 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.016s	sys 0.036s
I20260709 12:15:11.801972  9811 raft_consensus.cc:493] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:11.811161  9771 raft_consensus.cc:3055] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:11.802275  9938 raft_consensus.cc:2764] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:15:11.853499  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
W20260709 12:15:11.815383  5010 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ddd16ccf58f24f6db29e5fc39a06e5c4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica ad2f9a1e2f7a45429fa69fd23d09f821 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
W20260709 12:15:11.821830  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 78900.3us
I20260709 12:15:11.855511  5089 leader_election.cc:304] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:11.822211  9894 consensus_queue.cc:237] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:11.823113  9783 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:11.827423  5838 raft_consensus.cc:2393] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 12: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
W20260709 12:15:11.827258  9981 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.011s	sys 0.028s
I20260709 12:15:11.805227  9918 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:15:11.842213  5265 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.043s	sys 0.030s
I20260709 12:15:11.850490  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:15:11.860445  5265 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.043s	sys 0.031s
I20260709 12:15:11.851481  5196 raft_consensus.cc:1240] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:11.851594  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:11.852089  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
W20260709 12:15:11.861832  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 244510us
I20260709 12:15:11.863966  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:11.862854  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:11.864156  5166 leader_election.cc:304] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:15:11.861406  5829 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.014s	sys 0.021s
I20260709 12:15:11.847925  9811 raft_consensus.cc:3060] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:15:11.868710  5829 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.015s	sys 0.021s
I20260709 12:15:11.872566  5166 leader_election.cc:304] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:11.862751 10007 raft_consensus.cc:2749] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:11.874130  5089 leader_election.cc:304] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:11.875475  9754 leader_election.cc:290] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:11.878209  5191 raft_consensus.cc:1240] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
W20260709 12:15:11.921276  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 48812.3us
I20260709 12:15:11.880767  9783 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:11.848074  9771 raft_consensus.cc:740] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:11.881440  5265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34672 (request call id 2407) took 1111 ms. Trace:
I20260709 12:15:11.881834  5193 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:11.887501  9799 raft_consensus.cc:2749] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:11.887979  9949 raft_consensus.cc:2804] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:11.890883  9985 leader_election.cc:290] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:11.891367  9919 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:11.901115  5833 raft_consensus.cc:1240] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:15:11.910943 10009 raft_consensus.cc:515] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:11.912544  9954 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:11.913527  9946 consensus_queue.cc:1048] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:11.915096 10054 raft_consensus.cc:493] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
W20260709 12:15:11.921674  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 47648.7us
I20260709 12:15:11.931334  5089 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:11.933213  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:11.933903  5191 raft_consensus.cc:3060] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Advancing to term 12
W20260709 12:15:11.926517  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 482561us
W20260709 12:15:11.926669  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 485378us
I20260709 12:15:11.935401  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:15:11.932013  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 489917us
W20260709 12:15:11.930234  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 455432us
I20260709 12:15:11.926443  9898 raft_consensus.cc:2749] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:15:11.933331  5240 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.012s	sys 0.018s
I20260709 12:15:11.927867  9938 raft_consensus.cc:2749] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:15:11.943881  5240 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.013s	sys 0.018s
I20260709 12:15:11.936291  5088 leader_election.cc:304] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:11.945526  5238 leader_election.cc:304] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:11.947544  5164 leader_election.cc:304] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:15:11.926679  5265 rpcz_store.cc:276] 0709 12:15:10.770304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:10.844856 (+ 74552us) service_pool.cc:224] Handling call
0709 12:15:10.845186 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:10.845564 (+   378us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:15:11.251906 (+406342us) log.cc:844] Serialized 14 byte log entry
0709 12:15:11.868765 (+616859us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:11.868864 (+    99us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:15:11.881120 (+ 12256us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:11.881206 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:11.881346 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7574,"prepare.queue_time_us":87815,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":8105,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":35863,"thread_start_us":973460,"threads_started":2}
W20260709 12:15:11.947335  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 592655us
I20260709 12:15:11.949797  5163 leader_election.cc:304] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:11.952889  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:11.959225  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:11.960180  5194 raft_consensus.cc:2393] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 11: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
W20260709 12:15:11.964649  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 309678us
I20260709 12:15:11.935197 10054 raft_consensus.cc:515] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:11.968044 10054 leader_election.cc:290] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:15:11.951330 10052 log.cc:927] Time spent T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 12:15:11.923486  5166 leader_election.cc:304] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:11.970849  5121 raft_consensus.cc:1240] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:11.985540  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:11.946978  9799 raft_consensus.cc:2749] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:11.935668 10058 raft_consensus.cc:2749] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:11.972177  5238 leader_election.cc:304] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:11.976255  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:12.016474  5191 raft_consensus.cc:2468] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 12.
W20260709 12:15:11.985311  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 61903us
I20260709 12:15:12.027822  5166 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:12.029301  5830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46100 (request call id 1281) took 1043 ms. Trace:
I20260709 12:15:11.958665  9935 raft_consensus.cc:2804] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:12.032526  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:12.034046  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:12.034551  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:12.032039  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:12.031312  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:12.035498  5838 raft_consensus.cc:2468] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 11.
I20260709 12:15:12.037580  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:12.038919  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:15:12.041105  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 104889us
I20260709 12:15:12.029775  5830 rpcz_store.cc:276] 0709 12:15:10.999286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:11.010925 (+ 11639us) service_pool.cc:224] Handling call
0709 12:15:11.032077 (+ 21152us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:11.032425 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:15:11.653120 (+620695us) log.cc:844] Serialized 14 byte log entry
0709 12:15:12.028952 (+375832us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:12.029007 (+    55us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:15:12.029060 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:12.029123 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:12.029240 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":815574,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":3122,"thread_start_us":907047,"threads_started":2}
I20260709 12:15:12.042035  5088 leader_election.cc:304] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:12.044421  5089 leader_election.cc:304] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:15:12.045842  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:11.988657  9986 raft_consensus.cc:697] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 14 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:15:11.993738  9938 raft_consensus.cc:2804] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:11.958822 10007 consensus_queue.cc:1059] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 12:15:12.036428  9935 raft_consensus.cc:493] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:12.047437  9923 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.022s	sys 0.027s
I20260709 12:15:11.951470  9771 consensus_queue.cc:260] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:11.993460  9988 consensus_queue.cc:1059] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.079s
I20260709 12:15:12.053359 10072 raft_consensus.cc:2804] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:15:12.073947  9930 consensus_meta.cc:287] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.739s	user 0.008s	sys 0.004s
I20260709 12:15:12.054764  9783 raft_consensus.cc:2804] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:15:12.073472  9799 raft_consensus.cc:2749] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:12.075213  9898 raft_consensus.cc:2749] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:15:12.132740  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 160629us
I20260709 12:15:12.033174  9754 consensus_queue.cc:1059] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 12:15:12.058387  9938 raft_consensus.cc:493] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:12.090154 10058 raft_consensus.cc:2749] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:15:12.144856  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 90445.5us
I20260709 12:15:12.192188  5166 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:12.193250  5166 leader_election.cc:304] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
W20260709 12:15:12.145720  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 92484.2us
W20260709 12:15:12.088411  9923 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.022s	sys 0.027s
I20260709 12:15:12.073451  9935 raft_consensus.cc:3060] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:12.144484  9891 raft_consensus.cc:2804] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:15:12.151943  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 204691us
I20260709 12:15:12.072429  9946 consensus_queue.cc:1048] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.094s
I20260709 12:15:12.229969  5116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40402 (request call id 2697) took 1238 ms. Trace:
I20260709 12:15:12.152400  9985 raft_consensus.cc:493] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:12.156491  9806 raft_consensus.cc:3055] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:15:12.143940  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 101980us
I20260709 12:15:12.144716 10000 raft_consensus.cc:493] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
W20260709 12:15:12.163489 10059 log.cc:927] Time spent T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 12:15:12.231709  5116 rpcz_store.cc:276] 0709 12:15:10.984793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:10.984910 (+   117us) service_pool.cc:224] Handling call
0709 12:15:10.985252 (+   342us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:15:10.985641 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:10.985671 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:15:10.986325 (+   654us) log.cc:844] Serialized 52 byte log entry
0709 12:15:11.264898 (+278573us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:15:11.264939 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:11.265008 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:12.222981 (+957973us) raft_consensus.cc:1685] finished
0709 12:15:12.223004 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:12.223145 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9578,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"thread_start_us":278177,"threads_started":1,"wal-append.queue_time_us":691832}
I20260709 12:15:12.174502  9754 raft_consensus.cc:3055] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:12.151706 10072 raft_consensus.cc:697] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:12.226220  9876 raft_consensus.cc:2749] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:12.153932 10067 raft_consensus.cc:2804] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:12.203994  9938 raft_consensus.cc:3060] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:12.190464  9894 raft_consensus.cc:493] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:12.233063 10022 raft_consensus.cc:2804] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:12.173786 10066 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:12.238570 10054 consensus_queue.cc:1048] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 12:15:12.249163 10067 raft_consensus.cc:493] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:12.278266 10067 raft_consensus.cc:3060] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:12.278762 10030 consensus_queue.cc:1059] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:15:12.279698 10030 raft_consensus.cc:3055] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:15:12.280122 10030 raft_consensus.cc:740] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:12.281833 10066 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:12.284397 10066 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:15:12.285256 10077 log.cc:927] Time spent T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 12:15:12.244403 10000 raft_consensus.cc:515] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:12.287566 10000 leader_election.cc:290] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:12.241333 10058 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:12.288254 10058 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:12.254232 10009 leader_election.cc:290] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:12.291319 10022 raft_consensus.cc:697] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:12.292387 10022 consensus_queue.cc:237] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:12.258271  9986 consensus_queue.cc:237] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:12.280907 10030 consensus_queue.cc:260] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:12.298607 10030 raft_consensus.cc:3060] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:12.301218 10058 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:12.306131  9935 raft_consensus.cc:515] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:12.248580  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 54216.3us
I20260709 12:15:12.236532  9771 raft_consensus.cc:3060] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:12.242867 10076 raft_consensus.cc:3055] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:12.319279 10076 raft_consensus.cc:740] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:15:12.236123  9806 raft_consensus.cc:740] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:12.155624  5238 leader_election.cc:304] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:12.326889  5831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46100 (request call id 1289) took 1166 ms. Trace:
I20260709 12:15:12.327351  5831 rpcz_store.cc:276] 0709 12:15:11.159986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:11.160239 (+   253us) service_pool.cc:224] Handling call
0709 12:15:11.173716 (+ 13477us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:11.174138 (+   422us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:11.174166 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:11.174676 (+   510us) log.cc:844] Serialized 26 byte log entry
0709 12:15:11.802799 (+628123us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:15:12.088185 (+285386us) log.cc:844] Serialized 14 byte log entry
0709 12:15:12.113624 (+ 25439us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:12.113708 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:12.319341 (+205633us) spinlock_profiling.cc:243] Waited 6.35 ms on lock 0x7b24002ecdd8. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e395c9c4 00007f84e395aacb 00007f84e3b15dc9 00007f84e3b15a55 00007f84e3b14fb0 00007f84e678b488 00007f84e678bbe8 00007f84e6763398 00007f84e675e76a 00007f84e675dbb6
0709 12:15:12.326582 (+  7241us) raft_consensus.cc:1685] finished
0709 12:15:12.326676 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:12.326817 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46277,"prepare.queue_time_us":70914,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":24,"raft.queue_time_us":119091,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":34204,"spinlock_wait_cycles":14609280,"thread_start_us":905085,"threads_started":2,"wal-append.queue_time_us":755537}
I20260709 12:15:12.330844 10067 raft_consensus.cc:515] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:12.244809  9919 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:12.349301  5120 raft_consensus.cc:1240] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:12.350781  5122 raft_consensus.cc:1275] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:15:12.354465  5271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34674 (request call id 2475) took 1013 ms. Trace:
I20260709 12:15:12.354926  5271 rpcz_store.cc:276] 0709 12:15:11.340926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:11.344531 (+  3605us) service_pool.cc:224] Handling call
0709 12:15:12.354270 (+1009739us) spinlock_profiling.cc:243] Waited 891 ms on lock 0x7b5400103bd4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:15:12.354401 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2050259840}
W20260709 12:15:12.358492  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 202930us
I20260709 12:15:12.360008  9935 leader_election.cc:290] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:12.358422  9928 raft_consensus.cc:3060] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:12.248238  9954 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:12.255918 10072 consensus_queue.cc:237] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:12.233263  9985 raft_consensus.cc:515] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:12.152195  9930 raft_consensus.cc:515] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:12.241401  9754 raft_consensus.cc:740] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:12.240199  9811 raft_consensus.cc:515] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:12.150923  9783 raft_consensus.cc:493] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
W20260709 12:15:12.243775  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 284244us
I20260709 12:15:12.374574  5164 leader_election.cc:304] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:12.375435 10096 raft_consensus.cc:2749] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:12.375844  5164 leader_election.cc:304] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
W20260709 12:15:12.143115  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 98773.8us
I20260709 12:15:12.358002 10067 leader_election.cc:290] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:12.376518  5118 raft_consensus.cc:1275] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:15:12.235240  9891 raft_consensus.cc:493] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:12.269834  9894 raft_consensus.cc:515] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:12.272639  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:12.238643  5088 leader_election.cc:304] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:12.307704  5273 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50932 (request call id 987) took 1017 ms. Trace:
I20260709 12:15:12.309403  5119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40402 (request call id 2704) took 1038 ms. Trace:
I20260709 12:15:12.331728  5269 raft_consensus.cc:1275] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:15:12.382261  5164 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:12.333601  5199 raft_consensus.cc:3060] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:15:12.252249 10062 log.cc:927] Time spent T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:15:12.320468 10076 consensus_queue.cc:260] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:12.340839  9949 raft_consensus.cc:493] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:12.341542  5193 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 14.
W20260709 12:15:12.387183  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 148601us
I20260709 12:15:12.388000  5837 raft_consensus.cc:1240] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:12.321188  9806 consensus_queue.cc:260] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:12.342631  9938 raft_consensus.cc:515] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:12.321197  5801 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:12.342527  5268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50932 (request call id 985) took 1077 ms. Trace:
I20260709 12:15:12.254106 10094 raft_consensus.cc:493] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:12.366597  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:12.369426  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:12.399921  5125 raft_consensus.cc:3060] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:12.373188  5804 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:15:12.400455  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 79322.8us
W20260709 12:15:12.336889 10073 log.cc:927] Time spent T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
I20260709 12:15:12.267061  5829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46100 (request call id 1284) took 1160 ms. Trace:
I20260709 12:15:12.382893  5119 rpcz_store.cc:276] 0709 12:15:11.271014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:11.271184 (+   170us) service_pool.cc:224] Handling call
0709 12:15:12.309154 (+1037970us) spinlock_profiling.cc:243] Waited 935 ms on lock 0x7b54003444d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:15:12.309313 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2149804928}
I20260709 12:15:12.382565  5273 rpcz_store.cc:276] 0709 12:15:11.290456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:11.290623 (+   167us) service_pool.cc:224] Handling call
0709 12:15:12.307357 (+1016734us) spinlock_profiling.cc:243] Waited 925 ms on lock 0x7b54002576d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:15:12.307500 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2128390912}
I20260709 12:15:12.377663  9783 raft_consensus.cc:3060] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:12.391852  5088 leader_election.cc:400] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 election: Vote denied by peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709) with higher term. Message: Invalid argument: T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 11. Current term is 12.
I20260709 12:15:12.382709  9891 raft_consensus.cc:3060] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:12.406654  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:12.398772  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:12.398579  5163 leader_election.cc:304] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:12.401683  5829 rpcz_store.cc:276] 0709 12:15:11.119816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:11.128182 (+  8366us) service_pool.cc:224] Handling call
0709 12:15:11.128518 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:11.128796 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:15:11.872274 (+743478us) log.cc:844] Serialized 14 byte log entry
0709 12:15:12.266680 (+394406us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:12.266748 (+    68us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:15:12.266795 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:12.266858 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:12.266985 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15374,"prepare.queue_time_us":744689,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":16333,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":103,"thread_start_us":1054470,"threads_started":2,"wal-append.queue_time_us":348675}
W20260709 12:15:12.406060 10099 log.cc:927] Time spent T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 12:15:12.410988  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:12.406605  9985 leader_election.cc:290] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:12.397941  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:12.401860  5801 leader_election.cc:304] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:12.415694  5088 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:12.392270 10096 raft_consensus.cc:2749] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:15:12.428056  5237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:12.457046  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:12.465644  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:12.466228  5119 raft_consensus.cc:3060] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:12.466619  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:12.467221  5191 raft_consensus.cc:2468] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 11.
I20260709 12:15:12.389525  9949 raft_consensus.cc:3060] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:12.391873  5268 rpcz_store.cc:276] 0709 12:15:11.265553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:11.265693 (+   140us) service_pool.cc:224] Handling call
0709 12:15:12.342295 (+1076602us) spinlock_profiling.cc:243] Waited 778 ms on lock 0x7b5400110b54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:15:12.342444 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1789807872}
I20260709 12:15:12.402456  9771 raft_consensus.cc:2749] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:15:12.420053  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:12.457880  5088 leader_election.cc:304] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:12.416882  5271 raft_consensus.cc:3060] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:12.432003  5200 raft_consensus.cc:1275] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:15:12.388749 10030 consensus_queue.cc:1048] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 12:15:12.462777  5199 raft_consensus.cc:1275] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:15:12.470203  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:12.404386  9981 raft_consensus.cc:2749] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:15:12.407171 10036 raft_consensus.cc:2749] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:12.469514  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:12.470039  9860 raft_consensus.cc:493] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:12.472983  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:12.412559  9930 leader_election.cc:290] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:12.482589  5088 leader_election.cc:304] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
W20260709 12:15:12.486886  5804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:12.500168  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:12.503166  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
W20260709 12:15:12.488319  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 86524.7us
W20260709 12:15:12.493606  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 95115.1us
I20260709 12:15:12.506860  5163 leader_election.cc:304] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:12.470573 10084 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:12.470461  9985 consensus_queue.cc:1059] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:15:12.412389 10094 raft_consensus.cc:515] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:12.480676  9806 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:12.489288  9885 raft_consensus.cc:2749] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:12.462056 10054 consensus_queue.cc:1059] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 12:15:12.490092  9892 raft_consensus.cc:493] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:12.492822  9861 raft_consensus.cc:2749] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:12.512898  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:12.531175  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:12.537971  5198 raft_consensus.cc:2393] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 13: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:15:12.538508  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:12.559183  5838 raft_consensus.cc:2393] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 14: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:15:12.541452  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:12.542001  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:12.600104  5830 raft_consensus.cc:2393] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 12: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:15:12.542079  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:12.543473  5195 raft_consensus.cc:1240] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:12.561417 10075 consensus_queue.cc:1048] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.110s
I20260709 12:15:12.561213  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:12.603097  5835 raft_consensus.cc:3060] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:12.509698  5119 raft_consensus.cc:2468] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 13.
I20260709 12:15:12.531064  9986 raft_consensus.cc:493] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:12.550505  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:12.606308  9986 raft_consensus.cc:515] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:12.548326  5124 raft_consensus.cc:1240] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 11. Current term is 12. Ops: [11.12-11.12]
I20260709 12:15:12.561266 10065 raft_consensus.cc:2749] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:12.538165  9860 raft_consensus.cc:515] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:12.590680  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:12.514281  5801 leader_election.cc:304] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:12.544023  5196 raft_consensus.cc:1240] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 14. Current term is 15. Ops: []
W20260709 12:15:12.611598  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 45146.2us
I20260709 12:15:12.561177  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:12.613003  5191 raft_consensus.cc:2393] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 13: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:15:12.552147  9892 raft_consensus.cc:515] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:12.561632 10090 consensus_queue.cc:1059] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.198s
I20260709 12:15:12.622062  5237 leader_election.cc:304] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
W20260709 12:15:12.658900  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 149394us
I20260709 12:15:12.660934  5801 leader_election.cc:304] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:15:12.629663  5804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:12.561546 10085 raft_consensus.cc:2749] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:12.622538  5835 raft_consensus.cc:2468] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 10.
I20260709 12:15:12.517527  9771 raft_consensus.cc:2749] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:15:12.674196  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 52247us
I20260709 12:15:12.493274  9754 consensus_queue.cc:260] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:12.609198  9986 leader_election.cc:290] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:12.673867 10095 raft_consensus.cc:3055] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:12.688360  5801 leader_election.cc:304] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:12.688877  5835 raft_consensus.cc:1275] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:15:12.652387  9979 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:12.674117 10052 log.cc:927] Time spent T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.118s	user 0.005s	sys 0.001s
I20260709 12:15:12.696903  5237 leader_election.cc:304] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:12.693370 10095 raft_consensus.cc:740] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:12.711707 10095 consensus_queue.cc:260] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:12.712785 10064 raft_consensus.cc:2749] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:12.713105 10095 raft_consensus.cc:3060] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:12.715670  5125 raft_consensus.cc:2468] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 10.
I20260709 12:15:12.684118  9885 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:12.684998 10000 raft_consensus.cc:2804] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:15:12.734139  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 45992.6us
I20260709 12:15:12.680069 10108 raft_consensus.cc:493] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:12.533196 10084 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:12.692265 10090 raft_consensus.cc:493] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:12.725423  9986 raft_consensus.cc:493] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:12.763756 10075 raft_consensus.cc:2749] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:12.763092  9744 raft_consensus.cc:2804] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:12.764933  9938 leader_election.cc:290] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:12.760535  9894 leader_election.cc:290] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:12.722012  9979 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:12.778755  9930 raft_consensus.cc:493] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:12.805516  9892 leader_election.cc:290] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:12.797995  9860 leader_election.cc:290] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:12.766443  9885 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:12.810837 10094 leader_election.cc:290] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:12.812394  9885 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:12.788427  9986 raft_consensus.cc:515] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:12.833328  5164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:12.792654  9744 raft_consensus.cc:493] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
W20260709 12:15:12.842553  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:12.845211  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:12.846650  5240 leader_election.cc:304] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:15:12.847599  9979 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:12.847929  5830 raft_consensus.cc:1275] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:15:12.849236  5830 raft_consensus.cc:1275] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:15:12.850744  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:12.851785 10117 raft_consensus.cc:2749] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:12.856269  9811 leader_election.cc:290] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:12.857740  5163 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:12.858822  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:12.859709  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:12.860239  9892 raft_consensus.cc:2804] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:12.860874  9892 raft_consensus.cc:697] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 10 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:12.861862  9892 consensus_queue.cc:237] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:12.865747  5268 raft_consensus.cc:2393] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 14: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:15:12.866300  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:12.869837  5163 leader_election.cc:304] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:12.872366 10022 raft_consensus.cc:2749] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:15:12.803709 10067 raft_consensus.cc:2804] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:15:12.873517 10054 raft_consensus.cc:2749] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:15:12.877399  5124 raft_consensus.cc:1275] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:15:12.775277 10108 raft_consensus.cc:515] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:12.899715  9754 raft_consensus.cc:3060] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:12.878180  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:12.901328 10108 leader_election.cc:290] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:12.901721  5836 raft_consensus.cc:2468] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 11.
I20260709 12:15:12.781299 10090 raft_consensus.cc:515] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:12.902209  9928 consensus_meta.cc:287] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.530s	user 0.009s	sys 0.000s
I20260709 12:15:12.902658  9928 raft_consensus.cc:2749] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:12.903762 10090 leader_election.cc:290] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:12.866679  9744 raft_consensus.cc:3060] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:12.905520  5124 raft_consensus.cc:1240] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:12.906831  9998 consensus_queue.cc:1048] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:12.908833  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:12.909958  9369 consensus_queue.cc:1059] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:12.910979  9998 raft_consensus.cc:3055] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:12.911353  9998 raft_consensus.cc:740] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:12.911659  5118 raft_consensus.cc:1275] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:15:12.912205  9998 consensus_queue.cc:260] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:12.835929  9930 raft_consensus.cc:515] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:12.884081  5122 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 14.
I20260709 12:15:12.891861 10036 raft_consensus.cc:3055] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:12.896847  9799 raft_consensus.cc:2749] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:12.882615  5088 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:15:12.914211 10036 raft_consensus.cc:740] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:15:12.877707 10084 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:12.913887  5166 leader_election.cc:304] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:12.829571 10093 consensus_queue.cc:1048] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.103s
I20260709 12:15:12.917316  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:12.918524  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:12.861737  9918 raft_consensus.cc:3055] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:12.926383  5123 raft_consensus.cc:2468] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 9.
W20260709 12:15:12.921203  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:12.913637  9998 raft_consensus.cc:3060] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:12.930498  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:12.931172  5122 raft_consensus.cc:2468] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 15.
W20260709 12:15:12.933264  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 50750.5us
I20260709 12:15:12.934544  5088 leader_election.cc:304] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:12.938678  5123 raft_consensus.cc:1275] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:15:12.942299  5271 raft_consensus.cc:2468] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 13.
I20260709 12:15:12.938800  5835 raft_consensus.cc:2468] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 13.
I20260709 12:15:12.948596  5166 leader_election.cc:304] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:12.952636  5088 leader_election.cc:304] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:12.948952  9885 raft_consensus.cc:2749] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:12.954496 10112 consensus_queue.cc:1059] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:15:12.955807 10112 raft_consensus.cc:3055] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:12.956184 10112 raft_consensus.cc:740] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:12.957046 10112 consensus_queue.cc:260] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:12.958302 10112 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:12.961607  9909 consensus_queue.cc:1059] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:15:12.962766 10109 raft_consensus.cc:2749] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:15:12.938030 10084 consensus_queue.cc:1048] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:15:12.966073  9946 raft_consensus.cc:2749] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:12.966535  9885 raft_consensus.cc:3055] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:12.967031  9885 raft_consensus.cc:740] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:12.938226  9938 raft_consensus.cc:2764] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 12:15:12.945588  9949 raft_consensus.cc:515] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:12.967684  5164 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:12.969197 10067 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:12.969540  9949 leader_election.cc:290] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:12.969779 10067 raft_consensus.cc:3060] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:12.970165 10089 raft_consensus.cc:2749] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:12.973187 10095 raft_consensus.cc:2804] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:12.973006  9885 consensus_queue.cc:260] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:12.973757 10095 raft_consensus.cc:697] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
W20260709 12:15:12.975314  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 212846us
W20260709 12:15:12.975776  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:13.005191  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:12.983873  5802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:13.009560  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:13.010694  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:12.929358  9918 raft_consensus.cc:740] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:15:13.010759  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:13.014303  5193 raft_consensus.cc:2468] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 13.
I20260709 12:15:13.022064  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:12.964056  5088 leader_election.cc:304] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:15:13.040693  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 76726.9us
I20260709 12:15:12.969317  9898 raft_consensus.cc:493] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:13.044114  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:13.044814  5192 raft_consensus.cc:2468] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 16.
I20260709 12:15:13.041909  5088 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:15:13.044234  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 75087.4us
W20260709 12:15:13.057930  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 287891us
I20260709 12:15:13.069007  5196 raft_consensus.cc:1240] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:13.070256  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:13.073154  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:13.073963 10083 consensus_queue.cc:1059] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.100s
I20260709 12:15:13.074419 10086 consensus_queue.cc:1059] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:15:13.075295 10086 raft_consensus.cc:3055] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:13.075618 10086 raft_consensus.cc:740] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:13.076484 10086 consensus_queue.cc:260] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:13.060316  9885 raft_consensus.cc:3060] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:13.083504 10109 consensus_queue.cc:1059] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:15:13.056444  9806 raft_consensus.cc:3060] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:13.066007  9918 consensus_queue.cc:260] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:13.085321 10109 raft_consensus.cc:3055] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:15:13.098688 10109 raft_consensus.cc:740] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:13.099188  9928 raft_consensus.cc:493] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:13.099524 10109 consensus_queue.cc:260] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:13.101006 10109 raft_consensus.cc:3060] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:13.092168  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:13.102234  5835 raft_consensus.cc:2468] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 16.
W20260709 12:15:13.092499  5238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:13.090824  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:13.103639  5238 leader_election.cc:304] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:13.104825  5238 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:13.105891  9892 raft_consensus.cc:2749] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:13.106338  9930 leader_election.cc:290] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:13.094135 10121 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:13.108462 10121 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:13.096015 10095 consensus_queue.cc:237] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:13.110646  9918 raft_consensus.cc:3060] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:13.071277  9986 leader_election.cc:290] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:13.039357  9771 consensus_queue.cc:1048] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 12:15:13.042670  9909 raft_consensus.cc:2749] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:13.087803  5830 raft_consensus.cc:1240] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:13.097222  5194 raft_consensus.cc:2393] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 16: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:15:13.115155  5804 leader_election.cc:304] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:15:13.117865  5804 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
W20260709 12:15:13.117705  9891 consensus_meta.cc:287] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.657s	user 0.009s	sys 0.001s
I20260709 12:15:13.120949  9891 raft_consensus.cc:515] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:13.123389 10114 consensus_queue.cc:1048] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:15:13.101236  9744 raft_consensus.cc:515] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:13.039590  9981 consensus_queue.cc:1048] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:15:13.128598  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:13.053869  9889 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:13.106251 10084 raft_consensus.cc:2749] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:15:13.119043  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 58101.4us
I20260709 12:15:13.125450  5238 leader_election.cc:304] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:15:13.054414  9898 raft_consensus.cc:515] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:13.156635  9898 leader_election.cc:290] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:13.158574  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:13.073257  5801 leader_election.cc:304] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:13.163286  9861 raft_consensus.cc:2749] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:15:13.164245  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 91113.5us
I20260709 12:15:13.181674  5801 leader_election.cc:304] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:13.055370 10000 raft_consensus.cc:697] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 12 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:13.188747  5193 raft_consensus.cc:1275] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:15:13.112785 10089 consensus_queue.cc:1048] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 12:15:13.132164  9986 raft_consensus.cc:2804] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:13.118076  9928 raft_consensus.cc:515] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:13.196465 10075 consensus_queue.cc:1048] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:15:13.171315  9889 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:13.168290  9894 raft_consensus.cc:2804] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:15:13.215813  9891 leader_election.cc:290] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:15:13.407250  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 225651us
W20260709 12:15:13.199841  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 74517us
I20260709 12:15:13.151664 10086 raft_consensus.cc:3060] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:15:13.273790  5091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:13.405630  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:13.202479  5194 raft_consensus.cc:1275] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:15:13.097451 10096 consensus_queue.cc:1048] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.097s
W20260709 12:15:13.489740  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 296544us
I20260709 12:15:13.534143  5238 leader_election.cc:304] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:15:13.538592  5089 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:13.492805  5117 raft_consensus.cc:1275] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 12:15:13.507902  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 338329us
W20260709 12:15:13.509042  9783 consensus_meta.cc:287] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 1.086s	user 0.018s	sys 0.007s
W20260709 12:15:13.508564  9754 consensus_meta.cc:287] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.608s	user 0.017s	sys 0.006s
I20260709 12:15:13.494226 10083 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:13.548209  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:13.555248  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:13.555711  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:13.532845  9771 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:13.498497  9894 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:13.533010  9988 raft_consensus.cc:2804] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:13.533906 10076 raft_consensus.cc:3060] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:13.501089  9986 raft_consensus.cc:493] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:13.536613  9806 raft_consensus.cc:2749] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:13.624020  5120 raft_consensus.cc:1240] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:13.625496 10090 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:13.625941  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 91925.8us
I20260709 12:15:13.627521  5271 raft_consensus.cc:1240] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:15:13.627826  9979 consensus_queue.cc:1048] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:13.628665  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:13.629354  5268 raft_consensus.cc:1240] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:13.629714  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:13.630259  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:13.631022  5272 raft_consensus.cc:1240] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 11. Current term is 12. Ops: []
W20260709 12:15:13.631469 10131 log.cc:927] Time spent T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:15:13.599076  9928 leader_election.cc:290] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:13.601613 10089 raft_consensus.cc:493] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:13.632948 10089 raft_consensus.cc:515] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:13.545233 10108 raft_consensus.cc:493] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:13.634519 10108 raft_consensus.cc:515] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:13.634994 10089 leader_election.cc:290] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:13.609269 10036 consensus_queue.cc:260] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:13.613204  9981 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:13.635758 10000 consensus_queue.cc:237] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:13.636369  5268 raft_consensus.cc:1240] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:13.545656 10129 raft_consensus.cc:2804] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:13.629758  5269 raft_consensus.cc:2410] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:15:13.613801 10034 raft_consensus.cc:493] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:13.622942  9889 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:13.635879 10036 raft_consensus.cc:3060] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:13.630398  5274 raft_consensus.cc:3060] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:13.637466 10034 raft_consensus.cc:515] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:13.636214  9981 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:13.545130  9885 raft_consensus.cc:2804] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:13.597898  9744 leader_election.cc:290] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:15:13.621064  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 81226.4us
W20260709 12:15:13.691457  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 48017.8us
I20260709 12:15:13.645685  5122 raft_consensus.cc:2468] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 13.
W20260709 12:15:13.661696  5803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:13.707656  5266 raft_consensus.cc:1275] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 12:15:13.718516  5266 pending_rounds.cc:85] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929: Aborting all ops after (but not including) 12
I20260709 12:15:13.718824  5266 pending_rounds.cc:107] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 12:15:13.719097  5266 raft_consensus.cc:2889] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:13.708951  5273 raft_consensus.cc:1240] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:13.712368  9885 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:13.626173 10090 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:13.721976  9885 raft_consensus.cc:3060] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:13.724285 10090 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:13.724962 10034 leader_election.cc:290] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:13.711061  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:13.552330 10009 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:13.734889  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:13.562935  9894 raft_consensus.cc:3060] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:13.738072  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:13.740078  9981 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:13.740988  5835 raft_consensus.cc:1275] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:15:13.741240  5829 raft_consensus.cc:1275] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:15:13.741689  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:13.742393  5831 raft_consensus.cc:2393] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 13: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
W20260709 12:15:13.742693 10109 consensus_meta.cc:287] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.641s	user 0.000s	sys 0.014s
I20260709 12:15:13.641621  9930 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:13.733464  9754 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:13.726912 10066 raft_consensus.cc:493] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:13.744642 10066 raft_consensus.cc:515] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:13.745749  5088 leader_election.cc:304] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:13.712168  9889 raft_consensus.cc:493] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:13.746891 10066 leader_election.cc:290] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:13.747597  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:13.743741  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:13.750108  5834 raft_consensus.cc:2468] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 16.
I20260709 12:15:13.738816  5836 raft_consensus.cc:2468] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 10.
I20260709 12:15:13.751179  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:13.751204  5274 raft_consensus.cc:2468] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 12.
I20260709 12:15:13.746937  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:13.753690  5088 leader_election.cc:304] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:13.641337  9986 raft_consensus.cc:3060] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:13.754783  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:13.763036  5267 raft_consensus.cc:2368] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 12. Current term is 13.
I20260709 12:15:13.751889  5123 raft_consensus.cc:2468] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 15.
I20260709 12:15:13.762935  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:13.625810 10084 raft_consensus.cc:2804] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:13.767359  5238 leader_election.cc:304] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:15:13.785933  5238 leader_election.cc:304] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
W20260709 12:15:13.741127 10067 consensus_meta.cc:287] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.771s	user 0.006s	sys 0.015s
I20260709 12:15:13.562649  9988 raft_consensus.cc:493] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:13.689004 10112 consensus_meta.cc:287] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.730s	user 0.007s	sys 0.024s
I20260709 12:15:13.747295  9889 raft_consensus.cc:515] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:13.794720  5088 leader_election.cc:400] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 election: Vote denied by peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709) with higher term. Message: Invalid argument: T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 12. Current term is 13.
I20260709 12:15:13.636969 10129 raft_consensus.cc:493] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:13.743649  9979 raft_consensus.cc:493] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:13.803129  5088 leader_election.cc:403] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:15:13.565891  9771 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:13.558885  9783 raft_consensus.cc:515] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:13.775806 10110 raft_consensus.cc:2749] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:15:13.799214  9928 raft_consensus.cc:2804] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:15:13.845016  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:13.844120  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:13.841497 10112 raft_consensus.cc:2804] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:13.852523  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:13.852087  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:13.859403  5116 raft_consensus.cc:2410] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:15:13.803768  9935 raft_consensus.cc:2804] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:13.744316  9754 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:13.865124  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:13.812217  9988 raft_consensus.cc:3060] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:13.563338 10083 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:13.763527  9909 consensus_queue.cc:1059] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
W20260709 12:15:13.862741  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 326658us
I20260709 12:15:13.863161  5198 raft_consensus.cc:1240] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 7. Current term is 8. Ops: []
I20260709 12:15:13.747548 10009 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:13.744005  9930 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:13.778185 10030 consensus_queue.cc:1048] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 12:15:13.869762  5163 leader_election.cc:304] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
W20260709 12:15:14.022886  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 153207us
I20260709 12:15:13.871405  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:13.873240  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:13.959419  5274 raft_consensus.cc:1275] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:15:13.958128 10089 raft_consensus.cc:493] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:13.863747  9935 raft_consensus.cc:493] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:13.959976  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:14.036387  5273 raft_consensus.cc:2468] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 11.
I20260709 12:15:14.007555  5196 raft_consensus.cc:3060] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:13.822819 10129 raft_consensus.cc:3060] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:13.867578 10110 raft_consensus.cc:2749] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709) with higher term. Message: Invalid argument: T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 12. Current term is 13.
I20260709 12:15:13.823668  9979 raft_consensus.cc:515] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:13.859992 10084 raft_consensus.cc:697] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 13 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:13.868938 10121 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:13.841977 10066 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:13.856630  9928 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:13.787976  9891 consensus_queue.cc:1048] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 12:15:13.959936 10112 raft_consensus.cc:697] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:13.951803  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:13.856098  9806 raft_consensus.cc:493] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:14.019387  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:14.108011  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:13.800596 10067 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:15:14.028663  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 139290us
I20260709 12:15:14.024605  5163 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:14.032610  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:14.112754  5199 raft_consensus.cc:2410] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:15:13.965440  9954 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:14.037473  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:15:14.018594  9998 consensus_meta.cc:287] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 1.076s	user 0.021s	sys 0.002s
I20260709 12:15:14.006460  9946 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:14.012428 10109 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:14.021113  9898 raft_consensus.cc:493] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
W20260709 12:15:14.094445  5803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:14.101372  9928 raft_consensus.cc:3060] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:14.019706 10126 raft_consensus.cc:493] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:14.145581  5118 raft_consensus.cc:1240] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 17 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 16. Current term is 17. Ops: []
I20260709 12:15:14.040048  9935 raft_consensus.cc:3060] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:14.114174  5801 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:14.030737 10090 consensus_queue.cc:1048] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.074s
I20260709 12:15:14.030525 10119 consensus_queue.cc:1048] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 12:15:14.032634 10022 raft_consensus.cc:2749] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:15:14.138412  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 113911us
I20260709 12:15:14.137684  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:14.038954 10089 raft_consensus.cc:515] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:14.115860 10121 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:14.148445  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 353839us
W20260709 12:15:14.170104  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 56011.1us
I20260709 12:15:14.102389 10066 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:14.143877 10110 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:14.150981  5271 raft_consensus.cc:2468] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 13.
I20260709 12:15:14.136375 10125 raft_consensus.cc:493] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:14.116547  9806 raft_consensus.cc:515] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:14.157464 10054 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:14.140359  9946 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:14.164065  9954 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:14.244506 10110 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:14.177565 10034 raft_consensus.cc:2749] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:14.258633  5830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46100 (request call id 1303) took 1067 ms. Trace:
I20260709 12:15:14.142728 10109 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:14.263850  5830 rpcz_store.cc:276] 0709 12:15:13.190826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:13.193341 (+  2515us) service_pool.cc:224] Handling call
0709 12:15:13.193684 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:13.493405 (+299721us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:13.493436 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:13.493478 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:15:13.493509 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:14.258392 (+764883us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b54007d0d54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:15:14.258441 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:14.258570 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":688783744}
I20260709 12:15:14.180464  9771 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:14.145876  9898 raft_consensus.cc:515] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:14.265298  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 408248us
I20260709 12:15:14.301662  5240 leader_election.cc:304] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:15:14.162621 10126 raft_consensus.cc:515] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:14.250629  9783 leader_election.cc:290] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:14.304616  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:14.179924 10137 consensus_queue.cc:1059] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.121s
I20260709 12:15:14.179805 10121 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:14.260198 10135 log.cc:927] Time spent T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.239s	user 0.001s	sys 0.000s
I20260709 12:15:14.296501  9889 leader_election.cc:290] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:14.246340 10138 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:14.296674 10139 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:14.309507  9744 raft_consensus.cc:2804] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:14.251957  9754 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:14.319474 10094 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:14.255709 10110 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:14.350883  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:14.251523 10067 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 17 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:14.353490  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:14.362723  5119 raft_consensus.cc:2468] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 9.
I20260709 12:15:14.328754 10144 raft_consensus.cc:493] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:14.266096 10112 consensus_queue.cc:237] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:14.338225 10083 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:14.356382  9744 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:14.360630 10090 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:14.329124 10140 consensus_queue.cc:1048] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.144s
I20260709 12:15:14.297049 10084 consensus_queue.cc:237] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:14.291847 10125 raft_consensus.cc:515] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:14.413854  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:14.382465  9861 raft_consensus.cc:493] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
W20260709 12:15:14.426960  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 248686us
I20260709 12:15:14.431594  5163 leader_election.cc:304] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:14.404428  9744 raft_consensus.cc:3060] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:14.401826 10067 raft_consensus.cc:493] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:14.404682  9979 leader_election.cc:290] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:14.466886  5119 raft_consensus.cc:1275] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:15:14.355916 10139 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:14.468353  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 210812us
I20260709 12:15:14.383881 10094 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:14.450769  9909 raft_consensus.cc:493] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:14.474339  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:14.458451  9771 raft_consensus.cc:2749] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:14.479339  5199 raft_consensus.cc:2393] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 15: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:15:14.388254 10144 raft_consensus.cc:515] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:14.356562 10138 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:14.416740 10090 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:14.492434  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:14.485208  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:14.493461  5830 raft_consensus.cc:2468] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 14.
I20260709 12:15:14.495827  5272 raft_consensus.cc:1240] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 12 LEADER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:14.449115  9861 raft_consensus.cc:515] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:14.480189 10009 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:14.525674  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:14.504326  5196 raft_consensus.cc:1275] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:15:14.525791  5124 raft_consensus.cc:1275] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:15:14.482887 10066 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:14.542953  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:14.486907  9806 leader_election.cc:290] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:14.495127  9930 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:14.495462 10089 leader_election.cc:290] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:14.467998 10067 raft_consensus.cc:515] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:14.500998 10109 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:14.546782 10083 raft_consensus.cc:493] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:14.558843 10147 log.cc:927] Time spent T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 12:15:14.558575 10083 raft_consensus.cc:515] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:14.561079 10083 leader_election.cc:290] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:14.483963  9909 raft_consensus.cc:515] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:14.504386  9898 leader_election.cc:290] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:14.543061 10009 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:14.578996  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:14.579692  5838 raft_consensus.cc:2468] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 12.
I20260709 12:15:14.580520  9909 leader_election.cc:290] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:15:14.581557 10141 log.cc:927] Time spent T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.252s	user 0.000s	sys 0.001s
I20260709 12:15:14.582373 10094 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:14.587859  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:14.588574  5838 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 12.
I20260709 12:15:14.587795  9928 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:14.591588  9928 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:14.592025 10138 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:15:14.568698 10076 consensus_meta.cc:287] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.982s	user 0.006s	sys 0.006s
W20260709 12:15:14.626427 10159 log.cc:927] Time spent T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.075s	user 0.000s	sys 0.004s
I20260709 12:15:14.632594  5830 raft_consensus.cc:2468] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 11.
I20260709 12:15:14.570433 10140 raft_consensus.cc:493] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:14.577850 10126 leader_election.cc:290] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:15:14.629534  9885 consensus_meta.cc:287] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.907s	user 0.005s	sys 0.006s
I20260709 12:15:14.621865 10066 raft_consensus.cc:493] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
W20260709 12:15:14.648152 10086 consensus_meta.cc:287] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 1.111s	user 0.010s	sys 0.002s
I20260709 12:15:14.633204 10119 raft_consensus.cc:493] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:14.668560  5120 raft_consensus.cc:2410] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:15:14.623313 10009 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:15:14.670042 10160 log.cc:927] Time spent T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.057s	user 0.004s	sys 0.000s
I20260709 12:15:14.665477 10173 raft_consensus.cc:493] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:14.686632 10067 leader_election.cc:290] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:14.691295 10139 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:14.691951 10125 leader_election.cc:290] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:14.646509 10121 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:14.693193 10090 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:14.693521  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:14.710326  5200 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 12.
W20260709 12:15:14.694702  9986 consensus_meta.cc:287] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.894s	user 0.009s	sys 0.001s
W20260709 12:15:14.695047  5803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:14.668005 10066 raft_consensus.cc:515] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:14.685477 10144 leader_election.cc:290] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:14.712896 10178 raft_consensus.cc:493] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:14.715978  5198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47744 (request call id 2463) took 1647 ms. Trace:
I20260709 12:15:14.716406 10178 raft_consensus.cc:515] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:14.718788  9954 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:14.716431  5198 rpcz_store.cc:276] 0709 12:15:13.068402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:13.071026 (+  2624us) service_pool.cc:224] Handling call
0709 12:15:13.071315 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:14.013087 (+941772us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:14.715719 (+702632us) spinlock_profiling.cc:243] Waited 792 ms on lock 0x7b5400038ed4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:15:14.715889 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1820573440}
I20260709 12:15:14.700158 10137 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:14.705327 10176 raft_consensus.cc:493] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:14.647759 10140 raft_consensus.cc:515] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:14.726850  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:14.722441  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:14.653224  9885 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:14.696331  5801 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 1.654s (SENT) [suppressed 1 similar messages]
I20260709 12:15:14.729596  5200 raft_consensus.cc:2468] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 14.
I20260709 12:15:14.718822 10178 leader_election.cc:290] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:14.698406 10119 raft_consensus.cc:515] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:14.739892  5122 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40402 (request call id 2746) took 1609 ms (client timeout 1872 ms). Trace:
I20260709 12:15:14.721796  9986 raft_consensus.cc:515] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:14.743125  5122 rpcz_store.cc:269] 0709 12:15:13.128101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:13.128306 (+   205us) service_pool.cc:224] Handling call
0709 12:15:14.737014 (+1608708us) spinlock_profiling.cc:243] Waited 386 ms on lock 0x7b540008d754. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:15:14.737128 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":887006976}
I20260709 12:15:14.758081  5240 leader_election.cc:304] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:15:14.768074  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:14.769443  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:14.770532  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:14.771435  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:14.772074  5195 raft_consensus.cc:2468] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 12.
W20260709 12:15:14.773478 10054 consensus_meta.cc:287] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.512s	user 0.011s	sys 0.000s
I20260709 12:15:14.773924 10054 raft_consensus.cc:2749] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:14.778457 10066 leader_election.cc:290] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:15:14.779198  9988 consensus_meta.cc:287] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.820s	user 0.011s	sys 0.000s
I20260709 12:15:14.779646  9988 raft_consensus.cc:515] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:14.780050  9885 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 16 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:15:14.753607  9894 consensus_meta.cc:287] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.974s	user 0.006s	sys 0.006s
I20260709 12:15:14.782248  9894 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:14.784416  9894 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:15:14.786322 10129 consensus_meta.cc:287] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.736s	user 0.011s	sys 0.000s
I20260709 12:15:14.786753 10129 raft_consensus.cc:515] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:14.787556  9986 leader_election.cc:290] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:14.787818  5268 raft_consensus.cc:1240] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:14.727324 10137 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:14.728377 10176 raft_consensus.cc:515] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:14.790202 10137 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:14.791373 10009 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:14.794184  9988 leader_election.cc:290] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:14.771487  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:14.795383  5197 raft_consensus.cc:2468] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 14.
I20260709 12:15:14.796537 10176 leader_election.cc:290] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:14.797256  9744 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:14.799638  9744 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:14.801250 10067 raft_consensus.cc:493] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:14.801844 10067 raft_consensus.cc:515] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:15:14.802927  9935 consensus_meta.cc:287] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.630s	user 0.009s	sys 0.000s
I20260709 12:15:14.803364  9935 raft_consensus.cc:515] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:14.804294 10067 leader_election.cc:290] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:14.801822 10129 leader_election.cc:290] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:14.727113 10173 raft_consensus.cc:515] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:14.740782 10084 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:14.805935 10084 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:14.807032 10173 leader_election.cc:290] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:14.811367 10140 leader_election.cc:290] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:14.819010  9861 leader_election.cc:290] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:14.823567 10140 consensus_queue.cc:1048] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:15:14.835273  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:14.835563  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:14.836303  5834 raft_consensus.cc:2468] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 12.
I20260709 12:15:14.836675  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:14.836900  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:14.837204  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:14.837805  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:14.838687  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:14.839346  5829 raft_consensus.cc:2468] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 14.
I20260709 12:15:14.839452  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:14.840283  5833 raft_consensus.cc:2410] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
W20260709 12:15:14.763065 10132 log.cc:927] Time spent T 00000000000000000000000000000000 P 221aa011207d421b9725197ff8bed389: Append to log took a long time: real 0.797s	user 0.003s	sys 0.003s
I20260709 12:15:14.763548 10144 raft_consensus.cc:493] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:14.842165 10144 raft_consensus.cc:515] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:14.844300 10144 leader_election.cc:290] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:14.763252 10125 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:14.845250 10125 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:14.847352 10125 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:15:14.848071 10136 log.cc:927] Time spent T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.897s	user 0.000s	sys 0.002s
W20260709 12:15:14.849362 10181 log.cc:927] Time spent T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 12:15:14.849740  5121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40386 (request call id 2336) took 1735 ms. Trace:
I20260709 12:15:14.851070  9919 raft_consensus.cc:2804] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:14.850168  5121 rpcz_store.cc:276] 0709 12:15:13.113898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:13.114066 (+   168us) service_pool.cc:224] Handling call
0709 12:15:13.146656 (+ 32590us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:13.147041 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:13.147078 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:13.147568 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 12:15:13.566295 (+418727us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:15:13.566335 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:13.566408 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:14.847280 (+1280872us) spinlock_profiling.cc:243] Waited 65 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e675e86e 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221 00007f84e67671d9 00007f84e6767169
0709 12:15:14.849445 (+  2165us) raft_consensus.cc:1685] finished
0709 12:15:14.849468 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:14.849679 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4405,"raft.queue_time_us":1121,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":20871,"spinlock_wait_cycles":149614336,"thread_start_us":418348,"threads_started":1,"wal-append.queue_time_us":646997}
I20260709 12:15:14.851605  9919 raft_consensus.cc:493] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:14.852010  9919 raft_consensus.cc:3060] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:14.853888 10089 raft_consensus.cc:493] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:14.854545 10089 raft_consensus.cc:515] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:14.837872  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:14.842715  5118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40386 (request call id 2335) took 1739 ms. Trace:
I20260709 12:15:14.856635  5118 rpcz_store.cc:276] 0709 12:15:13.103669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:13.106575 (+  2906us) service_pool.cc:224] Handling call
0709 12:15:13.106881 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:14.162065 (+1055184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:14.842475 (+680410us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540009ced4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:15:14.842655 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2388349696}
I20260709 12:15:14.858268 10072 raft_consensus.cc:3055] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:14.858721 10072 raft_consensus.cc:740] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:14.859644 10072 consensus_queue.cc:260] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:14.860749 10072 raft_consensus.cc:3060] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:14.864516 10089 leader_election.cc:290] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:14.954298  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:14.955251  5117 raft_consensus.cc:2393] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 13: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:15:14.956019 10065 consensus_queue.cc:1059] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:14.957461 10065 raft_consensus.cc:3055] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:15:14.957857 10065 raft_consensus.cc:740] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:14.958706 10065 consensus_queue.cc:260] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:14.959939 10065 raft_consensus.cc:3060] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:14.864794 10108 leader_election.cc:290] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:14.839046  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:14.961640 10110 raft_consensus.cc:493] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:14.868989 10129 raft_consensus.cc:493] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:14.956581  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:14.962265 10110 raft_consensus.cc:515] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:14.871302  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:14.868930 10124 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:14.965258 10173 raft_consensus.cc:493] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:14.965435 10124 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:14.965899 10173 raft_consensus.cc:515] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:14.967625 10129 raft_consensus.cc:515] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:14.872836 10093 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:14.872916  9754 raft_consensus.cc:3055] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:14.876015  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:14.876504  5273 raft_consensus.cc:1240] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:14.969508 10144 raft_consensus.cc:493] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:14.876794  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:14.971673  5269 raft_consensus.cc:2393] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 13: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:15:14.879590 10163 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:13.982482  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:14.881505  5125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59390 (request call id 1046) took 1029 ms. Trace:
I20260709 12:15:14.972520 10163 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:14.883575  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:14.884306  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:14.973872  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:14.974433  5120 raft_consensus.cc:2468] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 9.
W20260709 12:15:14.885878  5164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:14.886475  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:14.977285  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:14.887636  5118 raft_consensus.cc:1275] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 12:15:14.973189  5125 rpcz_store.cc:276] 0709 12:15:13.851878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:13.852975 (+  1097us) service_pool.cc:224] Handling call
0709 12:15:13.853257 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:14.416163 (+562906us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:14.416196 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:14.449944 (+ 33748us) log.cc:844] Serialized 26 byte log entry
0709 12:15:14.571300 (+121356us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:15:14.571375 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:14.881089 (+309714us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b540038d1d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:15:14.881138 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:14.881186 (+    48us) raft_consensus.cc:1685] finished
0709 12:15:14.881200 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:14.881439 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":337432,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":210,"spinlock_wait_cycles":441763712,"thread_start_us":453820,"threads_started":2,"wal-append.queue_time_us":196661}
I20260709 12:15:14.978212  5118 pending_rounds.cc:85] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting all ops after (but not including) 7
I20260709 12:15:14.978521  5118 pending_rounds.cc:107] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 12:15:14.888072 10125 raft_consensus.cc:493] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:14.886420 10119 leader_election.cc:290] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:14.978731  5123 raft_consensus.cc:2410] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:15:14.885810  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:14.979089 10125 raft_consensus.cc:515] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:14.979707  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:14.980335  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:14.890118  5240 leader_election.cc:304] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:14.899513  5837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46100 (request call id 1309) took 1062 ms. Trace:
I20260709 12:15:14.901149  5272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34674 (request call id 2487) took 1268 ms. Trace:
W20260709 12:15:14.906248  5271 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34674 (request call id 2485) took 1277 ms (client timeout 1551 ms). Trace:
I20260709 12:15:14.969727  9754 raft_consensus.cc:740] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:14.909723  9946 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:14.978761  5118 raft_consensus.cc:2889] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:14.982703  9754 consensus_queue.cc:260] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:14.870711 10058 raft_consensus.cc:3055] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:14.983155  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:14.914371  5268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34672 (request call id 2436) took 1208 ms. Trace:
W20260709 12:15:14.981959  5271 rpcz_store.cc:269] 0709 12:15:13.628353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:13.630041 (+  1688us) service_pool.cc:224] Handling call
0709 12:15:14.906001 (+1275960us) spinlock_profiling.cc:243] Waited 507 ms on lock 0x7b54002eefd4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:15:14.906163 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1165904768}
I20260709 12:15:14.930095  5163 leader_election.cc:304] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:14.930517 10022 consensus_queue.cc:1048] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:15:14.934036  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:14.983776 10058 raft_consensus.cc:740] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:14.945240  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:14.945741  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:14.983891  5268 rpcz_store.cc:276] 0709 12:15:13.705994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:13.706116 (+   122us) service_pool.cc:224] Handling call
0709 12:15:13.706416 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:14.788302 (+1081886us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:14.913614 (+125312us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54002558d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:15:14.914295 (+   681us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2486568192}
I20260709 12:15:14.946527  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:14.981238  5837 rpcz_store.cc:276] 0709 12:15:13.837150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:13.837278 (+   128us) service_pool.cc:224] Handling call
0709 12:15:13.837659 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:14.116790 (+279131us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:14.116821 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:14.135653 (+ 18832us) log.cc:844] Serialized 26 byte log entry
0709 12:15:14.532206 (+396553us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:15:14.532247 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:14.899074 (+366827us) spinlock_profiling.cc:243] Waited 275 ms on lock 0x7b5400457254. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:15:14.899123 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:14.899185 (+    62us) raft_consensus.cc:1685] finished
0709 12:15:14.899199 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:14.899442 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9080,"raft.queue_time_us":15325,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":11597,"spinlock_wait_cycles":631842944,"thread_start_us":351696,"threads_started":1,"wal-append.queue_time_us":480787}
I20260709 12:15:14.982867  5272 rpcz_store.cc:276] 0709 12:15:13.632331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:13.632816 (+   485us) service_pool.cc:224] Handling call
0709 12:15:13.633056 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:14.497046 (+863990us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:14.900893 (+403847us) spinlock_profiling.cc:243] Waited 862 ms on lock 0x7b5400256cd4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:15:14.901086 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1983727360}
I20260709 12:15:14.969587 10093 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:14.981824  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:14.975363  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:14.921514 10084 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:14.987576  5125 raft_consensus.cc:2468] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 12.
I20260709 12:15:14.988620  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:14.989267  5125 raft_consensus.cc:2468] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 14.
I20260709 12:15:14.890556 10114 consensus_queue.cc:1048] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:14.985136  5830 raft_consensus.cc:2368] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 16. Current term is 17.
I20260709 12:15:14.963590  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:14.988641  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:14.981429  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:14.992355  5122 raft_consensus.cc:2468] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 14.
I20260709 12:15:14.993463  5122 raft_consensus.cc:1240] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 11. Current term is 12. Ops: [11.12-11.12]
I20260709 12:15:14.995344  9754 raft_consensus.cc:3060] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:14.985127 10058 consensus_queue.cc:260] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:14.935225  9935 leader_election.cc:290] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:14.997695 10058 raft_consensus.cc:3060] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:14.956166  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:14.999866  5117 raft_consensus.cc:2468] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 13.
I20260709 12:15:14.977957  5116 raft_consensus.cc:2468] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 12.
I20260709 12:15:15.003993  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:15.008674 10123 raft_consensus.cc:493] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:15.009370 10123 raft_consensus.cc:515] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:15.012359  9935 raft_consensus.cc:493] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:15.013067  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:15.013811  5265 raft_consensus.cc:2468] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 12.
I20260709 12:15:15.015429  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:15.012936  9935 raft_consensus.cc:515] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:15.017606  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:15.017850  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:15.018991 10067 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:15.019665 10067 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:15.022482  9783 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:15.023099  9783 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:15.023099  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:15.025156  5265 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 14.
W20260709 12:15:15.026144  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 96139us
I20260709 12:15:15.026970  5163 leader_election.cc:304] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:15.028266 10140 raft_consensus.cc:2749] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:15.029006 10095 raft_consensus.cc:2804] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:15.029465 10095 raft_consensus.cc:493] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:15.029850 10095 raft_consensus.cc:3060] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:15:15.042351  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 65172.2us
I20260709 12:15:14.980823  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:15.070999  5123 raft_consensus.cc:3060] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:15:15.072175  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 45301.3us
W20260709 12:15:15.073100  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 183069us
I20260709 12:15:15.073992  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:15.075280  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:15.076049  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:15.076072  5265 raft_consensus.cc:2393] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 14: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:15:15.107712  5268 raft_consensus.cc:1240] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 11. Current term is 12. Ops: []
W20260709 12:15:15.113081  5803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:15.114315  5164 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:15.091150 10114 raft_consensus.cc:2804] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:15.119803  5240 leader_election.cc:304] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:15:15.137269  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:15.138705  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:15.145598  5125 raft_consensus.cc:2468] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 11.
I20260709 12:15:15.146032  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:15.141614  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:15.147468  5837 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 14.
I20260709 12:15:15.143151  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:15.151306  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:15.152036  5272 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 14.
I20260709 12:15:15.146562  5164 leader_election.cc:304] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:15.156044  5123 raft_consensus.cc:2468] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 17.
I20260709 12:15:15.161882  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:15.166502  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:15.175848  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:15.167645  5164 leader_election.cc:304] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:15.156208  5119 raft_consensus.cc:2468] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 15.
I20260709 12:15:15.180202  5124 raft_consensus.cc:2393] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 11: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:15:15.088536 10144 raft_consensus.cc:515] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:15.182083  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:15.182967 10066 raft_consensus.cc:2804] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:15.183184 10150 raft_consensus.cc:2804] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:15.183597  9941 consensus_queue.cc:1048] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:15:15.184881 10089 raft_consensus.cc:2804] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:15.213825 10089 raft_consensus.cc:493] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:15.214329 10089 raft_consensus.cc:3060] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:15:15.188845  5018 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33896 (request call id 322) took 12914 ms (client timeout 15000 ms). Trace:
I20260709 12:15:15.134001 10140 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:15.197073  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:15.219769  5830 raft_consensus.cc:3060] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:15.198594  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:15.198891  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:15.168762 10137 raft_consensus.cc:2804] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:15.164247 10129 leader_election.cc:290] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:15.204146 10150 raft_consensus.cc:493] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:15.212515  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:15.232085  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:15.219870  5120 raft_consensus.cc:3060] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:15.219770  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:15.220399  5832 raft_consensus.cc:2468] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 12.
I20260709 12:15:15.227864  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:15.234243  5272 raft_consensus.cc:2393] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 17: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:15:15.235175  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:15.235733  5271 raft_consensus.cc:3060] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:15:15.206141 10066 raft_consensus.cc:493] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:15.230154  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:15.258038 10066 raft_consensus.cc:3060] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:15.258366  5119 raft_consensus.cc:2393] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 9: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:15:15.261785  9935 leader_election.cc:290] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:15.265667 10067 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:15.229490 10140 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:15.270113  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:15.270437  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:15.271800 10140 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:15.274540  9986 raft_consensus.cc:493] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:15.275127  9986 raft_consensus.cc:515] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:15.275472  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:15.275151  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:15.277333  5119 raft_consensus.cc:2410] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:15:15.271982  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:15.279191 10119 raft_consensus.cc:493] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:15.279788 10119 raft_consensus.cc:515] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:15.277319  9986 leader_election.cc:290] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:15.283191 10119 leader_election.cc:290] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:15.283411  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:15.283578  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:15.284040  5269 raft_consensus.cc:1240] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 17 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:15:15.284463  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:15.284091  5118 raft_consensus.cc:2468] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 15.
I20260709 12:15:15.285507  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:15.285970  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:15.286140  5116 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 14.
I20260709 12:15:15.288815  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:15.289218  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:15.290378  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:15.233116 10110 leader_election.cc:290] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:15.292793  5268 raft_consensus.cc:2468] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 12.
I20260709 12:15:15.234733 10150 raft_consensus.cc:3060] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:15.242318  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:15.244228  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:15.305526  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:15.245535  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:15.246033 10093 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:15.246485  9783 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:15.248471  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:15.248931  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:15.249229  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:15.308679  5120 raft_consensus.cc:2468] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 10.
I20260709 12:15:15.310904  5200 raft_consensus.cc:2393] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 15: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:15:15.249910 10173 leader_election.cc:290] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:15.229941 10123 leader_election.cc:290] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:15.250893 10125 leader_election.cc:290] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:15.251154 10163 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:15.211501  9919 raft_consensus.cc:515] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:15.252911 10144 leader_election.cc:290] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:15:15.217576  5018 rpcz_store.cc:269] 0709 12:15:02.273840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:02.274031 (+   191us) service_pool.cc:224] Handling call
0709 12:15:15.188607 (+12914576us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:15:08.291696 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:15:08.309302 (+ 17606us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:15:08.309339 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:15:08.309356 (+    17us) tablet.cc:662] Decoding operations
0709 12:15:08.545152 (+235796us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:15:08.547899 (+  2747us) write_op.cc:641] Partition lock acquired for write op
0709 12:15:08.568287 (+ 20388us) tablet.cc:685] Acquiring locks for 40 operations
0709 12:15:08.871958 (+303671us) tablet.cc:701] Row locks acquired
0709 12:15:08.871985 (+    27us) write_op.cc:260] PREPARE: finished
0709 12:15:08.872151 (+   166us) write_op.cc:270] Start()
0709 12:15:08.872282 (+   131us) write_op.cc:276] Timestamp: P: 1783599308872101 usec, L: 0
0709 12:15:08.872303 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:15:08.873136 (+   833us) log.cc:844] Serialized 15676 byte log entry
0709 12:15:09.705721 (+832585us) op_driver.cc:464] REPLICATION: finished
0709 12:15:10.057299 (+351578us) spinlock_profiling.cc:243] Waited 6.73 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e3ab90ac 00007f84ec9139a9 00007f84e3ad569b 00007f84e3ad393f 00007f84e3ad5c02 00007f84ea5f9ef0
0709 12:15:10.220090 (+162791us) write_op.cc:301] APPLY: starting
0709 12:15:10.220275 (+   185us) tablet.cc:1367] starting BulkCheckPresence
0709 12:15:10.662917 (+442642us) spinlock_profiling.cc:243] Waited 7.92 ms on lock 0x7b18002ec9c0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3ad6522 00007f84e3ad87c1 00007f84e3ad8779 00007f84e3ad8709 00007f84e3ad86d1 00007f84e3ad79cd 0000000000388634 0000000000388479 00007f84e3ab983a
0709 12:15:11.610386 (+947469us) tablet.cc:1370] finished BulkCheckPresence
0709 12:15:11.610436 (+    50us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:15:12.823307 (+1212871us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:15:12.823843 (+   536us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=80,key_file_lookups=80,delta_file_lookups=80,mrs_lookups=0
0709 12:15:12.823921 (+    78us) write_op.cc:312] APPLY: finished
0709 12:15:12.824683 (+   762us) log.cc:844] Serialized 340 byte log entry
0709 12:15:13.536213 (+711530us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:13.601680 (+ 65467us) write_op.cc:454] Released schema lock
0709 12:15:13.601788 (+   108us) write_op.cc:341] FINISH: Updating metrics
0709 12:15:13.602434 (+   646us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:13.602469 (+    35us) write_op.cc:454] Released schema lock
0709 12:15:14.751867 (+1149398us) spinlock_profiling.cc:243] Waited 53.6 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e675e86e 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221 00007f84e67671d9 00007f84e6767169
Metrics: {"mutex_wait_us":1834,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":506464,"apply.run_cpu_time_us":101935,"apply.run_wall_time_us":3382438,"cfile_cache_hit":162,"cfile_cache_hit_bytes":171247,"num_ops":40,"prepare.queue_time_us":296468,"prepare.run_cpu_time_us":31244,"prepare.run_wall_time_us":799058,"raft.queue_time_us":512873,"raft.run_cpu_time_us":15500,"raft.run_wall_time_us":456449,"replication_time_us":769961,"spinlock_wait_cycles":156925568,"thread_start_us":1515857,"threads_started":5,"wal-append.queue_time_us":1193902,"wal-append.run_cpu_time_us":22364,"wal-append.run_wall_time_us":1425240}]]}
I20260709 12:15:15.257311 10124 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:15.292963  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:15:15.318749  5801 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.004s	sys 0.016s
I20260709 12:15:15.228502 10137 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:15.249265  5271 raft_consensus.cc:2468] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 8.
I20260709 12:15:15.295159  5166 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:15.320528  5166 leader_election.cc:304] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:15.299096  5089 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:15:15.303108  5830 raft_consensus.cc:2468] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 12.
I20260709 12:15:15.244405  5266 consensus_queue.cc:237] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:15.306200  5199 raft_consensus.cc:2410] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:15:15.305634  5192 raft_consensus.cc:2468] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 8.
I20260709 12:15:15.313035  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:15.316313  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:15:15.318572  9811 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.017s	sys 0.003s
I20260709 12:15:15.326707  5089 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
W20260709 12:15:15.319067  5801 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.004s	sys 0.016s
W20260709 12:15:15.329973  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 633628us
I20260709 12:15:15.334519  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:15.335037  5195 raft_consensus.cc:3060] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:15:15.329200  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 63854.3us
I20260709 12:15:15.337711  5273 raft_consensus.cc:2368] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 9. Current term is 10.
I20260709 12:15:15.325824  5166 leader_election.cc:304] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:15.351229  5237 leader_election.cc:304] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:15.352792  5237 leader_election.cc:304] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:15:15.361470  5164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:15.363495  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:15.363622  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:15.365221  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:15.365860  5192 raft_consensus.cc:3060] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:15.323067 10137 raft_consensus.cc:3060] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:15.367153  5237 leader_election.cc:304] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:15:15.327973  9811 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.017s	sys 0.003s
I20260709 12:15:15.364207  5199 raft_consensus.cc:2468] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 13.
I20260709 12:15:15.369948  5269 raft_consensus.cc:1240] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:15.322973 10176 raft_consensus.cc:2749] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:15.373226  5272 raft_consensus.cc:1240] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:15.373111  5804 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:15:15.331379  9783 raft_consensus.cc:2804] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:15.328714 10144 raft_consensus.cc:2804] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:15.361280  9954 raft_consensus.cc:493] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:15.337895 10125 raft_consensus.cc:2804] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:15.381349  5237 leader_election.cc:304] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:15.390743  5804 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:15:15.362201 10178 raft_consensus.cc:2749] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:15.361757 10124 raft_consensus.cc:2749] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:15.361140 10173 raft_consensus.cc:493] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:15.403947  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:15.369508 10034 raft_consensus.cc:493] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:15.413431  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:15.414268  5237 leader_election.cc:304] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:15.423273  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:15.424705  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:15.378360 10093 raft_consensus.cc:2749] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:15:15.395399  9949 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.000s	sys 0.026s
I20260709 12:15:15.372445  9986 raft_consensus.cc:493] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:15.373701  5089 leader_election.cc:400] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 16 election: Vote denied by peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539) with higher term. Message: Invalid argument: T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 16. Current term is 17.
I20260709 12:15:15.440125  5089 leader_election.cc:403] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:15:15.404057 10119 raft_consensus.cc:2804] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:15.436376  5117 raft_consensus.cc:1240] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:15.407784 10125 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:15.395778  9783 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:15.448839  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:15:15.440631  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 75537.4us
W20260709 12:15:15.439106  9949 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.000s	sys 0.027s
I20260709 12:15:15.434111 10122 raft_consensus.cc:2749] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:15.400457 10144 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:15.440032  9930 raft_consensus.cc:2749] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:15.465983 10110 raft_consensus.cc:493] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:15.466604 10110 raft_consensus.cc:515] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:15.468904 10110 leader_election.cc:290] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:15.433881 10034 raft_consensus.cc:515] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:15.470034  9919 leader_election.cc:290] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:15.470499  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:15.471235  5268 raft_consensus.cc:2468] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 15.
I20260709 12:15:15.453498  9783 raft_consensus.cc:3060] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:15.426406 10173 raft_consensus.cc:515] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:15.474232 10173 leader_election.cc:290] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:15.465626 10144 raft_consensus.cc:3060] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:15.410001  9954 raft_consensus.cc:515] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:15:15.477950 10183 log.cc:927] Time spent T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:15:15.479406  9954 leader_election.cc:290] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:15.452497  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:15.443918  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:15.484234  5269 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 13.
I20260709 12:15:15.454305  5166 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:15.434615  9811 raft_consensus.cc:2804] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:15.454459  9935 consensus_queue.cc:1048] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 12:15:15.441617 10163 raft_consensus.cc:2749] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539) with higher term. Message: Invalid argument: T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 16. Current term is 17.
I20260709 12:15:15.462028 10095 raft_consensus.cc:515] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:15.462821 10089 raft_consensus.cc:515] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:15.491385  5166 leader_election.cc:304] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:15.492304  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:15.450977 10125 raft_consensus.cc:3060] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:15.493763  5271 raft_consensus.cc:1275] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:15:15.494410  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:15.524132  5163 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:15.471460 10034 leader_election.cc:290] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:15.501250  9954 raft_consensus.cc:2749] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:15.533746  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:15.534456  5193 raft_consensus.cc:3060] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:15:15.537755  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:15.496268  9811 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:15.541486  5163 leader_election.cc:304] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:15:15.497597  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:15.447019 10119 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:15.500098  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:15.508208  5269 raft_consensus.cc:2468] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 12.
I20260709 12:15:15.492949  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:15.566174  5273 raft_consensus.cc:2393] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 13: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:15:15.509646  5166 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
W20260709 12:15:15.568029  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 58486.8us
W20260709 12:15:15.570020  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:15.570640  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:15.576623  5121 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.031s	sys 0.051s
W20260709 12:15:15.577149  5121 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.032s	sys 0.051s
I20260709 12:15:15.548166  9954 raft_consensus.cc:2749] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:15.521306  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:15.545595  5193 raft_consensus.cc:2468] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 10.
W20260709 12:15:15.588730  5803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:15.588938  5163 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:15.547588  5194 raft_consensus.cc:2468] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 11.
W20260709 12:15:15.538384 10096 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.028s	sys 0.036s
I20260709 12:15:15.566092 10119 raft_consensus.cc:3060] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:15.566534 10163 raft_consensus.cc:493] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
W20260709 12:15:15.551177  5164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:15.449229  9986 raft_consensus.cc:515] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:15.543293  9811 raft_consensus.cc:3060] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:15.521545 10058 consensus_queue.cc:1059] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 12:15:15.566483 10065 raft_consensus.cc:2749] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:15.591043  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:15.576078 10072 raft_consensus.cc:2804] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:15.525520 10176 raft_consensus.cc:2804] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:15:15.519408  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 143637us
I20260709 12:15:15.542419 10066 raft_consensus.cc:515] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:15.595790 10096 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.028s	sys 0.036s
I20260709 12:15:15.603147  9986 leader_election.cc:290] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:15.595654 10140 consensus_queue.cc:1059] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 12:15:15.608469 10058 raft_consensus.cc:3055] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:15.630676 10058 raft_consensus.cc:740] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:15.634518 10066 leader_election.cc:290] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:15.634258 10058 consensus_queue.cc:260] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:15.615752 10176 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:15.635393 10176 raft_consensus.cc:3060] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:15.616544 10072 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:15.637674 10072 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:15.638072 10058 raft_consensus.cc:3060] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:15.620317  5195 raft_consensus.cc:2468] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 14.
I20260709 12:15:15.593647 10178 consensus_queue.cc:1059] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 12:15:15.642695  5801 leader_election.cc:304] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:15.643517  9986 raft_consensus.cc:2749] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:15.645680 10089 leader_election.cc:290] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:15.633852 10150 raft_consensus.cc:515] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:15.650154  5192 raft_consensus.cc:2468] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 17.
I20260709 12:15:15.628957  9954 raft_consensus.cc:2749] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:15.650954  5801 leader_election.cc:304] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:15:15.616390  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 449245us
I20260709 12:15:15.628803 10123 raft_consensus.cc:2749] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:15.600874 10163 raft_consensus.cc:515] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:15.596702  5237 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:15.623998  5163 leader_election.cc:304] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:15:15.663877  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 67238us
I20260709 12:15:15.662871  5801 leader_election.cc:304] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:15.666996  5801 leader_election.cc:304] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:15.629673 10114 raft_consensus.cc:697] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 13 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
W20260709 12:15:15.670456  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 46528.5us
I20260709 12:15:15.675603  5163 leader_election.cc:304] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:15.686306  5237 leader_election.cc:304] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:15.690295 10117 raft_consensus.cc:2749] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:15.691191 10117 raft_consensus.cc:3060] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:15.700795  5163 leader_election.cc:304] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:15.701818 10022 raft_consensus.cc:2749] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:15.702514 10022 raft_consensus.cc:2749] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:15.704783  5163 leader_election.cc:304] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:15.706723 10150 leader_election.cc:290] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:15.707597 10144 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:15.707890 10072 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:15.654047 10034 raft_consensus.cc:2749] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:15.649983  9811 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:15.671393  9928 raft_consensus.cc:2749] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:15.716427  5238 leader_election.cc:304] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:15.716333  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
W20260709 12:15:15.717840  5122 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.005s	sys 0.010s
I20260709 12:15:15.678109 10140 raft_consensus.cc:2804] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:15:15.717754  5117 raft_consensus.cc:2393] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 11: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
W20260709 12:15:15.719071  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 50531.6us
I20260709 12:15:15.719895  5240 leader_election.cc:304] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:15.724435  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:15.725746  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:15.726859  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:15.710414 10095 leader_election.cc:290] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:15.729046  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:15.739024  5116 raft_consensus.cc:3060] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:15.741535  5240 leader_election.cc:304] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:15.672233  9783 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:15.748315  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:15.747116  9954 raft_consensus.cc:2749] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:15.762432 10072 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:15.764097  9811 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:15.764981 10144 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:15.766175 10114 consensus_queue.cc:237] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:15.766821  9949 raft_consensus.cc:2749] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:15:15.767652  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 102108us
I20260709 12:15:15.738300 10150 raft_consensus.cc:2804] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:15.769600 10084 raft_consensus.cc:2804] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:15.769754 10150 raft_consensus.cc:697] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 15 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:15.770210 10084 raft_consensus.cc:697] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 10 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:15.770766 10150 consensus_queue.cc:237] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:15.771104 10084 consensus_queue.cc:237] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:15.774487 10125 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:15.775276  5237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:15.776703 10125 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 15 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:15.779841 10176 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:15.780575  5240 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:15.781855 10122 raft_consensus.cc:2749] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:15.782423 10163 leader_election.cc:290] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:15.783109  5240 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:15.784263  9783 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:15.785236 10137 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:15.785547  9954 consensus_queue.cc:1059] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:15.787351  9954 raft_consensus.cc:3055] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:15.787802  9954 raft_consensus.cc:740] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:15.788650 10119 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:15.790390 10089 raft_consensus.cc:493] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:15.790906 10089 raft_consensus.cc:515] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:15.791234  9930 raft_consensus.cc:2749] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:15.792964 10089 leader_election.cc:290] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:15.743505 10140 raft_consensus.cc:697] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:15.798061  5195 raft_consensus.cc:1240] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:15.799770  5116 raft_consensus.cc:2468] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 10.
I20260709 12:15:15.785185  5163 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:15.800894 10054 raft_consensus.cc:2749] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:15.802141  5163 leader_election.cc:400] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709) with higher term. Message: Invalid argument: T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 9. Current term is 10.
I20260709 12:15:15.802497  5163 leader_election.cc:403] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:15.803030 10054 raft_consensus.cc:2749] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709) with higher term. Message: Invalid argument: T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 9. Current term is 10.
W20260709 12:15:15.797960  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 52907.9us
I20260709 12:15:15.806705  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:15.808575  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:15.810271  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:15.810878  5269 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:15:15.815742  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:15.817122  5195 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f"
dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
mode: GRACEFUL
new_leader_uuid: "bce73265e27d4b30a4dcc1e491305088"
 from {username='slave'} at 127.0.0.1:53902
I20260709 12:15:15.817991  5195 raft_consensus.cc:606] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Received request to transfer leadership to TS bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:15.818508  5195 raft_consensus.cc:614] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:15.787302 10137 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:15.818972  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
W20260709 12:15:15.820313  5123 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.008s	sys 0.014s
I20260709 12:15:15.820449  5268 raft_consensus.cc:3060] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:15:15.821259  5123 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.008s	sys 0.014s
W20260709 12:15:15.821441  5838 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.045s	sys 0.063s
W20260709 12:15:15.821817  5838 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.045s	sys 0.063s
I20260709 12:15:15.823446  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:15.790676 10119 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:15.825683 10117 raft_consensus.cc:2749] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:15.836494  5166 leader_election.cc:304] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:15.837404 10178 raft_consensus.cc:2749] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:15.815683 10140 consensus_queue.cc:237] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:15.849758  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:15.788614  9954 consensus_queue.cc:260] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:15.852838  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:15.854354  9954 raft_consensus.cc:3060] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:15.857407  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:15.858048  5120 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:15.856673  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:15.860236  5117 raft_consensus.cc:3060] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:15.861289  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:15.862139  5119 raft_consensus.cc:2393] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 15: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:15:15.863747  5166 leader_election.cc:304] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:15.870921  5268 raft_consensus.cc:2468] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 13.
W20260709 12:15:15.937691  5164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:15.869273 10176 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 16 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:15.939109  5269 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 15.
I20260709 12:15:15.941949  5120 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 15.
I20260709 12:15:15.944445  5274 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
mode: GRACEFUL
new_leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
 from {username='slave'} at 127.0.0.1:43644
I20260709 12:15:15.948648  5163 leader_election.cc:304] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:15.952000  5274 raft_consensus.cc:606] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 9 LEADER]: Received request to transfer leadership to TS ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:15.958213  5163 leader_election.cc:304] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:15.963691  5163 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:15.966825  5117 raft_consensus.cc:2468] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 16.
W20260709 12:15:15.969492  5804 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.009s	sys 0.004s
I20260709 12:15:15.969609  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
W20260709 12:15:15.971287  5804 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.009s	sys 0.004s
W20260709 12:15:15.971611  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 580933us
I20260709 12:15:15.972901  5166 leader_election.cc:304] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
W20260709 12:15:15.980460  5088 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.191s	user 0.063s	sys 0.125s
W20260709 12:15:15.981182  5088 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.192s	user 0.063s	sys 0.125s
W20260709 12:15:15.981500  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 1.2148e+06us
W20260709 12:15:15.982023  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:15.975848  5804 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:15:15.938855 10058 raft_consensus.cc:2749] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:15.990346  5088 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:15.961349 10176 raft_consensus.cc:2749] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:16.001188  5804 leader_election.cc:304] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:15:16.002477  5804 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:15:16.003615  5804 leader_election.cc:304] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:15:15.969168 10072 raft_consensus.cc:2804] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:16.007141 10163 raft_consensus.cc:2749] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:16.009126  5088 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:16.002350 10144 consensus_queue.cc:1059] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.167s
W20260709 12:15:16.180486  5200 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.004s	sys 0.022s
W20260709 12:15:16.202375  5200 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.005s	sys 0.023s
W20260709 12:15:16.019959  5164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:15.979030 10178 raft_consensus.cc:2804] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:16.205596  5830 raft_consensus.cc:1240] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:16.207147  5830 raft_consensus.cc:1240] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 17 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 16. Current term is 17. Ops: []
W20260709 12:15:16.194356  5196 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.008s	sys 0.020s
W20260709 12:15:16.196204  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:16.010741 10119 raft_consensus.cc:2804] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:16.003329 10089 raft_consensus.cc:2804] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:15:16.218379  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:16.222294  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
W20260709 12:15:16.200791  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 191722us
I20260709 12:15:16.009809  9986 raft_consensus.cc:2804] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:15:16.210915  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:16.210762  5196 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.008s	sys 0.020s
I20260709 12:15:16.217248  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:16.230477  5836 raft_consensus.cc:3060] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:15:16.216655  5801 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.026s	sys 0.035s
W20260709 12:15:16.231281  5801 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.026s	sys 0.035s
W20260709 12:15:16.232002  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 565046us
I20260709 12:15:16.212102 10072 raft_consensus.cc:697] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:16.227651  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:16.237262  5192 raft_consensus.cc:1275] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:15:16.234006  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:16.239843  5198 raft_consensus.cc:2468] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 12.
I20260709 12:15:16.228643  5833 raft_consensus.cc:2393] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 15: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:15:16.232769  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:16.232846  5801 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:16.243714  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:16.201031  9941 raft_consensus.cc:2749] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:16.248868  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:16.261097  5119 raft_consensus.cc:3060] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:16.249730  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:16.250133  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:16.253818  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:16.254458  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:16.255158  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:16.255810 10199 raft_consensus.cc:493] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:16.257529  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:16.266644  5116 raft_consensus.cc:2393] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 15: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:15:16.209888 10163 raft_consensus.cc:2804] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:16.262519  5193 raft_consensus.cc:2393] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 13: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:15:16.263473  5198 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 14.
I20260709 12:15:16.264122  5199 raft_consensus.cc:2368] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 16. Current term is 17.
I20260709 12:15:16.267576  5118 raft_consensus.cc:2393] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 12: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:15:16.217473 10119 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:16.279582  9946 raft_consensus.cc:493] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:16.217964 10034 raft_consensus.cc:2804] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:16.280144  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:16.228957  9986 raft_consensus.cc:493] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:16.211395 10117 raft_consensus.cc:2804] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:15:16.200555 10137 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:16.322798  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:16.280268 10144 raft_consensus.cc:493] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:16.325038 10034 raft_consensus.cc:697] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 10 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:15:16.290828  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:16.295722  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:16.294173  5191 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 8.
I20260709 12:15:16.245165 10178 raft_consensus.cc:697] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
W20260709 12:15:16.312306  5166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:16.351131  5118 raft_consensus.cc:1240] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:16.351922  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:16.294004 10119 raft_consensus.cc:3060] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:16.325942  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:16.360571  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:16.328750  5119 raft_consensus.cc:2468] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 14.
I20260709 12:15:16.330960  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:16.280118 10199 raft_consensus.cc:515] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:16.283989 10163 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:16.319532  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:16.372466  5835 raft_consensus.cc:1240] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:16.289214  5088 leader_election.cc:304] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:16.294413  9811 raft_consensus.cc:493] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:16.309049  9986 raft_consensus.cc:3060] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:16.364048  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
W20260709 12:15:16.354522  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 121759us
I20260709 12:15:16.378764  5835 raft_consensus.cc:1275] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:15:16.373776  5193 raft_consensus.cc:2468] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 11.
W20260709 12:15:16.370548  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 124411us
W20260709 12:15:16.374082  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 88734.3us
I20260709 12:15:16.334220  9985 raft_consensus.cc:2749] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:16.381358  5198 raft_consensus.cc:2393] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 15: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:15:16.375763  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:16.382499  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:16.335273 10034 consensus_queue.cc:237] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:16.366241  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:16.385566  5088 leader_election.cc:304] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:16.385902  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:16.380028  5801 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:16.334141 10144 raft_consensus.cc:515] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:16.339213 10117 raft_consensus.cc:697] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 17 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:15:16.389340  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:16.374500 10163 raft_consensus.cc:3060] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:16.375666 10173 raft_consensus.cc:2749] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:15:16.319657  9946 raft_consensus.cc:515] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:16.397012  5801 leader_election.cc:304] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:16.402575  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:16.403366  5830 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 14.
I20260709 12:15:16.338960 10137 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:16.402655  5801 leader_election.cc:304] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:16.391717 10066 raft_consensus.cc:3055] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:15:16.394997 10193 log.cc:927] Time spent T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.274s	user 0.000s	sys 0.001s
I20260709 12:15:16.410072  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:16.406364  9985 consensus_queue.cc:1048] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 12:15:16.411829 10075 raft_consensus.cc:3060] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:16.406631 10173 raft_consensus.cc:2749] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:16.400874 10201 raft_consensus.cc:2749] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:16.435674  5838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46088 (request call id 931) took 1297 ms. Trace:
W20260709 12:15:16.436256 10207 log.cc:927] Time spent T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:15:16.420782 10096 consensus_queue.cc:1059] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:15:16.421756 10192 log.cc:927] Time spent T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.210s	user 0.000s	sys 0.001s
I20260709 12:15:16.444790  5265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50932 (request call id 1008) took 1329 ms. Trace:
I20260709 12:15:16.366179 10072 consensus_queue.cc:237] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:16.436182  5838 rpcz_store.cc:276] 0709 12:15:15.138161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:15.138298 (+   137us) service_pool.cc:224] Handling call
0709 12:15:15.178216 (+ 39918us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:15.178626 (+   410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:15.178656 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:15.197266 (+ 18610us) log.cc:844] Serialized 26 byte log entry
0709 12:15:15.822157 (+624891us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:15:16.194177 (+372020us) log.cc:844] Serialized 14 byte log entry
0709 12:15:16.201910 (+  7733us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:16.201981 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:16.435463 (+233482us) raft_consensus.cc:1685] finished
0709 12:15:16.435485 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:16.435612 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38019,"prepare.queue_time_us":577925,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":14605,"raft.queue_time_us":16130,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":12048,"thread_start_us":948409,"threads_started":2,"wal-append.queue_time_us":748501}
I20260709 12:15:16.383411  9811 raft_consensus.cc:515] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:16.435591  9985 raft_consensus.cc:2749] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:16.445219  5265 rpcz_store.cc:276] 0709 12:15:15.115678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:15.116336 (+   658us) service_pool.cc:224] Handling call
0709 12:15:15.117943 (+  1607us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:15.167352 (+ 49409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:15.167383 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:15.186254 (+ 18871us) log.cc:844] Serialized 26 byte log entry
0709 12:15:15.626119 (+439865us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:15:15.626165 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:15.626245 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:16.444517 (+818272us) raft_consensus.cc:1685] finished
0709 12:15:16.444542 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:16.444708 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43097,"raft.queue_time_us":48047,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":5279,"thread_start_us":438845,"threads_started":1,"wal-append.queue_time_us":774206}
I20260709 12:15:16.408612 10066 raft_consensus.cc:740] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:16.467168 10089 raft_consensus.cc:697] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:16.471302  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
W20260709 12:15:16.435690 10197 log.cc:927] Time spent T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:15:16.474824  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:16.481190  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:16.482113  5838 raft_consensus.cc:2393] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 15: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:15:16.486898 10137 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:16.458316 10198 raft_consensus.cc:493] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:16.487763 10198 raft_consensus.cc:515] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:16.404688 10178 consensus_queue.cc:237] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:16.473994 10117 consensus_queue.cc:237] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:16.490114  5272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34672 (request call id 2461) took 1073 ms. Trace:
I20260709 12:15:16.490492  5272 rpcz_store.cc:276] 0709 12:15:15.416870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:15.419640 (+  2770us) service_pool.cc:224] Handling call
0709 12:15:15.419958 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:15.446506 (+ 26548us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:15.446542 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:15.448423 (+  1881us) log.cc:844] Serialized 26 byte log entry
0709 12:15:15.687807 (+239384us) spinlock_profiling.cc:243] Waited 2.86 ms on lock 0x7b18002e3a80. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3ab8e07 00007f84ec9139a9 00007f84e3ad569b 00007f84e3ad393f 00007f84e3ad5c02 00007f84e675d20b 00007f84e6762d23 00007f84e67630d1 00007f84e6b7ea0f
0709 12:15:16.197591 (+509784us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:15:16.197632 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:16.197773 (+   141us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:16.489808 (+292035us) raft_consensus.cc:1685] finished
0709 12:15:16.489828 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:16.490050 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59106,"raft.queue_time_us":28808,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":4435,"spinlock_wait_cycles":6576000,"thread_start_us":462573,"threads_started":1,"wal-append.queue_time_us":886675}
W20260709 12:15:16.489171  9954 consensus_meta.cc:287] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.633s	user 0.010s	sys 0.000s
I20260709 12:15:16.501127  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:16.501704  5835 raft_consensus.cc:1275] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:15:16.498908  5164 leader_election.cc:304] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:16.410488 10176 consensus_queue.cc:1059] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.063s
I20260709 12:15:16.472486 10173 raft_consensus.cc:493] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:16.479202 10140 raft_consensus.cc:493] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:16.544795 10075 raft_consensus.cc:2749] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:15:16.561993  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:16.553094  5836 raft_consensus.cc:2468] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 13.
W20260709 12:15:16.570590  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 71777.9us
I20260709 12:15:16.571671  5164 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
W20260709 12:15:16.570791  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 185391us
I20260709 12:15:16.574082  5088 leader_election.cc:304] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:16.578523  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:16.581634  5118 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 14.
I20260709 12:15:16.575765 10137 raft_consensus.cc:2749] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:16.606484 10224 raft_consensus.cc:2749] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:16.609352 10228 raft_consensus.cc:493] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:16.609819  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:16.610038 10228 raft_consensus.cc:515] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:16.610601  5118 raft_consensus.cc:2468] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 12.
I20260709 12:15:16.611974  5166 leader_election.cc:304] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:16.612320 10228 leader_election.cc:290] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:16.612757 10227 raft_consensus.cc:2804] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:16.613201 10227 raft_consensus.cc:493] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:16.613615 10227 raft_consensus.cc:3060] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:16.564438 10140 raft_consensus.cc:515] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:16.615043 10123 raft_consensus.cc:493] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:16.615809 10140 leader_election.cc:290] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:16.617501 10150 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:16.563716 10173 raft_consensus.cc:515] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:16.615543 10123 raft_consensus.cc:515] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:16.622502  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:16.638445  5196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47728 (request call id 2536) took 1392 ms. Trace:
I20260709 12:15:16.618265 10199 leader_election.cc:290] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:16.638891  5196 rpcz_store.cc:276] 0709 12:15:15.246482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:15.247226 (+   744us) service_pool.cc:224] Handling call
0709 12:15:15.247545 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:15.247915 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:15.247942 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:15.426655 (+178713us) spinlock_profiling.cc:243] Waited 45.4 ms on lock 0x7b2c00010828. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e54bca11 00007f84e54cc372 00007f84e6bfea01 00007f84e6bc343a 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2
0709 12:15:15.439239 (+ 12584us) log.cc:844] Serialized 26 byte log entry
0709 12:15:16.230111 (+790872us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:15:16.249257 (+ 19146us) log.cc:844] Serialized 14 byte log entry
0709 12:15:16.376335 (+127078us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:16.376426 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:16.634166 (+257740us) raft_consensus.cc:1685] finished
0709 12:15:16.638257 (+  4091us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:16.638388 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25788,"prepare.queue_time_us":19156,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":29,"raft.queue_time_us":129013,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":5883,"spinlock_wait_cycles":104451840,"thread_start_us":868212,"threads_started":2,"wal-append.queue_time_us":817611}
I20260709 12:15:16.655783  5266 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
mode: GRACEFUL
new_leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
 from {username='slave'} at 127.0.0.1:43644
I20260709 12:15:16.667528  5266 raft_consensus.cc:606] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 11 LEADER]: Received request to transfer leadership to TS ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:16.595719 10218 raft_consensus.cc:2749] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:15:16.666267  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 263664us
I20260709 12:15:16.667037  5123 raft_consensus.cc:1275] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:15:16.665453  5804 leader_election.cc:304] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:16.633612 10137 raft_consensus.cc:493] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:16.675998 10117 raft_consensus.cc:2749] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:16.671885  5804 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:15:16.677767  5194 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e"
dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
mode: GRACEFUL
new_leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
 from {username='slave'} at 127.0.0.1:53902
I20260709 12:15:16.675925 10144 leader_election.cc:290] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:16.682479  9811 leader_election.cc:290] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:16.558743 10089 consensus_queue.cc:237] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:16.692308  9986 raft_consensus.cc:515] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:16.693912  9946 leader_election.cc:290] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:16.673609 10224 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:16.666107 10228 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:16.758181 10228 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:16.759650  5118 raft_consensus.cc:1275] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:15:16.688603 10227 raft_consensus.cc:515] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:16.631824 10150 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:16.706753 10198 leader_election.cc:290] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:16.708441 10137 raft_consensus.cc:515] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:16.735530 10126 raft_consensus.cc:993] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929: : Instructing follower ad2f9a1e2f7a45429fa69fd23d09f821 to start an election
I20260709 12:15:16.737030 10173 leader_election.cc:290] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:16.742594 10123 leader_election.cc:290] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:16.744395 10119 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:16.745798 10058 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:16.763027 10227 leader_election.cc:290] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:16.774121 10058 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:16.775887  5200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47728 (request call id 2550) took 1232 ms. Trace:
I20260709 12:15:16.776433 10058 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:16.774252  9986 leader_election.cc:290] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:16.778083  9986 raft_consensus.cc:2804] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:16.770741 10126 raft_consensus.cc:1081] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 9 LEADER]: Signalling peer ad2f9a1e2f7a45429fa69fd23d09f821 to start an election
I20260709 12:15:16.778666  9986 raft_consensus.cc:697] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 14 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
W20260709 12:15:16.779727 10194 log.cc:927] Time spent T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.497s	user 0.001s	sys 0.002s
I20260709 12:15:16.754523 10163 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:16.756362  5837 raft_consensus.cc:2368] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 11. Current term is 12.
W20260709 12:15:16.781061  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 107010us
W20260709 12:15:16.777977  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 106155us
I20260709 12:15:16.772400  5831 raft_consensus.cc:2393] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 13: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:15:16.783269  5801 leader_election.cc:304] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:16.787132  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:16.788277  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:16.789621  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:15:16.785305  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 211291us
I20260709 12:15:16.792058  5088 leader_election.cc:304] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:16.792641  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:16.793313  5123 raft_consensus.cc:3060] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:16.790321  5832 raft_consensus.cc:2468] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 11.
I20260709 12:15:16.795544  5088 leader_election.cc:304] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:16.796317  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:16.797044  5832 raft_consensus.cc:2468] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 13.
I20260709 12:15:16.791333  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:16.799332  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:16.801584  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:16.802729  5122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40402 (request call id 2779) took 1676 ms. Trace:
I20260709 12:15:16.803156  5122 rpcz_store.cc:276] 0709 12:15:15.126373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:15.131159 (+  4786us) service_pool.cc:224] Handling call
0709 12:15:15.131535 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:15.131896 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:15.131926 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:15.158116 (+ 26190us) log.cc:844] Serialized 26 byte log entry
0709 12:15:15.718379 (+560263us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:15:15.718415 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:15.718476 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:16.779135 (+1060659us) spinlock_profiling.cc:243] Waited 8.73 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e675e86e 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221 00007f84e67671d9 00007f84e6767169
0709 12:15:16.781001 (+  1866us) raft_consensus.cc:1685] finished
0709 12:15:16.781021 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:16.801365 (+ 20344us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":160,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":48653,"spinlock_wait_cycles":20076416,"thread_start_us":508933,"threads_started":1,"wal-append.queue_time_us":810612}
I20260709 12:15:16.801854  5124 raft_consensus.cc:2393] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 13: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:15:16.776284  5200 rpcz_store.cc:276] 0709 12:15:15.543883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:15.544002 (+   119us) service_pool.cc:224] Handling call
0709 12:15:15.544296 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:15.544489 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:15:15.571629 (+ 27140us) log.cc:844] Serialized 14 byte log entry
0709 12:15:15.658175 (+ 86546us) spinlock_profiling.cc:243] Waited 2.75 ms on lock 0x7b1800062b00. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3a50c0a 00007f84ed190219 00007f84e3ad8a40 00007f84e3ad34e4 00007f84e3ad5c02 00007f84e675d20b 00007f84e6762d23 00007f84e676323a 00007f84e6bcda2a
0709 12:15:16.775372 (+1117197us) spinlock_profiling.cc:243] Waited 6.87 ms on lock 0x7b1800062b00. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e676b4bc 00007f84e3ab948b 00007f84ec9139a9 00007f84e3ad569b 00007f84e3ad393f 00007f84e3ad3455 00007f84e6bbb060 00007f84e6bcd716 00007f84e6bde287
0709 12:15:16.775554 (+   182us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:16.775606 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:15:16.775651 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:16.775716 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:16.775828 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3887,"prepare.queue_time_us":30157,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":38290,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":22331,"spinlock_wait_cycles":22145024,"thread_start_us":690535,"threads_started":2,"wal-append.queue_time_us":789070}
I20260709 12:15:16.812706  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:16.816645  5121 raft_consensus.cc:1240] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:16.817075  5089 leader_election.cc:304] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:15:16.817538  5088 leader_election.cc:304] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:16.816054  5164 leader_election.cc:304] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:16.761330 10228 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:16.768241 10150 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:16.771589 10137 leader_election.cc:290] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:16.826591 10227 raft_consensus.cc:2804] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:16.827085 10227 raft_consensus.cc:493] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:16.827414 10227 raft_consensus.cc:3060] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:16.791254 10058 raft_consensus.cc:493] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:16.808990 10173 raft_consensus.cc:2749] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:16.806231 10075 raft_consensus.cc:2749] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:16.823668  5123 raft_consensus.cc:2468] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 12.
I20260709 12:15:16.772877 10224 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:16.837529  5804 leader_election.cc:304] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:15:16.808044 10144 consensus_queue.cc:1048] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 12:15:16.829859 10119 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:16.832361 10228 raft_consensus.cc:2749] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:16.779661  9986 consensus_queue.cc:237] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:16.835832 10058 raft_consensus.cc:515] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:16.878989  5266 raft_consensus.cc:1275] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:15:16.887481  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:16.888566  5266 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 14.
I20260709 12:15:16.891413  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:16.892304  5266 raft_consensus.cc:2468] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 14.
I20260709 12:15:16.894661  5829 raft_consensus.cc:1240] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 10 LEADER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:16.898459  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:16.899413  5835 raft_consensus.cc:2468] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 13.
I20260709 12:15:16.871634 10075 raft_consensus.cc:2804] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:16.906180  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:16.903479  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:16.901299  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:16.904954  5274 raft_consensus.cc:1240] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 17 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:15:16.905552  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:16.908420  5270 raft_consensus.cc:2468] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 16.
I20260709 12:15:16.907711  5265 raft_consensus.cc:2393] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 12: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:15:16.906983 10233 raft_consensus.cc:2804] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:16.910383 10233 raft_consensus.cc:493] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:16.910720 10233 raft_consensus.cc:3060] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:16.918955 10233 raft_consensus.cc:515] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:16.921092 10058 leader_election.cc:290] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:16.921298 10233 leader_election.cc:290] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:16.923864 10224 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:16.921473  5272 raft_consensus.cc:2393] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 15: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:15:16.934736 10125 raft_consensus.cc:3055] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:15:16.935354 10125 raft_consensus.cc:740] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:16.936395 10125 consensus_queue.cc:260] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:16.938798  5269 raft_consensus.cc:1240] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 7. Current term is 8. Ops: []
I20260709 12:15:16.942114  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:16.942997  5269 raft_consensus.cc:2393] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 10: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:15:16.945865  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:16.954567  5269 raft_consensus.cc:1275] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:15:16.957806 10066 consensus_queue.cc:260] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:16.959446 10066 raft_consensus.cc:3060] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:16.960124  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:16.904945 10173 raft_consensus.cc:2749] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:16.964538 10075 raft_consensus.cc:697] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 12 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:15:16.965682 10075 consensus_queue.cc:237] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:16.957809  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:16.980464  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:16.981362  5265 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 8.
I20260709 12:15:16.983070  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:16.985270  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:16.975203  5272 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 14.
W20260709 12:15:16.945712 10210 log.cc:927] Time spent T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.565s	user 0.003s	sys 0.000s
I20260709 12:15:16.989478 10216 raft_consensus.cc:493] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:16.990753  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:15:16.992901  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 373374us
W20260709 12:15:16.995771  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 178759us
W20260709 12:15:16.994951  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 314201us
I20260709 12:15:16.942428 10095 raft_consensus.cc:3055] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:15:16.989813 10163 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:16.985733 10058 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:16.992125 10125 raft_consensus.cc:3060] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:15:16.999051  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 181590us
I20260709 12:15:16.992623 10022 raft_consensus.cc:493] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:17.015908  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:17.020437  5829 raft_consensus.cc:3060] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:17.021657  5125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40402 (request call id 2783) took 1298 ms. Trace:
I20260709 12:15:17.022114  5125 rpcz_store.cc:276] 0709 12:15:15.722761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:15.727545 (+  4784us) service_pool.cc:224] Handling call
0709 12:15:15.727866 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:15.728210 (+   344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:15.728237 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:15.733722 (+  5485us) log.cc:844] Serialized 26 byte log entry
0709 12:15:15.854171 (+120449us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b180044d160. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3ab8e07 00007f84ec9139a9 00007f84e3ad569b 00007f84e3ad393f 00007f84e3ad5c02 00007f84e675d20b 00007f84e6762d23 00007f84e67630d1 00007f84e6b7ea0f
0709 12:15:16.194965 (+340794us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:15:16.195351 (+   386us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:16.195430 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:16.945043 (+749613us) spinlock_profiling.cc:243] Waited 4.11 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e675e86e 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221 00007f84e67671d9 00007f84e6767169
0709 12:15:17.021358 (+ 76315us) raft_consensus.cc:1685] finished
0709 12:15:17.021458 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:17.021589 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3948,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":5637,"spinlock_wait_cycles":36363008,"thread_start_us":340601,"threads_started":1,"wal-append.queue_time_us":586120}
I20260709 12:15:17.023797  5164 leader_election.cc:400] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 election: Vote denied by peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539) with higher term. Message: Invalid argument: T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 11. Current term is 12.
I20260709 12:15:17.024168  5164 leader_election.cc:403] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:15:17.025290  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:17.025899  5270 raft_consensus.cc:3060] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:17.026444  5117 raft_consensus.cc:1240] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:17.028314  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:17.028970  5120 raft_consensus.cc:2468] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 13.
I20260709 12:15:17.030010  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:17.030808  5119 raft_consensus.cc:2393] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 17: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:15:16.997547 10095 raft_consensus.cc:740] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:17.037161  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:17.037957  5266 raft_consensus.cc:2468] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 9.
I20260709 12:15:17.038419  5270 raft_consensus.cc:2468] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 13.
I20260709 12:15:17.038938  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:17.037163  5238 leader_election.cc:304] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:17.039803  5197 raft_consensus.cc:2468] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 11.
I20260709 12:15:17.043520  5238 leader_election.cc:304] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:17.043728  5192 raft_consensus.cc:1240] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 LEADER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 7. Current term is 8. Ops: []
I20260709 12:15:17.043565  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:17.045769  5238 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:17.046350  5197 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 12.
I20260709 12:15:17.051106  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:17.010800 10178 raft_consensus.cc:493] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:17.054901  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:17.055588  5200 raft_consensus.cc:2468] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 11.
W20260709 12:15:17.061092  5088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:17.062023  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:16.996161 10216 raft_consensus.cc:515] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:17.061975  5088 leader_election.cc:304] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:17.004066 10093 consensus_queue.cc:1059] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 12:15:17.034560  9935 raft_consensus.cc:493] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:17.078666  5088 leader_election.cc:304] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:17.036531  9783 raft_consensus.cc:3060] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:17.080873  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:15:17.079424  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 276063us
I20260709 12:15:17.082942  5088 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:17.083891  5088 leader_election.cc:400] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 16 election: Vote denied by peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455) with higher term. Message: Invalid argument: T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 16. Current term is 17.
I20260709 12:15:17.085108  5088 leader_election.cc:304] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:17.020123 10058 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:17.054237 10217 raft_consensus.cc:493] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:17.063143  9928 raft_consensus.cc:2749] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:15:17.036343  9941 consensus_queue.cc:1048] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:15:17.037603  9811 consensus_queue.cc:1059] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 12:15:17.019305 10235 consensus_queue.cc:1048] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 12:15:17.062942  5119 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
 from {username='slave'} at 127.0.0.1:40402
I20260709 12:15:17.088128 10173 raft_consensus.cc:2804] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:17.084357 10144 raft_consensus.cc:2749] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:17.084266 10234 raft_consensus.cc:2804] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:17.111513  5088 leader_election.cc:304] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:17.112847  5088 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:17.037297 10022 raft_consensus.cc:515] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:17.067358 10178 raft_consensus.cc:515] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:17.106532  5119 raft_consensus.cc:493] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:17.120884  5119 raft_consensus.cc:3060] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:17.064692 10108 raft_consensus.cc:2749] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:15:17.110419  5200 raft_consensus.cc:3060] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:17.091076 10084 raft_consensus.cc:2764] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:15:17.128914  5194 raft_consensus.cc:606] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 LEADER]: Received request to transfer leadership to TS ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:17.134372  5088 leader_election.cc:304] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:17.086197  9935 raft_consensus.cc:515] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:17.110781 10173 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:17.127079 10228 raft_consensus.cc:2749] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:15:17.153815  5088 leader_election.cc:304] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:17.140623  5119 raft_consensus.cc:515] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:17.157054  5829 raft_consensus.cc:2468] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 14.
I20260709 12:15:17.119424 10234 raft_consensus.cc:493] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:17.128204 10163 raft_consensus.cc:2764] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:15:17.126150 10244 raft_consensus.cc:2749] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:17.101058 10217 raft_consensus.cc:515] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:17.091406 10095 consensus_queue.cc:260] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:17.113956  9928 consensus_queue.cc:1048] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
W20260709 12:15:17.159847  5863 heartbeater.cc:646] Failed to heartbeat to 127.3.212.190:33295 (3 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.3.212.190:33295 timed out after 15.000s (SENT)
I20260709 12:15:17.145076 10144 raft_consensus.cc:2804] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:17.153160 10173 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:17.166504 10224 raft_consensus.cc:2804] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:17.173321  9811 raft_consensus.cc:3055] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:17.175107 10221 raft_consensus.cc:493] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:17.193886 10236 log.cc:927] Time spent T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
W20260709 12:15:17.214013 10204 log.cc:927] Time spent T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.520s	user 0.004s	sys 0.000s
I20260709 12:15:17.223873  9935 leader_election.cc:290] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:17.235461  5124 raft_consensus.cc:1275] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:15:17.238271 10022 leader_election.cc:290] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:15:17.239955  5020 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50918 (request call id 228) took 33174 ms (client timeout 15000 ms). Trace:
W20260709 12:15:17.175841  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 126280us
I20260709 12:15:17.240635 10227 raft_consensus.cc:515] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:17.189704  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 144014us
I20260709 12:15:17.240177  5089 leader_election.cc:304] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:15:17.250908  5238 leader_election.cc:304] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:17.241461  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:17.242380 10178 leader_election.cc:290] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:17.243065  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:17.168478 10234 raft_consensus.cc:3060] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:17.243548  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:17.256316 10244 raft_consensus.cc:2804] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:17.256865 10244 raft_consensus.cc:697] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:17.258451  5119 leader_election.cc:290] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:17.259522  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:17.260679  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:17.181191 10144 raft_consensus.cc:493] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:17.245031  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:17.185165 10224 raft_consensus.cc:493] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:17.247723  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:17.291390  5120 raft_consensus.cc:2468] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 12.
W20260709 12:15:17.241055  5020 rpcz_store.cc:269] 0709 12:14:44.065800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:14:44.065990 (+   190us) service_pool.cc:224] Handling call
0709 12:15:17.239746 (+33173756us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14092,"reported_tablets":39}
I20260709 12:15:17.248523  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:17.192448 10095 raft_consensus.cc:3060] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:17.189865  9811 raft_consensus.cc:740] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:15:17.188318  5200 raft_consensus.cc:2468] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 13.
I20260709 12:15:17.263814  5270 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
mode: GRACEFUL
new_leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
 from {username='slave'} at 127.0.0.1:43644
I20260709 12:15:17.270305  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:17.261358  5119 raft_consensus.cc:2393] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 13: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:15:17.296875  5194 raft_consensus.cc:3060] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:17.277719  5238 leader_election.cc:304] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:17.278951  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:17.247392 10216 leader_election.cc:290] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:17.266225 10234 raft_consensus.cc:515] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:17.266490 10189 raft_consensus.cc:2804] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:17.305152  5192 raft_consensus.cc:1240] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:17.266613 10205 raft_consensus.cc:493] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:17.308204  5088 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:17.289371 10144 raft_consensus.cc:3060] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:17.285066  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:17.279057  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:17.281039  5123 raft_consensus.cc:2468] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 17.
I20260709 12:15:17.287624 10217 leader_election.cc:290] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:17.244122  5125 raft_consensus.cc:1275] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 17 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:15:17.247166 10058 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:17.296751  5270 raft_consensus.cc:606] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Received request to transfer leadership to TS ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:17.281271 10178 raft_consensus.cc:493] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:17.298530  5166 leader_election.cc:304] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:17.312842  5270 raft_consensus.cc:614] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:17.302955  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:17.277331  9783 raft_consensus.cc:2749] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539) with higher term. Message: Invalid argument: T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 11. Current term is 12.
I20260709 12:15:17.284062  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:17.315344  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:17.291684 10224 raft_consensus.cc:3060] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:15:17.313616  5166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:17.314078  5196 raft_consensus.cc:2468] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 17.
I20260709 12:15:17.301239  5197 raft_consensus.cc:1275] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:15:17.316033  5120 raft_consensus.cc:2468] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 11.
W20260709 12:15:17.320935  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 237481us
I20260709 12:15:17.297096 10065 raft_consensus.cc:493] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:17.278542 10201 consensus_queue.cc:1048] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
W20260709 12:15:17.328032  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 50379.7us
I20260709 12:15:17.297307 10242 raft_consensus.cc:493] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:17.329032  5238 leader_election.cc:304] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:17.325623  5166 leader_election.cc:304] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:17.255376 10221 raft_consensus.cc:515] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:17.330638  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 248638us
I20260709 12:15:17.331876  5801 leader_election.cc:304] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:15:17.333316  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:15:17.315390 10163 raft_consensus.cc:2804] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:17.335714  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:17.314893 10216 raft_consensus.cc:2749] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:17.338835  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:17.339589  5021 catalog_manager.cc:5697] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 9 to 10, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 10 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:17.341578  5021 catalog_manager.cc:5697] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 7 to 9, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 9 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:17.342249  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:17.342918  5196 raft_consensus.cc:2468] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 11.
I20260709 12:15:17.334295 10065 raft_consensus.cc:515] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:17.336606 10126 raft_consensus.cc:2749] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:15:17.345897 10065 leader_election.cc:290] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:17.345005 10252 raft_consensus.cc:2804] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:17.347273 10252 raft_consensus.cc:697] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 14 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:15:17.348212 10252 consensus_queue.cc:237] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:17.334120  9783 raft_consensus.cc:2804] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:15:17.350167  5200 raft_consensus.cc:1240] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 LEADER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 15. Current term is 16. Ops: []
I20260709 12:15:17.351078 10228 raft_consensus.cc:493] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:17.360651  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
W20260709 12:15:17.366282  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 43967us
I20260709 12:15:17.365149  5198 raft_consensus.cc:1240] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:17.374586  5195 raft_consensus.cc:3060] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:17.376899  5837 raft_consensus.cc:2468] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 12.
I20260709 12:15:17.364672  5021 catalog_manager.cc:5697] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 5 to 10, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 10 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:17.361230  5116 raft_consensus.cc:1275] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:15:17.381848  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:17.382707  5199 raft_consensus.cc:2393] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 15: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
W20260709 12:15:17.384701  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 55780.2us
I20260709 12:15:17.385468  5238 leader_election.cc:304] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:17.387208  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:17.387990  5191 raft_consensus.cc:2368] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 12. Current term is 13.
I20260709 12:15:17.375775  5240 leader_election.cc:304] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:15:17.388517  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:17.391368  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:17.394348  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:17.316566 10119 consensus_queue.cc:1048] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 12:15:17.386978 10198 raft_consensus.cc:493] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:17.398191  5198 raft_consensus.cc:1275] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 17 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:15:17.399641  5198 raft_consensus.cc:1275] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:15:17.401190  5195 raft_consensus.cc:2468] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 14.
I20260709 12:15:17.323555 10178 raft_consensus.cc:515] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:17.377321  9783 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:17.366004 10189 raft_consensus.cc:697] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 12 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:17.396414  5021 catalog_manager.cc:5697] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:17.403477  9928 raft_consensus.cc:2804] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:17.408951  9928 raft_consensus.cc:493] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:17.409469  9928 raft_consensus.cc:3060] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:17.410271 10000 raft_consensus.cc:3055] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:17.410707 10000 raft_consensus.cc:740] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:17.411788  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:17.389792 10114 consensus_queue.cc:1059] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 12:15:17.412686  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:17.315008 10205 raft_consensus.cc:515] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:17.414475 10114 raft_consensus.cc:493] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:17.415007 10205 leader_election.cc:290] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:17.416090  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:17.418839  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:17.376323 10163 raft_consensus.cc:697] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:17.411527 10000 consensus_queue.cc:260] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:17.412182  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:17.391399 10084 raft_consensus.cc:2749] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:17.424134  5193 raft_consensus.cc:2468] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 12.
I20260709 12:15:17.421972  5801 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:17.439465  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:17.440209  5268 raft_consensus.cc:2468] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 12.
I20260709 12:15:17.441992  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:17.442790  5271 raft_consensus.cc:2393] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 13: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:15:17.446105  5266 raft_consensus.cc:2393] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 14: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:15:17.447491  5021 catalog_manager.cc:5697] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 9 to 11, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 11 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:17.426640 10243 consensus_queue.cc:1059] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:15:17.353142  9811 consensus_queue.cc:260] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:17.453261  5166 leader_election.cc:304] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:17.453835 10000 raft_consensus.cc:3060] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:17.456650  9985 raft_consensus.cc:2749] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:15:17.458283  5801 leader_election.cc:400] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Vote denied by peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455) with higher term. Message: Invalid argument: T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 12. Current term is 13.
I20260709 12:15:17.459407 10227 leader_election.cc:290] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:17.461774 10189 consensus_queue.cc:237] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:17.338129 10242 raft_consensus.cc:515] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:17.465318 10221 leader_election.cc:290] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:15:17.465744 10190 consensus_queue.cc:1175] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "bce73265e27d4b30a4dcc1e491305088" responder_term: 14 status { last_received { term: 12 index: 11 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 13. Current term is 14. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:15:17.466121 10163 consensus_queue.cc:237] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:17.468132  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 74316.1us
I20260709 12:15:17.415659 10205 raft_consensus.cc:3055] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:17.474099  5194 raft_consensus.cc:2468] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 10.
I20260709 12:15:17.475968  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:17.500902  5123 raft_consensus.cc:3060] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:17.503135  5088 leader_election.cc:304] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:17.419109  9783 raft_consensus.cc:3060] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:17.405488 10254 raft_consensus.cc:2749] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:17.325934 10244 consensus_queue.cc:237] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:17.389639 10228 raft_consensus.cc:515] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:17.398461 10198 raft_consensus.cc:515] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:17.485447  5801 leader_election.cc:403] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:17.486590  5021 catalog_manager.cc:5697] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:17.488157 10217 raft_consensus.cc:2804] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:17.488617 10178 leader_election.cc:290] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:17.490512  5120 raft_consensus.cc:1275] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:15:17.491091  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:17.415022 10114 raft_consensus.cc:515] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:17.508571  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 86124.2us
I20260709 12:15:17.516161  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:17.520326  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:17.530506  5829 raft_consensus.cc:3060] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Advancing to term 13
W20260709 12:15:17.531282  5088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:17.534775  5120 raft_consensus.cc:1275] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:15:17.520241  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:17.537569  5021 catalog_manager.cc:5697] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 4 to 12, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 12 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:17.500308 10205 raft_consensus.cc:740] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:17.520283  5164 leader_election.cc:304] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
W20260709 12:15:17.537683  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 79691.8us
I20260709 12:15:17.553699  5237 leader_election.cc:304] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:17.491509 10066 consensus_queue.cc:1048] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:15:17.564399  5829 raft_consensus.cc:2468] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 13.
I20260709 12:15:17.564994  5164 leader_election.cc:304] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:17.556701  5123 raft_consensus.cc:2468] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 13.
I20260709 12:15:17.537127 10217 raft_consensus.cc:493] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:17.526142  9811 raft_consensus.cc:3060] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:17.569598  5265 raft_consensus.cc:2468] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 10.
I20260709 12:15:17.521539 10022 raft_consensus.cc:493] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:17.573369  5164 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:17.509795 10125 raft_consensus.cc:2804] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:17.576504  5125 raft_consensus.cc:1240] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 15. Current term is 16. Ops: []
W20260709 12:15:17.606741  5804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:17.607511  5021 catalog_manager.cc:5697] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 7 to 9, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 9 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:15:17.614023  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 60453.8us
I20260709 12:15:17.567308 10238 raft_consensus.cc:493] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:17.616353  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:17.567577 10221 raft_consensus.cc:2749] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455) with higher term. Message: Invalid argument: T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 12. Current term is 13.
I20260709 12:15:17.592211  5801 leader_election.cc:304] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:17.569198 10218 raft_consensus.cc:2749] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:17.631524  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:17.571592 10217 raft_consensus.cc:3060] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:17.559913 10234 leader_election.cc:290] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:17.629779  5192 raft_consensus.cc:1240] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:17.632314  5193 raft_consensus.cc:2468] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 12.
I20260709 12:15:17.632027  5021 catalog_manager.cc:5697] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 6 to 11, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 11 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:17.578749 10095 raft_consensus.cc:2749] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:17.545826 10250 consensus_queue.cc:1048] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.102s
I20260709 12:15:17.568274 10178 consensus_queue.cc:1048] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
W20260709 12:15:17.645515  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 53407.5us
I20260709 12:15:17.568017 10058 consensus_queue.cc:1048] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 12:15:17.615173 10072 raft_consensus.cc:2749] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:17.570183 10034 consensus_queue.cc:1048] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
W20260709 12:15:17.665086 10257 log.cc:927] Time spent T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 12:15:17.576779 10248 consensus_queue.cc:1059] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.091s
I20260709 12:15:17.661897  5801 leader_election.cc:304] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:17.697314  5801 leader_election.cc:304] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:17.698637  5801 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:17.566769  9985 consensus_queue.cc:1048] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.074s
I20260709 12:15:17.642392 10239 raft_consensus.cc:2804] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:15:17.706452 10239 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:17.706894 10239 raft_consensus.cc:3060] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:17.688755  5021 catalog_manager.cc:5697] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 8 to 14, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 14 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:17.710789  5021 catalog_manager.cc:5697] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 5 to 10, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 10 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:17.612952 10022 raft_consensus.cc:515] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:17.658672 10119 raft_consensus.cc:2749] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:15:17.683146 10251 log.cc:927] Time spent T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.278s	user 0.000s	sys 0.001s
W20260709 12:15:17.705181 10258 log.cc:927] Time spent T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
I20260709 12:15:17.626784  9928 raft_consensus.cc:515] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:17.642575 10205 consensus_queue.cc:260] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:17.704373  5801 leader_election.cc:304] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:17.722185  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:17.731446  5197 raft_consensus.cc:2468] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 10.
I20260709 12:15:17.733021  5088 leader_election.cc:304] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:17.738848  5197 raft_consensus.cc:1275] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:15:17.701403 10231 raft_consensus.cc:2749] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:17.717336 10219 raft_consensus.cc:2749] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:17.632874 10238 raft_consensus.cc:515] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:17.714421 10201 raft_consensus.cc:2804] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:17.700438 10125 raft_consensus.cc:697] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:17.793191  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:17.691533 10108 consensus_queue.cc:1048] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:15:17.774113 10119 raft_consensus.cc:3060] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:17.811918  5021 catalog_manager.cc:5697] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 7 to 9, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 9 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:17.795563 10205 raft_consensus.cc:3060] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:17.793510 10163 raft_consensus.cc:2804] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:15:17.825292  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 295794us
I20260709 12:15:17.789418 10201 raft_consensus.cc:493] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
W20260709 12:15:17.822310  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 191477us
W20260709 12:15:17.832191  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 215465us
I20260709 12:15:17.797489 10267 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:17.825407 10266 raft_consensus.cc:3055] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:17.894870  5237 leader_election.cc:304] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:17.894259 10201 raft_consensus.cc:3060] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:17.834699 10163 raft_consensus.cc:493] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:17.896821 10242 leader_election.cc:290] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:17.899197 10198 leader_election.cc:290] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:17.904093 10228 leader_election.cc:290] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:17.903566 10266 raft_consensus.cc:740] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
W20260709 12:15:17.964457  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 69707.1us
I20260709 12:15:17.905998 10034 raft_consensus.cc:493] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:17.962348  5801 leader_election.cc:304] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
W20260709 12:15:17.936321 10173 consensus_meta.cc:287] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.748s	user 0.013s	sys 0.001s
W20260709 12:15:17.963502  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 129639us
I20260709 12:15:17.956490 10114 leader_election.cc:290] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:17.901839 10267 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:17.921010 10163 raft_consensus.cc:3060] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:17.988603 10266 consensus_queue.cc:260] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:17.990711  9935 raft_consensus.cc:2804] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:17.991247 10075 raft_consensus.cc:2804] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:18.002414  5194 raft_consensus.cc:1240] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:17.999570 10065 raft_consensus.cc:493] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:18.004019 10231 consensus_queue.cc:1048] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:15:18.023957 10065 raft_consensus.cc:515] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:17.999927 10228 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:18.025044 10228 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:18.026083 10065 leader_election.cc:290] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:18.018050  5193 raft_consensus.cc:1275] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:15:18.004508 10264 log.cc:927] Time spent T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 12:15:18.022220 10270 log.cc:927] Time spent T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 12:15:17.965715 10198 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:18.023272  9935 raft_consensus.cc:493] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:18.042994 10231 consensus_queue.cc:1048] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:15:18.043538 10267 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:18.044734 10022 leader_election.cc:290] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:18.028142 10075 raft_consensus.cc:493] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:18.045535  9928 leader_election.cc:290] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:17.956398 10125 consensus_queue.cc:237] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:17.971451 10034 raft_consensus.cc:515] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:18.027195 10228 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:15:18.022221 10144 consensus_meta.cc:287] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.699s	user 0.008s	sys 0.003s
W20260709 12:15:18.055286 10000 consensus_meta.cc:287] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.566s	user 0.008s	sys 0.003s
I20260709 12:15:18.074105  9935 raft_consensus.cc:3060] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:18.109189 10075 raft_consensus.cc:3060] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:18.091418 10072 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:18.066514 10108 raft_consensus.cc:493] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:18.137770  5270 raft_consensus.cc:2410] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:15:18.120675 10271 consensus_queue.cc:1059] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:15:18.121953 10144 raft_consensus.cc:515] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:18.071672 10198 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:18.170158 10244 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:18.173838 10253 raft_consensus.cc:3055] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:17.979868 10173 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:18.179665  5193 raft_consensus.cc:1275] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:15:18.145941 10238 leader_election.cc:290] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:15:18.197669 10272 log.cc:927] Time spent T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.231s	user 0.000s	sys 0.001s
I20260709 12:15:18.199213 10034 leader_election.cc:290] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:18.205781  5166 leader_election.cc:304] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:18.139751 10108 raft_consensus.cc:515] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:18.234726  5273 raft_consensus.cc:1275] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:15:18.235229  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:18.140436 10072 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:18.208125 10201 raft_consensus.cc:515] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:18.209211  9811 consensus_meta.cc:287] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.631s	user 0.010s	sys 0.000s
W20260709 12:15:18.227048  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 308647us
I20260709 12:15:18.231163 10022 raft_consensus.cc:2804] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:18.244753  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:18.220299 10271 consensus_queue.cc:1243] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer dd62e75bd3ed4ed28f1fb5955d650808 log is divergent from this leader: its last log entry 16.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:15:18.244335  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:18.235735  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:18.236399  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:15:18.241781 10224 consensus_meta.cc:287] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.909s	user 0.012s	sys 0.000s
I20260709 12:15:18.238292  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:18.238530  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:18.212921 10253 raft_consensus.cc:740] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:15:18.237447  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:18.283003  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:18.284243  5267 raft_consensus.cc:2368] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 13. Current term is 14.
I20260709 12:15:18.284518  5269 raft_consensus.cc:2468] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 11.
I20260709 12:15:18.284109  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:18.285142  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:18.286073  5267 raft_consensus.cc:2410] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:15:18.221446 10244 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:18.287242  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:18.288482  5271 raft_consensus.cc:3055] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:18.288319  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:18.289112  5271 raft_consensus.cc:740] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:18.294399  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:18.294804  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:15:18.308307  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 343071us
I20260709 12:15:18.308907  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:18.264542 10228 raft_consensus.cc:493] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:18.317654  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:15:18.292925  9783 consensus_meta.cc:287] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.762s	user 0.009s	sys 0.002s
W20260709 12:15:18.287288 10286 log.cc:927] Time spent T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:15:18.290294 10267 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:18.317624  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:18.285493 10034 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:18.327440 10250 raft_consensus.cc:993] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929: : Instructing follower ad2f9a1e2f7a45429fa69fd23d09f821 to start an election
I20260709 12:15:18.327680 10034 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:18.311607 10231 consensus_queue.cc:1059] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 12:15:18.329097 10231 raft_consensus.cc:3055] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:18.329463 10231 raft_consensus.cc:740] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:15:18.330471 10231 consensus_queue.cc:260] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:18.331811 10231 raft_consensus.cc:3060] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:15:18.299748 10239 consensus_meta.cc:287] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.592s	user 0.005s	sys 0.005s
I20260709 12:15:18.340325  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:18.341041  5116 raft_consensus.cc:3060] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:18.342425  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:18.344276  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:18.288102 10224 raft_consensus.cc:515] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:15:18.325474 10217 consensus_meta.cc:287] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.665s	user 0.011s	sys 0.000s
I20260709 12:15:18.375799  5801 leader_election.cc:304] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:18.322402 10228 raft_consensus.cc:515] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:18.379180 10228 leader_election.cc:290] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:18.378579 10274 raft_consensus.cc:2955] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 12 LEADER]: Committing config change with OpId 12.11: config changed from index 6 to 11, VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:18.348923 10235 consensus_queue.cc:1059] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:15:18.348923 10239 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:18.382754  5122 raft_consensus.cc:2368] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 12. Current term is 13.
I20260709 12:15:18.382946 10224 leader_election.cc:290] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:18.383724 10239 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:18.348559 10253 consensus_queue.cc:260] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:18.381075 10034 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:18.387302  5118 raft_consensus.cc:2468] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 8.
I20260709 12:15:18.334470  9783 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:15:18.390045 10285 log.cc:927] Time spent T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:15:18.297623 10000 consensus_queue.cc:1059] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 12:15:18.391731 10253 raft_consensus.cc:3060] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:18.395490  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:18.396382  5196 raft_consensus.cc:2468] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 12.
I20260709 12:15:18.399091  5266 raft_consensus.cc:3055] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:15:18.399575  5266 raft_consensus.cc:740] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:18.403640  5116 raft_consensus.cc:2468] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 14.
I20260709 12:15:18.405539 10066 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:18.408197 10066 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:18.407181  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:18.413866  5122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40386 (request call id 2376) took 1175 ms. Trace:
I20260709 12:15:18.414356  5122 rpcz_store.cc:276] 0709 12:15:17.238134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:17.241201 (+  3067us) service_pool.cc:224] Handling call
0709 12:15:18.413602 (+1172401us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54001b3354. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:15:18.413782 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2600900992}
W20260709 12:15:18.429734 10287 log.cc:927] Time spent T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.138s	user 0.003s	sys 0.000s
I20260709 12:15:18.433146  5122 raft_consensus.cc:1240] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 LEADER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:18.435248 10266 raft_consensus.cc:3060] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:18.441931  5124 raft_consensus.cc:1275] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:15:18.443157  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:15:18.392590 10279 log.cc:927] Time spent T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260709 12:15:18.450357 10058 raft_consensus.cc:493] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:18.450752 10221 raft_consensus.cc:493] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:18.451355 10221 raft_consensus.cc:515] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:18.454267 10201 leader_election.cc:290] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:18.455459 10221 leader_election.cc:290] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:15:18.447021 10119 consensus_meta.cc:287] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088: Time spent flushing consensus metadata: real 0.627s	user 0.009s	sys 0.002s
I20260709 12:15:18.456955 10119 raft_consensus.cc:2749] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:18.458050  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:18.458753  5193 raft_consensus.cc:2468] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 17.
I20260709 12:15:18.459931 10173 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 15 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:18.311411  9811 consensus_queue.cc:1048] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 12:15:18.347417 10267 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:18.470532 10250 raft_consensus.cc:1081] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 11 LEADER]: Signalling peer ad2f9a1e2f7a45429fa69fd23d09f821 to start an election
W20260709 12:15:18.471134  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 98343.8us
I20260709 12:15:18.472612 10144 leader_election.cc:290] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:18.475468  9935 raft_consensus.cc:515] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:18.478507 10108 leader_election.cc:290] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:15:18.481801  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 131818us
I20260709 12:15:18.493443  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:18.494576  5124 raft_consensus.cc:3060] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:18.448695  9985 raft_consensus.cc:2804] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:18.495333  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:18.496474  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:18.496755  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5815aa6770341a7ae03cf8dc1b8a05e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:18.497905  5240 leader_election.cc:304] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:15:18.501706  5166 leader_election.cc:400] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Vote denied by peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443) with higher term. Message: Invalid argument: T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 12. Current term is 13.
I20260709 12:15:18.502072  5166 leader_election.cc:403] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:18.503564  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:18.504189  5121 raft_consensus.cc:2468] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 15.
I20260709 12:15:18.504976  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:18.505225  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:18.505897  5829 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:18.507448  5837 raft_consensus.cc:1240] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:18.508934  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:18.509549  5836 raft_consensus.cc:3060] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:15:18.509739  5166 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:18.519917  5836 raft_consensus.cc:2468] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 14.
I20260709 12:15:18.392984 10217 raft_consensus.cc:515] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:18.522622  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:18.488423 10244 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:18.523897  5272 raft_consensus.cc:2393] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 13: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:15:18.524394  5830 raft_consensus.cc:1275] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:15:18.535959  5269 raft_consensus.cc:1275] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:15:18.538271  5166 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:18.529239  5125 raft_consensus.cc:2468] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 12.
I20260709 12:15:18.532469  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:18.495573 10058 raft_consensus.cc:515] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:18.531554 10198 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:18.520680 10108 raft_consensus.cc:2804] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:18.536799  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:18.449518 10075 raft_consensus.cc:515] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:18.528654  5835 raft_consensus.cc:1240] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:18.548439  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:18.549408  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:18.497673  9985 raft_consensus.cc:493] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:18.497467 10189 raft_consensus.cc:493] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:18.566066  5238 leader_election.cc:304] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:18.569170  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:18.573217  5191 raft_consensus.cc:1240] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:18.570938 10022 raft_consensus.cc:697] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:18.582392  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:18.605924 10093 raft_consensus.cc:2749] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:18.606498  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:18.608084  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:18.609319  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:18.611204  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:18.588899  5829 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 15.
W20260709 12:15:18.585836  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 293985us
I20260709 12:15:18.614594  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:15:18.581684  5197 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.011s	sys 0.021s
W20260709 12:15:18.602835  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 68400.5us
I20260709 12:15:18.616031  5121 raft_consensus.cc:1275] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:15:18.613281  5273 raft_consensus.cc:1240] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 9. Current term is 10. Ops: []
W20260709 12:15:18.615463  5197 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.011s	sys 0.021s
I20260709 12:15:18.594177  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:18.624939  5125 raft_consensus.cc:1240] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:18.596391  5124 raft_consensus.cc:2468] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 18.
I20260709 12:15:18.626642  5124 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
 from {username='slave'} at 127.0.0.1:40402
I20260709 12:15:18.628998  5125 raft_consensus.cc:1240] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:18.630015  5124 raft_consensus.cc:493] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:18.630625  5124 raft_consensus.cc:3060] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:15:18.634939  5088 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:18.636649  5088 leader_election.cc:304] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:18.635037  5164 leader_election.cc:304] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:18.588438  9985 raft_consensus.cc:3060] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:18.623588  5121 raft_consensus.cc:2955] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 6 to 11, VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:18.644613  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:18.602198 10108 raft_consensus.cc:697] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 14 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:18.646078  5124 raft_consensus.cc:515] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:18.654820  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:18.634105 10201 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:18.689604  5117 raft_consensus.cc:1240] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 LEADER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:18.686754 10224 raft_consensus.cc:3060] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:18.687053  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:18.640504 10266 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:18.593976 10189 raft_consensus.cc:515] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:18.692107  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:18.694514  5273 raft_consensus.cc:3060] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:18.650486 10296 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:18.698711 10274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:34668 (request call id 92) took 3610 ms. Trace:
I20260709 12:15:18.706074 10190 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:18.706897 10190 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:18.705940 10274 rpcz_store.cc:276] 0709 12:15:15.099005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:15.099151 (+   146us) service_pool.cc:224] Handling call
0709 12:15:15.243563 (+144412us) spinlock_profiling.cc:243] Waited 76 ms on lock 0x7b540024ff20. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6b38a1d 00007f84e6b1f1a4 00007f84e6ba1447 00007f84e6bbe70a 00007f84e6bbf76a 00007f84e6bbe91b 00007f84e6bca03c 00007f84e6bc96b3 00007f84e6bc19fa 00007f84ebb894c9
0709 12:15:15.363627 (+120064us) log.cc:844] Serialized 501 byte log entry
0709 12:15:16.579046 (+1215419us) spinlock_profiling.cc:243] Waited 2.33 ms on lock 0x7b180040aaa0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3a50c0a 00007f84ed190219 00007f84e3ad8a40 00007f84e3ad34e4 00007f84e3ad3455 00007f84e6b1cb0b 00007f84e6ba1b63 00007f84e6bc9752 00007f84e6bc19fa
0709 12:15:16.774110 (+195064us) spinlock_profiling.cc:243] Waited 5.67 ms on lock 0x7b180040aaa0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3ad63f3 00007f84e3ad87c1 00007f84e3ad8779 00007f84e3ad8709 00007f84e3ad86d1 00007f84e3ad79cd 0000000000388634 0000000000388479 00007f84e3ab983a
0709 12:15:18.691378 (+1917268us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":627196,"raft.queue_time_us":721017,"raft.run_cpu_time_us":6925,"raft.run_wall_time_us":78593,"spinlock_wait_cycles":193071616,"thread_start_us":490986,"threads_started":1,"wal-append.queue_time_us":597850,"wal-append.run_cpu_time_us":12619,"wal-append.run_wall_time_us":1277075}
I20260709 12:15:18.641999 10117 consensus_queue.cc:1048] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 12:15:18.691412 10239 raft_consensus.cc:493] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:18.686295 10307 raft_consensus.cc:3060] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:15:18.650096 10243 consensus_queue.cc:1048] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 12:15:18.709957 10296 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:18.693787 10299 consensus_queue.cc:1048] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:15:18.705960 10303 raft_consensus.cc:2804] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:18.744879 10303 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:18.745355 10303 raft_consensus.cc:3060] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:15:18.704190 10163 consensus_meta.cc:287] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.655s	user 0.006s	sys 0.006s
I20260709 12:15:18.699690 10266 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:18.641300 10022 consensus_queue.cc:237] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:18.747475  5124 leader_election.cc:290] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:18.742133 10296 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:18.693455 10283 consensus_queue.cc:1059] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:15:18.693872 10201 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:18.727253  9935 leader_election.cc:290] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:15:18.774281  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 132995us
I20260709 12:15:18.716979 10267 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:18.698983 10235 consensus_queue.cc:1059] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.050s
W20260709 12:15:18.773444  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 138423us
I20260709 12:15:18.770433  9941 raft_consensus.cc:493] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:18.775022 10058 leader_election.cc:290] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:18.738003 10239 raft_consensus.cc:515] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:18.785471  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:18.747023 10163 raft_consensus.cc:515] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:15:18.811877  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 195548us
W20260709 12:15:18.785938  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 149366us
I20260709 12:15:18.828644  5088 leader_election.cc:304] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:15:18.817620  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 279397us
I20260709 12:15:18.782012 10296 raft_consensus.cc:2804] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:18.824393  5124 raft_consensus.cc:2393] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 13: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:15:18.824326  5007 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 756d32b8c4d642a6955517f66ac5bb45 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:15:18.830305  5088 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:18.733255 10108 consensus_queue.cc:237] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:18.808636 10075 leader_election.cc:290] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:18.835516  5088 leader_election.cc:304] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:18.781689 10217 leader_election.cc:290] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:18.823424  9941 raft_consensus.cc:515] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:18.836354 10322 consensus_queue.cc:1048] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
W20260709 12:15:18.840106  5007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 63266.3us
I20260709 12:15:18.845636  5118 raft_consensus.cc:1240] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:18.849759 10321 raft_consensus.cc:2749] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:18.850656 10239 leader_election.cc:290] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:15:18.850984 10304 log.cc:927] Time spent T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:15:18.848562  5088 leader_election.cc:304] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:18.859699  5088 leader_election.cc:304] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:18.832904 10242 raft_consensus.cc:3060] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:18.860975  5088 leader_election.cc:304] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:18.838279 10296 raft_consensus.cc:493] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:18.864387  5163 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:18.843721 10267 raft_consensus.cc:2804] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:18.888341  5273 raft_consensus.cc:2468] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 13.
I20260709 12:15:18.871490 10316 consensus_queue.cc:1048] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:15:18.874256 10315 raft_consensus.cc:493] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:18.874886 10125 raft_consensus.cc:2804] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:18.876423 10189 leader_election.cc:290] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:18.847102 10248 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:18.862385 10244 raft_consensus.cc:2749] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:18.878284  5163 leader_election.cc:304] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
W20260709 12:15:18.878842 10308 log.cc:927] Time spent T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
W20260709 12:15:18.881491  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:18.881737 10058 raft_consensus.cc:2804] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:18.852051 10190 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:18.881527 10296 raft_consensus.cc:3060] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:18.886579 10267 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:18.902138 10266 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:18.862270 10298 raft_consensus.cc:2749] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:18.903971 10163 leader_election.cc:290] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:18.905903 10125 raft_consensus.cc:493] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:18.904299  9985 raft_consensus.cc:515] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:18.913087  5163 leader_election.cc:304] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:18.874928  9941 leader_election.cc:290] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:18.897487  5088 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:18.939020 10267 raft_consensus.cc:3060] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:18.922574  5266 consensus_queue.cc:260] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:18.949244  5266 raft_consensus.cc:3060] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:18.902577  5166 leader_election.cc:304] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
W20260709 12:15:18.950109  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 47621.8us
I20260709 12:15:18.950465  5163 leader_election.cc:304] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:18.922482 10217 raft_consensus.cc:2804] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:18.922287 10058 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:18.959529 10058 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:18.945055  5271 consensus_queue.cc:260] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:18.963027  5271 raft_consensus.cc:3060] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:18.964555 10303 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:18.954331 10217 raft_consensus.cc:493] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:18.967227 10217 raft_consensus.cc:3060] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:18.941715 10125 raft_consensus.cc:3060] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:18.950874  5166 leader_election.cc:304] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:18.951748  5163 leader_election.cc:304] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:18.953806  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:18.933543 10022 consensus_queue.cc:1048] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:15:18.955801 10326 raft_consensus.cc:2749] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:18.920758 10248 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:18.957962 10313 log.cc:927] Time spent T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.109s	user 0.002s	sys 0.000s
I20260709 12:15:18.972597  5197 raft_consensus.cc:2368] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 17. Current term is 18.
W20260709 12:15:18.971565  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 105423us
I20260709 12:15:18.970811  5266 raft_consensus.cc:1275] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 12:15:18.957320  5192 raft_consensus.cc:1240] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:18.990374  5266 pending_rounds.cc:85] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929: Aborting all ops after (but not including) 9
I20260709 12:15:18.990845  5266 pending_rounds.cc:107] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 12:15:18.990758  5088 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:18.991437  5266 raft_consensus.cc:2889] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:18.985729  5271 raft_consensus.cc:2468] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 10.
I20260709 12:15:18.992600  5088 leader_election.cc:400] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 election: Vote denied by peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709) with higher term. Message: Invalid argument: T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 13. Current term is 14.
I20260709 12:15:18.992949  5088 leader_election.cc:403] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:15:18.921687 10315 raft_consensus.cc:515] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:18.994302  5088 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:15:18.996692  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 45884.7us
I20260709 12:15:18.970559 10312 raft_consensus.cc:493] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:19.010690 10244 raft_consensus.cc:2749] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:19.012205 10326 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:19.051304  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:19.013147  9985 leader_election.cc:290] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:19.009519 10303 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 16 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:18.973588 10331 raft_consensus.cc:2804] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:19.005878 10329 raft_consensus.cc:2749] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709) with higher term. Message: Invalid argument: T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 13. Current term is 14.
I20260709 12:15:19.018170 10022 raft_consensus.cc:2804] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:15:18.991262 10316 raft_consensus.cc:2749] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:19.022092  5197 raft_consensus.cc:1240] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:18.995985 10163 raft_consensus.cc:2749] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:19.023381 10327 raft_consensus.cc:2804] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:19.075954 10327 raft_consensus.cc:493] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:19.076375 10327 raft_consensus.cc:3060] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:15:19.055589 10318 log.cc:927] Time spent T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.106s	user 0.001s	sys 0.001s
I20260709 12:15:19.077704 10296 raft_consensus.cc:515] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:19.078939  5199 raft_consensus.cc:1240] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:19.082260  5124 raft_consensus.cc:1240] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:15:19.057530 10217 raft_consensus.cc:515] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:19.026443 10058 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:19.031978 10324 raft_consensus.cc:2804] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:19.038048 10315 leader_election.cc:290] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:15:19.006678 10288 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 12:15:19.087786 10217 leader_election.cc:290] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:19.058832  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:19.067193  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:19.089178  5831 raft_consensus.cc:1240] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:19.028411  5088 leader_election.cc:304] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:15:19.007269 10084 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
W20260709 12:15:19.090174  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 61821.3us
I20260709 12:15:19.090899  5088 leader_election.cc:304] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:19.091356  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:19.071125 10201 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:19.088274 10075 raft_consensus.cc:493] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:19.070844 10248 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:19.107549  5088 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:19.052130 10325 raft_consensus.cc:493] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:19.076534  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:15:19.058323 10305 log.cc:927] Time spent T 00000000000000000000000000000000 P 221aa011207d421b9725197ff8bed389: Append to log took a long time: real 0.176s	user 0.011s	sys 0.000s
I20260709 12:15:19.101562  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:15:19.110271  5237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:19.110455  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:19.110703  5193 raft_consensus.cc:2468] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 11.
I20260709 12:15:19.103529  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:19.111752  5837 raft_consensus.cc:2468] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 12.
I20260709 12:15:19.105885  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
W20260709 12:15:19.106356  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:19.103231  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:19.085693 10331 raft_consensus.cc:697] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:19.108781  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:19.113420  5831 raft_consensus.cc:2393] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 15: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:15:19.114959  5088 leader_election.cc:304] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:19.115003  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:19.115679  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:19.114027  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:19.066200 10252 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:19.116680  5193 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:19.067987 10307 raft_consensus.cc:2749] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443) with higher term. Message: Invalid argument: T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 12. Current term is 13.
W20260709 12:15:19.118613  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 166925us
I20260709 12:15:19.121106  5163 leader_election.cc:304] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:19.121492  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:19.082370 10296 leader_election.cc:290] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:19.114415 10298 raft_consensus.cc:493] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:19.122227  5197 raft_consensus.cc:2393] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 15: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:15:19.123713  5163 leader_election.cc:304] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:19.100176 10163 raft_consensus.cc:493] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:19.127125 10163 raft_consensus.cc:515] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:19.131989  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:19.132122  5088 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:19.133335  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:19.134070  5195 raft_consensus.cc:3060] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:15:19.116585 10328 raft_consensus.cc:2749] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:19.109935 10224 raft_consensus.cc:2749] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:19.111500 10244 raft_consensus.cc:2749] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:19.052585 10312 raft_consensus.cc:515] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:19.148406  5193 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 15.
I20260709 12:15:19.118134 10322 raft_consensus.cc:2749] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:15:19.114987 10022 raft_consensus.cc:697] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 18 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:19.166906 10022 consensus_queue.cc:237] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:19.168792  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:19.170884  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:19.171427  5164 leader_election.cc:304] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:19.173547  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 18 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:19.174208  5801 leader_election.cc:304] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
W20260709 12:15:19.174908  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 710212us
I20260709 12:15:19.175343 10065 raft_consensus.cc:2804] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:19.175729 10065 raft_consensus.cc:493] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:19.176076 10065 raft_consensus.cc:3060] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:19.176556  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:19.177270  5271 raft_consensus.cc:2468] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 17.
I20260709 12:15:19.177836 10331 consensus_queue.cc:237] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:19.181265  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:19.182763  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:19.158862  5196 raft_consensus.cc:2468] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 13.
I20260709 12:15:19.160115 10328 raft_consensus.cc:2804] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:19.186486 10328 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:19.186892 10328 raft_consensus.cc:3060] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:19.136415 10329 raft_consensus.cc:2749] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:19.124790 10303 consensus_queue.cc:1048] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 12:15:19.174456  5192 raft_consensus.cc:2410] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 12:15:19.064828 10326 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:19.184952  5266 raft_consensus.cc:1275] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 12:15:19.227265  5266 pending_rounds.cc:85] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929: Aborting all ops after (but not including) 11
I20260709 12:15:19.227555  5266 pending_rounds.cc:107] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 12:15:19.227808  5266 raft_consensus.cc:2889] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:19.227948  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 18 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:19.192329  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:19.229516  5194 raft_consensus.cc:2393] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 13: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:15:19.193511  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:19.194423  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:19.145130 10267 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:19.110554 10125 raft_consensus.cc:515] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:19.113970 10075 raft_consensus.cc:515] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:19.118836 10325 raft_consensus.cc:515] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:19.184698  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:19.200309 10231 raft_consensus.cc:2804] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:15:19.226222  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:19.244864  5273 raft_consensus.cc:2468] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 11.
I20260709 12:15:19.227074  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:19.229759  5199 raft_consensus.cc:1240] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:19.230376  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:19.231176  5237 leader_election.cc:400] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 election: Vote denied by peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455) with higher term. Message: Invalid argument: T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 17. Current term is 18.
I20260709 12:15:19.231379  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:19.246412  5237 leader_election.cc:403] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:15:19.246587  5266 raft_consensus.cc:3060] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:19.247699  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:19.248409  5274 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 14.
I20260709 12:15:19.153944  5195 raft_consensus.cc:2468] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 13.
I20260709 12:15:19.197819  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:19.182832 10163 leader_election.cc:290] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:19.183329 10335 raft_consensus.cc:2749] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:19.249871  5197 raft_consensus.cc:2468] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 13.
I20260709 12:15:19.236585  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:19.123193 10252 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:19.132977 10336 raft_consensus.cc:2749] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:19.243842  5118 raft_consensus.cc:1240] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:19.249861  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:19.136137 10298 raft_consensus.cc:515] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:19.254885  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:19.255563  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:19.256254  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:19.233202  9985 raft_consensus.cc:493] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:19.254321  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:19.150504 10327 raft_consensus.cc:515] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:19.271821  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:19.269397  5237 leader_election.cc:304] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:19.272147  5838 raft_consensus.cc:2468] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 14.
I20260709 12:15:19.258966  5116 raft_consensus.cc:1240] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:19.268441  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:19.272888  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
W20260709 12:15:19.273392  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 139003us
I20260709 12:15:19.225505 10307 consensus_queue.cc:1048] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:15:19.257032  5238 leader_election.cc:304] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:19.270557  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:19.270432  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:19.268898  5273 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:19.244324 10231 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:19.274799  5831 raft_consensus.cc:2468] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 15.
I20260709 12:15:19.255329 10123 raft_consensus.cc:3060] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:19.267176  5266 raft_consensus.cc:2468] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 15.
I20260709 12:15:19.276597  5270 raft_consensus.cc:2376] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 10. Re-sending same reply.
I20260709 12:15:19.276319  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:19.285046  5270 raft_consensus.cc:1240] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 12:15:19.285148  5273 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 15.
I20260709 12:15:19.286558  5163 leader_election.cc:304] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:19.295254  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:19.277423  9941 raft_consensus.cc:2749] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:19.281371 10231 raft_consensus.cc:3060] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:19.288461 10189 raft_consensus.cc:2749] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:19.286932 10336 raft_consensus.cc:493] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:19.276605  9985 raft_consensus.cc:515] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:19.305151 10125 leader_election.cc:290] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:19.306042 10242 raft_consensus.cc:2749] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:19.291313 10303 raft_consensus.cc:2804] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:19.309811 10252 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:19.311810 10328 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:15:19.318086 10337 log.cc:927] Time spent T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 12:15:19.291841 10266 consensus_queue.cc:1059] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
W20260709 12:15:19.372359 10333 log.cc:927] Time spent T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
W20260709 12:15:19.374233  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 99872.7us
I20260709 12:15:19.377089 10201 raft_consensus.cc:493] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:19.391049  5088 leader_election.cc:304] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:19.380175 10312 leader_election.cc:290] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:19.396736  5088 leader_election.cc:304] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:19.367949 10336 raft_consensus.cc:515] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:19.399745  5088 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:19.400795  5088 leader_election.cc:304] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:19.378551 10250 consensus_queue.cc:1059] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 12:15:19.403127  5088 leader_election.cc:304] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:19.404109  5274 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
mode: GRACEFUL
new_leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
 from {username='slave'} at 127.0.0.1:43644
I20260709 12:15:19.407725  5274 raft_consensus.cc:606] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Received request to transfer leadership to TS ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:19.408022  5088 leader_election.cc:304] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:19.408016  5274 raft_consensus.cc:614] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:19.400934 10327 leader_election.cc:290] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:19.408345 10163 raft_consensus.cc:2764] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 LEADER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:15:19.400503 10125 raft_consensus.cc:2749] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:19.421497 10267 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:19.402272 10342 raft_consensus.cc:2749] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:19.422792 10328 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:19.403287 10331 raft_consensus.cc:2749] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:19.423774 10326 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:19.398132 10201 raft_consensus.cc:515] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:19.452301  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:19.453267  5838 raft_consensus.cc:2393] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 13: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:15:19.457080  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:19.457814  5834 raft_consensus.cc:3060] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:19.434280 10325 leader_election.cc:290] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:19.464612  5191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47728 (request call id 2571) took 1881 ms. Trace:
I20260709 12:15:19.465121  5191 rpcz_store.cc:276] 0709 12:15:17.582766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:17.582875 (+   109us) service_pool.cc:224] Handling call
0709 12:15:17.629921 (+ 47046us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:18.591801 (+961880us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:19.464354 (+872553us) spinlock_profiling.cc:243] Waited 943 ms on lock 0x7b54003769d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:15:19.464552 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2168820096}
I20260709 12:15:19.467260  5829 raft_consensus.cc:2955] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 6 to 11, VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:19.470016  5117 raft_consensus.cc:1240] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:19.470137 10319 raft_consensus.cc:493] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:19.472005 10319 raft_consensus.cc:515] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:19.457470 10244 raft_consensus.cc:2804] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:19.473248 10244 raft_consensus.cc:697] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:19.474377 10244 consensus_queue.cc:237] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:19.476013  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:19.476840  5124 raft_consensus.cc:2393] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 15: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:15:19.477082  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:19.477998 10319 leader_election.cc:290] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:19.480160 10065 raft_consensus.cc:515] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:19.424971  5088 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:19.425403 10336 leader_election.cc:290] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:19.426432  9985 leader_election.cc:290] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:19.427572 10072 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:19.430624 10000 raft_consensus.cc:3055] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:19.432475 10123 raft_consensus.cc:2749] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455) with higher term. Message: Invalid argument: T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 17. Current term is 18.
I20260709 12:15:19.399930 10075 leader_election.cc:290] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:19.433769  5272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34674 (request call id 2517) took 1196 ms. Trace:
I20260709 12:15:19.521919  5272 rpcz_store.cc:276] 0709 12:15:18.237396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:18.283828 (+ 46432us) service_pool.cc:224] Handling call
0709 12:15:19.433581 (+1149753us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b540040bd54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:15:19.433714 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":541435264}
I20260709 12:15:19.398769 10242 raft_consensus.cc:2749] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:15:19.437412  5238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:19.406812 10298 leader_election.cc:290] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:19.443817 10254 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:19.485477  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 60617.5us
I20260709 12:15:19.495536  5838 raft_consensus.cc:1275] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:15:19.461071 10201 leader_election.cc:290] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:19.496033 10173 raft_consensus.cc:2804] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:19.496635 10065 leader_election.cc:290] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:19.498446  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:19.499264  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:19.501531  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:19.554761  5123 raft_consensus.cc:3060] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:19.505896  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:19.509776  5834 raft_consensus.cc:2468] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 15.
I20260709 12:15:19.555102  5837 raft_consensus.cc:3060] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:19.528200  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:19.527412  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:19.528692  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:19.530866  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:19.497664 10231 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:19.535280  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:19.532382  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:19.540304  5088 leader_election.cc:304] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:19.560454  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:19.540830  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:19.544061  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:19.544139  5238 leader_election.cc:304] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:19.523036 10342 consensus_queue.cc:1059] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 12:15:19.564021  5238 leader_election.cc:304] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:19.548137  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:19.548496  5829 raft_consensus.cc:1275] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:15:19.549825 10075 raft_consensus.cc:493] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:19.550329  5801 leader_election.cc:304] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:19.565528  5836 raft_consensus.cc:1240] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:19.566933  5238 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:19.551365  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:19.552207  9783 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 18 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:19.495887 10066 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:19.566490 10173 raft_consensus.cc:697] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:19.572824 10173 consensus_queue.cc:237] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:19.573604 10288 raft_consensus.cc:2749] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:19.555086 10254 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:19.574836 10342 raft_consensus.cc:3055] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:19.575245 10342 raft_consensus.cc:740] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:19.575914 10254 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:19.557303  5273 raft_consensus.cc:2393] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 13: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:15:19.557557  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:19.577044  5270 raft_consensus.cc:3060] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:19.578303 10224 raft_consensus.cc:2749] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:15:19.579819 10224 raft_consensus.cc:493] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:19.580330 10224 raft_consensus.cc:515] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:19.581779 10075 raft_consensus.cc:515] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:19.584132 10075 leader_election.cc:290] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:19.556715  5267 raft_consensus.cc:2376] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 10. Re-sending same reply.
I20260709 12:15:19.558790  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:19.584980  5269 raft_consensus.cc:2468] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 13.
I20260709 12:15:19.508858 10000 raft_consensus.cc:740] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:19.589721 10144 consensus_queue.cc:1048] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:15:19.590098 10000 consensus_queue.cc:260] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:19.568424 10281 raft_consensus.cc:2764] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:15:19.590833 10231 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 18 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:19.568894 10274 raft_consensus.cc:2804] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:19.558477  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:19.591601 10274 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:19.592615 10274 raft_consensus.cc:3060] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:15:19.594513  5237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:19.595585 10281 raft_consensus.cc:493] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:19.596043 10281 raft_consensus.cc:515] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:19.591658  5830 raft_consensus.cc:2393] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 18: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:15:19.586212  5089 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:19.577162  5271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a975d4f227214562b6fc39ea53081961"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
mode: GRACEFUL
new_leader_uuid: "bce73265e27d4b30a4dcc1e491305088"
 from {username='slave'} at 127.0.0.1:43644
I20260709 12:15:19.598603  5271 raft_consensus.cc:606] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 11 LEADER]: Received request to transfer leadership to TS bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:19.600620  5837 raft_consensus.cc:2468] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 16.
I20260709 12:15:19.600785  5123 raft_consensus.cc:2468] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 16.
I20260709 12:15:19.588759  5270 raft_consensus.cc:2468] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 12.
W20260709 12:15:19.602960  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 52801.2us
I20260709 12:15:19.604190  5801 leader_election.cc:304] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:19.605894  5089 leader_election.cc:304] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:19.601914 10303 raft_consensus.cc:697] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:19.608497 10144 consensus_queue.cc:1059] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:15:19.609289  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 156716us
W20260709 12:15:19.609921  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 133775us
W20260709 12:15:19.607298  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 169371us
I20260709 12:15:19.607338  5088 leader_election.cc:304] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:19.610673  5801 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:19.615250  5270 raft_consensus.cc:1275] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:15:19.610716  5265 raft_consensus.cc:3055] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:19.615868  5265 raft_consensus.cc:740] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:19.616446  5271 raft_consensus.cc:1275] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 12:15:19.617580  5271 pending_rounds.cc:85] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929: Aborting all ops after (but not including) 11
I20260709 12:15:19.617961  5271 pending_rounds.cc:107] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 12:15:19.618232  5271 raft_consensus.cc:2889] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:19.622208  5801 leader_election.cc:304] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:19.626274 10144 raft_consensus.cc:3055] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:19.626744 10144 raft_consensus.cc:740] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:19.615417 10125 raft_consensus.cc:2749] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:19.576035 10342 consensus_queue.cc:260] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:19.615578  9985 raft_consensus.cc:2749] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:19.627640 10144 consensus_queue.cc:260] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:19.628320 10322 consensus_queue.cc:1175] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9e794b72ed7640219f90ec4232363929" responder_term: 13 status { last_received { term: 11 index: 11 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 12. Current term is 13. Ops: [12.12-12.12]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:15:19.629207 10267 raft_consensus.cc:2749] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:19.628633  5271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
mode: GRACEFUL
new_leader_uuid: "bce73265e27d4b30a4dcc1e491305088"
 from {username='slave'} at 127.0.0.1:43644
I20260709 12:15:19.628116 10342 raft_consensus.cc:3060] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:19.608525 10201 consensus_queue.cc:1059] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:15:19.609203 10298 consensus_queue.cc:1048] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 12:15:19.631783  5088 leader_election.cc:304] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:19.632644 10298 raft_consensus.cc:2749] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:15:19.609338 10242 raft_consensus.cc:2749] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:19.634053 10298 consensus_queue.cc:1048] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:15:19.634754 10303 consensus_queue.cc:237] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:19.636631 10298 consensus_queue.cc:1048] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:15:19.638461 10281 leader_election.cc:290] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:19.639623 10231 raft_consensus.cc:2749] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:19.639864 10058 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:19.640642 10034 raft_consensus.cc:3055] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:19.641054 10034 raft_consensus.cc:740] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:15:19.642158 10324 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:19.641888 10034 consensus_queue.cc:260] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:19.642668 10324 raft_consensus.cc:3060] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:19.643203 10034 raft_consensus.cc:3060] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:19.645033  5164 leader_election.cc:304] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:19.607116 10075 raft_consensus.cc:2749] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:19.647603 10307 raft_consensus.cc:2749] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:19.651783  5801 leader_election.cc:304] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:19.639900 10243 raft_consensus.cc:2749] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:19.662657  5801 leader_election.cc:304] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:19.653182  5163 leader_election.cc:304] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:19.661103  5166 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:19.665166  5240 leader_election.cc:304] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:19.649703 10288 raft_consensus.cc:493] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:19.717805  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 64708.5us
W20260709 12:15:19.727653  5802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:19.729828  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:15:19.731793  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 56439.3us
I20260709 12:15:19.733487  5192 raft_consensus.cc:1240] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 11. Current term is 13. Ops: []
I20260709 12:15:19.734773  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:19.735352  5273 raft_consensus.cc:3060] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:15:19.678673  5166 leader_election.cc:304] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:19.736317  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:19.738679  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:19.668709 10281 raft_consensus.cc:493] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:19.667948 10119 consensus_queue.cc:1048] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.073s
I20260709 12:15:19.740957 10281 raft_consensus.cc:515] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:19.670118 10108 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.786s	user 0.012s	sys 0.012s
I20260709 12:15:19.744159  5801 leader_election.cc:304] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:15:19.750982  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 72401.3us
I20260709 12:15:19.764678  5192 raft_consensus.cc:1240] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:15:19.765008  5166 leader_election.cc:304] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:19.767477  5273 raft_consensus.cc:2468] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 13.
I20260709 12:15:19.768357  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:19.675657 10190 raft_consensus.cc:2804] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:19.667400 10201 raft_consensus.cc:2804] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:19.672904  9985 raft_consensus.cc:2749] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:15:19.763202 10299 raft_consensus.cc:2749] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:19.673527 10276 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:19.778113 10276 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:19.774967 10315 raft_consensus.cc:2749] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:19.774781 10190 raft_consensus.cc:493] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:19.780336 10276 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:19.780732 10190 raft_consensus.cc:3060] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:19.783579  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:19.730712 10058 raft_consensus.cc:2749] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:19.682651 10144 raft_consensus.cc:3060] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:19.771330  5166 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:19.731359 10072 raft_consensus.cc:2804] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:19.786490 10281 leader_election.cc:290] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:19.787971 10224 leader_election.cc:290] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:19.676980 10248 consensus_queue.cc:1059] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.098s
I20260709 12:15:19.751202 10322 raft_consensus.cc:493] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:19.763681 10243 raft_consensus.cc:2749] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:19.794968 10254 consensus_queue.cc:1059] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:15:19.750020 10108 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.013s	sys 0.012s
I20260709 12:15:19.799028  5267 raft_consensus.cc:1275] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:15:19.663981 10274 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:19.819878  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:19.801718  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:19.773540  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:19.802076  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:19.801033  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:19.805950  5163 leader_election.cc:304] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:19.806221  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:19.817443 10072 raft_consensus.cc:697] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:19.817584  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:19.827602  5272 raft_consensus.cc:2368] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 11. Current term is 12.
I20260709 12:15:19.821880  5122 raft_consensus.cc:2468] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 13.
I20260709 12:15:19.830242  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:19.832224  5274 raft_consensus.cc:2468] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 18.
I20260709 12:15:19.834167 10201 raft_consensus.cc:697] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 13 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:15:19.835403 10201 consensus_queue.cc:237] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:19.839620  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:19.848385 10248 raft_consensus.cc:3055] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:19.848853 10248 raft_consensus.cc:740] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:19.849822 10248 consensus_queue.cc:260] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:19.851177 10248 raft_consensus.cc:3060] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:19.851480  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:19.852090  5268 raft_consensus.cc:3060] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:19.808856 10217 raft_consensus.cc:2804] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:15:19.732187 10288 raft_consensus.cc:515] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:19.864172 10288 leader_election.cc:290] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:15:19.853884 10235 consensus_queue.cc:1175] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" responder_term: 11 status { last_received { term: 11 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 11 index: 8 } }
I20260709 12:15:19.855819 10150 consensus_queue.cc:1059] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:15:19.868827 10189 raft_consensus.cc:3055] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:19.869355 10189 raft_consensus.cc:740] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:19.857460 10276 consensus_queue.cc:1059] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:15:19.860864  5273 raft_consensus.cc:2393] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 16: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:15:19.875402  5271 raft_consensus.cc:606] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Received request to transfer leadership to TS bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:19.875877  5271 raft_consensus.cc:614] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:19.878806 10326 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:19.879454 10326 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:19.829943 10303 raft_consensus.cc:2804] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:19.880592 10303 raft_consensus.cc:697] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:19.881409  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:19.881796  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:19.881641 10303 consensus_queue.cc:237] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:19.879575  5801 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:19.883268  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:19.879827 10058 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:19.884734 10058 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:19.821682 10322 raft_consensus.cc:515] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:19.886960 10058 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:19.884238 10117 consensus_queue.cc:1059] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 12:15:19.888439 10253 raft_consensus.cc:3055] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:15:19.861944 10274 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 16 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:19.891080 10072 consensus_queue.cc:237] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:19.884316 10243 raft_consensus.cc:2804] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:19.892604 10243 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:19.893016 10243 raft_consensus.cc:3060] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:19.888847 10253 raft_consensus.cc:740] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:15:19.895078 10253 consensus_queue.cc:260] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:19.890502 10217 raft_consensus.cc:697] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:19.896989 10253 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:19.887907 10322 leader_election.cc:290] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:19.911728  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:19.913744  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:19.914382  5199 raft_consensus.cc:3060] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:19.897161 10217 consensus_queue.cc:237] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:19.918709  5089 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:19.919155  5268 raft_consensus.cc:2468] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 18.
I20260709 12:15:19.920060  5270 raft_consensus.cc:1275] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 18 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:15:19.921682  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:19.922345  5837 raft_consensus.cc:3060] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:15:19.925164  5199 raft_consensus.cc:2468] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 18.
I20260709 12:15:19.926337  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:19.926923  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:19.927503  5830 raft_consensus.cc:2376] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 16. Re-sending same reply.
I20260709 12:15:19.929018  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:19.929715  5830 raft_consensus.cc:3060] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:19.931572  5238 leader_election.cc:304] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:19.931799  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:19.934820  5837 raft_consensus.cc:2468] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 12.
W20260709 12:15:19.949304  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 93899.7us
I20260709 12:15:19.952148  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:19.954893  5837 raft_consensus.cc:2468] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 14.
I20260709 12:15:19.952430  5830 raft_consensus.cc:2468] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 13.
I20260709 12:15:19.954303  5801 leader_election.cc:400] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709) with higher term. Message: Invalid argument: T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 11. Current term is 12.
I20260709 12:15:19.956440  5801 leader_election.cc:403] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:19.959004  5198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61"
dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
mode: GRACEFUL
new_leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
 from {username='slave'} at 127.0.0.1:53902
I20260709 12:15:19.954798  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:19.959698  5198 raft_consensus.cc:606] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 LEADER]: Received request to transfer leadership to TS ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:19.960578  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:19.961227  5834 raft_consensus.cc:2468] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 13.
I20260709 12:15:19.962608  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:19.963967  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:19.966737  5237 leader_election.cc:304] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:19.980527  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:19.941087 10322 raft_consensus.cc:2749] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:15:19.967108  5801 leader_election.cc:304] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:15:19.966107  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:19.982112 10238 raft_consensus.cc:2804] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:19.985960 10326 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:19.947197 10114 raft_consensus.cc:2749] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:15:19.996085  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:20.006351  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:20.007254  5830 raft_consensus.cc:2468] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 13.
I20260709 12:15:19.935810 10058 raft_consensus.cc:493] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:19.954470 10244 consensus_queue.cc:1048] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:15:19.899230 10190 raft_consensus.cc:515] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:19.963501 10367 raft_consensus.cc:2749] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709) with higher term. Message: Invalid argument: T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 11. Current term is 12.
I20260709 12:15:20.029361  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:20.030185  5829 raft_consensus.cc:2468] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 10.
I20260709 12:15:20.034420  5195 raft_consensus.cc:1275] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:15:20.034969  5834 raft_consensus.cc:1240] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:15:20.036291 10190 leader_election.cc:290] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:20.037489  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:20.038170  5198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f34c97113147431584d6336e0d849164"
dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
mode: GRACEFUL
new_leader_uuid: "bce73265e27d4b30a4dcc1e491305088"
 from {username='slave'} at 127.0.0.1:53902
I20260709 12:15:20.037508  5274 raft_consensus.cc:1240] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:20.038792  5198 raft_consensus.cc:606] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Received request to transfer leadership to TS bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:20.042701  5198 raft_consensus.cc:614] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:20.045560  5088 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:20.054952  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:19.961490 10065 consensus_queue.cc:1048] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.070s
I20260709 12:15:20.025959 10238 raft_consensus.cc:697] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 13 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:20.040645 10243 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:20.065241  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:20.065904  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:20.078959  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:20.027833 10058 raft_consensus.cc:515] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:20.082582  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:15:20.089087  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:20.089835  5164 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:20.090091  5830 raft_consensus.cc:2410] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for term 14 because replica has last-logged OpId of term: 11 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 12:15:20.094724  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:20.066797 10322 raft_consensus.cc:2749] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:20.106878  5829 raft_consensus.cc:1240] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:15:20.108368  5238 leader_election.cc:304] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:15:20.112927  5164 leader_election.cc:304] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:20.116914  5238 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:15:20.122838 10292 raft_consensus.cc:2804] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:20.123350 10292 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:20.123657  5238 leader_election.cc:304] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:15:20.120792 10190 raft_consensus.cc:2804] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:20.136431 10190 raft_consensus.cc:493] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:20.136927 10190 raft_consensus.cc:3060] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:20.077543 10173 consensus_queue.cc:1048] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 12:15:20.087199 10324 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:20.176054  5238 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:20.181030 10254 consensus_queue.cc:1059] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 12:15:20.190270 10058 leader_election.cc:290] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:20.228945  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:20.163246 10114 raft_consensus.cc:2804] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:20.202353 10238 consensus_queue.cc:237] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:20.203802  5198 raft_consensus.cc:1275] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 12:15:20.205904  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 238891us
W20260709 12:15:20.235276  5801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:20.236464  5801 leader_election.cc:304] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:20.237514  5118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59390 (request call id 1107) took 1146 ms. Trace:
I20260709 12:15:20.237996  5118 rpcz_store.cc:276] 0709 12:15:19.090932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:19.093205 (+  2273us) service_pool.cc:224] Handling call
0709 12:15:19.093501 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:19.261900 (+168399us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:20.237271 (+975371us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b54001b3d54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:15:20.237449 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":345307392}
I20260709 12:15:20.239482  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:20.159158 10331 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:20.146715 10072 raft_consensus.cc:2804] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:20.207605 10231 raft_consensus.cc:2804] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:15:20.224828 10274 raft_consensus.cc:2749] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:15:20.211431 10382 log.cc:927] Time spent T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:15:20.122267 10312 raft_consensus.cc:2749] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:20.216543  5238 leader_election.cc:304] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:20.122216 10280 raft_consensus.cc:493] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:20.123719 10292 raft_consensus.cc:3060] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:20.192754  9941 raft_consensus.cc:3055] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:20.229664  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:20.230707 10224 raft_consensus.cc:493] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:20.256214  5836 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 15.
I20260709 12:15:20.256291  5191 raft_consensus.cc:2393] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 14: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:15:20.258483 10072 raft_consensus.cc:493] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:20.213965 10243 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:15:20.266243  5802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:20.209393 10367 raft_consensus.cc:493] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:20.254577 10254 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:20.283812  9941 raft_consensus.cc:740] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:20.296509  9941 consensus_queue.cc:260] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:20.297613  9941 raft_consensus.cc:3060] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:15:20.299258 10385 log.cc:927] Time spent T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:15:20.321615 10367 raft_consensus.cc:515] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:20.324258 10367 leader_election.cc:290] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:15:20.326157  5237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:20.336279 10324 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:20.265048 10331 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:20.344687 10331 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:20.283038 10266 raft_consensus.cc:2749] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:20.345487  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:20.346321  5195 raft_consensus.cc:2393] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 15: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:15:20.289245 10224 raft_consensus.cc:515] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:20.350255 10224 leader_election.cc:290] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:20.351071  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:20.286875 10280 raft_consensus.cc:515] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:20.355556 10280 leader_election.cc:290] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:20.289955 10072 raft_consensus.cc:3060] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:20.360787 10254 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:20.364418 10378 log.cc:927] Time spent T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.232s	user 0.000s	sys 0.002s
I20260709 12:15:20.270488  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:20.271430  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:20.272270  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:20.370163  5116 raft_consensus.cc:2468] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 10.
I20260709 12:15:20.366832  5120 raft_consensus.cc:2468] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 13.
I20260709 12:15:20.273659  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:20.232693 10114 raft_consensus.cc:493] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:20.274463  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 58023.5us
I20260709 12:15:20.254235 10342 consensus_queue.cc:1048] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:15:20.282785  5122 raft_consensus.cc:2410] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 12:15:20.254398 10034 raft_consensus.cc:2749] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:20.277240  5801 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:15:20.381984  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 104842us
I20260709 12:15:20.384567  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:20.386518  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:20.387420  5269 raft_consensus.cc:1275] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:15:20.389405  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:20.390626  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:20.379398  5117 raft_consensus.cc:1240] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:20.391708  5124 raft_consensus.cc:1240] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 LEADER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 11. Current term is 13. Ops: []
W20260709 12:15:20.380360  5238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:20.402004  5801 leader_election.cc:304] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:20.364624 10254 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:20.405568  5124 raft_consensus.cc:1240] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 10. Current term is 11. Ops: []
I20260709 12:15:20.374243 10114 raft_consensus.cc:3060] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:20.400713 10243 raft_consensus.cc:3060] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:20.424515  5271 raft_consensus.cc:1240] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 15. Current term is 16. Ops: []
I20260709 12:15:20.427006  5268 raft_consensus.cc:1275] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:15:20.428846  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:20.429472  5271 raft_consensus.cc:3060] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:20.427480  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:20.433763  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:20.412590 10367 raft_consensus.cc:2749] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:20.438779  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:20.440662  5124 raft_consensus.cc:2393] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 9: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:15:20.410276 10298 raft_consensus.cc:493] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:20.441510  5271 raft_consensus.cc:2468] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 14.
I20260709 12:15:20.437938  5122 raft_consensus.cc:2393] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 10: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:15:20.419996 10274 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
W20260709 12:15:20.461266  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 169116us
I20260709 12:15:20.490470  5830 raft_consensus.cc:1275] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:15:20.451551 10298 raft_consensus.cc:515] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:20.496009  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:20.456363 10274 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:20.499583  5833 raft_consensus.cc:1275] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:15:20.494861 10075 consensus_queue.cc:1059] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
W20260709 12:15:20.550247 10360 log.cc:927] Time spent T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.760s	user 0.004s	sys 0.000s
W20260709 12:15:20.603587 10394 log.cc:927] Time spent T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:15:20.657234 10189 consensus_queue.cc:260] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:20.671944 10190 consensus_meta.cc:287] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.534s	user 0.010s	sys 0.000s
I20260709 12:15:20.672610 10190 raft_consensus.cc:515] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:20.668824 10292 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:20.652813 10298 leader_election.cc:290] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:20.462790 10231 raft_consensus.cc:697] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 18 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:15:20.692667 10231 consensus_queue.cc:237] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:20.704360 10274 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:15:20.727437 10376 log.cc:927] Time spent T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.603s	user 0.004s	sys 0.004s
W20260709 12:15:20.733315 10392 log.cc:927] Time spent T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.222s	user 0.000s	sys 0.004s
I20260709 12:15:20.756978 10292 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:20.764324 10190 leader_election.cc:290] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:20.829028  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:20.842257  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:20.848825  5191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47728 (request call id 2601) took 1119 ms. Trace:
I20260709 12:15:20.849540  5191 rpcz_store.cc:276] 0709 12:15:19.728840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:19.729558 (+   718us) service_pool.cc:224] Handling call
0709 12:15:20.848264 (+1118706us) spinlock_profiling.cc:243] Waited 525 ms on lock 0x7b5400194bd4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:15:20.848531 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1208610560}
I20260709 12:15:20.853644  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:20.858043  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:20.865800  5270 raft_consensus.cc:1240] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:15:20.867324  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:20.868330  5118 raft_consensus.cc:2468] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 13.
W20260709 12:15:20.875329  5801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:20.879703  5237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:20.880115  5163 leader_election.cc:304] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
W20260709 12:15:20.883271  5238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:20.895382  5265 consensus_queue.cc:260] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:20.897579  9783 raft_consensus.cc:493] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:20.898283  5266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34672 (request call id 2507) took 1364 ms. Trace:
I20260709 12:15:20.898494  9783 raft_consensus.cc:515] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:20.898753  5266 rpcz_store.cc:276] 0709 12:15:19.533745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:19.561461 (+ 27716us) service_pool.cc:224] Handling call
0709 12:15:19.561815 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:19.562194 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:19.562225 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:19.562732 (+   507us) log.cc:844] Serialized 26 byte log entry
0709 12:15:19.743113 (+180381us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:15:19.743154 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:19.743219 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:20.503055 (+759836us) spinlock_profiling.cc:243] Waited 2.08 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e675e86e 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221 00007f84e67671d9 00007f84e6767169
0709 12:15:20.897621 (+394566us) raft_consensus.cc:1685] finished
0709 12:15:20.897656 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:20.898044 (+   388us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":108,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":16322,"spinlock_wait_cycles":4786432,"thread_start_us":180064,"threads_started":1,"wal-append.queue_time_us":225638}
I20260709 12:15:20.901676  9783 leader_election.cc:290] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:20.903551  5271 raft_consensus.cc:1240] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 14. Current term is 15. Ops: []
I20260709 12:15:20.903923  9783 raft_consensus.cc:493] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:20.676518 10072 raft_consensus.cc:515] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:20.771502 10243 raft_consensus.cc:2749] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:15:20.929474  5267 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.000s	sys 0.016s
I20260709 12:15:20.904928  9783 raft_consensus.cc:515] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:20.897222  5265 raft_consensus.cc:3060] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:15:20.904577  5273 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 14.
I20260709 12:15:20.892983  5240 leader_election.cc:304] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:20.937911  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:20.961585  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:20.968273  9783 leader_election.cc:290] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:20.973462  5274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34672 (request call id 2515) took 1172 ms. Trace:
I20260709 12:15:20.974052  5274 rpcz_store.cc:276] 0709 12:15:19.735251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:19.840733 (+105482us) service_pool.cc:224] Handling call
0709 12:15:19.841121 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:20.038949 (+197828us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:20.906788 (+867839us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b5400172d54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:15:20.907174 (+   386us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":451106688}
I20260709 12:15:20.978489 10303 consensus_queue.cc:1059] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:15:20.980268  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 132044us
I20260709 12:15:20.981635  5166 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:20.990816 10117 raft_consensus.cc:3055] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:20.991431 10117 raft_consensus.cc:740] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:15:20.991890  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:15:20.996554  5088 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.212.131:46709 timed out after 1.600s (SENT) [suppressed 8 similar messages]
I20260709 12:15:21.001224 10244 raft_consensus.cc:493] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:21.002354 10244 raft_consensus.cc:515] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:21.004647  5198 raft_consensus.cc:1275] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:15:20.993211 10117 consensus_queue.cc:260] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:21.009286 10205 raft_consensus.cc:493] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.010315 10205 raft_consensus.cc:515] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:21.013988  5200 raft_consensus.cc:2368] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 13. Current term is 14.
W20260709 12:15:21.014794  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 122438us
I20260709 12:15:21.018923  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:21.019307 10274 raft_consensus.cc:2749] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:21.020205  5192 raft_consensus.cc:2393] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 15: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:15:20.712939 10114 raft_consensus.cc:515] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:21.023777  5198 raft_consensus.cc:1240] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 11. Current term is 13. Ops: []
I20260709 12:15:21.024195 10114 leader_election.cc:290] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:21.025763 10312 consensus_queue.cc:1048] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:15:21.023550 10117 raft_consensus.cc:3060] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:15:21.029543  5267 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.000s	sys 0.017s
I20260709 12:15:21.044255 10250 raft_consensus.cc:493] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:20.974202 10322 raft_consensus.cc:493] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:21.049652 10325 raft_consensus.cc:2804] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:21.049654 10331 raft_consensus.cc:493] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:21.051324 10331 raft_consensus.cc:515] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:21.054263 10331 leader_election.cc:290] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:21.055440 10391 raft_consensus.cc:493] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:21.056316 10391 raft_consensus.cc:515] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:21.058614  5836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46100 (request call id 1369) took 1127 ms. Trace:
I20260709 12:15:21.058837  5270 raft_consensus.cc:1275] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:15:21.059041  5836 rpcz_store.cc:276] 0709 12:15:19.931414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:19.931547 (+   133us) service_pool.cc:224] Handling call
0709 12:15:21.058121 (+1126574us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b540043e9d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:15:21.058332 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":588214016}
I20260709 12:15:21.037431 10244 leader_election.cc:290] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:15:21.063452  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 113071us
W20260709 12:15:21.063422 10126 consensus_queue.cc:1175] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" responder_term: 12 status { last_received { term: 12 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 12 index: 8 } }
I20260709 12:15:21.072482  5272 raft_consensus.cc:1275] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:15:21.073771 10322 raft_consensus.cc:515] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:21.041952 10072 leader_election.cc:290] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:21.077013 10322 leader_election.cc:290] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:15:21.078758  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 199335us
W20260709 12:15:21.083815  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 67596.5us
I20260709 12:15:21.059180 10391 leader_election.cc:290] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:15:21.094885  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 98486.1us
I20260709 12:15:21.045281 10250 raft_consensus.cc:515] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:21.100307  5192 raft_consensus.cc:1275] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:15:21.105544  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 124221us
I20260709 12:15:21.106714  5166 leader_election.cc:304] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:21.113952 10325 raft_consensus.cc:697] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
W20260709 12:15:21.115046  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 49076.3us
I20260709 12:15:21.116004 10325 consensus_queue.cc:237] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:21.118469 10400 consensus_queue.cc:1059] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:15:21.118937 10173 raft_consensus.cc:493] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.119625 10250 leader_election.cc:290] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:21.120044 10400 raft_consensus.cc:3055] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:15:21.120492 10400 raft_consensus.cc:740] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:21.105895 10307 raft_consensus.cc:2749] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:15:21.098963 10322 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
W20260709 12:15:21.122455  5122 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.011s	sys 0.010s
I20260709 12:15:21.138782  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:21.140995 10342 raft_consensus.cc:493] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.141893 10342 raft_consensus.cc:515] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:21.119922 10173 raft_consensus.cc:515] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:21.148756 10173 leader_election.cc:290] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:21.152194  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:21.154141  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:21.154461  5834 raft_consensus.cc:1240] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:15:21.155035  5832 raft_consensus.cc:3060] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:21.155277  5089 leader_election.cc:304] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:21.153107  5838 raft_consensus.cc:3060] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:21.156961 10391 consensus_queue.cc:1059] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:15:21.157938  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:21.158720  5116 raft_consensus.cc:3060] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:21.159682 10400 consensus_queue.cc:260] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:21.161530  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:21.161603 10244 raft_consensus.cc:3055] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:21.162282 10244 raft_consensus.cc:740] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:21.163211  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
W20260709 12:15:21.163429 10417 log.cc:927] Time spent T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:15:21.164461  5122 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.011s	sys 0.011s
I20260709 12:15:21.152217  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:21.165331  5120 raft_consensus.cc:1275] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 18 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:15:21.165584  5835 raft_consensus.cc:2393] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 15: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:15:21.166157  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:21.158519 10391 raft_consensus.cc:2749] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:21.167505  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:21.169050  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:21.149066  5166 leader_election.cc:304] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:15:21.182803  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:21.183696  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:21.184459  5830 raft_consensus.cc:2468] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 10.
I20260709 12:15:21.185235  5265 raft_consensus.cc:2468] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 13.
I20260709 12:15:21.186429 10415 raft_consensus.cc:493] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:21.187227 10415 raft_consensus.cc:515] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:21.188122  5268 raft_consensus.cc:1275] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:15:21.189234 10123 raft_consensus.cc:493] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.189760 10123 raft_consensus.cc:515] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:15:21.190948 10093 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 13 is higher.
I20260709 12:15:21.164376 10322 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:21.204445  5832 raft_consensus.cc:2468] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 11.
I20260709 12:15:21.191975 10205 leader_election.cc:290] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:21.163538 10244 consensus_queue.cc:260] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:21.145043 10342 leader_election.cc:290] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:21.187201 10402 consensus_queue.cc:1048] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 12:15:21.207713 10416 consensus_queue.cc:1048] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:15:21.185539 10243 raft_consensus.cc:493] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
W20260709 12:15:21.187141  5265 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34674 (request call id 2537) took 1934 ms (client timeout 1600 ms). Trace:
I20260709 12:15:21.209208 10243 raft_consensus.cc:515] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:21.161355 10400 raft_consensus.cc:3060] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:21.212361 10243 leader_election.cc:290] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:21.157267  5089 leader_election.cc:304] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:15:21.214895  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 57839.2us
I20260709 12:15:21.216616 10217 raft_consensus.cc:2804] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:21.217211 10217 raft_consensus.cc:493] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:21.217634 10342 raft_consensus.cc:2749] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:15:21.197580  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 73741.1us
I20260709 12:15:21.205595  5838 raft_consensus.cc:2468] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 14.
I20260709 12:15:21.205963 10324 raft_consensus.cc:3055] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:15:21.218580 10324 raft_consensus.cc:740] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:21.193008 10326 raft_consensus.cc:2749] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:21.207486 10244 raft_consensus.cc:3060] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:21.215291 10066 consensus_queue.cc:1048] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 12:15:21.219955 10217 raft_consensus.cc:3060] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:21.222723 10324 consensus_queue.cc:260] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:21.223857 10324 raft_consensus.cc:3060] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:15:21.209806  5265 rpcz_store.cc:269] 0709 12:15:19.251755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:19.270344 (+ 18589us) service_pool.cc:224] Handling call
0709 12:15:19.610595 (+340251us) spinlock_profiling.cc:243] Waited 18 ms on lock 0x7b540017eba0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6b3adc0 00007f84e6bc6e18 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:15:20.894081 (+1283486us) spinlock_profiling.cc:243] Waited 4.69 ms on lock 0x7b540017eba0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6b4106f 00007f84e6bb9f60 00007f84e6bbb7de 00007f84e6bc727c 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2
0709 12:15:21.185800 (+291719us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52186752}
I20260709 12:15:21.227164 10126 consensus_queue.cc:1048] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:15:21.229628 10244 raft_consensus.cc:493] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.230618 10244 raft_consensus.cc:515] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:15:21.232748 10403 log.cc:927] Time spent T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.183s	user 0.001s	sys 0.002s
I20260709 12:15:21.234579  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:21.237704 10173 raft_consensus.cc:493] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.238423 10391 raft_consensus.cc:476] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 LEADER]: Not starting pre-election -- already a leader
I20260709 12:15:21.238729 10173 raft_consensus.cc:515] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:21.239118  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:21.239360 10244 leader_election.cc:290] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:21.240118  5117 raft_consensus.cc:2410] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:15:21.237782  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:21.241019 10173 leader_election.cc:290] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:21.238329  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:21.245699  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:15:21.229863  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 81027us
W20260709 12:15:21.259651  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 124597us
I20260709 12:15:21.223773 10123 leader_election.cc:290] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:21.206943 10322 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:21.278772  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:21.285493  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:21.287560  5193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41416 (request call id 1056) took 1369 ms. Trace:
I20260709 12:15:21.270431 10117 raft_consensus.cc:493] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:21.289840 10117 raft_consensus.cc:515] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:21.290398  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:21.293460  5166 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:21.295310  5166 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:21.290802  5272 raft_consensus.cc:1240] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 15. Current term is 16. Ops: []
I20260709 12:15:21.297328 10065 raft_consensus.cc:2749] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:15:21.303943  5116 raft_consensus.cc:2468] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 14.
I20260709 12:15:21.281189 10066 raft_consensus.cc:493] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:21.288228  5193 rpcz_store.cc:276] 0709 12:15:19.918007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:19.918155 (+   148us) service_pool.cc:224] Handling call
0709 12:15:19.918472 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:19.918713 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:15:19.955560 (+ 36847us) log.cc:844] Serialized 14 byte log entry
0709 12:15:20.233302 (+277742us) spinlock_profiling.cc:243] Waited 3.04 ms on lock 0x7b18003303a0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3ab8e07 00007f84ec9139a9 00007f84e3ad569b 00007f84e3ad393f 00007f84e3ad5c02 00007f84e675d20b 00007f84e6762d23 00007f84e676323a 00007f84e6bcda2a
0709 12:15:20.445399 (+212097us) log.cc:844] Serialized 14 byte log entry
0709 12:15:20.732686 (+287287us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e675e86e 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221 00007f84e67671d9 00007f84e6767169
0709 12:15:20.895700 (+163014us) spinlock_profiling.cc:243] Waited 3.73 ms on lock 0x7b18003303a0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3ad63f3 00007f84e3ad87c1 00007f84e3ad8779 00007f84e3ad8709 00007f84e3ad86d1 00007f84e3ad79cd 0000000000388634 0000000000388479 00007f84e3ab983a
0709 12:15:21.126563 (+230863us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b18003303a0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3ab8e07 00007f84ec9139a9 00007f84e3ad569b 00007f84e3ad393f 00007f84e3ad3455 00007f84e6bbb060 00007f84e6bcd716 00007f84e6bde287 00007f84e6bde208
0709 12:15:21.259249 (+132686us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:21.259357 (+   108us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:15:21.268041 (+  8684us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:21.272816 (+  4775us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:21.287372 (+ 14556us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16585,"prepare.queue_time_us":36735,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":13054,"raft.queue_time_us":53205,"raft.run_cpu_time_us":465,"raft.run_wall_time_us":17092,"spinlock_wait_cycles":73513472,"thread_start_us":334682,"threads_started":2,"wal-append.queue_time_us":546115}
I20260709 12:15:21.308290 10416 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.307889 10072 raft_consensus.cc:2749] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:21.332154  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:21.333050  5801 leader_election.cc:304] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:21.333918  5200 raft_consensus.cc:2468] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 12.
I20260709 12:15:21.305267 10322 raft_consensus.cc:493] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:21.338107 10244 consensus_queue.cc:1059] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
W20260709 12:15:21.344141  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:21.344334 10173 consensus_queue.cc:1048] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:15:21.318368 10303 consensus_queue.cc:1048] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 12:15:21.358759  5238 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:21.319993 10342 raft_consensus.cc:493] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:21.365962 10075 raft_consensus.cc:493] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:21.366591  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:21.367911 10238 raft_consensus.cc:493] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.368590 10238 raft_consensus.cc:515] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:21.371177 10238 leader_election.cc:290] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:21.371661  5117 raft_consensus.cc:1275] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:15:21.374384 10117 leader_election.cc:290] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:21.366670 10075 raft_consensus.cc:515] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:21.375272  9985 consensus_queue.cc:1059] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:15:21.364439 10066 raft_consensus.cc:515] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:21.346303 10322 raft_consensus.cc:515] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:21.380860 10066 leader_election.cc:290] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:21.381518 10231 raft_consensus.cc:2749] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:21.381779 10235 raft_consensus.cc:2749] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:21.383186 10075 leader_election.cc:290] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:21.383704  5238 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:15:21.385552  5237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:21.385965  5165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:21.386309  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 134358us
W20260709 12:15:21.387151  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 70710.3us
I20260709 12:15:21.389307  5804 leader_election.cc:304] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:21.390142  9985 raft_consensus.cc:3055] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:15:21.391495 10000 raft_consensus.cc:3060] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:21.392735  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:21.393994  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:21.395298  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:21.398341 10189 raft_consensus.cc:3060] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:21.381167 10322 leader_election.cc:290] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:21.401830 10342 raft_consensus.cc:515] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:21.344980 10416 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:21.405759  5116 raft_consensus.cc:1275] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:15:21.399596  5120 raft_consensus.cc:1275] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:15:21.413208  5123 raft_consensus.cc:3060] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:15:21.425582  5124 raft_consensus.cc:2393] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 13: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:15:21.430096  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:21.438951  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:21.436065  5088 leader_election.cc:400] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Vote denied by peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455) with higher term. Message: Invalid argument: T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 13. Current term is 14.
I20260709 12:15:21.440217  5088 leader_election.cc:403] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:21.443499  5118 raft_consensus.cc:2393] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 11: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:15:21.445497  5240 leader_election.cc:304] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:21.411294  9985 raft_consensus.cc:740] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:15:21.433979 10075 raft_consensus.cc:2749] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:21.454860  5164 leader_election.cc:304] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:21.461529  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:21.463779  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:21.428532 10217 raft_consensus.cc:515] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:21.462427  5238 leader_election.cc:304] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
W20260709 12:15:21.467079  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:21.467684 10401 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:21.468416 10415 leader_election.cc:290] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:21.468319 10401 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:21.471377 10401 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:21.471990 10271 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:15:21.473580  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 107614us
I20260709 12:15:21.475271  5088 leader_election.cc:304] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
W20260709 12:15:21.476272 10419 log.cc:927] Time spent T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.102s	user 0.000s	sys 0.002s
I20260709 12:15:21.477571 10173 raft_consensus.cc:2804] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:21.478015 10173 raft_consensus.cc:493] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:21.461714 10235 raft_consensus.cc:2764] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
W20260709 12:15:21.485553  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 96523us
W20260709 12:15:21.494553  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 101293us
W20260709 12:15:21.500562  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 45777.8us
I20260709 12:15:21.478390 10173 raft_consensus.cc:3060] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:21.518779 10075 raft_consensus.cc:493] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:21.521169  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 81393.4us
I20260709 12:15:21.455426 10324 consensus_queue.cc:1048] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.067s
I20260709 12:15:21.523558 10395 raft_consensus.cc:493] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.586078 10395 raft_consensus.cc:515] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:21.588253 10395 leader_election.cc:290] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:21.476291  5088 leader_election.cc:304] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:21.461064 10322 raft_consensus.cc:493] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.589809 10322 raft_consensus.cc:515] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:21.591958  5269 raft_consensus.cc:2468] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 13.
W20260709 12:15:21.547252  5801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:21.503125 10400 raft_consensus.cc:2749] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:21.597561  5018 catalog_manager.cc:5697] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 8 to 10, leader changed from bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 10 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:21.600201  5018 catalog_manager.cc:5697] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:21.548751  5123 raft_consensus.cc:2468] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 14.
I20260709 12:15:21.551347  9985 consensus_queue.cc:260] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:21.552354 10331 raft_consensus.cc:3055] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:21.552918  5238 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:15:21.554548 10416 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:15:21.557677  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 62196.8us
I20260709 12:15:21.558804 10066 consensus_queue.cc:1048] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:15:21.560014  5195 raft_consensus.cc:1240] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:21.561501  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:21.563304  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:21.567494  5196 raft_consensus.cc:1240] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:15:21.567910  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:21.576534 10342 leader_election.cc:290] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:21.577879 10217 leader_election.cc:290] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:21.578759  5804 leader_election.cc:304] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:21.582574 10075 raft_consensus.cc:515] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:21.607177  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 130966us
I20260709 12:15:21.611589  5199 raft_consensus.cc:2468] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 13.
I20260709 12:15:21.613628 10298 raft_consensus.cc:2749] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455) with higher term. Message: Invalid argument: T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 13. Current term is 14.
I20260709 12:15:21.614087  5198 raft_consensus.cc:1275] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 18 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 12:15:21.624733  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 76197.1us
I20260709 12:15:21.626137  5804 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:21.628230 10243 raft_consensus.cc:2749] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:21.629572 10243 raft_consensus.cc:2749] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:15:21.632151  5804 leader_election.cc:304] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:21.617324  5194 raft_consensus.cc:2468] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 12.
I20260709 12:15:21.633865  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:21.594498 10244 raft_consensus.cc:2749] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:21.638680 10244 consensus_queue.cc:1059] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:15:21.639622 10244 raft_consensus.cc:3055] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:15:21.640064 10244 raft_consensus.cc:740] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:21.641067 10244 consensus_queue.cc:260] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:21.642449 10244 raft_consensus.cc:3060] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:21.642699 10075 leader_election.cc:290] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:21.595672 10415 raft_consensus.cc:2804] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:15:21.655236  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 174779us
I20260709 12:15:21.652200  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:21.658079  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:21.658921  5198 raft_consensus.cc:2393] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 12: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:15:21.604704 10331 raft_consensus.cc:740] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:21.664417  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:21.665140  5194 raft_consensus.cc:2468] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 10.
I20260709 12:15:21.666042 10034 raft_consensus.cc:2804] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:21.666548 10034 raft_consensus.cc:493] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:21.666915 10034 raft_consensus.cc:3060] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:21.670569  5166 leader_election.cc:304] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:21.643667 10000 raft_consensus.cc:493] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.676726  5801 leader_election.cc:304] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:21.658385 10238 raft_consensus.cc:2804] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:21.678323  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:21.675595 10402 consensus_queue.cc:1048] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 12:15:21.682303  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:21.680982  5193 raft_consensus.cc:2468] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 13.
I20260709 12:15:21.685441  5237 leader_election.cc:304] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:21.686599  5166 leader_election.cc:304] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:21.685233  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:21.672071 10342 raft_consensus.cc:493] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.679000 10324 raft_consensus.cc:2749] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:21.695962  5269 raft_consensus.cc:1275] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 18 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:15:21.696667  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:21.700582  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:21.700876  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:21.661217 10072 consensus_queue.cc:1048] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 12:15:21.702155  5122 raft_consensus.cc:1813] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Handling vote request from an unknown peer dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:21.699911  5088 leader_election.cc:304] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:21.676838 10415 raft_consensus.cc:697] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 11 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:21.699963  5200 raft_consensus.cc:2468] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 9.
I20260709 12:15:21.687615 10412 raft_consensus.cc:493] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.704768  5122 raft_consensus.cc:2410] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:15:21.677032 10416 raft_consensus.cc:493] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.705610  5237 leader_election.cc:304] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:21.702306  5272 raft_consensus.cc:2376] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 13. Re-sending same reply.
I20260709 12:15:21.708289  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:21.701229 10058 raft_consensus.cc:2804] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:15:21.721036  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 77054.1us
I20260709 12:15:21.702661  5267 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 15.
I20260709 12:15:21.681519 10000 raft_consensus.cc:515] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:21.695457 10238 raft_consensus.cc:697] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 14 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:21.738390  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:21.690325 10205 consensus_queue.cc:1059] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:15:21.742913  5265 raft_consensus.cc:1275] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:15:21.727339  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:21.743021  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:21.710709 10413 raft_consensus.cc:2749] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:21.744758  5272 raft_consensus.cc:2468] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 13.
I20260709 12:15:21.747788  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:21.755960  5265 raft_consensus.cc:2468] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 10.
I20260709 12:15:21.749245 10205 raft_consensus.cc:3055] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:21.749948 10281 raft_consensus.cc:2804] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:21.750402 10271 raft_consensus.cc:2749] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:21.726963 10123 raft_consensus.cc:2804] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:21.758404  5271 raft_consensus.cc:2410] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:15:21.721553 10322 leader_election.cc:290] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:21.726680 10342 raft_consensus.cc:515] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:21.773216  5118 raft_consensus.cc:3060] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:21.774756  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:21.739960 10058 raft_consensus.cc:697] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:21.757311 10205 raft_consensus.cc:740] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:21.737613 10416 raft_consensus.cc:515] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:21.759089 10281 raft_consensus.cc:493] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:21.800328  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 100484us
W20260709 12:15:21.807420  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 117512us
I20260709 12:15:21.709057 10331 consensus_queue.cc:260] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:21.788919 10322 raft_consensus.cc:2804] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:21.813813  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:21.745652 10412 raft_consensus.cc:515] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:21.803403 10324 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:21.808856 10281 raft_consensus.cc:3060] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:21.828672  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:21.823776  5267 raft_consensus.cc:2468] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 11.
W20260709 12:15:21.824169  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:21.812975 10322 raft_consensus.cc:493] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:21.834791  5835 raft_consensus.cc:1275] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:15:21.810473 10413 raft_consensus.cc:493] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:21.838091  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:21.838817 10058 consensus_queue.cc:237] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:21.839496 10396 consensus_queue.cc:1048] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:15:21.837998  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:21.841480 10436 raft_consensus.cc:493] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:21.847532 10205 consensus_queue.cc:260] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:21.830826  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:21.853272  5118 raft_consensus.cc:2468] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 14.
I20260709 12:15:21.834508 10415 consensus_queue.cc:237] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:21.857201 10238 consensus_queue.cc:237] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:21.837184 10322 raft_consensus.cc:3060] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:21.836855 10324 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:21.858667  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:21.881063  5833 raft_consensus.cc:2468] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 13.
W20260709 12:15:21.858347  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 173693us
W20260709 12:15:21.861706  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 105306us
I20260709 12:15:21.865415  5836 raft_consensus.cc:2393] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 15: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:15:21.858566  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:21.872862  5829 raft_consensus.cc:1240] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:21.884791  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:21.871795  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:21.886323  5088 leader_election.cc:304] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:21.886760  5194 raft_consensus.cc:2468] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 13.
I20260709 12:15:21.889670  5838 raft_consensus.cc:2468] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 11.
W20260709 12:15:21.896790  5237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:21.895920  5166 leader_election.cc:304] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:21.902630  5801 leader_election.cc:304] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:21.901891  5237 leader_election.cc:304] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:21.859294 10431 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:21.865918 10205 raft_consensus.cc:3060] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:21.867834 10331 raft_consensus.cc:3060] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:15:21.909478  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:21.876266 10324 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:21.914906  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:21.905270  5118 raft_consensus.cc:1275] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:15:21.910655  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:21.865298 10416 leader_election.cc:290] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:21.860755 10391 raft_consensus.cc:493] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:21.877092 10342 leader_election.cc:290] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:21.871490  9985 raft_consensus.cc:3060] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:21.868005 10123 raft_consensus.cc:493] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:21.905999 10433 consensus_queue.cc:1048] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.007s
I20260709 12:15:21.860525 10412 leader_election.cc:290] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:21.908399  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:21.918777  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:21.919433  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:21.921252  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:21.921509 10434 raft_consensus.cc:2804] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:21.914009 10126 raft_consensus.cc:2804] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:21.867988 10413 raft_consensus.cc:515] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:21.930425  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:21.935233  5240 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:21.936293  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:21.939240  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:21.906796 10217 raft_consensus.cc:2804] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:21.940939  5163 leader_election.cc:304] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:21.891369 10034 raft_consensus.cc:515] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:21.948318  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:15:21.963155  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:21.961449  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:15:21.964610  5165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:21.944365 10123 raft_consensus.cc:3060] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:21.969566  5117 raft_consensus.cc:2393] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 9: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:15:21.963248  5270 raft_consensus.cc:2468] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 10.
I20260709 12:15:21.942391 10416 raft_consensus.cc:2804] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:21.879051 10436 raft_consensus.cc:515] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:21.965098  5836 raft_consensus.cc:2468] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 10.
I20260709 12:15:21.977133  5274 raft_consensus.cc:2468] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 9.
I20260709 12:15:21.956704 10434 raft_consensus.cc:493] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:21.956571 10126 raft_consensus.cc:493] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:21.980422  5269 raft_consensus.cc:2393] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 9: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:15:21.940124 10435 raft_consensus.cc:493] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:21.944084 10400 consensus_queue.cc:1048] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:15:21.983922  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:21.944000 10391 raft_consensus.cc:515] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:21.969610 10325 raft_consensus.cc:2804] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:21.983687  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:21.974566 10416 raft_consensus.cc:493] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:21.990187  5833 raft_consensus.cc:1275] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:15:21.969729 10342 raft_consensus.cc:493] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:21.991788  5801 leader_election.cc:304] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:15:21.914189 10431 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:21.991811  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:21.998760  5272 raft_consensus.cc:2468] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 11.
I20260709 12:15:21.983609 10434 raft_consensus.cc:3060] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:21.977905 10415 raft_consensus.cc:493] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:21.996989  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:22.003710 10034 leader_election.cc:290] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:22.001330  5163 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:21.983831 10126 raft_consensus.cc:3060] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:22.009063  5163 leader_election.cc:304] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:22.007655  5836 raft_consensus.cc:1275] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:15:21.992486 10325 raft_consensus.cc:493] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:21.995771 10416 raft_consensus.cc:3060] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:21.984902 10231 consensus_queue.cc:1048] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 12:15:22.004994 10093 raft_consensus.cc:2749] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:22.007848 10438 raft_consensus.cc:493] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:22.042505  5833 raft_consensus.cc:1240] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 15. Current term is 16. Ops: []
I20260709 12:15:22.036720 10325 raft_consensus.cc:3060] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:15:22.054582  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 147910us
I20260709 12:15:22.038187 10034 raft_consensus.cc:493] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:22.058845  5237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:22.002599 10342 raft_consensus.cc:515] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:22.036033 10412 raft_consensus.cc:493] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:22.055858 10438 raft_consensus.cc:515] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:22.062556 10400 raft_consensus.cc:2749] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:22.063486 10326 raft_consensus.cc:2804] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:22.068356  5088 leader_election.cc:304] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:22.074892  5088 leader_election.cc:304] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:22.074112 10326 raft_consensus.cc:493] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:22.079089 10326 raft_consensus.cc:3060] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:15:22.079881 10442 log.cc:927] Time spent T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 12:15:22.015831 10435 raft_consensus.cc:515] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:22.085573 10448 raft_consensus.cc:493] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:22.086272 10448 raft_consensus.cc:515] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:22.087425 10326 raft_consensus.cc:515] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:22.088438 10413 leader_election.cc:290] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:22.089092 10322 raft_consensus.cc:515] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:22.091665 10322 leader_election.cc:290] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:22.053539 10445 raft_consensus.cc:2804] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:22.092542 10445 raft_consensus.cc:493] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:22.092953 10445 raft_consensus.cc:3060] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:22.099248 10326 leader_election.cc:290] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:22.037158 10415 raft_consensus.cc:515] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:22.106752  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:22.107484  5838 raft_consensus.cc:3060] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:22.108695 10449 consensus_queue.cc:1048] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:15:22.109338 10322 raft_consensus.cc:2749] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:22.110364 10449 raft_consensus.cc:2749] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:22.110957  5240 leader_election.cc:304] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:22.111557  5088 leader_election.cc:304] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:15:22.112620 10084 consensus_queue.cc:1059] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:15:22.113821 10084 raft_consensus.cc:2749] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:15:22.114332 10322 raft_consensus.cc:2804] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:22.114769 10322 raft_consensus.cc:493] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:22.115127 10322 raft_consensus.cc:3060] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:22.116520 10412 raft_consensus.cc:515] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:22.113893  5088 leader_election.cc:304] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:22.119047 10412 leader_election.cc:290] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:22.058424 10244 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:22.118254  5838 raft_consensus.cc:2468] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 14.
I20260709 12:15:22.087555 10435 leader_election.cc:290] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:22.070701 10034 raft_consensus.cc:515] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:22.150243 10244 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:22.307585 10244 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:22.088483 10448 leader_election.cc:290] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:22.210532 10391 leader_election.cc:290] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:22.144675 10439 raft_consensus.cc:493] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:22.119324  5088 leader_election.cc:304] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:15:22.309508 10439 raft_consensus.cc:515] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:22.212391 10342 leader_election.cc:290] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:22.213624 10431 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:15:22.214118 10173 consensus_meta.cc:287] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.601s	user 0.013s	sys 0.000s
I20260709 12:15:22.312206 10173 raft_consensus.cc:515] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:22.217691  5833 raft_consensus.cc:1275] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:15:22.218353 10000 leader_election.cc:290] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:22.219097 10415 leader_election.cc:290] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:22.212206 10322 raft_consensus.cc:515] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:22.216869 10281 raft_consensus.cc:515] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:22.316154  5265 raft_consensus.cc:2368] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 12. Current term is 13.
I20260709 12:15:22.194170 10449 consensus_queue.cc:1048] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:15:22.224293  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:22.225306  5837 raft_consensus.cc:1240] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 13. Current term is 14. Ops: [13.13-13.13]
I20260709 12:15:22.225733  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:22.227563  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:22.228931 10326 consensus_queue.cc:1048] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:15:22.228967 10331 raft_consensus.cc:2749] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:22.230839 10416 raft_consensus.cc:515] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:22.321943 10173 leader_election.cc:290] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:22.322994 10416 leader_election.cc:290] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:22.233834 10445 raft_consensus.cc:515] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:22.234300  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:22.324008  5125 raft_consensus.cc:2393] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 14: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:15:22.324205 10322 leader_election.cc:290] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:22.235586  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:22.115237 10271 raft_consensus.cc:3055] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:22.324927 10271 raft_consensus.cc:740] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:22.325117  5118 raft_consensus.cc:2393] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 12: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:15:22.238291 10438 leader_election.cc:290] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:22.233768  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:22.241801  5240 leader_election.cc:304] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:22.246680  5018 catalog_manager.cc:5697] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 10 to 13, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 13 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:22.326884 10439 leader_election.cc:290] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:22.326508  5018 catalog_manager.cc:5697] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 10 to 15, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 15 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:22.328187  5018 catalog_manager.cc:5697] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:15:22.332283  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 90578.3us
I20260709 12:15:22.254947 10303 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:22.338776 10303 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:22.341853 10303 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:22.245074 10434 raft_consensus.cc:515] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:22.344514 10434 leader_election.cc:290] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:22.212149 10126 raft_consensus.cc:515] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:22.275940  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:15:22.278523  5021 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50918 (request call id 229) took 20590 ms (client timeout 15000 ms). Trace:
W20260709 12:15:22.345429  5021 rpcz_store.cc:269] 0709 12:15:01.687949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:01.688221 (+   272us) service_pool.cc:224] Handling call
0709 12:15:22.278275 (+20590054us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:15:18.454821 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:15:18.455492 (+   671us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:15:18.455551 (+    59us) write_op.cc:435] Acquired schema lock
0709 12:15:18.455578 (+    27us) tablet.cc:662] Decoding operations
0709 12:15:18.456660 (+  1082us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:15:18.456753 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 12:15:18.456777 (+    24us) tablet.cc:685] Acquiring locks for 12 operations
0709 12:15:18.473508 (+ 16731us) tablet.cc:701] Row locks acquired
0709 12:15:18.473561 (+    53us) write_op.cc:260] PREPARE: finished
0709 12:15:18.473745 (+   184us) write_op.cc:270] Start()
0709 12:15:18.473892 (+   147us) write_op.cc:276] Timestamp: P: 1783599318473685 usec, L: 0
0709 12:15:18.473913 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:15:18.474650 (+   737us) log.cc:844] Serialized 4872 byte log entry
0709 12:15:19.036566 (+561916us) spinlock_profiling.cc:243] Waited 4.08 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e675e86e 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221 00007f84e67671d9 00007f84e6767169
0709 12:15:19.446121 (+409555us) op_driver.cc:464] REPLICATION: finished
0709 12:15:19.568701 (+122580us) write_op.cc:301] APPLY: starting
0709 12:15:19.568798 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 12:15:19.628698 (+ 59900us) tablet.cc:1370] finished BulkCheckPresence
0709 12:15:19.628727 (+    29us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:15:19.859702 (+230975us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:15:19.859973 (+   271us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 12:15:19.860019 (+    46us) write_op.cc:312] APPLY: finished
0709 12:15:19.860351 (+   332us) log.cc:844] Serialized 113 byte log entry
0709 12:15:19.861356 (+  1005us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:19.865086 (+  3730us) write_op.cc:454] Released schema lock
0709 12:15:19.865152 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 12:15:19.873827 (+  8675us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:19.873863 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":61990,"reported_tablets":39,"child_traces":[["op",{"apply.queue_time_us":122293,"apply.run_cpu_time_us":17198,"apply.run_wall_time_us":305088,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54263,"num_ops":12,"prepare.queue_time_us":147816,"prepare.run_cpu_time_us":20550,"prepare.run_wall_time_us":346871,"raft.queue_time_us":140917,"raft.run_cpu_time_us":24046,"raft.run_wall_time_us":183775,"replication_time_us":960456,"spinlock_wait_cycles":9379072,"thread_start_us":463638,"threads_started":4,"wal-append.queue_time_us":361915,"wal-append.run_cpu_time_us":37983,"wal-append.run_wall_time_us":2114005}]]}
I20260709 12:15:22.349179  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:22.137517 10447 raft_consensus.cc:493] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:22.282995  5274 raft_consensus.cc:2468] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 14.
I20260709 12:15:22.303822 10034 leader_election.cc:290] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:22.220484 10436 leader_election.cc:290] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:22.252311 10455 raft_consensus.cc:493] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:22.333014  5018 catalog_manager.cc:5697] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:22.334103 10415 raft_consensus.cc:2749] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:15:22.334975  5831 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 9.
I20260709 12:15:22.335711 10445 leader_election.cc:290] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:22.336324 10281 leader_election.cc:290] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:22.337553  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:22.409947  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:22.349805  5194 raft_consensus.cc:3060] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:22.350786  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:22.410674  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:22.411037  5117 raft_consensus.cc:3060] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:22.409524  5192 raft_consensus.cc:3060] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:22.418462 10447 raft_consensus.cc:515] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:22.420961 10447 leader_election.cc:290] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:22.345454 10325 raft_consensus.cc:515] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:22.423956 10325 leader_election.cc:290] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:22.393814  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
W20260709 12:15:22.394690  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:22.426537  5838 raft_consensus.cc:2376] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 15. Re-sending same reply.
I20260709 12:15:22.410710  5837 raft_consensus.cc:2368] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 11. Current term is 12.
I20260709 12:15:22.335001 10271 consensus_queue.cc:260] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:15:22.400287  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 281041us
I20260709 12:15:22.431054  5194 raft_consensus.cc:2468] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 14.
I20260709 12:15:22.436980  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:22.439745  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:22.455349  5123 raft_consensus.cc:2393] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 12: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:15:22.458134  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:22.290580 10123 raft_consensus.cc:515] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:22.393518 10217 raft_consensus.cc:697] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:22.472805  5192 raft_consensus.cc:2468] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 13.
W20260709 12:15:22.472994  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 71190.2us
I20260709 12:15:22.461822  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:22.473663  5200 raft_consensus.cc:3060] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:22.462774  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:15:22.398541  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 47963.2us
I20260709 12:15:22.441745  5018 catalog_manager.cc:5697] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:22.476317  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:22.477030  5199 raft_consensus.cc:3060] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:22.411932 10342 raft_consensus.cc:2804] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:22.409588 10455 raft_consensus.cc:515] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:22.478621  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:15:22.479928  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 268830us
I20260709 12:15:22.486622  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:22.407505  5804 leader_election.cc:304] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:22.396682 10326 consensus_queue.cc:1048] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.081s
W20260709 12:15:22.487126  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 478132us
I20260709 12:15:22.483613  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:22.488214  5237 leader_election.cc:304] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
W20260709 12:15:22.488270  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 498344us
W20260709 12:15:22.497041  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 89631.9us
I20260709 12:15:22.498944  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:22.499146  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:22.499423  5804 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:22.500232  5124 raft_consensus.cc:1275] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:15:22.508461  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:22.488687  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:22.480866 10342 raft_consensus.cc:493] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:22.481213 10126 leader_election.cc:290] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:22.611102  5116 raft_consensus.cc:3060] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:22.541538  5088 leader_election.cc:400] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709) with higher term. Message: Invalid argument: T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 12. Current term is 13.
I20260709 12:15:22.621312  5088 leader_election.cc:403] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:15:22.613814  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 114455us
I20260709 12:15:22.615362  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:22.616053  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:22.617187  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:15:22.618402  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 130272us
I20260709 12:15:22.619130  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
W20260709 12:15:22.614754  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 102652us
I20260709 12:15:22.622937  5269 raft_consensus.cc:1240] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:15:22.621913  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:22.628301  5265 raft_consensus.cc:3060] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:22.628724  5237 leader_election.cc:304] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:22.487751 10434 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
W20260709 12:15:22.630641  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 121020us
I20260709 12:15:22.630118  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:22.682132  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:22.682430  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:22.673867  5018 catalog_manager.cc:5697] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 7 to 8, leader changed from bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 8 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
W20260709 12:15:22.677585  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 49319.7us
I20260709 12:15:22.667027  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:22.684907  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:22.685030  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:22.685474  5266 raft_consensus.cc:3060] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:15:22.610622 10395 raft_consensus.cc:2749] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:15:22.686127  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 57489.1us
I20260709 12:15:22.511788 10075 raft_consensus.cc:2749] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:15:22.693832  5237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:15:22.611377 10243 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.017s	sys 0.041s
I20260709 12:15:22.694938  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:22.685318  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:22.620483 10235 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:22.697507  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:22.620697 10342 raft_consensus.cc:3060] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:22.513070 10401 consensus_queue.cc:1059] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.178s
I20260709 12:15:22.712587  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:22.712879  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:22.713616  5833 raft_consensus.cc:2393] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 14: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:15:22.664839 10271 raft_consensus.cc:3060] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:22.703378  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:22.511971 10066 consensus_queue.cc:1048] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.189s
I20260709 12:15:22.726904  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:22.727697  5834 raft_consensus.cc:2393] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 14: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:15:22.688203  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:22.728145  5269 raft_consensus.cc:3060] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:22.710878  5018 catalog_manager.cc:5697] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 7 to 10, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 10 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:22.728228 10217 consensus_queue.cc:237] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:22.729305  5018 catalog_manager.cc:5697] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 12 to 15, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 15 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:22.729718 10235 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:22.732264 10235 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:22.734383  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:22.689688 10205 raft_consensus.cc:2804] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:22.698074 10416 raft_consensus.cc:493] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:22.737883 10416 raft_consensus.cc:515] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:22.682857 10449 raft_consensus.cc:3060] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:15:22.726522  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:22.742784 10205 raft_consensus.cc:697] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 14 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:22.712587  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:22.715447 10450 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:22.715821  5268 raft_consensus.cc:2393] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 9: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
W20260709 12:15:22.715909  5008 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ddd16ccf58f24f6db29e5fc39a06e5c4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica bce73265e27d4b30a4dcc1e491305088 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:22.717514 10276 raft_consensus.cc:2804] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:22.717679  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:22.718194  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:22.684779 10434 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:22.725203  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:15:22.702009 10243 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.019s	sys 0.043s
I20260709 12:15:22.764788  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:22.765427  5121 raft_consensus.cc:2368] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 11. Current term is 12.
I20260709 12:15:22.730959  5018 catalog_manager.cc:5697] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 10 to 12, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 12 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
W20260709 12:15:22.763245  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 48774.5us
I20260709 12:15:22.765702  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:22.766961  5194 raft_consensus.cc:2393] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 14: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
W20260709 12:15:22.767680  5008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 51863.2us
I20260709 12:15:22.772929 10401 raft_consensus.cc:3055] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:22.773478  5121 raft_consensus.cc:1240] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 12. Current term is 14. Ops: []
I20260709 12:15:22.743896 10205 consensus_queue.cc:237] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:22.787189  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:22.790903  5116 raft_consensus.cc:2468] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 11.
I20260709 12:15:22.786837  5238 leader_election.cc:400] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Vote denied by peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539) with higher term. Message: Invalid argument: T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 11. Current term is 12.
I20260709 12:15:22.797771  5238 leader_election.cc:403] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:22.778195 10123 leader_election.cc:290] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:22.773476 10401 raft_consensus.cc:740] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:22.770016 10276 raft_consensus.cc:697] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 13 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:22.792129  5018 catalog_manager.cc:5697] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 12 to 14, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 14 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:22.785548 10093 raft_consensus.cc:493] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:22.797525 10455 leader_election.cc:290] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:22.804338  5238 leader_election.cc:304] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:22.837340  5265 raft_consensus.cc:2468] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 12.
I20260709 12:15:22.843750  5117 raft_consensus.cc:2468] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 14.
I20260709 12:15:22.846360  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:22.768078 10450 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:22.878311  5018 catalog_manager.cc:5697] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 9 to 11, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 11 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:22.903146  5804 leader_election.cc:304] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:15:22.904091  5117 raft_consensus.cc:1240] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:22.904403  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:22.905304  5018 catalog_manager.cc:5697] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 14 to 15, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 15 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:22.906946  5018 catalog_manager.cc:5697] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 7 to 12. New cstate: current_term: 12 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:22.917665 10276 consensus_queue.cc:237] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:22.918874 10431 raft_consensus.cc:493] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:22.919474 10431 raft_consensus.cc:515] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:22.920156  5089 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.960s	user 0.013s	sys 0.022s
W20260709 12:15:22.920518  5089 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.961s	user 0.013s	sys 0.022s
I20260709 12:15:22.922605 10431 leader_election.cc:290] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:22.923230 10400 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:22.923763 10400 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:22.926678 10400 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:22.929580 10281 raft_consensus.cc:2749] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:22.929492 10458 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:22.930876 10458 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:22.933689 10470 log.cc:927] Time spent T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 12:15:22.934949  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:22.935323  5166 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:22.845968 10093 raft_consensus.cc:515] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:22.943543 10093 leader_election.cc:290] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:22.944429  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:22.949575 10431 raft_consensus.cc:493] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:22.950172 10431 raft_consensus.cc:515] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:22.951179 10450 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:22.933331 10458 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:22.953430  5266 raft_consensus.cc:2468] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 12.
I20260709 12:15:22.960922 10454 raft_consensus.cc:3060] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:22.964000  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:22.966893 10434 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:22.967892 10415 raft_consensus.cc:2749] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539) with higher term. Message: Invalid argument: T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 11. Current term is 12.
I20260709 12:15:22.970067 10431 leader_election.cc:290] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:22.971963  5195 raft_consensus.cc:2468] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 9.
I20260709 12:15:22.888684 10416 leader_election.cc:290] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:22.979902  5269 raft_consensus.cc:2468] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 14.
W20260709 12:15:22.982889 10469 log.cc:927] Time spent T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:15:22.988021  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
W20260709 12:15:22.983939  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 179364us
I20260709 12:15:22.986112  5240 leader_election.cc:304] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:22.994901 10235 raft_consensus.cc:2749] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:22.984098  5018 catalog_manager.cc:5697] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 12 to 13, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 13 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:23.000278  5240 leader_election.cc:304] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:22.984406  5122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40386 (request call id 2438) took 1085 ms. Trace:
I20260709 12:15:22.917461 10453 raft_consensus.cc:2804] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:23.001574  5240 leader_election.cc:400] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Vote denied by peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443) with higher term. Message: Invalid argument: T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 11. Current term is 12.
I20260709 12:15:22.930807  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:23.001178  5018 catalog_manager.cc:5697] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 11 to 13, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 13 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } }
W20260709 12:15:23.027550  5199 consensus_meta.cc:287] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.548s	user 0.011s	sys 0.000s
W20260709 12:15:23.022784  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:23.040004  5199 raft_consensus.cc:2468] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 14.
I20260709 12:15:23.005124  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:23.034678  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
W20260709 12:15:23.015686  5200 consensus_meta.cc:287] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.536s	user 0.008s	sys 0.001s
W20260709 12:15:23.041487  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:23.041862  5200 raft_consensus.cc:2468] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 12.
I20260709 12:15:23.040820  5833 raft_consensus.cc:2468] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 10.
I20260709 12:15:23.043692  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:23.044354  5833 raft_consensus.cc:2468] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 8.
I20260709 12:15:23.051995  5268 raft_consensus.cc:2368] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 11. Current term is 12.
I20260709 12:15:23.004065  5122 rpcz_store.cc:276] 0709 12:15:21.898549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:21.899279 (+   730us) service_pool.cc:224] Handling call
0709 12:15:21.910625 (+ 11346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:22.054811 (+144186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:15:22.054930 (+   119us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:15:22.297076 (+242146us) log.cc:844] Serialized 26 byte log entry
0709 12:15:22.498260 (+201184us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:15:22.498301 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:22.498365 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:15:22.984110 (+485745us) raft_consensus.cc:1685] finished
0709 12:15:22.984133 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:22.984304 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35120,"raft.queue_time_us":65023,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":9941,"thread_start_us":301120,"threads_started":2,"wal-append.queue_time_us":498446}
I20260709 12:15:23.054131  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:23.053809  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:23.056967  5274 raft_consensus.cc:2368] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 13. Current term is 14.
I20260709 12:15:23.056392  5018 catalog_manager.cc:5697] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 10 to 12, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 12 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:23.053802  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:23.054975  5832 raft_consensus.cc:1275] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:15:23.054958  5271 raft_consensus.cc:2468] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 16.
I20260709 12:15:23.059165  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:23.059988  5238 leader_election.cc:304] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:23.060766  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:23.058018  5830 raft_consensus.cc:2468] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 16.
I20260709 12:15:23.057858  5018 catalog_manager.cc:5697] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:23.066613  5018 catalog_manager.cc:5697] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:23.068729  5836 raft_consensus.cc:1275] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:15:23.026911 10238 raft_consensus.cc:2749] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:23.070009  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:23.028275 10235 consensus_queue.cc:1048] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:15:23.068941  5088 leader_election.cc:304] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:23.072108  5273 raft_consensus.cc:1275] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:15:23.066246  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:23.067962  5018 catalog_manager.cc:5697] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 10 to 12, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 12 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:23.074790  5088 leader_election.cc:304] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:23.076224  5088 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:23.077358  5088 leader_election.cc:304] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:23.073766  5271 raft_consensus.cc:2468] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 15.
I20260709 12:15:23.077821  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:23.082768  5018 catalog_manager.cc:5697] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 14 to 16, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 16 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } }
I20260709 12:15:23.087880  5088 leader_election.cc:304] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:23.090191  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:23.084996  5018 catalog_manager.cc:5697] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 13 to 15, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 15 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:23.063638 10453 raft_consensus.cc:697] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 14 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:15:23.066444 10434 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:23.102583  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:23.084148 10391 raft_consensus.cc:2749] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:23.086088 10439 raft_consensus.cc:2749] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:23.085295 10431 raft_consensus.cc:2749] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:15:23.124255 10454 raft_consensus.cc:2749] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:23.126122 10449 raft_consensus.cc:2749] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709) with higher term. Message: Invalid argument: T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 12. Current term is 13.
I20260709 12:15:23.127017  5125 raft_consensus.cc:2468] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 13.
I20260709 12:15:23.113076 10434 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:23.129441 10451 raft_consensus.cc:493] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:23.130038 10451 raft_consensus.cc:515] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:23.119637 10391 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:23.131338 10391 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:23.132233 10451 leader_election.cc:290] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:23.074471 10450 consensus_queue.cc:1059] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:15:23.133975 10450 raft_consensus.cc:3055] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:23.134368 10450 raft_consensus.cc:740] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:23.135311 10450 consensus_queue.cc:260] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:23.136639 10450 raft_consensus.cc:3060] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:23.121044 10439 raft_consensus.cc:2749] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:23.125072  9941 raft_consensus.cc:493] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:23.103085 10461 raft_consensus.cc:2749] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:23.055488 10401 consensus_queue.cc:260] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:23.104538 10400 raft_consensus.cc:493] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
W20260709 12:15:23.143797  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 218403us
I20260709 12:15:23.151381  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:23.152086  5193 raft_consensus.cc:2468] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 16.
I20260709 12:15:23.153650  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:23.156998  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:23.138964 10000 raft_consensus.cc:2804] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:23.160444  5834 raft_consensus.cc:2393] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 12: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:15:23.130532 10434 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:23.196913  5237 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:23.213873  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:23.158982 10000 raft_consensus.cc:493] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:23.215337  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:23.193859 10434 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:23.159793 10400 raft_consensus.cc:515] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:23.227242 10000 raft_consensus.cc:3060] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:23.219666 10235 raft_consensus.cc:2804] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:15:23.157265  9941 raft_consensus.cc:515] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:23.222395 10326 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:23.256786  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:15:23.252787  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 180443us
I20260709 12:15:23.263222  5801 leader_election.cc:304] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:23.251919 10391 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:23.246981 10434 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:23.277186  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9634d2debd9f4e7ea32cf4479f9242e1" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:15:23.265278 10342 consensus_meta.cc:287] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.550s	user 0.010s	sys 0.000s
I20260709 12:15:23.256026 10235 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:23.284029  5240 leader_election.cc:304] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:23.258283 10327 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:23.234508 10453 consensus_queue.cc:237] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:23.287756  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 240042us
I20260709 12:15:23.275627 10395 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:23.294627 10327 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:23.296690 10476 log.cc:927] Time spent T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 12:15:23.301805  5089 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:23.320464  5089 leader_election.cc:304] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:23.322068  5089 leader_election.cc:304] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:23.302714 10461 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:23.303181 10400 leader_election.cc:290] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:23.285794 10235 raft_consensus.cc:3060] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:23.302841 10434 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:23.259922 10326 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:23.342191 10461 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:23.344555 10461 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:23.335752 10455 consensus_queue.cc:1048] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 12:15:23.335599 10439 raft_consensus.cc:2749] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:23.333078 10449 raft_consensus.cc:2749] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:23.349009  5089 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:23.349959 10449 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:23.358098  9941 leader_election.cc:290] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:15:23.365989 10477 log.cc:927] Time spent T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 12:15:23.285256 10342 raft_consensus.cc:515] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:23.329833 10391 raft_consensus.cc:493] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:23.371277  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 52364.9us
W20260709 12:15:23.338762 10473 log.cc:927] Time spent T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 12:15:23.398401  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:23.403509  5163 leader_election.cc:400] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 election: Vote denied by peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709) with higher term. Message: Invalid argument: T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 13. Current term is 14.
I20260709 12:15:23.403895  5163 leader_election.cc:403] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:15:23.404587 10205 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:23.405233 10205 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:23.409173 10205 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:23.404687  5163 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:23.431953  5163 leader_election.cc:400] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 election: Vote denied by peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709) with higher term. Message: Invalid argument: T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 11. Current term is 12.
I20260709 12:15:23.432258  5163 leader_election.cc:403] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:15:23.434538 10303 raft_consensus.cc:2804] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:15:23.434983 10303 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:23.435331 10303 raft_consensus.cc:3060] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:23.330394 10395 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:23.440887 10395 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:23.418726 10391 raft_consensus.cc:515] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:23.443579 10472 raft_consensus.cc:493] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:23.443833 10391 leader_election.cc:290] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:23.444193 10472 raft_consensus.cc:515] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:23.445218  5191 raft_consensus.cc:1275] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 12:15:23.448158  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 184989us
I20260709 12:15:23.450544 10075 raft_consensus.cc:2749] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:23.452363  5801 leader_election.cc:304] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:23.454172 10416 raft_consensus.cc:2749] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:23.456360  5118 raft_consensus.cc:1275] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:15:23.454902 10416 raft_consensus.cc:493] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:23.458146 10416 raft_consensus.cc:515] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:23.459425  5801 leader_election.cc:304] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:23.409025 10402 raft_consensus.cc:2749] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709) with higher term. Message: Invalid argument: T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 13. Current term is 14.
I20260709 12:15:23.467242  5801 leader_election.cc:304] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:23.476125  5801 leader_election.cc:304] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:23.368198 10487 raft_consensus.cc:2749] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:15:23.474581  5163 leader_election.cc:304] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
W20260709 12:15:23.479460  5090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:23.478762  5200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:23.494217  5200 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 9.
I20260709 12:15:23.435504 10326 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:23.465832 10324 raft_consensus.cc:493] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:23.474189 10391 raft_consensus.cc:493] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:23.478453 10307 raft_consensus.cc:2749] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709) with higher term. Message: Invalid argument: T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 11. Current term is 12.
I20260709 12:15:23.478106 10458 raft_consensus.cc:2749] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:23.478374 10433 raft_consensus.cc:2749] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:15:23.527179  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 178237us
I20260709 12:15:23.529397  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:15:23.526194  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 438358us
I20260709 12:15:23.533493  5123 raft_consensus.cc:2393] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 9: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:15:23.533622  5088 leader_election.cc:304] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:15:23.512638 10325 raft_consensus.cc:2749] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:15:23.536250  5088 leader_election.cc:304] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
W20260709 12:15:23.557328  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 81281.7us
I20260709 12:15:23.561893  5801 leader_election.cc:304] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:23.560951  5088 leader_election.cc:304] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:15:23.563395  5089 leader_election.cc:304] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:23.591688  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:23.570124 10455 raft_consensus.cc:2804] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:23.595688  5088 leader_election.cc:304] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:15:23.559587 10331 raft_consensus.cc:2804] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:23.603313  5089 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:23.604322  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:23.610893  5837 raft_consensus.cc:2468] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 16.
I20260709 12:15:23.522008 10486 consensus_queue.cc:1048] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.079s
I20260709 12:15:23.527484 10324 raft_consensus.cc:515] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:23.560448 10439 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:23.613569  5088 leader_election.cc:304] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:15:23.595937 10433 raft_consensus.cc:2749] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:23.615252  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:23.597283 10093 raft_consensus.cc:493] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:23.629307  5089 leader_election.cc:304] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:15:23.598330 10416 leader_election.cc:290] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:23.620221 10434 raft_consensus.cc:2804] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:23.634917 10434 raft_consensus.cc:493] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:23.635492  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:23.635365 10434 raft_consensus.cc:3060] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:23.612632 10461 raft_consensus.cc:2804] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:23.612928 10455 raft_consensus.cc:697] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:23.639436  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:23.640512  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:23.593140 10000 raft_consensus.cc:515] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:23.650645  5836 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 15.
I20260709 12:15:23.650883 10455 consensus_queue.cc:237] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:23.651604 10327 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:23.642303 10447 raft_consensus.cc:2804] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:23.652305 10000 leader_election.cc:290] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:23.533780 10391 raft_consensus.cc:515] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:23.643862 10342 leader_election.cc:290] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:23.645012  5120 raft_consensus.cc:1240] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 13. Current term is 14. Ops: [11.12-13.13]
W20260709 12:15:23.652690 10507 log.cc:927] Time spent T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 12:15:23.654702 10493 log.cc:927] Time spent T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 12:15:23.654649 10391 leader_election.cc:290] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:15:23.655750 10492 log.cc:927] Time spent T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:15:23.656755  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:23.657716  5836 raft_consensus.cc:2393] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 11: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:15:23.663239  5238 leader_election.cc:304] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:23.652227 10447 raft_consensus.cc:493] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:23.622843 10084 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:23.670647 10000 raft_consensus.cc:2749] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:23.672096 10084 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:23.672390 10000 consensus_queue.cc:1048] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:23.667765  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:23.671422  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:23.674229  5120 raft_consensus.cc:2468] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 11.
I20260709 12:15:23.674647 10084 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:23.626636 10439 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:23.637450 10436 raft_consensus.cc:2804] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:15:23.676918 10449 raft_consensus.cc:2749] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:23.677820 10461 raft_consensus.cc:697] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:23.612882 10497 raft_consensus.cc:2749] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:23.617452 10490 raft_consensus.cc:2749] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:23.665138 10447 raft_consensus.cc:3060] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:15:23.669783  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 56301.4us
I20260709 12:15:23.683012  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
W20260709 12:15:23.614041  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 139569us
I20260709 12:15:23.718899  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:23.641055 10093 raft_consensus.cc:515] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:23.728753  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:23.623965 10472 leader_election.cc:290] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:23.686612  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:23.687647  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:15:23.692000  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 130213us
I20260709 12:15:23.710817  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:23.712008  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:23.716849  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:23.717327  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:23.626900 10503 raft_consensus.cc:2749] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:23.682914 10331 raft_consensus.cc:697] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:23.725850  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:23.726151  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:23.742430  5192 raft_consensus.cc:2468] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 13.
I20260709 12:15:23.726799  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:23.734941  5833 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 9.
I20260709 12:15:23.726959  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:23.727440  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:23.744796  5271 raft_consensus.cc:2468] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 12.
I20260709 12:15:23.744905  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:23.727650  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:23.730433  5124 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 15.
I20260709 12:15:23.735256  5801 leader_election.cc:304] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:23.740027  5270 raft_consensus.cc:1275] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:15:23.743307  5273 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 8.
I20260709 12:15:23.747172  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:23.747838  5195 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 9.
I20260709 12:15:23.682327 10189 consensus_queue.cc:1048] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:15:23.746526  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:23.746061  5088 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:15:23.752849  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:23.754873  5272 raft_consensus.cc:3060] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:23.758370  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:23.758615  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:23.716712 10436 raft_consensus.cc:697] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:23.759274  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:23.759460  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:23.755422 10075 raft_consensus.cc:2749] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:15:23.761528 10488 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:23.771528  5801 leader_election.cc:304] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:23.741364 10400 consensus_queue.cc:1048] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 12:15:23.832124 10342 raft_consensus.cc:493] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:23.835624 10453 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:23.835561 10342 raft_consensus.cc:515] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:23.836210 10453 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:23.838065 10342 leader_election.cc:290] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:23.838877  5120 raft_consensus.cc:1275] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:15:23.751626 10303 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:23.839969  5272 raft_consensus.cc:2468] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 11.
I20260709 12:15:23.774716 10497 raft_consensus.cc:2804] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:23.840667 10075 raft_consensus.cc:2749] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:23.835457 10324 leader_election.cc:290] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:15:23.842170 10518 log.cc:927] Time spent T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 12:15:23.856643  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:23.838315 10453 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:23.857486  5118 raft_consensus.cc:2468] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 14.
I20260709 12:15:23.844305 10497 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:23.833050 10235 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:23.827440 10488 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:23.886814 10238 raft_consensus.cc:493] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:23.842718 10461 consensus_queue.cc:237] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:23.894574 10439 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:23.856060 10331 consensus_queue.cc:237] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:23.909711  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:23.917971  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:23.918221  5117 raft_consensus.cc:1275] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 12:15:23.918789  5195 raft_consensus.cc:2393] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 17: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:15:23.911489  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:23.913353  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:23.919621  5836 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 9.
I20260709 12:15:23.914692  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:23.920423  5197 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 15.
I20260709 12:15:23.918675  5117 pending_rounds.cc:85] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting all ops after (but not including) 9
W20260709 12:15:23.918643  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 73728us
I20260709 12:15:23.920027  5270 raft_consensus.cc:2393] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 17: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:15:23.933653  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:23.933508  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:23.935124  5265 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 15.
I20260709 12:15:23.935809  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:15:23.936053  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 164605us
I20260709 12:15:23.935436  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:23.941546  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:23.874879 10497 raft_consensus.cc:3060] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:23.838949 10436 consensus_queue.cc:237] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:23.921026  5117 pending_rounds.cc:107] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 12:15:23.944115  5117 raft_consensus.cc:2889] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:23.906392 10416 raft_consensus.cc:493] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:23.947124  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:23.947969  5836 raft_consensus.cc:2393] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 14: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:15:23.949501  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:23.964959  5088 leader_election.cc:304] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:15:23.970928  5829 raft_consensus.cc:2468] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 10.
I20260709 12:15:23.946636 10084 raft_consensus.cc:493] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:23.989846  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:23.948453 10072 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:23.974033  5088 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:23.915311 10238 raft_consensus.cc:515] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:24.075462  5089 leader_election.cc:304] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:24.076231 10506 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:24.076800 10506 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:23.976339 10439 raft_consensus.cc:2804] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:24.088140  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:24.094422  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:24.096442  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:24.097208  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:24.115175  5196 raft_consensus.cc:2410] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:15:24.100435  5238 leader_election.cc:304] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:24.102337  5089 leader_election.cc:304] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:24.117436  5089 leader_election.cc:304] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
W20260709 12:15:24.103307  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 129348us
I20260709 12:15:24.106015  5835 raft_consensus.cc:2468] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 14.
I20260709 12:15:24.123966  5088 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:24.119304  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:24.134531  5118 raft_consensus.cc:2410] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:15:23.967760 10416 raft_consensus.cc:515] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:24.141774  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 47791.7us
W20260709 12:15:24.150884  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 107528us
I20260709 12:15:24.152525  5088 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:24.106801 10342 raft_consensus.cc:2749] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:24.046449 10084 raft_consensus.cc:515] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:24.107817 10512 raft_consensus.cc:2749] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:24.138583 10431 raft_consensus.cc:2749] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:24.201783  5838 raft_consensus.cc:2468] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 14.
I20260709 12:15:24.120831 10439 raft_consensus.cc:697] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:24.208209 10238 leader_election.cc:290] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:24.074149 10072 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:24.098985 10325 consensus_queue.cc:1059] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
W20260709 12:15:24.280208  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 129761us
I20260709 12:15:24.213841 10449 raft_consensus.cc:2749] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:15:24.289194  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 142948us
W20260709 12:15:24.290020  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 189668us
I20260709 12:15:24.299491  5804 leader_election.cc:304] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:15:24.304461  5238 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:15:24.305141  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 187811us
I20260709 12:15:24.306666  5089 leader_election.cc:304] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:24.276711 10342 raft_consensus.cc:2804] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:24.278467 10000 raft_consensus.cc:2749] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:15:24.308454  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 221929us
I20260709 12:15:24.309412  5089 leader_election.cc:304] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:24.313812  5240 leader_election.cc:304] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:24.325412  5089 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:24.334465  5089 leader_election.cc:304] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:24.336251  5089 leader_election.cc:304] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:24.303066 10303 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 17 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:15:24.356580 10525 log.cc:927] Time spent T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:15:24.357692 10513 raft_consensus.cc:2804] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:24.358228 10513 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:24.358566 10513 raft_consensus.cc:3060] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:24.364055 10535 consensus_queue.cc:1048] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:15:24.369880 10238 raft_consensus.cc:2804] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:24.370417 10238 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:24.370810 10238 raft_consensus.cc:3060] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:24.376577 10271 raft_consensus.cc:2749] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:24.378199 10488 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:24.314688 10490 raft_consensus.cc:2749] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:24.379207 10490 raft_consensus.cc:2749] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:24.380007 10490 raft_consensus.cc:2749] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:24.314894 10342 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:24.386212 10342 raft_consensus.cc:3060] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:24.398336 10431 raft_consensus.cc:2749] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:24.401422 10072 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:24.402678  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:24.312759 10519 consensus_queue.cc:1048] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.431s
W20260709 12:15:24.409909 10517 log.cc:927] Time spent T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.447s	user 0.001s	sys 0.000s
I20260709 12:15:24.413779 10093 leader_election.cc:290] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:15:24.414809 10450 consensus_meta.cc:287] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 1.278s	user 0.006s	sys 0.006s
W20260709 12:15:24.417016 10434 consensus_meta.cc:287] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.751s	user 0.008s	sys 0.000s
W20260709 12:15:24.419052 10447 consensus_meta.cc:287] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.686s	user 0.008s	sys 0.000s
I20260709 12:15:24.420468  5116 raft_consensus.cc:1275] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:15:24.421455 10506 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:24.421805  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:24.448041  5121 raft_consensus.cc:2468] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 14.
I20260709 12:15:24.422375 10416 leader_election.cc:290] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:24.424328 10084 leader_election.cc:290] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:24.441254 10307 raft_consensus.cc:493] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:24.391687 10439 consensus_queue.cc:237] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:24.433053  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:24.380607 10490 raft_consensus.cc:2749] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:15:24.392614  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 51953.8us
W20260709 12:15:24.441617  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 289123us
I20260709 12:15:24.424798 10524 raft_consensus.cc:2804] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:24.490140 10506 raft_consensus.cc:493] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:24.478525  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 174146us
I20260709 12:15:24.490796 10506 raft_consensus.cc:515] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:24.491546  5238 leader_election.cc:304] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:15:24.484546 10307 raft_consensus.cc:515] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:24.492619  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 194272us
I20260709 12:15:24.447901 10434 raft_consensus.cc:515] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:24.494879 10538 consensus_queue.cc:1048] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 12:15:24.449229 10447 raft_consensus.cc:515] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:24.500252  5240 leader_election.cc:304] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:24.506825  5163 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:15:24.511524  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 357077us
I20260709 12:15:24.487380 10524 raft_consensus.cc:493] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:24.512434  5166 leader_election.cc:304] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:24.502964 10307 leader_election.cc:290] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:15:24.518826  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 182652us
I20260709 12:15:24.519652  5166 leader_election.cc:304] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:24.519836  5804 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:24.521322  5089 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:24.524855  5089 leader_election.cc:304] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:24.516136 10535 raft_consensus.cc:2764] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 12:15:24.519233 10524 raft_consensus.cc:3060] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:24.543766  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:24.515578 10325 raft_consensus.cc:2804] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:24.560766  5125 raft_consensus.cc:2468] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 14.
I20260709 12:15:24.565891  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:24.558611  5240 leader_election.cc:304] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:15:24.523924 10303 raft_consensus.cc:2749] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:15:24.545536 10497 consensus_meta.cc:287] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821: Time spent flushing consensus metadata: real 0.572s	user 0.000s	sys 0.010s
I20260709 12:15:24.527655 10490 raft_consensus.cc:2749] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:15:24.574754  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:24.574915  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:15:24.576035  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 44976.8us
I20260709 12:15:24.582615  5804 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:15:24.543586 10532 raft_consensus.cc:2749] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:24.544044 10084 raft_consensus.cc:2749] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:24.581861  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:24.559398 10243 raft_consensus.cc:2749] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:24.587697  5125 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 15.
I20260709 12:15:24.588706  5166 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:24.589090  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:24.591754  5166 leader_election.cc:304] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:24.592581 10451 raft_consensus.cc:2804] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:24.593039 10451 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:24.593124  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:24.593516 10451 raft_consensus.cc:3060] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:24.593809  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:24.594565  5272 raft_consensus.cc:2393] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 14: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:15:24.594970 10548 raft_consensus.cc:2804] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:24.595463 10548 raft_consensus.cc:493] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:24.595832 10548 raft_consensus.cc:3060] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:24.593221 10519 consensus_queue.cc:1048] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 12:15:24.598851  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:24.562465 10325 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:24.518723 10238 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:24.574455 10126 consensus_queue.cc:1048] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:15:24.615219 10548 raft_consensus.cc:515] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:24.610962 10537 raft_consensus.cc:493] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:24.565737 10433 raft_consensus.cc:493] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:24.575526 10488 raft_consensus.cc:493] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:24.605016 10271 raft_consensus.cc:2804] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:24.608841 10325 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:24.619985 10401 raft_consensus.cc:3060] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:24.656493  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:24.627610 10453 raft_consensus.cc:2804] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:24.659981  5116 raft_consensus.cc:2368] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 15. Current term is 16.
I20260709 12:15:24.661898  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:24.663110  5836 raft_consensus.cc:3060] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:24.675037  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:24.586050 10497 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:24.681679  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:24.685819  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:24.688069  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:24.686573  5273 raft_consensus.cc:2468] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 12.
I20260709 12:15:24.682518  5124 raft_consensus.cc:2468] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 13.
I20260709 12:15:24.692263  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:24.692999  5832 raft_consensus.cc:2468] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 12.
I20260709 12:15:24.639972 10271 raft_consensus.cc:493] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:24.693588  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:24.741613 10271 raft_consensus.cc:3060] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:24.637306 10537 raft_consensus.cc:515] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:24.744266 10537 leader_election.cc:290] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:24.701562  5116 raft_consensus.cc:1275] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:15:24.675520 10453 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:24.752265 10453 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:24.704234  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:24.705081  5804 leader_election.cc:400] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: Vote denied by peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443) with higher term. Message: Invalid argument: T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 15. Current term is 16.
I20260709 12:15:24.755321  5804 leader_election.cc:403] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:24.730049 10447 leader_election.cc:290] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:24.732990 10238 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:24.681569 10488 raft_consensus.cc:515] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:24.640615 10433 raft_consensus.cc:515] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:24.768667  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 63735.5us
I20260709 12:15:24.768767  5120 raft_consensus.cc:2368] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 12. Current term is 13.
I20260709 12:15:24.771049  5089 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:24.771968  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:24.752290 10434 leader_election.cc:290] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 16 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:24.778266 10541 raft_consensus.cc:3060] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:15:24.778805  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:24.777232 10513 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:24.780659 10235 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:24.778260 10327 raft_consensus.cc:493] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:24.783090 10527 raft_consensus.cc:493] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:24.783546 10543 consensus_queue.cc:1048] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:15:24.784825  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:24.785569 10271 raft_consensus.cc:515] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:15:24.798014  5165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:24.810499 10541 raft_consensus.cc:2749] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443) with higher term. Message: Invalid argument: T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 15. Current term is 16.
I20260709 12:15:24.761595 10072 raft_consensus.cc:493] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:24.826332  5116 raft_consensus.cc:2468] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 14.
I20260709 12:15:24.813118  5273 raft_consensus.cc:2468] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 12.
I20260709 12:15:24.825970  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:24.826977 10072 raft_consensus.cc:515] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:24.831528 10072 leader_election.cc:290] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:24.834470 10497 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:24.811518 10552 raft_consensus.cc:2749] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:24.837977 10433 leader_election.cc:290] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:24.842461 10342 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:24.844822 10342 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 15 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:24.846755 10488 leader_election.cc:290] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:24.811403 10327 raft_consensus.cc:515] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:24.849881  5197 raft_consensus.cc:1275] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 13. (term mismatch)
I20260709 12:15:24.850281  5197 pending_rounds.cc:85] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808: Aborting all ops after (but not including) 12
I20260709 12:15:24.850497  5197 pending_rounds.cc:107] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808: Aborting uncommitted NO_OP operation due to leader change: 13.13
I20260709 12:15:24.850724  5197 raft_consensus.cc:2889] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:24.851243 10327 leader_election.cc:290] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:24.795809 10434 raft_consensus.cc:2749] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:24.855728 10524 raft_consensus.cc:515] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:24.814703 10436 raft_consensus.cc:493] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:24.863147  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:24.863677 10436 raft_consensus.cc:515] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:24.864348  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:24.865878 10436 leader_election.cc:290] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:24.813017 10527 raft_consensus.cc:515] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:24.868676 10527 leader_election.cc:290] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:24.874915 10451 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:24.877877  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:24.878563  5193 raft_consensus.cc:3060] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:15:24.882541  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:24.885138 10451 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:24.894261 10506 leader_election.cc:290] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:24.885607  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:24.885959  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:24.899900  5119 raft_consensus.cc:2368] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 14. Current term is 15.
I20260709 12:15:24.901258  5197 raft_consensus.cc:1275] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:15:24.903599 10453 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:24.906586  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:24.907881 10325 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:24.909679  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:24.924654  5163 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:24.926436  5197 raft_consensus.cc:2393] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 17: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:15:24.911116  5836 raft_consensus.cc:2468] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 17.
I20260709 12:15:24.913009  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:24.913326  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:24.916652  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:24.918816  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:24.930845  5193 raft_consensus.cc:2468] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 13.
I20260709 12:15:24.938318  5829 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 9.
I20260709 12:15:24.939713  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:24.940423  5195 raft_consensus.cc:2468] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 9.
I20260709 12:15:24.940987  5265 raft_consensus.cc:2393] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 15: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:15:24.941641  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:24.939994  5125 raft_consensus.cc:2368] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 9. Current term is 10.
I20260709 12:15:24.944736  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:24.939729  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:24.945674  5198 raft_consensus.cc:3060] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:24.946084  5270 raft_consensus.cc:2393] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 15: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:15:24.947371  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:24.947849  5837 raft_consensus.cc:2393] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 17: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:15:24.947988  5834 raft_consensus.cc:1275] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:15:24.951344  5238 leader_election.cc:304] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:15:24.953317  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:24.954087  5829 raft_consensus.cc:2393] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 14: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:15:24.957643  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:24.957581  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:24.961442  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:24.953110  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:24.962852  5271 raft_consensus.cc:3060] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:24.966884  5833 raft_consensus.cc:2393] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 16: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:15:24.967131  5194 raft_consensus.cc:2393] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 16: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:15:24.970590  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:24.971130  5274 raft_consensus.cc:3060] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:24.964735  5088 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:24.975960  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:24.981760  5268 raft_consensus.cc:1275] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:15:24.987064  5164 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:15:24.970394 10238 raft_consensus.cc:2804] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:24.991277  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:24.968366 10401 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:24.968555 10451 raft_consensus.cc:2764] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:15:24.992558  5199 raft_consensus.cc:1275] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:15:25.000651  5117 raft_consensus.cc:1240] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:24.979276 10434 raft_consensus.cc:2804] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:25.012181  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:25.012835  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:25.015739  5198 raft_consensus.cc:2468] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 15.
I20260709 12:15:24.973654 10488 consensus_queue.cc:1048] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:15:24.999622 10532 raft_consensus.cc:2804] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:15:24.998878 10455 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.953s	user 0.015s	sys 0.019s
I20260709 12:15:25.023334  5274 raft_consensus.cc:2468] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 13.
W20260709 12:15:25.024784  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 61258.5us
I20260709 12:15:24.999389 10238 raft_consensus.cc:493] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:25.028988  5237 leader_election.cc:304] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:15:25.036067 10564 log.cc:927] Time spent T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:15:25.039464 10271 leader_election.cc:290] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:25.031424  5088 leader_election.cc:304] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:25.046449 10513 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:25.021907 10434 raft_consensus.cc:697] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:25.049639 10434 consensus_queue.cc:237] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:25.011303 10401 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:25.060379  5195 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 9.
W20260709 12:15:25.027225 10455 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.984s	user 0.016s	sys 0.019s
I20260709 12:15:25.062060 10126 raft_consensus.cc:2804] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:25.061439  5271 raft_consensus.cc:2468] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 16.
W20260709 12:15:25.033154 10510 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.072s	user 0.006s	sys 0.048s
I20260709 12:15:25.034825 10238 raft_consensus.cc:3060] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:25.032306 10524 leader_election.cc:290] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:25.055822 10532 raft_consensus.cc:697] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 17 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:25.076611  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:25.077915  5120 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:25.069206 10126 raft_consensus.cc:493] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:25.074244 10510 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.113s	user 0.006s	sys 0.049s
I20260709 12:15:25.073427 10189 raft_consensus.cc:493] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:25.068835 10325 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 16 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:25.083905 10189 raft_consensus.cc:515] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:25.082121 10126 raft_consensus.cc:3060] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:25.091050 10548 leader_election.cc:290] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:25.084858  5836 raft_consensus.cc:1240] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 11. Current term is 12. Ops: []
I20260709 12:15:25.164255  5163 leader_election.cc:304] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:25.164816  5120 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 16.
I20260709 12:15:25.097817 10532 consensus_queue.cc:237] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:25.170169  5123 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40386 (request call id 2446) took 1522 ms (client timeout 1738 ms). Trace:
W20260709 12:15:25.171227  5123 rpcz_store.cc:269] 0709 12:15:23.639992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:23.640281 (+   289us) service_pool.cc:224] Handling call
0709 12:15:25.085982 (+1445701us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b540038c7d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:15:25.162570 (+ 76588us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3260764928}
W20260709 12:15:25.175418  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 90165.7us
I20260709 12:15:25.179245  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:25.179700  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:25.180227  5273 raft_consensus.cc:2393] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 14: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:15:25.179347  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:25.181031  5269 raft_consensus.cc:3060] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:25.198292 10506 raft_consensus.cc:493] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:25.199059 10506 raft_consensus.cc:515] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:25.202868 10506 leader_election.cc:290] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:25.203687  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:25.182662 10072 raft_consensus.cc:2804] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:25.215305 10072 raft_consensus.cc:493] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting leader election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:25.215813 10072 raft_consensus.cc:3060] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:25.217005 10453 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 16 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:25.217693  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:25.212870  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:25.235631 10238 raft_consensus.cc:515] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:25.239586  5269 raft_consensus.cc:2468] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 16.
I20260709 12:15:25.257019  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:25.266531 10235 raft_consensus.cc:493] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:25.269023 10401 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:15:25.289745 10579 log.cc:927] Time spent T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 12:15:25.294189 10235 raft_consensus.cc:515] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:25.313820  5166 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:25.318511  5166 leader_election.cc:304] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:15:25.319453  5835 raft_consensus.cc:1275] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:15:25.319792  5166 leader_election.cc:304] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:15:25.320752  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:25.321297  5835 raft_consensus.cc:3060] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:25.322621  5166 leader_election.cc:304] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:25.323357  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:25.325124  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:25.326406 10548 raft_consensus.cc:2749] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:25.329352  5166 leader_election.cc:400] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 election: Vote denied by peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443) with higher term. Message: Invalid argument: T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 14. Current term is 15.
I20260709 12:15:25.329710  5166 leader_election.cc:403] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:15:25.320443 10327 raft_consensus.cc:2749] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:25.331257  5166 leader_election.cc:400] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Vote denied by peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443) with higher term. Message: Invalid argument: T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 12. Current term is 13.
I20260709 12:15:25.320901 10471 raft_consensus.cc:2804] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:25.332131 10471 raft_consensus.cc:493] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:25.332494 10471 raft_consensus.cc:3060] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:25.323061 10217 raft_consensus.cc:2804] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:25.335832 10217 raft_consensus.cc:697] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:25.336798 10217 consensus_queue.cc:237] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:25.337172 10189 leader_election.cc:290] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:25.339354 10526 raft_consensus.cc:2749] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443) with higher term. Message: Invalid argument: T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 14. Current term is 15.
I20260709 12:15:25.342654  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:25.343175  5836 raft_consensus.cc:3060] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:25.332558 10235 leader_election.cc:290] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:15:25.347584 10568 log.cc:927] Time spent T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.307s	user 0.000s	sys 0.004s
I20260709 12:15:25.356307  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:25.349239  5835 raft_consensus.cc:2468] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 15.
I20260709 12:15:25.356685  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:25.362653  5273 raft_consensus.cc:2393] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 16: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:15:25.355155  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:25.399842  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:25.416504  5836 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 10.
I20260709 12:15:25.430238 10524 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:25.454468 10524 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:25.430892  5801 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:25.447726  5831 raft_consensus.cc:2468] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 16.
I20260709 12:15:25.409055 10126 raft_consensus.cc:515] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:25.462402  5237 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:25.467783  5801 leader_election.cc:304] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:25.352558 10072 raft_consensus.cc:515] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:25.456269 10402 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:25.475577 10509 raft_consensus.cc:2749] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:25.468673 10486 raft_consensus.cc:2804] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:15:25.476987 10486 raft_consensus.cc:697] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 9 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:25.477861 10486 consensus_queue.cc:237] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:25.479262  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:25.480170  5199 raft_consensus.cc:2393] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 16: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:15:25.464677  9985 raft_consensus.cc:2749] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:25.482131 10402 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } attrs { replace: true } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:25.484390 10571 log.cc:927] Time spent T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.446s	user 0.000s	sys 0.006s
I20260709 12:15:25.486496 10402 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:25.492826  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:25.497025 10535 raft_consensus.cc:493] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:25.497414 10488 raft_consensus.cc:493] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:25.504493  5163 leader_election.cc:304] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:25.526669  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:25.526631 10488 raft_consensus.cc:515] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:25.527406  5163 leader_election.cc:304] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:25.528908  5163 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:25.505524 10524 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:15:25.506052 10570 log.cc:927] Time spent T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.465s	user 0.007s	sys 0.000s
I20260709 12:15:25.507565  5240 leader_election.cc:400] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 election: Vote denied by peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443) with higher term. Message: Invalid argument: T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 9. Current term is 10.
I20260709 12:15:25.509176  5238 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:25.509848  5194 raft_consensus.cc:1240] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:25.509742 10072 leader_election.cc:290] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:25.512907 10238 leader_election.cc:290] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:25.513584  5267 raft_consensus.cc:1240] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 12:15:25.518919  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:25.512192  9941 raft_consensus.cc:493] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:25.533241  5238 leader_election.cc:304] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:25.531733 10402 raft_consensus.cc:2749] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:25.540822  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20ba878da4e3492fbdf2f90c6bb202c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:25.545327  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:25.546283  5831 raft_consensus.cc:2393] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 16: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:15:25.534654 10281 raft_consensus.cc:2749] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:15:25.532788 10533 raft_consensus.cc:2749] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:15:25.561906  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 94168.4us
I20260709 12:15:25.563078  5801 leader_election.cc:304] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:25.563419  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:25.564102  5834 raft_consensus.cc:2468] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 12.
I20260709 12:15:25.568747  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:25.548480 10217 raft_consensus.cc:2804] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:15:25.575317  5238 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:25.530015 10535 raft_consensus.cc:515] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:25.553280  9941 raft_consensus.cc:515] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:15:25.586055  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 554702us
I20260709 12:15:25.586633 10513 raft_consensus.cc:2749] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:25.588050 10471 raft_consensus.cc:515] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:25.583310  5801 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:25.600483  5088 leader_election.cc:304] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:25.556895 10271 raft_consensus.cc:2749] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:25.603881  5088 leader_election.cc:304] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:15:25.605983  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:25.606688  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:25.608449 10533 raft_consensus.cc:493] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:25.609169  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:25.610412  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:25.588889  9985 consensus_queue.cc:1048] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 12:15:25.589339 10453 raft_consensus.cc:493] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:25.612914 10453 raft_consensus.cc:515] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:25.615120 10453 leader_election.cc:290] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:25.616883  9941 leader_election.cc:290] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:25.609017 10533 raft_consensus.cc:515] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:25.619102  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
W20260709 12:15:25.619400  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 44202.7us
I20260709 12:15:25.624107  5123 raft_consensus.cc:2393] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 16: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:15:25.581051 10243 raft_consensus.cc:2749] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:25.627070  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:25.631709  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:25.635186  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:25.636762  5199 raft_consensus.cc:1240] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:15:25.636976  5088 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:25.638476  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:25.639591  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:25.640036  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:25.599220 10217 raft_consensus.cc:697] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:25.626459 10281 raft_consensus.cc:2749] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:25.626459 10395 raft_consensus.cc:2749] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:15:25.645040  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:25.604848 10512 raft_consensus.cc:493] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:25.682528 10512 raft_consensus.cc:515] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:25.589958 10501 consensus_queue.cc:1059] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 12:15:25.673359  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:25.676107  5804 leader_election.cc:304] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:25.622148 10540 consensus_queue.cc:1048] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 12:15:25.685985  5191 raft_consensus.cc:3060] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:25.687019  5804 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:25.590191 10238 consensus_queue.cc:1048] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 12:15:25.648334 10126 leader_election.cc:290] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:25.689548 10541 raft_consensus.cc:2749] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:15:25.690757 10395 raft_consensus.cc:2749] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:25.690446 10217 consensus_queue.cc:237] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:25.632856 10539 raft_consensus.cc:2804] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:15:25.694415 10539 raft_consensus.cc:697] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:25.695348 10539 consensus_queue.cc:237] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:25.640841 10439 raft_consensus.cc:493] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:25.618754 10552 raft_consensus.cc:2749] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:25.697173 10512 leader_election.cc:290] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:25.677062 10471 leader_election.cc:290] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:25.698217  5801 leader_election.cc:304] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:25.697300 10439 raft_consensus.cc:515] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:25.700232 10524 raft_consensus.cc:2749] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:25.701077 10439 leader_election.cc:290] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:25.705554  5191 raft_consensus.cc:2468] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 10.
I20260709 12:15:25.705791  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:25.713685 10434 raft_consensus.cc:2804] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:25.714474 10434 raft_consensus.cc:697] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:25.715461 10434 consensus_queue.cc:237] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:25.652495 10513 consensus_queue.cc:1048] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 12:15:25.729125  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:25.736460  5274 raft_consensus.cc:1240] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:25.738446  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:25.739256  5193 raft_consensus.cc:2468] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 12.
W20260709 12:15:25.740131  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 177534us
I20260709 12:15:25.729499  5237 leader_election.cc:304] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:25.746316  5237 leader_election.cc:304] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:25.755103  5271 raft_consensus.cc:1240] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:25.760462  5163 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:25.764650  5240 leader_election.cc:304] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:25.686069 10501 raft_consensus.cc:3055] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:25.767844  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:25.767904  5238 leader_election.cc:304] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:25.769255  5163 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:25.770303  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:25.741578 10533 leader_election.cc:290] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:25.778223  5089 leader_election.cc:304] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:25.757445 10538 raft_consensus.cc:2804] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:25.781236  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:25.782138  5124 raft_consensus.cc:2410] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:15:25.782688  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:15:25.782699  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 93436.6us
I20260709 12:15:25.765967  9941 raft_consensus.cc:2804] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:25.785724  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:25.786015  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:25.787149  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:25.770396 10401 raft_consensus.cc:2749] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:25.771737 10501 raft_consensus.cc:740] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:25.831377  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:25.758594 10271 consensus_queue.cc:1059] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:15:25.779207 10534 raft_consensus.cc:2749] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:15:25.779520 10324 raft_consensus.cc:2749] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:25.844488  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:25.834798  5831 raft_consensus.cc:3060] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:25.819609  9941 raft_consensus.cc:493] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:25.821688 10439 raft_consensus.cc:2749] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:15:25.866983  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 220989us
I20260709 12:15:25.869308  5831 raft_consensus.cc:1275] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:15:25.873304  5088 leader_election.cc:304] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:25.876052  9985 consensus_queue.cc:1059] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 12:15:25.889310  9985 raft_consensus.cc:3055] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:25.889737  9985 raft_consensus.cc:740] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:15:25.890604  9985 consensus_queue.cc:260] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:25.892041  9985 raft_consensus.cc:3060] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:25.870687  9941 raft_consensus.cc:3060] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:25.898901 10436 raft_consensus.cc:3060] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:25.907315 10436 raft_consensus.cc:2749] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:25.910202  9941 raft_consensus.cc:515] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:25.912637  9941 leader_election.cc:290] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:15:25.916934  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 64139.7us
I20260709 12:15:25.917629  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:25.917161  5192 raft_consensus.cc:1275] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:15:25.929947  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:25.841806 10472 raft_consensus.cc:2749] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:15:25.913635 10487 raft_consensus.cc:3055] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:15:25.829005 10461 consensus_queue.cc:1048] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 12:15:25.941776  5240 leader_election.cc:304] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:25.942320  5193 raft_consensus.cc:1240] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
W20260709 12:15:25.915936 10571 log.cc:927] Time spent T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 12:15:25.946934  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 179114us
I20260709 12:15:25.972568  5238 leader_election.cc:304] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:25.970155  5089 leader_election.cc:304] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:25.978550  5089 leader_election.cc:304] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:25.981518 10342 raft_consensus.cc:2749] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:25.941656 10487 raft_consensus.cc:740] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:25.988246  5238 leader_election.cc:304] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:25.985776 10271 raft_consensus.cc:2804] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:25.982007 10472 raft_consensus.cc:2749] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:25.981556 10513 raft_consensus.cc:2749] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:15:26.047683  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 59530.1us
I20260709 12:15:25.985721 10540 consensus_queue.cc:1048] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 12:15:25.976703 10436 consensus_queue.cc:1048] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
W20260709 12:15:26.054366  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 73316.5us
I20260709 12:15:26.042495 10271 raft_consensus.cc:493] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:26.058183  5163 leader_election.cc:304] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:26.055874  5088 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:15:26.066912 10592 log.cc:927] Time spent T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.223s	user 0.000s	sys 0.001s
I20260709 12:15:25.986457 10595 consensus_queue.cc:1059] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 12:15:26.066926 10400 raft_consensus.cc:2749] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:26.075582  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:26.059655 10541 raft_consensus.cc:493] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:26.092221  5267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34672 (request call id 2576) took 1493 ms. Trace:
I20260709 12:15:25.940722 10501 consensus_queue.cc:260] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:26.119825  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:26.174182  5836 raft_consensus.cc:1275] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 17 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:15:26.125195  5272 raft_consensus.cc:1275] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 17 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:15:26.195864  5192 raft_consensus.cc:3060] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:26.194901  5267 rpcz_store.cc:276] 0709 12:15:24.598456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:24.600311 (+  1855us) service_pool.cc:224] Handling call
0709 12:15:25.513308 (+912997us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:15:25.548898 (+ 35590us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:26.091993 (+543095us) spinlock_profiling.cc:243] Waited 913 ms on lock 0x7b5400171e50. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc28ad 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:15:26.092156 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2098899200}
I20260709 12:15:26.065677 10271 raft_consensus.cc:3060] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:26.065905 10538 raft_consensus.cc:697] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 10 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:26.072256 10603 raft_consensus.cc:2749] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:26.076680 10497 raft_consensus.cc:2749] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:15:26.121304 10436 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:26.173174  9941 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:26.064141 10533 consensus_queue.cc:1059] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.192s
I20260709 12:15:26.258064  5192 raft_consensus.cc:2468] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 13.
I20260709 12:15:26.293009  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:26.255167 10434 consensus_queue.cc:1059] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:15:26.205060 10541 raft_consensus.cc:515] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:26.271148  9941 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:15:26.311120 10606 log.cc:927] Time spent T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:15:26.321126  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:26.322399  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6867413d1d4b49bcd267c1e134d12e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:26.323194  5124 raft_consensus.cc:1275] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:15:26.310633 10611 raft_consensus.cc:493] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:26.266114 10436 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:26.092532 10487 consensus_queue.cc:260] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:26.343030  5270 raft_consensus.cc:1275] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:15:26.345170  5166 leader_election.cc:304] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:26.353914  9941 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:15:26.359333 10608 log.cc:927] Time spent T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 12:15:26.363567 10607 log.cc:927] Time spent T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.234s	user 0.003s	sys 0.000s
W20260709 12:15:26.365676 10605 log.cc:927] Time spent T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 12:15:26.342370 10538 consensus_queue.cc:237] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:26.378090  5267 raft_consensus.cc:1240] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:26.382225 10533 consensus_queue.cc:1048] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:15:26.382572  5166 leader_election.cc:304] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:26.383721 10506 raft_consensus.cc:2749] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:26.384097 10533 consensus_queue.cc:1048] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:15:26.385326 10506 raft_consensus.cc:2749] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:15:26.386502 10541 leader_election.cc:290] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:26.330470 10611 raft_consensus.cc:515] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:26.360191 10271 raft_consensus.cc:515] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:26.398296 10271 leader_election.cc:290] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:26.393183 10454 consensus_queue.cc:1059] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:15:26.405367 10460 consensus_queue.cc:1048] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:15:26.394600 10533 consensus_queue.cc:1048] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:15:26.405972 10327 raft_consensus.cc:3055] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:15:26.406406 10327 raft_consensus.cc:740] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:26.395905 10436 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:26.407192 10327 consensus_queue.cc:260] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:26.408617 10327 raft_consensus.cc:3060] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:26.410368 10535 leader_election.cc:290] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:26.391974 10611 leader_election.cc:290] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:26.400833  5269 raft_consensus.cc:1240] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:15:26.401021 10526 raft_consensus.cc:3055] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:26.403249  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:26.415450  5119 raft_consensus.cc:1275] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:15:26.400271  5834 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8"
dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
mode: GRACEFUL
new_leader_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:47004
I20260709 12:15:26.417742  5834 raft_consensus.cc:606] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Received request to transfer leadership to TS 9e794b72ed7640219f90ec4232363929
I20260709 12:15:26.418128  5834 raft_consensus.cc:614] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:26.421446 10611 consensus_queue.cc:1059] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:15:26.422017  5838 raft_consensus.cc:1240] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:26.422423 10611 raft_consensus.cc:3055] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:26.422808 10611 raft_consensus.cc:740] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:26.423836  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:26.423688 10611 consensus_queue.cc:260] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:26.424046  5192 raft_consensus.cc:1240] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:15:26.424981 10611 raft_consensus.cc:3060] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:26.422312  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:26.428553  5194 raft_consensus.cc:1275] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:15:26.430968  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:26.431445  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:26.457345 10455 raft_consensus.cc:493] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:26.461233 10455 raft_consensus.cc:515] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:26.463505 10455 leader_election.cc:290] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:26.416605 10526 raft_consensus.cc:740] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:26.465517 10526 consensus_queue.cc:260] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:26.443413 10533 consensus_queue.cc:1048] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 12:15:26.505841  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:26.500123 10614 raft_consensus.cc:493] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:26.516371  5088 leader_election.cc:304] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:26.525276 10342 raft_consensus.cc:2749] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:26.525924 10461 consensus_queue.cc:1059] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:15:26.526928 10342 raft_consensus.cc:3055] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:26.527321 10342 raft_consensus.cc:740] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:26.528170 10342 consensus_queue.cc:260] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:26.529575 10342 raft_consensus.cc:3060] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:26.519876 10614 raft_consensus.cc:515] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:26.524555  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:26.554742  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:26.537181 10614 leader_election.cc:290] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:26.520036 10595 consensus_queue.cc:1048] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 12:15:26.521845 10610 raft_consensus.cc:493] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:26.579664 10610 raft_consensus.cc:515] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:26.582204 10610 leader_election.cc:290] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:26.564363 10617 consensus_queue.cc:1059] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:15:26.583454 10617 raft_consensus.cc:3055] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:26.583845 10617 raft_consensus.cc:740] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:26.584676 10617 consensus_queue.cc:260] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:26.565155  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:26.566437  5237 leader_election.cc:304] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:26.589356  5194 raft_consensus.cc:1275] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:15:26.590870  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:26.596814  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:26.607079 10488 leader_election.cc:290] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:26.586025 10617 raft_consensus.cc:3060] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:26.607713 10205 consensus_queue.cc:1048] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:15:26.609133  5088 leader_election.cc:304] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:26.610273 10595 raft_consensus.cc:2749] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:26.627071  5089 leader_election.cc:304] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:26.625989  5238 leader_election.cc:304] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:26.641201  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:26.593662 10603 raft_consensus.cc:2804] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:26.662604  5834 raft_consensus.cc:1275] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:15:26.645033 10205 raft_consensus.cc:2749] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:15:26.647179 10614 raft_consensus.cc:2749] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:26.651093 10342 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
W20260709 12:15:26.698805  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 417154us
I20260709 12:15:26.713912  5199 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6"
dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
mode: GRACEFUL
new_leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
 from {username='slave'} at 127.0.0.1:53902
I20260709 12:15:26.714614  5199 raft_consensus.cc:606] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Received request to transfer leadership to TS ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:26.714955  5199 raft_consensus.cc:614] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:26.670089 10603 raft_consensus.cc:697] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 13 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:26.734839  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:26.735728  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:26.674191 10535 consensus_queue.cc:1059] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:15:26.716367 10548 raft_consensus.cc:493] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:26.756263  5089 leader_election.cc:304] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:26.789574  5196 raft_consensus.cc:1240] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:15:26.712076 10342 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:26.791000 10548 raft_consensus.cc:515] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:26.796331 10548 leader_election.cc:290] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:26.801590  5804 leader_election.cc:304] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:15:26.803607  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 47443.8us
I20260709 12:15:26.803747  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecedf48dca8a4a35adc39d76a9a93513" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:26.803376  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:26.809096  5117 raft_consensus.cc:2410] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:15:26.809211  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:26.734107 10533 consensus_queue.cc:1048] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 12:15:26.790730 10455 raft_consensus.cc:493] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:26.858213  5271 raft_consensus.cc:1275] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:15:26.808609 10611 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:26.820982 10271 raft_consensus.cc:3055] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:26.825810 10436 raft_consensus.cc:2749] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:26.827026 10524 raft_consensus.cc:2749] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:15:26.864089  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 46592.9us
W20260709 12:15:26.853463 10601 log.cc:927] Time spent T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:15:26.875542  5240 leader_election.cc:304] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:26.894016  5837 raft_consensus.cc:1275] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:15:26.895289  5837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:26.842262 10461 consensus_queue.cc:1059] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:15:26.871821 10271 raft_consensus.cc:740] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:26.860726 10455 raft_consensus.cc:515] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:26.874114 10611 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:26.868177 10603 consensus_queue.cc:237] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:27.032145 10619 raft_consensus.cc:2749] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:15:27.076635 10327 consensus_meta.cc:287] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808: Time spent flushing consensus metadata: real 0.668s	user 0.009s	sys 0.005s
W20260709 12:15:27.094517 10621 log.cc:927] Time spent T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.239s	user 0.001s	sys 0.000s
I20260709 12:15:27.096185 10609 raft_consensus.cc:493] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:27.096870 10609 raft_consensus.cc:515] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:27.098886 10623 log.cc:927] Time spent T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 12:15:27.106215 10628 log.cc:927] Time spent T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:15:27.107545 10609 leader_election.cc:290] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:27.113992  5831 raft_consensus.cc:1240] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
W20260709 12:15:27.116374  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:27.138137 10342 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:27.139941 10501 raft_consensus.cc:3060] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:15:27.144565 10626 log.cc:927] Time spent T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 12:15:27.144961 10455 leader_election.cc:290] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:15:27.147598 10596 log.cc:927] Time spent T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.839s	user 0.009s	sys 0.013s
W20260709 12:15:27.131700 10634 log.cc:927] Time spent T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.184s	user 0.000s	sys 0.000s
I20260709 12:15:27.158489  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:27.158794  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:27.160589  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:27.155334 10436 raft_consensus.cc:493] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:27.147666 10611 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:27.170089 10526 raft_consensus.cc:3060] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:27.171555  5829 raft_consensus.cc:1275] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:15:27.172612  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:27.164474 10436 raft_consensus.cc:515] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:27.180056  5089 leader_election.cc:304] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:27.181208 10439 raft_consensus.cc:2749] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:27.182628 10439 consensus_queue.cc:1048] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:15:27.181213 10436 leader_election.cc:290] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:27.186233 10537 raft_consensus.cc:3055] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:15:27.186733 10537 raft_consensus.cc:740] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:27.187124 10439 consensus_queue.cc:1048] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:15:27.187624 10537 consensus_queue.cc:260] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:27.188822 10537 raft_consensus.cc:3060] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:27.190402  5265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34672 (request call id 2605) took 1068 ms. Trace:
I20260709 12:15:27.190788  5265 rpcz_store.cc:276] 0709 12:15:26.121703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:26.134658 (+ 12955us) service_pool.cc:224] Handling call
0709 12:15:26.202500 (+ 67842us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:15:26.335938 (+133438us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:15:26.350268 (+ 14330us) log.cc:844] Serialized 14 byte log entry
0709 12:15:26.722420 (+372152us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:15:26.722500 (+    80us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:15:26.722544 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:15:27.190166 (+467622us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b540036bfd4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:15:27.190213 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:15:27.190345 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72663,"prepare.queue_time_us":13112,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":19168,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":7848,"spinlock_wait_cycles":306398464,"thread_start_us":364710,"threads_started":1,"wal-append.queue_time_us":456212}
I20260709 12:15:27.192188  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:15:27.198973  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 323486us
W20260709 12:15:27.210094  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 348744us
I20260709 12:15:27.210423  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:27.219599  5192 raft_consensus.cc:1240] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:15:27.210426  5088 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:27.223062  5088 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:27.227497  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:27.235335  5193 raft_consensus.cc:1275] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:15:27.238011  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:27.239364  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:27.207589 10243 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.246580  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:27.248790  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:27.249531  5270 raft_consensus.cc:2468] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 8.
I20260709 12:15:27.237155 10593 raft_consensus.cc:493] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
W20260709 12:15:27.256491  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 55650.9us
W20260709 12:15:27.259840  5164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:27.259040  5240 leader_election.cc:304] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:27.258605  5088 leader_election.cc:304] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:27.240532 10461 raft_consensus.cc:2749] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:27.236559 10509 raft_consensus.cc:493] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:27.237296 10436 raft_consensus.cc:2749] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:27.254954 10653 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.296972 10653 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:27.298030 10497 raft_consensus.cc:493] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:27.259275 10331 consensus_queue.cc:1048] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:15:27.282580  9941 consensus_queue.cc:1059] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:15:27.289819 10654 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.291909 10487 raft_consensus.cc:3060] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:27.258141 10593 raft_consensus.cc:515] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:27.298842 10497 raft_consensus.cc:515] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:27.306381  5267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
mode: GRACEFUL
new_leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
 from {username='slave'} at 127.0.0.1:43644
I20260709 12:15:27.309267 10645 raft_consensus.cc:493] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:27.320072  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:27.321553  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:27.324479  5088 leader_election.cc:304] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
W20260709 12:15:27.317674  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 96626.9us
W20260709 12:15:27.326329  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 78015.6us
I20260709 12:15:27.328711  5164 leader_election.cc:304] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
W20260709 12:15:27.340941  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 81992.3us
I20260709 12:15:27.342309  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:27.346865  5193 raft_consensus.cc:1275] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:15:27.327116 10486 raft_consensus.cc:493] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:27.310889 10642 raft_consensus.cc:2749] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:27.302523 10454 consensus_queue.cc:1048] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 12:15:27.309893 10593 leader_election.cc:290] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:27.256115 10243 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:27.337069 10461 raft_consensus.cc:2749] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:27.299759 10653 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:27.338301 10439 raft_consensus.cc:493] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
W20260709 12:15:27.401583  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 60364.2us
W20260709 12:15:27.427253  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 85379.1us
I20260709 12:15:27.424526  5801 leader_election.cc:304] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:15:27.425832  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 119946us
I20260709 12:15:27.277328 10509 raft_consensus.cc:515] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:27.355109 10486 raft_consensus.cc:515] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:27.309993 10645 raft_consensus.cc:515] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:27.500938  5240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:27.404831 10451 raft_consensus.cc:2749] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:27.435444 10497 leader_election.cc:290] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:27.546324 10655 raft_consensus.cc:493] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:27.546999 10655 raft_consensus.cc:515] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:27.514567 10641 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:27.548971 10641 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:27.551378 10641 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:27.515893 10604 raft_consensus.cc:2749] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:15:27.468297 10510 raft_consensus.cc:2804] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:27.524236 10271 consensus_queue.cc:260] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:27.552824 10510 raft_consensus.cc:493] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:27.553296 10510 raft_consensus.cc:3060] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:27.553464 10271 raft_consensus.cc:3060] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:27.427304 10439 raft_consensus.cc:515] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:27.555560 10439 leader_election.cc:290] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:27.338840 10654 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:27.566702 10654 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:27.567451  5270 raft_consensus.cc:2468] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 13.
I20260709 12:15:27.574314  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:15:27.580092  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 252391us
I20260709 12:15:27.585775  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:27.590384  5088 leader_election.cc:304] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:27.591045  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:27.580861 10512 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:27.615589 10537 raft_consensus.cc:2749] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:27.589437 10488 raft_consensus.cc:493] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.628393 10453 raft_consensus.cc:493] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:27.647558 10324 raft_consensus.cc:493] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.639936 10524 raft_consensus.cc:493] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:27.681214  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 352576us
I20260709 12:15:27.650871 10661 raft_consensus.cc:493] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:27.640127 10512 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:27.695721  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:27.696465  5191 raft_consensus.cc:2468] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 13.
I20260709 12:15:27.698163  5801 leader_election.cc:304] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:27.650982 10488 raft_consensus.cc:515] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:27.702641  5239 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:27.711097  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:27.655540 10453 raft_consensus.cc:515] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:27.658083 10324 raft_consensus.cc:515] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:27.711956  5269 raft_consensus.cc:2468] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 12.
I20260709 12:15:27.665326 10524 raft_consensus.cc:515] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:27.691107 10661 raft_consensus.cc:515] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:27.702286 10591 raft_consensus.cc:2804] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:27.700865 10460 raft_consensus.cc:493] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:27.713308 10657 log.cc:927] Time spent T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.363s	user 0.004s	sys 0.000s
I20260709 12:15:27.720291  5088 leader_election.cc:304] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:15:27.738751 10509 leader_election.cc:290] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:15:27.741276  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 59215.6us
I20260709 12:15:27.748270  5117 raft_consensus.cc:1240] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 9. Current term is 10. Ops: []
I20260709 12:15:27.749745  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:27.750590  5272 raft_consensus.cc:2393] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 13: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:15:27.753966 10661 leader_election.cc:290] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:15:27.755442 10662 log.cc:927] Time spent T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 12:15:27.756912 10327 raft_consensus.cc:493] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.757567 10327 raft_consensus.cc:515] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:27.759887 10327 leader_election.cc:290] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:27.763150 10600 consensus_queue.cc:1048] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:15:27.764367  5120 raft_consensus.cc:1275] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 12:15:27.764758  5120 pending_rounds.cc:85] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting all ops after (but not including) 7
I20260709 12:15:27.764966  5120 pending_rounds.cc:107] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 12:15:27.765303  5120 raft_consensus.cc:2889] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:27.769191  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:27.770987  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:27.771049  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:27.772109  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34c97113147431584d6336e0d849164" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:27.775660  5199 raft_consensus.cc:2393] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 13: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:15:27.778041  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:27.783776  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:27.727944 10591 raft_consensus.cc:493] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:27.784488  5272 raft_consensus.cc:2468] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 12.
I20260709 12:15:27.737287 10618 raft_consensus.cc:2804] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:27.797921  5237 leader_election.cc:304] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:27.804896 10524 leader_election.cc:290] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:27.805549 10613 raft_consensus.cc:2749] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:27.806586 10620 consensus_queue.cc:1048] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:15:27.809104 10453 leader_election.cc:290] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:27.811025 10512 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:27.819540  5240 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:27.821406 10655 leader_election.cc:290] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:27.822520 10271 raft_consensus.cc:2749] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:27.787871 10645 leader_election.cc:290] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:27.802588  5163 leader_election.cc:304] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:27.828909  5117 raft_consensus.cc:1275] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 12:15:27.829442  5117 pending_rounds.cc:85] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting all ops after (but not including) 6
I20260709 12:15:27.829684  5117 pending_rounds.cc:107] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 12:15:27.829982  5117 raft_consensus.cc:2889] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:27.831427 10537 raft_consensus.cc:493] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.792331 10486 leader_election.cc:290] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:27.792800 10591 raft_consensus.cc:3060] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:27.834775 10537 raft_consensus.cc:515] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:27.735910 10460 raft_consensus.cc:515] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:27.797432 10618 raft_consensus.cc:493] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:27.839860 10618 raft_consensus.cc:3060] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:27.842089 10646 raft_consensus.cc:2804] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:27.842656 10646 raft_consensus.cc:493] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:27.842979 10646 raft_consensus.cc:3060] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:27.852816  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:27.853719  5125 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 10.
I20260709 12:15:27.854573  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:27.855175  5125 raft_consensus.cc:2468] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 13.
I20260709 12:15:27.855965  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:27.856760  5122 raft_consensus.cc:2393] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 9: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:15:27.857662  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:27.860538 10488 leader_election.cc:290] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:27.837231 10537 leader_election.cc:290] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:27.921067  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:27.923656 10324 leader_election.cc:290] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:27.927459  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:27.931370  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:15:27.864842 10487 consensus_meta.cc:287] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929: Time spent flushing consensus metadata: real 0.558s	user 0.009s	sys 0.000s
I20260709 12:15:27.867537 10243 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:27.868772 10655 raft_consensus.cc:493] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.933976 10655 raft_consensus.cc:515] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:27.936455 10655 leader_election.cc:290] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:27.874282  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:27.877759  5199 raft_consensus.cc:1275] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:15:27.937597  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:27.878579  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:27.938696  5267 raft_consensus.cc:606] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Received request to transfer leadership to TS ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:27.939109  5267 raft_consensus.cc:614] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:27.879354 10281 raft_consensus.cc:493] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.939518 10501 raft_consensus.cc:493] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:27.939630 10281 raft_consensus.cc:515] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:27.939999 10501 raft_consensus.cc:515] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:27.880259 10460 leader_election.cc:290] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:27.882628  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:27.942031  5838 raft_consensus.cc:2468] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 13.
I20260709 12:15:27.885141  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:27.943136  5836 raft_consensus.cc:2468] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 13.
I20260709 12:15:27.891978  5265 raft_consensus.cc:1275] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:15:27.938567  5270 raft_consensus.cc:2410] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:15:27.944481  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:27.945778 10281 leader_election.cc:290] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:27.895591  5273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:27.895125 10618 raft_consensus.cc:515] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:27.951258  5123 raft_consensus.cc:2468] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 12.
I20260709 12:15:27.903136  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:27.952780  5271 raft_consensus.cc:2468] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 9.
W20260709 12:15:27.899125 10660 log.cc:927] Time spent T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.220s	user 0.000s	sys 0.002s
I20260709 12:15:27.908457  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:27.954568  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:27.909566  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:27.955376  5266 raft_consensus.cc:2468] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 12.
I20260709 12:15:27.955463  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:27.956056  5120 raft_consensus.cc:2468] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 15.
I20260709 12:15:27.958449  5801 leader_election.cc:304] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:15:27.959916 10612 raft_consensus.cc:2804] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:27.960376 10612 raft_consensus.cc:493] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:27.960691 10612 raft_consensus.cc:3060] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:27.966125 10618 leader_election.cc:290] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:27.950256 10646 raft_consensus.cc:515] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:27.967887  5199 raft_consensus.cc:2393] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 14: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:15:27.967855  5166 leader_election.cc:304] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:27.969931 10460 raft_consensus.cc:2749] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:27.973740  5166 leader_election.cc:304] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
W20260709 12:15:27.904862  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 78406us
I20260709 12:15:27.915606  9941 consensus_queue.cc:1048] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:15:27.945587  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:27.946822  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:27.954667  5272 raft_consensus.cc:2393] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 13: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:15:27.977005 10488 consensus_queue.cc:1048] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:15:27.908457  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:27.978360  5268 raft_consensus.cc:2468] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 9.
I20260709 12:15:27.910579 10591 raft_consensus.cc:515] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:27.974706 10324 raft_consensus.cc:2804] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:27.979223  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:27.979532 10324 raft_consensus.cc:493] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:27.979921 10324 raft_consensus.cc:3060] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:27.980090  5121 raft_consensus.cc:2410] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 12:15:27.981207 10591 leader_election.cc:290] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:27.982502  5270 raft_consensus.cc:2468] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 12.
I20260709 12:15:27.869253 10510 raft_consensus.cc:515] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:27.985080  5088 leader_election.cc:304] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:15:27.976969  5163 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:27.986207  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:27.988523  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:27.988916  5801 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:27.998450  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:27.999086  5266 raft_consensus.cc:2468] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 15.
I20260709 12:15:27.996721 10646 leader_election.cc:290] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:28.006139  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:28.019212  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:27.986261 10537 raft_consensus.cc:2804] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:28.007228  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:27.985369 10510 leader_election.cc:290] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:28.017993  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:28.020418  5269 raft_consensus.cc:2393] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 13: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:15:28.007555  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:28.002118 10460 raft_consensus.cc:2804] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:28.030346  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:28.031112  5268 raft_consensus.cc:3060] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:15:28.007022  5801 leader_election.cc:304] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:15:28.004042 10591 raft_consensus.cc:2749] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:28.044485  5163 leader_election.cc:304] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:28.047241  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:28.040285  5801 leader_election.cc:304] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:15:28.020768 10537 raft_consensus.cc:493] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:28.056843  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:28.060868  5198 raft_consensus.cc:2468] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 13.
I20260709 12:15:28.061771  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:28.040999 10453 raft_consensus.cc:2804] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:15:28.022169 10331 consensus_queue.cc:1048] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:15:28.052635 10537 raft_consensus.cc:3060] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:28.056185 10524 raft_consensus.cc:2804] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:28.068014 10533 raft_consensus.cc:2749] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:28.069015 10453 raft_consensus.cc:493] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:28.093334  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:28.095775  5801 leader_election.cc:304] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:28.079411 10524 raft_consensus.cc:493] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:28.098541  5018 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33896 (request call id 323) took 11167 ms. Trace:
I20260709 12:15:28.105883  5801 leader_election.cc:304] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:15:28.105062 10510 raft_consensus.cc:2749] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:15:28.114475  5270 raft_consensus.cc:2468] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 12.
I20260709 12:15:28.092999 10453 raft_consensus.cc:3060] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:28.115785  5088 leader_election.cc:304] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:15:28.098924  5018 rpcz_store.cc:276] 0709 12:15:16.925930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:16.926220 (+   290us) service_pool.cc:224] Handling call
0709 12:15:28.092727 (+11166507us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:15:23.569174 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:15:23.594309 (+ 25135us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:15:23.606327 (+ 12018us) write_op.cc:435] Acquired schema lock
0709 12:15:23.611958 (+  5631us) tablet.cc:662] Decoding operations
0709 12:15:24.316410 (+704452us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:15:24.362123 (+ 45713us) write_op.cc:641] Partition lock acquired for write op
0709 12:15:24.362160 (+    37us) tablet.cc:685] Acquiring locks for 23 operations
0709 12:15:24.436954 (+ 74794us) tablet.cc:701] Row locks acquired
0709 12:15:24.437003 (+    49us) write_op.cc:260] PREPARE: finished
0709 12:15:24.437192 (+   189us) write_op.cc:270] Start()
0709 12:15:24.437360 (+   168us) write_op.cc:276] Timestamp: P: 1783599324437128 usec, L: 0
0709 12:15:24.437418 (+    58us) op_driver.cc:348] REPLICATION: starting
0709 12:15:24.438253 (+   835us) log.cc:844] Serialized 9028 byte log entry
0709 12:15:25.034627 (+596374us) op_driver.cc:464] REPLICATION: finished
0709 12:15:25.285499 (+250872us) write_op.cc:301] APPLY: starting
0709 12:15:25.289321 (+  3822us) tablet.cc:1367] starting BulkCheckPresence
0709 12:15:25.561324 (+272003us) tablet.cc:1370] finished BulkCheckPresence
0709 12:15:25.561482 (+   158us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:15:26.477072 (+915590us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:15:26.477753 (+   681us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=46,key_file_lookups=46,delta_file_lookups=46,mrs_lookups=0
0709 12:15:26.477817 (+    64us) write_op.cc:312] APPLY: finished
0709 12:15:26.478335 (+   518us) log.cc:844] Serialized 204 byte log entry
0709 12:15:26.877518 (+399183us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:27.010751 (+133233us) write_op.cc:454] Released schema lock
0709 12:15:27.042117 (+ 31366us) write_op.cc:341] FINISH: Updating metrics
0709 12:15:27.539697 (+497580us) spinlock_profiling.cc:243] Waited 6.88 ms on lock 0x7b54002a2528. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ecf7f9e1 00007f84ecf7e64c 00007f84ea60f3fd 00007f84ea5fb389 00007f84ea5fab53 00007f84ea5fed61 00007f84ea5fed19 00007f84ea5feca9 00007f84ea5fec71 00007f84ea5fde9d 0000000000388634
0709 12:15:27.540273 (+   576us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:27.540303 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":832027,"reported_tablets":34,"child_traces":[["op",{"apply.queue_time_us":215264,"apply.run_cpu_time_us":89346,"apply.run_wall_time_us":2266082,"cfile_cache_hit":94,"cfile_cache_hit_bytes":100221,"num_ops":23,"prepare.queue_time_us":248995,"prepare.run_cpu_time_us":25541,"prepare.run_wall_time_us":1018904,"raft.queue_time_us":289931,"raft.run_cpu_time_us":11341,"raft.run_wall_time_us":85512,"replication_time_us":578155,"spinlock_wait_cycles":15834496,"thread_start_us":842739,"threads_started":5,"wal-append.queue_time_us":857169,"wal-append.run_cpu_time_us":20009,"wal-append.run_wall_time_us":1240719}]]}
W20260709 12:15:28.122195  5164 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:28.101019 10524 raft_consensus.cc:3060] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:28.127497 10331 raft_consensus.cc:2804] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:28.128381 10331 raft_consensus.cc:697] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:28.129420 10331 consensus_queue.cc:237] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:28.136251  5270 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3beaf3ce31042719868401157039ee9"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
mode: GRACEFUL
new_leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
 from {username='slave'} at 127.0.0.1:43644
I20260709 12:15:28.141119 10612 raft_consensus.cc:515] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:28.143775 10612 leader_election.cc:290] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:28.144711  5834 raft_consensus.cc:2393] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 13: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:15:28.150758  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:28.151549  5164 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
W20260709 12:15:28.153998 10673 log.cc:927] Time spent T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:15:28.158062  5238 leader_election.cc:304] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:28.152879  5089 leader_election.cc:304] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:28.162303 10342 raft_consensus.cc:2749] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:28.164186 10524 raft_consensus.cc:515] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:28.165328 10324 raft_consensus.cc:515] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:15:28.166574 10672 log.cc:927] Time spent T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:15:28.166848  5192 raft_consensus.cc:2393] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 16: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:15:28.168370 10524 leader_election.cc:290] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:28.175002  5089 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:28.188566 10663 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:28.179594 10666 raft_consensus.cc:2749] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:15:28.186427 10342 raft_consensus.cc:2749] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:28.189323 10663 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:28.203071  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:28.203814  5124 raft_consensus.cc:3060] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:28.187549 10447 raft_consensus.cc:493] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:28.199759  5268 raft_consensus.cc:2468] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 14.
I20260709 12:15:28.209796  5270 raft_consensus.cc:606] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Received request to transfer leadership to TS dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:28.210309  5270 raft_consensus.cc:614] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:28.212059 10447 raft_consensus.cc:515] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:28.215530 10447 leader_election.cc:290] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:28.216089 10501 leader_election.cc:290] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:28.219941  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:28.219794  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:28.220824  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:28.223479  5119 raft_consensus.cc:2393] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 10: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:15:28.220610  5194 raft_consensus.cc:2468] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 13.
I20260709 12:15:28.225593  5088 leader_election.cc:304] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:15:28.211725 10617 raft_consensus.cc:2764] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:15:28.235157 10552 raft_consensus.cc:2804] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:28.235636 10552 raft_consensus.cc:493] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:28.236011 10552 raft_consensus.cc:3060] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:28.237957 10460 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:28.238481 10460 raft_consensus.cc:3060] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:28.244587 10552 raft_consensus.cc:515] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:28.247535 10552 leader_election.cc:290] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:28.250624  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:28.251443  5191 raft_consensus.cc:3060] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:28.245225 10537 raft_consensus.cc:515] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:28.255505  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:28.256173  5269 raft_consensus.cc:3060] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:28.250867  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:28.261521  5191 raft_consensus.cc:2468] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 14.
I20260709 12:15:28.262828  5088 leader_election.cc:304] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:15:28.290728  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:28.291043  5163 leader_election.cc:304] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:28.291705  5266 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 10.
I20260709 12:15:28.270776 10189 raft_consensus.cc:493] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:28.295825 10189 raft_consensus.cc:515] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:28.300462 10189 leader_election.cc:290] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:28.303092 10537 leader_election.cc:290] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:28.262108 10324 leader_election.cc:290] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 16 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:28.309441 10546 raft_consensus.cc:2804] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:28.310052 10546 raft_consensus.cc:697] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:28.310956 10546 consensus_queue.cc:237] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:28.278301 10552 raft_consensus.cc:2804] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:28.319337  5124 raft_consensus.cc:2468] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 16.
I20260709 12:15:28.320626  5269 raft_consensus.cc:2468] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 10.
I20260709 12:15:28.321329  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:28.323197  5266 raft_consensus.cc:3060] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:28.322661  5166 leader_election.cc:304] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:28.326468 10454 raft_consensus.cc:2804] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:15:28.340104 10537 raft_consensus.cc:493] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:28.340870 10537 raft_consensus.cc:515] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:28.343743 10537 leader_election.cc:290] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:28.346508  5088 leader_election.cc:304] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:15:28.347335 10537 raft_consensus.cc:2804] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:28.349014  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:28.348098 10537 raft_consensus.cc:697] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:28.329691 10552 raft_consensus.cc:697] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:28.360806  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:28.363878  5088 leader_election.cc:304] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:28.320230 10460 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:28.375586  5266 raft_consensus.cc:2468] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 16.
I20260709 12:15:28.350965 10537 consensus_queue.cc:237] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:28.369999 10447 raft_consensus.cc:2749] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:28.390357  5194 raft_consensus.cc:1240] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:28.393532 10552 consensus_queue.cc:237] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:28.396231 10453 raft_consensus.cc:515] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:28.400558  5198 raft_consensus.cc:1240] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:15:28.401264  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:28.402892  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:15:28.404738  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:28.401975  5199 raft_consensus.cc:2468] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 14.
W20260709 12:15:28.406678  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 300839us
I20260709 12:15:28.410107 10612 raft_consensus.cc:2804] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:28.410653  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:28.411545  5268 raft_consensus.cc:2393] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 14: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:15:28.410701 10612 raft_consensus.cc:697] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 13 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:15:28.413327 10612 consensus_queue.cc:237] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:28.415911  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:28.406697 10663 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:28.406816 10460 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:28.430236  5237 leader_election.cc:304] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:28.431524  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:28.432330  5266 raft_consensus.cc:3060] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:28.432780  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:15:28.412485  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 235376us
W20260709 12:15:28.441172  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 105367us
I20260709 12:15:28.445225  5804 leader_election.cc:304] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929
I20260709 12:15:28.448237  5832 raft_consensus.cc:2468] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 9.
I20260709 12:15:28.451399  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:28.452950  5836 raft_consensus.cc:2393] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 14: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:15:28.455533  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:28.462450  5238 leader_election.cc:304] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:28.467865  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:28.467456  5237 leader_election.cc:304] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:28.450038 10591 raft_consensus.cc:2804] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:28.472466 10591 raft_consensus.cc:493] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:28.472875 10591 raft_consensus.cc:3060] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:28.474011  5829 raft_consensus.cc:1240] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 8. Current term is 9. Ops: []
I20260709 12:15:28.489552  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:28.449540 10500 raft_consensus.cc:493] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:28.496523  5834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:28.497454  5834 raft_consensus.cc:2393] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 10: Already voted for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in this term.
I20260709 12:15:28.500917 10547 raft_consensus.cc:2804] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:28.497325  5266 raft_consensus.cc:2468] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 13.
I20260709 12:15:28.470167 10472 raft_consensus.cc:2749] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:28.501417 10547 raft_consensus.cc:493] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:28.502825 10500 raft_consensus.cc:515] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:28.506696  9941 raft_consensus.cc:2749] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:28.498570 10563 consensus_queue.cc:1059] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:15:28.502252 10591 raft_consensus.cc:515] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:28.534243 10591 leader_election.cc:290] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:28.516808 10547 raft_consensus.cc:3060] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:28.584420  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
W20260709 12:15:28.571684 10686 log.cc:927] Time spent T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:15:28.608843 10454 raft_consensus.cc:697] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:28.613035  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:28.594950 10447 raft_consensus.cc:493] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:28.641815 10500 leader_election.cc:290] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:28.672058  5121 raft_consensus.cc:1240] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 LEADER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 13. Current term is 14. Ops: []
I20260709 12:15:28.680011  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:28.732208  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:28.732882  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:28.732124  5022 catalog_manager.cc:5697] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 8 to 9, leader changed from bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 9 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:28.739602  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:28.665675 10447 raft_consensus.cc:515] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:28.730322 10453 leader_election.cc:290] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:15:28.758698  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 291955us
I20260709 12:15:28.766604  5119 raft_consensus.cc:2468] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 13.
I20260709 12:15:28.672762 10454 consensus_queue.cc:237] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:15:28.768977  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 306593us
I20260709 12:15:28.777757  5801 leader_election.cc:304] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:15:28.792626  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 325241us
I20260709 12:15:28.792520  5117 raft_consensus.cc:2468] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 13.
I20260709 12:15:28.794976  5804 leader_election.cc:304] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:15:28.800525  5163 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:15:28.831471  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 44448.3us
I20260709 12:15:28.831558  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:28.845531 10693 raft_consensus.cc:2749] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:15:28.850348 10643 raft_consensus.cc:2804] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:28.798676 10609 raft_consensus.cc:2749] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:15:28.865036  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 102892us
I20260709 12:15:28.873481 10694 consensus_queue.cc:1059] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:15:28.874311 10694 consensus_queue.cc:1243] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer ad2f9a1e2f7a45429fa69fd23d09f821 log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:15:28.874413 10447 leader_election.cc:290] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:28.956112 10547 raft_consensus.cc:515] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:28.962643  5238 leader_election.cc:304] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
W20260709 12:15:28.980628  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 130128us
W20260709 12:15:28.981303  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 138672us
I20260709 12:15:29.004117 10547 leader_election.cc:290] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:28.986774 10700 raft_consensus.cc:2749] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:29.009351  5801 leader_election.cc:304] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:29.015162  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:29.015911  5117 raft_consensus.cc:3060] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:15:29.022403 10617 raft_consensus.cc:3055] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:29.022934 10617 raft_consensus.cc:740] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:29.023838 10617 consensus_queue.cc:260] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:29.025100 10617 raft_consensus.cc:3060] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:15:29.029006 10696 log.cc:927] Time spent T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:15:29.040076 10524 raft_consensus.cc:2804] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:29.045768 10524 raft_consensus.cc:697] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 13 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
W20260709 12:15:29.019765 10691 log.cc:927] Time spent T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.154s	user 0.000s	sys 0.002s
I20260709 12:15:29.049182 10454 consensus_queue.cc:1059] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:15:29.050248  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:29.049692  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:29.051586  5267 raft_consensus.cc:2393] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 13: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:15:29.052239 10661 raft_consensus.cc:3055] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:15:29.052664 10661 raft_consensus.cc:740] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:29.046737 10524 consensus_queue.cc:237] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:29.050992  5270 raft_consensus.cc:2368] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 9. Current term is 10.
I20260709 12:15:29.053561 10661 consensus_queue.cc:260] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:29.055291 10661 raft_consensus.cc:3060] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:15:29.049301  5164 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:29.059165  5267 raft_consensus.cc:1240] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:29.060506  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:29.059216  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:29.064188  5274 raft_consensus.cc:2368] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 14. Current term is 15.
I20260709 12:15:29.038465  5117 raft_consensus.cc:2468] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 15.
I20260709 12:15:29.065908  5194 raft_consensus.cc:2393] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 in current term 14: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:15:29.070597  5801 leader_election.cc:400] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 election: Vote denied by peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709) with higher term. Message: Invalid argument: T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 9. Current term is 10.
I20260709 12:15:29.069067 10454 raft_consensus.cc:3060] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:29.069150  5240 leader_election.cc:304] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
W20260709 12:15:29.101518 10697 log.cc:927] Time spent T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.192s	user 0.001s	sys 0.001s
I20260709 12:15:29.104683 10500 raft_consensus.cc:2804] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:29.105183 10500 raft_consensus.cc:697] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 15 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:29.106281 10500 consensus_queue.cc:237] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:29.074890  5088 leader_election.cc:400] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709) with higher term. Message: Invalid argument: T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 14. Current term is 15.
I20260709 12:15:29.076391  5829 raft_consensus.cc:1275] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:15:29.079550  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:29.118309  5088 leader_election.cc:403] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:15:29.081156  5191 raft_consensus.cc:1240] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:15:29.083667  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:29.119156  5196 raft_consensus.cc:3060] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:29.118786  5194 raft_consensus.cc:2468] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 13.
W20260709 12:15:29.118297  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 49218.6us
I20260709 12:15:29.122577 10454 raft_consensus.cc:2749] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:15:29.101971  5801 leader_election.cc:403] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 12:15:29.124245  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 49525.1us
I20260709 12:15:29.040620 10643 raft_consensus.cc:697] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 13 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:15:29.123325 10487 raft_consensus.cc:493] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:29.129029  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 58596.9us
I20260709 12:15:29.128893 10699 raft_consensus.cc:2749] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709) with higher term. Message: Invalid argument: T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 14. Current term is 15.
I20260709 12:15:29.132597 10331 consensus_queue.cc:1059] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 12:15:29.133678 10699 raft_consensus.cc:3055] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:29.134071 10699 raft_consensus.cc:740] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:29.128592 10552 consensus_queue.cc:1059] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 12:15:29.135133 10552 raft_consensus.cc:3055] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:29.153072  5265 raft_consensus.cc:1275] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:15:29.155090 10699 consensus_queue.cc:260] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:29.156548 10699 raft_consensus.cc:3060] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:29.128361 10487 raft_consensus.cc:515] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:29.140743 10655 raft_consensus.cc:3060] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:29.135514 10552 raft_consensus.cc:740] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:29.160566 10487 leader_election.cc:290] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:29.161046 10552 consensus_queue.cc:260] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:29.162469 10552 raft_consensus.cc:3060] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:29.134603 10643 consensus_queue.cc:237] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:29.167955  5237 leader_election.cc:304] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:29.169827  5267 raft_consensus.cc:1275] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:15:29.170528 10705 consensus_queue.cc:1048] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:15:29.171232 10702 raft_consensus.cc:2804] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:15:29.171703 10702 raft_consensus.cc:493] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:29.174194  5196 raft_consensus.cc:2468] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 15.
I20260709 12:15:29.174568  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:29.175554  5117 raft_consensus.cc:2410] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:15:29.177770  5191 raft_consensus.cc:1275] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:15:29.180656 10453 consensus_queue.cc:1048] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:15:29.180902  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:29.190356 10640 consensus_queue.cc:1048] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:15:29.172071 10702 raft_consensus.cc:3060] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:29.198709  5267 raft_consensus.cc:1275] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:15:29.196375  5240 leader_election.cc:304] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:29.201555 10617 raft_consensus.cc:2749] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:29.196135  5196 raft_consensus.cc:1275] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:15:29.213825 10342 consensus_queue.cc:1048] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:15:29.217585 10497 consensus_queue.cc:1048] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:15:29.223222 10537 consensus_queue.cc:1048] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:15:29.310669 10655 raft_consensus.cc:2749] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709) with higher term. Message: Invalid argument: T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for earlier term 9. Current term is 10.
I20260709 12:15:29.333581 10702 raft_consensus.cc:515] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:29.335913 10702 leader_election.cc:290] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:29.337951  5274 raft_consensus.cc:1240] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:15:29.339896  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:29.340320  5117 raft_consensus.cc:1275] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:15:29.343291 10533 consensus_queue.cc:1048] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:15:29.344238  5270 raft_consensus.cc:1275] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:15:29.346418 10217 consensus_queue.cc:1048] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:15:29.347316 10643 consensus_queue.cc:1059] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:15:29.348309 10643 raft_consensus.cc:3055] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:29.348752  5829 raft_consensus.cc:1275] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:15:29.349239  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:29.348851 10643 raft_consensus.cc:740] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:15:29.350486 10643 consensus_queue.cc:260] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:29.351006  5238 leader_election.cc:304] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:29.351629 10643 raft_consensus.cc:3060] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:29.352442 10617 raft_consensus.cc:2749] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:15:29.360941 10699 consensus_queue.cc:1048] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
W20260709 12:15:29.498387 10717 log.cc:927] Time spent T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 12:15:29.507478  5117 raft_consensus.cc:1275] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 12:15:29.507882  5117 pending_rounds.cc:85] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting all ops after (but not including) 9
I20260709 12:15:29.508101  5117 pending_rounds.cc:107] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 12:15:29.508340  5117 raft_consensus.cc:2889] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:15:29.514668 10655 consensus_queue.cc:1048] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:15:29.560889  5268 raft_consensus.cc:1275] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:15:29.608323 10453 consensus_queue.cc:1048] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:29.682505  5196 raft_consensus.cc:1275] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:15:29.710908 10487 consensus_queue.cc:1048] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:15:29.735709 10643 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:29.736907 10643 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:29.747072  5018 catalog_manager.cc:5697] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 reported cstate change: config changed from index 6 to 11, VOTER dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) evicted. New cstate: current_term: 12 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:29.749222  5018 catalog_manager.cc:5697] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 7 to 14, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 14 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:29.750878  5018 catalog_manager.cc:5697] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 13 to 18, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 18 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:29.752229  5018 catalog_manager.cc:5697] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 12 to 15, leader changed from bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 15 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
W20260709 12:15:29.758903  5022 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33888 (request call id 337) took 27157 ms (client timeout 15000 ms). Trace:
I20260709 12:15:29.774170  5018 catalog_manager.cc:5697] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 15 to 16, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 16 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } }
I20260709 12:15:29.775941  5018 catalog_manager.cc:5697] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 10 to 14, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 14 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } }
I20260709 12:15:29.777370  5018 catalog_manager.cc:5697] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 12 to 16, leader changed from bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 16 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
W20260709 12:15:29.771529  5022 rpcz_store.cc:269] 0709 12:15:02.601812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:02.606466 (+  4654us) service_pool.cc:224] Handling call
0709 12:15:02.898984 (+292518us) spinlock_profiling.cc:243] Waited 4.01 ms on lock 0x7b540026ff54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2d090 00007f84e6bcbf3a 00007f84ec981e9c 00007f84eca8004e 00007f84eaf412a4 00007f84eaf41232 00007f84eaf41161 00007f84eaf410dc 00007f84eaf40392 00007f84e4efe48c 00007f84e4efd8c6
0709 12:15:29.758807 (+26859823us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:15:29.131586 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:15:29.132134 (+   548us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:15:29.132168 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:15:29.132185 (+    17us) tablet.cc:662] Decoding operations
0709 12:15:29.132496 (+   311us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:15:29.132568 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 12:15:29.132598 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:15:29.132803 (+   205us) tablet.cc:701] Row locks acquired
0709 12:15:29.132821 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:15:29.132955 (+   134us) write_op.cc:270] Start()
0709 12:15:29.133069 (+   114us) write_op.cc:276] Timestamp: P: 1783599329132911 usec, L: 0
0709 12:15:29.133089 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:15:29.133743 (+   654us) log.cc:844] Serialized 536 byte log entry
0709 12:15:29.399707 (+265964us) op_driver.cc:464] REPLICATION: finished
0709 12:15:29.507633 (+107926us) write_op.cc:301] APPLY: starting
0709 12:15:29.507733 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0709 12:15:29.519361 (+ 11628us) tablet.cc:1370] finished BulkCheckPresence
0709 12:15:29.519751 (+   390us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:15:29.524973 (+  5222us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:15:29.525136 (+   163us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:15:29.525177 (+    41us) write_op.cc:312] APPLY: finished
0709 12:15:29.525357 (+   180us) log.cc:844] Serialized 25 byte log entry
0709 12:15:29.525672 (+   315us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:29.525766 (+    94us) write_op.cc:454] Released schema lock
0709 12:15:29.525806 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 12:15:29.526191 (+   385us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:29.526220 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":47,"spinlock_wait_cycles":9231104,"child_traces":[["op",{"apply.queue_time_us":107605,"apply.run_cpu_time_us":3529,"apply.run_wall_time_us":18537,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8305,"num_ops":1,"prepare.queue_time_us":245493,"prepare.run_cpu_time_us":34744,"prepare.run_wall_time_us":123079,"raft.queue_time_us":81095,"raft.run_cpu_time_us":18073,"raft.run_wall_time_us":74179,"replication_time_us":259699,"thread_start_us":374262,"threads_started":4,"wal-append.queue_time_us":165549}]]}
I20260709 12:15:29.779011  5018 catalog_manager.cc:5697] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 6 to 10, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 10 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:29.788058  5018 catalog_manager.cc:5697] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 9 to 11, leader changed from bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 11 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:29.794271  5123 raft_consensus.cc:1275] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:15:29.796152 10487 consensus_queue.cc:1048] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:29.799122 10643 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:29.800585  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:29.801517  5194 raft_consensus.cc:2410] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:15:29.790234  5018 catalog_manager.cc:5697] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } }
I20260709 12:15:29.806113  5268 raft_consensus.cc:1275] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:15:29.806649  5018 catalog_manager.cc:5697] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 9 to 10, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 10 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } }
I20260709 12:15:29.807652  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:29.808516  5268 raft_consensus.cc:2410] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:15:29.808355  5018 catalog_manager.cc:5697] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 12 to 14, leader changed from bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 14 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:29.809764  5018 catalog_manager.cc:5697] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 11 to 15, leader changed from bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 15 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:29.811281  5018 catalog_manager.cc:5697] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 13 to 14, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 14 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:29.812724  5018 catalog_manager.cc:5697] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 11 to 13, leader changed from bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 13 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:29.813161 10707 consensus_queue.cc:1048] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:15:29.814280  5018 catalog_manager.cc:5697] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 12 to 14, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 14 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } }
I20260709 12:15:29.815656  5018 catalog_manager.cc:5697] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:29.824250  5801 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:29.825346 10707 raft_consensus.cc:2749] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:29.817003  5018 catalog_manager.cc:5697] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 12 to 14, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 14 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } }
I20260709 12:15:29.833525  5018 catalog_manager.cc:5697] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 13 to 16, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 16 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:29.834815  5018 catalog_manager.cc:5697] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 10 to 13, leader changed from bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 13 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:29.836056  5018 catalog_manager.cc:5697] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:29.837400  5018 catalog_manager.cc:5697] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:29.838724  5018 catalog_manager.cc:5697] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 11 to 13, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 13 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } }
I20260709 12:15:29.839882  5018 catalog_manager.cc:5697] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 11 to 14, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 14 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:29.841333  5018 catalog_manager.cc:5697] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 9 to 15. New cstate: current_term: 15 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } }
I20260709 12:15:29.854928  5018 catalog_manager.cc:5697] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 11 to 13, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 13 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:29.856761  5018 catalog_manager.cc:5697] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:29.858853  5018 catalog_manager.cc:5697] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 11 to 14, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 14 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } }
I20260709 12:15:29.880898  5124 raft_consensus.cc:1275] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:15:29.883787 10699 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:29.884395 10699 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:29.885766  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:29.886528  5124 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 10.
I20260709 12:15:29.887158 10699 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:29.889580  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:29.890420  5265 raft_consensus.cc:2410] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:15:29.894049  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:29.907796  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:29.908514  5836 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 10.
I20260709 12:15:29.915416  5196 raft_consensus.cc:2410] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad2f9a1e2f7a45429fa69fd23d09f821 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:15:29.916971  5088 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:29.918498 10643 consensus_queue.cc:1048] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:15:29.918716 10699 raft_consensus.cc:2749] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:29.997004  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:15:30.182436  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 67067.6us
I20260709 12:15:30.236730  5123 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:37016
I20260709 12:15:30.237419  5123 raft_consensus.cc:606] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 LEADER]: Received request to transfer leadership
I20260709 12:15:30.253149  5123 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:37016
I20260709 12:15:30.253895  5123 raft_consensus.cc:606] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 LEADER]: Received request to transfer leadership
W20260709 12:15:30.254226  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 59091.1us
W20260709 12:15:30.258209  5010 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for c7bb7b814fea4a2488cc39d06fc90483 already in progress [suppressed 3 similar messages]
I20260709 12:15:30.277668  5123 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:37016
I20260709 12:15:30.278427  5123 raft_consensus.cc:606] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 LEADER]: Received request to transfer leadership
I20260709 12:15:30.301397  5186 tablet_service.cc:1558] Processing DeleteTablet for tablet 756d32b8c4d642a6955517f66ac5bb45 with delete_type TABLET_DATA_TOMBSTONED (TS dd62e75bd3ed4ed28f1fb5955d650808 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:47718
I20260709 12:15:30.306329 10705 raft_consensus.cc:493] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:30.306982 10705 raft_consensus.cc:515] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:30.309859 10738 tablet_replica.cc:333] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
I20260709 12:15:30.310199  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:30.324565  5194 raft_consensus.cc:2468] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 9.
I20260709 12:15:30.312001 10705 leader_election.cc:290] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:30.313988  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:30.327250  5801 leader_election.cc:304] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:30.335072 10707 raft_consensus.cc:2804] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:15:30.340634  5265 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
mode: GRACEFUL
new_leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
 from {username='slave'} at 127.0.0.1:43644
I20260709 12:15:30.341102 10738 raft_consensus.cc:2243] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:30.341558  5265 raft_consensus.cc:606] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 10 LEADER]: Received request to transfer leadership to TS ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:30.344439 10738 raft_consensus.cc:2272] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:30.338267 10695 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:30.345876 10695 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:30.347836 10738 ts_tablet_manager.cc:1916] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:15:30.349561  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:30.350353  5194 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 10.
I20260709 12:15:30.349551  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:30.353091  5265 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
mode: GRACEFUL
new_leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
 from {username='slave'} at 127.0.0.1:43644
I20260709 12:15:30.351732  5123 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 10.
I20260709 12:15:30.353740  5265 raft_consensus.cc:606] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Received request to transfer leadership to TS ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:30.337841 10707 raft_consensus.cc:493] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:30.354247  5265 raft_consensus.cc:614] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:30.355386  5240 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:30.354614 10707 raft_consensus.cc:3060] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:30.365258 10695 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:30.369293 10695 raft_consensus.cc:993] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929: : Instructing follower ad2f9a1e2f7a45429fa69fd23d09f821 to start an election
I20260709 12:15:30.369812 10695 raft_consensus.cc:1081] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 10 LEADER]: Signalling peer ad2f9a1e2f7a45429fa69fd23d09f821 to start an election
I20260709 12:15:30.370460  5265 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
mode: GRACEFUL
new_leader_uuid: "bce73265e27d4b30a4dcc1e491305088"
 from {username='slave'} at 127.0.0.1:43644
I20260709 12:15:30.373013  5265 raft_consensus.cc:606] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 14 LEADER]: Received request to transfer leadership to TS bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:30.371845  5123 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
 from {username='slave'} at 127.0.0.1:40402
I20260709 12:15:30.373425  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:30.373981  5123 raft_consensus.cc:493] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:30.374389  5123 raft_consensus.cc:3060] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:30.374112  5838 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 10.
I20260709 12:15:30.374413 10617 raft_consensus.cc:2804] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:30.383752 10617 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:30.384114 10617 raft_consensus.cc:3060] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:30.386656  5123 raft_consensus.cc:515] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:30.389866  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:30.390483  5267 raft_consensus.cc:3055] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:30.390812  5267 raft_consensus.cc:740] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:30.391541  5267 consensus_queue.cc:260] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:30.392714  5267 raft_consensus.cc:3060] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:30.396449  5265 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
mode: GRACEFUL
new_leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
 from {username='slave'} at 127.0.0.1:43644
I20260709 12:15:30.399459  5265 raft_consensus.cc:606] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 15 LEADER]: Received request to transfer leadership to TS ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:30.398164 10707 raft_consensus.cc:515] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:30.413934  5265 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
mode: GRACEFUL
new_leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
 from {username='slave'} at 127.0.0.1:43644
I20260709 12:15:30.417212  5123 leader_election.cc:290] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:30.417855  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:30.418478  5836 raft_consensus.cc:3060] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:30.419027  5267 raft_consensus.cc:2468] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 11.
I20260709 12:15:30.420451  5088 leader_election.cc:304] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:15:30.414589  5265 raft_consensus.cc:606] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 10 LEADER]: Received request to transfer leadership to TS ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:30.424137  5018 catalog_manager.cc:5697] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 8 to 10, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 10 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:30.430075  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:15:30.432359  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:30.430621  5018 catalog_manager.cc:5697] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 13 to 16, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 16 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } }
I20260709 12:15:30.423964 10734 raft_consensus.cc:2804] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:30.433252  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:30.436226  5018 catalog_manager.cc:5697] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 10 to 13, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 13 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:30.452554  5836 raft_consensus.cc:2468] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 11.
I20260709 12:15:30.449090 10734 raft_consensus.cc:697] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:30.464624 10734 consensus_queue.cc:237] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:30.468247  5018 catalog_manager.cc:5697] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:30.482141 10552 raft_consensus.cc:993] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821: : Instructing follower dd62e75bd3ed4ed28f1fb5955d650808 to start an election
I20260709 12:15:30.482705 10552 raft_consensus.cc:1081] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 LEADER]: Signalling peer dd62e75bd3ed4ed28f1fb5955d650808 to start an election
I20260709 12:15:30.484596  5194 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483"
dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
 from {username='slave'} at 127.0.0.1:47744
I20260709 12:15:30.485190  5194 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:30.487927  5194 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:30.485934 10617 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:30.492267  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:30.492975  5196 raft_consensus.cc:3060] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:15:30.494838 10533 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:30.495409 10533 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:30.498490  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:30.499163  5124 raft_consensus.cc:2468] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 14.
I20260709 12:15:30.500265  5166 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:30.502884 10326 raft_consensus.cc:2804] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:30.503332 10326 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:30.503707 10326 raft_consensus.cc:3060] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:30.506606  5194 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:30.510879  5196 raft_consensus.cc:2468] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 10.
I20260709 12:15:30.522533 10533 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:30.529395  5801 leader_election.cc:304] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:30.530544  9985 raft_consensus.cc:2804] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:15:30.532835  9985 raft_consensus.cc:697] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 10 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:15:30.542475 10707 leader_election.cc:290] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 10 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:30.534008  9985 consensus_queue.cc:237] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:30.545746  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:30.546446  5265 raft_consensus.cc:2468] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 13.
I20260709 12:15:30.549813  5194 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 16 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:30.550562  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:30.551239 10617 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:30.552078  5836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:30.552649  5836 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:30.546555  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:30.554134  5123 raft_consensus.cc:3055] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:15:30.554435  5123 raft_consensus.cc:740] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:30.555249  5123 consensus_queue.cc:260] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:30.555622  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:30.556202  5830 raft_consensus.cc:3060] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:30.551195  5267 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:15:30.558609  5019 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58198 (request call id 328) took 29149 ms (client timeout 15000 ms). Trace:
W20260709 12:15:30.559108  5019 rpcz_store.cc:269] 0709 12:15:01.409451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:01.413617 (+  4166us) service_pool.cc:224] Handling call
0709 12:15:30.558407 (+29144790us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":657,"reported_tablets":47}
I20260709 12:15:30.562569  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:30.565914  5123 raft_consensus.cc:3060] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:30.565759  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:30.568100  5196 raft_consensus.cc:3060] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:30.569589  5830 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 11.
I20260709 12:15:30.575310  5267 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 16.
I20260709 12:15:30.579139 10738 ts_tablet_manager.cc:1929] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.10
I20260709 12:15:30.579749 10738 log.cc:1199] T 756d32b8c4d642a6955517f66ac5bb45 P dd62e75bd3ed4ed28f1fb5955d650808: Deleting WAL directory at /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/ts-1-root/wals/756d32b8c4d642a6955517f66ac5bb45
I20260709 12:15:30.581701 10326 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:30.584092 10326 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:30.573745  5836 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 16.
I20260709 12:15:30.585304  5838 raft_consensus.cc:1240] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Rejecting Update request from peer ad2f9a1e2f7a45429fa69fd23d09f821 for earlier term 15. Current term is 16. Ops: []
I20260709 12:15:30.586586  5007 catalog_manager.cc:5028] TS dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): tablet 756d32b8c4d642a6955517f66ac5bb45 (table test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]) successfully deleted
I20260709 12:15:30.589843  5123 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 16.
I20260709 12:15:30.590001  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:30.590611  5124 raft_consensus.cc:3060] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:30.591182  5164 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:30.598145  5123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:30.598781  5123 raft_consensus.cc:3060] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:30.599932  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:30.600757  5267 raft_consensus.cc:3060] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:15:30.607314  5124 raft_consensus.cc:2468] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 15.
I20260709 12:15:30.615999  5123 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 11.
I20260709 12:15:30.616163  5196 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 11.
I20260709 12:15:30.627244  5166 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:30.629302  5267 raft_consensus.cc:2468] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 15.
I20260709 12:15:30.597024 10326 raft_consensus.cc:2804] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:15:30.629522  5237 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:30.629333 10651 raft_consensus.cc:2804] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:30.639441 10651 raft_consensus.cc:697] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:30.640475 10651 consensus_queue.cc:237] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:30.639355 10326 raft_consensus.cc:697] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:30.642525 10326 consensus_queue.cc:237] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:30.664846 10488 raft_consensus.cc:993] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929: : Instructing follower ad2f9a1e2f7a45429fa69fd23d09f821 to start an election
I20260709 12:15:30.665439 10488 raft_consensus.cc:1081] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 15 LEADER]: Signalling peer ad2f9a1e2f7a45429fa69fd23d09f821 to start an election
I20260709 12:15:30.666253 10488 raft_consensus.cc:493] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:30.666764 10488 raft_consensus.cc:515] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:30.669008 10488 leader_election.cc:290] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:30.652171 10487 raft_consensus.cc:2804] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:30.669898 10487 raft_consensus.cc:697] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 11 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:30.670800 10487 consensus_queue.cc:237] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:30.679510  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:30.671255  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:30.726761  5194 raft_consensus.cc:2368] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 9. Current term is 10.
I20260709 12:15:30.728150  5237 leader_election.cc:400] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Vote denied by peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455) with higher term. Message: Invalid argument: T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 9. Current term is 10.
I20260709 12:15:30.728473  5237 leader_election.cc:403] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:15:30.732332  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 46305.5us
I20260709 12:15:30.746958  5123 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
 from {username='slave'} at 127.0.0.1:40402
I20260709 12:15:30.747736  5123 raft_consensus.cc:493] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:30.748165  5123 raft_consensus.cc:3060] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:30.759012  5123 raft_consensus.cc:515] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:30.741868 10746 raft_consensus.cc:3060] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:15:30.777549  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:30.779816  5194 raft_consensus.cc:3060] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:30.776778  5123 leader_election.cc:290] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 16 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:30.782153  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:30.782836  5265 raft_consensus.cc:3055] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:15:30.783157  5265 raft_consensus.cc:740] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:30.784123  5265 consensus_queue.cc:260] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:30.785403  5265 raft_consensus.cc:3060] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:30.819864  5265 raft_consensus.cc:2468] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 16.
I20260709 12:15:30.826022  5194 raft_consensus.cc:2468] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 16.
I20260709 12:15:30.827695  5088 leader_election.cc:304] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:30.840677 10447 raft_consensus.cc:2804] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:15:30.848909  5071 auto_rebalancer.cc:893] Removing replace marker failed: Replica ad2f9a1e2f7a45429fa69fd23d09f821 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
W20260709 12:15:30.860167  5071 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for c7bb7b814fea4a2488cc39d06fc90483 already in progress
W20260709 12:15:30.860616  5071 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for c7bb7b814fea4a2488cc39d06fc90483 already in progress
I20260709 12:15:30.853531  5020 catalog_manager.cc:5697] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 9 to 12, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 12 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:30.888211  5020 catalog_manager.cc:5697] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 11 to 14, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 14 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:30.868089 10447 raft_consensus.cc:697] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:30.895313 10753 raft_consensus.cc:993] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929: : Instructing follower ad2f9a1e2f7a45429fa69fd23d09f821 to start an election
I20260709 12:15:30.895685 10755 raft_consensus.cc:993] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929: : Instructing follower bce73265e27d4b30a4dcc1e491305088 to start an election
I20260709 12:15:30.895915 10753 raft_consensus.cc:1081] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 10 LEADER]: Signalling peer ad2f9a1e2f7a45429fa69fd23d09f821 to start an election
I20260709 12:15:30.896186 10755 raft_consensus.cc:1081] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 14 LEADER]: Signalling peer bce73265e27d4b30a4dcc1e491305088 to start an election
I20260709 12:15:30.893066  5020 catalog_manager.cc:5697] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 11 to 12, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 12 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:15:30.898949  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 52938us
I20260709 12:15:30.900242  5020 catalog_manager.cc:5697] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 9 to 11, leader changed from bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 11 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:30.911134  5020 catalog_manager.cc:5697] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 14 to 17, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 17 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:30.917647  5836 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85"
dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
 from {username='slave'} at 127.0.0.1:46088
I20260709 12:15:30.918321  5836 raft_consensus.cc:493] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:30.918726  5836 raft_consensus.cc:3060] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:30.926872  5836 raft_consensus.cc:515] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:30.920249  5020 catalog_manager.cc:5697] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 9 to 10, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 10 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:15:30.957543  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 92950.6us
I20260709 12:15:30.967294  5836 leader_election.cc:290] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:30.973847  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:30.974493  5124 raft_consensus.cc:3060] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:30.975725  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f93759199ab4820a9a807a0f1c70c85" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:30.985340  5123 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
 from {username='slave'} at 127.0.0.1:40402
I20260709 12:15:30.985975  5123 raft_consensus.cc:493] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:30.986321  5123 raft_consensus.cc:3060] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:30.986867  5124 raft_consensus.cc:2468] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 15.
I20260709 12:15:30.895244 10447 consensus_queue.cc:237] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:30.988062  5804 leader_election.cc:304] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:15:31.018433  5125 raft_consensus.cc:1240] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 14. Current term is 15. Ops: []
W20260709 12:15:31.044788 10749 log.cc:927] Time spent T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 12:15:31.046994 10767 consensus_queue.cc:1059] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:15:31.018222 10763 raft_consensus.cc:2804] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:31.054061 10763 raft_consensus.cc:697] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 15 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
W20260709 12:15:31.015398 10765 log.cc:927] Time spent T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 12:15:31.059424  5123 raft_consensus.cc:515] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:15:31.058703  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 85183.9us
I20260709 12:15:31.055059 10763 consensus_queue.cc:237] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:31.010573 10764 raft_consensus.cc:493] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
W20260709 12:15:31.076689  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 74620.3us
I20260709 12:15:31.085282  5270 raft_consensus.cc:1275] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 12:15:31.089326  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 101344us
I20260709 12:15:31.087179 10773 raft_consensus.cc:493] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:31.079974 10764 raft_consensus.cc:515] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:31.094534  5836 raft_consensus.cc:1275] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:15:31.095538 10773 raft_consensus.cc:515] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:31.103523 10773 leader_election.cc:290] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:31.104343 10746 raft_consensus.cc:2749] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455) with higher term. Message: Invalid argument: T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 for earlier term 9. Current term is 10.
I20260709 12:15:31.107036 10764 leader_election.cc:290] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:31.135504  5123 leader_election.cc:290] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:31.152664  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:31.154248  5194 raft_consensus.cc:3060] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:31.156764  5268 raft_consensus.cc:3055] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:15:31.157351  5268 raft_consensus.cc:740] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:31.159044  5268 consensus_queue.cc:260] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:31.163507  5268 raft_consensus.cc:3060] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:31.172602  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:31.186210  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:31.196692  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:31.204087  5272 raft_consensus.cc:1275] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:15:31.208360  5274 raft_consensus.cc:1275] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 12:15:31.219132  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 213058us
I20260709 12:15:31.227656  5265 raft_consensus.cc:1275] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:15:31.243506  5269 raft_consensus.cc:3055] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:15:31.244041  5269 raft_consensus.cc:740] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:31.245329  5269 consensus_queue.cc:260] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:31.246910  5269 raft_consensus.cc:3060] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:31.250154  5836 raft_consensus.cc:1275] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:15:31.251333 10754 consensus_queue.cc:1048] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 12:15:31.251006  5267 raft_consensus.cc:2468] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 14.
W20260709 12:15:31.265219  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 76348.8us
I20260709 12:15:31.259119 10762 consensus_queue.cc:1048] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:15:31.273036  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:31.274156  5196 raft_consensus.cc:2468] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 13.
I20260709 12:15:31.281775  5196 raft_consensus.cc:1275] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:15:31.295960  5125 raft_consensus.cc:1275] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:15:31.309095 10757 consensus_queue.cc:1048] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:15:31.321507  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 66136us
I20260709 12:15:31.309908  5801 leader_election.cc:304] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:15:31.323743  9985 raft_consensus.cc:2804] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:31.322747  5018 catalog_manager.cc:5697] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 8 to 11, leader changed from bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 11 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:31.324162  9985 raft_consensus.cc:493] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:31.324570  9985 raft_consensus.cc:3060] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:31.342284 10460 consensus_queue.cc:1048] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:15:31.342679  5268 raft_consensus.cc:2468] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 15.
I20260709 12:15:31.346511  5269 raft_consensus.cc:2468] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 11.
I20260709 12:15:31.346873 10750 consensus_queue.cc:1048] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
W20260709 12:15:31.346598 10767 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 12:15:31.359702 10774 consensus_queue.cc:1048] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:15:31.376382 10760 consensus_queue.cc:1048] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:15:31.377833  9985 raft_consensus.cc:515] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:31.385989  9985 leader_election.cc:290] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:31.387267  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:31.387970  5269 raft_consensus.cc:3060] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:31.389771  5125 raft_consensus.cc:1275] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:15:31.393841 10762 consensus_queue.cc:1048] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:15:31.387483  5123 raft_consensus.cc:1275] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:15:31.400482  5269 raft_consensus.cc:2468] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 15.
I20260709 12:15:31.407423  5801 leader_election.cc:304] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
W20260709 12:15:31.408751  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 55336.4us
I20260709 12:15:31.408814  9985 raft_consensus.cc:2804] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:31.416359  9985 raft_consensus.cc:697] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 15 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:15:31.435501  5834 raft_consensus.cc:1275] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:15:31.437879  5194 raft_consensus.cc:2468] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 11.
I20260709 12:15:31.437255  5088 leader_election.cc:304] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:15:31.452551  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:15:31.473498  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 51146.9us
I20260709 12:15:31.473630  9985 consensus_queue.cc:237] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:31.475479 10780 raft_consensus.cc:2804] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:31.476101 10780 raft_consensus.cc:697] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:31.480572 10780 consensus_queue.cc:237] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:31.496850  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:31.499419  5196 raft_consensus.cc:3060] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:15:31.513576 10217 consensus_queue.cc:1048] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:15:31.539816 10772 consensus_queue.cc:1048] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
W20260709 12:15:31.612144 10786 log.cc:927] Time spent T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:15:31.612557  5195 raft_consensus.cc:1275] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 12:15:31.630959 10783 log.cc:927] Time spent T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 12:15:31.632594  5192 raft_consensus.cc:1240] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Rejecting Update request from peer 9e794b72ed7640219f90ec4232363929 for earlier term 10. Current term is 11. Ops: []
W20260709 12:15:31.636904  5240 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:31.641922  5196 raft_consensus.cc:2468] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 15.
I20260709 12:15:31.673456  5198 raft_consensus.cc:1275] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:15:31.680672  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 71809.1us
I20260709 12:15:31.689073  5020 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50918 (request call id 230) took 10457 ms. Trace:
I20260709 12:15:31.692466  5020 rpcz_store.cc:276] 0709 12:15:21.231364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:21.231719 (+   355us) service_pool.cc:224] Handling call
0709 12:15:31.688778 (+10457059us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:15:30.989614 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:15:31.053083 (+ 63469us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:15:31.053137 (+    54us) write_op.cc:435] Acquired schema lock
0709 12:15:31.053156 (+    19us) tablet.cc:662] Decoding operations
0709 12:15:31.053943 (+   787us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:15:31.054002 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 12:15:31.054036 (+    34us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:15:31.054558 (+   522us) tablet.cc:701] Row locks acquired
0709 12:15:31.054577 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:15:31.054742 (+   165us) write_op.cc:270] Start()
0709 12:15:31.054865 (+   123us) write_op.cc:276] Timestamp: P: 1783599331054685 usec, L: 0
0709 12:15:31.054886 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:15:31.073171 (+ 18285us) log.cc:844] Serialized 2448 byte log entry
0709 12:15:31.091471 (+ 18300us) op_driver.cc:464] REPLICATION: finished
0709 12:15:31.096397 (+  4926us) write_op.cc:301] APPLY: starting
0709 12:15:31.096539 (+   142us) tablet.cc:1367] starting BulkCheckPresence
0709 12:15:31.100998 (+  4459us) tablet.cc:1370] finished BulkCheckPresence
0709 12:15:31.101073 (+    75us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:15:31.105506 (+  4433us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:15:31.106301 (+   795us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 12:15:31.106347 (+    46us) write_op.cc:312] APPLY: finished
0709 12:15:31.242741 (+136394us) log.cc:844] Serialized 65 byte log entry
0709 12:15:31.245580 (+  2839us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:31.245946 (+   366us) write_op.cc:454] Released schema lock
0709 12:15:31.246053 (+   107us) write_op.cc:341] FINISH: Updating metrics
0709 12:15:31.246902 (+   849us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:31.246937 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":356299,"reported_tablets":39,"child_traces":[["op",{"apply.queue_time_us":545,"apply.run_cpu_time_us":9087,"apply.run_wall_time_us":150384,"cfile_cache_hit":24,"cfile_cache_hit_bytes":25068,"num_ops":6,"prepare.queue_time_us":1517,"prepare.run_cpu_time_us":4272,"prepare.run_wall_time_us":103207,"replication_time_us":32112}]]}
I20260709 12:15:31.694512 10552 consensus_queue.cc:1048] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 12:15:31.768692  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:31.769551  5164 leader_election.cc:304] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:31.780516  5272 raft_consensus.cc:1275] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:15:31.782506 10533 raft_consensus.cc:2749] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:31.783555 10769 consensus_queue.cc:1048] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:15:31.826546 10760 consensus_queue.cc:1048] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:15:31.980777  5021 catalog_manager.cc:5697] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 10 to 13, leader changed from bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 13 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:32.031131  5271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34668
I20260709 12:15:32.032001  5271 raft_consensus.cc:606] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 11 LEADER]: Received request to transfer leadership
W20260709 12:15:32.032508 10792 log.cc:927] Time spent T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 12:15:32.047305  5021 catalog_manager.cc:5697] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 12 to 13, leader changed from bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 13 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:32.052073  5021 catalog_manager.cc:5697] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:15:32.063030  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 143227us
I20260709 12:15:32.067762  5125 raft_consensus.cc:1275] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:15:32.069342  5274 raft_consensus.cc:1275] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:15:32.068368  5021 catalog_manager.cc:5697] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 7 to 16, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 16 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:32.101658 10776 consensus_queue.cc:1048] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:15:32.138712  5270 raft_consensus.cc:1275] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:15:32.141170 10643 consensus_queue.cc:1048] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:15:32.154918 10752 raft_consensus.cc:993] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929: : Instructing follower bce73265e27d4b30a4dcc1e491305088 to start an election
I20260709 12:15:32.162751 10779 consensus_queue.cc:1048] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:15:32.163931 10811 log.cc:927] Time spent T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:15:32.181237 10757 raft_consensus.cc:1081] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 11 LEADER]: Signalling peer bce73265e27d4b30a4dcc1e491305088 to start an election
W20260709 12:15:32.253649  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 72782.9us
W20260709 12:15:32.269997  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 73930.6us
W20260709 12:15:32.259739  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 100811us
I20260709 12:15:32.274919 10761 consensus_queue.cc:1048] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:15:32.286370  5270 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34668
I20260709 12:15:32.299502  5270 raft_consensus.cc:606] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 11 LEADER]: Received request to transfer leadership
W20260709 12:15:32.299602  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 76943.8us
I20260709 12:15:32.325323  5268 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34668
I20260709 12:15:32.326012  5268 raft_consensus.cc:606] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 11 LEADER]: Received request to transfer leadership
I20260709 12:15:32.350628  5192 raft_consensus.cc:1275] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 12:15:32.349555  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 55708.4us
I20260709 12:15:32.370376  5199 raft_consensus.cc:1275] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:15:32.372680  5268 raft_consensus.cc:1275] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:15:32.390118 10734 consensus_queue.cc:1048] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 12:15:32.412249 10776 consensus_queue.cc:1048] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:15:32.447448  5832 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4"
dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
 from {username='slave'} at 127.0.0.1:46088
I20260709 12:15:32.476137  5832 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:32.476589  5832 raft_consensus.cc:3060] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:32.443672 10552 consensus_queue.cc:1048] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:15:32.536664  5832 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:32.541059  5832 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:32.544497  5124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:32.545267  5124 raft_consensus.cc:3060] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:15:32.590631  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 133422us
I20260709 12:15:32.590813  5124 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 12.
W20260709 12:15:32.598800  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 107305us
I20260709 12:15:32.640678  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:32.641628  5268 raft_consensus.cc:3055] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:32.641997  5268 raft_consensus.cc:740] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:32.640724  5198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:32.648948  5268 consensus_queue.cc:260] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:32.654103  5198 raft_consensus.cc:3060] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:32.677978  5268 raft_consensus.cc:3060] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:15:32.722106  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 167001us
I20260709 12:15:32.724812  5268 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 12.
I20260709 12:15:32.741796  5198 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 12.
I20260709 12:15:32.752163  5801 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:32.755447 10763 raft_consensus.cc:2804] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:32.756013 10763 raft_consensus.cc:697] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 12 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:15:32.757052 10763 consensus_queue.cc:237] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:32.774601  5071 auto_rebalancer.cc:893] Removing replace marker failed: Replica 9e794b72ed7640219f90ec4232363929 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
W20260709 12:15:32.775072  5071 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for ddd16ccf58f24f6db29e5fc39a06e5c4 already in progress
W20260709 12:15:32.775388  5071 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for ddd16ccf58f24f6db29e5fc39a06e5c4 already in progress
I20260709 12:15:32.837152  5023 catalog_manager.cc:5697] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 10 to 12, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 12 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:32.864626  5021 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33888 (request call id 338) took 9020 ms. Trace:
I20260709 12:15:32.866317  5186 tablet_service.cc:1558] Processing DeleteTablet for tablet 756d32b8c4d642a6955517f66ac5bb45 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 6 (current committed config index is 11)) from {username='slave'} at 127.0.0.1:47718
I20260709 12:15:32.865023  5021 rpcz_store.cc:276] 0709 12:15:23.850534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:23.853619 (+  3085us) service_pool.cc:224] Handling call
0709 12:15:24.901566 (+1047947us) spinlock_profiling.cc:243] Waited 37.4 ms on lock 0x7b540026ff54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2d090 00007f84e6bcbf3a 00007f84ec981e9c 00007f84eca8004e 00007f84eaf412a4 00007f84eaf41232 00007f84eaf41161 00007f84eaf410dc 00007f84eaf40392 00007f84e4efe48c 00007f84e4efd8c6
0709 12:15:32.139633 (+7238067us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:32.139663 (+    30us) write_op.cc:454] Released schema lock
0709 12:15:32.864562 (+724899us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:15:32.115850 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:15:32.116393 (+   543us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:15:32.116431 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:15:32.116448 (+    17us) tablet.cc:662] Decoding operations
0709 12:15:32.117038 (+   590us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:15:32.117093 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 12:15:32.117122 (+    29us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:15:32.117535 (+   413us) tablet.cc:701] Row locks acquired
0709 12:15:32.117555 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:15:32.117708 (+   153us) write_op.cc:270] Start()
0709 12:15:32.117837 (+   129us) write_op.cc:276] Timestamp: P: 1783599332117662 usec, L: 0
0709 12:15:32.117862 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:15:32.118533 (+   671us) log.cc:844] Serialized 1686 byte log entry
0709 12:15:32.121071 (+  2538us) op_driver.cc:464] REPLICATION: finished
0709 12:15:32.121847 (+   776us) write_op.cc:301] APPLY: starting
0709 12:15:32.121933 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 12:15:32.124860 (+  2927us) tablet.cc:1370] finished BulkCheckPresence
0709 12:15:32.124976 (+   116us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:15:32.134788 (+  9812us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:15:32.134961 (+   173us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 12:15:32.135009 (+    48us) write_op.cc:312] APPLY: finished
0709 12:15:32.135250 (+   241us) log.cc:844] Serialized 49 byte log entry
0709 12:15:32.136425 (+  1175us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:32.136533 (+   108us) write_op.cc:454] Released schema lock
0709 12:15:32.136578 (+    45us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":5641,"reported_tablets":47,"spinlock_wait_cycles":86097152,"child_traces":[["op",{"apply.queue_time_us":352,"apply.run_cpu_time_us":7284,"apply.run_wall_time_us":15067,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16712,"num_ops":4,"prepare.queue_time_us":122,"prepare.run_cpu_time_us":3004,"prepare.run_wall_time_us":4909,"replication_time_us":3068}]]}
I20260709 12:15:32.903102  5271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
mode: GRACEFUL
new_leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
 from {username='slave'} at 127.0.0.1:43644
I20260709 12:15:32.903779  5271 raft_consensus.cc:606] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 15 LEADER]: Received request to transfer leadership to TS ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:32.922771  5271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
mode: GRACEFUL
new_leader_uuid: "bce73265e27d4b30a4dcc1e491305088"
 from {username='slave'} at 127.0.0.1:43644
I20260709 12:15:32.923365  5271 raft_consensus.cc:606] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 14 LEADER]: Received request to transfer leadership to TS bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:32.924386  5007 catalog_manager.cc:5028] TS dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): tablet 756d32b8c4d642a6955517f66ac5bb45 (table test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]) successfully deleted
I20260709 12:15:32.930600  5271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
mode: GRACEFUL
new_leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
 from {username='slave'} at 127.0.0.1:43644
I20260709 12:15:32.931326  5271 raft_consensus.cc:606] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 13 LEADER]: Received request to transfer leadership to TS ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:32.935177  5192 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a"
dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
mode: GRACEFUL
new_leader_uuid: "bce73265e27d4b30a4dcc1e491305088"
 from {username='slave'} at 127.0.0.1:53902
I20260709 12:15:32.935776  5192 raft_consensus.cc:606] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Received request to transfer leadership to TS bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:32.936146  5192 raft_consensus.cc:614] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:15:32.938918  5192 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61"
dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
mode: GRACEFUL
new_leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
 from {username='slave'} at 127.0.0.1:53902
I20260709 12:15:32.939527  5192 raft_consensus.cc:606] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 LEADER]: Received request to transfer leadership to TS ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:32.940764  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:15:32.942523  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:32.943616  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:32.975570 10777 raft_consensus.cc:993] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808: : Instructing follower ad2f9a1e2f7a45429fa69fd23d09f821 to start an election
I20260709 12:15:32.976166 10777 raft_consensus.cc:1081] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 LEADER]: Signalling peer ad2f9a1e2f7a45429fa69fd23d09f821 to start an election
I20260709 12:15:32.981098  5118 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
 from {username='slave'} at 127.0.0.1:40386
I20260709 12:15:32.981875  5118 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:32.982259  5118 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:33.009078  5118 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:33.014560  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:33.015206  5192 raft_consensus.cc:3055] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:15:33.015501  5192 raft_consensus.cc:740] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:33.015954  5118 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 16 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:33.017575  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:33.018224  5271 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:33.023916 10757 raft_consensus.cc:993] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929: : Instructing follower ad2f9a1e2f7a45429fa69fd23d09f821 to start an election
I20260709 12:15:33.024557 10757 raft_consensus.cc:1081] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 13 LEADER]: Signalling peer ad2f9a1e2f7a45429fa69fd23d09f821 to start an election
I20260709 12:15:33.029579  5120 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
 from {username='slave'} at 127.0.0.1:40402
I20260709 12:15:33.030198  5120 raft_consensus.cc:493] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:33.030558  5120 raft_consensus.cc:3060] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:33.028443  5192 consensus_queue.cc:260] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:33.040417  5271 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 16.
I20260709 12:15:33.041096  5274 raft_consensus.cc:1240] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Rejecting Update request from peer dd62e75bd3ed4ed28f1fb5955d650808 for earlier term 15. Current term is 16. Ops: []
I20260709 12:15:33.042557  5192 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:33.041744  5088 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:15:33.045418 10824 raft_consensus.cc:2804] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:15:33.045980 10824 raft_consensus.cc:697] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:33.046975 10824 consensus_queue.cc:237] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:33.053030  5192 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 16.
I20260709 12:15:33.061996  5120 raft_consensus.cc:515] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:33.070283  5120 leader_election.cc:290] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 election: Requested vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:33.071734  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:33.072414  5830 raft_consensus.cc:3060] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:33.071905  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:33.076676  5271 raft_consensus.cc:3055] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:33.077032  5271 raft_consensus.cc:740] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:33.078370  5271 consensus_queue.cc:260] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:33.087813  5271 raft_consensus.cc:3060] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:33.112648  5830 raft_consensus.cc:2468] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 14.
I20260709 12:15:33.114271  5089 leader_election.cc:304] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:15:33.115247 10552 raft_consensus.cc:2804] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:33.115738 10552 raft_consensus.cc:697] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:33.117369  5271 raft_consensus.cc:2468] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 14.
I20260709 12:15:33.116659 10552 consensus_queue.cc:237] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:33.144721 10739 raft_consensus.cc:993] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929: : Instructing follower ad2f9a1e2f7a45429fa69fd23d09f821 to start an election
I20260709 12:15:33.145314 10767 raft_consensus.cc:1081] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 15 LEADER]: Signalling peer ad2f9a1e2f7a45429fa69fd23d09f821 to start an election
I20260709 12:15:33.153620  5118 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
 from {username='slave'} at 127.0.0.1:40402
I20260709 12:15:33.154157  5118 raft_consensus.cc:493] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:33.154511  5118 raft_consensus.cc:3060] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:33.177042  5120 raft_consensus.cc:1275] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:15:33.164930  5118 raft_consensus.cc:515] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:33.182735 10707 consensus_queue.cc:1048] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:15:33.184705  5118 leader_election.cc:290] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 16 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:33.185428  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: true dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:33.186079  5192 raft_consensus.cc:3060] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:33.190641  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: true dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:33.191295  5271 raft_consensus.cc:3055] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:15:33.191606  5271 raft_consensus.cc:740] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:33.192356  5271 consensus_queue.cc:260] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:33.193506  5271 raft_consensus.cc:3060] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:33.198608  5192 raft_consensus.cc:2468] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 16.
I20260709 12:15:33.200237  5271 raft_consensus.cc:2468] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 16.
I20260709 12:15:33.207626  5088 leader_election.cc:304] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 
I20260709 12:15:33.205273  5018 catalog_manager.cc:5697] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 13 to 14, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 14 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:33.211151  5018 catalog_manager.cc:5697] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 12 to 14, leader changed from bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 14 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:33.211730 10552 raft_consensus.cc:2804] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:15:33.213050 10552 raft_consensus.cc:697] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:33.217337 10552 consensus_queue.cc:237] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:33.214221  5018 catalog_manager.cc:5697] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:33.221058  5018 catalog_manager.cc:5697] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 10 to 11, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 11 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:33.223425  5018 catalog_manager.cc:5697] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 15 to 16, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 16 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:33.227784  5018 catalog_manager.cc:5697] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 14 to 15, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 15 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:33.231734  5018 catalog_manager.cc:5697] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 8 to 10, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 10 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:15:33.234861  5023 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58198 (request call id 329) took 11569 ms (client timeout 15000 ms). Trace:
I20260709 12:15:33.234709  5018 catalog_manager.cc:5697] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 12 to 15, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 15 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:33.243188  5271 raft_consensus.cc:1275] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 12:15:33.235275  5023 rpcz_store.cc:269] 0709 12:15:21.665743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:21.665968 (+   225us) service_pool.cc:224] Handling call
0709 12:15:33.234798 (+11568830us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:15:33.025201 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:15:33.043271 (+ 18070us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:15:33.043610 (+   339us) write_op.cc:435] Acquired schema lock
0709 12:15:33.043637 (+    27us) tablet.cc:662] Decoding operations
0709 12:15:33.043982 (+   345us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:15:33.044050 (+    68us) write_op.cc:641] Partition lock acquired for write op
0709 12:15:33.044084 (+    34us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:15:33.044249 (+   165us) tablet.cc:701] Row locks acquired
0709 12:15:33.044266 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:15:33.044395 (+   129us) write_op.cc:270] Start()
0709 12:15:33.044506 (+   111us) write_op.cc:276] Timestamp: P: 1783599333044350 usec, L: 0
0709 12:15:33.044528 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:15:33.045176 (+   648us) log.cc:844] Serialized 536 byte log entry
0709 12:15:33.123091 (+ 77915us) op_driver.cc:464] REPLICATION: finished
0709 12:15:33.124807 (+  1716us) write_op.cc:301] APPLY: starting
0709 12:15:33.124897 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 12:15:33.126112 (+  1215us) tablet.cc:1370] finished BulkCheckPresence
0709 12:15:33.126217 (+   105us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:15:33.126946 (+   729us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:15:33.127119 (+   173us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:15:33.127173 (+    54us) write_op.cc:312] APPLY: finished
0709 12:15:33.127372 (+   199us) log.cc:844] Serialized 25 byte log entry
0709 12:15:33.127541 (+   169us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:33.127624 (+    83us) write_op.cc:454] Released schema lock
0709 12:15:33.127665 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 12:15:33.129211 (+  1546us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:33.129243 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":256903,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":1079,"apply.run_cpu_time_us":3265,"apply.run_wall_time_us":4736,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8305,"num_ops":1,"prepare.queue_time_us":139076,"prepare.run_cpu_time_us":2668,"prepare.run_wall_time_us":20264,"replication_time_us":78444,"thread_start_us":97750,"threads_started":2}]]}
I20260709 12:15:33.249843 10776 consensus_queue.cc:1048] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:15:33.310106 10767 raft_consensus.cc:993] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929: : Instructing follower bce73265e27d4b30a4dcc1e491305088 to start an election
I20260709 12:15:33.310639 10767 raft_consensus.cc:1081] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 14 LEADER]: Signalling peer bce73265e27d4b30a4dcc1e491305088 to start an election
I20260709 12:15:33.317546  5832 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0"
dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
 from {username='slave'} at 127.0.0.1:46088
I20260709 12:15:33.318208  5832 raft_consensus.cc:493] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:33.318852  5832 raft_consensus.cc:3060] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:33.330286  5192 raft_consensus.cc:1275] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:15:33.338706  5832 raft_consensus.cc:515] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:33.347422  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:33.348287  5832 leader_election.cc:290] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:33.349274  5192 raft_consensus.cc:3060] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:33.349326  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c65b96548e49b3863d03db116fd8d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:33.352034  5268 raft_consensus.cc:3055] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:15:33.352603  5268 raft_consensus.cc:740] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:33.339583 10758 consensus_queue.cc:1048] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 12:15:33.358217  5268 consensus_queue.cc:260] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:33.361899  5268 raft_consensus.cc:3060] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:33.385614  5192 raft_consensus.cc:2468] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 15.
I20260709 12:15:33.395514  5801 leader_election.cc:304] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:33.398001  5020 catalog_manager.cc:5697] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 13 to 15, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 15 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } }
I20260709 12:15:33.405776 10776 raft_consensus.cc:2804] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:33.419111  5018 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50918 (request call id 231) took 1076 ms. Trace:
I20260709 12:15:33.419374 10776 raft_consensus.cc:697] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 15 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:15:33.422475 10776 consensus_queue.cc:237] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:33.425836  5268 raft_consensus.cc:2468] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 15.
I20260709 12:15:33.438369  5020 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33896 (request call id 327) took 1025 ms. Trace:
I20260709 12:15:33.449456  5021 catalog_manager.cc:5697] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 10 to 11, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 11 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } }
I20260709 12:15:33.452773  5021 catalog_manager.cc:5697] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 15 to 16, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 16 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } }
I20260709 12:15:33.445586  5020 rpcz_store.cc:276] 0709 12:15:32.412773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:32.413933 (+  1160us) service_pool.cc:224] Handling call
0709 12:15:33.438306 (+1024373us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:15:33.409677 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:15:33.410201 (+   524us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:15:33.410238 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:15:33.410251 (+    13us) tablet.cc:662] Decoding operations
0709 12:15:33.410583 (+   332us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:15:33.410635 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 12:15:33.410664 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:15:33.410832 (+   168us) tablet.cc:701] Row locks acquired
0709 12:15:33.410848 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:15:33.410995 (+   147us) write_op.cc:270] Start()
0709 12:15:33.411130 (+   135us) write_op.cc:276] Timestamp: P: 1783599333410944 usec, L: 0
0709 12:15:33.411147 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 12:15:33.411832 (+   685us) log.cc:844] Serialized 541 byte log entry
0709 12:15:33.414112 (+  2280us) op_driver.cc:464] REPLICATION: finished
0709 12:15:33.421604 (+  7492us) write_op.cc:301] APPLY: starting
0709 12:15:33.421695 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 12:15:33.422524 (+   829us) tablet.cc:1370] finished BulkCheckPresence
0709 12:15:33.422613 (+    89us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:15:33.423370 (+   757us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:15:33.423521 (+   151us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:15:33.423560 (+    39us) write_op.cc:312] APPLY: finished
0709 12:15:33.423749 (+   189us) log.cc:844] Serialized 25 byte log entry
0709 12:15:33.433536 (+  9787us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:33.433621 (+    85us) write_op.cc:454] Released schema lock
0709 12:15:33.433663 (+    42us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":373893,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":7232,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4178,"num_ops":1,"prepare.queue_time_us":8184,"prepare.run_cpu_time_us":2453,"prepare.run_wall_time_us":2452,"replication_time_us":2817}]]}
I20260709 12:15:33.419615  5018 rpcz_store.cc:276] 0709 12:15:32.343121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:15:32.344033 (+   912us) service_pool.cc:224] Handling call
0709 12:15:33.418982 (+1074949us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:15:33.254757 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:15:33.258335 (+  3578us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:15:33.259573 (+  1238us) write_op.cc:435] Acquired schema lock
0709 12:15:33.260212 (+   639us) tablet.cc:662] Decoding operations
0709 12:15:33.270284 (+ 10072us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:15:33.271066 (+   782us) write_op.cc:641] Partition lock acquired for write op
0709 12:15:33.271828 (+   762us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:15:33.283569 (+ 11741us) tablet.cc:701] Row locks acquired
0709 12:15:33.283590 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:15:33.283755 (+   165us) write_op.cc:270] Start()
0709 12:15:33.283863 (+   108us) write_op.cc:276] Timestamp: P: 1783599333283711 usec, L: 0
0709 12:15:33.283882 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:15:33.285004 (+  1122us) log.cc:844] Serialized 3281 byte log entry
0709 12:15:33.286975 (+  1971us) op_driver.cc:464] REPLICATION: finished
0709 12:15:33.287313 (+   338us) write_op.cc:301] APPLY: starting
0709 12:15:33.287400 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 12:15:33.291726 (+  4326us) tablet.cc:1370] finished BulkCheckPresence
0709 12:15:33.291835 (+   109us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:15:33.389836 (+ 98001us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:15:33.390024 (+   188us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 12:15:33.390081 (+    57us) write_op.cc:312] APPLY: finished
0709 12:15:33.390335 (+   254us) log.cc:844] Serialized 81 byte log entry
0709 12:15:33.390502 (+   167us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:33.390621 (+   119us) write_op.cc:454] Released schema lock
0709 12:15:33.390665 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 12:15:33.390995 (+   330us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:15:33.391025 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":377644,"reported_tablets":32,"child_traces":[["op",{"apply.queue_time_us":111,"apply.run_cpu_time_us":13382,"apply.run_wall_time_us":103653,"cfile_cache_hit":32,"cfile_cache_hit_bytes":33424,"num_ops":8,"prepare.queue_time_us":2200,"prepare.run_cpu_time_us":4408,"prepare.run_wall_time_us":32075,"replication_time_us":2966}]]}
I20260709 12:15:33.494146  5268 raft_consensus.cc:1275] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:15:33.505038 10552 consensus_queue.cc:1048] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 12:15:33.562613  5020 catalog_manager.cc:5697] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 13 to 14, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 14 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:33.564611  5020 catalog_manager.cc:5697] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 15 to 16, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 16 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:33.566915  5020 catalog_manager.cc:5697] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 11 to 12, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 12 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:33.573936  5020 catalog_manager.cc:5697] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 15 to 16, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 16 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:33.591944  5197 raft_consensus.cc:1275] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:15:33.596181  5197 consensus_queue.cc:237] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:33.606877 10824 consensus_queue.cc:1048] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:15:33.680786  5830 raft_consensus.cc:1275] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:15:33.694746  5018 catalog_manager.cc:5697] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 14 to 15, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 15 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:33.707921 10777 consensus_queue.cc:1048] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:15:33.735667  5268 raft_consensus.cc:1275] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:15:33.767447 10824 consensus_queue.cc:1048] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 12:15:33.776273  5268 raft_consensus.cc:1275] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:15:33.787411  5832 raft_consensus.cc:1275] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:15:33.789371  5118 raft_consensus.cc:1275] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:15:33.792182 10854 consensus_queue.cc:1048] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:15:33.792632 10552 consensus_queue.cc:1048] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:15:33.795670 10777 consensus_queue.cc:1048] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 12:15:33.806945  5198 raft_consensus.cc:1275] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:15:33.819027 10552 consensus_queue.cc:1048] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:15:33.836438  5830 raft_consensus.cc:2955] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 4 to 12, VOTER 9e794b72ed7640219f90ec4232363929 (127.3.212.131) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:33.820092 10851 raft_consensus.cc:2955] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 4 to 12, VOTER 9e794b72ed7640219f90ec4232363929 (127.3.212.131) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:33.950841  5274 raft_consensus.cc:1275] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 12:15:34.001215 10869 log.cc:927] Time spent T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:15:34.029861  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:15:34.025213 10866 log.cc:927] Time spent T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 12:15:34.101861  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 103482us
W20260709 12:15:34.137633  5089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 85819.3us
W20260709 12:15:34.150264  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 107356us
W20260709 12:15:34.152715 10868 log.cc:927] Time spent T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
W20260709 12:15:34.217273 10874 log.cc:927] Time spent T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 12:15:34.231604  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 161913us
W20260709 12:15:34.230945 10870 log.cc:927] Time spent T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
I20260709 12:15:34.204834 10707 consensus_queue.cc:1048] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 12:15:34.436841  5007 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ecdd526dba8b4d84859ef5f6ee618387 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:15:34.486323  5191 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8"
dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
mode: GRACEFUL
new_leader_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:53902
I20260709 12:15:34.487020  5191 raft_consensus.cc:606] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 LEADER]: Received request to transfer leadership to TS 9e794b72ed7640219f90ec4232363929
W20260709 12:15:34.516880  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 49618.8us
I20260709 12:15:34.530409  5191 raft_consensus.cc:1275] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 12:15:34.550117  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 47245.7us
I20260709 12:15:34.593567  5829 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f"
dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
mode: GRACEFUL
new_leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
 from {username='slave'} at 127.0.0.1:47004
I20260709 12:15:34.594204  5829 raft_consensus.cc:606] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 14 LEADER]: Received request to transfer leadership to TS ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:34.617453  5195 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f"
dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
mode: GRACEFUL
new_leader_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:53902
I20260709 12:15:34.618252  5195 raft_consensus.cc:606] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 LEADER]: Received request to transfer leadership to TS 9e794b72ed7640219f90ec4232363929
I20260709 12:15:34.628440 10853 consensus_queue.cc:1048] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:15:34.633648 10852 raft_consensus.cc:993] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088: : Instructing follower ad2f9a1e2f7a45429fa69fd23d09f821 to start an election
I20260709 12:15:34.635164 10852 raft_consensus.cc:1081] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 14 LEADER]: Signalling peer ad2f9a1e2f7a45429fa69fd23d09f821 to start an election
I20260709 12:15:34.655319  5121 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
 from {username='slave'} at 127.0.0.1:59390
I20260709 12:15:34.655916  5121 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:34.656311  5121 raft_consensus.cc:3060] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:34.670759  5023 catalog_manager.cc:5697] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: config changed from index 4 to 12, VOTER 9e794b72ed7640219f90ec4232363929 (127.3.212.131) evicted. New cstate: current_term: 16 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:34.675303  5831 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4"
dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
mode: GRACEFUL
new_leader_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:47004
I20260709 12:15:34.676064  5831 raft_consensus.cc:606] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 12 LEADER]: Received request to transfer leadership to TS 9e794b72ed7640219f90ec4232363929
I20260709 12:15:34.680507  5195 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3beaf3ce31042719868401157039ee9"
dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
mode: GRACEFUL
new_leader_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:53902
I20260709 12:15:34.680899  5118 raft_consensus.cc:2955] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 4 to 12, VOTER 9e794b72ed7640219f90ec4232363929 (127.3.212.131) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:34.691673  5195 raft_consensus.cc:606] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 LEADER]: Received request to transfer leadership to TS 9e794b72ed7640219f90ec4232363929
I20260709 12:15:34.693305  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:15:34.809639  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 193596us
I20260709 12:15:34.821715  5121 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:34.831930  5121 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 15 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:34.835778  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:34.837831  5831 raft_consensus.cc:3055] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:15:34.836215  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:34.839102  5195 raft_consensus.cc:3060] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:34.838244  5831 raft_consensus.cc:740] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
W20260709 12:15:34.849061  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 63709.8us
I20260709 12:15:34.845917  5831 consensus_queue.cc:260] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:34.876396  5831 raft_consensus.cc:3060] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:34.888000 10826 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:34.888913 10826 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:34.884886  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 54911.7us
W20260709 12:15:34.915604  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 50301.3us
I20260709 12:15:34.888190  5196 consensus_queue.cc:237] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:15:34.954752 10826 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:34.964869  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" is_pre_election: true
I20260709 12:15:34.967058  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:34.978183  5195 raft_consensus.cc:2468] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 15.
I20260709 12:15:34.980618  5831 raft_consensus.cc:2468] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 15.
I20260709 12:15:35.000722  5089 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:15:35.001783  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:35.024406  5238 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:35.006379 10854 raft_consensus.cc:2804] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:35.047616 10854 raft_consensus.cc:697] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:35.081453 10904 raft_consensus.cc:2749] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:35.087734  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:15:35.125623  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 68888.8us
W20260709 12:15:35.128217  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 49423us
I20260709 12:15:35.134681 10854 consensus_queue.cc:237] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:35.171387 10875 raft_consensus.cc:993] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088: : Instructing follower 9e794b72ed7640219f90ec4232363929 to start an election
I20260709 12:15:35.171916 10875 raft_consensus.cc:1081] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 12 LEADER]: Signalling peer 9e794b72ed7640219f90ec4232363929 to start an election
I20260709 12:15:35.182065  5271 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:50932
I20260709 12:15:35.182772  5271 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:35.183401  5271 raft_consensus.cc:3060] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:35.210160  5271 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:35.216889 10867 raft_consensus.cc:993] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808: : Instructing follower 9e794b72ed7640219f90ec4232363929 to start an election
I20260709 12:15:35.217509 10867 raft_consensus.cc:1081] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 LEADER]: Signalling peer 9e794b72ed7640219f90ec4232363929 to start an election
I20260709 12:15:35.224571  5125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
I20260709 12:15:35.225214  5125 raft_consensus.cc:3060] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:35.227048  5271 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:35.229811  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:35.230356  5838 raft_consensus.cc:3055] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:15:35.230563  5838 raft_consensus.cc:740] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:15:35.231169  5838 consensus_queue.cc:260] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:35.234078  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:35.237769  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:35.238366  5193 raft_consensus.cc:3060] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:35.244212  5125 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 13.
I20260709 12:15:35.247107  5193 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 13.
I20260709 12:15:35.257542 10899 raft_consensus.cc:993] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808: : Instructing follower 9e794b72ed7640219f90ec4232363929 to start an election
I20260709 12:15:35.258107 10899 raft_consensus.cc:1081] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 LEADER]: Signalling peer 9e794b72ed7640219f90ec4232363929 to start an election
I20260709 12:15:35.265511  5265 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:34672
I20260709 12:15:35.266228  5265 raft_consensus.cc:493] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 12:15:35.265976  5164 consensus_peers.cc:597] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Couldn't send request to peer bce73265e27d4b30a4dcc1e491305088. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fe3c5015888a494085f9a8b6eb204bcf. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:35.267735  5265 raft_consensus.cc:3060] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:35.271245  5237 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:35.272194 10903 raft_consensus.cc:2804] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:35.272768 10903 raft_consensus.cc:697] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 13 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:35.276415 10903 consensus_queue.cc:237] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:35.280314  5274 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:34672
I20260709 12:15:35.280967  5274 raft_consensus.cc:493] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:35.281358  5274 raft_consensus.cc:3060] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:35.292488  5269 raft_consensus.cc:1275] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 18 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:15:35.277248  5265 raft_consensus.cc:515] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:35.300221  5199 raft_consensus.cc:1240] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Rejecting Update request from peer bce73265e27d4b30a4dcc1e491305088 for earlier term 12. Current term is 13. Ops: []
I20260709 12:15:35.302736  5125 raft_consensus.cc:1275] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 18 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:15:35.304463 10914 consensus_queue.cc:1048] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:15:35.307133 10897 raft_consensus.cc:993] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808: : Instructing follower 9e794b72ed7640219f90ec4232363929 to start an election
I20260709 12:15:35.307682 10750 raft_consensus.cc:1081] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 LEADER]: Signalling peer 9e794b72ed7640219f90ec4232363929 to start an election
I20260709 12:15:35.325920  5265 leader_election.cc:290] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:35.324674  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:35.330066  5199 raft_consensus.cc:3055] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:35.331959  5838 raft_consensus.cc:3060] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:35.332058  5199 raft_consensus.cc:740] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:35.333024  5274 raft_consensus.cc:515] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:35.334133  5263 tablet_service.cc:1558] Processing DeleteTablet for tablet ecdd526dba8b4d84859ef5f6ee618387 with delete_type TABLET_DATA_TOMBSTONED (TS 9e794b72ed7640219f90ec4232363929 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:34668
I20260709 12:15:35.324600 10914 consensus_queue.cc:1048] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 12:15:35.346602  5199 consensus_queue.cc:260] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:35.347874  5199 raft_consensus.cc:3060] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:15:35.359966  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 62027.5us
I20260709 12:15:35.367630  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:35.368253  5831 raft_consensus.cc:3060] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:35.366534  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:35.368942  5193 raft_consensus.cc:3055] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:15:35.369239  5193 raft_consensus.cc:740] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:35.369901  5193 consensus_queue.cc:260] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:35.376075  5274 leader_election.cc:290] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:35.377964  5271 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e3beaf3ce31042719868401157039ee9"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
 from {username='slave'} at 127.0.0.1:34672
I20260709 12:15:35.378628  5271 raft_consensus.cc:493] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:35.378995  5271 raft_consensus.cc:3060] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:35.381731  5193 raft_consensus.cc:3060] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:35.368551  5018 catalog_manager.cc:5697] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 14 to 15, leader changed from bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 15 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:35.390300  5838 raft_consensus.cc:2468] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 13.
I20260709 12:15:35.394903  5193 raft_consensus.cc:2468] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 14.
I20260709 12:15:35.409034  5831 raft_consensus.cc:2468] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 14.
I20260709 12:15:35.406270  5237 leader_election.cc:304] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:35.420783 10888 raft_consensus.cc:2955] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 18 LEADER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:15:35.442104  5118 raft_consensus.cc:2955] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:15:35.449026  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90cb6c9306054ce3b2bc1bbd21c7345f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:35.449694  5831 raft_consensus.cc:3060] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:15:35.460673  5238 leader_election.cc:304] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:15:35.461674  5271 raft_consensus.cc:515] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:35.441108 10903 raft_consensus.cc:2804] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:35.468426  5831 raft_consensus.cc:2468] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 14.
I20260709 12:15:35.477931  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:35.479537  5197 raft_consensus.cc:3055] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:15:35.470742 10903 raft_consensus.cc:697] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 14 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:35.479804  5197 raft_consensus.cc:740] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:35.484112  5271 leader_election.cc:290] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:35.474388 10904 raft_consensus.cc:2804] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:15:35.487017 10904 raft_consensus.cc:697] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 14 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:35.480669 10903 consensus_queue.cc:237] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:35.488854 10924 tablet_replica.cc:333] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
I20260709 12:15:35.490044 10924 raft_consensus.cc:2243] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:35.490814 10924 raft_consensus.cc:2272] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:35.491700  5271 consensus_queue.cc:237] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:15:35.484790  5197 consensus_queue.cc:260] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:35.498911  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:35.499436  5831 raft_consensus.cc:3060] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:35.506970  5197 raft_consensus.cc:3060] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:35.501780  5020 catalog_manager.cc:5697] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 12 to 13, leader changed from bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 13 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:35.511523  5831 raft_consensus.cc:2468] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 15.
I20260709 12:15:35.512496  5238 leader_election.cc:304] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:15:35.513306 10760 raft_consensus.cc:2804] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:35.513859 10760 raft_consensus.cc:697] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 15 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:35.514708 10760 consensus_queue.cc:237] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:35.516305  5018 catalog_manager.cc:5697] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: config changed from index -1 to 12, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New cstate: current_term: 18 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:15:35.487960 10904 consensus_queue.cc:237] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:35.553009 10924 ts_tablet_manager.cc:1916] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:15:35.548353  5199 raft_consensus.cc:2468] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 14.
I20260709 12:15:35.585752  5835 raft_consensus.cc:1275] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:15:35.587258 10882 consensus_queue.cc:1048] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:15:35.621626  5199 raft_consensus.cc:1275] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:15:35.623472 10903 consensus_queue.cc:1048] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:35.642418  5196 raft_consensus.cc:1275] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:15:35.649863 10824 consensus_queue.cc:1048] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 12:15:35.661896 10931 ts_tablet_manager.cc:933] T fe3c5015888a494085f9a8b6eb204bcf P bce73265e27d4b30a4dcc1e491305088: Initiating tablet copy from peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:35.662245  5271 raft_consensus.cc:2955] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:15:35.662968  5018 catalog_manager.cc:5697] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 13 to 14, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 14 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:35.665309  5118 raft_consensus.cc:1275] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:15:35.665020  5018 catalog_manager.cc:5697] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 13 to 14, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 14 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:35.666781  5018 catalog_manager.cc:5697] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 14 to 15, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 15 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:35.713294  5197 raft_consensus.cc:2468] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 15.
I20260709 12:15:35.673241 10905 consensus_queue.cc:1048] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:15:35.785895  5196 raft_consensus.cc:1275] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 12:15:35.783504 10916 log.cc:927] Time spent T 00000000000000000000000000000000 P 221aa011207d421b9725197ff8bed389: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 12:15:35.793149  5238 consensus_peers.cc:597] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 -> Peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Couldn't send request to peer bce73265e27d4b30a4dcc1e491305088. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4e275c844ff54adea37252a082eae526. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:35.795508  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 72405.9us
I20260709 12:15:35.790354 10903 consensus_queue.cc:1048] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 12:15:35.827077 10931 tablet_copy_client.cc:323] T fe3c5015888a494085f9a8b6eb204bcf P bce73265e27d4b30a4dcc1e491305088: tablet copy: Beginning tablet copy session from remote peer at address 127.3.212.130:44455
I20260709 12:15:35.853037  5210 tablet_copy_service.cc:140] P dd62e75bd3ed4ed28f1fb5955d650808: Received BeginTabletCopySession request for tablet fe3c5015888a494085f9a8b6eb204bcf from peer bce73265e27d4b30a4dcc1e491305088 ({username='slave'} at 127.0.0.1:41416)
I20260709 12:15:35.853808  5210 tablet_copy_service.cc:161] P dd62e75bd3ed4ed28f1fb5955d650808: Beginning new tablet copy session on tablet fe3c5015888a494085f9a8b6eb204bcf from peer bce73265e27d4b30a4dcc1e491305088 at {username='slave'} at 127.0.0.1:41416: session id = bce73265e27d4b30a4dcc1e491305088-fe3c5015888a494085f9a8b6eb204bcf
W20260709 12:15:35.865634 10932 log.cc:927] Time spent T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.079s	user 0.000s	sys 0.002s
I20260709 12:15:35.887106  5210 tablet_copy_source_session.cc:215] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:15:35.911211  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 80940.3us
I20260709 12:15:35.929180  5121 raft_consensus.cc:1275] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:15:35.931448 10904 consensus_queue.cc:1048] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:15:35.904529 10876 raft_consensus.cc:2955] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:15:35.951805  5831 raft_consensus.cc:1275] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:15:35.945314 10924 ts_tablet_manager.cc:1929] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.11
I20260709 12:15:35.951289  5191 raft_consensus.cc:2955] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:15:35.990851 10931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe3c5015888a494085f9a8b6eb204bcf. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:15:36.017593  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 45728us
I20260709 12:15:35.973704 10924 log.cc:1199] T ecdd526dba8b4d84859ef5f6ee618387 P 9e794b72ed7640219f90ec4232363929: Deleting WAL directory at /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599103767690-3922-0/minicluster-data/ts-2-root/wals/ecdd526dba8b4d84859ef5f6ee618387
W20260709 12:15:36.028474 10932 log.cc:927] Time spent T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:15:36.035832  5007 catalog_manager.cc:5028] TS 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): tablet ecdd526dba8b4d84859ef5f6ee618387 (table test-workload [id=104cc8c8eab04c47a5a31b71ff987f9b]) successfully deleted
W20260709 12:15:36.084055  5007 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 48261.4us
W20260709 12:15:36.142134  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 70720.9us
W20260709 12:15:36.151196  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 198132us
W20260709 12:15:36.168073  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 212575us
I20260709 12:15:36.075047 10938 consensus_queue.cc:1048] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
W20260709 12:15:36.175684  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 146530us
I20260709 12:15:36.204088 10931 tablet_copy_client.cc:806] T fe3c5015888a494085f9a8b6eb204bcf P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 0 data blocks...
I20260709 12:15:36.206593  5118 raft_consensus.cc:2955] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
W20260709 12:15:36.215253  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 149107us
I20260709 12:15:36.243594  5191 raft_consensus.cc:1275] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:15:36.254884  5191 raft_consensus.cc:1275] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:15:36.219095 10931 tablet_copy_client.cc:670] T fe3c5015888a494085f9a8b6eb204bcf P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 1 WAL segments...
I20260709 12:15:36.304291  5191 raft_consensus.cc:1275] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 12:15:36.305822  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 132995us
I20260709 12:15:36.315135  5121 consensus_queue.cc:237] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:15:36.350835  5835 raft_consensus.cc:1275] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:15:36.363736  5831 raft_consensus.cc:1275] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:15:36.309966 10843 consensus_queue.cc:1048] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 12:15:36.309790 10946 consensus_queue.cc:1048] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 12:15:36.375917  5020 catalog_manager.cc:5697] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: config changed from index -1 to 10, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New cstate: current_term: 15 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:15:36.373615 10876 consensus_queue.cc:1048] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.057s
I20260709 12:15:36.431937  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:15:36.492717  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 194223us
I20260709 12:15:36.535619 10964 ts_tablet_manager.cc:933] T 4e275c844ff54adea37252a082eae526 P bce73265e27d4b30a4dcc1e491305088: Initiating tablet copy from peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:36.544975  5192 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "00645b1f1e014de995e4a937f842d909"
dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
mode: GRACEFUL
new_leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
 from {username='slave'} at 127.0.0.1:53902
W20260709 12:15:36.547688  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.StartTabletCopy -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 83765.9us
I20260709 12:15:36.545656  5192 raft_consensus.cc:606] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 LEADER]: Received request to transfer leadership to TS ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:36.557837  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:15:36.559764  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:36.560671  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:36.570672 10905 consensus_queue.cc:1048] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:15:36.570819 10903 consensus_queue.cc:1048] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:15:36.604733  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 67782.5us
I20260709 12:15:36.613090 10931 tablet_copy_client.cc:538] T fe3c5015888a494085f9a8b6eb204bcf P bce73265e27d4b30a4dcc1e491305088: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:15:36.621812 10964 tablet_copy_client.cc:323] T 4e275c844ff54adea37252a082eae526 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Beginning tablet copy session from remote peer at address 127.3.212.131:46709
W20260709 12:15:36.658262  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 270478us
I20260709 12:15:36.671597  5192 raft_consensus.cc:1275] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:15:36.682277  5271 raft_consensus.cc:1275] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:15:36.688093  5835 raft_consensus.cc:1275] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:15:36.693449  5284 tablet_copy_service.cc:140] P 9e794b72ed7640219f90ec4232363929: Received BeginTabletCopySession request for tablet 4e275c844ff54adea37252a082eae526 from peer bce73265e27d4b30a4dcc1e491305088 ({username='slave'} at 127.0.0.1:50932)
I20260709 12:15:36.694231  5284 tablet_copy_service.cc:161] P 9e794b72ed7640219f90ec4232363929: Beginning new tablet copy session on tablet 4e275c844ff54adea37252a082eae526 from peer bce73265e27d4b30a4dcc1e491305088 at {username='slave'} at 127.0.0.1:50932: session id = bce73265e27d4b30a4dcc1e491305088-4e275c844ff54adea37252a082eae526
I20260709 12:15:36.700747 10972 consensus_queue.cc:1048] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:15:36.756881  5284 tablet_copy_source_session.cc:215] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:15:36.729754 10824 consensus_queue.cc:1048] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 12:15:36.775344 10931 tablet_bootstrap.cc:492] T fe3c5015888a494085f9a8b6eb204bcf P bce73265e27d4b30a4dcc1e491305088: Bootstrap starting.
I20260709 12:15:36.776355 10964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e275c844ff54adea37252a082eae526. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:15:36.805181  5089 consensus_peers.cc:597] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 -> Peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Couldn't send request to peer bce73265e27d4b30a4dcc1e491305088. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d87fb855c56c430f896b24f98722bd61. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:36.816313 10872 consensus_queue.cc:1048] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 12:15:36.874591 10914 raft_consensus.cc:993] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808: : Instructing follower ad2f9a1e2f7a45429fa69fd23d09f821 to start an election
I20260709 12:15:36.875206 10914 raft_consensus.cc:1081] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 LEADER]: Signalling peer ad2f9a1e2f7a45429fa69fd23d09f821 to start an election
I20260709 12:15:36.885107  5124 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "00645b1f1e014de995e4a937f842d909"
dest_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821"
 from {username='slave'} at 127.0.0.1:40386
I20260709 12:15:36.911839  5124 raft_consensus.cc:493] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:36.912352  5124 raft_consensus.cc:3060] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:36.935137 10972 raft_consensus.cc:2955] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index -1 to 12, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:15:36.943034  5193 raft_consensus.cc:2955] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index -1 to 12, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:15:36.996717  5124 raft_consensus.cc:515] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:36.964323 10964 tablet_copy_client.cc:806] T 4e275c844ff54adea37252a082eae526 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 0 data blocks...
I20260709 12:15:37.008908  5124 leader_election.cc:290] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:37.012089  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:37.013698  5192 raft_consensus.cc:3055] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:15:37.014111  5192 raft_consensus.cc:740] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:37.015049  5192 consensus_queue.cc:260] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:37.018824  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:37.019400  5830 raft_consensus.cc:3060] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:37.025106  5192 raft_consensus.cc:3060] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:37.022150 10964 tablet_copy_client.cc:670] T 4e275c844ff54adea37252a082eae526 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 1 WAL segments...
I20260709 12:15:37.034163  5830 raft_consensus.cc:2468] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 12.
I20260709 12:15:37.043709  5089 leader_election.cc:304] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:15:37.046182 10954 raft_consensus.cc:2804] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:37.049626 10954 raft_consensus.cc:697] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 LEADER]: Becoming Leader. State: Replica: ad2f9a1e2f7a45429fa69fd23d09f821, State: Running, Role: LEADER
I20260709 12:15:37.051404 10954 consensus_queue.cc:237] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:37.057165 10964 tablet_copy_client.cc:538] T 4e275c844ff54adea37252a082eae526 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:15:37.036870  5018 catalog_manager.cc:5697] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: config changed from index -1 to 12, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New cstate: current_term: 16 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:15:37.083551  5192 raft_consensus.cc:2468] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2f9a1e2f7a45429fa69fd23d09f821 in term 12.
I20260709 12:15:37.092108  5271 raft_consensus.cc:2955] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index -1 to 12, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:15:37.116133 10964 tablet_bootstrap.cc:492] T 4e275c844ff54adea37252a082eae526 P bce73265e27d4b30a4dcc1e491305088: Bootstrap starting.
I20260709 12:15:37.117951  5192 consensus_queue.cc:237] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:15:37.141273  5020 catalog_manager.cc:5697] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: term changed from 11 to 12, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129). New cstate: current_term: 12 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:15:37.159662  5164 consensus_peers.cc:597] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539): Couldn't send request to peer bce73265e27d4b30a4dcc1e491305088. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 33f09d9f057844568fb4a24c314a746a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:37.175390  5124 raft_consensus.cc:1275] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:15:37.178422 10851 consensus_queue.cc:1048] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:37.186866  5271 raft_consensus.cc:1275] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:15:37.203955 10740 consensus_queue.cc:1048] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 12:15:37.289335 10949 raft_consensus.cc:2955] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:15:37.297453  5124 raft_consensus.cc:2955] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:15:37.316076  5269 raft_consensus.cc:2955] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:15:37.329083  5023 catalog_manager.cc:5697] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 reported cstate change: config changed from index -1 to 10, NON_VOTER bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) added. New cstate: current_term: 15 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } } }
I20260709 12:15:37.381920 10995 ts_tablet_manager.cc:933] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088: Initiating tablet copy from peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443)
I20260709 12:15:37.463380 10931 tablet_bootstrap.cc:492] T fe3c5015888a494085f9a8b6eb204bcf P bce73265e27d4b30a4dcc1e491305088: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:37.495925 10995 tablet_copy_client.cc:323] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Beginning tablet copy session from remote peer at address 127.3.212.129:34443
I20260709 12:15:37.498800  5135 tablet_copy_service.cc:140] P ad2f9a1e2f7a45429fa69fd23d09f821: Received BeginTabletCopySession request for tablet d87fb855c56c430f896b24f98722bd61 from peer bce73265e27d4b30a4dcc1e491305088 ({username='slave'} at 127.0.0.1:59390)
I20260709 12:15:37.499517  5135 tablet_copy_service.cc:161] P ad2f9a1e2f7a45429fa69fd23d09f821: Beginning new tablet copy session on tablet d87fb855c56c430f896b24f98722bd61 from peer bce73265e27d4b30a4dcc1e491305088 at {username='slave'} at 127.0.0.1:59390: session id = bce73265e27d4b30a4dcc1e491305088-d87fb855c56c430f896b24f98722bd61
I20260709 12:15:37.517913 10931 tablet_bootstrap.cc:492] T fe3c5015888a494085f9a8b6eb204bcf P bce73265e27d4b30a4dcc1e491305088: Bootstrap complete.
I20260709 12:15:37.518862 10931 ts_tablet_manager.cc:1403] T fe3c5015888a494085f9a8b6eb204bcf P bce73265e27d4b30a4dcc1e491305088: Time spent bootstrapping tablet: real 0.751s	user 0.046s	sys 0.035s
I20260709 12:15:37.528059  5192 raft_consensus.cc:1275] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:15:37.529713 10972 consensus_queue.cc:1048] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:15:37.525285 10931 raft_consensus.cc:359] T fe3c5015888a494085f9a8b6eb204bcf P bce73265e27d4b30a4dcc1e491305088 [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:15:37.545631 10931 raft_consensus.cc:740] T fe3c5015888a494085f9a8b6eb204bcf P bce73265e27d4b30a4dcc1e491305088 [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Initialized, Role: LEARNER
I20260709 12:15:37.550050 10931 consensus_queue.cc:260] T fe3c5015888a494085f9a8b6eb204bcf P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:15:37.553303 10931 ts_tablet_manager.cc:1434] T fe3c5015888a494085f9a8b6eb204bcf P bce73265e27d4b30a4dcc1e491305088: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.002s
I20260709 12:15:37.522639  5135 tablet_copy_source_session.cc:215] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:15:37.584913  5210 tablet_copy_service.cc:342] P dd62e75bd3ed4ed28f1fb5955d650808: Request end of tablet copy session bce73265e27d4b30a4dcc1e491305088-fe3c5015888a494085f9a8b6eb204bcf received from {username='slave'} at 127.0.0.1:41416
I20260709 12:15:37.585451  5210 tablet_copy_service.cc:434] P dd62e75bd3ed4ed28f1fb5955d650808: ending tablet copy session bce73265e27d4b30a4dcc1e491305088-fe3c5015888a494085f9a8b6eb204bcf on tablet fe3c5015888a494085f9a8b6eb204bcf with peer bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:37.586037  5829 raft_consensus.cc:1275] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:15:37.589216 10972 consensus_queue.cc:1048] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:15:37.590639 10995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d87fb855c56c430f896b24f98722bd61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:37.599812 10964 tablet_bootstrap.cc:492] T 4e275c844ff54adea37252a082eae526 P bce73265e27d4b30a4dcc1e491305088: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:37.610047 10964 tablet_bootstrap.cc:492] T 4e275c844ff54adea37252a082eae526 P bce73265e27d4b30a4dcc1e491305088: Bootstrap complete.
I20260709 12:15:37.611239 10964 ts_tablet_manager.cc:1403] T 4e275c844ff54adea37252a082eae526 P bce73265e27d4b30a4dcc1e491305088: Time spent bootstrapping tablet: real 0.495s	user 0.037s	sys 0.043s
I20260709 12:15:37.645272  5830 raft_consensus.cc:1217] T fe3c5015888a494085f9a8b6eb204bcf P bce73265e27d4b30a4dcc1e491305088 [term 18 LEARNER]: Deduplicated request from leader. Original: 18.11->[18.12-18.12]   Dedup: 18.12->[]
I20260709 12:15:37.664882 10964 raft_consensus.cc:359] T 4e275c844ff54adea37252a082eae526 P bce73265e27d4b30a4dcc1e491305088 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:15:37.665807 10964 raft_consensus.cc:740] T 4e275c844ff54adea37252a082eae526 P bce73265e27d4b30a4dcc1e491305088 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Initialized, Role: LEARNER
I20260709 12:15:37.666468 10964 consensus_queue.cc:260] T 4e275c844ff54adea37252a082eae526 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:15:37.680967 10964 ts_tablet_manager.cc:1434] T 4e275c844ff54adea37252a082eae526 P bce73265e27d4b30a4dcc1e491305088: Time spent starting tablet: real 0.059s	user 0.005s	sys 0.001s
I20260709 12:15:37.689147  5284 tablet_copy_service.cc:342] P 9e794b72ed7640219f90ec4232363929: Request end of tablet copy session bce73265e27d4b30a4dcc1e491305088-4e275c844ff54adea37252a082eae526 received from {username='slave'} at 127.0.0.1:50932
I20260709 12:15:37.691726  5284 tablet_copy_service.cc:434] P 9e794b72ed7640219f90ec4232363929: ending tablet copy session bce73265e27d4b30a4dcc1e491305088-4e275c844ff54adea37252a082eae526 on tablet 4e275c844ff54adea37252a082eae526 with peer bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:37.704912  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:37.726734 10995 tablet_copy_client.cc:806] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 0 data blocks...
I20260709 12:15:37.733805 10995 tablet_copy_client.cc:670] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 1 WAL segments...
I20260709 12:15:37.741125 10995 tablet_copy_client.cc:538] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:15:37.752208 10995 tablet_bootstrap.cc:492] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088: Bootstrap starting.
I20260709 12:15:37.782943 10964 ts_tablet_manager.cc:933] T 33f09d9f057844568fb4a24c314a746a P bce73265e27d4b30a4dcc1e491305088: Initiating tablet copy from peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:37.818234 10964 tablet_copy_client.cc:323] T 33f09d9f057844568fb4a24c314a746a P bce73265e27d4b30a4dcc1e491305088: tablet copy: Beginning tablet copy session from remote peer at address 127.3.212.130:44455
I20260709 12:15:37.821795  5830 raft_consensus.cc:1217] T 4e275c844ff54adea37252a082eae526 P bce73265e27d4b30a4dcc1e491305088 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.9->[15.10-15.10]   Dedup: 15.10->[]
I20260709 12:15:37.830417  5210 tablet_copy_service.cc:140] P dd62e75bd3ed4ed28f1fb5955d650808: Received BeginTabletCopySession request for tablet 33f09d9f057844568fb4a24c314a746a from peer bce73265e27d4b30a4dcc1e491305088 ({username='slave'} at 127.0.0.1:41416)
I20260709 12:15:37.830945  5210 tablet_copy_service.cc:161] P dd62e75bd3ed4ed28f1fb5955d650808: Beginning new tablet copy session on tablet 33f09d9f057844568fb4a24c314a746a from peer bce73265e27d4b30a4dcc1e491305088 at {username='slave'} at 127.0.0.1:41416: session id = bce73265e27d4b30a4dcc1e491305088-33f09d9f057844568fb4a24c314a746a
I20260709 12:15:37.863898  5210 tablet_copy_source_session.cc:215] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:15:37.867585 10964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33f09d9f057844568fb4a24c314a746a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:15:37.892459  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 65773.1us
I20260709 12:15:37.912698  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:37.938501  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:37.939468  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:37.995524 10964 tablet_copy_client.cc:806] T 33f09d9f057844568fb4a24c314a746a P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 0 data blocks...
I20260709 12:15:37.996317 10964 tablet_copy_client.cc:670] T 33f09d9f057844568fb4a24c314a746a P bce73265e27d4b30a4dcc1e491305088: tablet copy: Starting download of 1 WAL segments...
I20260709 12:15:38.010473 10964 tablet_copy_client.cc:538] T 33f09d9f057844568fb4a24c314a746a P bce73265e27d4b30a4dcc1e491305088: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:15:38.038488  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:38.076546 10964 tablet_bootstrap.cc:492] T 33f09d9f057844568fb4a24c314a746a P bce73265e27d4b30a4dcc1e491305088: Bootstrap starting.
I20260709 12:15:38.091518 10851 raft_consensus.cc:1064] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808: attempting to promote NON_VOTER bce73265e27d4b30a4dcc1e491305088 to VOTER
I20260709 12:15:38.102834 10995 tablet_bootstrap.cc:492] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=3 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:38.123760 10995 tablet_bootstrap.cc:492] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088: Bootstrap complete.
I20260709 12:15:38.134145 10995 ts_tablet_manager.cc:1403] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088: Time spent bootstrapping tablet: real 0.382s	user 0.033s	sys 0.021s
I20260709 12:15:38.130805 10851 consensus_queue.cc:237] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 10, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:38.179876 10995 raft_consensus.cc:359] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:15:38.180778 10995 raft_consensus.cc:740] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Initialized, Role: LEARNER
I20260709 12:15:38.182669 10995 consensus_queue.cc:260] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:15:38.189845 10995 ts_tablet_manager.cc:1434] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088: Time spent starting tablet: real 0.053s	user 0.007s	sys 0.001s
I20260709 12:15:38.207017  5832 raft_consensus.cc:1217] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.11->[16.12-16.12]   Dedup: 16.12->[]
W20260709 12:15:38.221123  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 66513.4us
I20260709 12:15:38.267338 10964 tablet_bootstrap.cc:492] T 33f09d9f057844568fb4a24c314a746a P bce73265e27d4b30a4dcc1e491305088: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:15:38.289693 10964 tablet_bootstrap.cc:492] T 33f09d9f057844568fb4a24c314a746a P bce73265e27d4b30a4dcc1e491305088: Bootstrap complete.
I20260709 12:15:38.291486 10964 ts_tablet_manager.cc:1403] T 33f09d9f057844568fb4a24c314a746a P bce73265e27d4b30a4dcc1e491305088: Time spent bootstrapping tablet: real 0.215s	user 0.037s	sys 0.024s
I20260709 12:15:38.294720  5135 tablet_copy_service.cc:342] P ad2f9a1e2f7a45429fa69fd23d09f821: Request end of tablet copy session bce73265e27d4b30a4dcc1e491305088-d87fb855c56c430f896b24f98722bd61 received from {username='slave'} at 127.0.0.1:59390
I20260709 12:15:38.295264  5135 tablet_copy_service.cc:434] P ad2f9a1e2f7a45429fa69fd23d09f821: ending tablet copy session bce73265e27d4b30a4dcc1e491305088-d87fb855c56c430f896b24f98722bd61 on tablet d87fb855c56c430f896b24f98722bd61 with peer bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:38.303602 10964 raft_consensus.cc:359] T 33f09d9f057844568fb4a24c314a746a P bce73265e27d4b30a4dcc1e491305088 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:15:38.310233 10964 raft_consensus.cc:740] T 33f09d9f057844568fb4a24c314a746a P bce73265e27d4b30a4dcc1e491305088 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Initialized, Role: LEARNER
I20260709 12:15:38.305749  3922 tablet_server.cc:179] TabletServer@127.3.212.129:0 shutting down...
I20260709 12:15:38.319041 10964 consensus_queue.cc:260] T 33f09d9f057844568fb4a24c314a746a P bce73265e27d4b30a4dcc1e491305088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:15:38.322547 10964 ts_tablet_manager.cc:1434] T 33f09d9f057844568fb4a24c314a746a P bce73265e27d4b30a4dcc1e491305088: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
W20260709 12:15:38.322779  5166 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
W20260709 12:15:38.331518  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 120644us
I20260709 12:15:38.357203  5210 tablet_copy_service.cc:342] P dd62e75bd3ed4ed28f1fb5955d650808: Request end of tablet copy session bce73265e27d4b30a4dcc1e491305088-33f09d9f057844568fb4a24c314a746a received from {username='slave'} at 127.0.0.1:41416
I20260709 12:15:38.358093  5210 tablet_copy_service.cc:434] P dd62e75bd3ed4ed28f1fb5955d650808: ending tablet copy session bce73265e27d4b30a4dcc1e491305088-33f09d9f057844568fb4a24c314a746a on tablet 33f09d9f057844568fb4a24c314a746a with peer bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:38.365965 11004 raft_consensus.cc:1064] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929: attempting to promote NON_VOTER bce73265e27d4b30a4dcc1e491305088 to VOTER
I20260709 12:15:38.368925 11004 consensus_queue.cc:237] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 8, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:38.430287  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 107494us
W20260709 12:15:38.432013  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 99081us
W20260709 12:15:38.444192  5166 consensus_peers.cc:597] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:38.444939  5166 consensus_peers.cc:597] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:38.472266  5166 consensus_peers.cc:597] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:38.474202  5166 consensus_peers.cc:597] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:38.481570  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 96438.4us
W20260709 12:15:38.494086  5166 consensus_peers.cc:597] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:38.502684  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 123530us
I20260709 12:15:38.517125  5832 raft_consensus.cc:1275] T fe3c5015888a494085f9a8b6eb204bcf P bce73265e27d4b30a4dcc1e491305088 [term 18 LEARNER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:15:38.517402  5268 raft_consensus.cc:1275] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 18 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 12:15:38.505740  5240 consensus_peers.cc:597] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:38.520864  5240 consensus_peers.cc:597] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:38.522262  5240 consensus_peers.cc:597] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:38.523813  5240 consensus_peers.cc:597] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:38.531018 11011 consensus_queue.cc:1048] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:15:38.537272  5240 consensus_peers.cc:597] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:38.541620  5192 raft_consensus.cc:1275] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:15:38.543399 10952 consensus_queue.cc:1048] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:15:38.550200  5832 raft_consensus.cc:1217] T 33f09d9f057844568fb4a24c314a746a P bce73265e27d4b30a4dcc1e491305088 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.9->[15.10-15.10]   Dedup: 15.10->[]
W20260709 12:15:38.561690  5166 consensus_peers.cc:597] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:38.562243  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 45410.3us
W20260709 12:15:38.576399  5240 consensus_peers.cc:597] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:38.578909 10851 consensus_queue.cc:1048] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:15:38.607527  5830 raft_consensus.cc:1275] T 4e275c844ff54adea37252a082eae526 P bce73265e27d4b30a4dcc1e491305088 [term 15 LEARNER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 12:15:38.612416  5240 consensus_peers.cc:597] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:38.649417  5240 consensus_peers.cc:597] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:38.664479  5166 consensus_peers.cc:597] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:38.694375  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 45052.5us
W20260709 12:15:38.648159  5804 consensus_peers.cc:597] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:38.702843  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 54751.3us
W20260709 12:15:38.711017  5240 consensus_peers.cc:597] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:38.714954  5166 consensus_peers.cc:597] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:38.722520  5166 consensus_peers.cc:597] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:38.746224 10872 consensus_queue.cc:1048] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 12:15:38.777664 11020 raft_consensus.cc:1064] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821: attempting to promote NON_VOTER bce73265e27d4b30a4dcc1e491305088 to VOTER
I20260709 12:15:38.780474 11020 consensus_queue.cc:237] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 10, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:38.792997  5166 consensus_peers.cc:597] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:38.795027  5166 consensus_peers.cc:597] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:38.764320  5804 consensus_peers.cc:597] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:38.806005  5804 consensus_peers.cc:597] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:38.870081  5240 consensus_peers.cc:597] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:38.877007  5166 consensus_peers.cc:597] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:38.894312  5268 raft_consensus.cc:1275] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:15:38.901950  5191 raft_consensus.cc:1275] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:15:38.900962 11025 consensus_queue.cc:1048] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
W20260709 12:15:38.907958  5804 consensus_peers.cc:597] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:38.910533  5804 consensus_peers.cc:597] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:38.911199  5804 consensus_peers.cc:597] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:38.915483  5804 consensus_peers.cc:597] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:38.916227  5804 consensus_peers.cc:597] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:38.918613  5804 consensus_peers.cc:597] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:38.906904 11025 consensus_queue.cc:1048] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.008s
I20260709 12:15:38.964854  5829 raft_consensus.cc:1275] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [term 16 LEARNER]: Refusing update from remote peer ad2f9a1e2f7a45429fa69fd23d09f821: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:15:38.988685 10872 raft_consensus.cc:2955] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index 10 to 11, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:39.007251  5838 raft_consensus.cc:2955] T 4e275c844ff54adea37252a082eae526 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:39.011798 10954 consensus_queue.cc:1048] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:15:38.998632 10851 raft_consensus.cc:2955] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index 12 to 13, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:39.019451  5274 raft_consensus.cc:2955] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:39.006839  5829 raft_consensus.cc:2955] T fe3c5015888a494085f9a8b6eb204bcf P bce73265e27d4b30a4dcc1e491305088 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
W20260709 12:15:39.024101  5804 consensus_peers.cc:597] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:39.030678  5195 raft_consensus.cc:2955] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:39.084702  3922 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:39.085361  5023 catalog_manager.cc:5697] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: config changed from index 10 to 11, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:39.085973  3922 tablet_replica.cc:333] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:15:39.093112  3922 raft_consensus.cc:2243] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:15:39.094311  3922 raft_consensus.cc:2272] T d09ac3a18bc549dabadd7ec3c3f57017 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:39.097157  3922 tablet_replica.cc:333] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:15:39.097991  3922 raft_consensus.cc:2243] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:39.098539  3922 raft_consensus.cc:2272] T c7bb7b814fea4a2488cc39d06fc90483 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:39.105468  3922 tablet_replica.cc:333] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:15:39.113967 11011 raft_consensus.cc:1064] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808: attempting to promote NON_VOTER bce73265e27d4b30a4dcc1e491305088 to VOTER
I20260709 12:15:39.130904  5020 catalog_manager.cc:5697] T fe3c5015888a494085f9a8b6eb204bcf P bce73265e27d4b30a4dcc1e491305088 reported cstate change: config changed from index 12 to 13, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:39.116976 11011 consensus_queue.cc:237] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 8, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:39.135161 10861 raft_consensus.cc:2955] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 LEADER]: Committing config change with OpId 16.13: config changed from index 12 to 13, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:39.153215  5268 raft_consensus.cc:2955] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:39.156791  5193 raft_consensus.cc:2955] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:39.159950  3922 raft_consensus.cc:2243] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Raft consensus shutting down.
W20260709 12:15:39.182796  5007 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ddd16ccf58f24f6db29e5fc39a06e5c4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer 9e794b72ed7640219f90ec4232363929 from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 13 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:39.181586  5832 raft_consensus.cc:2955] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:39.186043  3922 raft_consensus.cc:2272] T f5815aa6770341a7ae03cf8dc1b8a05e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:39.212749  3922 tablet_replica.cc:333] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:15:39.223428 11020 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:39.224195 11020 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:15:39.228377  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:39.233666  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:39.236572  5088 leader_election.cc:304] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:39.237555 10861 raft_consensus.cc:2749] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:15:39.275900 11020 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:39.280622  3922 raft_consensus.cc:2243] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:39.281446  3922 raft_consensus.cc:2272] T 9f93759199ab4820a9a807a0f1c70c85 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:39.284062  3922 tablet_replica.cc:333] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:15:39.284840  3922 raft_consensus.cc:2243] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:39.286569  3922 raft_consensus.cc:2272] T 2a6867413d1d4b49bcd267c1e134d12e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:39.295382  5832 raft_consensus.cc:1275] T 33f09d9f057844568fb4a24c314a746a P bce73265e27d4b30a4dcc1e491305088 [term 15 LEARNER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:15:39.302403  5274 raft_consensus.cc:1275] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:15:39.304868 10851 consensus_queue.cc:1048] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:15:39.305977  3922 tablet_replica.cc:333] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:15:39.306849  3922 raft_consensus.cc:2243] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:39.307518  3922 raft_consensus.cc:2272] T ecedf48dca8a4a35adc39d76a9a93513 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:39.310616  3922 tablet_replica.cc:333] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:15:39.311961 11025 raft_consensus.cc:493] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:39.312669 11025 raft_consensus.cc:515] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:39.316284  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:39.325490 11018 consensus_queue.cc:1048] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:15:39.347774  3922 raft_consensus.cc:2243] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:39.348619  3922 raft_consensus.cc:2272] T 9634d2debd9f4e7ea32cf4479f9242e1 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:39.348555 10861 raft_consensus.cc:493] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:39.359227  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f87264424df422fa5223dd7a8803eab" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:39.352460 10861 raft_consensus.cc:515] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:39.361949 10861 leader_election.cc:290] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:15:39.353195  5166 consensus_peers.cc:597] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:39.363404  5088 leader_election.cc:304] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:39.364346 10861 raft_consensus.cc:2749] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:39.359054 11025 leader_election.cc:290] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:39.366348  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:39.366706  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db164e3a1ce4a43b0a112a777118daa" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:39.369551  5088 leader_election.cc:304] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:39.370951 11025 raft_consensus.cc:2749] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:39.382283 11025 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:39.382916 11025 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:15:39.387722  3922 tablet_replica.cc:333] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:15:39.388815  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:39.390086  3922 raft_consensus.cc:2243] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:15:39.385228 11025 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:39.414353 11025 raft_consensus.cc:493] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:39.414556  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:39.415333 11025 raft_consensus.cc:515] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:39.419399 11025 leader_election.cc:290] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:39.414800  3922 raft_consensus.cc:2272] T 9f927a751b4041e99eb5ac25ddf214ec P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:39.448784  3922 tablet_replica.cc:333] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:15:39.434762 10861 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:39.450454 10861 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:39.441830 11021 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:39.451447 11021 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:39.454620 11021 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:39.444775 10954 raft_consensus.cc:493] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:39.456019 10954 raft_consensus.cc:515] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:39.458165 10954 leader_election.cc:290] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:39.456489  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:39.460654  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:39.461768  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:39.445125  5088 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:39.433511 11013 raft_consensus.cc:2955] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index 10 to 11, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:39.463891 11021 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:39.449985  5268 raft_consensus.cc:2955] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:39.442484 11020 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:39.469892 11020 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:39.472761 11020 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:39.439673  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:39.475188 11021 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:39.484295  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:39.484591  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:39.485133  5829 raft_consensus.cc:2955] T 33f09d9f057844568fb4a24c314a746a P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:39.487812 11021 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:15:39.490556  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 45506.8us
I20260709 12:15:39.492399  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:39.494578  5088 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:39.495193 11020 raft_consensus.cc:2749] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:39.495491  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:39.498709  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd16ccf58f24f6db29e5fc39a06e5c4" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:39.499847  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56627990da7d49f7a12669f23294a596" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:39.501487  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "756d32b8c4d642a6955517f66ac5bb45" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:39.502301  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c69b050cdaeb4f1db6cd4993ad703192" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:39.486339  3922 raft_consensus.cc:2243] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:15:39.502779 10861 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:39.510002  3922 raft_consensus.cc:2272] T 88f51ae73df747849e2f3cd63547a1d0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:39.505873 11021 raft_consensus.cc:493] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:39.507175  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cb582e4337464894d9eb032a3b2cd2" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:39.512741 11021 raft_consensus.cc:515] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:39.513219 11025 raft_consensus.cc:2749] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:39.518373  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:39.521661 11020 raft_consensus.cc:493] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:39.522367 11020 raft_consensus.cc:515] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:39.525238 11020 leader_election.cc:290] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:39.526993  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:39.512980  5088 leader_election.cc:304] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:39.521210 11021 leader_election.cc:290] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:39.520852  3922 tablet_replica.cc:333] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:15:39.529732  5088 leader_election.cc:304] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:39.530210 11021 raft_consensus.cc:2749] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:15:39.542764  5023 catalog_manager.cc:5697] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: config changed from index 12 to 13, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:39.530650  3922 raft_consensus.cc:2243] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:15:39.550082 11020 raft_consensus.cc:493] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:39.556316 11021 raft_consensus.cc:2749] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:39.585670 11021 raft_consensus.cc:493] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:39.586297 11021 raft_consensus.cc:515] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:39.588694 11021 leader_election.cc:290] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:39.622409  5021 catalog_manager.cc:5697] T 33f09d9f057844568fb4a24c314a746a P bce73265e27d4b30a4dcc1e491305088 reported cstate change: config changed from index 10 to 11, bce73265e27d4b30a4dcc1e491305088 (127.3.212.132) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:39.627978  5265 consensus_queue.cc:237] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:39.634313  5193 raft_consensus.cc:1275] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:15:39.561257  3922 raft_consensus.cc:2272] T ba4d42e47cfd4d859ca8f5ee6401379c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:39.567016  5088 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:39.639339  5830 raft_consensus.cc:1275] T 4e275c844ff54adea37252a082eae526 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:15:39.639874 11004 consensus_queue.cc:1048] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:15:39.561652 11020 raft_consensus.cc:515] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:39.642887 11020 leader_election.cc:290] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:39.643760 11021 raft_consensus.cc:493] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:39.644222 11021 raft_consensus.cc:515] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:39.645913 11021 leader_election.cc:290] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:15:39.646812  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 79881.7us
I20260709 12:15:39.647385 11021 raft_consensus.cc:2749] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:39.652251 11004 consensus_queue.cc:1048] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:15:39.655865  3922 tablet_replica.cc:333] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:15:39.654934 10872 raft_consensus.cc:2955] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:39.656780  3922 raft_consensus.cc:2243] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:39.661079  5193 raft_consensus.cc:2955] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:39.671360  3922 raft_consensus.cc:2272] T 756d32b8c4d642a6955517f66ac5bb45 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:39.647548  5088 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:39.683112  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:39.687497 11021 raft_consensus.cc:2749] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:39.700148 11025 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:39.700774 11025 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: NON_VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: true } }
I20260709 12:15:39.705775 11025 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:39.706624 10954 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:39.707149 10954 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:39.709326 10954 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:39.720960 10954 raft_consensus.cc:493] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:39.721695 10954 raft_consensus.cc:515] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:39.562291 10861 raft_consensus.cc:493] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:39.724120 10954 leader_election.cc:290] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:15:39.725934  5088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 78458.2us
I20260709 12:15:39.727843  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9212b0f778ec4455b8054add86b66d78" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:39.729274  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:39.735201  5007 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4e275c844ff54adea37252a082eae526 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:15:39.736682  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:39.737867  3922 tablet_replica.cc:333] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:15:39.739423  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f38af52cc54adeb374ef3d32a43af6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:39.745862  3922 raft_consensus.cc:2243] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:15:39.747084  3922 raft_consensus.cc:2272] T a6b2fb64d40642259e41424cef193db0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:39.749223  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:39.724145 10861 raft_consensus.cc:515] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:39.765885  3922 tablet_replica.cc:333] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:15:39.766795  3922 raft_consensus.cc:2243] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:39.767365 10861 leader_election.cc:290] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:39.767549  3922 raft_consensus.cc:2272] T fe3c5015888a494085f9a8b6eb204bcf P ad2f9a1e2f7a45429fa69fd23d09f821 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:39.764938  5018 catalog_manager.cc:5697] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: config changed from index 11 to 12, VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) evicted. New cstate: current_term: 15 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:39.777993  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:39.778420  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:39.782251  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62577fc91bb44d3a882109dc63f74008" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:39.783484  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:39.784390  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:39.787451  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd07c3eb35104201a0e6b64cd77cb6b6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:39.792305 11021 raft_consensus.cc:493] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:39.792630  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:39.792984 11021 raft_consensus.cc:515] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:39.797744  3922 tablet_replica.cc:333] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:15:39.814172  3922 raft_consensus.cc:2243] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:39.798399 11025 raft_consensus.cc:493] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:39.805749 10954 raft_consensus.cc:493] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:39.822002  3922 raft_consensus.cc:2272] T 3db164e3a1ce4a43b0a112a777118daa P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:39.822522 10954 raft_consensus.cc:515] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:39.822935 11025 raft_consensus.cc:515] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:39.824715 10954 leader_election.cc:290] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:39.797945 11021 leader_election.cc:290] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:39.825402 11025 leader_election.cc:290] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:39.829720 11021 raft_consensus.cc:493] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:39.830538  3922 tablet_replica.cc:333] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:15:39.830286 11021 raft_consensus.cc:515] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:39.834767  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecdd526dba8b4d84859ef5f6ee618387" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:39.836294 11021 leader_election.cc:290] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:39.836784  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed974c2bf41a490ca098100bdfc63351" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:39.837435  3922 raft_consensus.cc:2243] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:39.838107  3922 raft_consensus.cc:2272] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:39.841086  3922 tablet_replica.cc:333] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:15:39.843362  3922 raft_consensus.cc:2243] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:39.856048  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:39.857481  3922 raft_consensus.cc:2272] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:39.858040  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:39.866549  5829 raft_consensus.cc:2955] T 4e275c844ff54adea37252a082eae526 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } } }
I20260709 12:15:39.868882  3922 tablet_replica.cc:333] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:15:39.869899  3922 raft_consensus.cc:2243] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:39.876223  3922 raft_consensus.cc:2272] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:39.885402  5010 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 58416.1us
I20260709 12:15:39.887490 11025 raft_consensus.cc:493] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:39.894969 11025 raft_consensus.cc:515] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:39.899130  3922 tablet_replica.cc:333] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:15:39.900151  3922 raft_consensus.cc:2243] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:39.909549  3922 raft_consensus.cc:2272] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:39.912600  3922 tablet_replica.cc:333] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
W20260709 12:15:39.913157  5010 catalog_manager.cc:4755] TS ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 4e275c844ff54adea37252a082eae526: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 12:15:39.921525  3922 raft_consensus.cc:2243] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:39.924221 11025 leader_election.cc:290] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:39.926201  5088 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:39.927666  5088 leader_election.cc:304] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:39.930207 10861 raft_consensus.cc:493] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:39.930790 10861 raft_consensus.cc:515] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:39.932765 10861 leader_election.cc:290] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:39.925472  3922 raft_consensus.cc:2272] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:39.935163  5088 leader_election.cc:304] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:39.937319 11043 raft_consensus.cc:2749] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:15:39.938226  5088 raft_consensus.cc:2686] T 62577fc91bb44d3a882109dc63f74008 P ad2f9a1e2f7a45429fa69fd23d09f821: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:15:39.933212 10861 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:39.939922 11021 raft_consensus.cc:2749] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:39.946995 10861 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:39.955657 10861 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:39.962720  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:39.970237  5088 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:39.976634  5088 leader_election.cc:304] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:39.977475 11042 raft_consensus.cc:2749] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:39.978169 11042 raft_consensus.cc:2749] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:39.979439  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271b0c7d258142798f30accd6aaba829" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:39.980824  5272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:39.982748  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71729ba8cfa049e8b7dac6674d1ba13b" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:39.983520  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:39.985101  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8dc93d0992c4324872c6aab5aa9db8c" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:39.986053  5088 leader_election.cc:304] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:39.986347  5199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:39.982846  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8017a2b75074e4b9f0691c32850f71a" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:39.988235  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21832120214f4b8fb9e2e0de351565f0" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:39.990190  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:39.991917  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:39.992841  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:39.993046  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:39.996302  3922 tablet_replica.cc:333] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:15:39.997206  3922 raft_consensus.cc:2243] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:15:39.999090 11020 raft_consensus.cc:2749] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:40.005676  3922 raft_consensus.cc:2272] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.008988  3922 tablet_replica.cc:333] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:15:40.011160  5088 leader_election.cc:304] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:40.012486  5088 leader_election.cc:304] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:40.015554  3922 raft_consensus.cc:2243] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:40.021665 11043 raft_consensus.cc:2749] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:40.022455 11043 raft_consensus.cc:2749] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:40.023821  5088 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:40.037626 11020 raft_consensus.cc:2749] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:40.039592  3922 raft_consensus.cc:2272] T ddd16ccf58f24f6db29e5fc39a06e5c4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.043387  5088 leader_election.cc:304] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:40.046322 11020 raft_consensus.cc:2749] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:40.045677  3922 tablet_replica.cc:333] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:15:40.052465  5088 leader_election.cc:304] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:15:40.053171  5088 raft_consensus.cc:2686] T 71729ba8cfa049e8b7dac6674d1ba13b P ad2f9a1e2f7a45429fa69fd23d09f821: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:15:40.054000  5088 leader_election.cc:304] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:15:40.054618  5088 raft_consensus.cc:2686] T d8dc93d0992c4324872c6aab5aa9db8c P ad2f9a1e2f7a45429fa69fd23d09f821: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:15:40.055505  5088 leader_election.cc:304] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:40.056073 11020 raft_consensus.cc:2749] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:40.056517  3922 raft_consensus.cc:2243] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:40.071254  3922 raft_consensus.cc:2272] T 63f38af52cc54adeb374ef3d32a43af6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.076015  5088 leader_election.cc:304] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:40.079806  3922 tablet_replica.cc:333] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:15:40.081084  3922 raft_consensus.cc:2243] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:15:40.084658  3922 raft_consensus.cc:2272] T 93f7ce8a804f431dbbc5adfbca8d745e P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:40.088284  5088 raft_consensus.cc:2686] T 21832120214f4b8fb9e2e0de351565f0 P ad2f9a1e2f7a45429fa69fd23d09f821: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:15:40.094173  5088 leader_election.cc:304] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:40.097597 11020 raft_consensus.cc:2749] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:40.099174  5088 leader_election.cc:304] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:15:40.102316  5088 raft_consensus.cc:2686] T d8017a2b75074e4b9f0691c32850f71a P ad2f9a1e2f7a45429fa69fd23d09f821: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:15:40.096076  3922 tablet_replica.cc:333] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:15:40.105324  3922 raft_consensus.cc:2243] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:15:40.108582  5088 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad2f9a1e2f7a45429fa69fd23d09f821; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:40.113837  3922 raft_consensus.cc:2272] T d87fb855c56c430f896b24f98722bd61 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.118316 11043 raft_consensus.cc:2749] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:15:40.133038  3922 tablet_replica.cc:333] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:15:40.134753  3922 raft_consensus.cc:2243] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:40.138545  3922 raft_consensus.cc:2272] T 56627990da7d49f7a12669f23294a596 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.158607  3922 tablet_replica.cc:333] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:15:40.159564  3922 raft_consensus.cc:2243] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:40.160223  3922 raft_consensus.cc:2272] T cd07c3eb35104201a0e6b64cd77cb6b6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.162725  3922 tablet_replica.cc:333] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:15:40.163516  3922 raft_consensus.cc:2243] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:15:40.164517  3922 raft_consensus.cc:2272] T 00645b1f1e014de995e4a937f842d909 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.199478  3922 tablet_replica.cc:333] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:15:40.200404  3922 raft_consensus.cc:2243] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:40.215270  3922 raft_consensus.cc:2272] T ecdd526dba8b4d84859ef5f6ee618387 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.237541  3922 tablet_replica.cc:333] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:15:40.238344  3922 raft_consensus.cc:2243] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:40.238914  3922 raft_consensus.cc:2272] T 9212b0f778ec4455b8054add86b66d78 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.241748 10878 raft_consensus.cc:493] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:40.242342 10878 raft_consensus.cc:515] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:40.244921 10878 leader_election.cc:290] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:15:40.247743  5804 leader_election.cc:336] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:15:40.248749  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:40.252189  5801 leader_election.cc:304] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:40.254899 10977 raft_consensus.cc:2749] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:40.259088  3922 tablet_replica.cc:333] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:15:40.259985  3922 raft_consensus.cc:2243] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:40.260628  3922 raft_consensus.cc:2272] T 4f87264424df422fa5223dd7a8803eab P ad2f9a1e2f7a45429fa69fd23d09f821 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.318861  3922 tablet_replica.cc:333] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:15:40.326081  3922 raft_consensus.cc:2243] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:40.326887  3922 raft_consensus.cc:2272] T 62cb582e4337464894d9eb032a3b2cd2 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.331946  3922 tablet_replica.cc:333] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:15:40.334621  3922 raft_consensus.cc:2243] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:15:40.337847  3922 raft_consensus.cc:2272] T 45e701f062f14e4e80492fc08144cca6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.373983  3922 tablet_replica.cc:333] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:15:40.375597  3922 raft_consensus.cc:2243] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:40.377763  3922 raft_consensus.cc:2272] T c0500c51d8bf49ff987108802ec3ee12 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.384433  3922 tablet_replica.cc:333] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:15:40.402067  3922 raft_consensus.cc:2243] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:15:40.412221  3922 raft_consensus.cc:2272] T 01b3c9565b564c6d934ce652edaabd1f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.419871  3922 tablet_replica.cc:333] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:15:40.421274 11004 raft_consensus.cc:493] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:40.429767 11004 raft_consensus.cc:515] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:40.432019 11004 leader_election.cc:290] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:40.433344  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:40.434136  5829 raft_consensus.cc:2468] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 10.
I20260709 12:15:40.435431  5238 leader_election.cc:304] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:15:40.436281 11004 raft_consensus.cc:2804] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:40.436689 11004 raft_consensus.cc:493] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:40.437088 11004 raft_consensus.cc:3060] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:15:40.438700  5240 leader_election.cc:336] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:15:40.441862  3922 raft_consensus.cc:2243] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:40.442713  3922 raft_consensus.cc:2272] T 4e275c844ff54adea37252a082eae526 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.452234 11004 raft_consensus.cc:515] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:40.454545 11004 leader_election.cc:290] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:40.455647  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09ac3a18bc549dabadd7ec3c3f57017" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:40.457612  5829 raft_consensus.cc:3060] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:15:40.458683  5240 leader_election.cc:336] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:15:40.466614  3922 tablet_replica.cc:333] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:15:40.468956  3922 raft_consensus.cc:2243] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:40.469619  3922 raft_consensus.cc:2272] T 7a9971183fee4e958cff325230a31b26 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.473933  5829 raft_consensus.cc:2468] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 11.
I20260709 12:15:40.475169  5238 leader_election.cc:304] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:40.478470  3922 tablet_replica.cc:333] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:15:40.478892 11004 raft_consensus.cc:2804] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:15:40.480430 11004 raft_consensus.cc:697] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 11 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:40.484256  3922 raft_consensus.cc:2243] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:15:40.489991 11004 consensus_queue.cc:237] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:40.502219  3922 raft_consensus.cc:2272] T b0fcb55471024c3d818106c4bfdf84d4 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.520110 11004 raft_consensus.cc:493] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:40.520788 11004 raft_consensus.cc:515] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:40.533568  3922 tablet_replica.cc:333] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:15:40.521260  5018 catalog_manager.cc:5697] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 10 to 11, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 11 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:40.542613 11004 leader_election.cc:290] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:40.544996  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:40.550006  3922 raft_consensus.cc:2243] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:40.550849  3922 raft_consensus.cc:2272] T 33f09d9f057844568fb4a24c314a746a P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:40.551321  5240 leader_election.cc:336] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:15:40.551869  5240 leader_election.cc:304] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:40.552665 10872 raft_consensus.cc:2749] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:40.553633  3922 tablet_replica.cc:333] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:15:40.554459  3922 raft_consensus.cc:2243] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:40.555044  3922 raft_consensus.cc:2272] T c69b050cdaeb4f1db6cd4993ad703192 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.557185 11004 raft_consensus.cc:493] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:40.557817 11004 raft_consensus.cc:515] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:40.564774  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:15:40.567929  5240 leader_election.cc:336] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:15:40.569033  5166 consensus_peers.cc:597] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:40.562115 11004 leader_election.cc:290] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:40.582237  3922 tablet_replica.cc:333] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:15:40.583108  3922 raft_consensus.cc:2243] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:40.584061  3922 raft_consensus.cc:2272] T ed974c2bf41a490ca098100bdfc63351 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.581363  5237 leader_election.cc:304] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:40.585896 11004 raft_consensus.cc:2749] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:40.586822  3922 tablet_replica.cc:333] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:15:40.605844  3922 raft_consensus.cc:2243] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:15:40.606961  3922 raft_consensus.cc:2272] T 8d081e937c2741c9b646839e29e5599f P ad2f9a1e2f7a45429fa69fd23d09f821 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.609678  3922 tablet_replica.cc:333] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:15:40.610419  3922 raft_consensus.cc:2243] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:40.611044  3922 raft_consensus.cc:2272] T 271b0c7d258142798f30accd6aaba829 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.638598  3922 tablet_replica.cc:333] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:15:40.639611  3922 raft_consensus.cc:2243] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:40.640251  3922 raft_consensus.cc:2272] T 8a4dd376f83a42a896a5e1aca58d3221 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.643458  3922 tablet_replica.cc:333] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:15:40.644166  3922 raft_consensus.cc:2243] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:15:40.654114  3922 raft_consensus.cc:2272] T 84919c977be24017b74e122582f71fbe P ad2f9a1e2f7a45429fa69fd23d09f821 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.656822  3922 tablet_replica.cc:333] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:15:40.661000  3922 raft_consensus.cc:2243] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:40.661718  3922 raft_consensus.cc:2272] T 60d88a24e03749b5a24c6baea8ab27f6 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.665916  3922 tablet_replica.cc:333] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:15:40.666599  3922 raft_consensus.cc:2243] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:15:40.667551  3922 raft_consensus.cc:2272] T a71edf310ae54d6981a7c37794f6ba4d P ad2f9a1e2f7a45429fa69fd23d09f821 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.670107  3922 tablet_replica.cc:333] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821: stopping tablet replica
I20260709 12:15:40.670745  3922 raft_consensus.cc:2243] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:40.672657  3922 raft_consensus.cc:2272] T 4d8224f2bf564e7197a33ee531527a15 P ad2f9a1e2f7a45429fa69fd23d09f821 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:40.677685 10977 raft_consensus.cc:493] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:40.678324 10977 raft_consensus.cc:515] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:40.680585 10977 leader_election.cc:290] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:40.683457  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:40.686009 10977 raft_consensus.cc:493] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:40.686771 10977 raft_consensus.cc:515] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:40.688891 10977 leader_election.cc:290] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:40.689945  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:40.690613  5271 raft_consensus.cc:2468] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 16.
I20260709 12:15:40.691824  5801 leader_election.cc:304] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
W20260709 12:15:40.692525  5804 leader_election.cc:336] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:15:40.692663 10977 raft_consensus.cc:2804] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:15:40.693049  5804 leader_election.cc:304] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:40.693922 10878 raft_consensus.cc:2749] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:15:40.696662  5804 leader_election.cc:336] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:15:40.693168 10977 raft_consensus.cc:493] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:40.697817 10977 raft_consensus.cc:3060] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:40.710048 10977 raft_consensus.cc:515] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:40.716609  5804 leader_election.cc:336] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:15:40.718338  5804 consensus_peers.cc:597] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:40.744904 10977 leader_election.cc:290] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:40.746771  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f927a751b4041e99eb5ac25ddf214ec" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:40.747470  5271 raft_consensus.cc:3060] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:15:40.782831  5166 consensus_peers.cc:597] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:40.789265  5240 consensus_peers.cc:597] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:40.794494 11013 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:40.795542  5271 raft_consensus.cc:2468] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 17.
I20260709 12:15:40.797150  5801 leader_election.cc:304] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:40.797072 11013 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:40.798081 10977 raft_consensus.cc:2804] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:15:40.798599 10977 raft_consensus.cc:697] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 17 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:15:40.799496 10977 consensus_queue.cc:237] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:40.801262  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:40.799373 11013 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:15:40.810693  5804 consensus_peers.cc:597] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:40.822978  5166 leader_election.cc:336] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:15:40.823510  5166 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:40.830613 11013 raft_consensus.cc:2749] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:40.840811  5018 catalog_manager.cc:5697] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 16 to 17, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 17 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:40.891453 11018 raft_consensus.cc:493] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:40.892095 11018 raft_consensus.cc:515] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:40.894341 11018 leader_election.cc:290] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:40.895478  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:40.896159  5271 raft_consensus.cc:2468] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 11.
I20260709 12:15:40.897687  5163 leader_election.cc:304] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:40.902138 11018 raft_consensus.cc:2804] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:40.902580 11018 raft_consensus.cc:493] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:40.902963 11018 raft_consensus.cc:3060] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:40.914470 11018 raft_consensus.cc:515] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:15:40.917414  5240 consensus_peers.cc:597] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:40.934979 11018 leader_election.cc:290] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:40.936146  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4d42e47cfd4d859ca8f5ee6401379c" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:40.936777  5271 raft_consensus.cc:3060] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:15:40.936978  5240 consensus_peers.cc:597] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:40.950609  5832 raft_consensus.cc:1275] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:15:40.951112  5240 consensus_peers.cc:597] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:40.947273  5271 raft_consensus.cc:2468] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 12.
I20260709 12:15:40.952208 10951 consensus_queue.cc:1048] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:40.955555  5163 leader_election.cc:304] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:40.956355 11013 raft_consensus.cc:2804] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:40.956862 11013 raft_consensus.cc:697] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:40.958626 11013 consensus_queue.cc:237] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:15:40.986279  5166 leader_election.cc:336] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
W20260709 12:15:40.988255  5166 consensus_peers.cc:597] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:40.988749  5166 leader_election.cc:336] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
W20260709 12:15:40.989468  5166 consensus_peers.cc:597] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:40.990676  5018 catalog_manager.cc:5697] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 11 to 12, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 12 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:41.002401 10872 raft_consensus.cc:493] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:41.003012 10872 raft_consensus.cc:515] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:41.005184 10872 leader_election.cc:290] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:41.037773  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:41.038537  5830 raft_consensus.cc:2468] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 14.
I20260709 12:15:41.049530  5238 leader_election.cc:304] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:15:41.050593 10872 raft_consensus.cc:2804] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:41.051409 10872 raft_consensus.cc:493] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:41.051844 10872 raft_consensus.cc:3060] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:15:41.062819  5166 consensus_peers.cc:597] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:41.065506  5166 consensus_peers.cc:597] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:41.077353 10872 raft_consensus.cc:515] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:41.093921  5804 consensus_peers.cc:597] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:41.094501  5804 consensus_peers.cc:597] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:41.097834 10776 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:41.098475 10776 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:41.102469 10776 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:41.103632  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:41.103950 10872 leader_election.cc:290] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:41.104380  5191 raft_consensus.cc:2468] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 15.
I20260709 12:15:41.105757  5801 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:41.106506 10776 raft_consensus.cc:2804] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:41.107004 10776 raft_consensus.cc:493] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:41.107463 10776 raft_consensus.cc:3060] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:41.107636  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88f51ae73df747849e2f3cd63547a1d0" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:41.108386  5832 raft_consensus.cc:3060] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:15:41.108752  5804 leader_election.cc:336] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:41.116605  5832 raft_consensus.cc:2468] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 15.
I20260709 12:15:41.118943  5238 leader_election.cc:304] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:15:41.120141 10872 raft_consensus.cc:2804] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:41.120798 10872 raft_consensus.cc:697] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 15 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:41.121876 10872 consensus_queue.cc:237] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:41.119823 10776 raft_consensus.cc:515] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:41.124663 10776 leader_election.cc:290] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 16 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:41.127516  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b2fb64d40642259e41424cef193db0" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:41.128367  5191 raft_consensus.cc:3060] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:15:41.140098  5804 leader_election.cc:336] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:41.144538  5191 raft_consensus.cc:2468] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 16.
I20260709 12:15:41.145915  5801 leader_election.cc:304] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:41.146790 10977 raft_consensus.cc:2804] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:15:41.147297 10977 raft_consensus.cc:697] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 16 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:15:41.148213 10977 consensus_queue.cc:237] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:41.167742  5804 consensus_peers.cc:597] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:41.168283  5804 consensus_peers.cc:597] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:41.178007  5018 catalog_manager.cc:5697] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 14 to 15, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 15 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:41.206218  5023 catalog_manager.cc:5697] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 15 to 16, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 16 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:15:41.209317  5166 consensus_peers.cc:597] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:41.213935  5271 raft_consensus.cc:1275] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 17 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:15:41.215942 10977 consensus_queue.cc:1048] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:15:41.235540 10907 raft_consensus.cc:493] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:41.236136 10907 raft_consensus.cc:515] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:41.241443 10907 leader_election.cc:290] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:41.242873  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:15:41.248050  5166 leader_election.cc:336] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:41.248612  5166 leader_election.cc:304] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:41.265682 11018 raft_consensus.cc:2749] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:15:41.318070  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 59226.6us
W20260709 12:15:41.322572  5804 consensus_peers.cc:597] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:41.331700  5804 consensus_peers.cc:597] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:41.341251  5804 consensus_peers.cc:597] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:41.343140 10907 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:41.345968 10907 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:41.349501 10907 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:41.353019  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:41.355965 10977 raft_consensus.cc:493] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:41.356549 10977 raft_consensus.cc:515] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:41.358863 10977 leader_election.cc:290] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:41.359994  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:15:41.344004  5166 consensus_peers.cc:597] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:41.371973  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:15:41.386658  5166 consensus_peers.cc:597] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:41.387253  5166 consensus_peers.cc:597] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:41.390046  5164 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
W20260709 12:15:41.390434  5804 consensus_peers.cc:597] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:41.391088  5804 leader_election.cc:336] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:41.391656  5804 leader_election.cc:304] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:41.392372 10776 raft_consensus.cc:2749] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:41.391008 11018 raft_consensus.cc:2749] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:15:41.343788  5010 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 86045.1us
I20260709 12:15:41.519338 11064 raft_consensus.cc:493] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:41.520431  5271 raft_consensus.cc:1275] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:15:41.520860 11064 raft_consensus.cc:515] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:41.502835 11004 raft_consensus.cc:493] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:41.526527 11004 raft_consensus.cc:515] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:41.529337 11004 leader_election.cc:290] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:41.531243 11065 consensus_queue.cc:1048] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
W20260709 12:15:41.538023  5010 catalog_manager.cc:4755] TS ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 4e275c844ff54adea37252a082eae526: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:41.546593 11064 leader_election.cc:290] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:41.555776 11013 raft_consensus.cc:493] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:41.570538 11013 raft_consensus.cc:515] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:41.573510 11013 leader_election.cc:290] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:41.582011  5832 raft_consensus.cc:1275] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:15:41.592330 11013 raft_consensus.cc:493] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:41.593181 11013 raft_consensus.cc:515] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:41.595963 11013 leader_election.cc:290] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:41.597678  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:41.608055  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
W20260709 12:15:41.608737  5804 consensus_peers.cc:597] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:41.608974  5195 raft_consensus.cc:2468] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 14.
I20260709 12:15:41.610735  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:41.611514 11004 consensus_queue.cc:1048] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:15:41.611964  5237 leader_election.cc:304] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:41.613360 11004 raft_consensus.cc:2804] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:41.613883 11004 raft_consensus.cc:493] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:41.614310 11004 raft_consensus.cc:3060] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:15:41.616629  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 103681us
I20260709 12:15:41.618696 11070 raft_consensus.cc:493] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:41.619686 11070 raft_consensus.cc:515] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:41.623584  5191 raft_consensus.cc:2468] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 10.
I20260709 12:15:41.624387  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:41.625038  5268 raft_consensus.cc:2468] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 10.
I20260709 12:15:41.629844 10872 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:41.630436  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:41.630764 10872 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:41.631316  5831 raft_consensus.cc:2468] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 12.
I20260709 12:15:41.636089 10872 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:41.636497  5163 leader_election.cc:304] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:41.636760 10872 raft_consensus.cc:493] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:41.637524 10872 raft_consensus.cc:515] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:41.640386 10872 leader_election.cc:290] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:41.642417 11068 raft_consensus.cc:2804] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:15:41.630716  5166 leader_election.cc:336] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:41.646337  5237 leader_election.cc:304] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:41.650681  5191 raft_consensus.cc:1275] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:15:41.647032 11070 leader_election.cc:290] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:15:41.655295  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 50033.2us
I20260709 12:15:41.657624 10872 raft_consensus.cc:2804] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:15:41.658068 10872 raft_consensus.cc:493] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:41.658493 10872 raft_consensus.cc:3060] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:15:41.658095  5166 consensus_peers.cc:597] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:41.656111  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:41.661803  5195 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 16.
I20260709 12:15:41.647322 11068 raft_consensus.cc:493] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:41.662717 11068 raft_consensus.cc:3060] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:15:41.686300 10872 raft_consensus.cc:515] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:41.690032 10872 leader_election.cc:290] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:41.699633  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:41.713915  5164 leader_election.cc:304] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:41.714767 11070 raft_consensus.cc:2804] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:15:41.715029  5804 consensus_peers.cc:597] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:41.715180 11070 raft_consensus.cc:493] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:41.715576 11070 raft_consensus.cc:3060] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:41.717665 11013 raft_consensus.cc:493] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:41.725790 11013 raft_consensus.cc:515] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:41.728647 11013 leader_election.cc:290] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:41.731040  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:41.712935 11004 raft_consensus.cc:515] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:41.736899 11071 raft_consensus.cc:493] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:41.740891 11071 raft_consensus.cc:515] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:41.742698  5166 leader_election.cc:336] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
W20260709 12:15:41.743511  5166 leader_election.cc:336] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:41.743921  5166 leader_election.cc:304] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:41.746474 10977 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:41.747359 10977 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:41.763763  5166 leader_election.cc:336] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:41.765580 10907 raft_consensus.cc:2749] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:41.767882 10977 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:41.769399 11071 leader_election.cc:290] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:15:41.780686  5166 consensus_peers.cc:597] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:41.781323  5166 leader_election.cc:336] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:41.781803  5166 leader_election.cc:304] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:41.757287 11068 raft_consensus.cc:515] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:41.783597  5195 raft_consensus.cc:2393] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 11: Already voted for candidate dd62e75bd3ed4ed28f1fb5955d650808 in this term.
I20260709 12:15:41.786381  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:41.787247  5830 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 16.
I20260709 12:15:41.788657  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:41.789489  5832 raft_consensus.cc:2468] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 11.
I20260709 12:15:41.793668 11013 raft_consensus.cc:2749] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:41.795862  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0d002ca1342c9b1b6eb6ed1f0f958" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:41.796533  5195 raft_consensus.cc:3060] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:41.796542 11071 raft_consensus.cc:493] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:41.796537 11070 raft_consensus.cc:515] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:41.802971 11064 raft_consensus.cc:493] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:41.803627 11064 raft_consensus.cc:515] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:41.804669 11070 leader_election.cc:290] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:41.806910 11064 leader_election.cc:290] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:15:41.804194  5166 leader_election.cc:336] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:41.823462 10776 consensus_queue.cc:1048] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:15:41.828613  5166 leader_election.cc:336] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:41.808449  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:41.805217 11071 raft_consensus.cc:515] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:41.810665 10951 raft_consensus.cc:493] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:41.830967 10951 raft_consensus.cc:515] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:41.832312 11071 leader_election.cc:290] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:41.833015 10951 leader_election.cc:290] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:41.811733  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:41.833829  5196 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 16.
I20260709 12:15:41.813290  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:41.813438  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:41.835860  5274 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 16.
I20260709 12:15:41.814494  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:41.814495 11004 leader_election.cc:290] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:41.817728 11068 leader_election.cc:290] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:41.837046  5265 raft_consensus.cc:2468] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 11.
I20260709 12:15:41.837448  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:41.838097  5196 raft_consensus.cc:2468] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 16.
I20260709 12:15:41.838513  5268 raft_consensus.cc:2393] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 11: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:15:41.839336  5237 leader_election.cc:304] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:41.843351  5195 raft_consensus.cc:2468] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 15.
I20260709 12:15:41.846372  5163 leader_election.cc:304] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:41.847548 11070 raft_consensus.cc:2749] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:15:41.846565 11004 raft_consensus.cc:2804] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:15:41.849220 11004 raft_consensus.cc:493] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:41.849764 11004 raft_consensus.cc:3060] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:41.846292  5237 leader_election.cc:304] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:41.854791 10951 raft_consensus.cc:2804] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:41.855361 10951 raft_consensus.cc:697] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 15 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:41.856386 10951 consensus_queue.cc:237] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:41.860049 11004 raft_consensus.cc:515] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:41.863226  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00645b1f1e014de995e4a937f842d909" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:41.863879  5832 raft_consensus.cc:3060] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:41.864768  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:41.865398  5196 raft_consensus.cc:3060] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:41.872033  5832 raft_consensus.cc:2468] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 13.
I20260709 12:15:41.874799  5196 raft_consensus.cc:2468] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 17.
W20260709 12:15:41.839320  5166 consensus_peers.cc:597] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:41.875363 11004 leader_election.cc:290] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:41.877208  5237 leader_election.cc:304] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:41.878597 11004 raft_consensus.cc:2804] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:15:41.879576 10872 raft_consensus.cc:493] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:41.880206 10872 raft_consensus.cc:515] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:41.882653 10872 leader_election.cc:290] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:41.884728  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:41.885856  5196 raft_consensus.cc:2468] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 14.
I20260709 12:15:41.887171  5237 leader_election.cc:304] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:41.887428  5801 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:41.888235 10872 raft_consensus.cc:2804] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:41.888394 10878 raft_consensus.cc:2804] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:15:41.888854 10878 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:41.888787 10872 raft_consensus.cc:493] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:41.889247 10878 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:41.889559 10872 raft_consensus.cc:3060] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:15:41.891065  3922 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 5146)
I20260709 12:15:41.896667  5164 leader_election.cc:304] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:41.879421 11004 raft_consensus.cc:697] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 17 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:41.897809 11068 raft_consensus.cc:2804] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:41.898391 11068 raft_consensus.cc:697] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:41.899405 11068 consensus_queue.cc:237] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:41.882704  5238 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:41.901266 10951 raft_consensus.cc:2804] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:15:41.901688 10951 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:41.902122 10951 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:41.904465 11004 consensus_queue.cc:237] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:41.901708  5801 leader_election.cc:304] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:15:41.900858  5238 leader_election.cc:304] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:15:41.909441 11071 raft_consensus.cc:2804] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:41.909973 11071 raft_consensus.cc:493] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:41.910429 11071 raft_consensus.cc:3060] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:41.912081  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:41.904511 10878 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:41.919425 10878 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:41.916486 11064 raft_consensus.cc:2804] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:41.924448  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:41.924654 11064 raft_consensus.cc:493] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:41.914515 10872 raft_consensus.cc:515] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:41.925137 11064 raft_consensus.cc:3060] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:41.926714  5195 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:15:41.927832  5804 leader_election.cc:336] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
W20260709 12:15:41.928797  5804 leader_election.cc:336] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:41.930209 10872 leader_election.cc:290] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:41.937680  5195 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 17.
I20260709 12:15:41.942031 10776 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:41.942653 10776 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:41.944875 10776 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:41.940845 11071 raft_consensus.cc:515] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:41.951661  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:41.961436 11070 raft_consensus.cc:493] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:41.962055 11070 raft_consensus.cc:515] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:41.964254 11070 leader_election.cc:290] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:41.968482 10951 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:41.971065 11071 leader_election.cc:290] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:41.971462 10951 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:41.973491  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:41.974167  5195 raft_consensus.cc:3060] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:41.976984  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
W20260709 12:15:41.983242  5166 leader_election.cc:336] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:41.984759  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:41.983546  5192 raft_consensus.cc:2393] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 17: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:15:41.990069  5195 raft_consensus.cc:2468] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 15.
I20260709 12:15:41.990360  5268 raft_consensus.cc:2393] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 17: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:15:41.991446  5237 leader_election.cc:304] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:41.993759  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:41.995776 11064 raft_consensus.cc:515] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:42.002025  5271 raft_consensus.cc:2393] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 12: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:15:42.004503 10951 raft_consensus.cc:2804] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:42.015508 10951 raft_consensus.cc:697] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 15 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:42.018416 11064 leader_election.cc:290] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:42.027482  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:42.028308  5268 raft_consensus.cc:2468] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 16.
I20260709 12:15:42.009931  5018 catalog_manager.cc:5697] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 12 to 13, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 13 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:42.035902  5163 leader_election.cc:304] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:42.037263 11070 raft_consensus.cc:2804] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:15:42.037707 11070 raft_consensus.cc:493] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:42.038053 11070 raft_consensus.cc:3060] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:42.016642 10951 consensus_queue.cc:237] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:42.078194 11067 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:42.080546 11067 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:42.094549 11067 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:42.112169 11070 raft_consensus.cc:515] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:15:42.117491  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 90367.4us
W20260709 12:15:42.122128  5166 leader_election.cc:336] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
W20260709 12:15:42.130280  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 127103us
I20260709 12:15:42.130661  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:42.135183  5830 raft_consensus.cc:2468] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 15.
I20260709 12:15:42.140995 11080 raft_consensus.cc:493] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:42.142213 11080 raft_consensus.cc:515] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:42.155838  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a71edf310ae54d6981a7c37794f6ba4d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:42.156548  5265 raft_consensus.cc:3060] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:15:42.157589 11080 leader_election.cc:290] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:15:42.160192  5166 leader_election.cc:336] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:42.164722  5265 raft_consensus.cc:2468] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 17.
I20260709 12:15:42.169762  5163 leader_election.cc:304] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:15:42.172822  5804 leader_election.cc:336] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:42.175074  5804 leader_election.cc:304] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:42.176254 11068 raft_consensus.cc:2804] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:15:42.177038 11068 raft_consensus.cc:697] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 17 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:42.178283 11068 consensus_queue.cc:237] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:42.185536 10977 raft_consensus.cc:2749] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:42.175846 11070 leader_election.cc:290] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 17 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:42.207726  5164 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:42.210520 11068 raft_consensus.cc:2804] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:42.210978 11068 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:42.211371 11068 raft_consensus.cc:3060] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:42.222376  5830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:42.226155  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:42.227015  5829 raft_consensus.cc:2393] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 12: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:15:42.230490  5830 raft_consensus.cc:2393] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 17: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:15:42.249401  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:42.250260  5835 raft_consensus.cc:2468] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 11.
I20260709 12:15:42.259974 11068 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:42.265652  5804 leader_election.cc:336] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:42.267593  5804 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:42.268705 11083 raft_consensus.cc:2749] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:15:42.270280  5804 leader_election.cc:336] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:42.270860  5804 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:42.271864 11083 raft_consensus.cc:2749] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:15:42.273866  5240 consensus_peers.cc:597] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:42.274536  5240 leader_election.cc:336] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
W20260709 12:15:42.274626  5804 leader_election.cc:336] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:42.275360  5804 leader_election.cc:304] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:15:42.276492 11088 log.cc:927] Time spent T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:15:42.277179 11083 raft_consensus.cc:2749] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:15:42.275496  5240 consensus_peers.cc:597] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:42.279598  5240 consensus_peers.cc:597] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:42.289712  5240 leader_election.cc:336] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
W20260709 12:15:42.293643  5240 consensus_peers.cc:597] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:42.294257  5240 consensus_peers.cc:597] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:42.294977  5240 leader_election.cc:336] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
W20260709 12:15:42.295712  5240 leader_election.cc:336] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
W20260709 12:15:42.296389  5240 leader_election.cc:336] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
W20260709 12:15:42.301437  5166 leader_election.cc:336] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:42.289762  5023 catalog_manager.cc:5697] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 16 to 17, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 17 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:42.302795 11068 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 16 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:42.303371  5023 catalog_manager.cc:5697] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 14 to 15, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 15 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:42.305294  5023 catalog_manager.cc:5697] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 14 to 15, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 15 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:42.306916  5238 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:42.307832 11064 raft_consensus.cc:2749] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:15:42.309332  5238 leader_election.cc:304] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:15:42.310268 11064 raft_consensus.cc:2804] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:42.310667 11064 raft_consensus.cc:493] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ad2f9a1e2f7a45429fa69fd23d09f821)
I20260709 12:15:42.311050 11064 raft_consensus.cc:3060] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:42.320458 11064 raft_consensus.cc:515] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:42.322950  5018 catalog_manager.cc:5697] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 16 to 17, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 17 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:42.335505  5191 raft_consensus.cc:1275] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 12:15:42.297153  5240 leader_election.cc:336] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:42.337785  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d081e937c2741c9b646839e29e5599f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:42.338488  5835 raft_consensus.cc:3060] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:42.338696 11080 consensus_queue.cc:1048] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:15:42.357471 11064 leader_election.cc:290] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:15:42.359386  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 62245.3us
I20260709 12:15:42.362635  5835 raft_consensus.cc:2468] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 16.
W20260709 12:15:42.360061  5240 leader_election.cc:336] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:42.366904  5240 leader_election.cc:304] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:42.371619  5830 raft_consensus.cc:1275] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:15:42.373548 11080 raft_consensus.cc:2749] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:15:42.377265  5240 consensus_peers.cc:597] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:42.379261  5240 leader_election.cc:336] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
W20260709 12:15:42.380044  5240 leader_election.cc:336] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:42.380429  5240 leader_election.cc:304] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:42.381161 11064 raft_consensus.cc:2749] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:15:42.382229  5240 leader_election.cc:336] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
W20260709 12:15:42.382915  5240 leader_election.cc:336] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
W20260709 12:15:42.383518  5240 leader_election.cc:336] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
W20260709 12:15:42.384148  5240 leader_election.cc:336] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:42.396965  5835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84919c977be24017b74e122582f71fbe" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:42.397786  5835 raft_consensus.cc:3060] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:15:42.417725  5240 leader_election.cc:336] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:42.419158 11018 consensus_queue.cc:1048] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:15:42.420435  5164 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:42.422935 11018 raft_consensus.cc:2804] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:15:42.423741 11018 raft_consensus.cc:697] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:42.424722 11018 consensus_queue.cc:237] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:42.431082  5191 raft_consensus.cc:1275] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 17 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:15:42.432554 11080 consensus_queue.cc:1048] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:15:42.495082  5018 catalog_manager.cc:5697] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 15 to 16, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 16 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:15:42.496656  5240 leader_election.cc:336] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:42.497187  5240 leader_election.cc:304] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:42.497983 11064 raft_consensus.cc:2749] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:15:42.500586  5166 consensus_peers.cc:597] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:42.502241  5835 raft_consensus.cc:2468] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 12.
W20260709 12:15:42.505632  5240 leader_election.cc:336] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
W20260709 12:15:42.515714  5240 leader_election.cc:336] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
W20260709 12:15:42.516356  5240 consensus_peers.cc:597] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:42.522373  5240 consensus_peers.cc:597] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:42.545342  5238 leader_election.cc:304] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:42.547972 11080 raft_consensus.cc:2804] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:42.550159 11080 raft_consensus.cc:697] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 12 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:42.554085 11080 consensus_queue.cc:237] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:42.568250  5166 consensus_peers.cc:597] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:42.578799  5240 consensus_peers.cc:597] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:42.600114  5018 catalog_manager.cc:5697] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 11 to 12, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 12 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:15:42.640190  5010 catalog_manager.cc:4755] TS ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 4e275c844ff54adea37252a082eae526: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:42.670847  5196 raft_consensus.cc:1275] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:15:42.674619 11080 consensus_queue.cc:1048] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:15:42.678179  5240 consensus_peers.cc:597] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:42.815351  5271 raft_consensus.cc:1275] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 17 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:15:42.821019 11070 consensus_queue.cc:1048] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
W20260709 12:15:42.891628  3922 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 5146)
W20260709 12:15:42.933480  5166 consensus_peers.cc:597] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:42.958642  5166 consensus_peers.cc:597] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:42.965922  5240 consensus_peers.cc:597] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:42.971165  5832 raft_consensus.cc:1275] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:15:43.007903 11070 consensus_queue.cc:1048] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:15:43.184126  5830 raft_consensus.cc:1275] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:15:43.196851 11062 consensus_queue.cc:1048] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:15:43.205639  5166 consensus_peers.cc:597] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:43.278687  5166 consensus_peers.cc:597] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:43.328158  5240 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111) [suppressed 380 similar messages]
W20260709 12:15:43.403544  5804 consensus_peers.cc:597] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:43.442613  5166 consensus_peers.cc:597] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:43.536473  5166 consensus_peers.cc:597] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:43.552465 11070 raft_consensus.cc:493] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.553288 11070 raft_consensus.cc:515] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:43.556303 11070 leader_election.cc:290] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:43.557864  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:43.559731  5265 raft_consensus.cc:2468] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 11.
I20260709 12:15:43.568773  5163 leader_election.cc:304] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:43.570493 11067 raft_consensus.cc:2804] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:15:43.570976 11067 raft_consensus.cc:493] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:43.571435 11067 raft_consensus.cc:3060] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:15:43.584324 11067 raft_consensus.cc:515] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:43.587567 11067 leader_election.cc:290] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:15:43.552659  5166 consensus_peers.cc:597] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:43.587752  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f7ce8a804f431dbbc5adfbca8d745e" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:43.588992  5265 raft_consensus.cc:3060] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:15:43.615296  5166 leader_election.cc:336] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
W20260709 12:15:43.616374  5166 leader_election.cc:336] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
W20260709 12:15:43.634434  5166 consensus_peers.cc:597] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:43.635059  5804 consensus_peers.cc:597] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:43.642204  5265 raft_consensus.cc:2468] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd62e75bd3ed4ed28f1fb5955d650808 in term 12.
I20260709 12:15:43.649035  5163 leader_election.cc:304] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:15:43.645984  5804 consensus_peers.cc:597] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:43.650544 11018 raft_consensus.cc:2804] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:15:43.651134 11018 raft_consensus.cc:697] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 LEADER]: Becoming Leader. State: Replica: dd62e75bd3ed4ed28f1fb5955d650808, State: Running, Role: LEADER
I20260709 12:15:43.652062 11018 consensus_queue.cc:237] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:43.678687  5023 catalog_manager.cc:5697] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 reported cstate change: term changed from 10 to 12, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130). New cstate: current_term: 12 leader_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } }
W20260709 12:15:43.715828  5166 consensus_peers.cc:597] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:43.728490 11107 log.cc:927] Time spent T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 12:15:43.747862  5804 consensus_peers.cc:597] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:43.778837  5804 consensus_peers.cc:597] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:43.796679  5166 consensus_peers.cc:597] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:43.816684  5804 consensus_peers.cc:597] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:43.853637  5804 consensus_peers.cc:597] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:43.892614  3922 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 5146)
W20260709 12:15:43.942636  5804 consensus_peers.cc:597] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:43.961885  5166 consensus_peers.cc:597] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:43.962477  5166 consensus_peers.cc:597] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:43.993783 11087 raft_consensus.cc:493] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:43.994319 11087 raft_consensus.cc:515] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:43.996469 11087 leader_election.cc:290] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:43.999547  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:44.000232  5265 raft_consensus.cc:2468] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 12.
I20260709 12:15:44.005025  5801 leader_election.cc:304] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:15:44.006879 11083 raft_consensus.cc:2804] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:15:44.007294 11083 raft_consensus.cc:493] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:44.007608 11083 raft_consensus.cc:3060] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:15:44.020574  5804 leader_election.cc:336] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
W20260709 12:15:44.030184  5804 consensus_peers.cc:597] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:44.045082  5166 consensus_peers.cc:597] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:44.051038  5166 consensus_peers.cc:597] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:44.046082 11083 raft_consensus.cc:515] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:44.058619  5804 leader_election.cc:336] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:44.062613 11083 leader_election.cc:290] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:44.063289  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e701f062f14e4e80492fc08144cca6" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:44.066931  5265 raft_consensus.cc:3060] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:15:44.081689  5265 raft_consensus.cc:2468] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 13.
W20260709 12:15:44.092199  5166 consensus_peers.cc:597] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:44.105150  5804 consensus_peers.cc:597] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:44.120249  5240 consensus_peers.cc:597] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:44.165809  5240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 45363.3us
I20260709 12:15:44.173197 11062 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.173907 11062 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:44.180037 11062 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:44.182356  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:44.182701  5268 raft_consensus.cc:1275] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Refusing update from remote peer dd62e75bd3ed4ed28f1fb5955d650808: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:15:44.189019  5196 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 17.
I20260709 12:15:44.191782 11067 consensus_queue.cc:1048] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:15:44.245198  5240 consensus_peers.cc:597] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:44.271559  5240 leader_election.cc:336] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
W20260709 12:15:44.275332  5240 consensus_peers.cc:597] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:44.289577 11114 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:44.290313 11114 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:44.293166 11114 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:15:44.301834  5240 consensus_peers.cc:597] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:44.335665  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 195879us
I20260709 12:15:44.365813  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:44.366564  5265 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 17.
I20260709 12:15:44.372785  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:44.373684  5829 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 17.
I20260709 12:15:44.399879  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:44.400597  5196 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 17.
I20260709 12:15:44.407972  5801 leader_election.cc:304] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:44.409523 11115 raft_consensus.cc:2804] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:15:44.410154 11115 raft_consensus.cc:697] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 13 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:15:44.411533 11115 consensus_queue.cc:237] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:44.429983  5801 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
W20260709 12:15:44.431731  5240 consensus_peers.cc:597] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:44.450346 11087 raft_consensus.cc:2804] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:15:44.450874 11087 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:44.451231 11087 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:44.475628  5238 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:44.476501 11105 raft_consensus.cc:2804] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:15:44.476909 11105 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:44.477242 11105 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:15:44.489996  5240 consensus_peers.cc:597] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:44.495270  5804 consensus_peers.cc:597] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:44.498957  5240 consensus_peers.cc:597] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:44.496903 11087 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:44.504869 11105 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:44.508136 11087 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 18 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:44.509931  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:44.510073  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:44.510660  5191 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:44.510926  5274 raft_consensus.cc:2393] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate bce73265e27d4b30a4dcc1e491305088 in current term 18: Already voted for candidate 9e794b72ed7640219f90ec4232363929 in this term.
I20260709 12:15:44.513482 11105 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 18 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:44.514132  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:44.520757  5191 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 18.
I20260709 12:15:44.539636  5018 catalog_manager.cc:5697] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 11 to 13, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 13 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:15:44.521819  5804 leader_election.cc:336] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
W20260709 12:15:44.542871  5804 consensus_peers.cc:597] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:44.545500  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
W20260709 12:15:44.537284  5240 leader_election.cc:336] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:44.546722  5240 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:44.546277  5838 raft_consensus.cc:2393] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e794b72ed7640219f90ec4232363929 in current term 18: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:15:44.553195 11079 raft_consensus.cc:2749] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 12:15:44.557982  5804 leader_election.cc:336] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:44.558610  5804 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:44.562494 11087 raft_consensus.cc:2749] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 12:15:44.578234  5240 consensus_peers.cc:597] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:44.713912  5240 consensus_peers.cc:597] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:44.745054  5010 catalog_manager.cc:4755] TS ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 4e275c844ff54adea37252a082eae526: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
W20260709 12:15:44.845239  5240 consensus_peers.cc:597] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:44.864573  5240 consensus_peers.cc:597] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:44.893129  3922 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 5146)
W20260709 12:15:44.927412  5804 consensus_peers.cc:597] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:44.932559  5274 raft_consensus.cc:1275] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:15:44.938336 11112 consensus_queue.cc:1048] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:15:44.952589  5166 consensus_peers.cc:597] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:45.017861  5166 consensus_peers.cc:597] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:45.129542  5240 consensus_peers.cc:597] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:45.156862  5240 consensus_peers.cc:597] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:45.274001  5240 consensus_peers.cc:597] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:45.343060  5240 consensus_peers.cc:597] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:45.381745  5166 consensus_peers.cc:597] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:45.504056  5166 consensus_peers.cc:597] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:45.560559  5166 consensus_peers.cc:597] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:45.718488  5166 consensus_peers.cc:597] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:45.893638  3922 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 5146)
W20260709 12:15:45.968788  5166 consensus_peers.cc:597] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:46.077562  5166 consensus_peers.cc:597] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:46.088213  5166 consensus_peers.cc:597] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:46.090569  5804 consensus_peers.cc:597] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:46.091150  5804 consensus_peers.cc:597] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:46.226655  5804 consensus_peers.cc:597] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:46.259104  5166 consensus_peers.cc:597] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:46.259816  5166 consensus_peers.cc:597] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:46.292691  5804 consensus_peers.cc:597] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:46.300881  5804 consensus_peers.cc:597] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:46.307044  5804 consensus_peers.cc:597] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:46.318899  5240 consensus_peers.cc:597] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:46.321239  5166 consensus_peers.cc:597] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:46.328378  5804 consensus_peers.cc:597] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:46.410419  5240 consensus_peers.cc:597] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:46.479434  5166 consensus_peers.cc:597] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:46.524789  5804 consensus_peers.cc:597] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:46.530560  5166 consensus_peers.cc:597] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:46.552106  5240 consensus_peers.cc:597] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:46.576210  5804 consensus_peers.cc:597] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:46.578091  5166 consensus_peers.cc:597] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:46.611678  5166 consensus_peers.cc:597] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:46.647845  5240 consensus_peers.cc:597] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:46.724895  5804 consensus_peers.cc:597] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:46.744431  5166 consensus_peers.cc:597] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:46.799122  5240 consensus_peers.cc:597] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:46.809799  5240 consensus_peers.cc:597] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:46.828848  5804 consensus_peers.cc:597] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:46.860986  5804 consensus_peers.cc:597] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:46.894368  3922 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 5146)
W20260709 12:15:47.002382  5240 consensus_peers.cc:597] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:15:47.090230 11124 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:47.090823 11124 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:47.091413  5240 consensus_peers.cc:597] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:15:47.094820 11124 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:47.096709  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:15:47.097368  5240 leader_election.cc:336] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:47.097605  5831 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 18.
I20260709 12:15:47.108525  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:47.110471  5196 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 18.
I20260709 12:15:47.112607  5237 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:47.120304 11124 raft_consensus.cc:2804] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:15:47.120777 11124 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:47.121162 11124 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:15:47.173807 11124 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:47.184873 11124 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 19 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:47.185644  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:47.186826  5196 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:15:47.190250  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:47.190910  5831 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:15:47.200166  5196 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 19.
I20260709 12:15:47.207041  5831 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 19.
I20260709 12:15:47.210577  5238 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: 
I20260709 12:15:47.211899 11062 raft_consensus.cc:2804] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:15:47.212504 11062 raft_consensus.cc:697] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 19 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:47.213498 11062 consensus_queue.cc:237] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:47.214051  5240 leader_election.cc:336] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:47.239763  5018 catalog_manager.cc:5697] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 16 to 19, leader changed from ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 19 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:15:47.239799  5240 consensus_peers.cc:597] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:15:47.353533  5268 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34668
I20260709 12:15:47.354326  5268 raft_consensus.cc:606] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 19 LEADER]: Received request to transfer leadership
I20260709 12:15:47.364629  5274 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34668
I20260709 12:15:47.365208  5274 raft_consensus.cc:606] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 19 LEADER]: Received request to transfer leadership
I20260709 12:15:47.400605  5268 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61"
dest_uuid: "9e794b72ed7640219f90ec4232363929"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34668
I20260709 12:15:47.401327  5268 raft_consensus.cc:606] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 19 LEADER]: Received request to transfer leadership
W20260709 12:15:47.424532  5071 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:15:47.425004  5071 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for d87fb855c56c430f896b24f98722bd61 already in progress
W20260709 12:15:47.425309  5071 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for d87fb855c56c430f896b24f98722bd61 already in progress
W20260709 12:15:47.473595  5166 consensus_peers.cc:597] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:47.525452  5240 consensus_peers.cc:597] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:47.526563  5801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 56543.7us
W20260709 12:15:47.560434  5240 consensus_peers.cc:597] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:47.561645  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 45418.7us
W20260709 12:15:47.653779  5240 consensus_peers.cc:597] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:47.694416  5240 consensus_peers.cc:597] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:47.701287  5838 raft_consensus.cc:1275] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [term 19 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 12:15:47.723186  5804 consensus_peers.cc:597] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:47.724637 11062 consensus_queue.cc:1048] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.006s
W20260709 12:15:47.779278  5240 consensus_peers.cc:597] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:15:47.779280  5196 raft_consensus.cc:1275] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 19 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:15:47.784943 11062 consensus_queue.cc:1048] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:15:47.801100 11062 raft_consensus.cc:993] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929: : Instructing follower bce73265e27d4b30a4dcc1e491305088 to start an election
I20260709 12:15:47.801653 11062 raft_consensus.cc:1081] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 19 LEADER]: Signalling peer bce73265e27d4b30a4dcc1e491305088 to start an election
I20260709 12:15:47.816496  5838 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61"
dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
 from {username='slave'} at 127.0.0.1:46088
I20260709 12:15:47.817183  5838 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:47.817551  5838 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:15:47.828934  5838 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:47.841935  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: true dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:47.862020  5838 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 20 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:47.864645  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: true dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:47.866472  5274 raft_consensus.cc:3055] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:15:47.866792  5274 raft_consensus.cc:740] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:47.867597  5274 consensus_queue.cc:260] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:47.868927  5274 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:15:47.885082  5240 consensus_peers.cc:597] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:47.885710  5274 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 20.
W20260709 12:15:47.892915  5804 leader_election.cc:336] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:47.893543  5804 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:47.894376 11144 raft_consensus.cc:2749] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 12:15:47.895277  3922 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 5146)
W20260709 12:15:47.908397  5166 consensus_peers.cc:597] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:47.914270  5240 consensus_peers.cc:597] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:47.926817  5166 consensus_peers.cc:597] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:47.994872  5166 consensus_peers.cc:597] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:48.053089  5166 consensus_peers.cc:597] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:48.294657  5166 consensus_peers.cc:597] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:48.308501  5804 consensus_peers.cc:597] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:48.331475  5804 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111) [suppressed 457 similar messages]
W20260709 12:15:48.513260  5166 consensus_peers.cc:597] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:48.521627  5166 consensus_peers.cc:597] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:48.524984  5166 consensus_peers.cc:597] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:48.592592  5804 consensus_peers.cc:597] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:48.652005  5804 consensus_peers.cc:597] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:48.682548  5240 consensus_peers.cc:597] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:48.705547  5804 consensus_peers.cc:597] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:48.726058  5166 consensus_peers.cc:597] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:48.869696  5166 consensus_peers.cc:597] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:48.888774  5804 consensus_peers.cc:597] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:48.895759  3922 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 5146)
W20260709 12:15:48.907224  5240 consensus_peers.cc:597] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:48.916877  5804 consensus_peers.cc:597] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:48.918728  5010 catalog_manager.cc:4755] TS ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 4e275c844ff54adea37252a082eae526: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
W20260709 12:15:48.933343  5166 consensus_peers.cc:597] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:48.956528  5804 consensus_peers.cc:597] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:48.971839  5166 consensus_peers.cc:597] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:48.976482  5240 consensus_peers.cc:597] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:48.978647  5804 consensus_peers.cc:597] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:49.053519  5240 consensus_peers.cc:597] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:49.132712  5240 consensus_peers.cc:597] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:49.137025  5166 consensus_peers.cc:597] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:49.212734  5804 consensus_peers.cc:597] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:49.237924  5804 consensus_peers.cc:597] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:49.267257  5166 consensus_peers.cc:597] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:49.296362  5166 consensus_peers.cc:597] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:15:49.298507 11136 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:49.299191 11136 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:49.305694  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:49.306506  5274 raft_consensus.cc:2393] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 20: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
I20260709 12:15:49.308828 11136 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:49.333678  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:49.334471  5832 raft_consensus.cc:2393] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd62e75bd3ed4ed28f1fb5955d650808 in current term 20: Already voted for candidate bce73265e27d4b30a4dcc1e491305088 in this term.
W20260709 12:15:49.336980  5166 leader_election.cc:336] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:49.337527  5166 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:49.346235 11136 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:15:49.381522  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 44577.1us
W20260709 12:15:49.416919  5240 consensus_peers.cc:597] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:15:49.431198 11136 raft_consensus.cc:2749] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:15:49.444768  5804 consensus_peers.cc:597] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:49.445348  5804 consensus_peers.cc:597] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:49.470007  5166 consensus_peers.cc:597] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:49.480015  5240 consensus_peers.cc:597] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:49.535512  5240 consensus_peers.cc:597] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:49.825922  5240 consensus_peers.cc:597] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:15:49.871440 11144 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:49.872036 11144 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:49.875768 11144 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:49.882342  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" is_pre_election: true
I20260709 12:15:49.883069  5196 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 20.
I20260709 12:15:49.884161  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:49.884829  5274 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 20.
W20260709 12:15:49.886956  5804 leader_election.cc:336] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:49.887495  5801 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:49.890062 11144 raft_consensus.cc:2804] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:15:49.890554 11144 raft_consensus.cc:493] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:49.893147 11144 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:15:49.896288  3922 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 5146)
I20260709 12:15:49.901847 11144 raft_consensus.cc:515] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:49.908169  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "dd62e75bd3ed4ed28f1fb5955d650808"
I20260709 12:15:49.908800  5196 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:15:49.919636  5804 leader_election.cc:336] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:49.923578  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d87fb855c56c430f896b24f98722bd61" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:49.924191  5274 raft_consensus.cc:3060] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:15:49.924651  5196 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 21.
I20260709 12:15:49.930514  5274 raft_consensus.cc:2468] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 21.
I20260709 12:15:49.932896  5801 leader_election.cc:304] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:49.934227 11155 raft_consensus.cc:2804] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:15:49.935320 11155 raft_consensus.cc:697] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [term 21 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:15:49.933471 11144 leader_election.cc:290] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 21 election: Requested vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:49.940236 11155 consensus_queue.cc:237] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:49.965531  5018 catalog_manager.cc:5697] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 19 to 21, leader changed from 9e794b72ed7640219f90ec4232363929 (127.3.212.131) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 21 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:15:49.970227  5166 consensus_peers.cc:597] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:50.109100  5240 consensus_peers.cc:597] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:50.277026  5240 consensus_peers.cc:597] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:50.277695  5240 consensus_peers.cc:597] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:50.288079  5240 consensus_peers.cc:597] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:50.348698  5804 consensus_peers.cc:597] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:50.370877  5240 consensus_peers.cc:597] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:15:50.415894  5191 raft_consensus.cc:1275] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 21 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:15:50.417807 11155 consensus_queue.cc:1048] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:15:50.445683  5166 consensus_peers.cc:597] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:15:50.458665  5268 raft_consensus.cc:1275] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 21 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:15:50.462867 11137 consensus_queue.cc:1048] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:15:50.488190  5804 consensus_peers.cc:597] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:50.498227  5166 consensus_peers.cc:597] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:50.511992  5804 consensus_peers.cc:597] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:50.521672  5240 consensus_peers.cc:597] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:50.723994  5166 consensus_peers.cc:597] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:50.760109  5166 consensus_peers.cc:597] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:50.827354  5166 consensus_peers.cc:597] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:50.896827  3922 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 5146)
W20260709 12:15:50.940871  5804 consensus_peers.cc:597] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:51.129318  5804 consensus_peers.cc:597] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:51.147548  5240 consensus_peers.cc:597] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:51.262265  5804 consensus_peers.cc:597] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:51.333003  5804 consensus_peers.cc:597] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:51.471769  5804 consensus_peers.cc:597] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:51.513453  5240 consensus_peers.cc:597] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:51.543381  5804 consensus_peers.cc:597] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:51.565526  5804 consensus_peers.cc:597] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:51.667443  5240 consensus_peers.cc:597] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:51.706184  5240 consensus_peers.cc:597] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:51.727586  5804 consensus_peers.cc:597] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:51.747010  5804 consensus_peers.cc:597] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:51.793856  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 45940.7us
W20260709 12:15:51.797744  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44455, user_credentials={real_user=slave}} blocked reactor thread for 50350.7us
W20260709 12:15:51.812867  5240 consensus_peers.cc:597] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:51.848205  5240 consensus_peers.cc:597] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:51.882120  5804 consensus_peers.cc:597] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:51.902707  5804 consensus_peers.cc:597] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:51.929682  5240 consensus_peers.cc:597] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:51.954376  5166 consensus_peers.cc:597] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:51.955112  5166 consensus_peers.cc:597] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:51.966711  5166 consensus_peers.cc:597] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:51.967375  5166 consensus_peers.cc:597] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:51.980650  5166 consensus_peers.cc:597] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:52.071707  5240 consensus_peers.cc:597] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:52.187530  5166 consensus_peers.cc:597] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:52.217226  5166 consensus_peers.cc:597] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:52.220074  5166 consensus_peers.cc:597] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:52.278364  5240 consensus_peers.cc:597] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:52.280133  5166 consensus_peers.cc:597] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:52.380715  5166 consensus_peers.cc:597] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:15:52.389816  3922 tablet_server.cc:196] TabletServer@127.3.212.129:0 shutdown complete.
W20260709 12:15:52.539108  5166 consensus_peers.cc:597] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:52.564311  5240 consensus_peers.cc:597] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:15:52.689080  3922 tablet_server.cc:179] TabletServer@127.3.212.130:0 shutting down...
W20260709 12:15:52.703570  5240 consensus_peers.cc:597] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:52.711730  5804 consensus_peers.cc:597] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:52.714161  5801 consensus_peers.cc:597] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:52.724097  5166 consensus_peers.cc:597] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:52.775455  5237 consensus_peers.cc:597] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:52.776293  5237 consensus_peers.cc:597] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:52.779129  5237 consensus_peers.cc:597] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:52.787073  5240 consensus_peers.cc:597] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:52.847867  5801 consensus_peers.cc:597] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:52.873400  5801 consensus_peers.cc:597] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:52.885165  5240 consensus_peers.cc:597] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:52.893146  5804 consensus_peers.cc:597] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:52.904441  5237 consensus_peers.cc:597] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:52.917696  5237 consensus_peers.cc:597] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:52.922595  5801 consensus_peers.cc:597] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:52.939618  5801 consensus_peers.cc:597] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:52.949818  5801 consensus_peers.cc:597] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:52.969195  5240 consensus_peers.cc:597] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:52.990770  5801 consensus_peers.cc:597] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:52.990794  5237 consensus_peers.cc:597] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:52.994920  5801 consensus_peers.cc:597] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:53.001119  5801 consensus_peers.cc:597] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:53.005489  5801 consensus_peers.cc:597] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:53.011442  5237 consensus_peers.cc:597] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:53.013759  3922 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:53.019461  3922 tablet_replica.cc:333] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
I20260709 12:15:53.020515  3922 raft_consensus.cc:2243] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:15:53.023380  3922 raft_consensus.cc:2272] T c7bb7b814fea4a2488cc39d06fc90483 P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:53.028146  3922 tablet_replica.cc:333] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
I20260709 12:15:53.034283  3922 raft_consensus.cc:2243] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 LEADER]: Raft consensus shutting down.
W20260709 12:15:53.030576  5804 consensus_peers.cc:597] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:53.037560  5237 consensus_peers.cc:597] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:53.057336  5237 consensus_peers.cc:597] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:53.095543  5801 consensus_peers.cc:597] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:53.111455  5237 consensus_peers.cc:597] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:53.126734  5237 consensus_peers.cc:597] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:53.042460  3922 raft_consensus.cc:2272] T f5815aa6770341a7ae03cf8dc1b8a05e P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:53.166867  5237 consensus_peers.cc:597] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:53.167517  3922 tablet_replica.cc:333] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
I20260709 12:15:53.168993  3922 raft_consensus.cc:2243] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Raft consensus shutting down.
W20260709 12:15:53.170605  5238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 44718.6us
W20260709 12:15:53.182219  5801 consensus_peers.cc:597] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:53.188930  5801 consensus_peers.cc:597] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:53.189339  3922 raft_consensus.cc:2272] T 2a6867413d1d4b49bcd267c1e134d12e P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:53.221264  5237 consensus_peers.cc:597] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:53.231680  3922 tablet_replica.cc:333] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
I20260709 12:15:53.250375  3922 raft_consensus.cc:2243] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:15:53.335888  3922 raft_consensus.cc:2272] T ecedf48dca8a4a35adc39d76a9a93513 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:53.303763  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 73548.6us
W20260709 12:15:53.343083  5804 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111) [suppressed 456 similar messages]
I20260709 12:15:53.373361  3922 tablet_replica.cc:333] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
W20260709 12:15:53.404440  5240 consensus_peers.cc:597] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:15:53.419262  3922 raft_consensus.cc:2243] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:53.465413  3922 raft_consensus.cc:2272] T ddd16ccf58f24f6db29e5fc39a06e5c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:53.496407  3922 tablet_replica.cc:333] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
I20260709 12:15:53.541203  3922 raft_consensus.cc:2243] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:53.541920  3922 raft_consensus.cc:2272] T 90cb6c9306054ce3b2bc1bbd21c7345f P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:53.515829  5240 consensus_peers.cc:597] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:15:53.546167  3922 tablet_replica.cc:333] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
I20260709 12:15:53.547000  3922 raft_consensus.cc:2243] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:15:53.548314  3922 raft_consensus.cc:2272] T ba4d42e47cfd4d859ca8f5ee6401379c P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:53.551338  3922 tablet_replica.cc:333] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
I20260709 12:15:53.553709  3922 raft_consensus.cc:2243] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:53.555243  3922 raft_consensus.cc:2272] T a6b2fb64d40642259e41424cef193db0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:53.558240  3922 tablet_replica.cc:333] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
I20260709 12:15:53.559059  3922 raft_consensus.cc:2243] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:15:53.560747  3922 raft_consensus.cc:2272] T fe3c5015888a494085f9a8b6eb204bcf P dd62e75bd3ed4ed28f1fb5955d650808 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:53.564044  3922 tablet_replica.cc:333] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
I20260709 12:15:53.564913  3922 raft_consensus.cc:2243] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:53.565517  3922 raft_consensus.cc:2272] T 20ba878da4e3492fbdf2f90c6bb202c4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:53.568996  3922 tablet_replica.cc:333] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
I20260709 12:15:53.569839  3922 raft_consensus.cc:2243] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:53.571234  3922 raft_consensus.cc:2272] T 21832120214f4b8fb9e2e0de351565f0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:53.576975  3922 tablet_replica.cc:333] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
I20260709 12:15:53.577881  3922 raft_consensus.cc:2243] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:15:53.593834 11181 raft_consensus.cc:493] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:53.594807  3922 raft_consensus.cc:2272] T d8017a2b75074e4b9f0691c32850f71a P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:53.594477 11181 raft_consensus.cc:515] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:53.598106  3922 tablet_replica.cc:333] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
I20260709 12:15:53.598985  3922 raft_consensus.cc:2243] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:53.599308 11181 leader_election.cc:290] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:53.599861  3922 raft_consensus.cc:2272] T 63f38af52cc54adeb374ef3d32a43af6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:53.623833  3922 tablet_replica.cc:333] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
I20260709 12:15:53.624676  3922 raft_consensus.cc:2243] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:53.637655  5831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:53.643052  3922 raft_consensus.cc:2272] T 41c65b96548e49b3863d03db116fd8d0 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:53.646284  3922 tablet_replica.cc:333] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
I20260709 12:15:53.647167  3922 raft_consensus.cc:2243] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:15:53.648353  3922 raft_consensus.cc:2272] T 93f7ce8a804f431dbbc5adfbca8d745e P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:53.652565  3922 tablet_replica.cc:333] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
I20260709 12:15:53.653527  3922 raft_consensus.cc:2243] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:53.654703  3922 raft_consensus.cc:2272] T d87fb855c56c430f896b24f98722bd61 P dd62e75bd3ed4ed28f1fb5955d650808 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:53.671262  3922 tablet_replica.cc:333] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
I20260709 12:15:53.676738  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63fe19b7c5e4c73b49eee26ad00e88d" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:53.695878 11181 raft_consensus.cc:493] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:53.696743 11181 raft_consensus.cc:515] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:53.728466 11181 leader_election.cc:290] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:53.675797  3922 raft_consensus.cc:2243] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:15:53.734354  3922 raft_consensus.cc:2272] T 71729ba8cfa049e8b7dac6674d1ba13b P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:53.737200  3922 tablet_replica.cc:333] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
I20260709 12:15:53.738144  3922 raft_consensus.cc:2243] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:53.738966  3922 raft_consensus.cc:2272] T 62577fc91bb44d3a882109dc63f74008 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:53.741854  3922 tablet_replica.cc:333] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
I20260709 12:15:53.742655  3922 raft_consensus.cc:2243] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:15:53.743896  3922 raft_consensus.cc:2272] T b4b265799c1c447794c6126f3ae47e5d P dd62e75bd3ed4ed28f1fb5955d650808 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:53.744882  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d88a24e03749b5a24c6baea8ab27f6" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:53.754717  3922 tablet_replica.cc:333] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
I20260709 12:15:53.755623  3922 raft_consensus.cc:2243] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:53.756336  3922 raft_consensus.cc:2272] T d8dc93d0992c4324872c6aab5aa9db8c P dd62e75bd3ed4ed28f1fb5955d650808 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:53.757531  5166 consensus_peers.cc:597] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:54.082497  5166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 324992us
I20260709 12:15:53.759397  3922 tablet_replica.cc:333] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
I20260709 12:15:54.085081  3922 raft_consensus.cc:2243] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:54.085840  3922 raft_consensus.cc:2272] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:54.088667  3922 tablet_replica.cc:333] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
I20260709 12:15:53.850512 11187 raft_consensus.cc:493] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:54.090919 11187 raft_consensus.cc:515] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:53.787901  5164 leader_election.cc:304] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:54.035910 11188 raft_consensus.cc:493] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:54.103416 11188 raft_consensus.cc:515] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:54.105731 11188 leader_election.cc:290] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:54.038199 11181 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:54.106470 11181 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:54.108539 11181 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:54.055685 11171 raft_consensus.cc:493] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:54.110868 11171 raft_consensus.cc:515] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:54.070290 11136 raft_consensus.cc:493] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
W20260709 12:15:54.114916  5240 consensus_peers.cc:597] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:15:54.114758 11136 raft_consensus.cc:515] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:54.115904  5240 consensus_peers.cc:597] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:15:54.116778 11136 leader_election.cc:290] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:54.076417 11189 raft_consensus.cc:493] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:54.117445 11189 raft_consensus.cc:515] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:54.119709 11189 leader_election.cc:290] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:54.093158 11187 leader_election.cc:290] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:54.113293 11171 leader_election.cc:290] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:15:54.124302  5240 consensus_peers.cc:597] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:15:54.135838 11181 raft_consensus.cc:2749] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:54.138844  3922 raft_consensus.cc:2243] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:15:54.140027  3922 raft_consensus.cc:2272] T cd07c3eb35104201a0e6b64cd77cb6b6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:54.142856  3922 tablet_replica.cc:333] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
I20260709 12:15:54.143630  3922 raft_consensus.cc:2243] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Raft consensus shutting down.
W20260709 12:15:54.154832  5164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:43539, user_credentials={real_user=slave}} blocked reactor thread for 367115us
I20260709 12:15:54.155674  3922 raft_consensus.cc:2272] T f34c97113147431584d6336e0d849164 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:54.156559  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:46709, user_credentials={real_user=slave}} blocked reactor thread for 81671.2us
W20260709 12:15:54.189132  5804 consensus_peers.cc:597] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:15:54.191123  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0fcb55471024c3d818106c4bfdf84d4" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:54.191561  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:54.194299  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:54.194433  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:54.191615  3922 tablet_replica.cc:333] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
I20260709 12:15:54.199168  3922 raft_consensus.cc:2243] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:15:54.199936  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:54.200189  3922 raft_consensus.cc:2272] T 4f87264424df422fa5223dd7a8803eab P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:54.200373  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b3c9565b564c6d934ce652edaabd1f" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:15:54.206040  5240 consensus_peers.cc:597] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:54.218453  5804 consensus_peers.cc:597] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:54.222098  5804 consensus_peers.cc:597] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:15:54.225224  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89852cae0bd14fd8be73b84dc4a49b2a" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:15:54.226606  5804 consensus_peers.cc:597] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:54.227800  5166 leader_election.cc:336] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:54.228253  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e275c844ff54adea37252a082eae526" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:54.229962  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3beaf3ce31042719868401157039ee9" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:15:54.231007  5165 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:15:54.228283  5166 leader_election.cc:304] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:54.232306 11194 raft_consensus.cc:2749] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:54.232316  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a975d4f227214562b6fc39ea53081961" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:54.233299 11194 raft_consensus.cc:493] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:54.233837 11194 raft_consensus.cc:515] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:54.236222 11194 leader_election.cc:290] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:54.237613  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0500c51d8bf49ff987108802ec3ee12" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:54.237682 11182 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:54.238503 11182 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:54.240036 11194 raft_consensus.cc:493] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:54.240589 11194 raft_consensus.cc:515] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:54.243412  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:54.243944 11182 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:54.242681 11194 leader_election.cc:290] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:54.244998 11188 raft_consensus.cc:493] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:54.249948 11188 raft_consensus.cc:515] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:54.252048 11188 leader_election.cc:290] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:54.248067 11192 raft_consensus.cc:493] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bce73265e27d4b30a4dcc1e491305088)
I20260709 12:15:54.254459 11192 raft_consensus.cc:515] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:54.248822  5801 leader_election.cc:336] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:15:54.257339  5804 leader_election.cc:336] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:54.257843  5804 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:54.258651 11182 raft_consensus.cc:2749] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:54.226922  3922 tablet_replica.cc:333] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
I20260709 12:15:54.260653  3922 raft_consensus.cc:2243] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:15:54.262156 11192 leader_election.cc:290] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:54.262401  3922 raft_consensus.cc:2272] T 62cb582e4337464894d9eb032a3b2cd2 P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:54.264631  3922 tablet_replica.cc:333] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
I20260709 12:15:54.265230  3922 raft_consensus.cc:2243] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:54.265748  3922 raft_consensus.cc:2272] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:54.267728  3922 tablet_replica.cc:333] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
I20260709 12:15:54.268396  3922 raft_consensus.cc:2243] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:54.270351 11192 raft_consensus.cc:493] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:15:54.270888 11192 raft_consensus.cc:515] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:54.271347  3922 raft_consensus.cc:2272] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:54.273144 11192 leader_election.cc:290] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:54.274344  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a9971183fee4e958cff325230a31b26" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:54.278369  3922 tablet_replica.cc:333] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
I20260709 12:15:54.279364  3922 raft_consensus.cc:2243] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:15:54.282222  5833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f01a696969543e4ba24b4a07185fce8" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:54.285866  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a4dd376f83a42a896a5e1aca58d3221" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:15:54.286875  5166 leader_election.cc:336] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:54.287330  5166 leader_election.cc:304] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:54.288166  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8224f2bf564e7197a33ee531527a15" candidate_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:54.291193  3922 raft_consensus.cc:2272] T e63d70b5bbd74a49be2a18fef7617e3e P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:54.291337  5164 leader_election.cc:304] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:54.292647  5164 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:54.293221 11192 raft_consensus.cc:2749] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:54.293351 11188 raft_consensus.cc:2749] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:54.294313  5164 leader_election.cc:304] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:54.295495  5164 leader_election.cc:304] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:54.296233 11188 raft_consensus.cc:2749] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:15:54.297447 11192 raft_consensus.cc:2749] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:54.298069 11171 raft_consensus.cc:2749] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:54.299052  5164 leader_election.cc:304] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:54.299808 11192 raft_consensus.cc:2749] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:54.295701  3922 tablet_replica.cc:333] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
I20260709 12:15:54.305778  3922 raft_consensus.cc:2243] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:54.306448  3922 raft_consensus.cc:2272] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [term 7 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:54.311465  5166 leader_election.cc:336] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:54.311934  5166 leader_election.cc:304] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:15:54.312588  5166 raft_consensus.cc:2686] T 01b3c9565b564c6d934ce652edaabd1f P dd62e75bd3ed4ed28f1fb5955d650808: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 12:15:54.313338  5166 leader_election.cc:336] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:54.313740  5166 leader_election.cc:304] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:15:54.314277  5166 raft_consensus.cc:2686] T c0500c51d8bf49ff987108802ec3ee12 P dd62e75bd3ed4ed28f1fb5955d650808: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 12:15:54.314785  5166 leader_election.cc:336] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:54.315124  5166 leader_election.cc:304] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:54.317926  3922 tablet_replica.cc:333] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
I20260709 12:15:54.318809  3922 raft_consensus.cc:2243] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:54.319639  3922 raft_consensus.cc:2272] T b0fcb55471024c3d818106c4bfdf84d4 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:54.319993 11171 raft_consensus.cc:2749] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:54.325255  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:54.337881  3922 tablet_replica.cc:333] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
I20260709 12:15:54.338567 11190 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:54.340126 11190 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:15:54.341205  5166 consensus_peers.cc:597] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:54.342013  5166 leader_election.cc:336] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:54.342485  5166 leader_election.cc:304] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:54.342744 11190 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:54.343324 11192 raft_consensus.cc:2749] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:15:54.344372  5166 leader_election.cc:336] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:54.344810  5166 leader_election.cc:304] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd62e75bd3ed4ed28f1fb5955d650808; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:15:54.345438  5166 raft_consensus.cc:2686] T 7a9971183fee4e958cff325230a31b26 P dd62e75bd3ed4ed28f1fb5955d650808: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:15:54.345916  3922 raft_consensus.cc:2243] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:54.347148  3922 raft_consensus.cc:2272] T 4e275c844ff54adea37252a082eae526 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:54.353327  5240 leader_election.cc:336] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:54.355465 11190 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:54.356235 11190 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:54.357587  3922 tablet_replica.cc:333] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
I20260709 12:15:54.361507  3922 raft_consensus.cc:2243] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:15:54.362661  3922 raft_consensus.cc:2272] T 87f29f851a0e43738cf01ef3724e5533 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:54.365190  3922 tablet_replica.cc:333] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
I20260709 12:15:54.366030  3922 raft_consensus.cc:2243] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:15:54.367676  3922 raft_consensus.cc:2272] T 33f09d9f057844568fb4a24c314a746a P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:54.367703  5240 leader_election.cc:336] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:54.376169  5829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:54.376928  5829 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 16.
I20260709 12:15:54.375061 11190 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:54.382944  3922 tablet_replica.cc:333] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
I20260709 12:15:54.383934  3922 raft_consensus.cc:2243] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:54.384714  3922 raft_consensus.cc:2272] T c63fe19b7c5e4c73b49eee26ad00e88d P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:54.387655  3922 tablet_replica.cc:333] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
I20260709 12:15:54.388518  3922 raft_consensus.cc:2243] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:15:54.389806  3922 raft_consensus.cc:2272] T ecdd526dba8b4d84859ef5f6ee618387 P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:54.392556  3922 tablet_replica.cc:333] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
W20260709 12:15:54.396310  5237 leader_election.cc:336] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:15:54.396919  5237 leader_election.cc:304] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:54.397754 11190 raft_consensus.cc:2749] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:15:54.399060  5237 leader_election.cc:336] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:15:54.406141  5237 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:54.407043 11190 raft_consensus.cc:2749] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:54.417059  3922 raft_consensus.cc:2243] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:15:54.418527  3922 raft_consensus.cc:2272] T 00645b1f1e014de995e4a937f842d909 P dd62e75bd3ed4ed28f1fb5955d650808 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:54.421460  3922 tablet_replica.cc:333] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
I20260709 12:15:54.426326  3922 raft_consensus.cc:2243] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:54.434754  3922 raft_consensus.cc:2272] T e3beaf3ce31042719868401157039ee9 P dd62e75bd3ed4ed28f1fb5955d650808 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:54.439903  3922 tablet_replica.cc:333] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
I20260709 12:15:54.441668  3922 raft_consensus.cc:2243] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:54.442824  3922 raft_consensus.cc:2272] T a975d4f227214562b6fc39ea53081961 P dd62e75bd3ed4ed28f1fb5955d650808 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:54.446564  3922 tablet_replica.cc:333] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
I20260709 12:15:54.447434  3922 raft_consensus.cc:2243] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:54.448313  3922 raft_consensus.cc:2272] T 4d8224f2bf564e7197a33ee531527a15 P dd62e75bd3ed4ed28f1fb5955d650808 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:54.451221  3922 tablet_replica.cc:333] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
I20260709 12:15:54.452108  3922 raft_consensus.cc:2243] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:54.452821  3922 raft_consensus.cc:2272] T 60d88a24e03749b5a24c6baea8ab27f6 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:54.455530  3922 tablet_replica.cc:333] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
I20260709 12:15:54.456351  3922 raft_consensus.cc:2243] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:15:54.457617  3922 raft_consensus.cc:2272] T a71edf310ae54d6981a7c37794f6ba4d P dd62e75bd3ed4ed28f1fb5955d650808 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:54.467026  3922 tablet_replica.cc:333] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
I20260709 12:15:54.468266  3922 raft_consensus.cc:2243] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:54.471488  3922 raft_consensus.cc:2272] T 89852cae0bd14fd8be73b84dc4a49b2a P dd62e75bd3ed4ed28f1fb5955d650808 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:54.479367  3922 tablet_replica.cc:333] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
I20260709 12:15:54.480219  3922 raft_consensus.cc:2243] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:54.480928  3922 raft_consensus.cc:2272] T 2f01a696969543e4ba24b4a07185fce8 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:54.483856  3922 tablet_replica.cc:333] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
I20260709 12:15:54.575377  3922 raft_consensus.cc:2243] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:15:54.576304 11195 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P bce73265e27d4b30a4dcc1e491305088 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:54.577095 11195 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P bce73265e27d4b30a4dcc1e491305088 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:54.580003 11195 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:15:54.586454  5804 consensus_peers.cc:597] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:54.625123  5804 consensus_peers.cc:597] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:54.635637  5804 leader_election.cc:336] T fe3c5015888a494085f9a8b6eb204bcf P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:54.639036  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:54.613044  3922 raft_consensus.cc:2272] T ed974c2bf41a490ca098100bdfc63351 P dd62e75bd3ed4ed28f1fb5955d650808 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:54.624351 11193 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:54.651418 11193 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:54.653661 11193 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:15:54.657110  5804 consensus_peers.cc:597] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:15:54.662056  3922 tablet_replica.cc:333] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
I20260709 12:15:54.662843  3922 raft_consensus.cc:2243] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:15:54.663952  3922 raft_consensus.cc:2272] T 8d081e937c2741c9b646839e29e5599f P dd62e75bd3ed4ed28f1fb5955d650808 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:54.686870  5237 leader_election.cc:336] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:15:54.690459  5801 leader_election.cc:304] T fe3c5015888a494085f9a8b6eb204bcf P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:15:54.692157 11182 raft_consensus.cc:2749] T fe3c5015888a494085f9a8b6eb204bcf P bce73265e27d4b30a4dcc1e491305088 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:15:54.695623  5801 leader_election.cc:336] T fe3c5015888a494085f9a8b6eb204bcf P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:15:54.707940  5240 leader_election.cc:336] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:54.708464  5240 leader_election.cc:304] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:54.709553 11193 raft_consensus.cc:2749] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:54.725749  3922 tablet_replica.cc:333] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808: stopping tablet replica
I20260709 12:15:54.726565  3922 raft_consensus.cc:2243] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:54.727471  3922 raft_consensus.cc:2272] T 8a4dd376f83a42a896a5e1aca58d3221 P dd62e75bd3ed4ed28f1fb5955d650808 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:54.733168  5240 consensus_peers.cc:597] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:54.739728  5804 consensus_peers.cc:597] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:54.749089  5240 consensus_peers.cc:597] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:54.755666  5804 consensus_peers.cc:597] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:54.756270  5804 consensus_peers.cc:597] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:54.763146  5240 consensus_peers.cc:597] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:54.818826  5221 debug-util.cc:398] Leaking SignalData structure 0x7b08003ecca0 after lost signal to thread 3925
W20260709 12:15:54.819985  5221 debug-util.cc:398] Leaking SignalData structure 0x7b08003fb880 after lost signal to thread 5057
W20260709 12:15:54.820437  5804 consensus_peers.cc:597] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:54.820556  5221 debug-util.cc:398] Leaking SignalData structure 0x7b08001e3680 after lost signal to thread 5224
W20260709 12:15:54.821830  5221 debug-util.cc:398] Leaking SignalData structure 0x7b080038bde0 after lost signal to thread 5298
W20260709 12:15:54.822992  5221 debug-util.cc:398] Leaking SignalData structure 0x7b0800258d80 after lost signal to thread 5862
I20260709 12:15:54.831175 11190 raft_consensus.cc:493] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:54.831777 11190 raft_consensus.cc:515] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:54.834005 11190 leader_election.cc:290] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:15:54.841063  5240 leader_election.cc:336] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
W20260709 12:15:54.841619  5237 leader_election.cc:336] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:15:54.842163  5237 leader_election.cc:304] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:54.843415 11190 raft_consensus.cc:2749] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:15:54.852852 11195 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:54.853540 11195 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:54.855696 11195 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:54.858448  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
W20260709 12:15:54.862624  5801 leader_election.cc:336] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:15:54.863322  5801 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:54.864591 11195 raft_consensus.cc:2749] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:15:54.882309 11190 raft_consensus.cc:493] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:54.882961 11190 raft_consensus.cc:515] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:54.885318 11190 leader_election.cc:290] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:15:54.893033  5240 leader_election.cc:336] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
W20260709 12:15:54.893994  5237 leader_election.cc:336] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:15:54.895572  5237 leader_election.cc:304] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:54.897112 11190 raft_consensus.cc:2749] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:54.957820 11190 raft_consensus.cc:493] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:54.958424 11190 raft_consensus.cc:515] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:54.960721 11190 leader_election.cc:290] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:15:54.968084  5237 leader_election.cc:336] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:15:54.968762  5240 leader_election.cc:336] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:54.969235  5240 leader_election.cc:304] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:54.970449 11190 raft_consensus.cc:2749] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:54.994089 11190 raft_consensus.cc:493] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:54.994738 11190 raft_consensus.cc:515] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:54.997149 11190 leader_election.cc:290] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:55.001540 11193 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:55.002128 11193 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:55.005257  5237 leader_election.cc:336] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:15:55.006311 11193 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:55.006942  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:55.007567  5838 raft_consensus.cc:2468] T fe3c5015888a494085f9a8b6eb204bcf P bce73265e27d4b30a4dcc1e491305088 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 18.
W20260709 12:15:55.008249  5240 leader_election.cc:336] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:55.008715  5240 leader_election.cc:304] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:55.014546 11179 raft_consensus.cc:2749] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:15:55.015370  5801 consensus_peers.cc:597] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:55.015955  5237 leader_election.cc:336] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:15:55.026973  5240 leader_election.cc:336] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:55.027460  5240 leader_election.cc:304] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:55.031190 11190 raft_consensus.cc:2749] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:15:55.096522 11193 raft_consensus.cc:493] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:55.097366 11193 raft_consensus.cc:515] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:15:55.109112  5240 leader_election.cc:336] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:55.125320 11193 leader_election.cc:290] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:15:55.162107  5237 consensus_peers.cc:597] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:55.179679 11193 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:55.180410 11193 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:55.182816 11193 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:55.191956  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:55.192694  5838 raft_consensus.cc:2468] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 17.
W20260709 12:15:55.185762  5237 leader_election.cc:336] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
I20260709 12:15:55.208734  5237 leader_election.cc:304] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:55.215844 11179 raft_consensus.cc:493] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:55.216439 11179 raft_consensus.cc:515] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:55.211122 11193 raft_consensus.cc:2749] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:15:55.213771  5238 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:15:55.227890 11190 raft_consensus.cc:2804] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:15:55.228366 11190 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 17 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:55.228714 11190 raft_consensus.cc:3060] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:15:55.235183 11179 leader_election.cc:290] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:15:55.240576  5240 consensus_peers.cc:597] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:55.259116  5240 consensus_peers.cc:597] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:55.262120  5237 consensus_peers.cc:597] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:55.282976  5240 consensus_peers.cc:597] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:55.283780  5801 consensus_peers.cc:597] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:55.287123  5237 leader_election.cc:336] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
W20260709 12:15:55.296486  5237 leader_election.cc:336] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
W20260709 12:15:55.296972  5240 leader_election.cc:336] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:55.299532  5240 leader_election.cc:304] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:55.300350 11197 raft_consensus.cc:2749] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:15:55.301471  5240 consensus_peers.cc:597] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:15:55.291567 11190 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:55.319103  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b265799c1c447794c6126f3ae47e5d" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088"
I20260709 12:15:55.320572  5838 raft_consensus.cc:3060] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:15:55.322348  5237 leader_election.cc:336] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
I20260709 12:15:55.318919 11190 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 18 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:55.329430  5838 raft_consensus.cc:2468] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 18.
I20260709 12:15:55.335085  5238 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:55.336199 11190 raft_consensus.cc:2804] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:15:55.336762 11190 raft_consensus.cc:697] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 18 LEADER]: Becoming Leader. State: Replica: 9e794b72ed7640219f90ec4232363929, State: Running, Role: LEADER
I20260709 12:15:55.337702 11190 consensus_queue.cc:237] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:55.344084  5237 consensus_peers.cc:597] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:55.362509  5020 catalog_manager.cc:5697] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 reported cstate change: term changed from 17 to 18, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to 9e794b72ed7640219f90ec4232363929 (127.3.212.131). New cstate: current_term: 18 leader_uuid: "9e794b72ed7640219f90ec4232363929" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:15:55.387396  5801 consensus_peers.cc:597] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:55.455698  5237 consensus_peers.cc:597] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:55.472230  5237 consensus_peers.cc:597] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:55.493342  5801 consensus_peers.cc:597] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:55.494576  5237 consensus_peers.cc:597] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:55.495157  5237 consensus_peers.cc:597] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:55.497225  5237 consensus_peers.cc:597] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:55.547091  5237 consensus_peers.cc:597] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:55.557519  5801 consensus_peers.cc:597] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:55.561028  5237 consensus_peers.cc:597] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:55.571887  5801 consensus_peers.cc:597] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:55.578907  5801 consensus_peers.cc:597] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:55.588865  5804 consensus_peers.cc:597] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:15:55.645344  5801 consensus_peers.cc:597] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:55.656708  5237 consensus_peers.cc:597] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:55.711211  5240 consensus_peers.cc:597] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:15:55.726909 11182 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:55.727558 11182 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:55.735875 11195 raft_consensus.cc:493] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:55.736418 11195 raft_consensus.cc:515] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:55.738142 11182 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:15:55.738996  5804 leader_election.cc:336] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:55.740281 11195 leader_election.cc:290] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:15:55.741673  5801 leader_election.cc:336] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
I20260709 12:15:55.742110  5801 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:15:55.742671  5240 consensus_peers.cc:597] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:15:55.744388 11195 raft_consensus.cc:2749] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:55.749841 11190 raft_consensus.cc:493] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:55.750524 11190 raft_consensus.cc:515] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:55.754575 11190 leader_election.cc:290] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:15:55.756493  5801 leader_election.cc:336] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
I20260709 12:15:55.757732  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:55.757493 11204 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:55.758800 11193 raft_consensus.cc:493] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
W20260709 12:15:55.759740  5804 leader_election.cc:336] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:55.759549 11193 raft_consensus.cc:515] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:55.760231  5804 leader_election.cc:304] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:55.762214 11182 raft_consensus.cc:2749] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:55.762355 11193 leader_election.cc:290] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:15:55.759433  5237 leader_election.cc:336] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
I20260709 12:15:55.763432  5238 leader_election.cc:304] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:55.763839  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:55.764487 11193 raft_consensus.cc:2749] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:55.765158 11193 raft_consensus.cc:493] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:55.765645 11193 raft_consensus.cc:515] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:55.759387 11204 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:55.768329 11204 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:55.768851 11193 leader_election.cc:290] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:15:55.771281  5237 leader_election.cc:336] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
I20260709 12:15:55.773814  5237 leader_election.cc:304] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: bce73265e27d4b30a4dcc1e491305088, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:15:55.776266  5240 leader_election.cc:336] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:55.776887 11193 raft_consensus.cc:2749] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:15:55.779731  5804 leader_election.cc:336] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:55.781030 11204 raft_consensus.cc:493] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
W20260709 12:15:55.781939  5237 leader_election.cc:336] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
I20260709 12:15:55.781628 11204 raft_consensus.cc:515] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:55.786209 11182 raft_consensus.cc:493] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:55.786211  5237 leader_election.cc:304] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:55.786762 11182 raft_consensus.cc:515] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:55.787608 11204 leader_election.cc:290] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:55.787623 11193 raft_consensus.cc:2749] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:15:55.788823 11182 leader_election.cc:290] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:55.782670 11195 raft_consensus.cc:493] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:55.790449 11195 raft_consensus.cc:515] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:55.797643  5801 consensus_peers.cc:597] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:55.799937  5804 leader_election.cc:336] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:55.801947  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:55.802688  5268 raft_consensus.cc:2468] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 15.
I20260709 12:15:55.804529  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:55.805358  5268 raft_consensus.cc:2468] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 14.
I20260709 12:15:55.792527 11195 leader_election.cc:290] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:15:55.818262  5801 leader_election.cc:336] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
I20260709 12:15:55.818745  5801 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:15:55.820750  5237 consensus_peers.cc:597] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:55.823336 11182 raft_consensus.cc:2749] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:55.824002  5801 leader_election.cc:304] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:15:55.826078 11193 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:55.826663 11193 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:55.830608 11193 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:55.831791  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:15:55.835629  5240 leader_election.cc:336] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:55.836112  5240 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, bce73265e27d4b30a4dcc1e491305088
I20260709 12:15:55.836544 11182 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:55.836920 11190 raft_consensus.cc:2749] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:15:55.837095 11195 raft_consensus.cc:2804] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:15:55.837780 11195 raft_consensus.cc:493] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:55.837085 11182 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:55.838133 11195 raft_consensus.cc:3060] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:15:55.840322 11182 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:15:55.843528  5804 leader_election.cc:336] T 33f09d9f057844568fb4a24c314a746a P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:55.845701  5801 leader_election.cc:304] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: 
I20260709 12:15:55.846601 11182 raft_consensus.cc:2804] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:15:55.847033 11182 raft_consensus.cc:493] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting leader election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:55.847395 11182 raft_consensus.cc:3060] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:15:55.853988  5237 leader_election.cc:336] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
I20260709 12:15:55.857453 11182 raft_consensus.cc:515] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:55.862416 11195 raft_consensus.cc:515] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:55.868798  5801 leader_election.cc:336] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
I20260709 12:15:55.883739  5838 raft_consensus.cc:1275] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 18 FOLLOWER]: Refusing update from remote peer 9e794b72ed7640219f90ec4232363929: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:15:55.893179  5801 leader_election.cc:304] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:15:55.894248  5801 leader_election.cc:336] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
W20260709 12:15:55.894966  5801 leader_election.cc:336] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
I20260709 12:15:55.894737 11205 raft_consensus.cc:2749] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:55.895516 11193 consensus_queue.cc:1048] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:15:55.894326 11182 leader_election.cc:290] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:55.897636  5274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929" is_pre_election: true
I20260709 12:15:55.898280  5274 raft_consensus.cc:2468] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 15.
W20260709 12:15:55.899029  5237 consensus_peers.cc:597] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:55.900831 11195 leader_election.cc:290] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 16 election: Requested vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:15:55.908390  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63d70b5bbd74a49be2a18fef7617e3e" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:55.909086  5268 raft_consensus.cc:3060] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:15:55.911332  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f29f851a0e43738cf01ef3724e5533" candidate_uuid: "bce73265e27d4b30a4dcc1e491305088" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9e794b72ed7640219f90ec4232363929"
I20260709 12:15:55.912084  5271 raft_consensus.cc:3060] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:15:55.913134  5801 consensus_peers.cc:597] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:55.913723  5801 leader_election.cc:336] T 33f09d9f057844568fb4a24c314a746a P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
I20260709 12:15:55.914108  5801 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:55.916931 11205 raft_consensus.cc:2749] T 33f09d9f057844568fb4a24c314a746a P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:15:55.934258  5801 leader_election.cc:336] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
W20260709 12:15:55.934988  5801 leader_election.cc:336] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
I20260709 12:15:55.938601  5271 raft_consensus.cc:2468] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 16.
I20260709 12:15:55.943511  5801 leader_election.cc:304] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:15:55.944628  5801 consensus_peers.cc:597] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:55.944939 11195 raft_consensus.cc:2804] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:15:55.945538 11195 raft_consensus.cc:697] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 16 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:15:55.946552 11195 consensus_queue.cc:237] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:55.971879  5020 catalog_manager.cc:5697] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 15 to 16, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 16 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:15:55.986042  5268 raft_consensus.cc:2468] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bce73265e27d4b30a4dcc1e491305088 in term 15.
W20260709 12:15:55.987689  5801 consensus_peers.cc:597] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:55.988646  5801 leader_election.cc:304] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:55.989848 11207 raft_consensus.cc:2804] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:15:55.990415 11207 raft_consensus.cc:697] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 15 LEADER]: Becoming Leader. State: Replica: bce73265e27d4b30a4dcc1e491305088, State: Running, Role: LEADER
I20260709 12:15:55.996449 11207 consensus_queue.cc:237] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:56.067154 11212 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:56.067728 11212 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:56.069954 11212 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:15:56.080945  5240 leader_election.cc:336] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
W20260709 12:15:56.086355  5240 consensus_peers.cc:597] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:56.099627  5237 leader_election.cc:336] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
I20260709 12:15:56.100188  5237 leader_election.cc:304] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:56.101565 11213 raft_consensus.cc:2749] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:15:56.107223  5804 consensus_peers.cc:597] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:56.132344  3922 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 5221)
I20260709 12:15:56.165431 11207 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:56.168013 11207 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:56.170909 11207 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:56.175498  5020 catalog_manager.cc:5697] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 reported cstate change: term changed from 14 to 15, leader changed from dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130) to bce73265e27d4b30a4dcc1e491305088 (127.3.212.132). New cstate: current_term: 15 leader_uuid: "bce73265e27d4b30a4dcc1e491305088" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:15:56.179386  5804 leader_election.cc:336] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
W20260709 12:15:56.195194  5801 leader_election.cc:336] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
I20260709 12:15:56.201637  5801 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:56.202508 11207 raft_consensus.cc:2749] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:15:56.228196  5804 consensus_peers.cc:597] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:56.258771  5801 consensus_peers.cc:597] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:56.292560 11213 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:56.293327 11213 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:56.297250 11213 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:56.300400  5838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:56.301152  5838 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 16.
W20260709 12:15:56.304051  5804 consensus_peers.cc:597] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:56.306102  5237 leader_election.cc:336] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
W20260709 12:15:56.310236  5240 leader_election.cc:336] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:56.310705  5240 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:56.311997 11190 raft_consensus.cc:2749] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:15:56.315660  5240 consensus_peers.cc:597] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:56.330205  5237 consensus_peers.cc:597] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:15:56.365798  5271 raft_consensus.cc:1275] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:15:56.367390 11207 consensus_queue.cc:1048] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:15:56.372813  5240 consensus_peers.cc:597] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:56.377897  5801 consensus_peers.cc:597] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:56.406828  5801 consensus_peers.cc:597] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:56.462014  5268 raft_consensus.cc:1275] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Refusing update from remote peer bce73265e27d4b30a4dcc1e491305088: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:15:56.471514 11195 consensus_queue.cc:1048] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:15:56.543031 11190 raft_consensus.cc:493] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:56.543610 11190 raft_consensus.cc:515] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:56.546015 11190 leader_election.cc:290] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:56.586571 11193 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:56.587218 11193 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:56.591185 11193 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:15:56.637246  5804 consensus_peers.cc:597] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:56.651304  5804 consensus_peers.cc:597] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:15:56.997370 11220 raft_consensus.cc:493] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:56.998867 11220 raft_consensus.cc:515] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:57.001860 11220 leader_election.cc:290] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:57.013716 11220 raft_consensus.cc:493] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:57.021322 11220 raft_consensus.cc:515] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:57.026777 11220 leader_election.cc:290] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:57.023339 11225 raft_consensus.cc:493] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:57.028306 11225 raft_consensus.cc:515] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:57.027334 11223 raft_consensus.cc:493] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:57.024232 11221 raft_consensus.cc:493] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:57.033092 11221 raft_consensus.cc:515] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:57.036191 11221 leader_election.cc:290] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:15:57.047318  5240 consensus_peers.cc:597] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:57.063580  5240 leader_election.cc:336] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:57.033918 11223 raft_consensus.cc:515] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:57.068873 11223 leader_election.cc:290] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:57.062551 11225 leader_election.cc:290] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:15:57.132968  3922 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 5221)
W20260709 12:15:57.157613  5240 leader_election.cc:336] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
W20260709 12:15:57.158670  5240 leader_election.cc:336] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
W20260709 12:15:57.159584  5240 leader_election.cc:336] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
W20260709 12:15:57.160090  5240 leader_election.cc:336] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
W20260709 12:15:57.195003  5240 leader_election.cc:336] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
W20260709 12:15:57.195744  5240 consensus_peers.cc:597] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:57.196216  5240 leader_election.cc:336] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
W20260709 12:15:57.210330  5240 consensus_peers.cc:597] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:57.215279  5240 consensus_peers.cc:597] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:57.219784  5804 consensus_peers.cc:597] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:57.230273  5240 consensus_peers.cc:597] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:57.232801  5804 consensus_peers.cc:597] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:15:57.253599 11193 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:57.254187 11193 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:57.260986  5240 leader_election.cc:336] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:57.262866 11193 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:15:57.240787  5237 leader_election.cc:336] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
W20260709 12:15:57.241541  5010 catalog_manager.cc:4755] TS ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 4e275c844ff54adea37252a082eae526: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:57.274359  5237 leader_election.cc:304] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:57.277640 11193 raft_consensus.cc:2749] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:15:57.273121  5804 consensus_peers.cc:597] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:57.278321  5804 consensus_peers.cc:597] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:15:57.280030  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:57.280689  5832 raft_consensus.cc:2468] T fe3c5015888a494085f9a8b6eb204bcf P bce73265e27d4b30a4dcc1e491305088 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 18.
W20260709 12:15:57.277848  5237 leader_election.cc:336] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
I20260709 12:15:57.287130  5237 leader_election.cc:304] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:57.287909 11193 raft_consensus.cc:2749] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:15:57.288326  5237 leader_election.cc:336] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
I20260709 12:15:57.288787  5237 leader_election.cc:304] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:57.289570 11193 raft_consensus.cc:2749] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:15:57.290134  5237 leader_election.cc:336] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
I20260709 12:15:57.290627  5237 leader_election.cc:304] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:57.291392 11193 raft_consensus.cc:2749] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:15:57.291574  5237 leader_election.cc:336] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
I20260709 12:15:57.294649  5237 leader_election.cc:304] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:15:57.294129  5804 consensus_peers.cc:597] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:15:57.296281 11193 raft_consensus.cc:2749] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:15:57.297608  5237 leader_election.cc:336] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
I20260709 12:15:57.306984  5237 leader_election.cc:304] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:57.307961 11193 raft_consensus.cc:2749] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:15:57.309036  5237 leader_election.cc:336] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
I20260709 12:15:57.309566  5237 leader_election.cc:304] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:57.310375 11193 raft_consensus.cc:2749] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:15:57.345664  5237 leader_election.cc:336] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
I20260709 12:15:57.346289  5237 leader_election.cc:304] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:57.347158 11193 raft_consensus.cc:2749] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:15:57.372159 11193 raft_consensus.cc:493] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:57.372771 11193 raft_consensus.cc:515] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:57.382965 11193 leader_election.cc:290] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:15:57.393203  5237 leader_election.cc:336] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
W20260709 12:15:57.393981  5237 consensus_peers.cc:597] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:57.409111  5240 leader_election.cc:336] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:57.409706  5240 leader_election.cc:304] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:57.413462 11219 raft_consensus.cc:2749] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:15:57.492611  5804 consensus_peers.cc:597] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:15:57.519174 11205 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:57.519733 11205 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:57.533414 11205 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:15:57.541918  5804 consensus_peers.cc:597] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:57.542407  5801 leader_election.cc:336] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
W20260709 12:15:57.565564  5804 leader_election.cc:336] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:57.568457  5804 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:57.569569 11195 raft_consensus.cc:2749] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:57.610870 11193 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:57.611510 11193 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:57.630872 11193 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:57.633627  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:15:57.649961  5804 consensus_peers.cc:597] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:15:57.654598  5832 raft_consensus.cc:2468] T 33f09d9f057844568fb4a24c314a746a P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 15.
W20260709 12:15:57.653438  5240 leader_election.cc:336] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
W20260709 12:15:57.672536  5237 leader_election.cc:336] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
I20260709 12:15:57.673225  5237 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:57.674425 11193 raft_consensus.cc:2749] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:15:57.700069  5240 consensus_peers.cc:597] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:57.725795  5801 consensus_peers.cc:597] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:57.773073  5240 consensus_peers.cc:597] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:57.787552  5240 consensus_peers.cc:597] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:57.847282  5801 consensus_peers.cc:597] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:57.907226 11207 raft_consensus.cc:493] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:57.907816 11207 raft_consensus.cc:515] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:57.910228 11207 leader_election.cc:290] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:15:57.917285  5237 consensus_peers.cc:597] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:57.921190  5801 leader_election.cc:336] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
W20260709 12:15:57.925637  5804 leader_election.cc:336] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:57.926863  5804 leader_election.cc:304] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:57.930887 11207 raft_consensus.cc:2749] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:15:57.939950  5240 consensus_peers.cc:597] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:57.948832  5237 consensus_peers.cc:597] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:57.960656 11207 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:57.961207 11207 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:57.964876  5801 consensus_peers.cc:597] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:57.966481 11207 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:57.968168 11193 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:57.968760 11193 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:57.971927 11193 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:15:57.976609  5801 leader_election.cc:336] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
W20260709 12:15:57.981141  5804 leader_election.cc:336] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:57.981746  5804 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:15:57.982031  5237 leader_election.cc:336] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
W20260709 12:15:57.982357  5240 consensus_peers.cc:597] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:15:57.985977 11205 raft_consensus.cc:2749] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:15:57.986304  5240 leader_election.cc:336] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:57.986784  5240 leader_election.cc:304] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:57.988113 11219 raft_consensus.cc:2749] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:15:57.992278  5237 consensus_peers.cc:597] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:58.032774  5801 consensus_peers.cc:597] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:58.055300  5801 consensus_peers.cc:597] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:58.065496  5295 debug-util.cc:398] Leaking SignalData structure 0x7b0800111020 after lost signal to thread 3925
W20260709 12:15:58.066638  5295 debug-util.cc:398] Leaking SignalData structure 0x7b08000fe700 after lost signal to thread 5057
W20260709 12:15:58.067917  5295 debug-util.cc:398] Leaking SignalData structure 0x7b08002be640 after lost signal to thread 5298
W20260709 12:15:58.069159  5295 debug-util.cc:398] Leaking SignalData structure 0x7b08003c4ca0 after lost signal to thread 5862
W20260709 12:15:58.078382  5801 consensus_peers.cc:597] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:58.084285 11207 raft_consensus.cc:493] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:58.084875 11207 raft_consensus.cc:515] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:58.087231 11207 leader_election.cc:290] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:15:58.099071  5804 leader_election.cc:336] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
W20260709 12:15:58.099952  5237 consensus_peers.cc:597] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:58.100797  5801 leader_election.cc:336] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
I20260709 12:15:58.101317  5801 leader_election.cc:304] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:58.102294 11207 raft_consensus.cc:2749] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:15:58.128893  5801 consensus_peers.cc:597] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:58.137445  3922 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 5221)
I20260709 12:15:58.137974 11193 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:58.138599 11193 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:58.150755  5237 leader_election.cc:336] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
W20260709 12:15:58.162201  5240 leader_election.cc:336] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:58.162719  5240 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:58.171101 11193 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:15:58.171828  5237 consensus_peers.cc:597] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:58.172765 11225 raft_consensus.cc:2749] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:15:58.181565  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:58.182282  5832 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 16.
W20260709 12:15:58.251886  5237 consensus_peers.cc:597] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:58.287523  5237 consensus_peers.cc:597] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:58.298127  5240 consensus_peers.cc:597] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:58.366750  5237 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111) [suppressed 639 similar messages]
I20260709 12:15:58.380311 11195 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:58.381211 11195 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:58.383224 11195 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:15:58.392859  5804 leader_election.cc:336] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
W20260709 12:15:58.393055  5237 consensus_peers.cc:597] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:58.395924  5801 leader_election.cc:336] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
I20260709 12:15:58.396482  5801 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:58.397269 11195 raft_consensus.cc:2749] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:15:58.417651  5801 consensus_peers.cc:597] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:58.428980  5237 consensus_peers.cc:597] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:58.429688  5801 consensus_peers.cc:597] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:58.432056  5237 consensus_peers.cc:597] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:58.456940  5237 consensus_peers.cc:597] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:58.488080  5237 consensus_peers.cc:597] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:58.534987  5804 consensus_peers.cc:597] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:15:58.547132  5801 consensus_peers.cc:597] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:58.550491  5804 consensus_peers.cc:597] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:15:58.652154  5801 consensus_peers.cc:597] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:58.660035  5801 consensus_peers.cc:597] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:15:58.702364  5240 consensus_peers.cc:597] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:58.726116  5801 consensus_peers.cc:597] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:58.875258 11231 raft_consensus.cc:493] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
W20260709 12:15:58.875437  5801 consensus_peers.cc:597] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:15:58.875864 11231 raft_consensus.cc:515] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:58.878098 11231 leader_election.cc:290] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:15:58.884059  5240 leader_election.cc:336] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
W20260709 12:15:58.948067  5240 consensus_peers.cc:597] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:59.010437  5801 consensus_peers.cc:597] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:15:59.013355  5240 consensus_peers.cc:597] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:15:59.032871  5240 consensus_peers.cc:597] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:15:59.084910 11225 raft_consensus.cc:493] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:59.085552 11225 raft_consensus.cc:515] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:15:59.091140  5804 consensus_peers.cc:597] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:15:59.095695  5240 leader_election.cc:336] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:59.096287 11225 leader_election.cc:290] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:15:59.125924  5804 consensus_peers.cc:597] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:15:59.135205  5804 consensus_peers.cc:597] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:15:59.232870 11225 raft_consensus.cc:493] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:59.233489 11225 raft_consensus.cc:515] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:59.235772 11225 leader_election.cc:290] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:15:59.240737  5240 leader_election.cc:336] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
W20260709 12:15:59.285652  5804 consensus_peers.cc:597] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:15:59.333132 11225 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:59.333251 11231 raft_consensus.cc:493] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:59.333835 11225 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:59.333978 11231 raft_consensus.cc:515] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:59.336272 11231 leader_election.cc:290] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:59.337618 11225 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:59.338240  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f09d9f057844568fb4a24c314a746a" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:59.338886 11225 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:59.338917  5832 raft_consensus.cc:2468] T 33f09d9f057844568fb4a24c314a746a P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 15.
I20260709 12:15:59.339635 11225 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:59.342849 11225 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
W20260709 12:15:59.343045  5240 leader_election.cc:336] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:59.344061  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe3c5015888a494085f9a8b6eb204bcf" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
W20260709 12:15:59.344429  5240 leader_election.cc:336] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:59.344833  5832 raft_consensus.cc:2468] T fe3c5015888a494085f9a8b6eb204bcf P bce73265e27d4b30a4dcc1e491305088 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 18.
W20260709 12:15:59.347138  5240 leader_election.cc:336] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
W20260709 12:15:59.417892  5804 consensus_peers.cc:597] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:15:59.473426  5240 consensus_peers.cc:597] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:15:59.511252  5804 consensus_peers.cc:597] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:15:59.600579 11231 raft_consensus.cc:493] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:59.601188 11231 raft_consensus.cc:515] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:59.606437 11231 leader_election.cc:290] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:15:59.612043  5240 leader_election.cc:336] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
W20260709 12:15:59.633914  5240 consensus_peers.cc:597] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:15:59.642870  5804 consensus_peers.cc:597] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:15:59.710204  5240 consensus_peers.cc:597] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:15:59.718634  5804 consensus_peers.cc:597] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:15:59.725111  5240 consensus_peers.cc:597] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:15:59.753940  5804 consensus_peers.cc:597] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:15:59.775279 11232 raft_consensus.cc:493] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:59.776090 11232 raft_consensus.cc:515] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:59.779685 11225 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:59.780325 11225 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:15:59.783555 11225 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), bce73265e27d4b30a4dcc1e491305088 (127.3.212.132:43539)
I20260709 12:15:59.795457  5832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7bb7b814fea4a2488cc39d06fc90483" candidate_uuid: "9e794b72ed7640219f90ec4232363929" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bce73265e27d4b30a4dcc1e491305088" is_pre_election: true
I20260709 12:15:59.796190  5832 raft_consensus.cc:2468] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e794b72ed7640219f90ec4232363929 in term 16.
W20260709 12:15:59.798144  5804 leader_election.cc:336] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
W20260709 12:15:59.798781  5240 leader_election.cc:336] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:59.807693 11232 leader_election.cc:290] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:15:59.819505  5801 leader_election.cc:336] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
I20260709 12:15:59.820595  5801 leader_election.cc:304] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:59.821951 11232 raft_consensus.cc:2749] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:15:59.877401 11225 raft_consensus.cc:493] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:59.878031 11225 raft_consensus.cc:515] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:15:59.880892 11225 leader_election.cc:290] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:15:59.903090 11232 raft_consensus.cc:493] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:15:59.903744 11232 raft_consensus.cc:515] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:15:59.909785  5240 leader_election.cc:336] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:15:59.920177 11232 leader_election.cc:290] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:15:59.956741  5804 leader_election.cc:336] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
W20260709 12:15:59.970148  5801 leader_election.cc:336] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
I20260709 12:15:59.971642  5801 leader_election.cc:304] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:15:59.972347  5240 consensus_peers.cc:597] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:15:59.974426  5237 leader_election.cc:336] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
I20260709 12:15:59.981974  5237 leader_election.cc:304] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:15:59.985351 11232 raft_consensus.cc:2749] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:15:59.992695 11225 raft_consensus.cc:2749] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:15:59.995473  5237 consensus_peers.cc:597] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:00.013773  5237 leader_election.cc:336] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
I20260709 12:16:00.021356  5237 leader_election.cc:304] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:16:00.028028 11225 raft_consensus.cc:2749] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:16:00.030594  5237 leader_election.cc:336] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
I20260709 12:16:00.036077  5237 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:16:00.046475  5237 leader_election.cc:336] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
I20260709 12:16:00.047138 11225 raft_consensus.cc:2749] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:16:00.055511  5237 leader_election.cc:304] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:16:00.063510 11225 raft_consensus.cc:2749] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:16:00.078910  5237 leader_election.cc:336] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
I20260709 12:16:00.084220  5237 leader_election.cc:304] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:16:00.088042  5237 leader_election.cc:336] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
I20260709 12:16:00.090822 11225 raft_consensus.cc:2749] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:00.096946  5237 leader_election.cc:304] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:16:00.108839 11233 raft_consensus.cc:2749] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:16:00.118732  5804 consensus_peers.cc:597] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:16:00.109159  5237 leader_election.cc:336] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
I20260709 12:16:00.121604  5237 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929, bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:16:00.122421 11233 raft_consensus.cc:2749] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:16:00.129470  5237 leader_election.cc:336] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
I20260709 12:16:00.130017  5237 leader_election.cc:304] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:16:00.140206 11233 raft_consensus.cc:2749] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:16:00.205525  5240 consensus_peers.cc:597] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:16:00.208405  5240 consensus_peers.cc:597] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:16:00.217257  5240 consensus_peers.cc:597] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:16:00.235473  5804 consensus_peers.cc:597] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:16:00.257095  5237 leader_election.cc:336] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
I20260709 12:16:00.257637  5237 leader_election.cc:304] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:16:00.260419  5804 consensus_peers.cc:597] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:16:00.263111 11233 raft_consensus.cc:2749] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:16:00.266920  5801 consensus_peers.cc:597] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:16:00.350728  5801 consensus_peers.cc:597] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:16:00.420007  5237 consensus_peers.cc:597] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:16:00.422925  5801 consensus_peers.cc:597] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:16:00.449446 11234 raft_consensus.cc:493] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:16:00.450044 11234 raft_consensus.cc:515] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:16:00.452287 11234 leader_election.cc:290] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:16:00.461908  5240 leader_election.cc:336] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
W20260709 12:16:00.469029  5237 leader_election.cc:336] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
I20260709 12:16:00.478353  5237 leader_election.cc:304] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:16:00.479799 11234 raft_consensus.cc:2749] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:16:00.524811  5801 consensus_peers.cc:597] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:16:00.528326  5801 consensus_peers.cc:597] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:16:00.546684 11234 raft_consensus.cc:493] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:16:00.547307 11234 raft_consensus.cc:515] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
I20260709 12:16:00.549525 11234 leader_election.cc:290] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:16:00.554184  5240 consensus_peers.cc:597] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:16:00.565676  5240 leader_election.cc:336] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
W20260709 12:16:00.580056  5801 consensus_peers.cc:597] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:16:00.605445  5237 leader_election.cc:336] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
I20260709 12:16:00.605932  5237 leader_election.cc:304] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:16:00.611302 11225 raft_consensus.cc:2749] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:16:00.652675  5240 consensus_peers.cc:597] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:16:00.659896 11234 raft_consensus.cc:493] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:16:00.664522 11234 raft_consensus.cc:515] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } }
W20260709 12:16:00.661623  5801 consensus_peers.cc:597] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:16:00.669679  5240 consensus_peers.cc:597] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:16:00.671868 11234 leader_election.cc:290] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:16:00.677028  5240 leader_election.cc:336] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:16:00.679003  3922 tablet_server.cc:196] TabletServer@127.3.212.130:0 shutdown complete.
W20260709 12:16:00.697875  5237 leader_election.cc:336] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
I20260709 12:16:00.698534  5237 leader_election.cc:304] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e794b72ed7640219f90ec4232363929; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:16:00.700388 11234 raft_consensus.cc:2749] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:00.746397 11232 raft_consensus.cc:493] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:16:00.746951 11232 raft_consensus.cc:515] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:16:00.748292  5237 consensus_peers.cc:597] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:16:00.749074 11232 leader_election.cc:290] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:16:00.759902  5804 leader_election.cc:336] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
W20260709 12:16:00.764034  5801 leader_election.cc:336] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
I20260709 12:16:00.764925  5801 leader_election.cc:304] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:16:00.765733 11232 raft_consensus.cc:2749] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:16:00.873523  5801 consensus_peers.cc:597] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:16:00.902019  3922 tablet_server.cc:179] TabletServer@127.3.212.131:0 shutting down...
W20260709 12:16:00.925778  5801 consensus_peers.cc:597] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 -> Peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Couldn't send request to peer 9e794b72ed7640219f90ec4232363929. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:00.963913  5801 consensus_peers.cc:597] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 -> Peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Couldn't send request to peer 9e794b72ed7640219f90ec4232363929. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:00.991135  5801 consensus_peers.cc:597] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:16:00.993590  5237 consensus_peers.cc:597] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:16:00.997915  5801 consensus_peers.cc:597] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 -> Peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Couldn't send request to peer 9e794b72ed7640219f90ec4232363929. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:01.021783  5237 consensus_peers.cc:597] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:16:01.037142  3922 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:01.038323  3922 tablet_replica.cc:333] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
I20260709 12:16:01.041410  3922 raft_consensus.cc:2243] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:01.043756  3922 raft_consensus.cc:2272] T c7bb7b814fea4a2488cc39d06fc90483 P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:01.046993  3922 tablet_replica.cc:333] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
I20260709 12:16:01.047820  3922 raft_consensus.cc:2243] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:16:01.049013  3922 raft_consensus.cc:2272] T d09ac3a18bc549dabadd7ec3c3f57017 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:01.056447  5804 consensus_peers.cc:597] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:16:01.059015  3922 tablet_replica.cc:333] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
I20260709 12:16:01.063266  3922 raft_consensus.cc:2243] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:01.064113  3922 raft_consensus.cc:2272] T f5815aa6770341a7ae03cf8dc1b8a05e P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:01.066972  3922 tablet_replica.cc:333] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
W20260709 12:16:01.075606  5801 consensus_peers.cc:597] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 -> Peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Couldn't send request to peer 9e794b72ed7640219f90ec4232363929. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:01.085886  5801 consensus_peers.cc:597] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 -> Peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Couldn't send request to peer 9e794b72ed7640219f90ec4232363929. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:01.087033  3922 raft_consensus.cc:2243] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 11 LEADER]: Raft consensus shutting down.
W20260709 12:16:01.089531  5801 consensus_peers.cc:597] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 -> Peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Couldn't send request to peer 9e794b72ed7640219f90ec4232363929. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:01.090365  3922 raft_consensus.cc:2272] T 9634d2debd9f4e7ea32cf4479f9242e1 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:01.093367  3922 tablet_replica.cc:333] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
I20260709 12:16:01.094507  3922 raft_consensus.cc:2243] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:01.095136  3922 raft_consensus.cc:2272] T 9f93759199ab4820a9a807a0f1c70c85 P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:01.098085  3922 tablet_replica.cc:333] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
I20260709 12:16:01.101351  3922 raft_consensus.cc:2243] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:16:01.104077  3922 raft_consensus.cc:2272] T 90cb6c9306054ce3b2bc1bbd21c7345f P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:01.111802  3922 tablet_replica.cc:333] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
I20260709 12:16:01.112550  3922 raft_consensus.cc:2243] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:01.113458  3922 raft_consensus.cc:2272] T fe3c5015888a494085f9a8b6eb204bcf P 9e794b72ed7640219f90ec4232363929 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:01.116081  3922 tablet_replica.cc:333] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
I20260709 12:16:01.116860  3922 raft_consensus.cc:2243] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:01.120568 11237 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P bce73265e27d4b30a4dcc1e491305088 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:16:01.121152 11237 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P bce73265e27d4b30a4dcc1e491305088 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:16:01.124524 11237 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:16:01.126371  3922 raft_consensus.cc:2272] T 20ba878da4e3492fbdf2f90c6bb202c4 P 9e794b72ed7640219f90ec4232363929 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:01.134871  5801 leader_election.cc:336] T fe3c5015888a494085f9a8b6eb204bcf P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:16:01.135430  3922 tablet_replica.cc:333] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
I20260709 12:16:01.136309  3922 raft_consensus.cc:2243] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:16:01.137555  3922 raft_consensus.cc:2272] T 88f51ae73df747849e2f3cd63547a1d0 P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:01.140269  3922 tablet_replica.cc:333] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
I20260709 12:16:01.141101  3922 raft_consensus.cc:2243] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:01.141860  3922 raft_consensus.cc:2272] T 9f927a751b4041e99eb5ac25ddf214ec P 9e794b72ed7640219f90ec4232363929 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:01.142464  5804 leader_election.cc:336] T fe3c5015888a494085f9a8b6eb204bcf P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:16:01.143471  5804 leader_election.cc:304] T fe3c5015888a494085f9a8b6eb204bcf P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:16:01.144435 11207 raft_consensus.cc:2749] T fe3c5015888a494085f9a8b6eb204bcf P bce73265e27d4b30a4dcc1e491305088 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:16:01.144649  3922 tablet_replica.cc:333] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
I20260709 12:16:01.146617  3922 raft_consensus.cc:2243] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:01.147245  3922 raft_consensus.cc:2272] T ba4d42e47cfd4d859ca8f5ee6401379c P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:01.150002  3922 tablet_replica.cc:333] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
I20260709 12:16:01.150791  3922 raft_consensus.cc:2243] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:01.151361  3922 raft_consensus.cc:2272] T ecedf48dca8a4a35adc39d76a9a93513 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:01.155134  3922 tablet_replica.cc:333] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
I20260709 12:16:01.156008  3922 raft_consensus.cc:2243] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:01.156646  3922 raft_consensus.cc:2272] T 71729ba8cfa049e8b7dac6674d1ba13b P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:01.156853  5801 leader_election.cc:336] T fe3c5015888a494085f9a8b6eb204bcf P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
W20260709 12:16:01.157920  5801 consensus_peers.cc:597] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:16:01.158689  5237 consensus_peers.cc:597] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:16:01.159343  3922 tablet_replica.cc:333] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
I20260709 12:16:01.160198  3922 raft_consensus.cc:2243] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:16:01.161562  3922 raft_consensus.cc:2272] T b4b265799c1c447794c6126f3ae47e5d P 9e794b72ed7640219f90ec4232363929 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:01.164111  3922 tablet_replica.cc:333] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
I20260709 12:16:01.164911  3922 raft_consensus.cc:2243] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:16:01.166030  3922 raft_consensus.cc:2272] T 68b0d002ca1342c9b1b6eb6ed1f0f958 P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:01.167104 11237 raft_consensus.cc:493] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:16:01.167652 11237 raft_consensus.cc:515] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:16:01.168500  5801 consensus_peers.cc:597] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 -> Peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Couldn't send request to peer 9e794b72ed7640219f90ec4232363929. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:01.169828 11237 leader_election.cc:290] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
I20260709 12:16:01.172628  3922 tablet_replica.cc:333] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
I20260709 12:16:01.173738  3922 raft_consensus.cc:2243] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:01.174659  3922 raft_consensus.cc:2272] T 3db164e3a1ce4a43b0a112a777118daa P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:01.175280  5801 consensus_peers.cc:597] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 -> Peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Couldn't send request to peer 9e794b72ed7640219f90ec4232363929. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:01.177050  5804 leader_election.cc:336] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:16:01.178674  3922 tablet_replica.cc:333] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
I20260709 12:16:01.179672  3922 raft_consensus.cc:2243] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:01.180343  3922 raft_consensus.cc:2272] T d8017a2b75074e4b9f0691c32850f71a P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:01.183208  3922 tablet_replica.cc:333] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
I20260709 12:16:01.183982  3922 raft_consensus.cc:2243] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:16:01.185133  3922 raft_consensus.cc:2272] T 756d32b8c4d642a6955517f66ac5bb45 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:01.186487  5801 leader_election.cc:336] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
I20260709 12:16:01.186990  5801 leader_election.cc:304] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:16:01.187798 11237 raft_consensus.cc:2749] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:16:01.188808  3922 tablet_replica.cc:333] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
I20260709 12:16:01.189706  3922 raft_consensus.cc:2243] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:16:01.190727  3922 raft_consensus.cc:2272] T 63f38af52cc54adeb374ef3d32a43af6 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:01.193948  3922 tablet_replica.cc:333] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
I20260709 12:16:01.194787  3922 raft_consensus.cc:2243] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:01.195423  3922 raft_consensus.cc:2272] T 41c65b96548e49b3863d03db116fd8d0 P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:01.198355  3922 tablet_replica.cc:333] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
I20260709 12:16:01.199146  3922 raft_consensus.cc:2243] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:01.199785  3922 raft_consensus.cc:2272] T 93f7ce8a804f431dbbc5adfbca8d745e P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:01.190606  5801 consensus_peers.cc:597] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 -> Peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Couldn't send request to peer 9e794b72ed7640219f90ec4232363929. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:01.202265 11207 raft_consensus.cc:493] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:16:01.202713 11207 raft_consensus.cc:515] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:16:01.203339  3922 tablet_replica.cc:333] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
I20260709 12:16:01.204109  3922 raft_consensus.cc:2243] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:01.204586 11207 leader_election.cc:290] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455)
W20260709 12:16:01.205117  5237 consensus_peers.cc:597] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:16:01.205232  3922 raft_consensus.cc:2272] T d87fb855c56c430f896b24f98722bd61 P 9e794b72ed7640219f90ec4232363929 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:01.208048  3922 tablet_replica.cc:333] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
I20260709 12:16:01.208858  3922 raft_consensus.cc:2243] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 13 LEADER]: Raft consensus shutting down.
W20260709 12:16:01.212292  5804 consensus_peers.cc:597] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:16:01.212836  5804 leader_election.cc:336] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:16:01.218209  3922 raft_consensus.cc:2272] T ddd16ccf58f24f6db29e5fc39a06e5c4 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:01.220904  3922 tablet_replica.cc:333] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
I20260709 12:16:01.221835  3922 raft_consensus.cc:2243] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:01.222625  3922 raft_consensus.cc:2272] T f34c97113147431584d6336e0d849164 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:01.224133  5801 leader_election.cc:336] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
I20260709 12:16:01.224615  5801 leader_election.cc:304] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: ad2f9a1e2f7a45429fa69fd23d09f821, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:16:01.225346  3922 tablet_replica.cc:333] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
I20260709 12:16:01.225283 11207 raft_consensus.cc:2749] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:16:01.226167  5801 consensus_peers.cc:597] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:16:01.226697  3922 raft_consensus.cc:2243] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Raft consensus shutting down.
W20260709 12:16:01.227104  5801 consensus_peers.cc:597] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 -> Peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Couldn't send request to peer 9e794b72ed7640219f90ec4232363929. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:01.227370  3922 raft_consensus.cc:2272] T 56627990da7d49f7a12669f23294a596 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:01.229920  3922 tablet_replica.cc:333] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
I20260709 12:16:01.230697  3922 raft_consensus.cc:2243] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:01.231309  3922 raft_consensus.cc:2272] T cd07c3eb35104201a0e6b64cd77cb6b6 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:01.233948  3922 tablet_replica.cc:333] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
I20260709 12:16:01.234777  3922 raft_consensus.cc:2243] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:16:01.235769  3922 raft_consensus.cc:2272] T c0500c51d8bf49ff987108802ec3ee12 P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:01.238288  3922 tablet_replica.cc:333] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
I20260709 12:16:01.239030  3922 raft_consensus.cc:2243] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:16:01.240298  3922 raft_consensus.cc:2272] T 01b3c9565b564c6d934ce652edaabd1f P 9e794b72ed7640219f90ec4232363929 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:01.245363  3922 tablet_replica.cc:333] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
I20260709 12:16:01.246134  3922 raft_consensus.cc:2243] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:01.246721  3922 raft_consensus.cc:2272] T 9212b0f778ec4455b8054add86b66d78 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:01.249197  3922 tablet_replica.cc:333] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
I20260709 12:16:01.250010  3922 raft_consensus.cc:2243] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:01.250594  3922 raft_consensus.cc:2272] T 4f87264424df422fa5223dd7a8803eab P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:01.253201  3922 tablet_replica.cc:333] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
I20260709 12:16:01.254014  3922 raft_consensus.cc:2243] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:01.254604  3922 raft_consensus.cc:2272] T 45e701f062f14e4e80492fc08144cca6 P 9e794b72ed7640219f90ec4232363929 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:01.259558  3922 tablet_replica.cc:333] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
I20260709 12:16:01.260306  3922 raft_consensus.cc:2243] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:16:01.261395  3922 raft_consensus.cc:2272] T 7a9971183fee4e958cff325230a31b26 P 9e794b72ed7640219f90ec4232363929 [term 7 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:01.263299  5801 consensus_peers.cc:597] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 -> Peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Couldn't send request to peer 9e794b72ed7640219f90ec4232363929. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:01.263844  3922 tablet_replica.cc:333] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
W20260709 12:16:01.264598  5801 consensus_peers.cc:597] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 -> Peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Couldn't send request to peer 9e794b72ed7640219f90ec4232363929. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:01.264669  3922 raft_consensus.cc:2243] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:16:01.266006  3922 raft_consensus.cc:2272] T b0fcb55471024c3d818106c4bfdf84d4 P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:01.268522  3922 tablet_replica.cc:333] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
I20260709 12:16:01.269300  3922 raft_consensus.cc:2243] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:16:01.270421  3922 raft_consensus.cc:2272] T 4e275c844ff54adea37252a082eae526 P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:01.273723  3922 tablet_replica.cc:333] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
I20260709 12:16:01.274502  3922 raft_consensus.cc:2243] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:01.275213  3922 raft_consensus.cc:2272] T e63d70b5bbd74a49be2a18fef7617e3e P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:01.277061  5801 consensus_peers.cc:597] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 -> Peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Couldn't send request to peer 9e794b72ed7640219f90ec4232363929. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:01.277804  3922 tablet_replica.cc:333] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
I20260709 12:16:01.278692  3922 raft_consensus.cc:2243] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:16:01.281108  3922 raft_consensus.cc:2272] T c69b050cdaeb4f1db6cd4993ad703192 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:01.285004  3922 tablet_replica.cc:333] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
I20260709 12:16:01.285808  3922 raft_consensus.cc:2243] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Raft consensus shutting down.
W20260709 12:16:01.286339  5801 consensus_peers.cc:597] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 -> Peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Couldn't send request to peer 9e794b72ed7640219f90ec4232363929. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:01.286716  3922 raft_consensus.cc:2272] T c63fe19b7c5e4c73b49eee26ad00e88d P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:01.289700  3922 tablet_replica.cc:333] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
W20260709 12:16:01.289700  5801 consensus_peers.cc:597] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:16:01.290692  3922 raft_consensus.cc:2243] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:16:01.291781  3922 raft_consensus.cc:2272] T 271b0c7d258142798f30accd6aaba829 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:01.294771  3922 tablet_replica.cc:333] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
I20260709 12:16:01.295583  3922 raft_consensus.cc:2243] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:01.296478  3922 raft_consensus.cc:2272] T 33f09d9f057844568fb4a24c314a746a P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:01.299233  3922 tablet_replica.cc:333] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
I20260709 12:16:01.300063  3922 raft_consensus.cc:2243] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:01.300628  3922 raft_consensus.cc:2272] T 87f29f851a0e43738cf01ef3724e5533 P 9e794b72ed7640219f90ec4232363929 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:01.303025  3922 tablet_replica.cc:333] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
I20260709 12:16:01.303751  3922 raft_consensus.cc:2243] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:01.304422  3922 raft_consensus.cc:2272] T 89852cae0bd14fd8be73b84dc4a49b2a P 9e794b72ed7640219f90ec4232363929 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:01.306919  3922 tablet_replica.cc:333] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
I20260709 12:16:01.307811  3922 raft_consensus.cc:2243] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:16:01.308868  3922 raft_consensus.cc:2272] T 2f01a696969543e4ba24b4a07185fce8 P 9e794b72ed7640219f90ec4232363929 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:01.311444  3922 tablet_replica.cc:333] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
I20260709 12:16:01.312130  3922 raft_consensus.cc:2243] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:16:01.313283  3922 raft_consensus.cc:2272] T 84919c977be24017b74e122582f71fbe P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:01.315814  3922 tablet_replica.cc:333] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
I20260709 12:16:01.316560  3922 raft_consensus.cc:2243] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:16:01.317668  3922 raft_consensus.cc:2272] T 60d88a24e03749b5a24c6baea8ab27f6 P 9e794b72ed7640219f90ec4232363929 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:01.320276  3922 tablet_replica.cc:333] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
I20260709 12:16:01.320961  3922 raft_consensus.cc:2243] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:01.321623  3922 raft_consensus.cc:2272] T a71edf310ae54d6981a7c37794f6ba4d P 9e794b72ed7640219f90ec4232363929 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:01.324290  3922 tablet_replica.cc:333] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
I20260709 12:16:01.325001  3922 raft_consensus.cc:2243] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:16:01.326088  3922 raft_consensus.cc:2272] T a975d4f227214562b6fc39ea53081961 P 9e794b72ed7640219f90ec4232363929 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:01.328456  3922 tablet_replica.cc:333] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929: stopping tablet replica
I20260709 12:16:01.329066  3922 raft_consensus.cc:2243] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:16:01.330142  3922 raft_consensus.cc:2272] T e3beaf3ce31042719868401157039ee9 P 9e794b72ed7640219f90ec4232363929 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:01.455188  5804 consensus_peers.cc:597] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:16:01.525005  5804 consensus_peers.cc:597] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:16:01.527060  5801 consensus_peers.cc:597] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:16:01.540501  5801 consensus_peers.cc:597] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:01.639948  5804 consensus_peers.cc:597] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:16:01.804162  5801 consensus_peers.cc:597] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:01.941006  5804 consensus_peers.cc:597] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:16:01.941627  5804 consensus_peers.cc:597] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:16:01.974424  5804 consensus_peers.cc:597] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:16:01.987097  5804 consensus_peers.cc:597] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:16:01.994666  5804 consensus_peers.cc:597] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:16:02.101115 11207 raft_consensus.cc:493] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:16:02.102092 11207 raft_consensus.cc:515] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:16:02.112672  5801 leader_election.cc:336] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Network error: Client connection negotiation failed: client connection to 127.3.212.131:46709: connect: Connection refused (error 111)
I20260709 12:16:02.105144 11207 leader_election.cc:290] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:16:02.113721 11232 raft_consensus.cc:493] T 33f09d9f057844568fb4a24c314a746a P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
W20260709 12:16:02.113721  5804 leader_election.cc:336] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:16:02.114707  5804 leader_election.cc:304] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:16:02.114811 11232 raft_consensus.cc:515] T 33f09d9f057844568fb4a24c314a746a P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:16:02.116104 11207 raft_consensus.cc:2749] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:16:02.118623 11232 leader_election.cc:290] T 33f09d9f057844568fb4a24c314a746a P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:16:02.125489  5801 leader_election.cc:336] T 33f09d9f057844568fb4a24c314a746a P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Network error: Client connection negotiation failed: client connection to 127.3.212.131:46709: connect: Connection refused (error 111)
W20260709 12:16:02.151743  5804 leader_election.cc:336] T 33f09d9f057844568fb4a24c314a746a P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:16:02.152225  5804 leader_election.cc:304] T 33f09d9f057844568fb4a24c314a746a P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:16:02.159734 11207 raft_consensus.cc:2749] T 33f09d9f057844568fb4a24c314a746a P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:16:02.165668  5804 consensus_peers.cc:597] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:16:02.265841 11207 raft_consensus.cc:493] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:16:02.266384 11238 raft_consensus.cc:493] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:16:02.267199 11238 raft_consensus.cc:515] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:16:02.266502 11207 raft_consensus.cc:515] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:16:02.269721 11207 leader_election.cc:290] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:16:02.280807  5801 leader_election.cc:336] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Network error: Client connection negotiation failed: client connection to 127.3.212.131:46709: connect: Connection refused (error 111)
W20260709 12:16:02.285591  5804 leader_election.cc:336] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:16:02.286805  5804 leader_election.cc:304] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:16:02.282610 11238 leader_election.cc:290] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:16:02.287900 11207 raft_consensus.cc:2749] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:16:02.287994  5804 leader_election.cc:336] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
W20260709 12:16:02.293036  5801 leader_election.cc:336] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Network error: Client connection negotiation failed: client connection to 127.3.212.131:46709: connect: Connection refused (error 111)
I20260709 12:16:02.294237  5801 leader_election.cc:304] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:16:02.295166 11238 raft_consensus.cc:2749] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:16:02.351066 11207 raft_consensus.cc:493] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:16:02.351761 11207 raft_consensus.cc:515] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:16:02.354146 11238 raft_consensus.cc:493] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:16:02.354830 11238 raft_consensus.cc:515] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:16:02.355412 11207 leader_election.cc:290] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:16:02.357043 11238 leader_election.cc:290] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:16:02.359186 11238 raft_consensus.cc:493] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:16:02.359918 11238 raft_consensus.cc:515] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:16:02.361946  5801 leader_election.cc:336] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Network error: Client connection negotiation failed: client connection to 127.3.212.131:46709: connect: Connection refused (error 111)
I20260709 12:16:02.362386 11238 leader_election.cc:290] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:16:02.362485  5801 leader_election.cc:336] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Network error: Client connection negotiation failed: client connection to 127.3.212.131:46709: connect: Connection refused (error 111)
W20260709 12:16:02.370221  5801 leader_election.cc:336] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Network error: Client connection negotiation failed: client connection to 127.3.212.131:46709: connect: Connection refused (error 111)
W20260709 12:16:02.381297  5804 consensus_peers.cc:597] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:16:02.382325 11207 raft_consensus.cc:493] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:16:02.383016 11207 raft_consensus.cc:515] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:16:02.385336 11207 leader_election.cc:290] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:16:02.401171  5801 leader_election.cc:336] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Network error: Client connection negotiation failed: client connection to 127.3.212.131:46709: connect: Connection refused (error 111)
I20260709 12:16:02.455396 11238 raft_consensus.cc:493] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:16:02.456216 11238 raft_consensus.cc:515] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:16:02.458711 11238 leader_election.cc:290] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:16:02.463945  5801 leader_election.cc:336] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Network error: Client connection negotiation failed: client connection to 127.3.212.131:46709: connect: Connection refused (error 111)
I20260709 12:16:02.539950 11207 raft_consensus.cc:493] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:16:02.540697 11207 raft_consensus.cc:515] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:16:02.542795 11207 leader_election.cc:290] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:16:02.563316  5801 leader_election.cc:336] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Network error: Client connection negotiation failed: client connection to 127.3.212.131:46709: connect: Connection refused (error 111)
I20260709 12:16:02.786847 11238 raft_consensus.cc:493] T fe3c5015888a494085f9a8b6eb204bcf P bce73265e27d4b30a4dcc1e491305088 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:16:02.787739 11238 raft_consensus.cc:515] T fe3c5015888a494085f9a8b6eb204bcf P bce73265e27d4b30a4dcc1e491305088 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } attrs { replace: true } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:16:02.791652 11238 leader_election.cc:290] T fe3c5015888a494085f9a8b6eb204bcf P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:16:02.796589  5801 leader_election.cc:336] T fe3c5015888a494085f9a8b6eb204bcf P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Network error: Client connection negotiation failed: client connection to 127.3.212.131:46709: connect: Connection refused (error 111)
I20260709 12:16:02.819962 11238 raft_consensus.cc:493] T 4e275c844ff54adea37252a082eae526 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:16:02.822829 11238 raft_consensus.cc:515] T 4e275c844ff54adea37252a082eae526 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:16:02.825503 11238 leader_election.cc:290] T 4e275c844ff54adea37252a082eae526 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:16:02.826455  5804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:34443, user_credentials={real_user=slave}} blocked reactor thread for 354398us
I20260709 12:16:02.827708 11238 raft_consensus.cc:493] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:16:02.829514 11238 raft_consensus.cc:515] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:16:02.831812 11238 leader_election.cc:290] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:16:02.896610  5801 leader_election.cc:336] T 4e275c844ff54adea37252a082eae526 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Network error: Client connection negotiation failed: client connection to 127.3.212.131:46709: connect: Connection refused (error 111)
I20260709 12:16:02.903669 11207 raft_consensus.cc:493] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:16:02.905546 11238 raft_consensus.cc:493] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dd62e75bd3ed4ed28f1fb5955d650808)
I20260709 12:16:02.913926 11207 raft_consensus.cc:515] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:16:02.914163 11238 raft_consensus.cc:515] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } attrs { replace: true } } peers { permanent_uuid: "dd62e75bd3ed4ed28f1fb5955d650808" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44455 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:16:02.917083 11238 leader_election.cc:290] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:16:02.917676 11241 raft_consensus.cc:493] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:16:02.918290 11241 raft_consensus.cc:515] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
I20260709 12:16:02.920569 11241 leader_election.cc:290] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:16:02.921288 11207 leader_election.cc:290] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
I20260709 12:16:02.921060 11241 raft_consensus.cc:493] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e794b72ed7640219f90ec4232363929)
I20260709 12:16:02.925925 11241 raft_consensus.cc:515] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ad2f9a1e2f7a45429fa69fd23d09f821" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 34443 } } peers { permanent_uuid: "9e794b72ed7640219f90ec4232363929" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 46709 } } peers { permanent_uuid: "bce73265e27d4b30a4dcc1e491305088" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 43539 } attrs { promote: false } }
W20260709 12:16:02.929185  5804 leader_election.cc:336] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:16:02.933864  5804 leader_election.cc:304] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:16:02.935235 11238 raft_consensus.cc:2749] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:16:02.938236 11241 leader_election.cc:290] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443), 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709)
W20260709 12:16:02.951298  5801 leader_election.cc:336] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Network error: Client connection negotiation failed: client connection to 127.3.212.131:46709: connect: Connection refused (error 111)
W20260709 12:16:02.959782  5801 leader_election.cc:336] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Network error: Client connection negotiation failed: client connection to 127.3.212.131:46709: connect: Connection refused (error 111)
W20260709 12:16:02.970634  5801 leader_election.cc:336] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Network error: Client connection negotiation failed: client connection to 127.3.212.131:46709: connect: Connection refused (error 111)
W20260709 12:16:02.970361  5804 leader_election.cc:336] T fe3c5015888a494085f9a8b6eb204bcf P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
W20260709 12:16:02.971256  5801 leader_election.cc:336] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Network error: Client connection negotiation failed: client connection to 127.3.212.131:46709: connect: Connection refused (error 111)
I20260709 12:16:02.971469  5804 leader_election.cc:304] T fe3c5015888a494085f9a8b6eb204bcf P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:16:02.973889 11241 raft_consensus.cc:2749] T fe3c5015888a494085f9a8b6eb204bcf P bce73265e27d4b30a4dcc1e491305088 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:16:02.988976  5801 leader_election.cc:336] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): Network error: Client connection negotiation failed: client connection to 127.3.212.131:46709: connect: Connection refused (error 111)
W20260709 12:16:02.993350  5804 leader_election.cc:336] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:16:03.001698  5804 leader_election.cc:304] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:16:03.002599  5801 leader_election.cc:336] T 33f09d9f057844568fb4a24c314a746a P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
W20260709 12:16:03.002938  5804 consensus_peers.cc:597] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:16:03.003430  5804 leader_election.cc:336] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:16:03.003798  5804 leader_election.cc:304] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
W20260709 12:16:03.004313  5801 leader_election.cc:336] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
I20260709 12:16:03.004652 11244 raft_consensus.cc:2749] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:03.004870 11241 raft_consensus.cc:2749] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:16:03.005496  5801 leader_election.cc:336] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
W20260709 12:16:03.004706  5804 leader_election.cc:336] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:16:03.006137  5804 leader_election.cc:304] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:16:03.006928 11241 raft_consensus.cc:2749] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:16:03.007850  5804 leader_election.cc:336] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:16:03.008308  5804 leader_election.cc:304] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:16:03.009027 11241 raft_consensus.cc:2749] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:16:03.010694  5804 leader_election.cc:336] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:16:03.011140  5804 leader_election.cc:304] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, ad2f9a1e2f7a45429fa69fd23d09f821
I20260709 12:16:03.011863 11241 raft_consensus.cc:2749] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:16:03.015381  5801 leader_election.cc:304] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:16:03.017170 11241 raft_consensus.cc:2749] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:16:03.018365  5801 leader_election.cc:336] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
I20260709 12:16:03.019675  5801 leader_election.cc:304] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:16:03.020462 11241 raft_consensus.cc:2749] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:16:03.021447  5801 leader_election.cc:336] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
I20260709 12:16:03.023973  5801 leader_election.cc:304] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:16:03.025245 11241 raft_consensus.cc:2749] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:16:03.027109  5801 leader_election.cc:336] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
I20260709 12:16:03.027587  5801 leader_election.cc:304] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:16:03.034461 11241 raft_consensus.cc:2749] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:16:03.035584  5801 leader_election.cc:336] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
I20260709 12:16:03.036055  5801 leader_election.cc:304] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
W20260709 12:16:03.033656  5804 consensus_peers.cc:597] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:16:03.037195 11241 raft_consensus.cc:2749] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:16:03.038339  5801 leader_election.cc:336] T fe3c5015888a494085f9a8b6eb204bcf P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
W20260709 12:16:03.039289  5801 leader_election.cc:336] T 4e275c844ff54adea37252a082eae526 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
I20260709 12:16:03.039700  5801 leader_election.cc:304] T 4e275c844ff54adea37252a082eae526 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bce73265e27d4b30a4dcc1e491305088; no voters: 9e794b72ed7640219f90ec4232363929, dd62e75bd3ed4ed28f1fb5955d650808
I20260709 12:16:03.040452 11241 raft_consensus.cc:2749] T 4e275c844ff54adea37252a082eae526 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:16:03.041414  5801 leader_election.cc:336] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
I20260709 12:16:03.142757  3922 tablet_server.cc:196] TabletServer@127.3.212.131:0 shutdown complete.
I20260709 12:16:03.331374  3922 tablet_server.cc:179] TabletServer@127.3.212.132:0 shutting down...
W20260709 12:16:03.351125  5801 consensus_peers.cc:597] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:16:03.369817  5801 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.212.131:46709: connect: Connection refused (error 111) [suppressed 548 similar messages]
W20260709 12:16:03.374632  5801 consensus_peers.cc:597] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 -> Peer dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): Couldn't send request to peer dd62e75bd3ed4ed28f1fb5955d650808. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:16:03.413764  3922 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:03.414906  3922 tablet_replica.cc:333] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088: stopping tablet replica
I20260709 12:16:03.415870  3922 raft_consensus.cc:2243] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:16:03.417933  3922 raft_consensus.cc:2272] T d87fb855c56c430f896b24f98722bd61 P bce73265e27d4b30a4dcc1e491305088 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.421155  3922 tablet_replica.cc:333] T fe3c5015888a494085f9a8b6eb204bcf P bce73265e27d4b30a4dcc1e491305088: stopping tablet replica
I20260709 12:16:03.422127  3922 raft_consensus.cc:2243] T fe3c5015888a494085f9a8b6eb204bcf P bce73265e27d4b30a4dcc1e491305088 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:03.423378  3922 raft_consensus.cc:2272] T fe3c5015888a494085f9a8b6eb204bcf P bce73265e27d4b30a4dcc1e491305088 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.432106  3922 tablet_replica.cc:333] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088: stopping tablet replica
I20260709 12:16:03.433033  3922 raft_consensus.cc:2243] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:03.434485  3922 raft_consensus.cc:2272] T 756d32b8c4d642a6955517f66ac5bb45 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.437911  3922 tablet_replica.cc:333] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088: stopping tablet replica
I20260709 12:16:03.438851  3922 raft_consensus.cc:2243] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:03.440326  3922 raft_consensus.cc:2272] T ecdd526dba8b4d84859ef5f6ee618387 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.443614  3922 tablet_replica.cc:333] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088: stopping tablet replica
I20260709 12:16:03.444618  3922 raft_consensus.cc:2243] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:16:03.447340  3922 raft_consensus.cc:2272] T 20ba878da4e3492fbdf2f90c6bb202c4 P bce73265e27d4b30a4dcc1e491305088 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.451815  3922 tablet_replica.cc:333] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088: stopping tablet replica
I20260709 12:16:03.452802  3922 raft_consensus.cc:2243] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:03.453775  3922 raft_consensus.cc:2272] T 8d081e937c2741c9b646839e29e5599f P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.458026  3922 tablet_replica.cc:333] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088: stopping tablet replica
I20260709 12:16:03.459030  3922 raft_consensus.cc:2243] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:03.459972  3922 raft_consensus.cc:2272] T 271b0c7d258142798f30accd6aaba829 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.463176  3922 tablet_replica.cc:333] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088: stopping tablet replica
I20260709 12:16:03.464047  3922 raft_consensus.cc:2243] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:16:03.465685  3922 raft_consensus.cc:2272] T 87f29f851a0e43738cf01ef3724e5533 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.468765  3922 tablet_replica.cc:333] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088: stopping tablet replica
I20260709 12:16:03.469686  3922 raft_consensus.cc:2243] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:16:03.471261  3922 raft_consensus.cc:2272] T 2a6867413d1d4b49bcd267c1e134d12e P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.474432  3922 tablet_replica.cc:333] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088: stopping tablet replica
I20260709 12:16:03.475369  3922 raft_consensus.cc:2243] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:03.476112  3922 raft_consensus.cc:2272] T ddd16ccf58f24f6db29e5fc39a06e5c4 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.479506  3922 tablet_replica.cc:333] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088: stopping tablet replica
I20260709 12:16:03.480583  3922 raft_consensus.cc:2243] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:16:03.482226  3922 raft_consensus.cc:2272] T f34c97113147431584d6336e0d849164 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:03.482363  5804 consensus_peers.cc:597] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 -> Peer ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): Couldn't send request to peer ad2f9a1e2f7a45429fa69fd23d09f821. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:16:03.485476  3922 tablet_replica.cc:333] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088: stopping tablet replica
I20260709 12:16:03.486469  3922 raft_consensus.cc:2243] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:16:03.487893  3922 raft_consensus.cc:2272] T 62577fc91bb44d3a882109dc63f74008 P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.490933  3922 tablet_replica.cc:333] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088: stopping tablet replica
I20260709 12:16:03.491832  3922 raft_consensus.cc:2243] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:16:03.493408  3922 raft_consensus.cc:2272] T 3db164e3a1ce4a43b0a112a777118daa P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.496706  3922 tablet_replica.cc:333] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088: stopping tablet replica
I20260709 12:16:03.497673  3922 raft_consensus.cc:2243] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:16:03.499280  3922 raft_consensus.cc:2272] T a6b2fb64d40642259e41424cef193db0 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.502540  3922 tablet_replica.cc:333] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088: stopping tablet replica
I20260709 12:16:03.503453  3922 raft_consensus.cc:2243] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:03.504390  3922 raft_consensus.cc:2272] T 2f01a696969543e4ba24b4a07185fce8 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.507359  3922 tablet_replica.cc:333] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088: stopping tablet replica
I20260709 12:16:03.508235  3922 raft_consensus.cc:2243] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:16:03.509873  3922 raft_consensus.cc:2272] T e63d70b5bbd74a49be2a18fef7617e3e P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.513077  3922 tablet_replica.cc:333] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088: stopping tablet replica
I20260709 12:16:03.514014  3922 raft_consensus.cc:2243] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:16:03.515350  3922 raft_consensus.cc:2272] T 56627990da7d49f7a12669f23294a596 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.518263  3922 tablet_replica.cc:333] T 4e275c844ff54adea37252a082eae526 P bce73265e27d4b30a4dcc1e491305088: stopping tablet replica
I20260709 12:16:03.519275  3922 raft_consensus.cc:2243] T 4e275c844ff54adea37252a082eae526 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:03.520500  3922 raft_consensus.cc:2272] T 4e275c844ff54adea37252a082eae526 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.524495  3922 tablet_replica.cc:333] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088: stopping tablet replica
I20260709 12:16:03.525338  3922 raft_consensus.cc:2243] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:03.526165  3922 raft_consensus.cc:2272] T ed974c2bf41a490ca098100bdfc63351 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.529244  3922 tablet_replica.cc:333] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088: stopping tablet replica
I20260709 12:16:03.530187  3922 raft_consensus.cc:2243] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:16:03.531582  3922 raft_consensus.cc:2272] T 9212b0f778ec4455b8054add86b66d78 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.534853  3922 tablet_replica.cc:333] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088: stopping tablet replica
I20260709 12:16:03.535794  3922 raft_consensus.cc:2243] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:16:03.537181  3922 raft_consensus.cc:2272] T 4d8224f2bf564e7197a33ee531527a15 P bce73265e27d4b30a4dcc1e491305088 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.540401  3922 tablet_replica.cc:333] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088: stopping tablet replica
I20260709 12:16:03.541316  3922 raft_consensus.cc:2243] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:03.542119  3922 raft_consensus.cc:2272] T 84919c977be24017b74e122582f71fbe P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.544963  3922 tablet_replica.cc:333] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088: stopping tablet replica
I20260709 12:16:03.545818  3922 raft_consensus.cc:2243] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:16:03.547240  3922 raft_consensus.cc:2272] T 89852cae0bd14fd8be73b84dc4a49b2a P bce73265e27d4b30a4dcc1e491305088 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.550172  3922 tablet_replica.cc:333] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088: stopping tablet replica
I20260709 12:16:03.550983  3922 raft_consensus.cc:2243] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:16:03.552433  3922 raft_consensus.cc:2272] T 21832120214f4b8fb9e2e0de351565f0 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.555675  3922 tablet_replica.cc:333] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088: stopping tablet replica
I20260709 12:16:03.556571  3922 raft_consensus.cc:2243] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:16:03.558136  3922 raft_consensus.cc:2272] T 45e701f062f14e4e80492fc08144cca6 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.561074  3922 tablet_replica.cc:333] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088: stopping tablet replica
I20260709 12:16:03.561906  3922 raft_consensus.cc:2243] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:03.562803  3922 raft_consensus.cc:2272] T 62cb582e4337464894d9eb032a3b2cd2 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.565725  3922 tablet_replica.cc:333] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088: stopping tablet replica
I20260709 12:16:03.566592  3922 raft_consensus.cc:2243] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:03.567505  3922 raft_consensus.cc:2272] T d09ac3a18bc549dabadd7ec3c3f57017 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.570612  3922 tablet_replica.cc:333] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088: stopping tablet replica
I20260709 12:16:03.571528  3922 raft_consensus.cc:2243] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:16:03.572923  3922 raft_consensus.cc:2272] T 9f93759199ab4820a9a807a0f1c70c85 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.575806  3922 tablet_replica.cc:333] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088: stopping tablet replica
I20260709 12:16:03.576773  3922 raft_consensus.cc:2243] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:03.577682  3922 raft_consensus.cc:2272] T 90cb6c9306054ce3b2bc1bbd21c7345f P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.580628  3922 tablet_replica.cc:333] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088: stopping tablet replica
I20260709 12:16:03.581527  3922 raft_consensus.cc:2243] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:16:03.583050  3922 raft_consensus.cc:2272] T 41c65b96548e49b3863d03db116fd8d0 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.585983  3922 tablet_replica.cc:333] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088: stopping tablet replica
I20260709 12:16:03.586850  3922 raft_consensus.cc:2243] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:03.587603  3922 raft_consensus.cc:2272] T c7bb7b814fea4a2488cc39d06fc90483 P bce73265e27d4b30a4dcc1e491305088 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.590622  3922 tablet_replica.cc:333] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088: stopping tablet replica
I20260709 12:16:03.591425  3922 raft_consensus.cc:2243] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:03.592166  3922 raft_consensus.cc:2272] T e3beaf3ce31042719868401157039ee9 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.595230  3922 tablet_replica.cc:333] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088: stopping tablet replica
I20260709 12:16:03.596045  3922 raft_consensus.cc:2243] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:03.596760  3922 raft_consensus.cc:2272] T 00645b1f1e014de995e4a937f842d909 P bce73265e27d4b30a4dcc1e491305088 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.599716  3922 tablet_replica.cc:333] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088: stopping tablet replica
I20260709 12:16:03.600587  3922 raft_consensus.cc:2243] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:16:03.601948  3922 raft_consensus.cc:2272] T c63fe19b7c5e4c73b49eee26ad00e88d P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.604831  3922 tablet_replica.cc:333] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088: stopping tablet replica
I20260709 12:16:03.605671  3922 raft_consensus.cc:2243] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:16:03.607072  3922 raft_consensus.cc:2272] T 8a4dd376f83a42a896a5e1aca58d3221 P bce73265e27d4b30a4dcc1e491305088 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.609745  3922 tablet_replica.cc:333] T 33f09d9f057844568fb4a24c314a746a P bce73265e27d4b30a4dcc1e491305088: stopping tablet replica
I20260709 12:16:03.610566  3922 raft_consensus.cc:2243] T 33f09d9f057844568fb4a24c314a746a P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:03.611515  3922 raft_consensus.cc:2272] T 33f09d9f057844568fb4a24c314a746a P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.615255  3922 tablet_replica.cc:333] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088: stopping tablet replica
I20260709 12:16:03.616145  3922 raft_consensus.cc:2243] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:03.617556  3922 raft_consensus.cc:2272] T c69b050cdaeb4f1db6cd4993ad703192 P bce73265e27d4b30a4dcc1e491305088 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.620528  3922 tablet_replica.cc:333] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088: stopping tablet replica
I20260709 12:16:03.621345  3922 raft_consensus.cc:2243] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:03.622234  3922 raft_consensus.cc:2272] T 88f51ae73df747849e2f3cd63547a1d0 P bce73265e27d4b30a4dcc1e491305088 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.625360  3922 tablet_replica.cc:333] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088: stopping tablet replica
I20260709 12:16:03.626183  3922 raft_consensus.cc:2243] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:03.627043  3922 raft_consensus.cc:2272] T 9634d2debd9f4e7ea32cf4479f9242e1 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.630035  3922 tablet_replica.cc:333] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088: stopping tablet replica
I20260709 12:16:03.630839  3922 raft_consensus.cc:2243] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:03.632706  3922 raft_consensus.cc:2272] T a975d4f227214562b6fc39ea53081961 P bce73265e27d4b30a4dcc1e491305088 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.635759  3922 tablet_replica.cc:333] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088: stopping tablet replica
I20260709 12:16:03.636525  3922 raft_consensus.cc:2243] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:16:03.638160  3922 raft_consensus.cc:2272] T 9f927a751b4041e99eb5ac25ddf214ec P bce73265e27d4b30a4dcc1e491305088 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.641358  3922 tablet_replica.cc:333] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088: stopping tablet replica
I20260709 12:16:03.642198  3922 raft_consensus.cc:2243] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:03.643081  3922 raft_consensus.cc:2272] T b4b265799c1c447794c6126f3ae47e5d P bce73265e27d4b30a4dcc1e491305088 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:03.646194  3922 tablet_replica.cc:333] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088: stopping tablet replica
I20260709 12:16:03.646915  3922 raft_consensus.cc:2243] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:16:03.648250  3922 raft_consensus.cc:2272] T d8dc93d0992c4324872c6aab5aa9db8c P bce73265e27d4b30a4dcc1e491305088 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:03.834121  5859 debug-util.cc:398] Leaking SignalData structure 0x7b08003aa0e0 after lost signal to thread 3925
W20260709 12:16:03.835251  5859 debug-util.cc:398] Leaking SignalData structure 0x7b08003436a0 after lost signal to thread 5057
W20260709 12:16:03.836560  5859 debug-util.cc:398] Leaking SignalData structure 0x7b080034d400 after lost signal to thread 5862
W20260709 12:16:04.746013  3922 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 5859)
I20260709 12:16:05.887187  3922 tablet_server.cc:196] TabletServer@127.3.212.132:0 shutdown complete.
I20260709 12:16:05.967164  3922 master.cc:562] Master@127.3.212.190:33295 shutting down...
W20260709 12:16:06.008320  5071 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 12:16:06.008615  5071 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:16:06.008819  5071 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:16:06.079838  5054 debug-util.cc:398] Leaking SignalData structure 0x7b080034fd20 after lost signal to thread 3925
W20260709 12:16:06.080848  5054 debug-util.cc:398] Leaking SignalData structure 0x7b08003b1040 after lost signal to thread 5057
W20260709 12:16:08.341066  5007 catalog_manager.cc:4755] TS dd62e75bd3ed4ed28f1fb5955d650808 (127.3.212.130:44455): ChangeConfig:REMOVE_PEER RPC failed for tablet c7bb7b814fea4a2488cc39d06fc90483: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44455: connect: Connection refused (error 111)
W20260709 12:16:11.964247  5007 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.212.131:46709: connect: Connection refused (error 111) [suppressed 23 similar messages]
W20260709 12:16:11.968605  5007 catalog_manager.cc:4755] TS 9e794b72ed7640219f90ec4232363929 (127.3.212.131:46709): ChangeConfig:REMOVE_PEER RPC failed for tablet ddd16ccf58f24f6db29e5fc39a06e5c4: Network error: Client connection negotiation failed: client connection to 127.3.212.131:46709: connect: Connection refused (error 111)
W20260709 12:16:13.685137  5010 catalog_manager.cc:4755] TS ad2f9a1e2f7a45429fa69fd23d09f821 (127.3.212.129:34443): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 4e275c844ff54adea37252a082eae526: Network error: Client connection negotiation failed: client connection to 127.3.212.129:34443: connect: Connection refused (error 111)
I20260709 12:16:14.740092  3922 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 221aa011207d421b9725197ff8bed389 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:14.741344  3922 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 221aa011207d421b9725197ff8bed389 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:14.741824  3922 tablet_replica.cc:333] T 00000000000000000000000000000000 P 221aa011207d421b9725197ff8bed389: stopping tablet replica
I20260709 12:16:14.959766  3922 master.cc:584] Master@127.3.212.190:33295 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (210710 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 12:16:15.073342  3922 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.212.190:40671
I20260709 12:16:15.074927  3922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:15.083179 11253 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:15.083184 11252 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:15.083225 11255 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:15.084992  3922 server_base.cc:1061] running on GCE node
I20260709 12:16:15.089078  3922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:15.089435  3922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:15.089622  3922 hybrid_clock.cc:648] HybridClock initialized: now 1783599375089604 us; error 0 us; skew 500 ppm
I20260709 12:16:15.090224  3922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:15.095283  3922 webserver.cc:533] Webserver started at http://127.3.212.190:40057/ using document root <none> and password file <none>
I20260709 12:16:15.096041  3922 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:15.096249  3922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:15.096580  3922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:15.098229  3922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599103767690-3922-0/minicluster-data/master-0-root/instance:
uuid: "eb02cb678b0c4f28932bfb6c2377165e"
format_stamp: "Formatted at 2026-07-09 12:16:15 on dist-test-slave-442x"
I20260709 12:16:15.104451  3922 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:16:15.110098 11260 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:15.111270  3922 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 12:16:15.111819  3922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599103767690-3922-0/minicluster-data/master-0-root
uuid: "eb02cb678b0c4f28932bfb6c2377165e"
format_stamp: "Formatted at 2026-07-09 12:16:15 on dist-test-slave-442x"
I20260709 12:16:15.112224  3922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599103767690-3922-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599103767690-3922-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599103767690-3922-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:15.154507  3922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:15.156095  3922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:15.207266  3922 rpc_server.cc:307] RPC server started. Bound to: 127.3.212.190:40671
I20260709 12:16:15.207414 11311 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.212.190:40671 every 8 connection(s)
I20260709 12:16:15.212146 11312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:15.225344 11312 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb02cb678b0c4f28932bfb6c2377165e: Bootstrap starting.
I20260709 12:16:15.231346 11312 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eb02cb678b0c4f28932bfb6c2377165e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:15.236686 11312 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb02cb678b0c4f28932bfb6c2377165e: No bootstrap required, opened a new log
I20260709 12:16:15.239095 11312 raft_consensus.cc:359] T 00000000000000000000000000000000 P eb02cb678b0c4f28932bfb6c2377165e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb02cb678b0c4f28932bfb6c2377165e" member_type: VOTER }
I20260709 12:16:15.239617 11312 raft_consensus.cc:385] T 00000000000000000000000000000000 P eb02cb678b0c4f28932bfb6c2377165e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:15.239948 11312 raft_consensus.cc:740] T 00000000000000000000000000000000 P eb02cb678b0c4f28932bfb6c2377165e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb02cb678b0c4f28932bfb6c2377165e, State: Initialized, Role: FOLLOWER
I20260709 12:16:15.240674 11312 consensus_queue.cc:260] T 00000000000000000000000000000000 P eb02cb678b0c4f28932bfb6c2377165e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb02cb678b0c4f28932bfb6c2377165e" member_type: VOTER }
I20260709 12:16:15.241191 11312 raft_consensus.cc:399] T 00000000000000000000000000000000 P eb02cb678b0c4f28932bfb6c2377165e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:16:15.241452 11312 raft_consensus.cc:493] T 00000000000000000000000000000000 P eb02cb678b0c4f28932bfb6c2377165e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:16:15.241721 11312 raft_consensus.cc:3060] T 00000000000000000000000000000000 P eb02cb678b0c4f28932bfb6c2377165e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:15.246798 11312 raft_consensus.cc:515] T 00000000000000000000000000000000 P eb02cb678b0c4f28932bfb6c2377165e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb02cb678b0c4f28932bfb6c2377165e" member_type: VOTER }
I20260709 12:16:15.247376 11312 leader_election.cc:304] T 00000000000000000000000000000000 P eb02cb678b0c4f28932bfb6c2377165e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eb02cb678b0c4f28932bfb6c2377165e; no voters: 
I20260709 12:16:15.249167 11312 leader_election.cc:290] T 00000000000000000000000000000000 P eb02cb678b0c4f28932bfb6c2377165e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:16:15.249843 11315 raft_consensus.cc:2804] T 00000000000000000000000000000000 P eb02cb678b0c4f28932bfb6c2377165e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:15.251596 11315 raft_consensus.cc:697] T 00000000000000000000000000000000 P eb02cb678b0c4f28932bfb6c2377165e [term 1 LEADER]: Becoming Leader. State: Replica: eb02cb678b0c4f28932bfb6c2377165e, State: Running, Role: LEADER
I20260709 12:16:15.252388 11315 consensus_queue.cc:237] T 00000000000000000000000000000000 P eb02cb678b0c4f28932bfb6c2377165e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb02cb678b0c4f28932bfb6c2377165e" member_type: VOTER }
I20260709 12:16:15.252708 11312 sys_catalog.cc:565] T 00000000000000000000000000000000 P eb02cb678b0c4f28932bfb6c2377165e [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:16:15.260999 11317 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb02cb678b0c4f28932bfb6c2377165e [sys.catalog]: SysCatalogTable state changed. Reason: New leader eb02cb678b0c4f28932bfb6c2377165e. Latest consensus state: current_term: 1 leader_uuid: "eb02cb678b0c4f28932bfb6c2377165e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb02cb678b0c4f28932bfb6c2377165e" member_type: VOTER } }
I20260709 12:16:15.261835 11317 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb02cb678b0c4f28932bfb6c2377165e [sys.catalog]: This master's current role is: LEADER
I20260709 12:16:15.264350 11324 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:16:15.263958 11316 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb02cb678b0c4f28932bfb6c2377165e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eb02cb678b0c4f28932bfb6c2377165e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb02cb678b0c4f28932bfb6c2377165e" member_type: VOTER } }
I20260709 12:16:15.264876 11316 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb02cb678b0c4f28932bfb6c2377165e [sys.catalog]: This master's current role is: LEADER
I20260709 12:16:15.272159 11324 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:16:15.273810  3922 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:16:15.284570 11324 catalog_manager.cc:1383] Generated new cluster ID: ac515e4748974d32bfd89b0126a42dd7
I20260709 12:16:15.284965 11324 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:16:15.304589 11324 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:16:15.306648 11324 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:16:15.324640 11324 catalog_manager.cc:6070] T 00000000000000000000000000000000 P eb02cb678b0c4f28932bfb6c2377165e: Generated new TSK 0
I20260709 12:16:15.325492 11324 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:16:15.341574  3922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:15.348685 11333 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:15.349143 11334 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:15.350889 11336 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:15.352540  3922 server_base.cc:1061] running on GCE node
I20260709 12:16:15.355227  3922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:15.355449  3922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:15.355576  3922 hybrid_clock.cc:648] HybridClock initialized: now 1783599375355565 us; error 0 us; skew 500 ppm
I20260709 12:16:15.356072  3922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:15.358882  3922 webserver.cc:533] Webserver started at http://127.3.212.129:41499/ using document root <none> and password file <none>
I20260709 12:16:15.359424  3922 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:15.359608  3922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:15.359843  3922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:15.361027  3922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599103767690-3922-0/minicluster-data/ts-0-root/instance:
uuid: "b126028166e8480ba25541bf8f7fc6de"
format_stamp: "Formatted at 2026-07-09 12:16:15 on dist-test-slave-442x"
I20260709 12:16:15.366626  3922 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.003s
I20260709 12:16:15.370645 11341 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:15.371485  3922 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:16:15.371845  3922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599103767690-3922-0/minicluster-data/ts-0-root
uuid: "b126028166e8480ba25541bf8f7fc6de"
format_stamp: "Formatted at 2026-07-09 12:16:15 on dist-test-slave-442x"
I20260709 12:16:15.372149  3922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599103767690-3922-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599103767690-3922-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599103767690-3922-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:15.384256  3922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:15.385594  3922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:15.387123  3922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:15.389860  3922 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:15.390091  3922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:15.390318  3922 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:15.390479  3922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:15.436340  3922 rpc_server.cc:307] RPC server started. Bound to: 127.3.212.129:37935
I20260709 12:16:15.436460 11403 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.212.129:37935 every 8 connection(s)
I20260709 12:16:15.441596  3922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:15.450773 11408 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:15.452580 11409 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:15.457293 11411 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:15.457547  3922 server_base.cc:1061] running on GCE node
I20260709 12:16:15.457603 11404 heartbeater.cc:344] Connected to a master server at 127.3.212.190:40671
I20260709 12:16:15.458242 11404 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:15.459282 11404 heartbeater.cc:507] Master 127.3.212.190:40671 requested a full tablet report, sending...
I20260709 12:16:15.460081  3922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:15.460356  3922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:15.460518  3922 hybrid_clock.cc:648] HybridClock initialized: now 1783599375460501 us; error 0 us; skew 500 ppm
I20260709 12:16:15.461175  3922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:15.461726 11277 ts_manager.cc:194] Registered new tserver with Master: b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:15.464075  3922 webserver.cc:533] Webserver started at http://127.3.212.130:36659/ using document root <none> and password file <none>
I20260709 12:16:15.464110 11277 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57416
I20260709 12:16:15.464769  3922 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:15.465006  3922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:15.465273  3922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:15.466602  3922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599103767690-3922-0/minicluster-data/ts-1-root/instance:
uuid: "1c101e338f954ef086338e251deed19d"
format_stamp: "Formatted at 2026-07-09 12:16:15 on dist-test-slave-442x"
I20260709 12:16:15.471875  3922 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:16:15.476377 11416 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:15.477272  3922 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:16:15.477640  3922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599103767690-3922-0/minicluster-data/ts-1-root
uuid: "1c101e338f954ef086338e251deed19d"
format_stamp: "Formatted at 2026-07-09 12:16:15 on dist-test-slave-442x"
I20260709 12:16:15.477924  3922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599103767690-3922-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599103767690-3922-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599103767690-3922-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:15.494334  3922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:15.495638  3922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:15.497212  3922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:15.499699  3922 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:15.499971  3922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:15.500223  3922 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:15.500383  3922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:15.546260  3922 rpc_server.cc:307] RPC server started. Bound to: 127.3.212.130:41579
I20260709 12:16:15.546362 11478 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.212.130:41579 every 8 connection(s)
I20260709 12:16:15.551571  3922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:15.560711 11482 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:15.560807 11483 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:15.563688 11485 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:15.565057  3922 server_base.cc:1061] running on GCE node
I20260709 12:16:15.565076 11479 heartbeater.cc:344] Connected to a master server at 127.3.212.190:40671
I20260709 12:16:15.565728 11479 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:15.566360  3922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:15.566792  3922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:15.566746 11479 heartbeater.cc:507] Master 127.3.212.190:40671 requested a full tablet report, sending...
I20260709 12:16:15.567198  3922 hybrid_clock.cc:648] HybridClock initialized: now 1783599375567174 us; error 0 us; skew 500 ppm
I20260709 12:16:15.568045  3922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:15.569698 11277 ts_manager.cc:194] Registered new tserver with Master: 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:15.570938  3922 webserver.cc:533] Webserver started at http://127.3.212.131:45717/ using document root <none> and password file <none>
I20260709 12:16:15.571203 11277 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57426
I20260709 12:16:15.571483  3922 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:15.571913  3922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:15.572263  3922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:15.573835  3922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599103767690-3922-0/minicluster-data/ts-2-root/instance:
uuid: "a03223e9e41247c3a36b7b7c3d476671"
format_stamp: "Formatted at 2026-07-09 12:16:15 on dist-test-slave-442x"
I20260709 12:16:15.578626  3922 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 12:16:15.582541 11490 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:15.583503  3922 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:16:15.583839  3922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599103767690-3922-0/minicluster-data/ts-2-root
uuid: "a03223e9e41247c3a36b7b7c3d476671"
format_stamp: "Formatted at 2026-07-09 12:16:15 on dist-test-slave-442x"
I20260709 12:16:15.584215  3922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599103767690-3922-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599103767690-3922-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599103767690-3922-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:15.603626  3922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:15.604957  3922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:15.606674  3922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:15.609305  3922 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:15.609577  3922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:16:15.609825  3922 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:15.609978  3922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:15.654366  3922 rpc_server.cc:307] RPC server started. Bound to: 127.3.212.131:36063
I20260709 12:16:15.654595 11552 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.212.131:36063 every 8 connection(s)
I20260709 12:16:15.659384  3922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:15.668807 11556 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:15.670876 11557 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:15.671798 11559 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:15.671886  3922 server_base.cc:1061] running on GCE node
I20260709 12:16:15.673157  3922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:15.673463  3922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:15.673739  3922 hybrid_clock.cc:648] HybridClock initialized: now 1783599375673717 us; error 0 us; skew 500 ppm
I20260709 12:16:15.674479  3922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:15.677214 11553 heartbeater.cc:344] Connected to a master server at 127.3.212.190:40671
I20260709 12:16:15.677716 11553 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:15.677721  3922 webserver.cc:533] Webserver started at http://127.3.212.132:44195/ using document root <none> and password file <none>
I20260709 12:16:15.678603  3922 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:15.678855  3922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:15.678859 11553 heartbeater.cc:507] Master 127.3.212.190:40671 requested a full tablet report, sending...
I20260709 12:16:15.679349  3922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:15.681171  3922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599103767690-3922-0/minicluster-data/ts-3-root/instance:
uuid: "9da53be18b0f446aaa406216e20b0ec8"
format_stamp: "Formatted at 2026-07-09 12:16:15 on dist-test-slave-442x"
I20260709 12:16:15.682152 11277 ts_manager.cc:194] Registered new tserver with Master: a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:15.683617 11277 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57430
I20260709 12:16:15.686565  3922 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:16:15.690762 11564 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:15.691614  3922 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.004s
I20260709 12:16:15.691920  3922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599103767690-3922-0/minicluster-data/ts-3-root
uuid: "9da53be18b0f446aaa406216e20b0ec8"
format_stamp: "Formatted at 2026-07-09 12:16:15 on dist-test-slave-442x"
I20260709 12:16:15.692220  3922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599103767690-3922-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599103767690-3922-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599103767690-3922-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:15.706668  3922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:15.708083  3922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:15.709754  3922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:15.712172  3922 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:15.712420  3922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:15.712651  3922 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:15.712815  3922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:15.757704  3922 rpc_server.cc:307] RPC server started. Bound to: 127.3.212.132:34973
I20260709 12:16:15.757867 11626 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.212.132:34973 every 8 connection(s)
I20260709 12:16:15.772076 11627 heartbeater.cc:344] Connected to a master server at 127.3.212.190:40671
I20260709 12:16:15.772506 11627 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:15.773288 11627 heartbeater.cc:507] Master 127.3.212.190:40671 requested a full tablet report, sending...
I20260709 12:16:15.775370 11277 ts_manager.cc:194] Registered new tserver with Master: 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:15.776320  3922 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.015158606s
I20260709 12:16:15.776829 11277 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57440
I20260709 12:16:15.805866 11277 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57448:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 12:16:16.050132 11369 tablet_service.cc:1511] Processing CreateTablet for tablet 98cd3dfdeed3494ea7d5a7c45337ad3f (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:16:16.051841 11369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98cd3dfdeed3494ea7d5a7c45337ad3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.052904 11518 tablet_service.cc:1511] Processing CreateTablet for tablet 98cd3dfdeed3494ea7d5a7c45337ad3f (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:16:16.054456 11518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98cd3dfdeed3494ea7d5a7c45337ad3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.054831 11368 tablet_service.cc:1511] Processing CreateTablet for tablet 6480ef79a4dc499b94fdb7081ff36fdd (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:16:16.056283 11368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6480ef79a4dc499b94fdb7081ff36fdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.058646 11517 tablet_service.cc:1511] Processing CreateTablet for tablet 6480ef79a4dc499b94fdb7081ff36fdd (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:16:16.060259 11517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6480ef79a4dc499b94fdb7081ff36fdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.063618 11367 tablet_service.cc:1511] Processing CreateTablet for tablet e896afa1887146dfade142338e2fc407 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:16:16.066051 11367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e896afa1887146dfade142338e2fc407. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.069032 11516 tablet_service.cc:1511] Processing CreateTablet for tablet 0b15621d7be54f2489041bbe8258bb79 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:16:16.070704 11516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b15621d7be54f2489041bbe8258bb79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.072041 11366 tablet_service.cc:1511] Processing CreateTablet for tablet f8e9a700accc4fff8304eec59a498721 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:16:16.074702 11515 tablet_service.cc:1511] Processing CreateTablet for tablet f8e9a700accc4fff8304eec59a498721 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:16:16.076311 11515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8e9a700accc4fff8304eec59a498721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.080837 11514 tablet_service.cc:1511] Processing CreateTablet for tablet 987e6a4207394b2f80be7c7d03b696bf (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:16:16.081400 11366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8e9a700accc4fff8304eec59a498721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.080709 11365 tablet_service.cc:1511] Processing CreateTablet for tablet 5ffe47647c274723808482c166efa21c (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:16:16.084028 11365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ffe47647c274723808482c166efa21c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.082911 11514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 987e6a4207394b2f80be7c7d03b696bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.086750 11364 tablet_service.cc:1511] Processing CreateTablet for tablet 987e6a4207394b2f80be7c7d03b696bf (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:16:16.088241 11364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 987e6a4207394b2f80be7c7d03b696bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.089131 11513 tablet_service.cc:1511] Processing CreateTablet for tablet 49b270aad1134eb894de5aa7cc60f3a8 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:16:16.090550 11513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49b270aad1134eb894de5aa7cc60f3a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.093243 11363 tablet_service.cc:1511] Processing CreateTablet for tablet 985a868591ad444faeace7fc051862cd (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:16:16.095366 11363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 985a868591ad444faeace7fc051862cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.096199 11362 tablet_service.cc:1511] Processing CreateTablet for tablet ef13d597f7a84434a1bbdc95857e6215 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:16:16.097685 11362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef13d597f7a84434a1bbdc95857e6215. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.099783 11512 tablet_service.cc:1511] Processing CreateTablet for tablet 985a868591ad444faeace7fc051862cd (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:16:16.101495 11512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 985a868591ad444faeace7fc051862cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.110817 11511 tablet_service.cc:1511] Processing CreateTablet for tablet 9b19a20c753d463babb75ec55ddd0ba8 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:16:16.112406 11511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b19a20c753d463babb75ec55ddd0ba8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.125111 11361 tablet_service.cc:1511] Processing CreateTablet for tablet 9b19a20c753d463babb75ec55ddd0ba8 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:16:16.126778 11361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b19a20c753d463babb75ec55ddd0ba8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.130719 11592 tablet_service.cc:1511] Processing CreateTablet for tablet 98cd3dfdeed3494ea7d5a7c45337ad3f (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:16:16.132369 11592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98cd3dfdeed3494ea7d5a7c45337ad3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.134673 11591 tablet_service.cc:1511] Processing CreateTablet for tablet e896afa1887146dfade142338e2fc407 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:16:16.137169 11590 tablet_service.cc:1511] Processing CreateTablet for tablet 0b15621d7be54f2489041bbe8258bb79 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:16:16.144721 11589 tablet_service.cc:1511] Processing CreateTablet for tablet 5ffe47647c274723808482c166efa21c (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:16:16.147585 11586 tablet_service.cc:1511] Processing CreateTablet for tablet ef13d597f7a84434a1bbdc95857e6215 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:16:16.149837 11591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e896afa1887146dfade142338e2fc407. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.150255 11587 tablet_service.cc:1511] Processing CreateTablet for tablet 49b270aad1134eb894de5aa7cc60f3a8 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:16:16.151854 11587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49b270aad1134eb894de5aa7cc60f3a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.156576 11589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ffe47647c274723808482c166efa21c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.154814 11588 tablet_service.cc:1511] Processing CreateTablet for tablet 987e6a4207394b2f80be7c7d03b696bf (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:16:16.158092 11588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 987e6a4207394b2f80be7c7d03b696bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.163393 11585 tablet_service.cc:1511] Processing CreateTablet for tablet 9b19a20c753d463babb75ec55ddd0ba8 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:16:16.164981 11585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b19a20c753d463babb75ec55ddd0ba8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.174147 11510 tablet_service.cc:1511] Processing CreateTablet for tablet 3205ea0248f74fa5ba9de670d91b9568 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:16:16.177291 11510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3205ea0248f74fa5ba9de670d91b9568. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.174176 11590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b15621d7be54f2489041bbe8258bb79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.187429 11586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef13d597f7a84434a1bbdc95857e6215. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.195431 11584 tablet_service.cc:1511] Processing CreateTablet for tablet 3205ea0248f74fa5ba9de670d91b9568 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:16:16.196945 11584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3205ea0248f74fa5ba9de670d91b9568. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.202180 11646 tablet_bootstrap.cc:492] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:16.218575 11646 tablet_bootstrap.cc:654] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:16.226893 11443 tablet_service.cc:1511] Processing CreateTablet for tablet e896afa1887146dfade142338e2fc407 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:16:16.228600 11443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e896afa1887146dfade142338e2fc407. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.230660 11442 tablet_service.cc:1511] Processing CreateTablet for tablet 0b15621d7be54f2489041bbe8258bb79 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:16:16.232149 11442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b15621d7be54f2489041bbe8258bb79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.234691 11441 tablet_service.cc:1511] Processing CreateTablet for tablet f8e9a700accc4fff8304eec59a498721 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:16:16.237128 11440 tablet_service.cc:1511] Processing CreateTablet for tablet 5ffe47647c274723808482c166efa21c (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:16:16.238158 11647 tablet_bootstrap.cc:492] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671: Bootstrap starting.
I20260709 12:16:16.239631 11439 tablet_service.cc:1511] Processing CreateTablet for tablet 49b270aad1134eb894de5aa7cc60f3a8 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:16:16.242748 11437 tablet_service.cc:1511] Processing CreateTablet for tablet ef13d597f7a84434a1bbdc95857e6215 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:16:16.245184 11444 tablet_service.cc:1511] Processing CreateTablet for tablet 6480ef79a4dc499b94fdb7081ff36fdd (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:16:16.248299 11436 tablet_service.cc:1511] Processing CreateTablet for tablet 3205ea0248f74fa5ba9de670d91b9568 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:16:16.250180 11438 tablet_service.cc:1511] Processing CreateTablet for tablet 985a868591ad444faeace7fc051862cd (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:16:16.253774 11439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49b270aad1134eb894de5aa7cc60f3a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.255689 11437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef13d597f7a84434a1bbdc95857e6215. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.257484 11436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3205ea0248f74fa5ba9de670d91b9568. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.259066 11441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8e9a700accc4fff8304eec59a498721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.260637 11438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 985a868591ad444faeace7fc051862cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.261804 11440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ffe47647c274723808482c166efa21c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.263396 11444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6480ef79a4dc499b94fdb7081ff36fdd. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:16:16.269631 11325 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:16.284777 11649 tablet_bootstrap.cc:492] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8: Bootstrap starting.
I20260709 12:16:16.287593 11364 tablet_service.cc:1511] Processing CreateTablet for tablet e7458151705b45928221728d170b4024 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:16:16.291286 11435 tablet_service.cc:1511] Processing CreateTablet for tablet e7458151705b45928221728d170b4024 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:16:16.295100 11435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7458151705b45928221728d170b4024. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.295049 11364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7458151705b45928221728d170b4024. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.301286 11510 tablet_service.cc:1511] Processing CreateTablet for tablet e7458151705b45928221728d170b4024 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:16:16.302758 11510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7458151705b45928221728d170b4024. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.307296 11647 tablet_bootstrap.cc:654] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:16.318894 11592 tablet_service.cc:1511] Processing CreateTablet for tablet e3b977efa036417c9a75e3b30b19c72a (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:16:16.320436 11592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3b977efa036417c9a75e3b30b19c72a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.328836 11368 tablet_service.cc:1511] Processing CreateTablet for tablet e3b977efa036417c9a75e3b30b19c72a (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:16:16.330365 11368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3b977efa036417c9a75e3b30b19c72a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.346674 11647 tablet_bootstrap.cc:492] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671: No bootstrap required, opened a new log
I20260709 12:16:16.360329 11647 ts_tablet_manager.cc:1403] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671: Time spent bootstrapping tablet: real 0.123s	user 0.000s	sys 0.014s
I20260709 12:16:16.350690 11646 tablet_bootstrap.cc:492] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de: No bootstrap required, opened a new log
I20260709 12:16:16.360807 11510 tablet_service.cc:1511] Processing CreateTablet for tablet 7b179748933846ae9a419549cdfb997a (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:16:16.363196 11366 tablet_service.cc:1511] Processing CreateTablet for tablet 7b179748933846ae9a419549cdfb997a (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:16:16.367722 11366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b179748933846ae9a419549cdfb997a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.368515 11442 tablet_service.cc:1511] Processing CreateTablet for tablet e3b977efa036417c9a75e3b30b19c72a (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:16:16.366753 11510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b179748933846ae9a419549cdfb997a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.369902 11442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3b977efa036417c9a75e3b30b19c72a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.372196 11584 tablet_service.cc:1511] Processing CreateTablet for tablet 7b179748933846ae9a419549cdfb997a (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:16:16.373612 11584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b179748933846ae9a419549cdfb997a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.373679 11646 ts_tablet_manager.cc:1403] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.172s	user 0.024s	sys 0.016s
I20260709 12:16:16.376868 11514 tablet_service.cc:1511] Processing CreateTablet for tablet 2ff9fe9a94294836aec652338f44367d (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:16:16.378374 11514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ff9fe9a94294836aec652338f44367d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.376866 11646 raft_consensus.cc:359] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:16.386518 11646 raft_consensus.cc:385] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:16.386895 11646 raft_consensus.cc:740] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:16.387871 11646 consensus_queue.cc:260] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:16.385960 11651 tablet_bootstrap.cc:492] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d: Bootstrap starting.
I20260709 12:16:16.389925 11649 tablet_bootstrap.cc:654] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:16.388458 11443 tablet_service.cc:1511] Processing CreateTablet for tablet 2ff9fe9a94294836aec652338f44367d (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:16:16.388346 11647 raft_consensus.cc:359] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:16.393615 11647 raft_consensus.cc:385] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:16.397454 11589 tablet_service.cc:1511] Processing CreateTablet for tablet 2ff9fe9a94294836aec652338f44367d (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:16:16.394022 11647 raft_consensus.cc:740] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Initialized, Role: FOLLOWER
I20260709 12:16:16.398875 11589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ff9fe9a94294836aec652338f44367d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.398931 11647 consensus_queue.cc:260] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:16.403707 11363 tablet_service.cc:1511] Processing CreateTablet for tablet 74b107ce07924505acbedf93698833e7 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:16:16.405788 11363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74b107ce07924505acbedf93698833e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.406359 11443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ff9fe9a94294836aec652338f44367d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.427438 11649 tablet_bootstrap.cc:492] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8: No bootstrap required, opened a new log
I20260709 12:16:16.429790 11649 ts_tablet_manager.cc:1403] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8: Time spent bootstrapping tablet: real 0.145s	user 0.017s	sys 0.004s
I20260709 12:16:16.433135 11440 tablet_service.cc:1511] Processing CreateTablet for tablet 74b107ce07924505acbedf93698833e7 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:16:16.436528 11646 ts_tablet_manager.cc:1434] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.062s	user 0.003s	sys 0.004s
W20260709 12:16:16.441634 11405 tablet.cc:2406] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:16:16.440555 11651 tablet_bootstrap.cc:654] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:16.437247 11404 heartbeater.cc:499] Master 127.3.212.190:40671 was elected leader, sending a full tablet report...
I20260709 12:16:16.442780 11646 tablet_bootstrap.cc:492] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:16.441769 11440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74b107ce07924505acbedf93698833e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.455674 11553 heartbeater.cc:499] Master 127.3.212.190:40671 was elected leader, sending a full tablet report...
I20260709 12:16:16.455479 11584 tablet_service.cc:1511] Processing CreateTablet for tablet 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:16:16.456911 11584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42cf7a9497dc4b2ebf7a4c7d4f4dbed4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.436601 11649 raft_consensus.cc:359] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:16.462296 11649 raft_consensus.cc:385] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:16.462595 11649 raft_consensus.cc:740] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Initialized, Role: FOLLOWER
I20260709 12:16:16.462498 11510 tablet_service.cc:1511] Processing CreateTablet for tablet 74b107ce07924505acbedf93698833e7 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:16:16.464211 11510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74b107ce07924505acbedf93698833e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.466168 11647 ts_tablet_manager.cc:1434] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671: Time spent starting tablet: real 0.101s	user 0.000s	sys 0.025s
I20260709 12:16:16.467573 11647 tablet_bootstrap.cc:492] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671: Bootstrap starting.
I20260709 12:16:16.471647 11366 tablet_service.cc:1511] Processing CreateTablet for tablet 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:16:16.473306 11366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42cf7a9497dc4b2ebf7a4c7d4f4dbed4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.463642 11649 consensus_queue.cc:260] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:16.481590 11651 tablet_bootstrap.cc:492] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d: No bootstrap required, opened a new log
I20260709 12:16:16.482298 11651 ts_tablet_manager.cc:1403] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d: Time spent bootstrapping tablet: real 0.097s	user 0.012s	sys 0.003s
I20260709 12:16:16.487478 11646 tablet_bootstrap.cc:654] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:16.492787 11647 tablet_bootstrap.cc:654] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:16.494583 11627 heartbeater.cc:499] Master 127.3.212.190:40671 was elected leader, sending a full tablet report...
I20260709 12:16:16.495196 11649 ts_tablet_manager.cc:1434] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8: Time spent starting tablet: real 0.062s	user 0.006s	sys 0.002s
I20260709 12:16:16.497874 11514 tablet_service.cc:1511] Processing CreateTablet for tablet 67ed4eeff0ae44d0bc1ebb8cbe3adea5 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:16:16.499013 11439 tablet_service.cc:1511] Processing CreateTablet for tablet 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:16:16.503953 11646 tablet_bootstrap.cc:492] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de: No bootstrap required, opened a new log
I20260709 12:16:16.504251 11439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42cf7a9497dc4b2ebf7a4c7d4f4dbed4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.504487 11646 ts_tablet_manager.cc:1403] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.062s	user 0.011s	sys 0.004s
I20260709 12:16:16.507302 11514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67ed4eeff0ae44d0bc1ebb8cbe3adea5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.507786 11646 raft_consensus.cc:359] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:16.493278 11651 raft_consensus.cc:359] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:16.513654 11651 raft_consensus.cc:385] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:16.514008 11651 raft_consensus.cc:740] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Initialized, Role: FOLLOWER
I20260709 12:16:16.514968 11651 consensus_queue.cc:260] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:16.503209 11649 tablet_bootstrap.cc:492] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8: Bootstrap starting.
I20260709 12:16:16.501614 11363 tablet_service.cc:1511] Processing CreateTablet for tablet 67ed4eeff0ae44d0bc1ebb8cbe3adea5 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:16:16.517529 11363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67ed4eeff0ae44d0bc1ebb8cbe3adea5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.500370 11584 tablet_service.cc:1511] Processing CreateTablet for tablet 67ed4eeff0ae44d0bc1ebb8cbe3adea5 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:16:16.522390 11646 raft_consensus.cc:385] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:16.523222 11646 raft_consensus.cc:740] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:16.524530 11646 consensus_queue.cc:260] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:16.531634 11443 tablet_service.cc:1511] Processing CreateTablet for tablet ba25a071498548cdba1aaf992fa805e8 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:16:16.532882 11584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67ed4eeff0ae44d0bc1ebb8cbe3adea5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.537456 11513 tablet_service.cc:1511] Processing CreateTablet for tablet ba25a071498548cdba1aaf992fa805e8 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:16:16.537930 11589 tablet_service.cc:1511] Processing CreateTablet for tablet ba25a071498548cdba1aaf992fa805e8 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:16:16.538901 11513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba25a071498548cdba1aaf992fa805e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.539268 11589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba25a071498548cdba1aaf992fa805e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.541790 11442 tablet_service.cc:1511] Processing CreateTablet for tablet c67c223a5ec948b4bf18874bf0d591b5 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:16:16.543216 11368 tablet_service.cc:1511] Processing CreateTablet for tablet c67c223a5ec948b4bf18874bf0d591b5 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:16:16.544523 11368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c67c223a5ec948b4bf18874bf0d591b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.547103 11649 tablet_bootstrap.cc:654] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:16.547643 11515 tablet_service.cc:1511] Processing CreateTablet for tablet c67c223a5ec948b4bf18874bf0d591b5 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:16:16.533074 11443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba25a071498548cdba1aaf992fa805e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.551045 11515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c67c223a5ec948b4bf18874bf0d591b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.557277 11442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c67c223a5ec948b4bf18874bf0d591b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.571853 11646 ts_tablet_manager.cc:1434] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.067s	user 0.008s	sys 0.001s
I20260709 12:16:16.573165 11646 tablet_bootstrap.cc:492] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:16.573935 11479 heartbeater.cc:499] Master 127.3.212.190:40671 was elected leader, sending a full tablet report...
I20260709 12:16:16.581393 11646 tablet_bootstrap.cc:654] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:16.587857 11589 tablet_service.cc:1511] Processing CreateTablet for tablet a215788da7ae4b548e5c307a6b294109 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:16:16.589274 11589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a215788da7ae4b548e5c307a6b294109. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.592655 11654 raft_consensus.cc:493] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:16.593348 11654 raft_consensus.cc:515] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:16.597133 11363 tablet_service.cc:1511] Processing CreateTablet for tablet a215788da7ae4b548e5c307a6b294109 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:16:16.598187 11439 tablet_service.cc:1511] Processing CreateTablet for tablet a215788da7ae4b548e5c307a6b294109 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:16:16.598703 11363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a215788da7ae4b548e5c307a6b294109. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.606199 11654 leader_election.cc:290] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:16.635437 11439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a215788da7ae4b548e5c307a6b294109. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.641582 11510 tablet_service.cc:1511] Processing CreateTablet for tablet b9c607d0d1e744b6babe5fc93505013b (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:16:16.643061 11510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9c607d0d1e744b6babe5fc93505013b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.644626 11649 tablet_bootstrap.cc:492] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8: No bootstrap required, opened a new log
I20260709 12:16:16.648984 11366 tablet_service.cc:1511] Processing CreateTablet for tablet b9c607d0d1e744b6babe5fc93505013b (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:16:16.650434 11366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9c607d0d1e744b6babe5fc93505013b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.653506 11592 tablet_service.cc:1511] Processing CreateTablet for tablet b9c607d0d1e744b6babe5fc93505013b (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:16:16.654891 11592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9c607d0d1e744b6babe5fc93505013b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.645220 11649 ts_tablet_manager.cc:1403] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8: Time spent bootstrapping tablet: real 0.142s	user 0.009s	sys 0.022s
I20260709 12:16:16.642095 11651 ts_tablet_manager.cc:1434] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d: Time spent starting tablet: real 0.159s	user 0.004s	sys 0.014s
I20260709 12:16:16.660921 11651 tablet_bootstrap.cc:492] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d: Bootstrap starting.
I20260709 12:16:16.666644 11440 tablet_service.cc:1511] Processing CreateTablet for tablet 183ead47e21645c289d90fbfe75fd319 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:16:16.668146 11440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 183ead47e21645c289d90fbfe75fd319. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.668004 11649 raft_consensus.cc:359] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:16.669100 11649 raft_consensus.cc:385] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:16.669521 11649 raft_consensus.cc:740] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Initialized, Role: FOLLOWER
I20260709 12:16:16.670435 11649 consensus_queue.cc:260] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:16.673352 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:16.674232 11454 raft_consensus.cc:2468] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 0.
I20260709 12:16:16.674614 11649 ts_tablet_manager.cc:1434] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:16:16.675784 11649 tablet_bootstrap.cc:492] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8: Bootstrap starting.
I20260709 12:16:16.679419 11646 tablet_bootstrap.cc:492] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de: No bootstrap required, opened a new log
I20260709 12:16:16.680012 11646 ts_tablet_manager.cc:1403] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.107s	user 0.014s	sys 0.015s
I20260709 12:16:16.682077 11647 tablet_bootstrap.cc:492] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671: No bootstrap required, opened a new log
I20260709 12:16:16.682785 11647 ts_tablet_manager.cc:1403] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671: Time spent bootstrapping tablet: real 0.215s	user 0.054s	sys 0.042s
I20260709 12:16:16.683719 11646 raft_consensus.cc:359] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:16.684630 11646 raft_consensus.cc:385] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:16.684976 11646 raft_consensus.cc:740] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:16.685832 11646 consensus_queue.cc:260] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:16.685933 11647 raft_consensus.cc:359] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:16.690187 11646 ts_tablet_manager.cc:1434] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 12:16:16.691354 11646 tablet_bootstrap.cc:492] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:16.691347 11491 leader_election.cc:304] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:16:16.692520 11654 raft_consensus.cc:2804] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:16.692904 11654 raft_consensus.cc:493] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:16.693250 11654 raft_consensus.cc:3060] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:16.698486 11649 tablet_bootstrap.cc:654] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:16.705829 11646 tablet_bootstrap.cc:654] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:16.711171 11514 tablet_service.cc:1511] Processing CreateTablet for tablet 183ead47e21645c289d90fbfe75fd319 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:16:16.712791 11514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 183ead47e21645c289d90fbfe75fd319. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.715366 11586 tablet_service.cc:1511] Processing CreateTablet for tablet 183ead47e21645c289d90fbfe75fd319 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:16:16.716804 11586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 183ead47e21645c289d90fbfe75fd319. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.718797 11651 tablet_bootstrap.cc:654] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:16.725927 11654 raft_consensus.cc:515] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:16.728493 11654 leader_election.cc:290] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:16.729261 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:16.729526 11647 raft_consensus.cc:385] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:16.730146 11454 raft_consensus.cc:3060] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:16.738246 11454 raft_consensus.cc:2468] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 1.
I20260709 12:16:16.730125 11647 raft_consensus.cc:740] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Initialized, Role: FOLLOWER
I20260709 12:16:16.739866 11491 leader_election.cc:304] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:16:16.740849 11647 consensus_queue.cc:260] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:16.744747 11654 raft_consensus.cc:2804] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:16.748955 11363 tablet_service.cc:1511] Processing CreateTablet for tablet 85a1c543b632476b909b2a5fb50e9f78 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:16:16.750499 11363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85a1c543b632476b909b2a5fb50e9f78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.751534 11442 tablet_service.cc:1511] Processing CreateTablet for tablet 85a1c543b632476b909b2a5fb50e9f78 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:16:16.752875 11442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85a1c543b632476b909b2a5fb50e9f78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.755990 11513 tablet_service.cc:1511] Processing CreateTablet for tablet 85a1c543b632476b909b2a5fb50e9f78 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:16:16.757792 11513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85a1c543b632476b909b2a5fb50e9f78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.765738 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:16.766261 11654 raft_consensus.cc:697] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 1 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:16:16.766927 11378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:16.767263 11654 consensus_queue.cc:237] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:16.768509 11656 raft_consensus.cc:493] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:16.769057 11656 raft_consensus.cc:515] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
W20260709 12:16:16.770797 11493 leader_election.cc:343] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:16.771905 11493 leader_election.cc:343] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:16.744333 11646 tablet_bootstrap.cc:492] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de: No bootstrap required, opened a new log
I20260709 12:16:16.774276 11646 ts_tablet_manager.cc:1403] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.083s	user 0.007s	sys 0.020s
I20260709 12:16:16.775801 11651 tablet_bootstrap.cc:492] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d: No bootstrap required, opened a new log
I20260709 12:16:16.776422 11651 ts_tablet_manager.cc:1403] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d: Time spent bootstrapping tablet: real 0.116s	user 0.009s	sys 0.003s
I20260709 12:16:16.777434 11656 leader_election.cc:290] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:16.779615 11651 raft_consensus.cc:359] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:16.784008 11651 raft_consensus.cc:385] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:16.784390 11651 raft_consensus.cc:740] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Initialized, Role: FOLLOWER
I20260709 12:16:16.785233 11651 consensus_queue.cc:260] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:16.786854 11646 raft_consensus.cc:359] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:16.790261 11651 ts_tablet_manager.cc:1434] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.004s
I20260709 12:16:16.791666 11646 raft_consensus.cc:385] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:16.792018 11646 raft_consensus.cc:740] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:16.792867 11651 tablet_bootstrap.cc:492] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d: Bootstrap starting.
I20260709 12:16:16.792778 11646 consensus_queue.cc:260] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:16.796355 11652 raft_consensus.cc:493] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:16.795656 11276 catalog_manager.cc:5697] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 0 to 1, leader changed from <none> to a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131). New cstate: current_term: 1 leader_uuid: "a03223e9e41247c3a36b7b7c3d476671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:16.796916 11652 raft_consensus.cc:515] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:16.798328 11646 ts_tablet_manager.cc:1434] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.004s
I20260709 12:16:16.799507 11646 tablet_bootstrap.cc:492] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:16.800577 11651 tablet_bootstrap.cc:654] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:16.802639 11652 leader_election.cc:290] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:16.812052 11646 tablet_bootstrap.cc:654] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:16.815541 11654 raft_consensus.cc:493] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:16.816220 11654 raft_consensus.cc:515] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:16.825484 11654 leader_election.cc:290] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:16.845119 11649 tablet_bootstrap.cc:492] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8: No bootstrap required, opened a new log
I20260709 12:16:16.845782 11649 ts_tablet_manager.cc:1403] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8: Time spent bootstrapping tablet: real 0.170s	user 0.022s	sys 0.042s
I20260709 12:16:16.857410 11647 ts_tablet_manager.cc:1434] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671: Time spent starting tablet: real 0.174s	user 0.015s	sys 0.001s
I20260709 12:16:16.860821 11647 tablet_bootstrap.cc:492] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671: Bootstrap starting.
I20260709 12:16:16.865790 11440 tablet_service.cc:1511] Processing CreateTablet for tablet 34d43eecbad746fd9ddce50c5b9fc3e8 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:16:16.849126 11649 raft_consensus.cc:359] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:16.870200 11649 raft_consensus.cc:385] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:16.870640 11649 raft_consensus.cc:740] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Initialized, Role: FOLLOWER
I20260709 12:16:16.871516 11649 consensus_queue.cc:260] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:16.873910 11649 ts_tablet_manager.cc:1434] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 12:16:16.882807 11649 tablet_bootstrap.cc:492] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8: Bootstrap starting.
I20260709 12:16:16.875020 11440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34d43eecbad746fd9ddce50c5b9fc3e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.883548 11515 tablet_service.cc:1511] Processing CreateTablet for tablet 45c355b3902a4e7fb72bac6a91ea3316 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:16:16.886507 11515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45c355b3902a4e7fb72bac6a91ea3316. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.900365 11649 tablet_bootstrap.cc:654] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:16.903499 11363 tablet_service.cc:1511] Processing CreateTablet for tablet 34d43eecbad746fd9ddce50c5b9fc3e8 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:16:16.903880 11366 tablet_service.cc:1511] Processing CreateTablet for tablet 45c355b3902a4e7fb72bac6a91ea3316 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:16:16.905429 11363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34d43eecbad746fd9ddce50c5b9fc3e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.907236 11589 tablet_service.cc:1511] Processing CreateTablet for tablet 34d43eecbad746fd9ddce50c5b9fc3e8 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:16:16.908677 11589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34d43eecbad746fd9ddce50c5b9fc3e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.908499 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:16.909454 11379 raft_consensus.cc:2468] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 0.
I20260709 12:16:16.910421 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:16.911053 11493 leader_election.cc:304] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:16.912114 11668 raft_consensus.cc:2804] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:16.912535 11668 raft_consensus.cc:493] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:16.912880 11668 raft_consensus.cc:3060] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:16.908354 11586 tablet_service.cc:1511] Processing CreateTablet for tablet 45c355b3902a4e7fb72bac6a91ea3316 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:16:16.914229 11586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45c355b3902a4e7fb72bac6a91ea3316. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.907151 11366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45c355b3902a4e7fb72bac6a91ea3316. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.920708 11442 tablet_service.cc:1511] Processing CreateTablet for tablet a5e58472d98540b986b1ed39edf597d4 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:16:16.922115 11442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5e58472d98540b986b1ed39edf597d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.927040 11668 raft_consensus.cc:515] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:16.930282 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:16.930683 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:16.930958 11379 raft_consensus.cc:3060] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:16.932420 11514 tablet_service.cc:1511] Processing CreateTablet for tablet a5e58472d98540b986b1ed39edf597d4 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:16:16.933842 11514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5e58472d98540b986b1ed39edf597d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.937562 11647 tablet_bootstrap.cc:654] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:16.943641 11379 raft_consensus.cc:2468] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 1.
I20260709 12:16:16.945190 11493 leader_election.cc:304] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:16.946144 11654 raft_consensus.cc:2804] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:16.946709 11654 raft_consensus.cc:697] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 1 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:16:16.947556 11654 consensus_queue.cc:237] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:16.958896 11646 tablet_bootstrap.cc:492] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de: No bootstrap required, opened a new log
I20260709 12:16:16.959594 11646 ts_tablet_manager.cc:1403] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.160s	user 0.010s	sys 0.005s
I20260709 12:16:16.971211 11646 raft_consensus.cc:359] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:16.972008 11646 raft_consensus.cc:385] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:16.972355 11646 raft_consensus.cc:740] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:16.973104 11646 consensus_queue.cc:260] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:16.975430 11646 ts_tablet_manager.cc:1434] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:16:16.971477 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:16.982659 11652 raft_consensus.cc:493] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:16.983222 11652 raft_consensus.cc:515] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:16.984481 11656 raft_consensus.cc:493] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:16.984704 11368 tablet_service.cc:1511] Processing CreateTablet for tablet e916ed5651f842f99af4ebb1748cd1bb (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:16:16.985114 11656 raft_consensus.cc:515] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:16.986243 11368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e916ed5651f842f99af4ebb1748cd1bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.987565 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:16.987834 11656 leader_election.cc:290] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:16:16.989501 11343 leader_election.cc:343] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:16.985749 11652 leader_election.cc:290] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:16.994616 11439 tablet_service.cc:1511] Processing CreateTablet for tablet 88412eb571b84fdc8d521a981be63bfa (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
W20260709 12:16:16.994673 11566 leader_election.cc:343] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:16.995663 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 69230.6us
I20260709 12:16:16.996138 11439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88412eb571b84fdc8d521a981be63bfa. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:16:16.996316 11565 leader_election.cc:343] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:16.982158 11646 tablet_bootstrap.cc:492] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:16.998831 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:16.995477 11513 tablet_service.cc:1511] Processing CreateTablet for tablet 88412eb571b84fdc8d521a981be63bfa (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:16:17.002233 11513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88412eb571b84fdc8d521a981be63bfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.002787 11592 tablet_service.cc:1511] Processing CreateTablet for tablet e916ed5651f842f99af4ebb1748cd1bb (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:16:17.003122 11586 tablet_service.cc:1511] Processing CreateTablet for tablet a5e58472d98540b986b1ed39edf597d4 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:16:17.004158 11592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e916ed5651f842f99af4ebb1748cd1bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.998852 11565 leader_election.cc:304] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:17.009789 11656 raft_consensus.cc:2749] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:17.012292 11366 tablet_service.cc:1511] Processing CreateTablet for tablet 88412eb571b84fdc8d521a981be63bfa (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:16:17.013731 11366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88412eb571b84fdc8d521a981be63bfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.012677 11275 catalog_manager.cc:5697] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 0 to 1, leader changed from <none> to a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131). New cstate: current_term: 1 leader_uuid: "a03223e9e41247c3a36b7b7c3d476671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:16.981578 11668 leader_election.cc:290] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:17.013645 11586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5e58472d98540b986b1ed39edf597d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.019909 11649 tablet_bootstrap.cc:492] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8: No bootstrap required, opened a new log
I20260709 12:16:17.020474 11649 ts_tablet_manager.cc:1403] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8: Time spent bootstrapping tablet: real 0.138s	user 0.030s	sys 0.007s
I20260709 12:16:17.023759 11649 raft_consensus.cc:359] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:17.024639 11649 raft_consensus.cc:385] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:17.025025 11649 raft_consensus.cc:740] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Initialized, Role: FOLLOWER
I20260709 12:16:17.025909 11649 consensus_queue.cc:260] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:17.028344 11649 ts_tablet_manager.cc:1434] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:16:17.029606 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:17.049407 11379 raft_consensus.cc:2393] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 1: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:16:17.050092 11649 tablet_bootstrap.cc:492] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8: Bootstrap starting.
I20260709 12:16:17.051017 11567 leader_election.cc:304] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:17.052573 11656 raft_consensus.cc:3060] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:17.030622 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 86036.8us
I20260709 12:16:17.017211 11646 tablet_bootstrap.cc:654] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:17.036417 11443 tablet_service.cc:1511] Processing CreateTablet for tablet e916ed5651f842f99af4ebb1748cd1bb (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:16:17.058599 11443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e916ed5651f842f99af4ebb1748cd1bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.059713 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:17.040143 11510 tablet_service.cc:1511] Processing CreateTablet for tablet 721df15d88f64a09bcaa4fe04a559f48 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:16:17.061473 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:17.062219 11510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 721df15d88f64a09bcaa4fe04a559f48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.041869 11651 tablet_bootstrap.cc:492] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d: No bootstrap required, opened a new log
I20260709 12:16:17.065838 11651 ts_tablet_manager.cc:1403] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d: Time spent bootstrapping tablet: real 0.273s	user 0.051s	sys 0.068s
I20260709 12:16:17.068213 11656 raft_consensus.cc:2749] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:17.042486 11364 tablet_service.cc:1511] Processing CreateTablet for tablet 721df15d88f64a09bcaa4fe04a559f48 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:16:17.070211 11364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 721df15d88f64a09bcaa4fe04a559f48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.044340 11584 tablet_service.cc:1511] Processing CreateTablet for tablet 721df15d88f64a09bcaa4fe04a559f48 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:16:17.073163 11584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 721df15d88f64a09bcaa4fe04a559f48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.044986 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:17.046734 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:17.083035 11342 leader_election.cc:304] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:17.082329 11600 raft_consensus.cc:2468] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 1.
I20260709 12:16:17.084450 11592 tablet_service.cc:1511] Processing CreateTablet for tablet 281f1a743bd44c27af6ace022a8a3ad1 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:16:17.085960 11592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 281f1a743bd44c27af6ace022a8a3ad1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.080013 11363 tablet_service.cc:1511] Processing CreateTablet for tablet 876bdec904324677a10f21ffbc21f5e3 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:16:17.087661 11363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 876bdec904324677a10f21ffbc21f5e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.069139 11651 raft_consensus.cc:359] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:17.090026 11651 raft_consensus.cc:385] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:17.095284 11652 raft_consensus.cc:2749] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:17.095127 11514 tablet_service.cc:1511] Processing CreateTablet for tablet 281f1a743bd44c27af6ace022a8a3ad1 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
W20260709 12:16:17.096064 11342 leader_election.cc:343] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:17.104323 11342 leader_election.cc:304] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:17.104861 11514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 281f1a743bd44c27af6ace022a8a3ad1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.106170 11652 raft_consensus.cc:2749] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:17.105885 11589 tablet_service.cc:1511] Processing CreateTablet for tablet cb7937e0cff84ef7a26c84247c8ffc08 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:16:17.109194 11589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb7937e0cff84ef7a26c84247c8ffc08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.098542 11515 tablet_service.cc:1511] Processing CreateTablet for tablet 876bdec904324677a10f21ffbc21f5e3 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:16:17.113576 11646 tablet_bootstrap.cc:492] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de: No bootstrap required, opened a new log
I20260709 12:16:17.114173 11646 ts_tablet_manager.cc:1403] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.136s	user 0.012s	sys 0.010s
I20260709 12:16:17.114312 11515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 876bdec904324677a10f21ffbc21f5e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.117556 11646 raft_consensus.cc:359] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:17.118432 11646 raft_consensus.cc:385] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:17.118782 11646 raft_consensus.cc:740] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:17.101773 11651 raft_consensus.cc:740] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Initialized, Role: FOLLOWER
I20260709 12:16:17.119602 11646 consensus_queue.cc:260] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:17.120551 11651 consensus_queue.cc:260] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:17.122432 11646 ts_tablet_manager.cc:1434] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:16:17.122779 11651 ts_tablet_manager.cc:1434] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.000s
I20260709 12:16:17.123582 11646 tablet_bootstrap.cc:492] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:17.124457 11442 tablet_service.cc:1511] Processing CreateTablet for tablet 281f1a743bd44c27af6ace022a8a3ad1 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:16:17.125873 11442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 281f1a743bd44c27af6ace022a8a3ad1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.132472 11368 tablet_service.cc:1511] Processing CreateTablet for tablet cb7937e0cff84ef7a26c84247c8ffc08 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:16:17.134956 11440 tablet_service.cc:1511] Processing CreateTablet for tablet cb7937e0cff84ef7a26c84247c8ffc08 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:16:17.135351 11439 tablet_service.cc:1511] Processing CreateTablet for tablet 876bdec904324677a10f21ffbc21f5e3 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:16:17.136475 11440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb7937e0cff84ef7a26c84247c8ffc08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.136879 11591 tablet_service.cc:1511] Processing CreateTablet for tablet 4abcb35dfa874d3f9cb851efa0baaea5 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:16:17.138341 11591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4abcb35dfa874d3f9cb851efa0baaea5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.139618 11511 tablet_service.cc:1511] Processing CreateTablet for tablet 4abcb35dfa874d3f9cb851efa0baaea5 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:16:17.141183 11511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4abcb35dfa874d3f9cb851efa0baaea5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.123677 11651 tablet_bootstrap.cc:492] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d: Bootstrap starting.
I20260709 12:16:17.149472 11646 tablet_bootstrap.cc:654] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:17.153007 11651 tablet_bootstrap.cc:654] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:17.151924 11368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb7937e0cff84ef7a26c84247c8ffc08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.162739 11652 raft_consensus.cc:493] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:17.163480 11659 raft_consensus.cc:493] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:17.164060 11659 raft_consensus.cc:515] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:17.163314 11652 raft_consensus.cc:515] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:17.167377 11652 leader_election.cc:290] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:17.168305 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffe47647c274723808482c166efa21c" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:17.169356 11659 leader_election.cc:290] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:17.179921 11652 raft_consensus.cc:493] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:17.180529 11652 raft_consensus.cc:515] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:17.183034 11652 leader_election.cc:290] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:17.179968 11649 tablet_bootstrap.cc:654] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:17.189134 11439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 876bdec904324677a10f21ffbc21f5e3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:16:17.212817 11342 leader_election.cc:343] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:17.214859 11647 tablet_bootstrap.cc:492] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671: No bootstrap required, opened a new log
I20260709 12:16:17.215804 11647 ts_tablet_manager.cc:1403] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671: Time spent bootstrapping tablet: real 0.355s	user 0.028s	sys 0.027s
I20260709 12:16:17.216692 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:16:17.218674 11342 leader_election.cc:343] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:17.219229 11647 raft_consensus.cc:359] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:17.220093 11647 raft_consensus.cc:385] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:17.220463 11647 raft_consensus.cc:740] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Initialized, Role: FOLLOWER
I20260709 12:16:17.214829 11651 tablet_bootstrap.cc:492] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d: No bootstrap required, opened a new log
I20260709 12:16:17.221575 11651 ts_tablet_manager.cc:1403] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d: Time spent bootstrapping tablet: real 0.098s	user 0.012s	sys 0.006s
I20260709 12:16:17.224910 11651 raft_consensus.cc:359] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
W20260709 12:16:17.228747 11493 consensus_peers.cc:597] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:17.225997 11647 consensus_queue.cc:260] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:17.231992 11363 tablet_service.cc:1511] Processing CreateTablet for tablet 4abcb35dfa874d3f9cb851efa0baaea5 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:16:17.233867 11363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4abcb35dfa874d3f9cb851efa0baaea5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.240093 11647 ts_tablet_manager.cc:1434] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.001s
I20260709 12:16:17.240532 11651 raft_consensus.cc:385] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:17.221633 11646 tablet_bootstrap.cc:492] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de: No bootstrap required, opened a new log
I20260709 12:16:17.245240 11646 ts_tablet_manager.cc:1403] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.122s	user 0.009s	sys 0.013s
I20260709 12:16:17.248929 11647 tablet_bootstrap.cc:492] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671: Bootstrap starting.
I20260709 12:16:17.251192 11646 raft_consensus.cc:359] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:17.252672 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffe47647c274723808482c166efa21c" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:17.254046 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:17.254750 11514 tablet_service.cc:1511] Processing CreateTablet for tablet 390e91331fd04f97a5235133a34875ee (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
W20260709 12:16:17.255991 11342 leader_election.cc:343] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:17.256701 11342 leader_election.cc:304] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:16:17.257552 11652 raft_consensus.cc:2749] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:17.259719 11646 raft_consensus.cc:385] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:17.260154 11646 raft_consensus.cc:740] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:17.244071 11651 raft_consensus.cc:740] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Initialized, Role: FOLLOWER
I20260709 12:16:17.262167 11656 raft_consensus.cc:493] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:17.256246 11514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 390e91331fd04f97a5235133a34875ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.267773 11442 tablet_service.cc:1511] Processing CreateTablet for tablet 390e91331fd04f97a5235133a34875ee (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:16:17.266944 11656 raft_consensus.cc:515] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:17.269326 11442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 390e91331fd04f97a5235133a34875ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.269721 11591 tablet_service.cc:1511] Processing CreateTablet for tablet 390e91331fd04f97a5235133a34875ee (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:16:17.271037 11591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 390e91331fd04f97a5235133a34875ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.278730 11647 tablet_bootstrap.cc:654] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:17.278496 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:17.278398 11652 raft_consensus.cc:493] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:17.279430 11379 raft_consensus.cc:2468] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 0.
I20260709 12:16:17.279489 11652 raft_consensus.cc:515] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:17.280642 11649 tablet_bootstrap.cc:492] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8: No bootstrap required, opened a new log
I20260709 12:16:17.281234 11649 ts_tablet_manager.cc:1403] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8: Time spent bootstrapping tablet: real 0.231s	user 0.009s	sys 0.017s
I20260709 12:16:17.281086 11567 leader_election.cc:304] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:17.282058 11652 leader_election.cc:290] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:17.283974 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:16:17.286157 11343 leader_election.cc:343] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:17.287704 11325 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:17.272308 11656 leader_election.cc:290] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:17.288930 11656 raft_consensus.cc:2804] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:17.289296 11656 raft_consensus.cc:493] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:17.289707 11656 raft_consensus.cc:3060] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:17.295274 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:17.295807 11363 tablet_service.cc:1511] Processing CreateTablet for tablet a690fb2f9e0548988bfefbe6ed3ab694 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:16:17.297096 11363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a690fb2f9e0548988bfefbe6ed3ab694. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.298105 11651 consensus_queue.cc:260] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:17.299387 11453 raft_consensus.cc:2468] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 0.
I20260709 12:16:17.300540 11440 tablet_service.cc:1511] Processing CreateTablet for tablet a690fb2f9e0548988bfefbe6ed3ab694 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:16:17.302030 11440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a690fb2f9e0548988bfefbe6ed3ab694. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.302380 11651 ts_tablet_manager.cc:1434] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d: Time spent starting tablet: real 0.080s	user 0.006s	sys 0.001s
I20260709 12:16:17.305058 11511 tablet_service.cc:1511] Processing CreateTablet for tablet a690fb2f9e0548988bfefbe6ed3ab694 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:16:17.306707 11511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a690fb2f9e0548988bfefbe6ed3ab694. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.310256 11651 tablet_bootstrap.cc:492] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d: Bootstrap starting.
I20260709 12:16:17.285187 11649 raft_consensus.cc:359] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:17.316629 11649 raft_consensus.cc:385] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:17.317005 11649 raft_consensus.cc:740] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Initialized, Role: FOLLOWER
I20260709 12:16:17.318233 11649 consensus_queue.cc:260] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:17.319446 11600 raft_consensus.cc:2468] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 0.
I20260709 12:16:17.321619 11342 leader_election.cc:304] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:17.321718 11589 tablet_service.cc:1511] Processing CreateTablet for tablet 2d78aaa911094df3ac90f175cd5c58fb (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:16:17.322881 11652 raft_consensus.cc:2804] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:17.323132 11589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d78aaa911094df3ac90f175cd5c58fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.323290 11652 raft_consensus.cc:493] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:17.323746 11652 raft_consensus.cc:3060] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:17.325210 11668 consensus_queue.cc:1048] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:17.327137 11646 consensus_queue.cc:260] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:17.328330 11659 raft_consensus.cc:493] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:17.329005 11659 raft_consensus.cc:515] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:17.328310 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:17.328611 11342 leader_election.cc:304] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:16:17.335636 11651 tablet_bootstrap.cc:654] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:17.335855 11659 leader_election.cc:290] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:17.340847 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:17.341571 11379 raft_consensus.cc:2468] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 0.
I20260709 12:16:17.332409 11453 raft_consensus.cc:2468] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 0.
I20260709 12:16:17.351405 11419 leader_election.cc:304] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:17.362150 11659 raft_consensus.cc:2804] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:17.362599 11659 raft_consensus.cc:493] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:17.361801 11439 tablet_service.cc:1511] Processing CreateTablet for tablet 2d78aaa911094df3ac90f175cd5c58fb (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:16:17.363054 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:17.363924 11528 raft_consensus.cc:2468] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 0.
W20260709 12:16:17.350211 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 69209.9us
I20260709 12:16:17.365290 11646 ts_tablet_manager.cc:1434] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.117s	user 0.008s	sys 0.000s
I20260709 12:16:17.366163 11418 leader_election.cc:304] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:16:17.366473 11646 tablet_bootstrap.cc:492] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:17.362955 11659 raft_consensus.cc:3060] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:17.362852 11696 raft_consensus.cc:2804] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:17.368160 11696 raft_consensus.cc:493] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:17.368516 11696 raft_consensus.cc:3060] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:17.371897 11656 raft_consensus.cc:515] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:17.372632 11439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d78aaa911094df3ac90f175cd5c58fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.379284 11646 tablet_bootstrap.cc:654] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:17.380308 11656 leader_election.cc:290] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:17.382788 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:17.379892 11659 raft_consensus.cc:515] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:17.377151 11696 raft_consensus.cc:515] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:17.387853 11379 raft_consensus.cc:3060] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:17.388818 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:17.389631 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:17.396070 11601 raft_consensus.cc:2468] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 0.
I20260709 12:16:17.398797 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:17.399736 11453 raft_consensus.cc:2393] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 1: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:16:17.391669 11656 raft_consensus.cc:493] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:17.402364 11600 raft_consensus.cc:2393] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 1: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:16:17.404090 11668 consensus_queue.cc:1048] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:17.404851 11647 tablet_bootstrap.cc:492] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671: No bootstrap required, opened a new log
I20260709 12:16:17.405438 11647 ts_tablet_manager.cc:1403] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671: Time spent bootstrapping tablet: real 0.157s	user 0.025s	sys 0.013s
I20260709 12:16:17.402484 11656 raft_consensus.cc:515] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:17.413369 11649 ts_tablet_manager.cc:1434] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8: Time spent starting tablet: real 0.132s	user 0.005s	sys 0.004s
I20260709 12:16:17.396850 11652 raft_consensus.cc:515] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:17.414796 11649 tablet_bootstrap.cc:492] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8: Bootstrap starting.
I20260709 12:16:17.416064 11698 raft_consensus.cc:2804] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:17.416580 11698 raft_consensus.cc:493] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:17.416981 11698 raft_consensus.cc:3060] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:17.417738 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
W20260709 12:16:17.419461 11343 leader_election.cc:343] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:17.422837 11659 leader_election.cc:290] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:17.423697 11377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:17.423849 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:17.424726 11600 raft_consensus.cc:2393] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 1: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:16:17.416679 11652 leader_election.cc:290] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:17.432655 11511 tablet_service.cc:1511] Processing CreateTablet for tablet 35be292dd086433e8b50b99e6f150395 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:16:17.434034 11511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35be292dd086433e8b50b99e6f150395. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.436192 11656 leader_election.cc:290] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:17.434041 11591 tablet_service.cc:1511] Processing CreateTablet for tablet 35be292dd086433e8b50b99e6f150395 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:16:17.436964 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:17.438025 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:17.438637 11647 raft_consensus.cc:359] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:17.439185 11668 consensus_queue.cc:1048] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:16:17.442268 11566 leader_election.cc:343] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:17.443655 11565 leader_election.cc:343] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:17.444298 11565 leader_election.cc:304] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:17.445550 11417 leader_election.cc:304] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:17.446005 11656 raft_consensus.cc:2749] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:17.446473 11659 raft_consensus.cc:2749] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:16:17.439447 11647 raft_consensus.cc:385] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:17.438825 11591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35be292dd086433e8b50b99e6f150395. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.450440 11647 raft_consensus.cc:740] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Initialized, Role: FOLLOWER
W20260709 12:16:17.450336 11342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 121822us
I20260709 12:16:17.460448 11696 leader_election.cc:290] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:17.472050 11651 tablet_bootstrap.cc:492] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d: No bootstrap required, opened a new log
I20260709 12:16:17.472318 11584 tablet_service.cc:1511] Processing CreateTablet for tablet da8741606df54c3f8b5cc5c1141862ea (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:16:17.471494 11510 tablet_service.cc:1511] Processing CreateTablet for tablet da8741606df54c3f8b5cc5c1141862ea (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:16:17.473745 11584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da8741606df54c3f8b5cc5c1141862ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.472788 11651 ts_tablet_manager.cc:1403] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d: Time spent bootstrapping tablet: real 0.163s	user 0.011s	sys 0.005s
I20260709 12:16:17.472379 11440 tablet_service.cc:1511] Processing CreateTablet for tablet da8741606df54c3f8b5cc5c1141862ea (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:16:17.478374 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:17.479280 11601 raft_consensus.cc:3060] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:17.479456 11440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da8741606df54c3f8b5cc5c1141862ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.473847 11510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da8741606df54c3f8b5cc5c1141862ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.484205 11651 raft_consensus.cc:359] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:17.484910 11651 raft_consensus.cc:385] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:17.485154 11651 raft_consensus.cc:740] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Initialized, Role: FOLLOWER
I20260709 12:16:17.485883 11651 consensus_queue.cc:260] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:17.488323 11651 ts_tablet_manager.cc:1434] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.000s
I20260709 12:16:17.510830 11601 raft_consensus.cc:2468] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 1.
I20260709 12:16:17.527272 11646 tablet_bootstrap.cc:492] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de: No bootstrap required, opened a new log
I20260709 12:16:17.527920 11646 ts_tablet_manager.cc:1403] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.162s	user 0.013s	sys 0.005s
I20260709 12:16:17.504230 11647 consensus_queue.cc:260] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:17.537477 11651 tablet_bootstrap.cc:492] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d: Bootstrap starting.
I20260709 12:16:17.550806 11363 tablet_service.cc:1511] Processing CreateTablet for tablet 2d78aaa911094df3ac90f175cd5c58fb (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:16:17.551874 11363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d78aaa911094df3ac90f175cd5c58fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.560484 11514 tablet_service.cc:1511] Processing CreateTablet for tablet a34e69406a86484482230bfec0edfcfa (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:16:17.562053 11514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a34e69406a86484482230bfec0edfcfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.561589 11443 tablet_service.cc:1511] Processing CreateTablet for tablet a34e69406a86484482230bfec0edfcfa (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:16:17.552961 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:17.559505 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:17.568058 11586 tablet_service.cc:1511] Processing CreateTablet for tablet 1d2554b9de634e0daa5c0257a1821025 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:16:17.569284 11443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a34e69406a86484482230bfec0edfcfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.569865 11646 raft_consensus.cc:359] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:17.572975 11646 raft_consensus.cc:385] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:17.573305 11646 raft_consensus.cc:740] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:17.575876 11646 consensus_queue.cc:260] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:17.579092 11646 ts_tablet_manager.cc:1434] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.000s
I20260709 12:16:17.574218 11453 raft_consensus.cc:3060] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:17.570438 11368 tablet_service.cc:1511] Processing CreateTablet for tablet 35be292dd086433e8b50b99e6f150395 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:16:17.566715 11379 raft_consensus.cc:2468] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 1.
I20260709 12:16:17.587168 11363 tablet_service.cc:1511] Processing CreateTablet for tablet a34e69406a86484482230bfec0edfcfa (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:16:17.588835 11363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a34e69406a86484482230bfec0edfcfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.599486 11586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d2554b9de634e0daa5c0257a1821025. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.599550 11567 leader_election.cc:304] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d
I20260709 12:16:17.602677 11656 raft_consensus.cc:2804] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:17.603206 11656 raft_consensus.cc:697] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:17.604043 11656 consensus_queue.cc:237] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:17.606467 11368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35be292dd086433e8b50b99e6f150395. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.609485 11436 tablet_service.cc:1511] Processing CreateTablet for tablet 1d2554b9de634e0daa5c0257a1821025 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:16:17.611019 11436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d2554b9de634e0daa5c0257a1821025. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.595942 11649 tablet_bootstrap.cc:654] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:17.616298 11646 tablet_bootstrap.cc:492] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:17.615908 11342 leader_election.cc:304] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:17.618129 11696 raft_consensus.cc:2804] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:17.618649 11696 raft_consensus.cc:697] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 1 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:16:17.619483 11696 consensus_queue.cc:237] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
W20260709 12:16:17.623746 11342 leader_election.cc:343] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:17.629058 11363 tablet_service.cc:1511] Processing CreateTablet for tablet 1d2554b9de634e0daa5c0257a1821025 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:16:17.632380 11363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d2554b9de634e0daa5c0257a1821025. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.640086 11698 raft_consensus.cc:515] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:17.646860 11277 catalog_manager.cc:5697] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 1 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:17.649890 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:17.650610 11601 raft_consensus.cc:3060] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:17.656091 11698 leader_election.cc:290] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:17.671643 11511 tablet_service.cc:1511] Processing CreateTablet for tablet 381fa277bb844a948c90100e03a4059a (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:16:17.673276 11511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 381fa277bb844a948c90100e03a4059a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.679795 11651 tablet_bootstrap.cc:654] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:17.662248 11453 raft_consensus.cc:2468] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 1.
I20260709 12:16:17.706275 11342 leader_election.cc:304] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:16:17.708284 11696 raft_consensus.cc:2804] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:17.708859 11696 raft_consensus.cc:697] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 1 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:16:17.709208 11591 tablet_service.cc:1511] Processing CreateTablet for tablet 381fa277bb844a948c90100e03a4059a (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:16:17.710139 11710 raft_consensus.cc:493] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:17.710701 11591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 381fa277bb844a948c90100e03a4059a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.710988 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:17.711606 11528 raft_consensus.cc:3060] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:17.711887 11647 ts_tablet_manager.cc:1434] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671: Time spent starting tablet: real 0.306s	user 0.024s	sys 0.005s
I20260709 12:16:17.713101 11647 tablet_bootstrap.cc:492] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671: Bootstrap starting.
I20260709 12:16:17.699980 11652 raft_consensus.cc:493] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:17.709797 11696 consensus_queue.cc:237] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:17.717746 11378 raft_consensus.cc:3060] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:17.729780 11364 tablet_service.cc:1511] Processing CreateTablet for tablet 381fa277bb844a948c90100e03a4059a (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:16:17.731493 11364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 381fa277bb844a948c90100e03a4059a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.715432 11652 raft_consensus.cc:515] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:17.743541 11652 leader_election.cc:290] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:17.744899 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:17.746061 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
W20260709 12:16:17.748641 11342 leader_election.cc:343] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:17.749565 11646 tablet_bootstrap.cc:654] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:17.750880 11647 tablet_bootstrap.cc:654] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:17.755311 11436 tablet_service.cc:1511] Processing CreateTablet for tablet 773ed4105356479c90eb937ef6da81a5 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:16:17.756235 11528 raft_consensus.cc:2468] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 1.
I20260709 12:16:17.756755 11436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 773ed4105356479c90eb937ef6da81a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.757665 11418 leader_election.cc:304] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:16:17.758620 11698 raft_consensus.cc:2804] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:17.759158 11698 raft_consensus.cc:697] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 1 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:16:17.759680 11589 tablet_service.cc:1511] Processing CreateTablet for tablet 773ed4105356479c90eb937ef6da81a5 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:16:17.760016 11698 consensus_queue.cc:237] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:17.761194 11589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 773ed4105356479c90eb937ef6da81a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.710671 11710 raft_consensus.cc:515] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:17.763646 11710 leader_election.cc:290] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:17.764573 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:17.764842 11527 raft_consensus.cc:2468] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 0.
I20260709 12:16:17.765367 11379 raft_consensus.cc:2468] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 0.
I20260709 12:16:17.766873 11493 leader_election.cc:304] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:17.767624 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:17.771318 11343 leader_election.cc:304] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d
I20260709 12:16:17.772222 11710 raft_consensus.cc:2804] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:17.757695 11514 tablet_service.cc:1511] Processing CreateTablet for tablet 773ed4105356479c90eb937ef6da81a5 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:16:17.772733 11710 raft_consensus.cc:493] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:17.773846 11514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 773ed4105356479c90eb937ef6da81a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.772686 11652 raft_consensus.cc:2804] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:17.776290 11710 raft_consensus.cc:3060] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:17.777658 11363 tablet_service.cc:1511] Processing CreateTablet for tablet 50204b9643974af9a0505210d261ee78 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:16:17.778805 11363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50204b9643974af9a0505210d261ee78. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:16:17.781836 11491 leader_election.cc:343] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:17.772294 11649 tablet_bootstrap.cc:492] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8: No bootstrap required, opened a new log
I20260709 12:16:17.792377 11649 ts_tablet_manager.cc:1403] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8: Time spent bootstrapping tablet: real 0.378s	user 0.014s	sys 0.007s
I20260709 12:16:17.795367 11651 tablet_bootstrap.cc:492] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d: No bootstrap required, opened a new log
I20260709 12:16:17.795954 11651 ts_tablet_manager.cc:1403] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d: Time spent bootstrapping tablet: real 0.274s	user 0.018s	sys 0.015s
I20260709 12:16:17.797978 11649 raft_consensus.cc:359] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:17.798804 11649 raft_consensus.cc:385] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:17.799014 11651 raft_consensus.cc:359] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:17.799789 11651 raft_consensus.cc:385] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:17.800266 11651 raft_consensus.cc:740] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Initialized, Role: FOLLOWER
I20260709 12:16:17.777652 11652 raft_consensus.cc:493] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:17.801069 11651 consensus_queue.cc:260] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:17.807979 11651 ts_tablet_manager.cc:1434] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:16:17.807372 11274 catalog_manager.cc:5697] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 0 to 1, leader changed from <none> to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 1 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:17.809170 11651 tablet_bootstrap.cc:492] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d: Bootstrap starting.
I20260709 12:16:17.811012 11443 tablet_service.cc:1511] Processing CreateTablet for tablet 50204b9643974af9a0505210d261ee78 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:16:17.812160 11652 raft_consensus.cc:3060] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:17.802583 11649 raft_consensus.cc:740] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Initialized, Role: FOLLOWER
I20260709 12:16:17.825508 11443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50204b9643974af9a0505210d261ee78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.825563 11510 tablet_service.cc:1511] Processing CreateTablet for tablet 50204b9643974af9a0505210d261ee78 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:16:17.826354 11659 raft_consensus.cc:493] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:17.838349 11510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50204b9643974af9a0505210d261ee78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.819075 11601 raft_consensus.cc:2468] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 1.
I20260709 12:16:17.837886 11659 raft_consensus.cc:515] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:17.830909 11646 tablet_bootstrap.cc:492] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de: No bootstrap required, opened a new log
I20260709 12:16:17.847318 11584 tablet_service.cc:1511] Processing CreateTablet for tablet 193e9917816a4990998188f9a4e9d08c (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:16:17.847849 11368 tablet_service.cc:1511] Processing CreateTablet for tablet 193e9917816a4990998188f9a4e9d08c (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:16:17.849098 11368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 193e9917816a4990998188f9a4e9d08c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.848708 11440 tablet_service.cc:1511] Processing CreateTablet for tablet 193e9917816a4990998188f9a4e9d08c (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:16:17.850307 11440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 193e9917816a4990998188f9a4e9d08c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.850523 11659 leader_election.cc:290] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:17.840410 11646 ts_tablet_manager.cc:1403] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.225s	user 0.002s	sys 0.012s
I20260709 12:16:17.848767 11584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 193e9917816a4990998188f9a4e9d08c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.855304 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:16:17.857858 11417 leader_election.cc:343] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:17.842006 11651 tablet_bootstrap.cc:654] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:17.865803 11649 consensus_queue.cc:260] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:17.877720 11649 ts_tablet_manager.cc:1434] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8: Time spent starting tablet: real 0.083s	user 0.003s	sys 0.005s
I20260709 12:16:17.878816 11649 tablet_bootstrap.cc:492] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8: Bootstrap starting.
I20260709 12:16:17.871470 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:16:17.881776 11418 leader_election.cc:343] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:17.882319 11418 leader_election.cc:304] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:17.881546 11514 tablet_service.cc:1511] Processing CreateTablet for tablet 2b52025153e440eebdadbe35d49837ff (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:16:17.885114 11514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b52025153e440eebdadbe35d49837ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.889329 11700 raft_consensus.cc:493] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:16:17.889945 11700 raft_consensus.cc:515] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:17.885172 11659 raft_consensus.cc:2749] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:17.892616 11586 tablet_service.cc:1511] Processing CreateTablet for tablet 2b52025153e440eebdadbe35d49837ff (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:16:17.892794 11363 tablet_service.cc:1511] Processing CreateTablet for tablet 2b52025153e440eebdadbe35d49837ff (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:16:17.894003 11363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b52025153e440eebdadbe35d49837ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.903410 11647 tablet_bootstrap.cc:492] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671: No bootstrap required, opened a new log
I20260709 12:16:17.863399 11710 raft_consensus.cc:515] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:17.903668 11646 raft_consensus.cc:359] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:17.907932 11646 raft_consensus.cc:385] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:17.908494 11646 raft_consensus.cc:740] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:17.906615 11700 leader_election.cc:290] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:17.907281 11586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b52025153e440eebdadbe35d49837ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.910971 11646 consensus_queue.cc:260] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:17.904038 11647 ts_tablet_manager.cc:1403] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671: Time spent bootstrapping tablet: real 0.191s	user 0.032s	sys 0.006s
I20260709 12:16:17.910351 11659 raft_consensus.cc:493] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:17.918264 11647 raft_consensus.cc:359] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:17.919054 11647 raft_consensus.cc:385] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:17.919313 11647 raft_consensus.cc:740] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Initialized, Role: FOLLOWER
I20260709 12:16:17.919987 11647 consensus_queue.cc:260] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:17.912982 11277 catalog_manager.cc:5697] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 1 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:17.914413 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:17.907473 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:17.914410 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:17.924454 11342 leader_election.cc:304] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:17.931799 11511 tablet_service.cc:1511] Processing CreateTablet for tablet cdf8217c2b5b47f68e62de34bb95e95d (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:16:17.933324 11511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdf8217c2b5b47f68e62de34bb95e95d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.936275 11436 tablet_service.cc:1511] Processing CreateTablet for tablet cdf8217c2b5b47f68e62de34bb95e95d (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:16:17.939565 11591 tablet_service.cc:1511] Processing CreateTablet for tablet cdf8217c2b5b47f68e62de34bb95e95d (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:16:17.941695 11591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdf8217c2b5b47f68e62de34bb95e95d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.941819 11696 raft_consensus.cc:2749] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:17.918414 11659 raft_consensus.cc:515] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:17.946939 11377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:17.947667 11377 raft_consensus.cc:2468] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 0.
I20260709 12:16:17.949301 11419 leader_election.cc:304] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:17.951249 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
W20260709 12:16:17.952811 11491 leader_election.cc:343] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:17.953001 11698 raft_consensus.cc:2804] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:17.953482 11698 raft_consensus.cc:493] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:17.953858 11698 raft_consensus.cc:3060] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:17.958400 11659 leader_election.cc:290] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:17.959055 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:17.959795 11528 raft_consensus.cc:2468] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 0.
I20260709 12:16:17.964160 11649 tablet_bootstrap.cc:654] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:17.949536 11710 leader_election.cc:290] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:17.966817 11647 ts_tablet_manager.cc:1434] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.000s
I20260709 12:16:17.966811 11436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdf8217c2b5b47f68e62de34bb95e95d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.967808 11651 tablet_bootstrap.cc:492] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d: No bootstrap required, opened a new log
I20260709 12:16:17.968330 11651 ts_tablet_manager.cc:1403] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d: Time spent bootstrapping tablet: real 0.159s	user 0.015s	sys 0.015s
I20260709 12:16:17.970023 11647 tablet_bootstrap.cc:492] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671: Bootstrap starting.
I20260709 12:16:17.973594 11443 tablet_service.cc:1511] Processing CreateTablet for tablet cc18a67cc3d24753b2677d72cfee35b4 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:16:17.974917 11652 raft_consensus.cc:515] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:17.976346 11379 raft_consensus.cc:2393] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 1: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:16:17.978367 11493 leader_election.cc:304] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:17.980350 11710 raft_consensus.cc:2749] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:16:17.980798 11589 tablet_service.cc:1511] Processing CreateTablet for tablet 167448b175c040d180318f81f6d10c8d (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:16:17.982570 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:17.983440 11528 raft_consensus.cc:2393] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 1: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:16:17.983026 11651 raft_consensus.cc:359] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:17.983843 11651 raft_consensus.cc:385] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:17.984181 11651 raft_consensus.cc:740] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Initialized, Role: FOLLOWER
I20260709 12:16:17.983996 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:17.975013 11443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc18a67cc3d24753b2677d72cfee35b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.982074 11698 raft_consensus.cc:515] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:17.985651 11363 tablet_service.cc:1511] Processing CreateTablet for tablet 167448b175c040d180318f81f6d10c8d (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
W20260709 12:16:17.986294 11342 leader_election.cc:343] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:17.986884 11363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 167448b175c040d180318f81f6d10c8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.986766 11342 leader_election.cc:304] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:17.988622 11368 tablet_service.cc:1511] Processing CreateTablet for tablet cc18a67cc3d24753b2677d72cfee35b4 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:16:17.982091 11589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 167448b175c040d180318f81f6d10c8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.990028 11368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc18a67cc3d24753b2677d72cfee35b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.993669 11700 raft_consensus.cc:2749] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:16:17.996743 11646 ts_tablet_manager.cc:1434] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.144s	user 0.006s	sys 0.001s
I20260709 12:16:17.984350 11277 catalog_manager.cc:5697] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 0 to 1, leader changed from <none> to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 1 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:18.000484 11439 tablet_service.cc:1511] Processing CreateTablet for tablet 167448b175c040d180318f81f6d10c8d (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:16:18.001945 11439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 167448b175c040d180318f81f6d10c8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.002241 11514 tablet_service.cc:1511] Processing CreateTablet for tablet cc18a67cc3d24753b2677d72cfee35b4 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:16:18.013994 11646 tablet_bootstrap.cc:492] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:18.016598 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:17.985039 11651 consensus_queue.cc:260] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:18.017398 11379 raft_consensus.cc:3060] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.019670 11514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc18a67cc3d24753b2677d72cfee35b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.028069 11379 raft_consensus.cc:2468] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 1.
W20260709 12:16:18.028779 11343 consensus_peers.cc:597] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de -> Peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Couldn't send request to peer a03223e9e41247c3a36b7b7c3d476671. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:18.030162 11419 leader_election.cc:304] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:18.031142 11659 raft_consensus.cc:2804] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:18.032232 11510 tablet_service.cc:1511] Processing CreateTablet for tablet 9a3a6ef0117045b19d2915baab58e53f (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:16:18.020300 11652 leader_election.cc:290] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:18.033624 11510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a3a6ef0117045b19d2915baab58e53f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.035066 11651 ts_tablet_manager.cc:1434] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d: Time spent starting tablet: real 0.066s	user 0.005s	sys 0.005s
I20260709 12:16:18.042393 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:18.043159 11528 raft_consensus.cc:3060] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.049865 11651 tablet_bootstrap.cc:492] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d: Bootstrap starting.
I20260709 12:16:18.052644 11656 consensus_queue.cc:1048] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:18.064996 11646 tablet_bootstrap.cc:654] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.065423 11649 tablet_bootstrap.cc:492] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8: No bootstrap required, opened a new log
I20260709 12:16:18.065717 11659 raft_consensus.cc:697] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 1 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:16:18.066016 11649 ts_tablet_manager.cc:1403] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8: Time spent bootstrapping tablet: real 0.187s	user 0.008s	sys 0.004s
I20260709 12:16:18.066759 11659 consensus_queue.cc:237] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:18.067178 11698 leader_election.cc:290] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:18.085268 11528 raft_consensus.cc:2468] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 1.
I20260709 12:16:18.086709 11363 tablet_service.cc:1511] Processing CreateTablet for tablet 9a3a6ef0117045b19d2915baab58e53f (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:16:18.087970 11363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a3a6ef0117045b19d2915baab58e53f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.092850 11651 tablet_bootstrap.cc:654] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.097744 11649 raft_consensus.cc:359] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:18.098730 11649 raft_consensus.cc:385] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.099046 11649 raft_consensus.cc:740] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.100638 11647 tablet_bootstrap.cc:654] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.102416 11591 tablet_service.cc:1511] Processing CreateTablet for tablet 9a3a6ef0117045b19d2915baab58e53f (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:16:18.108289 11652 consensus_queue.cc:1048] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:16:18.107383 11440 tablet_service.cc:1511] Processing CreateTablet for tablet 2ec97657dc1d40eeb0b7a225b412300f (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:16:18.111179 11591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a3a6ef0117045b19d2915baab58e53f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.112108 11649 consensus_queue.cc:260] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:18.113405 11589 tablet_service.cc:1511] Processing CreateTablet for tablet 2ec97657dc1d40eeb0b7a225b412300f (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:16:18.115302 11510 tablet_service.cc:1511] Processing CreateTablet for tablet 2ec97657dc1d40eeb0b7a225b412300f (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:16:18.118911 11440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ec97657dc1d40eeb0b7a225b412300f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.122116 11510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ec97657dc1d40eeb0b7a225b412300f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.122510 11589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ec97657dc1d40eeb0b7a225b412300f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.126658 11363 tablet_service.cc:1511] Processing CreateTablet for tablet 4d8592bdb30445228c429e3c55360c25 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:16:18.132807 11277 catalog_manager.cc:5697] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 1 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:18.137145 11697 consensus_queue.cc:1048] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:18.140887 11649 ts_tablet_manager.cc:1434] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8: Time spent starting tablet: real 0.074s	user 0.007s	sys 0.002s
I20260709 12:16:18.142220 11649 tablet_bootstrap.cc:492] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8: Bootstrap starting.
I20260709 12:16:18.145788 11584 tablet_service.cc:1511] Processing CreateTablet for tablet 2aaa267a7b85487a991ce0600309cac0 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:16:18.147270 11584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2aaa267a7b85487a991ce0600309cac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.149906 11514 tablet_service.cc:1511] Processing CreateTablet for tablet 4d8592bdb30445228c429e3c55360c25 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:16:18.151096 11646 tablet_bootstrap.cc:492] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de: No bootstrap required, opened a new log
I20260709 12:16:18.151703 11646 ts_tablet_manager.cc:1403] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.138s	user 0.031s	sys 0.009s
I20260709 12:16:18.151296 11514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d8592bdb30445228c429e3c55360c25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.160811 11659 consensus_queue.cc:1048] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:18.164353 11363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d8592bdb30445228c429e3c55360c25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.166616 11436 tablet_service.cc:1511] Processing CreateTablet for tablet 4d8592bdb30445228c429e3c55360c25 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:16:18.168260 11436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d8592bdb30445228c429e3c55360c25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.166679 11646 raft_consensus.cc:359] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:18.170455 11646 raft_consensus.cc:385] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.171365 11646 raft_consensus.cc:740] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.172646 11646 consensus_queue.cc:260] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:18.177713 11368 tablet_service.cc:1511] Processing CreateTablet for tablet 2aaa267a7b85487a991ce0600309cac0 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:16:18.180218 11439 tablet_service.cc:1511] Processing CreateTablet for tablet 2aaa267a7b85487a991ce0600309cac0 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:16:18.182345 11511 tablet_service.cc:1511] Processing CreateTablet for tablet da6f4e0d7b894d0581c87d020e67b559 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:16:18.183620 11511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da6f4e0d7b894d0581c87d020e67b559. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.183449 11439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2aaa267a7b85487a991ce0600309cac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.185526 11368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2aaa267a7b85487a991ce0600309cac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.188330 11649 tablet_bootstrap.cc:654] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.188994 11646 ts_tablet_manager.cc:1434] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.037s	user 0.004s	sys 0.004s
I20260709 12:16:18.193063 11647 tablet_bootstrap.cc:492] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671: No bootstrap required, opened a new log
I20260709 12:16:18.203127 11646 tablet_bootstrap.cc:492] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:18.210494 11647 ts_tablet_manager.cc:1403] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671: Time spent bootstrapping tablet: real 0.243s	user 0.015s	sys 0.006s
I20260709 12:16:18.233215 11735 raft_consensus.cc:493] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.233826 11735 raft_consensus.cc:515] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:18.236059 11735 leader_election.cc:290] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:18.244642 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:18.249104 11378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:18.259500 11378 raft_consensus.cc:2468] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 0.
I20260709 12:16:18.261814 11567 leader_election.cc:304] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:18.262753 11735 raft_consensus.cc:2804] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:18.263144 11735 raft_consensus.cc:493] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:18.263499 11700 consensus_queue.cc:1048] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:18.245096 11647 raft_consensus.cc:359] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:18.268209 11647 raft_consensus.cc:385] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.268680 11647 raft_consensus.cc:740] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.245044 11591 tablet_service.cc:1511] Processing CreateTablet for tablet da6f4e0d7b894d0581c87d020e67b559 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:16:18.255906 11440 tablet_service.cc:1511] Processing CreateTablet for tablet e7e4724ed93a467ea47763eec9a6de2e (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:16:18.265604 11646 tablet_bootstrap.cc:654] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.274225 11368 tablet_service.cc:1511] Processing CreateTablet for tablet da6f4e0d7b894d0581c87d020e67b559 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:16:18.273394 11440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7e4724ed93a467ea47763eec9a6de2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.271844 11584 tablet_service.cc:1511] Processing CreateTablet for tablet e7e4724ed93a467ea47763eec9a6de2e (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:16:18.263513 11735 raft_consensus.cc:3060] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.275561 11368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da6f4e0d7b894d0581c87d020e67b559. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.258322 11510 tablet_service.cc:1511] Processing CreateTablet for tablet e7e4724ed93a467ea47763eec9a6de2e (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:16:18.276865 11651 tablet_bootstrap.cc:492] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d: No bootstrap required, opened a new log
I20260709 12:16:18.285878 11651 ts_tablet_manager.cc:1403] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d: Time spent bootstrapping tablet: real 0.237s	user 0.026s	sys 0.014s
I20260709 12:16:18.286242 11510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7e4724ed93a467ea47763eec9a6de2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.290297 11591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da6f4e0d7b894d0581c87d020e67b559. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.289786 11647 consensus_queue.cc:260] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:18.292627 11647 ts_tablet_manager.cc:1434] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671: Time spent starting tablet: real 0.065s	user 0.006s	sys 0.000s
I20260709 12:16:18.293874 11527 raft_consensus.cc:2468] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 0.
I20260709 12:16:18.295220 11697 raft_consensus.cc:493] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.295790 11697 raft_consensus.cc:515] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:18.303269 11584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7e4724ed93a467ea47763eec9a6de2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.303071 11439 tablet_service.cc:1511] Processing CreateTablet for tablet f1589b98714c45ef8ed01287d13b8252 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:16:18.304461 11439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1589b98714c45ef8ed01287d13b8252. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.310879 11363 tablet_service.cc:1511] Processing CreateTablet for tablet f1589b98714c45ef8ed01287d13b8252 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:16:18.312711 11363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1589b98714c45ef8ed01287d13b8252. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.305646 11730 raft_consensus.cc:493] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.322235 11730 raft_consensus.cc:515] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:18.324522 11730 leader_election.cc:290] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:18.325836 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:18.326386 11514 tablet_service.cc:1511] Processing CreateTablet for tablet f1589b98714c45ef8ed01287d13b8252 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:16:18.327638 11514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1589b98714c45ef8ed01287d13b8252. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:16:18.327699 11418 leader_election.cc:343] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:18.326038 11378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:18.328768 11378 raft_consensus.cc:2468] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 0.
W20260709 12:16:18.331040 11325 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:18.333462 11419 leader_election.cc:304] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:18.334957 11698 raft_consensus.cc:2804] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:18.335392 11698 raft_consensus.cc:493] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:18.335719 11698 raft_consensus.cc:3060] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.338722 11697 leader_election.cc:290] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:18.343995 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:16:18.349354 11566 leader_election.cc:343] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:18.351169 11730 consensus_queue.cc:1048] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:18.351987 11589 tablet_service.cc:1511] Processing CreateTablet for tablet a841f2f09ced40a4bbf33594e11bd7ad (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:16:18.352754 11649 tablet_bootstrap.cc:492] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8: No bootstrap required, opened a new log
I20260709 12:16:18.353281 11649 ts_tablet_manager.cc:1403] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8: Time spent bootstrapping tablet: real 0.211s	user 0.018s	sys 0.001s
I20260709 12:16:18.353226 11589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a841f2f09ced40a4bbf33594e11bd7ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.360045 11649 raft_consensus.cc:359] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:18.360760 11649 raft_consensus.cc:385] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.361040 11649 raft_consensus.cc:740] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.361553 11647 tablet_bootstrap.cc:492] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671: Bootstrap starting.
I20260709 12:16:18.363541 11651 raft_consensus.cc:359] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:18.364377 11651 raft_consensus.cc:385] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.364655 11651 raft_consensus.cc:740] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Initialized, Role: FOLLOWER
W20260709 12:16:18.365778 11342 consensus_peers.cc:597] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de -> Peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973): Couldn't send request to peer 9da53be18b0f446aaa406216e20b0ec8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:18.366941 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:18.365504 11649 consensus_queue.cc:260] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:18.367779 11453 raft_consensus.cc:2468] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 0.
I20260709 12:16:18.369123 11565 leader_election.cc:304] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:18.369598 11649 ts_tablet_manager.cc:1434] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:16:18.369781 11735 raft_consensus.cc:515] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:18.370301 11697 raft_consensus.cc:2804] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:18.370851 11697 raft_consensus.cc:493] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:18.371234 11697 raft_consensus.cc:3060] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.372189 11735 leader_election.cc:290] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:18.373504 11378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:18.374141 11378 raft_consensus.cc:3060] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.378778 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:18.379472 11528 raft_consensus.cc:3060] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.384958 11647 tablet_bootstrap.cc:654] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.385231 11378 raft_consensus.cc:2468] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 1.
I20260709 12:16:18.365332 11651 consensus_queue.cc:260] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:18.386482 11649 tablet_bootstrap.cc:492] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8: Bootstrap starting.
I20260709 12:16:18.387492 11364 tablet_service.cc:1511] Processing CreateTablet for tablet a841f2f09ced40a4bbf33594e11bd7ad (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:16:18.413115 11567 leader_election.cc:304] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:18.413605 11364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a841f2f09ced40a4bbf33594e11bd7ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.414022 11656 raft_consensus.cc:2804] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:18.389887 11698 raft_consensus.cc:515] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:18.403545 11646 tablet_bootstrap.cc:492] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de: No bootstrap required, opened a new log
I20260709 12:16:18.418118 11646 ts_tablet_manager.cc:1403] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.215s	user 0.014s	sys 0.002s
I20260709 12:16:18.405495 11436 tablet_service.cc:1511] Processing CreateTablet for tablet a841f2f09ced40a4bbf33594e11bd7ad (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:16:18.422430 11436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a841f2f09ced40a4bbf33594e11bd7ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.423311 11378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:18.423965 11378 raft_consensus.cc:3060] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.422539 11698 leader_election.cc:290] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:18.426126 11649 tablet_bootstrap.cc:654] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.426266 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
W20260709 12:16:18.432292 11418 leader_election.cc:343] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:18.425029 11651 ts_tablet_manager.cc:1434] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d: Time spent starting tablet: real 0.139s	user 0.006s	sys 0.001s
I20260709 12:16:18.400868 11697 raft_consensus.cc:515] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:18.409018 11735 raft_consensus.cc:493] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.434056 11735 raft_consensus.cc:515] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:18.436049 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:18.436707 11453 raft_consensus.cc:3060] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.437358 11651 tablet_bootstrap.cc:492] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d: Bootstrap starting.
I20260709 12:16:18.437737 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:18.441069 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:18.442588 11565 leader_election.cc:304] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:18.420969 11646 raft_consensus.cc:359] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:18.445591 11646 raft_consensus.cc:385] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.445879 11646 raft_consensus.cc:740] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.446590 11646 consensus_queue.cc:260] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:18.444972 11510 tablet_service.cc:1511] Processing CreateTablet for tablet f112ae9059f34e52b722c66748dbffe5 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:16:18.448768 11646 ts_tablet_manager.cc:1434] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.000s
I20260709 12:16:18.449090 11510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f112ae9059f34e52b722c66748dbffe5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.450683 11453 raft_consensus.cc:2468] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 1.
I20260709 12:16:18.453996 11651 tablet_bootstrap.cc:654] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.455093 11378 raft_consensus.cc:2468] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 1.
I20260709 12:16:18.456914 11646 tablet_bootstrap.cc:492] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:18.459898 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
W20260709 12:16:18.461427 11566 leader_election.cc:343] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:18.462035 11697 leader_election.cc:290] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:18.464781 11419 leader_election.cc:304] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:18.465152 11747 raft_consensus.cc:2749] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:18.465479 11656 raft_consensus.cc:697] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:18.466060 11730 raft_consensus.cc:2804] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:18.466624 11730 raft_consensus.cc:697] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 1 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:16:18.467702 11730 consensus_queue.cc:237] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:18.466477 11656 consensus_queue.cc:237] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:18.469168 11649 tablet_bootstrap.cc:492] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8: No bootstrap required, opened a new log
I20260709 12:16:18.469734 11649 ts_tablet_manager.cc:1403] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8: Time spent bootstrapping tablet: real 0.098s	user 0.011s	sys 0.000s
I20260709 12:16:18.470952 11528 raft_consensus.cc:2468] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 1.
I20260709 12:16:18.472620 11649 raft_consensus.cc:359] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:18.480314 11649 raft_consensus.cc:385] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.481791 11649 raft_consensus.cc:740] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.442164 11735 leader_election.cc:290] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:18.483289 11649 consensus_queue.cc:260] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:18.468245 11647 tablet_bootstrap.cc:492] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671: No bootstrap required, opened a new log
I20260709 12:16:18.475328 11565 leader_election.cc:304] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:18.473865 11368 tablet_service.cc:1511] Processing CreateTablet for tablet f112ae9059f34e52b722c66748dbffe5 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:16:18.484908 11651 tablet_bootstrap.cc:492] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d: No bootstrap required, opened a new log
I20260709 12:16:18.485177 11368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f112ae9059f34e52b722c66748dbffe5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.485416 11651 ts_tablet_manager.cc:1403] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d: Time spent bootstrapping tablet: real 0.048s	user 0.009s	sys 0.000s
I20260709 12:16:18.487336 11647 ts_tablet_manager.cc:1403] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671: Time spent bootstrapping tablet: real 0.126s	user 0.006s	sys 0.008s
I20260709 12:16:18.485502 11584 tablet_service.cc:1511] Processing CreateTablet for tablet f112ae9059f34e52b722c66748dbffe5 (DEFAULT_TABLE table=test-workload [id=b8773446d49f44f99921a5b948fc70e6]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:16:18.488250 11651 raft_consensus.cc:359] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:18.488971 11651 raft_consensus.cc:385] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.481832 11646 tablet_bootstrap.cc:654] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.489259 11276 catalog_manager.cc:5697] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 1 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:18.487457 11277 catalog_manager.cc:5697] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 1 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:18.489421 11584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f112ae9059f34e52b722c66748dbffe5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:18.489255 11651 raft_consensus.cc:740] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.492460 11647 raft_consensus.cc:359] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:18.492846 11651 consensus_queue.cc:260] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:18.488122 11656 raft_consensus.cc:2804] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:18.493871 11656 raft_consensus.cc:697] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:18.495227 11651 ts_tablet_manager.cc:1434] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:16:18.495143 11656 consensus_queue.cc:237] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:18.491632 11649 ts_tablet_manager.cc:1434] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.002s
I20260709 12:16:18.496265 11651 tablet_bootstrap.cc:492] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d: Bootstrap starting.
I20260709 12:16:18.502380 11649 tablet_bootstrap.cc:492] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8: Bootstrap starting.
I20260709 12:16:18.493201 11647 raft_consensus.cc:385] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.520947 11649 tablet_bootstrap.cc:654] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.524370 11651 tablet_bootstrap.cc:654] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.510695 11647 raft_consensus.cc:740] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.528192 11647 consensus_queue.cc:260] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:18.529244 11646 tablet_bootstrap.cc:492] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de: No bootstrap required, opened a new log
I20260709 12:16:18.529827 11646 ts_tablet_manager.cc:1403] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.073s	user 0.013s	sys 0.004s
I20260709 12:16:18.530402 11647 ts_tablet_manager.cc:1434] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.001s
I20260709 12:16:18.533010 11646 raft_consensus.cc:359] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:18.533828 11646 raft_consensus.cc:385] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.534108 11646 raft_consensus.cc:740] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.534816 11646 consensus_queue.cc:260] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:18.536079 11647 tablet_bootstrap.cc:492] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671: Bootstrap starting.
I20260709 12:16:18.546705 11646 ts_tablet_manager.cc:1434] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.003s
I20260709 12:16:18.546307 11274 catalog_manager.cc:5697] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 1 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:18.549696 11647 tablet_bootstrap.cc:654] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.554018 11646 tablet_bootstrap.cc:492] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:18.555544 11649 tablet_bootstrap.cc:492] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8: No bootstrap required, opened a new log
I20260709 12:16:18.556275 11649 ts_tablet_manager.cc:1403] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8: Time spent bootstrapping tablet: real 0.054s	user 0.016s	sys 0.008s
I20260709 12:16:18.555529 11651 tablet_bootstrap.cc:492] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d: No bootstrap required, opened a new log
I20260709 12:16:18.556867 11651 ts_tablet_manager.cc:1403] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d: Time spent bootstrapping tablet: real 0.061s	user 0.011s	sys 0.012s
I20260709 12:16:18.559489 11649 raft_consensus.cc:359] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:18.560946 11649 raft_consensus.cc:385] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.558048 11647 tablet_bootstrap.cc:492] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671: No bootstrap required, opened a new log
I20260709 12:16:18.562227 11647 ts_tablet_manager.cc:1403] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.004s
I20260709 12:16:18.561190 11651 raft_consensus.cc:359] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:18.561244 11649 raft_consensus.cc:740] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.562701 11651 raft_consensus.cc:385] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.563006 11651 raft_consensus.cc:740] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.563526 11646 tablet_bootstrap.cc:654] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.563231 11649 consensus_queue.cc:260] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:18.563972 11651 consensus_queue.cc:260] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:18.566150 11651 ts_tablet_manager.cc:1434] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 12:16:18.567860 11649 ts_tablet_manager.cc:1434] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:16:18.568908 11649 tablet_bootstrap.cc:492] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8: Bootstrap starting.
I20260709 12:16:18.574899 11649 tablet_bootstrap.cc:654] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.579500 11656 raft_consensus.cc:493] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.580343 11651 tablet_bootstrap.cc:492] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d: Bootstrap starting.
I20260709 12:16:18.580183 11656 raft_consensus.cc:515] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:18.585690 11378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:18.586498 11378 raft_consensus.cc:2468] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 0.
I20260709 12:16:18.586792 11656 leader_election.cc:290] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:18.587546 11651 tablet_bootstrap.cc:654] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.588133 11567 leader_election.cc:304] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:18.588713 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:18.589273 11656 raft_consensus.cc:2804] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:18.589452 11453 raft_consensus.cc:2468] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 0.
I20260709 12:16:18.589787 11656 raft_consensus.cc:493] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:18.590551 11656 raft_consensus.cc:3060] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.567188 11647 raft_consensus.cc:359] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:18.591008 11647 raft_consensus.cc:385] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.591267 11647 raft_consensus.cc:740] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.591938 11647 consensus_queue.cc:260] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:18.594866 11698 consensus_queue.cc:1048] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:18.598996 11647 ts_tablet_manager.cc:1434] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 12:16:18.600278 11647 tablet_bootstrap.cc:492] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671: Bootstrap starting.
I20260709 12:16:18.603641 11646 tablet_bootstrap.cc:492] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de: No bootstrap required, opened a new log
I20260709 12:16:18.603860 11649 tablet_bootstrap.cc:492] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8: No bootstrap required, opened a new log
I20260709 12:16:18.604233 11646 ts_tablet_manager.cc:1403] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.050s	user 0.016s	sys 0.012s
I20260709 12:16:18.604446 11649 ts_tablet_manager.cc:1403] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.004s
I20260709 12:16:18.601029 11656 raft_consensus.cc:515] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:18.607529 11646 raft_consensus.cc:359] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:18.608282 11646 raft_consensus.cc:385] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.608559 11646 raft_consensus.cc:740] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.609239 11646 consensus_queue.cc:260] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:18.609781 11656 leader_election.cc:290] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:18.610688 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:18.611374 11646 ts_tablet_manager.cc:1434] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:16:18.611413 11453 raft_consensus.cc:3060] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.612386 11646 tablet_bootstrap.cc:492] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:18.617233 11378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:18.617882 11698 consensus_queue.cc:1048] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:18.619325 11646 tablet_bootstrap.cc:654] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.617933 11378 raft_consensus.cc:3060] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.637043 11649 raft_consensus.cc:359] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:18.640211 11649 raft_consensus.cc:385] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.640535 11649 raft_consensus.cc:740] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.644564 11647 tablet_bootstrap.cc:654] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.646442 11649 consensus_queue.cc:260] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:18.650698 11698 raft_consensus.cc:493] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.651388 11698 raft_consensus.cc:515] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:18.654851 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffe47647c274723808482c166efa21c" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:18.655535 11601 raft_consensus.cc:2468] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 0.
I20260709 12:16:18.656370 11649 ts_tablet_manager.cc:1434] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8: Time spent starting tablet: real 0.052s	user 0.008s	sys 0.000s
I20260709 12:16:18.657061 11417 leader_election.cc:304] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:16:18.658079 11730 raft_consensus.cc:2804] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:18.658456 11730 raft_consensus.cc:493] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:18.658776 11730 raft_consensus.cc:3060] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.662688 11698 leader_election.cc:290] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:18.663187 11649 tablet_bootstrap.cc:492] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8: Bootstrap starting.
I20260709 12:16:18.664409 11377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffe47647c274723808482c166efa21c" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:18.665170 11377 raft_consensus.cc:2468] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 0.
I20260709 12:16:18.676813 11649 tablet_bootstrap.cc:654] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.679229 11651 tablet_bootstrap.cc:492] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d: No bootstrap required, opened a new log
I20260709 12:16:18.679860 11651 ts_tablet_manager.cc:1403] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d: Time spent bootstrapping tablet: real 0.100s	user 0.022s	sys 0.000s
I20260709 12:16:18.680017 11730 raft_consensus.cc:515] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:18.683216 11651 raft_consensus.cc:359] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:18.687831 11651 raft_consensus.cc:385] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.688321 11651 raft_consensus.cc:740] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.689164 11651 consensus_queue.cc:260] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:18.691246 11651 ts_tablet_manager.cc:1434] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:16:18.692675 11651 tablet_bootstrap.cc:492] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d: Bootstrap starting.
I20260709 12:16:18.706782 11730 leader_election.cc:290] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:18.710830 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffe47647c274723808482c166efa21c" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:18.711566 11601 raft_consensus.cc:3060] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.715382 11377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffe47647c274723808482c166efa21c" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:18.716068 11377 raft_consensus.cc:3060] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.719854 11378 raft_consensus.cc:2468] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 1.
I20260709 12:16:18.708773 11700 raft_consensus.cc:493] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.721927 11567 leader_election.cc:304] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:18.722286 11700 raft_consensus.cc:515] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:18.723259 11750 raft_consensus.cc:2804] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:18.723768 11750 raft_consensus.cc:697] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:18.724627 11750 consensus_queue.cc:237] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:18.725507 11700 leader_election.cc:290] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:18.726657 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:18.731473 11600 raft_consensus.cc:2468] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 0.
I20260709 12:16:18.733013 11342 leader_election.cc:304] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:18.734278 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:18.735301 11724 raft_consensus.cc:2804] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:18.735739 11724 raft_consensus.cc:493] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:16:18.735809 11343 leader_election.cc:343] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:18.736133 11724 raft_consensus.cc:3060] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.739416 11600 raft_consensus.cc:3060] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.747511 11651 tablet_bootstrap.cc:654] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.752837 11649 tablet_bootstrap.cc:492] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8: No bootstrap required, opened a new log
I20260709 12:16:18.753741 11649 ts_tablet_manager.cc:1403] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8: Time spent bootstrapping tablet: real 0.096s	user 0.044s	sys 0.026s
I20260709 12:16:18.695148 11453 raft_consensus.cc:2468] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 1.
I20260709 12:16:18.758236 11601 raft_consensus.cc:2468] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 1.
I20260709 12:16:18.760515 11649 raft_consensus.cc:359] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:18.762706 11646 tablet_bootstrap.cc:492] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de: No bootstrap required, opened a new log
I20260709 12:16:18.763412 11649 raft_consensus.cc:385] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.763679 11646 ts_tablet_manager.cc:1403] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.151s	user 0.036s	sys 0.064s
I20260709 12:16:18.763742 11649 raft_consensus.cc:740] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.764292 11417 leader_election.cc:304] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:16:18.774394 11649 consensus_queue.cc:260] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:18.773036 11659 raft_consensus.cc:493] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.775601 11659 raft_consensus.cc:515] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:18.767844 11646 raft_consensus.cc:359] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:18.777573 11646 raft_consensus.cc:385] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.777772 11646 raft_consensus.cc:740] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.778368 11646 consensus_queue.cc:260] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:18.781322 11698 raft_consensus.cc:493] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.782126 11698 raft_consensus.cc:515] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:18.782967 11646 ts_tablet_manager.cc:1434] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:16:18.784018 11646 tablet_bootstrap.cc:492] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:18.784983 11698 leader_election.cc:290] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:18.791524 11378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:18.779870 11766 raft_consensus.cc:2804] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:18.787073 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9fe9a94294836aec652338f44367d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:18.792409 11766 raft_consensus.cc:697] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 1 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:16:18.792810 11602 raft_consensus.cc:2468] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 0.
I20260709 12:16:18.788444 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9fe9a94294836aec652338f44367d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:18.792403 11378 raft_consensus.cc:2393] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 1: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:16:18.794443 11766 consensus_queue.cc:237] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
W20260709 12:16:18.797019 11418 leader_election.cc:343] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:18.797464 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:18.798280 11528 raft_consensus.cc:2393] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 1: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:16:18.799760 11417 leader_election.cc:304] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:18.790198 11659 leader_election.cc:290] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:18.802013 11659 raft_consensus.cc:2804] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:18.802476 11659 raft_consensus.cc:493] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:18.802881 11659 raft_consensus.cc:3060] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.803750 11418 leader_election.cc:304] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:18.807268 11730 raft_consensus.cc:3060] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.809213 11651 tablet_bootstrap.cc:492] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d: No bootstrap required, opened a new log
I20260709 12:16:18.809360 11377 raft_consensus.cc:2468] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 1.
I20260709 12:16:18.809924 11651 ts_tablet_manager.cc:1403] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d: Time spent bootstrapping tablet: real 0.117s	user 0.013s	sys 0.000s
I20260709 12:16:18.812736 11651 raft_consensus.cc:359] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:18.790146 11646 tablet_bootstrap.cc:654] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.804081 11649 ts_tablet_manager.cc:1434] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.001s
I20260709 12:16:18.817042 11730 raft_consensus.cc:2749] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:18.812739 11724 raft_consensus.cc:515] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:18.822652 11274 catalog_manager.cc:5697] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 1 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:18.821156 11649 tablet_bootstrap.cc:492] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8: Bootstrap starting.
I20260709 12:16:18.824849 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:18.816828 11659 raft_consensus.cc:515] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:18.826370 11700 raft_consensus.cc:493] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.826915 11700 raft_consensus.cc:515] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:18.820982 11651 raft_consensus.cc:385] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.829685 11651 raft_consensus.cc:740] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.828703 11659 leader_election.cc:290] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:18.831020 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9fe9a94294836aec652338f44367d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:18.833258 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
W20260709 12:16:18.833559 11418 leader_election.cc:343] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:18.835338 11342 leader_election.cc:343] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:18.831311 11700 leader_election.cc:290] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:16:18.831372 11343 leader_election.cc:343] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:18.836644 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9fe9a94294836aec652338f44367d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:18.837733 11601 raft_consensus.cc:3060] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.830487 11651 consensus_queue.cc:260] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:18.841423 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:18.843124 11651 ts_tablet_manager.cc:1434] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
W20260709 12:16:18.845309 11343 leader_election.cc:343] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:18.845852 11343 leader_election.cc:304] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:18.848317 11724 leader_election.cc:290] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:18.849009 11724 raft_consensus.cc:2749] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:18.851461 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:18.852073 11602 raft_consensus.cc:3060] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.856182 11647 tablet_bootstrap.cc:492] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671: No bootstrap required, opened a new log
I20260709 12:16:18.856772 11647 ts_tablet_manager.cc:1403] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671: Time spent bootstrapping tablet: real 0.257s	user 0.065s	sys 0.046s
I20260709 12:16:18.859762 11647 raft_consensus.cc:359] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:18.860524 11647 raft_consensus.cc:385] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.860918 11647 raft_consensus.cc:740] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.860530 11646 tablet_bootstrap.cc:492] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de: No bootstrap required, opened a new log
I20260709 12:16:18.861963 11602 raft_consensus.cc:2468] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 1.
I20260709 12:16:18.862840 11646 ts_tablet_manager.cc:1403] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.079s	user 0.011s	sys 0.014s
I20260709 12:16:18.861930 11647 consensus_queue.cc:260] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:18.863926 11342 leader_election.cc:304] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:18.865546 11700 raft_consensus.cc:2804] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:18.865742 11647 ts_tablet_manager.cc:1434] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:16:18.864948 11274 catalog_manager.cc:5697] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 1 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:18.866138 11700 raft_consensus.cc:697] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 1 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:16:18.867321 11700 consensus_queue.cc:237] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:18.870359 11647 tablet_bootstrap.cc:492] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671: Bootstrap starting.
I20260709 12:16:18.870592 11649 tablet_bootstrap.cc:654] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.876713 11750 consensus_queue.cc:1048] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:18.877908 11647 tablet_bootstrap.cc:654] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.883776 11646 raft_consensus.cc:359] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:18.885336 11646 raft_consensus.cc:385] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.885692 11646 raft_consensus.cc:740] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.886498 11646 consensus_queue.cc:260] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:18.888899 11646 ts_tablet_manager.cc:1434] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.000s
I20260709 12:16:18.889923 11646 tablet_bootstrap.cc:492] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:18.889782 11601 raft_consensus.cc:2468] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 1.
I20260709 12:16:18.891068 11417 leader_election.cc:304] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:18.891971 11766 raft_consensus.cc:2804] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:18.892469 11766 raft_consensus.cc:697] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [term 1 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:16:18.893347 11766 consensus_queue.cc:237] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:18.895419 11651 tablet_bootstrap.cc:492] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d: Bootstrap starting.
I20260709 12:16:18.905057 11656 consensus_queue.cc:1048] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:18.908581 11710 raft_consensus.cc:493] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.909209 11710 raft_consensus.cc:515] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:18.911664 11710 leader_election.cc:290] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:18.916749 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:18.917817 11453 raft_consensus.cc:2393] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 1: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:16:18.917443 11274 catalog_manager.cc:5697] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 0 to 1, leader changed from <none> to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 1 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:18.920542 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:18.922410 11491 leader_election.cc:304] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:16:18.923707 11710 raft_consensus.cc:3060] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.916796 11651 tablet_bootstrap.cc:654] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.931092 11646 tablet_bootstrap.cc:654] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.933804 11647 tablet_bootstrap.cc:492] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671: No bootstrap required, opened a new log
I20260709 12:16:18.934340 11647 ts_tablet_manager.cc:1403] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671: Time spent bootstrapping tablet: real 0.064s	user 0.020s	sys 0.006s
I20260709 12:16:18.939069 11647 raft_consensus.cc:359] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:18.939800 11647 raft_consensus.cc:385] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.940053 11647 raft_consensus.cc:740] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.940743 11647 consensus_queue.cc:260] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:18.942056 11649 tablet_bootstrap.cc:492] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8: No bootstrap required, opened a new log
I20260709 12:16:18.942700 11649 ts_tablet_manager.cc:1403] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8: Time spent bootstrapping tablet: real 0.122s	user 0.013s	sys 0.001s
I20260709 12:16:18.943943 11527 raft_consensus.cc:3060] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.947973 11656 consensus_queue.cc:1048] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:18.970438 11710 raft_consensus.cc:2749] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:18.975665 11656 consensus_queue.cc:1048] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:18.981068 11649 raft_consensus.cc:359] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:18.982131 11649 raft_consensus.cc:385] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.982553 11649 raft_consensus.cc:740] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.990314 11649 consensus_queue.cc:260] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:19.000272 11649 ts_tablet_manager.cc:1434] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8: Time spent starting tablet: real 0.057s	user 0.006s	sys 0.002s
I20260709 12:16:19.001641 11649 tablet_bootstrap.cc:492] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8: Bootstrap starting.
I20260709 12:16:19.008159 11649 tablet_bootstrap.cc:654] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.010277 11656 raft_consensus.cc:493] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:19.010965 11656 raft_consensus.cc:515] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:19.012418 11274 catalog_manager.cc:5697] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 1 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:19.014480 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:19.015215 11379 raft_consensus.cc:2468] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 0.
I20260709 12:16:19.016270 11779 raft_consensus.cc:493] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:19.016786 11779 raft_consensus.cc:515] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:19.019130 11779 leader_election.cc:290] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:19.020987 11656 leader_election.cc:290] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:19.016959 11567 leader_election.cc:304] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:19.023627 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:19.025271 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
W20260709 12:16:19.027987 11565 leader_election.cc:343] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:19.028203 11656 raft_consensus.cc:2804] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:19.028762 11656 raft_consensus.cc:493] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:19.029140 11656 raft_consensus.cc:3060] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:19.041831 11651 tablet_bootstrap.cc:492] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d: No bootstrap required, opened a new log
I20260709 12:16:19.042449 11651 ts_tablet_manager.cc:1403] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d: Time spent bootstrapping tablet: real 0.147s	user 0.020s	sys 0.003s
I20260709 12:16:19.045469 11651 raft_consensus.cc:359] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:19.046200 11651 raft_consensus.cc:385] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.046461 11651 raft_consensus.cc:740] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.047487 11651 consensus_queue.cc:260] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:19.052356 11766 consensus_queue.cc:1048] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:19.052752 11647 ts_tablet_manager.cc:1434] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671: Time spent starting tablet: real 0.118s	user 0.033s	sys 0.015s
I20260709 12:16:19.053263 11646 tablet_bootstrap.cc:492] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de: No bootstrap required, opened a new log
I20260709 12:16:19.054003 11646 ts_tablet_manager.cc:1403] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.164s	user 0.016s	sys 0.005s
I20260709 12:16:19.054037 11647 tablet_bootstrap.cc:492] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671: Bootstrap starting.
I20260709 12:16:19.057741 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:19.059046 11379 raft_consensus.cc:2393] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 1: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:16:19.063889 11647 tablet_bootstrap.cc:654] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.063603 11646 raft_consensus.cc:359] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:19.064352 11646 raft_consensus.cc:385] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.064669 11646 raft_consensus.cc:740] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.065016 11493 leader_election.cc:304] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:19.068476 11526 raft_consensus.cc:3060] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:19.078918 11783 raft_consensus.cc:493] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:19.079586 11783 raft_consensus.cc:515] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:19.082147 11783 leader_election.cc:290] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:19.083894 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:19.084154 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:19.084697 11453 raft_consensus.cc:2468] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 0.
I20260709 12:16:19.086174 11491 leader_election.cc:304] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:16:19.086680 11649 tablet_bootstrap.cc:492] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8: No bootstrap required, opened a new log
I20260709 12:16:19.087555 11649 ts_tablet_manager.cc:1403] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8: Time spent bootstrapping tablet: real 0.086s	user 0.012s	sys 0.007s
I20260709 12:16:19.089120 11656 raft_consensus.cc:515] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:19.068660 11651 ts_tablet_manager.cc:1434] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.001s
I20260709 12:16:19.095486 11651 tablet_bootstrap.cc:492] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d: Bootstrap starting.
I20260709 12:16:19.096760 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:19.097501 11379 raft_consensus.cc:3060] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:19.097757 11700 raft_consensus.cc:493] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:19.098430 11700 raft_consensus.cc:515] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:19.072094 11710 raft_consensus.cc:493] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:19.101739 11710 raft_consensus.cc:515] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:19.104295 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ed4eeff0ae44d0bc1ebb8cbe3adea5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:19.073421 11735 raft_consensus.cc:493] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:19.106251 11342 leader_election.cc:343] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:19.106029 11735 raft_consensus.cc:515] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:19.107240 11601 raft_consensus.cc:2468] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 0.
I20260709 12:16:19.107415 11379 raft_consensus.cc:2468] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 1.
I20260709 12:16:19.108044 11700 leader_election.cc:290] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:19.108747 11735 leader_election.cc:290] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:19.108892 11567 leader_election.cc:304] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:19.112272 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:19.113019 11453 raft_consensus.cc:2468] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 0.
I20260709 12:16:19.113808 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:19.114920 11565 leader_election.cc:304] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:16:19.115799 11750 raft_consensus.cc:2804] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:19.116178 11750 raft_consensus.cc:493] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:19.116500 11750 raft_consensus.cc:3060] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:19.090581 11649 raft_consensus.cc:359] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:19.092386 11785 raft_consensus.cc:2749] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:19.122395 11649 raft_consensus.cc:385] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.122841 11649 raft_consensus.cc:740] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.123873 11649 consensus_queue.cc:260] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:19.124091 11750 raft_consensus.cc:515] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:19.069789 11646 consensus_queue.cc:260] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:19.093724 11766 consensus_queue.cc:1048] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:19.126262 11649 ts_tablet_manager.cc:1434] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8: Time spent starting tablet: real 0.038s	user 0.002s	sys 0.004s
I20260709 12:16:19.113566 11697 raft_consensus.cc:2804] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:19.128319 11656 leader_election.cc:290] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:19.111056 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ed4eeff0ae44d0bc1ebb8cbe3adea5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:19.128409 11697 raft_consensus.cc:697] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:19.131949 11697 consensus_queue.cc:237] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:19.128861 11710 leader_election.cc:290] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:19.129818 11649 tablet_bootstrap.cc:492] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8: Bootstrap starting.
I20260709 12:16:19.130252 11651 tablet_bootstrap.cc:654] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.130162 11378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:19.134169 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:19.090111 11788 raft_consensus.cc:2804] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:19.140846 11646 ts_tablet_manager.cc:1434] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.086s	user 0.007s	sys 0.000s
W20260709 12:16:19.139307 11343 leader_election.cc:343] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:19.142184 11646 tablet_bootstrap.cc:492] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:19.142499 11343 leader_election.cc:304] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:19.139324 11527 raft_consensus.cc:2468] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 0.
I20260709 12:16:19.143338 11700 raft_consensus.cc:2749] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:19.147033 11647 tablet_bootstrap.cc:492] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671: No bootstrap required, opened a new log
I20260709 12:16:19.147620 11647 ts_tablet_manager.cc:1403] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671: Time spent bootstrapping tablet: real 0.094s	user 0.038s	sys 0.016s
W20260709 12:16:19.141522 11565 leader_election.cc:343] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:19.153882 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:19.156375 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:19.148476 11788 raft_consensus.cc:493] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:19.157053 11453 raft_consensus.cc:3060] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:19.157529 11788 raft_consensus.cc:3060] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:19.157747 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:19.157014 11750 leader_election.cc:290] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:19.162004 11491 leader_election.cc:304] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:19.167733 11646 tablet_bootstrap.cc:654] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.169040 11710 raft_consensus.cc:2749] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:19.168919 11647 raft_consensus.cc:359] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:19.169843 11647 raft_consensus.cc:385] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.170149 11647 raft_consensus.cc:740] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.170849 11647 consensus_queue.cc:260] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:19.173177 11647 ts_tablet_manager.cc:1434] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671: Time spent starting tablet: real 0.025s	user 0.002s	sys 0.005s
I20260709 12:16:19.164265 11649 tablet_bootstrap.cc:654] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.165138 11453 raft_consensus.cc:2468] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 1.
I20260709 12:16:19.176831 11788 raft_consensus.cc:515] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:19.176630 11276 catalog_manager.cc:5697] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 1 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:19.178171 11527 raft_consensus.cc:2393] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 1: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:16:19.178948 11651 tablet_bootstrap.cc:492] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d: No bootstrap required, opened a new log
I20260709 12:16:19.179543 11651 ts_tablet_manager.cc:1403] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d: Time spent bootstrapping tablet: real 0.084s	user 0.012s	sys 0.005s
I20260709 12:16:19.174197 11647 tablet_bootstrap.cc:492] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671: Bootstrap starting.
I20260709 12:16:19.179916 11565 leader_election.cc:304] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:16:19.193909 11651 raft_consensus.cc:359] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:19.194765 11651 raft_consensus.cc:385] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.195029 11651 raft_consensus.cc:740] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.195731 11651 consensus_queue.cc:260] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:19.200687 11788 leader_election.cc:290] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:19.186390 11697 raft_consensus.cc:2804] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:19.201225 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:19.201767 11697 raft_consensus.cc:697] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:19.202728 11697 consensus_queue.cc:237] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:19.200719 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:19.205811 11647 tablet_bootstrap.cc:654] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.206032 11453 raft_consensus.cc:2393] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 1: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:16:19.215013 11651 ts_tablet_manager.cc:1434] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 12:16:19.216845 11651 tablet_bootstrap.cc:492] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d: Bootstrap starting.
I20260709 12:16:19.223812 11646 tablet_bootstrap.cc:492] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de: No bootstrap required, opened a new log
I20260709 12:16:19.225629 11646 ts_tablet_manager.cc:1403] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.084s	user 0.014s	sys 0.005s
I20260709 12:16:19.227985 11649 tablet_bootstrap.cc:492] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8: No bootstrap required, opened a new log
I20260709 12:16:19.228638 11649 ts_tablet_manager.cc:1403] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8: Time spent bootstrapping tablet: real 0.099s	user 0.022s	sys 0.006s
I20260709 12:16:19.229677 11646 raft_consensus.cc:359] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:19.230461 11646 raft_consensus.cc:385] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.230733 11646 raft_consensus.cc:740] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.231964 11649 raft_consensus.cc:359] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:19.232750 11649 raft_consensus.cc:385] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.233070 11649 raft_consensus.cc:740] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.233958 11649 consensus_queue.cc:260] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:19.234624 11647 tablet_bootstrap.cc:492] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671: No bootstrap required, opened a new log
I20260709 12:16:19.235142 11647 ts_tablet_manager.cc:1403] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671: Time spent bootstrapping tablet: real 0.061s	user 0.008s	sys 0.004s
I20260709 12:16:19.235299 11491 leader_election.cc:304] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:16:19.236344 11649 ts_tablet_manager.cc:1434] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:16:19.236521 11788 raft_consensus.cc:2749] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:16:19.236969 11651 tablet_bootstrap.cc:654] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.237907 11647 raft_consensus.cc:359] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:19.238497 11649 tablet_bootstrap.cc:492] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8: Bootstrap starting.
I20260709 12:16:19.238662 11647 raft_consensus.cc:385] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.238961 11647 raft_consensus.cc:740] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.239761 11647 consensus_queue.cc:260] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:19.244573 11649 tablet_bootstrap.cc:654] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.245360 11647 ts_tablet_manager.cc:1434] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671: Time spent starting tablet: real 0.010s	user 0.000s	sys 0.007s
I20260709 12:16:19.263002 11647 tablet_bootstrap.cc:492] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671: Bootstrap starting.
I20260709 12:16:19.267112 11646 consensus_queue.cc:260] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:19.270174 11647 tablet_bootstrap.cc:654] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.270404 11274 catalog_manager.cc:5697] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 1 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:19.271478 11646 ts_tablet_manager.cc:1434] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.000s
I20260709 12:16:19.273185 11646 tablet_bootstrap.cc:492] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:19.287483 11649 tablet_bootstrap.cc:492] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8: No bootstrap required, opened a new log
I20260709 12:16:19.290122 11649 ts_tablet_manager.cc:1403] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8: Time spent bootstrapping tablet: real 0.052s	user 0.019s	sys 0.012s
I20260709 12:16:19.290148 11646 tablet_bootstrap.cc:654] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.287429 11651 tablet_bootstrap.cc:492] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d: No bootstrap required, opened a new log
I20260709 12:16:19.293555 11651 ts_tablet_manager.cc:1403] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d: Time spent bootstrapping tablet: real 0.078s	user 0.021s	sys 0.019s
I20260709 12:16:19.293569 11649 raft_consensus.cc:359] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:19.294902 11649 raft_consensus.cc:385] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.295186 11649 raft_consensus.cc:740] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.296471 11649 consensus_queue.cc:260] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:19.296711 11651 raft_consensus.cc:359] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:19.297451 11651 raft_consensus.cc:385] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.297765 11651 raft_consensus.cc:740] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.298450 11651 consensus_queue.cc:260] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:19.299819 11750 consensus_queue.cc:1048] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:19.301632 11651 ts_tablet_manager.cc:1434] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:16:19.298828 11649 ts_tablet_manager.cc:1434] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:16:19.304121 11646 tablet_bootstrap.cc:492] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de: No bootstrap required, opened a new log
I20260709 12:16:19.304541 11649 tablet_bootstrap.cc:492] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8: Bootstrap starting.
I20260709 12:16:19.304723 11646 ts_tablet_manager.cc:1403] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.000s
I20260709 12:16:19.307961 11646 raft_consensus.cc:359] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:19.308677 11646 raft_consensus.cc:385] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.308941 11646 raft_consensus.cc:740] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.310894 11651 tablet_bootstrap.cc:492] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d: Bootstrap starting.
I20260709 12:16:19.311342 11649 tablet_bootstrap.cc:654] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.313608 11700 raft_consensus.cc:493] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:19.314252 11700 raft_consensus.cc:515] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:19.316592 11700 leader_election.cc:290] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:19.318962 11788 raft_consensus.cc:493] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:19.319272 11651 tablet_bootstrap.cc:654] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.320617 11788 raft_consensus.cc:515] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:19.316493 11646 consensus_queue.cc:260] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:19.323103 11788 leader_election.cc:290] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:19.320830 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:19.326009 11377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:19.326880 11646 ts_tablet_manager.cc:1434] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 12:16:19.327682 11698 raft_consensus.cc:493] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:19.319388 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:19.327898 11646 tablet_bootstrap.cc:492] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
W20260709 12:16:19.329630 11342 leader_election.cc:343] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:19.336889 11646 tablet_bootstrap.cc:654] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.339304 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:19.340328 11601 raft_consensus.cc:2393] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 1: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
W20260709 12:16:19.342253 11342 leader_election.cc:343] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:19.343427 11342 leader_election.cc:304] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:16:19.346974 11730 consensus_queue.cc:1048] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:19.350534 11735 consensus_queue.cc:1048] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:19.351728 11646 tablet_bootstrap.cc:492] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de: No bootstrap required, opened a new log
I20260709 12:16:19.352306 11646 ts_tablet_manager.cc:1403] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.025s	user 0.007s	sys 0.004s
I20260709 12:16:19.353638 11491 leader_election.cc:304] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:19.355952 11788 raft_consensus.cc:3060] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:19.357126 11735 raft_consensus.cc:493] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:19.357764 11735 raft_consensus.cc:515] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:19.363215 11698 raft_consensus.cc:515] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:19.365859 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:19.366740 11452 raft_consensus.cc:2468] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 0.
I20260709 12:16:19.373081 11659 consensus_queue.cc:1048] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:19.378777 11565 leader_election.cc:304] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:16:19.379549 11698 leader_election.cc:290] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:19.379830 11697 raft_consensus.cc:2804] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:19.380363 11697 raft_consensus.cc:493] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:19.380759 11697 raft_consensus.cc:3060] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:19.381043 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:16:19.382905 11418 leader_election.cc:343] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:19.390352 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:19.391149 11379 raft_consensus.cc:2468] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 0.
W20260709 12:16:19.401901 11342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 57118.7us
I20260709 12:16:19.405215 11735 leader_election.cc:290] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:19.405663 11646 raft_consensus.cc:359] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:19.406529 11646 raft_consensus.cc:385] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.406824 11646 raft_consensus.cc:740] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.408669 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:19.406000 11419 leader_election.cc:304] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:19.402715 11724 raft_consensus.cc:2749] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:19.408987 11647 tablet_bootstrap.cc:492] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671: No bootstrap required, opened a new log
W20260709 12:16:19.411334 11566 leader_election.cc:343] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:19.411372 11647 ts_tablet_manager.cc:1403] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671: Time spent bootstrapping tablet: real 0.165s	user 0.013s	sys 0.032s
I20260709 12:16:19.413601 11646 consensus_queue.cc:260] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:19.419783 11651 tablet_bootstrap.cc:492] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d: No bootstrap required, opened a new log
I20260709 12:16:19.420470 11651 ts_tablet_manager.cc:1403] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d: Time spent bootstrapping tablet: real 0.110s	user 0.027s	sys 0.030s
I20260709 12:16:19.420544 11788 raft_consensus.cc:2749] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:19.424295 11649 tablet_bootstrap.cc:492] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8: No bootstrap required, opened a new log
I20260709 12:16:19.423915 11651 raft_consensus.cc:359] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:19.425037 11649 ts_tablet_manager.cc:1403] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8: Time spent bootstrapping tablet: real 0.121s	user 0.049s	sys 0.038s
I20260709 12:16:19.427042 11697 raft_consensus.cc:515] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:19.427955 11649 raft_consensus.cc:359] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:19.428740 11649 raft_consensus.cc:385] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.429024 11649 raft_consensus.cc:740] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.425041 11651 raft_consensus.cc:385] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.429807 11649 consensus_queue.cc:260] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:19.430521 11651 raft_consensus.cc:740] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.417308 11735 raft_consensus.cc:493] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:19.431350 11651 consensus_queue.cc:260] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:19.431726 11735 raft_consensus.cc:515] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:19.432149 11649 ts_tablet_manager.cc:1434] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:16:19.433889 11649 tablet_bootstrap.cc:492] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8: Bootstrap starting.
I20260709 12:16:19.434896 11526 raft_consensus.cc:3060] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:19.412637 11698 raft_consensus.cc:2804] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:19.436959 11698 raft_consensus.cc:493] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:19.437415 11698 raft_consensus.cc:3060] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:19.439968 11649 tablet_bootstrap.cc:654] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.446815 11646 ts_tablet_manager.cc:1434] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.094s	user 0.011s	sys 0.000s
W20260709 12:16:19.416947 11325 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:19.454320 11647 raft_consensus.cc:359] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:19.455428 11647 raft_consensus.cc:385] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.455780 11647 raft_consensus.cc:740] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.456615 11647 consensus_queue.cc:260] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:19.459475 11700 raft_consensus.cc:493] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:19.459964 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:19.460078 11700 raft_consensus.cc:515] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:19.460615 11651 ts_tablet_manager.cc:1434] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.001s
I20260709 12:16:19.461748 11651 tablet_bootstrap.cc:492] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d: Bootstrap starting.
I20260709 12:16:19.462136 11750 raft_consensus.cc:493] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:19.462697 11750 raft_consensus.cc:515] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
W20260709 12:16:19.463228 11566 leader_election.cc:343] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:19.459724 11697 leader_election.cc:290] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:19.465394 11724 consensus_queue.cc:1048] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:19.466840 11659 consensus_queue.cc:1048] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:19.471616 11647 ts_tablet_manager.cc:1434] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.000s
I20260709 12:16:19.472852 11647 tablet_bootstrap.cc:492] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671: Bootstrap starting.
I20260709 12:16:19.464907 11750 leader_election.cc:290] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:19.482053 11724 raft_consensus.cc:493] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:19.482875 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:19.483417 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:19.484138 11735 leader_election.cc:290] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:19.485288 11646 tablet_bootstrap.cc:492] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:19.481267 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:19.486735 11452 raft_consensus.cc:3060] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:19.486929 11710 raft_consensus.cc:493] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:19.487540 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ed4eeff0ae44d0bc1ebb8cbe3adea5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:19.487443 11710 raft_consensus.cc:515] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:19.488186 11379 raft_consensus.cc:2468] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 0.
I20260709 12:16:19.492290 11567 leader_election.cc:304] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:19.492687 11710 leader_election.cc:290] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:19.493247 11735 raft_consensus.cc:2804] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:19.493660 11735 raft_consensus.cc:493] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:19.493999 11735 raft_consensus.cc:3060] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:19.495286 11659 consensus_queue.cc:1048] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:19.495632 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:19.482705 11724 raft_consensus.cc:515] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:19.496942 11651 tablet_bootstrap.cc:654] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.497931 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ed4eeff0ae44d0bc1ebb8cbe3adea5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:16:19.491585 11565 leader_election.cc:343] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:19.501968 11566 leader_election.cc:343] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:19.507930 11647 tablet_bootstrap.cc:654] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.509590 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:19.510345 11379 raft_consensus.cc:2468] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 0.
I20260709 12:16:19.512720 11566 leader_election.cc:304] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:19.516371 11698 raft_consensus.cc:515] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:19.514585 11750 raft_consensus.cc:2749] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:19.530396 11454 raft_consensus.cc:2393] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 1: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
W20260709 12:16:19.514547 11566 leader_election.cc:343] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:19.534340 11700 leader_election.cc:290] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:19.536417 11724 leader_election.cc:290] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:19.545017 11813 consensus_queue.cc:1048] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260709 12:16:19.549522 11493 leader_election.cc:304] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d
I20260709 12:16:19.550825 11788 raft_consensus.cc:2804] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:19.551234 11788 raft_consensus.cc:493] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:19.551578 11788 raft_consensus.cc:3060] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:19.552304 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:19.553788 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:19.519230 11735 raft_consensus.cc:515] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
W20260709 12:16:19.564221 11343 leader_election.cc:343] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:19.566128 11343 leader_election.cc:343] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:19.568221 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:19.569128 11698 leader_election.cc:290] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:16:19.561744 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 47232.6us
I20260709 12:16:19.569449 11377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:19.570250 11377 raft_consensus.cc:3060] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:19.569274 11649 tablet_bootstrap.cc:492] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8: No bootstrap required, opened a new log
I20260709 12:16:19.567096 11788 raft_consensus.cc:515] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:19.572527 11649 ts_tablet_manager.cc:1403] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8: Time spent bootstrapping tablet: real 0.139s	user 0.015s	sys 0.001s
I20260709 12:16:19.571830 11735 leader_election.cc:290] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:19.575567 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ed4eeff0ae44d0bc1ebb8cbe3adea5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:19.578383 11646 tablet_bootstrap.cc:654] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.580169 11528 raft_consensus.cc:2393] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 1: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:16:19.581718 11788 leader_election.cc:290] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:19.583956 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:19.585004 11453 raft_consensus.cc:2393] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 1: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:16:19.590023 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:19.590803 11601 raft_consensus.cc:2468] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 0.
I20260709 12:16:19.593675 11377 raft_consensus.cc:2468] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 1.
I20260709 12:16:19.596375 11419 leader_election.cc:304] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:19.587594 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:19.598073 11454 raft_consensus.cc:2468] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 0.
I20260709 12:16:19.598631 11659 raft_consensus.cc:2804] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:19.599267 11659 raft_consensus.cc:697] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 1 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:16:19.600188 11659 consensus_queue.cc:237] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:19.589092 11649 raft_consensus.cc:359] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:19.605269 11649 raft_consensus.cc:385] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.605057 11342 leader_election.cc:304] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:19.605605 11649 raft_consensus.cc:740] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.606487 11813 raft_consensus.cc:2804] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:19.606967 11813 raft_consensus.cc:493] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:19.606716 11649 consensus_queue.cc:260] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:19.607334 11813 raft_consensus.cc:3060] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:19.608723 11566 leader_election.cc:343] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:19.609925 11342 leader_election.cc:304] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:19.610805 11700 raft_consensus.cc:2804] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:19.611202 11700 raft_consensus.cc:493] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:19.611515 11700 raft_consensus.cc:3060] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:19.613780 11649 ts_tablet_manager.cc:1434] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260709 12:16:19.614822 11649 tablet_bootstrap.cc:492] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8: Bootstrap starting.
I20260709 12:16:19.613794 11377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:19.617502 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ed4eeff0ae44d0bc1ebb8cbe3adea5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:19.617888 11377 raft_consensus.cc:2393] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 1: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:16:19.618180 11379 raft_consensus.cc:3060] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:19.618920 11698 raft_consensus.cc:493] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:19.619436 11698 raft_consensus.cc:515] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:19.630200 11649 tablet_bootstrap.cc:654] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.630683 11700 raft_consensus.cc:515] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:19.632787 11379 raft_consensus.cc:2468] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 1.
I20260709 12:16:19.631151 11452 raft_consensus.cc:2468] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 1.
I20260709 12:16:19.649508 11493 leader_election.cc:304] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:19.651033 11788 raft_consensus.cc:2749] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:16:19.662887 11454 raft_consensus.cc:3060] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:19.631058 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:19.651146 11651 tablet_bootstrap.cc:492] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d: No bootstrap required, opened a new log
I20260709 12:16:19.666183 11651 ts_tablet_manager.cc:1403] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d: Time spent bootstrapping tablet: real 0.205s	user 0.016s	sys 0.001s
I20260709 12:16:19.670596 11567 leader_election.cc:304] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:19.672281 11656 raft_consensus.cc:2804] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:19.672847 11656 raft_consensus.cc:697] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:19.674007 11656 consensus_queue.cc:237] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:19.680768 11750 consensus_queue.cc:1048] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:19.690234 11565 leader_election.cc:304] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:19.691948 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:19.693210 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:19.697952 11379 raft_consensus.cc:2393] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 1: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:16:19.698487 11647 tablet_bootstrap.cc:492] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671: No bootstrap required, opened a new log
I20260709 12:16:19.694718 11697 raft_consensus.cc:2804] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:19.699149 11647 ts_tablet_manager.cc:1403] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671: Time spent bootstrapping tablet: real 0.227s	user 0.014s	sys 0.008s
I20260709 12:16:19.690366 11698 leader_election.cc:290] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:19.705518 11697 raft_consensus.cc:697] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:19.706535 11697 consensus_queue.cc:237] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:19.716358 11419 leader_election.cc:304] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:19.718175 11647 raft_consensus.cc:359] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:19.718977 11647 raft_consensus.cc:385] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.719280 11647 raft_consensus.cc:740] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.719498 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:19.719980 11647 consensus_queue.cc:260] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:19.720261 11600 raft_consensus.cc:3060] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:19.713662 11813 raft_consensus.cc:515] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:19.726579 11700 leader_election.cc:290] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:19.726774 11813 leader_election.cc:290] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:16:19.727277 11343 leader_election.cc:343] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:19.730914 11647 ts_tablet_manager.cc:1434] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.002s
I20260709 12:16:19.731807 11647 tablet_bootstrap.cc:492] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671: Bootstrap starting.
I20260709 12:16:19.737114 11646 tablet_bootstrap.cc:492] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de: No bootstrap required, opened a new log
I20260709 12:16:19.737733 11646 ts_tablet_manager.cc:1403] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.257s	user 0.018s	sys 0.061s
I20260709 12:16:19.743774 11651 raft_consensus.cc:359] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:19.746004 11651 raft_consensus.cc:385] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.746246 11651 raft_consensus.cc:740] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.748824 11649 tablet_bootstrap.cc:492] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8: No bootstrap required, opened a new log
I20260709 12:16:19.749502 11649 ts_tablet_manager.cc:1403] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8: Time spent bootstrapping tablet: real 0.135s	user 0.039s	sys 0.027s
I20260709 12:16:19.752493 11649 raft_consensus.cc:359] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:19.753754 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:19.754477 11454 raft_consensus.cc:3060] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:19.754769 11647 tablet_bootstrap.cc:654] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.757162 11750 consensus_queue.cc:1048] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:19.763546 11454 raft_consensus.cc:2468] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 1.
I20260709 12:16:19.753261 11649 raft_consensus.cc:385] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.734735 11698 raft_consensus.cc:2749] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:19.764422 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:19.769598 11750 consensus_queue.cc:1048] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:19.772845 11646 raft_consensus.cc:359] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:19.773764 11646 raft_consensus.cc:385] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:16:19.772846 11343 leader_election.cc:343] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:19.774143 11646 raft_consensus.cc:740] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.775072 11646 consensus_queue.cc:260] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:19.746762 11651 consensus_queue.cc:260] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:19.765245 11649 raft_consensus.cc:740] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.782050 11649 consensus_queue.cc:260] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:19.784669 11649 ts_tablet_manager.cc:1434] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 12:16:19.786100 11649 tablet_bootstrap.cc:492] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8: Bootstrap starting.
I20260709 12:16:19.781533 11651 ts_tablet_manager.cc:1434] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d: Time spent starting tablet: real 0.115s	user 0.008s	sys 0.000s
I20260709 12:16:19.779435 11274 catalog_manager.cc:5697] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 1 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:19.789915 11651 tablet_bootstrap.cc:492] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d: Bootstrap starting.
I20260709 12:16:19.794124 11646 ts_tablet_manager.cc:1434] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.056s	user 0.008s	sys 0.000s
I20260709 12:16:19.796350 11646 tablet_bootstrap.cc:492] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:19.791711 11342 leader_election.cc:304] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:19.817571 11600 raft_consensus.cc:2468] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 1.
I20260709 12:16:19.818634 11813 raft_consensus.cc:2804] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:19.824563 11813 raft_consensus.cc:697] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 1 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:16:19.825238 11700 raft_consensus.cc:493] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:19.825619 11813 consensus_queue.cc:237] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:19.825846 11700 raft_consensus.cc:515] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:19.828327 11700 leader_election.cc:290] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:19.828454 11656 consensus_queue.cc:1048] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:19.830570 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:16:19.832386 11343 leader_election.cc:343] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:19.832597 11649 tablet_bootstrap.cc:654] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.837890 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:19.842098 11342 leader_election.cc:304] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:19.855427 11647 tablet_bootstrap.cc:492] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671: No bootstrap required, opened a new log
I20260709 12:16:19.856168 11647 ts_tablet_manager.cc:1403] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671: Time spent bootstrapping tablet: real 0.125s	user 0.038s	sys 0.038s
I20260709 12:16:19.855944 11813 raft_consensus.cc:2804] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:16:19.858748 11342 leader_election.cc:343] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:19.864643 11710 raft_consensus.cc:493] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:19.865096 11646 tablet_bootstrap.cc:654] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.869683 11649 tablet_bootstrap.cc:492] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8: No bootstrap required, opened a new log
I20260709 12:16:19.872014 11647 raft_consensus.cc:359] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:19.877319 11647 raft_consensus.cc:385] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.877791 11647 raft_consensus.cc:740] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.876257 11651 tablet_bootstrap.cc:654] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.878698 11710 raft_consensus.cc:515] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:19.880520 11649 ts_tablet_manager.cc:1403] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8: Time spent bootstrapping tablet: real 0.095s	user 0.015s	sys 0.004s
I20260709 12:16:19.878769 11647 consensus_queue.cc:260] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:19.882051 11342 leader_election.cc:304] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:19.885916 11700 raft_consensus.cc:2749] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:19.890172 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:19.890980 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:19.882189 11813 raft_consensus.cc:697] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 1 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:16:19.892012 11454 raft_consensus.cc:2393] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 1: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:16:19.893405 11491 leader_election.cc:304] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:16:19.894476 11788 raft_consensus.cc:3060] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:19.886446 11710 leader_election.cc:290] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:19.895257 11647 ts_tablet_manager.cc:1434] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 12:16:19.898005 11813 consensus_queue.cc:237] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:19.899566 11649 raft_consensus.cc:359] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:19.900350 11649 raft_consensus.cc:385] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.900668 11649 raft_consensus.cc:740] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.901563 11649 consensus_queue.cc:260] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:19.902699 11646 tablet_bootstrap.cc:492] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de: No bootstrap required, opened a new log
I20260709 12:16:19.903504 11646 ts_tablet_manager.cc:1403] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.107s	user 0.017s	sys 0.004s
I20260709 12:16:19.904520 11647 tablet_bootstrap.cc:492] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671: Bootstrap starting.
I20260709 12:16:19.919456 11647 tablet_bootstrap.cc:654] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.926280 11649 ts_tablet_manager.cc:1434] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.001s
I20260709 12:16:19.927695 11788 raft_consensus.cc:2749] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:19.929426 11649 tablet_bootstrap.cc:492] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8: Bootstrap starting.
I20260709 12:16:19.938807 11649 tablet_bootstrap.cc:654] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.942719 11646 raft_consensus.cc:359] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:19.943519 11646 raft_consensus.cc:385] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.943791 11646 raft_consensus.cc:740] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.944517 11646 consensus_queue.cc:260] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:19.947101 11646 ts_tablet_manager.cc:1434] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 12:16:19.949985 11649 tablet_bootstrap.cc:492] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8: No bootstrap required, opened a new log
I20260709 12:16:19.950052 11647 tablet_bootstrap.cc:492] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671: No bootstrap required, opened a new log
I20260709 12:16:19.950735 11649 ts_tablet_manager.cc:1403] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.003s
I20260709 12:16:19.950812 11647 ts_tablet_manager.cc:1403] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.000s
I20260709 12:16:19.952621 11646 tablet_bootstrap.cc:492] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:19.953265 11647 raft_consensus.cc:359] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:19.953914 11647 raft_consensus.cc:385] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.954198 11647 raft_consensus.cc:740] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.953750 11649 raft_consensus.cc:359] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:19.954560 11649 raft_consensus.cc:385] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.955041 11649 raft_consensus.cc:740] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.954818 11647 consensus_queue.cc:260] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:19.955797 11649 consensus_queue.cc:260] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:19.956915 11647 ts_tablet_manager.cc:1434] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:16:19.958012 11647 tablet_bootstrap.cc:492] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671: Bootstrap starting.
I20260709 12:16:19.958112 11649 ts_tablet_manager.cc:1434] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:16:19.959390 11646 tablet_bootstrap.cc:654] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.960410 11649 tablet_bootstrap.cc:492] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8: Bootstrap starting.
I20260709 12:16:19.963938 11651 tablet_bootstrap.cc:492] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d: No bootstrap required, opened a new log
I20260709 12:16:19.964542 11651 ts_tablet_manager.cc:1403] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d: Time spent bootstrapping tablet: real 0.177s	user 0.029s	sys 0.012s
I20260709 12:16:19.967053 11649 tablet_bootstrap.cc:654] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.967716 11651 raft_consensus.cc:359] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:19.968497 11651 raft_consensus.cc:385] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.968813 11651 raft_consensus.cc:740] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.971302 11651 consensus_queue.cc:260] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:19.972504 11276 catalog_manager.cc:5697] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 0 to 1, leader changed from <none> to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 1 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:19.973974 11651 ts_tablet_manager.cc:1434] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:16:19.975412 11651 tablet_bootstrap.cc:492] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d: Bootstrap starting.
I20260709 12:16:19.978258 11697 raft_consensus.cc:493] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:19.978809 11697 raft_consensus.cc:515] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:19.981887 11697 leader_election.cc:290] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:19.982052 11377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:19.982833 11377 raft_consensus.cc:2468] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 0.
I20260709 12:16:19.984899 11567 leader_election.cc:304] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:19.986716 11735 raft_consensus.cc:2804] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:19.987152 11735 raft_consensus.cc:493] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:19.987478 11735 raft_consensus.cc:3060] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:19.987830 11649 tablet_bootstrap.cc:492] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8: No bootstrap required, opened a new log
I20260709 12:16:19.988361 11649 ts_tablet_manager.cc:1403] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.004s
I20260709 12:16:19.995402 11649 raft_consensus.cc:359] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:19.995900 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:19.996150 11651 tablet_bootstrap.cc:654] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.996378 11649 raft_consensus.cc:385] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.996661 11452 raft_consensus.cc:2468] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 0.
I20260709 12:16:19.997118 11649 raft_consensus.cc:740] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.997874 11649 consensus_queue.cc:260] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:20.000240 11649 ts_tablet_manager.cc:1434] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.002s
I20260709 12:16:20.001281 11649 tablet_bootstrap.cc:492] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8: Bootstrap starting.
I20260709 12:16:20.001209 11735 raft_consensus.cc:515] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:20.004330 11646 tablet_bootstrap.cc:492] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de: No bootstrap required, opened a new log
I20260709 12:16:20.005146 11377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:20.006085 11377 raft_consensus.cc:3060] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.007553 11274 catalog_manager.cc:5697] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 0 to 1, leader changed from <none> to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 1 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:20.009584 11813 raft_consensus.cc:493] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.010267 11813 raft_consensus.cc:515] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:20.012681 11813 leader_election.cc:290] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:20.015112 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d43eecbad746fd9ddce50c5b9fc3e8" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:20.016001 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d43eecbad746fd9ddce50c5b9fc3e8" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:20.016716 11600 raft_consensus.cc:2468] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 0.
W20260709 12:16:20.017007 11342 leader_election.cc:343] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.017974 11342 leader_election.cc:304] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d
I20260709 12:16:20.019390 11813 raft_consensus.cc:2804] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:20.019829 11813 raft_consensus.cc:493] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:20.020289 11813 raft_consensus.cc:3060] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.021018 11647 tablet_bootstrap.cc:654] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.028702 11277 catalog_manager.cc:5697] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 1 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:20.030865 11277 catalog_manager.cc:5697] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 1 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:20.033365 11377 raft_consensus.cc:2468] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 1.
I20260709 12:16:20.035141 11567 leader_election.cc:304] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:20.036116 11697 raft_consensus.cc:2804] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:20.036643 11697 raft_consensus.cc:697] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:20.037484 11697 consensus_queue.cc:237] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:20.006172 11646 ts_tablet_manager.cc:1403] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.054s	user 0.012s	sys 0.011s
I20260709 12:16:20.045168 11735 leader_election.cc:290] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:20.045926 11651 tablet_bootstrap.cc:492] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d: No bootstrap required, opened a new log
I20260709 12:16:20.046650 11651 ts_tablet_manager.cc:1403] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d: Time spent bootstrapping tablet: real 0.071s	user 0.013s	sys 0.024s
I20260709 12:16:20.049201 11649 tablet_bootstrap.cc:654] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.048450 11813 raft_consensus.cc:515] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:20.050338 11647 tablet_bootstrap.cc:492] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671: No bootstrap required, opened a new log
I20260709 12:16:20.050858 11647 ts_tablet_manager.cc:1403] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671: Time spent bootstrapping tablet: real 0.093s	user 0.024s	sys 0.008s
I20260709 12:16:20.051997 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d43eecbad746fd9ddce50c5b9fc3e8" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:20.052625 11600 raft_consensus.cc:3060] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.054968 11646 raft_consensus.cc:359] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:20.055910 11646 raft_consensus.cc:385] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.046504 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:20.056262 11646 raft_consensus.cc:740] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.057042 11651 raft_consensus.cc:359] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:20.057855 11651 raft_consensus.cc:385] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.058171 11651 raft_consensus.cc:740] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.057966 11646 consensus_queue.cc:260] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:20.059068 11651 consensus_queue.cc:260] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:20.061161 11651 ts_tablet_manager.cc:1434] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:16:20.061357 11646 ts_tablet_manager.cc:1434] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:16:20.064172 11600 raft_consensus.cc:2468] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 1.
I20260709 12:16:20.064388 11646 tablet_bootstrap.cc:492] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:20.056591 11452 raft_consensus.cc:3060] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.068883 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d43eecbad746fd9ddce50c5b9fc3e8" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:20.075124 11651 tablet_bootstrap.cc:492] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d: Bootstrap starting.
I20260709 12:16:20.065958 11277 catalog_manager.cc:5697] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 1 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:20.065973 11813 leader_election.cc:290] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
W20260709 12:16:20.079943 11342 leader_election.cc:343] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.080035 11646 tablet_bootstrap.cc:654] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.083241 11342 leader_election.cc:304] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d
I20260709 12:16:20.084371 11700 raft_consensus.cc:2804] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:20.084913 11700 raft_consensus.cc:697] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 1 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:16:20.085853 11700 consensus_queue.cc:237] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:20.087147 11647 raft_consensus.cc:359] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:20.089561 11647 raft_consensus.cc:385] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.089924 11647 raft_consensus.cc:740] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.090855 11647 consensus_queue.cc:260] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:20.092080 11698 raft_consensus.cc:493] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.092338 11646 tablet_bootstrap.cc:492] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de: No bootstrap required, opened a new log
I20260709 12:16:20.095427 11735 consensus_queue.cc:1048] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:20.097790 11698 raft_consensus.cc:515] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:20.099468 11646 ts_tablet_manager.cc:1403] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.035s	user 0.008s	sys 0.004s
I20260709 12:16:20.100134 11698 leader_election.cc:290] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:20.102587 11646 raft_consensus.cc:359] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:20.103214 11698 consensus_queue.cc:1048] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:20.103839 11647 ts_tablet_manager.cc:1434] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.001s
I20260709 12:16:20.096725 11651 tablet_bootstrap.cc:654] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.102536 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:20.105073 11379 raft_consensus.cc:2468] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 0.
I20260709 12:16:20.105696 11647 tablet_bootstrap.cc:492] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671: Bootstrap starting.
I20260709 12:16:20.102716 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:20.103744 11646 raft_consensus.cc:385] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.109508 11419 leader_election.cc:304] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:20.110042 11646 raft_consensus.cc:740] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
W20260709 12:16:20.111119 11418 leader_election.cc:343] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.111670 11698 raft_consensus.cc:2804] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:20.114346 11698 raft_consensus.cc:493] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:20.114158 11646 consensus_queue.cc:260] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:20.114804 11698 raft_consensus.cc:3060] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.116189 11646 ts_tablet_manager.cc:1434] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 12:16:20.120507 11646 tablet_bootstrap.cc:492] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:20.117774 11276 catalog_manager.cc:5697] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 0 to 1, leader changed from <none> to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 1 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:20.119333 11647 tablet_bootstrap.cc:654] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.126833 11646 tablet_bootstrap.cc:654] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.125011 11452 raft_consensus.cc:2468] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 1.
I20260709 12:16:20.135659 11698 raft_consensus.cc:515] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:20.144207 11649 tablet_bootstrap.cc:492] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8: No bootstrap required, opened a new log
I20260709 12:16:20.144763 11649 ts_tablet_manager.cc:1403] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8: Time spent bootstrapping tablet: real 0.144s	user 0.019s	sys 0.013s
I20260709 12:16:20.147651 11647 tablet_bootstrap.cc:492] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671: No bootstrap required, opened a new log
I20260709 12:16:20.148025 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:20.148371 11647 ts_tablet_manager.cc:1403] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671: Time spent bootstrapping tablet: real 0.043s	user 0.006s	sys 0.011s
I20260709 12:16:20.149319 11649 raft_consensus.cc:359] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
W20260709 12:16:20.149963 11418 leader_election.cc:343] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.150753 11698 leader_election.cc:290] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:20.152007 11651 tablet_bootstrap.cc:492] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d: No bootstrap required, opened a new log
I20260709 12:16:20.152580 11651 ts_tablet_manager.cc:1403] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d: Time spent bootstrapping tablet: real 0.082s	user 0.012s	sys 0.004s
I20260709 12:16:20.153225 11647 raft_consensus.cc:359] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:20.154109 11647 raft_consensus.cc:385] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.154474 11647 raft_consensus.cc:740] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.155694 11646 tablet_bootstrap.cc:492] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de: No bootstrap required, opened a new log
I20260709 12:16:20.155285 11647 consensus_queue.cc:260] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:20.156265 11646 ts_tablet_manager.cc:1403] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.036s	user 0.009s	sys 0.004s
I20260709 12:16:20.156749 11651 raft_consensus.cc:359] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:20.157506 11651 raft_consensus.cc:385] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.157801 11651 raft_consensus.cc:740] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.158210 11647 ts_tablet_manager.cc:1434] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:16:20.159374 11647 tablet_bootstrap.cc:492] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671: Bootstrap starting.
I20260709 12:16:20.158994 11651 consensus_queue.cc:260] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:20.163323 11526 raft_consensus.cc:3060] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.159374 11646 raft_consensus.cc:359] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:20.163995 11646 raft_consensus.cc:385] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.164392 11646 raft_consensus.cc:740] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.165146 11646 consensus_queue.cc:260] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:20.165227 11651 ts_tablet_manager.cc:1434] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.004s
I20260709 12:16:20.166708 11700 raft_consensus.cc:493] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.166882 11651 tablet_bootstrap.cc:492] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d: Bootstrap starting.
I20260709 12:16:20.167253 11700 raft_consensus.cc:515] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:20.168484 11649 raft_consensus.cc:385] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.168779 11649 raft_consensus.cc:740] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.169430 11700 leader_election.cc:290] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:20.170419 11649 consensus_queue.cc:260] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:20.171299 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:20.171952 11454 raft_consensus.cc:2468] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 1.
I20260709 12:16:20.173418 11342 leader_election.cc:304] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:20.173954 11750 raft_consensus.cc:493] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.174347 11700 raft_consensus.cc:2804] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:20.174479 11750 raft_consensus.cc:515] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:20.175007 11700 raft_consensus.cc:493] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:20.175467 11700 raft_consensus.cc:3060] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:20.176966 11750 leader_election.cc:290] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:20.177140 11647 tablet_bootstrap.cc:654] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.182101 11724 raft_consensus.cc:493] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.195640 11724 raft_consensus.cc:515] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:20.174324 11646 ts_tablet_manager.cc:1434] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:16:20.179674 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c355b3902a4e7fb72bac6a91ea3316" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:20.177673 11651 tablet_bootstrap.cc:654] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.197535 11646 tablet_bootstrap.cc:492] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:20.198593 11724 leader_election.cc:290] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:20.184520 11735 consensus_queue.cc:1048] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 12:16:20.200130 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:20.184273 11656 raft_consensus.cc:493] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.200872 11656 raft_consensus.cc:515] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:20.203019 11656 leader_election.cc:290] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:16:20.205829 11342 leader_election.cc:343] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.208768 11378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c355b3902a4e7fb72bac6a91ea3316" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:20.206281 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:20.209767 11454 raft_consensus.cc:2468] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 0.
I20260709 12:16:20.208611 11377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:20.210291 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:20.211094 11525 raft_consensus.cc:2468] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 1.
I20260709 12:16:20.211532 11565 leader_election.cc:304] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:16:20.210806 11377 raft_consensus.cc:3060] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.209671 11378 raft_consensus.cc:2468] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 0.
I20260709 12:16:20.217078 11788 raft_consensus.cc:493] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.217818 11788 raft_consensus.cc:515] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:20.221462 11788 leader_election.cc:290] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:20.222368 11567 leader_election.cc:304] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:20.222788 11730 consensus_queue.cc:1048] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:20.222376 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:20.222270 11750 raft_consensus.cc:2804] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:20.224145 11600 raft_consensus.cc:2468] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 0.
I20260709 12:16:20.225067 11750 raft_consensus.cc:493] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:20.225517 11750 raft_consensus.cc:3060] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.225776 11656 raft_consensus.cc:2804] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:20.226328 11656 raft_consensus.cc:493] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:20.226716 11656 raft_consensus.cc:3060] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.232352 11491 leader_election.cc:304] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:16:20.232739 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:20.233999 11788 raft_consensus.cc:2804] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:20.234575 11788 raft_consensus.cc:493] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:20.234946 11788 raft_consensus.cc:3060] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.240155 11700 raft_consensus.cc:515] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:20.243593 11649 ts_tablet_manager.cc:1434] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8: Time spent starting tablet: real 0.098s	user 0.004s	sys 0.004s
I20260709 12:16:20.244809 11649 tablet_bootstrap.cc:492] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8: Bootstrap starting.
I20260709 12:16:20.233489 11454 raft_consensus.cc:2468] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 0.
I20260709 12:16:20.251283 11646 tablet_bootstrap.cc:654] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.237118 11377 raft_consensus.cc:2468] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 1.
I20260709 12:16:20.259984 11419 leader_election.cc:304] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:20.260947 11730 raft_consensus.cc:2804] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:20.261529 11730 raft_consensus.cc:697] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 1 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:16:20.262408 11730 consensus_queue.cc:237] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:20.262903 11750 raft_consensus.cc:515] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:20.274924 11710 raft_consensus.cc:493] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.275775 11710 raft_consensus.cc:515] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:20.278383 11710 leader_election.cc:290] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:20.276784 11788 raft_consensus.cc:515] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:20.280853 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:20.283047 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:20.283942 11454 raft_consensus.cc:2393] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 1: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:16:20.286248 11491 leader_election.cc:304] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:20.287165 11710 raft_consensus.cc:3060] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.287346 11788 leader_election.cc:290] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:20.289217 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:20.289994 11451 raft_consensus.cc:3060] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.272567 11656 raft_consensus.cc:515] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:20.292997 11735 raft_consensus.cc:493] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.293612 11735 raft_consensus.cc:515] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:20.294315 11724 raft_consensus.cc:493] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.294919 11724 raft_consensus.cc:515] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:20.295879 11735 leader_election.cc:290] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:20.296730 11656 leader_election.cc:290] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:20.297171 11724 leader_election.cc:290] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:20.298864 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
W20260709 12:16:20.300843 11342 leader_election.cc:343] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.301321 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:20.301924 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:20.302597 11379 raft_consensus.cc:2468] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 0.
I20260709 12:16:20.300735 11526 raft_consensus.cc:3060] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.304041 11788 raft_consensus.cc:493] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.304704 11788 raft_consensus.cc:515] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:20.304960 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c355b3902a4e7fb72bac6a91ea3316" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:20.305233 11451 raft_consensus.cc:2468] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 1.
I20260709 12:16:20.305771 11379 raft_consensus.cc:3060] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.307503 11788 leader_election.cc:290] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:20.308372 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:20.309063 11600 raft_consensus.cc:3060] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.310623 11724 raft_consensus.cc:493] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.311357 11724 raft_consensus.cc:515] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:20.314654 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:20.319332 11379 raft_consensus.cc:2468] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 1.
I20260709 12:16:20.311553 11491 leader_election.cc:304] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:16:20.320322 11710 raft_consensus.cc:2749] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:20.320611 11788 raft_consensus.cc:2804] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:16:20.320758 11342 leader_election.cc:343] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.321560 11567 leader_election.cc:304] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:20.322158 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ed4eeff0ae44d0bc1ebb8cbe3adea5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:20.322554 11656 raft_consensus.cc:2804] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:20.323204 11656 raft_consensus.cc:493] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:20.323516 11647 tablet_bootstrap.cc:492] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671: No bootstrap required, opened a new log
I20260709 12:16:20.323561 11656 raft_consensus.cc:3060] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.324214 11647 ts_tablet_manager.cc:1403] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671: Time spent bootstrapping tablet: real 0.165s	user 0.043s	sys 0.029s
I20260709 12:16:20.324599 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:20.329107 11600 raft_consensus.cc:2468] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 1.
I20260709 12:16:20.326139 11649 tablet_bootstrap.cc:654] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:20.331853 11565 leader_election.cc:343] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.327167 11647 raft_consensus.cc:359] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:20.330415 11567 leader_election.cc:304] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:20.338197 11735 raft_consensus.cc:2804] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:20.338766 11735 raft_consensus.cc:697] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:20.339783 11735 consensus_queue.cc:237] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:20.314983 11724 leader_election.cc:290] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:20.330931 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:20.338598 11651 tablet_bootstrap.cc:492] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d: No bootstrap required, opened a new log
I20260709 12:16:20.324276 11646 tablet_bootstrap.cc:492] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de: No bootstrap required, opened a new log
W20260709 12:16:20.342944 11343 leader_election.cc:343] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.343341 11646 ts_tablet_manager.cc:1403] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.146s	user 0.005s	sys 0.007s
I20260709 12:16:20.343724 11647 raft_consensus.cc:385] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.344051 11647 raft_consensus.cc:740] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.345206 11651 ts_tablet_manager.cc:1403] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d: Time spent bootstrapping tablet: real 0.179s	user 0.016s	sys 0.016s
I20260709 12:16:20.345902 11377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ed4eeff0ae44d0bc1ebb8cbe3adea5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:20.346428 11646 raft_consensus.cc:359] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:20.344869 11647 consensus_queue.cc:260] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:20.349792 11646 raft_consensus.cc:385] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.350178 11646 raft_consensus.cc:740] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.356004 11651 raft_consensus.cc:359] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:20.356868 11651 raft_consensus.cc:385] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.357151 11651 raft_consensus.cc:740] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.354314 11646 consensus_queue.cc:260] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:20.343508 11343 leader_election.cc:304] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:20.372409 11647 ts_tablet_manager.cc:1434] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671: Time spent starting tablet: real 0.048s	user 0.010s	sys 0.000s
I20260709 12:16:20.371549 11651 consensus_queue.cc:260] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:20.373947 11649 tablet_bootstrap.cc:492] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8: No bootstrap required, opened a new log
I20260709 12:16:20.374564 11649 ts_tablet_manager.cc:1403] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8: Time spent bootstrapping tablet: real 0.130s	user 0.017s	sys 0.004s
I20260709 12:16:20.371264 11697 raft_consensus.cc:493] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.375674 11697 raft_consensus.cc:515] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:20.377900 11697 leader_election.cc:290] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:20.378765 11647 tablet_bootstrap.cc:492] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671: Bootstrap starting.
I20260709 12:16:20.397303 11651 ts_tablet_manager.cc:1434] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 12:16:20.398553 11651 tablet_bootstrap.cc:492] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d: Bootstrap starting.
I20260709 12:16:20.389948 11788 raft_consensus.cc:697] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 1 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:16:20.401422 11700 leader_election.cc:290] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:16:20.401262 11343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 58360.4us
I20260709 12:16:20.402566 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
W20260709 12:16:20.402789 11343 leader_election.cc:343] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.403322 11343 leader_election.cc:304] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:20.403560 11700 consensus_queue.cc:1048] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:20.399941 11788 consensus_queue.cc:237] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:20.405308 11493 leader_election.cc:304] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:20.405539 11724 raft_consensus.cc:2749] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:20.403247 11452 raft_consensus.cc:3060] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:20.390827 11813 raft_consensus.cc:2749] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:20.406988 11710 raft_consensus.cc:2749] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:20.407915 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:20.408594 11528 raft_consensus.cc:3060] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:20.409149 11750 leader_election.cc:290] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:16:20.365904 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 173948us
I20260709 12:16:20.412086 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c355b3902a4e7fb72bac6a91ea3316" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:20.413796 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:20.414896 11452 raft_consensus.cc:2468] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 2.
I20260709 12:16:20.416199 11342 leader_election.cc:304] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:20.414180 11651 tablet_bootstrap.cc:654] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.417901 11724 raft_consensus.cc:2804] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:20.418444 11724 raft_consensus.cc:697] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 2 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:16:20.350333 11656 raft_consensus.cc:515] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:20.423965 11646 ts_tablet_manager.cc:1434] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.080s	user 0.006s	sys 0.000s
I20260709 12:16:20.419334 11724 consensus_queue.cc:237] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:20.447839 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:20.450770 11528 raft_consensus.cc:2468] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 2.
I20260709 12:16:20.451130 11700 consensus_queue.cc:1048] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:20.458781 11750 consensus_queue.cc:1048] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:20.449764 11276 catalog_manager.cc:5697] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 1 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:20.458734 11700 consensus_queue.cc:1048] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:16:20.461539 11659 raft_consensus.cc:493] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.462095 11659 raft_consensus.cc:515] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:20.464134 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:20.464982 11659 leader_election.cc:290] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:20.467684 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d43eecbad746fd9ddce50c5b9fc3e8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:20.478024 11656 leader_election.cc:290] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:20.478587 11646 tablet_bootstrap.cc:492] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
W20260709 12:16:20.469267 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 104599us
I20260709 12:16:20.490784 11788 raft_consensus.cc:493] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.491400 11788 raft_consensus.cc:515] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:20.494307 11378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:20.495163 11378 raft_consensus.cc:2393] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 1: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
W20260709 12:16:20.495900 11325 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:20.496181 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:20.496425 11646 tablet_bootstrap.cc:654] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.500092 11379 raft_consensus.cc:3060] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.513309 11277 catalog_manager.cc:5697] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 0 to 1, leader changed from <none> to a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131). New cstate: current_term: 1 leader_uuid: "a03223e9e41247c3a36b7b7c3d476671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:20.518631 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:20.520342 11651 tablet_bootstrap.cc:492] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d: No bootstrap required, opened a new log
I20260709 12:16:20.520938 11651 ts_tablet_manager.cc:1403] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d: Time spent bootstrapping tablet: real 0.123s	user 0.018s	sys 0.007s
I20260709 12:16:20.523873 11651 raft_consensus.cc:359] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:20.524638 11651 raft_consensus.cc:385] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.524930 11651 raft_consensus.cc:740] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.527271 11651 consensus_queue.cc:260] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:20.529485 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d43eecbad746fd9ddce50c5b9fc3e8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:20.530395 11601 raft_consensus.cc:2393] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 1: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:16:20.531000 11651 ts_tablet_manager.cc:1434] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d: Time spent starting tablet: real 0.010s	user 0.001s	sys 0.005s
I20260709 12:16:20.533288 11651 tablet_bootstrap.cc:492] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d: Bootstrap starting.
I20260709 12:16:20.537158 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:20.539366 11491 leader_election.cc:304] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:20.540335 11651 tablet_bootstrap.cc:654] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.540361 11862 raft_consensus.cc:3060] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.541096 11649 raft_consensus.cc:359] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:20.541872 11649 raft_consensus.cc:385] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.542169 11649 raft_consensus.cc:740] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.542843 11649 consensus_queue.cc:260] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:20.547582 11647 tablet_bootstrap.cc:654] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.547938 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:20.551961 11649 ts_tablet_manager.cc:1434] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8: Time spent starting tablet: real 0.177s	user 0.007s	sys 0.001s
I20260709 12:16:20.552791 11276 catalog_manager.cc:5697] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 0 to 2, leader changed from <none> to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 2 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:20.548763 11454 raft_consensus.cc:3060] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.540370 11788 leader_election.cc:290] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
W20260709 12:16:20.581712 11565 leader_election.cc:343] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.554266 11813 raft_consensus.cc:493] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.583389 11813 raft_consensus.cc:515] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:20.585248 11274 catalog_manager.cc:5697] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 1 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:20.591996 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:20.611228 11862 raft_consensus.cc:2749] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:16:20.612504 11565 leader_election.cc:343] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.599133 11813 leader_election.cc:290] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:20.602948 11855 consensus_queue.cc:1048] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:20.608410 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:20.609669 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:20.615199 11600 raft_consensus.cc:2393] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 1: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
W20260709 12:16:20.615506 11343 leader_election.cc:343] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.614032 11649 tablet_bootstrap.cc:492] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8: Bootstrap starting.
W20260709 12:16:20.620620 11566 leader_election.cc:343] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.621850 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:20.622879 11601 raft_consensus.cc:2468] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 0.
I20260709 12:16:20.637734 11379 raft_consensus.cc:2468] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 1.
I20260709 12:16:20.641333 11454 raft_consensus.cc:2468] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 1.
I20260709 12:16:20.643177 11855 consensus_queue.cc:1048] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:20.663648 11567 leader_election.cc:304] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d
I20260709 12:16:20.664268 11565 leader_election.cc:304] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:16:20.665725 11855 raft_consensus.cc:2804] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:20.666298 11855 raft_consensus.cc:697] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
W20260709 12:16:20.666735 11342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 66296us
W20260709 12:16:20.643205 11566 leader_election.cc:343] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:20.668390 11566 leader_election.cc:343] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.665349 11656 raft_consensus.cc:2804] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:20.669900 11656 raft_consensus.cc:697] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:20.670622 11866 consensus_queue.cc:1048] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:20.670796 11656 consensus_queue.cc:237] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
W20260709 12:16:20.672485 11566 leader_election.cc:343] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.673287 11566 leader_election.cc:304] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:20.674209 11735 raft_consensus.cc:2749] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:20.667160 11855 consensus_queue.cc:237] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:20.654651 11659 consensus_queue.cc:1048] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:20.659076 11651 tablet_bootstrap.cc:492] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d: No bootstrap required, opened a new log
W20260709 12:16:20.675477 11566 leader_election.cc:343] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.677960 11651 ts_tablet_manager.cc:1403] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d: Time spent bootstrapping tablet: real 0.145s	user 0.036s	sys 0.066s
I20260709 12:16:20.684352 11649 tablet_bootstrap.cc:654] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.687736 11730 consensus_queue.cc:1048] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:20.699931 11651 raft_consensus.cc:359] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:20.700774 11651 raft_consensus.cc:385] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.701056 11651 raft_consensus.cc:740] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.702227 11651 consensus_queue.cc:260] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:20.704530 11651 ts_tablet_manager.cc:1434] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 12:16:20.707624 11646 tablet_bootstrap.cc:492] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de: No bootstrap required, opened a new log
I20260709 12:16:20.708250 11646 ts_tablet_manager.cc:1403] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.272s	user 0.021s	sys 0.050s
I20260709 12:16:20.713202 11651 tablet_bootstrap.cc:492] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d: Bootstrap starting.
I20260709 12:16:20.733762 11647 tablet_bootstrap.cc:492] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671: No bootstrap required, opened a new log
I20260709 12:16:20.734313 11647 ts_tablet_manager.cc:1403] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671: Time spent bootstrapping tablet: real 0.361s	user 0.015s	sys 0.003s
I20260709 12:16:20.735790 11417 leader_election.cc:304] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:20.737030 11647 raft_consensus.cc:359] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:20.737859 11647 raft_consensus.cc:385] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.738126 11647 raft_consensus.cc:740] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.739058 11647 consensus_queue.cc:260] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:20.741688 11647 ts_tablet_manager.cc:1434] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:16:20.742772 11647 tablet_bootstrap.cc:492] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671: Bootstrap starting.
I20260709 12:16:20.725219 11454 raft_consensus.cc:3060] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.757997 11342 leader_election.cc:304] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:16:20.760350 11876 raft_consensus.cc:2749] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:20.785485 11724 consensus_queue.cc:1048] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:20.788573 11647 tablet_bootstrap.cc:654] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.807253 11646 raft_consensus.cc:359] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:20.807893 11646 raft_consensus.cc:385] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.808121 11646 raft_consensus.cc:740] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.806824 11730 raft_consensus.cc:2749] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:20.811431 11646 consensus_queue.cc:260] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:20.820593 11649 tablet_bootstrap.cc:492] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8: No bootstrap required, opened a new log
I20260709 12:16:20.821476 11649 ts_tablet_manager.cc:1403] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8: Time spent bootstrapping tablet: real 0.209s	user 0.023s	sys 0.022s
I20260709 12:16:20.799974 11342 leader_election.cc:304] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:20.823515 11876 raft_consensus.cc:2804] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:20.824013 11876 raft_consensus.cc:493] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:20.824391 11813 consensus_queue.cc:1048] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:20.824350 11876 raft_consensus.cc:3060] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:20.831030 11877 log.cc:927] Time spent T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 12:16:20.835531 11735 consensus_queue.cc:1048] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:20.836488 11862 raft_consensus.cc:493] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.837024 11862 raft_consensus.cc:515] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:20.837013 11276 catalog_manager.cc:5697] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 1 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:20.838841 11276 catalog_manager.cc:5697] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 1 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:20.840931 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:20.839464 11862 leader_election.cc:290] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:20.844192 11451 raft_consensus.cc:2393] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 1: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:16:20.846236 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:20.846578 11651 tablet_bootstrap.cc:654] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.847957 11491 leader_election.cc:304] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:16:20.848883 11788 raft_consensus.cc:3060] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.850270 11646 ts_tablet_manager.cc:1434] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.142s	user 0.008s	sys 0.002s
I20260709 12:16:20.851467 11646 tablet_bootstrap.cc:492] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:20.836133 11766 raft_consensus.cc:493] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.855084 11766 raft_consensus.cc:515] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:20.856536 11710 consensus_queue.cc:1048] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:20.858698 11813 consensus_queue.cc:1048] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:20.871793 11766 leader_election.cc:290] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:20.888670 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:20.899147 11788 raft_consensus.cc:2749] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:20.900689 11788 consensus_queue.cc:1048] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:20.904505 11876 raft_consensus.cc:515] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:20.905658 11377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:16:20.925791 11880 log.cc:927] Time spent T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:16:20.932605 11649 raft_consensus.cc:359] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:20.933468 11649 raft_consensus.cc:385] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.933748 11649 raft_consensus.cc:740] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.934448 11649 consensus_queue.cc:260] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:20.956568 11377 raft_consensus.cc:2393] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 1: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:16:20.959712 11649 ts_tablet_manager.cc:1434] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8: Time spent starting tablet: real 0.138s	user 0.007s	sys 0.000s
W20260709 12:16:20.925838 11566 consensus_peers.cc:597] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Couldn't send request to peer a03223e9e41247c3a36b7b7c3d476671. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:20.961198 11649 tablet_bootstrap.cc:492] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8: Bootstrap starting.
I20260709 12:16:20.996310 11419 leader_election.cc:304] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:20.997335 11876 leader_election.cc:290] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:21.001612 11659 raft_consensus.cc:3060] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.010568 11646 tablet_bootstrap.cc:654] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.004299 11526 raft_consensus.cc:1275] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:16:21.013825 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:21.028847 11766 raft_consensus.cc:493] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:21.031306 11766 raft_consensus.cc:515] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:21.034029 11766 leader_election.cc:290] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:16:21.034336 11888 log.cc:927] Time spent T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.070s	user 0.000s	sys 0.002s
I20260709 12:16:21.038249 11750 raft_consensus.cc:493] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:21.038877 11750 raft_consensus.cc:515] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:21.040488 11451 raft_consensus.cc:1275] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:16:21.041806 11750 leader_election.cc:290] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:21.042840 11724 consensus_queue.cc:1048] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:16:21.047101 11377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:21.047979 11377 raft_consensus.cc:2468] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 0.
I20260709 12:16:21.049556 11724 consensus_queue.cc:1048] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:21.050040 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
W20260709 12:16:21.049620 11343 leader_election.cc:343] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:21.053239 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:21.068097 11602 raft_consensus.cc:3060] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.066987 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:16:21.077327 11418 leader_election.cc:343] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:21.080145 11651 tablet_bootstrap.cc:492] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d: No bootstrap required, opened a new log
I20260709 12:16:21.080720 11651 ts_tablet_manager.cc:1403] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d: Time spent bootstrapping tablet: real 0.369s	user 0.024s	sys 0.013s
I20260709 12:16:21.082619 11602 raft_consensus.cc:2468] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 1.
I20260709 12:16:21.084651 11651 raft_consensus.cc:359] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:21.085327 11651 raft_consensus.cc:385] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.086653 11651 raft_consensus.cc:740] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.090883 11659 raft_consensus.cc:2749] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:21.092234 11651 consensus_queue.cc:260] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:21.094623 11342 leader_election.cc:304] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:21.097666 11700 raft_consensus.cc:2804] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:21.098241 11700 raft_consensus.cc:697] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 1 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:16:21.099107 11700 consensus_queue.cc:237] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
W20260709 12:16:21.102968 11566 leader_election.cc:343] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:21.105448 11377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:21.092751 11647 tablet_bootstrap.cc:492] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671: No bootstrap required, opened a new log
I20260709 12:16:21.113601 11647 ts_tablet_manager.cc:1403] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671: Time spent bootstrapping tablet: real 0.371s	user 0.028s	sys 0.031s
I20260709 12:16:21.115010 11419 leader_election.cc:304] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:21.094044 11649 tablet_bootstrap.cc:654] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.116703 11651 ts_tablet_manager.cc:1434] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 12:16:21.117955 11647 raft_consensus.cc:359] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:21.119236 11647 raft_consensus.cc:385] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.119553 11647 raft_consensus.cc:740] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.121467 11647 consensus_queue.cc:260] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:21.131065 11647 ts_tablet_manager.cc:1434] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.003s
I20260709 12:16:21.127619 11766 raft_consensus.cc:2804] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:21.144413 11646 tablet_bootstrap.cc:492] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de: No bootstrap required, opened a new log
I20260709 12:16:21.145026 11646 ts_tablet_manager.cc:1403] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.294s	user 0.019s	sys 0.008s
I20260709 12:16:21.139474 11766 raft_consensus.cc:493] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:21.135043 11710 raft_consensus.cc:493] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:21.151682 11710 raft_consensus.cc:515] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:21.152499 11651 tablet_bootstrap.cc:492] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d: Bootstrap starting.
I20260709 12:16:21.153689 11710 leader_election.cc:290] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:21.159561 11766 raft_consensus.cc:3060] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.162505 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c355b3902a4e7fb72bac6a91ea3316" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:21.170912 11750 consensus_queue.cc:1048] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:21.178615 11813 raft_consensus.cc:493] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:21.179445 11647 tablet_bootstrap.cc:492] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671: Bootstrap starting.
I20260709 12:16:21.179235 11813 raft_consensus.cc:515] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:21.180444 11651 tablet_bootstrap.cc:654] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.203549 11646 raft_consensus.cc:359] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:21.204152 11646 raft_consensus.cc:385] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.204631 11646 raft_consensus.cc:740] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
W20260709 12:16:21.209811 11567 leader_election.cc:343] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:21.210516 11567 leader_election.cc:304] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:21.212749 11866 raft_consensus.cc:2749] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:21.186272 11750 consensus_queue.cc:1048] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 12:16:21.217967 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7937e0cff84ef7a26c84247c8ffc08" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:21.220323 11766 raft_consensus.cc:515] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
W20260709 12:16:21.220479 11342 leader_election.cc:343] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:21.226259 11377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c355b3902a4e7fb72bac6a91ea3316" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:21.227982 11813 leader_election.cc:290] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:21.235132 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7937e0cff84ef7a26c84247c8ffc08" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
W20260709 12:16:21.236847 11342 leader_election.cc:343] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:21.237999 11342 leader_election.cc:304] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:16:21.205271 11646 consensus_queue.cc:260] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:21.239342 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:21.244892 11649 tablet_bootstrap.cc:492] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8: No bootstrap required, opened a new log
I20260709 12:16:21.245644 11649 ts_tablet_manager.cc:1403] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8: Time spent bootstrapping tablet: real 0.285s	user 0.028s	sys 0.023s
I20260709 12:16:21.246655 11646 ts_tablet_manager.cc:1434] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.101s	user 0.008s	sys 0.000s
I20260709 12:16:21.250690 11646 tablet_bootstrap.cc:492] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:21.246063 11876 raft_consensus.cc:2749] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:16:21.255084 11418 leader_election.cc:343] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:21.242919 11766 leader_election.cc:290] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:21.249282 11274 catalog_manager.cc:5697] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 0 to 1, leader changed from <none> to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 1 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:21.262603 11647 tablet_bootstrap.cc:654] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.272444 11646 tablet_bootstrap.cc:654] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.279968 11651 tablet_bootstrap.cc:492] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d: No bootstrap required, opened a new log
I20260709 12:16:21.281600 11651 ts_tablet_manager.cc:1403] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d: Time spent bootstrapping tablet: real 0.129s	user 0.015s	sys 0.002s
I20260709 12:16:21.284415 11651 raft_consensus.cc:359] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:21.285187 11651 raft_consensus.cc:385] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.285514 11651 raft_consensus.cc:740] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.286401 11651 consensus_queue.cc:260] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:21.293229 11651 ts_tablet_manager.cc:1434] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:16:21.297227 11493 leader_election.cc:304] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:21.289876 11855 consensus_queue.cc:1048] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:21.302910 11710 raft_consensus.cc:2749] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:21.301462 11651 tablet_bootstrap.cc:492] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d: Bootstrap starting.
I20260709 12:16:21.314971 11651 tablet_bootstrap.cc:654] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.317087 11855 consensus_queue.cc:1048] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:21.323484 11647 tablet_bootstrap.cc:492] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671: No bootstrap required, opened a new log
I20260709 12:16:21.326442 11647 ts_tablet_manager.cc:1403] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671: Time spent bootstrapping tablet: real 0.147s	user 0.006s	sys 0.019s
I20260709 12:16:21.328536 11525 raft_consensus.cc:3060] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.329596 11647 raft_consensus.cc:359] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:21.330415 11647 raft_consensus.cc:385] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.330740 11647 raft_consensus.cc:740] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.339474 11649 raft_consensus.cc:359] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:21.340996 11377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:21.344153 11377 raft_consensus.cc:3060] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.352432 11377 raft_consensus.cc:2468] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 1.
I20260709 12:16:21.353442 11649 raft_consensus.cc:385] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.356362 11649 raft_consensus.cc:740] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.357633 11649 consensus_queue.cc:260] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:21.331480 11647 consensus_queue.cc:260] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:21.362955 11647 ts_tablet_manager.cc:1434] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.000s
I20260709 12:16:21.377048 11651 tablet_bootstrap.cc:492] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d: No bootstrap required, opened a new log
I20260709 12:16:21.377590 11651 ts_tablet_manager.cc:1403] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d: Time spent bootstrapping tablet: real 0.076s	user 0.018s	sys 0.024s
I20260709 12:16:21.378712 11419 leader_election.cc:304] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:21.380117 11698 raft_consensus.cc:2804] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:21.380616 11698 raft_consensus.cc:697] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 1 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:16:21.381090 11651 raft_consensus.cc:359] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:21.381906 11651 raft_consensus.cc:385] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.381539 11698 consensus_queue.cc:237] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:21.382207 11651 raft_consensus.cc:740] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.383073 11651 consensus_queue.cc:260] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:21.385991 11651 ts_tablet_manager.cc:1434] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:16:21.387879 11651 tablet_bootstrap.cc:492] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d: Bootstrap starting.
I20260709 12:16:21.398169 11651 tablet_bootstrap.cc:654] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.406528 11647 tablet_bootstrap.cc:492] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671: Bootstrap starting.
I20260709 12:16:21.407009 11274 catalog_manager.cc:5697] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 1 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:21.397228 11646 tablet_bootstrap.cc:492] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de: No bootstrap required, opened a new log
I20260709 12:16:21.415438 11646 ts_tablet_manager.cc:1403] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.164s	user 0.012s	sys 0.003s
I20260709 12:16:21.411703 11651 tablet_bootstrap.cc:492] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d: No bootstrap required, opened a new log
I20260709 12:16:21.420773 11651 ts_tablet_manager.cc:1403] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d: Time spent bootstrapping tablet: real 0.033s	user 0.017s	sys 0.000s
I20260709 12:16:21.422518 11646 raft_consensus.cc:359] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:21.423874 11646 raft_consensus.cc:385] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.424239 11646 raft_consensus.cc:740] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.424551 11651 raft_consensus.cc:359] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:21.412317 11649 ts_tablet_manager.cc:1434] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8: Time spent starting tablet: real 0.166s	user 0.006s	sys 0.001s
I20260709 12:16:21.425043 11646 consensus_queue.cc:260] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:21.428082 11646 ts_tablet_manager.cc:1434] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:16:21.428539 11649 tablet_bootstrap.cc:492] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8: Bootstrap starting.
I20260709 12:16:21.429278 11646 tablet_bootstrap.cc:492] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:21.435292 11651 raft_consensus.cc:385] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.435724 11651 raft_consensus.cc:740] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.435967 11646 tablet_bootstrap.cc:654] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.436302 11651 consensus_queue.cc:260] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:21.435201 11649 tablet_bootstrap.cc:654] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.438325 11651 ts_tablet_manager.cc:1434] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.001s
I20260709 12:16:21.438313 11813 raft_consensus.cc:493] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:21.439085 11813 raft_consensus.cc:515] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:21.439690 11651 tablet_bootstrap.cc:492] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d: Bootstrap starting.
I20260709 12:16:21.441529 11813 leader_election.cc:290] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:21.443012 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:21.443501 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:21.444212 11450 raft_consensus.cc:2468] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 0.
I20260709 12:16:21.412497 11647 tablet_bootstrap.cc:654] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:21.444895 11343 leader_election.cc:343] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:21.445703 11342 leader_election.cc:304] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:21.446978 11813 raft_consensus.cc:2804] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:21.447443 11813 raft_consensus.cc:493] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:21.447836 11813 raft_consensus.cc:3060] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.451226 11651 tablet_bootstrap.cc:654] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.457713 11813 raft_consensus.cc:515] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:21.462744 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:21.463415 11450 raft_consensus.cc:3060] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.469558 11651 tablet_bootstrap.cc:492] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d: No bootstrap required, opened a new log
I20260709 12:16:21.470176 11651 ts_tablet_manager.cc:1403] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.003s
I20260709 12:16:21.473038 11450 raft_consensus.cc:2468] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 1.
I20260709 12:16:21.474897 11698 raft_consensus.cc:493] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:21.477486 11698 raft_consensus.cc:515] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:21.478188 11342 leader_election.cc:304] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:21.478319 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:21.479748 11698 leader_election.cc:290] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:21.480394 11876 raft_consensus.cc:2804] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:21.480930 11876 raft_consensus.cc:697] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 1 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
W20260709 12:16:21.481479 11343 leader_election.cc:343] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:21.481807 11876 consensus_queue.cc:237] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:21.482640 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:21.481622 11647 tablet_bootstrap.cc:492] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671: No bootstrap required, opened a new log
I20260709 12:16:21.483235 11525 raft_consensus.cc:2468] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 0.
I20260709 12:16:21.483384 11647 ts_tablet_manager.cc:1403] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671: Time spent bootstrapping tablet: real 0.077s	user 0.015s	sys 0.000s
I20260709 12:16:21.484550 11649 tablet_bootstrap.cc:492] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8: No bootstrap required, opened a new log
I20260709 12:16:21.485070 11649 ts_tablet_manager.cc:1403] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8: Time spent bootstrapping tablet: real 0.057s	user 0.022s	sys 0.023s
I20260709 12:16:21.484937 11418 leader_election.cc:304] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:16:21.486048 11698 raft_consensus.cc:2804] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:21.474207 11651 raft_consensus.cc:359] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:21.475533 11646 tablet_bootstrap.cc:492] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de: No bootstrap required, opened a new log
I20260709 12:16:21.476881 11813 leader_election.cc:290] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:21.487418 11646 ts_tablet_manager.cc:1403] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.058s	user 0.009s	sys 0.003s
I20260709 12:16:21.486439 11698 raft_consensus.cc:493] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:21.486766 11377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:21.488142 11698 raft_consensus.cc:3060] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.488240 11377 raft_consensus.cc:2468] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 0.
I20260709 12:16:21.490672 11646 raft_consensus.cc:359] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:21.491508 11646 raft_consensus.cc:385] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.491770 11646 raft_consensus.cc:740] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.492488 11646 consensus_queue.cc:260] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:21.486418 11647 raft_consensus.cc:359] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:21.494861 11646 ts_tablet_manager.cc:1434] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:16:21.494071 11647 raft_consensus.cc:385] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.496033 11646 tablet_bootstrap.cc:492] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:21.495851 11647 raft_consensus.cc:740] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.501503 11651 raft_consensus.cc:385] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.501137 11647 consensus_queue.cc:260] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:21.501859 11651 raft_consensus.cc:740] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.502800 11651 consensus_queue.cc:260] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:21.503983 11647 ts_tablet_manager.cc:1434] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:16:21.500061 11698 raft_consensus.cc:515] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:21.505434 11651 ts_tablet_manager.cc:1434] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 12:16:21.506420 11647 tablet_bootstrap.cc:492] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671: Bootstrap starting.
I20260709 12:16:21.513060 11647 tablet_bootstrap.cc:654] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.514987 11866 raft_consensus.cc:493] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:21.516225 11866 raft_consensus.cc:515] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:21.518700 11866 leader_election.cc:290] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:21.520545 11651 tablet_bootstrap.cc:492] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d: Bootstrap starting.
I20260709 12:16:21.520668 11377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7937e0cff84ef7a26c84247c8ffc08" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:21.524662 11377 raft_consensus.cc:2468] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 0.
I20260709 12:16:21.526273 11567 leader_election.cc:304] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:21.527598 11866 raft_consensus.cc:2804] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:21.528090 11866 raft_consensus.cc:493] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:21.528499 11866 raft_consensus.cc:3060] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.530143 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7937e0cff84ef7a26c84247c8ffc08" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:21.530846 11451 raft_consensus.cc:2468] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 0.
I20260709 12:16:21.532308 11646 tablet_bootstrap.cc:654] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.535744 11647 tablet_bootstrap.cc:492] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671: No bootstrap required, opened a new log
I20260709 12:16:21.536096 11651 tablet_bootstrap.cc:654] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.536259 11647 ts_tablet_manager.cc:1403] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.008s
I20260709 12:16:21.548681 11651 tablet_bootstrap.cc:492] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d: No bootstrap required, opened a new log
I20260709 12:16:21.549410 11651 ts_tablet_manager.cc:1403] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.000s
I20260709 12:16:21.551499 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:21.552249 11379 raft_consensus.cc:3060] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.552661 11651 raft_consensus.cc:359] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:21.553519 11651 raft_consensus.cc:385] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.553791 11651 raft_consensus.cc:740] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.554489 11651 consensus_queue.cc:260] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:21.564043 11766 raft_consensus.cc:493] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:21.564723 11766 raft_consensus.cc:515] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:21.500034 11649 raft_consensus.cc:359] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:21.565866 11649 raft_consensus.cc:385] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.566164 11649 raft_consensus.cc:740] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.557423 11274 catalog_manager.cc:5697] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 0 to 1, leader changed from <none> to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 1 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:21.568074 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:21.568279 11766 leader_election.cc:290] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
W20260709 12:16:21.569741 11418 leader_election.cc:343] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:21.570063 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:21.570813 11601 raft_consensus.cc:2468] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 0.
I20260709 12:16:21.571668 11651 ts_tablet_manager.cc:1434] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:16:21.572023 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:21.572223 11417 leader_election.cc:304] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:21.572683 11525 raft_consensus.cc:3060] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.573829 11659 raft_consensus.cc:2804] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:21.574237 11659 raft_consensus.cc:493] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:21.574570 11659 raft_consensus.cc:3060] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.566888 11649 consensus_queue.cc:260] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:21.582187 11876 raft_consensus.cc:493] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:21.582806 11876 raft_consensus.cc:515] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:21.585122 11698 leader_election.cc:290] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:21.586808 11651 tablet_bootstrap.cc:492] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d: Bootstrap starting.
I20260709 12:16:21.587448 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:16:21.592869 11343 leader_election.cc:343] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:21.594460 11651 tablet_bootstrap.cc:654] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.539683 11647 raft_consensus.cc:359] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:21.600979 11647 raft_consensus.cc:385] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.604605 11647 raft_consensus.cc:740] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.604977 11525 raft_consensus.cc:2468] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 1.
I20260709 12:16:21.600101 11659 raft_consensus.cc:515] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:21.606472 11418 leader_election.cc:304] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:16:21.607470 11647 consensus_queue.cc:260] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:21.608362 11766 raft_consensus.cc:2804] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:21.609166 11766 raft_consensus.cc:697] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 1 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:16:21.610090 11766 consensus_queue.cc:237] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:21.612448 11647 ts_tablet_manager.cc:1434] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671: Time spent starting tablet: real 0.076s	user 0.005s	sys 0.001s
I20260709 12:16:21.640193 11647 tablet_bootstrap.cc:492] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671: Bootstrap starting.
I20260709 12:16:21.614498 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:21.642681 11601 raft_consensus.cc:3060] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.645279 11646 tablet_bootstrap.cc:492] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de: No bootstrap required, opened a new log
I20260709 12:16:21.645910 11646 ts_tablet_manager.cc:1403] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.150s	user 0.022s	sys 0.028s
I20260709 12:16:21.652376 11646 raft_consensus.cc:359] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:21.653201 11646 raft_consensus.cc:385] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.653525 11646 raft_consensus.cc:740] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.654289 11646 consensus_queue.cc:260] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:21.657158 11646 ts_tablet_manager.cc:1434] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:16:21.615017 11379 raft_consensus.cc:2468] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 1.
I20260709 12:16:21.617199 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:21.624213 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:21.660573 11602 raft_consensus.cc:2468] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 0.
I20260709 12:16:21.626070 11876 leader_election.cc:290] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
W20260709 12:16:21.661904 11418 leader_election.cc:343] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:21.628161 11649 ts_tablet_manager.cc:1434] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8: Time spent starting tablet: real 0.143s	user 0.006s	sys 0.002s
I20260709 12:16:21.631395 11651 tablet_bootstrap.cc:492] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d: No bootstrap required, opened a new log
I20260709 12:16:21.634675 11866 raft_consensus.cc:515] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:21.663772 11651 ts_tablet_manager.cc:1403] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d: Time spent bootstrapping tablet: real 0.077s	user 0.018s	sys 0.007s
I20260709 12:16:21.664224 11649 tablet_bootstrap.cc:492] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8: Bootstrap starting.
I20260709 12:16:21.613477 11659 leader_election.cc:290] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:21.658735 11646 tablet_bootstrap.cc:492] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:21.665236 11866 leader_election.cc:290] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:21.667685 11342 leader_election.cc:304] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:21.668063 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7937e0cff84ef7a26c84247c8ffc08" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:21.668784 11451 raft_consensus.cc:3060] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.671407 11651 raft_consensus.cc:359] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:21.672914 11651 raft_consensus.cc:385] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.673414 11651 raft_consensus.cc:740] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.675239 11813 raft_consensus.cc:2804] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:21.675288 11876 consensus_queue.cc:1048] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:21.675732 11813 raft_consensus.cc:493] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:21.676086 11813 raft_consensus.cc:3060] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.677654 11651 consensus_queue.cc:260] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:21.678627 11526 raft_consensus.cc:3060] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.682546 11649 tablet_bootstrap.cc:654] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.683960 11813 raft_consensus.cc:515] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:21.684664 11651 ts_tablet_manager.cc:1434] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:16:21.685873 11651 tablet_bootstrap.cc:492] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d: Bootstrap starting.
I20260709 12:16:21.687124 11813 leader_election.cc:290] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:21.687359 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:21.688249 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
W20260709 12:16:21.688714 11343 leader_election.cc:343] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:21.688869 11602 raft_consensus.cc:3060] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.691761 11651 tablet_bootstrap.cc:654] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.696480 11700 raft_consensus.cc:493] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:21.697861 11700 raft_consensus.cc:515] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:21.699059 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7937e0cff84ef7a26c84247c8ffc08" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:21.700155 11700 leader_election.cc:290] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:21.702118 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:21.722021 11379 raft_consensus.cc:3060] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.722213 11649 tablet_bootstrap.cc:492] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8: No bootstrap required, opened a new log
I20260709 12:16:21.722924 11649 ts_tablet_manager.cc:1403] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8: Time spent bootstrapping tablet: real 0.059s	user 0.015s	sys 0.000s
I20260709 12:16:21.725689 11649 raft_consensus.cc:359] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:21.726382 11649 raft_consensus.cc:385] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.727588 11651 tablet_bootstrap.cc:492] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d: No bootstrap required, opened a new log
W20260709 12:16:21.727730 11342 leader_election.cc:343] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:21.728219 11651 ts_tablet_manager.cc:1403] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d: Time spent bootstrapping tablet: real 0.043s	user 0.017s	sys 0.000s
I20260709 12:16:21.726666 11649 raft_consensus.cc:740] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.729230 11649 consensus_queue.cc:260] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:21.732117 11649 ts_tablet_manager.cc:1434] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:16:21.733119 11649 tablet_bootstrap.cc:492] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8: Bootstrap starting.
I20260709 12:16:21.726629 11451 raft_consensus.cc:2468] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 1.
I20260709 12:16:21.734517 11565 leader_election.cc:304] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:16:21.735324 11735 raft_consensus.cc:2804] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:21.735812 11735 raft_consensus.cc:697] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:21.736627 11735 consensus_queue.cc:237] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:21.738343 11651 raft_consensus.cc:359] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:21.705237 11646 tablet_bootstrap.cc:654] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.739439 11651 raft_consensus.cc:385] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.739775 11651 raft_consensus.cc:740] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.740501 11651 consensus_queue.cc:260] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:21.708174 11788 raft_consensus.cc:493] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:21.742246 11788 raft_consensus.cc:515] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:21.742612 11651 ts_tablet_manager.cc:1434] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:16:21.743934 11651 tablet_bootstrap.cc:492] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d: Bootstrap starting.
I20260709 12:16:21.744505 11788 leader_election.cc:290] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:21.718955 11602 raft_consensus.cc:2468] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 1.
I20260709 12:16:21.746207 11377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:21.747779 11377 raft_consensus.cc:2393] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 1: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:16:21.748159 11342 leader_election.cc:304] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:21.745759 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:21.750133 11651 tablet_bootstrap.cc:654] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.750593 11876 raft_consensus.cc:2804] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:21.750713 11491 leader_election.cc:304] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:21.751224 11876 raft_consensus.cc:697] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 1 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:16:21.752467 11788 raft_consensus.cc:3060] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.752287 11876 consensus_queue.cc:237] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:21.758744 11646 tablet_bootstrap.cc:492] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de: No bootstrap required, opened a new log
I20260709 12:16:21.761642 11788 raft_consensus.cc:2749] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:21.765970 11646 ts_tablet_manager.cc:1403] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.108s	user 0.014s	sys 0.003s
I20260709 12:16:21.769297 11646 raft_consensus.cc:359] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:21.770076 11646 raft_consensus.cc:385] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.770358 11646 raft_consensus.cc:740] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.771059 11649 tablet_bootstrap.cc:654] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.720500 11601 raft_consensus.cc:2468] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 1.
I20260709 12:16:21.721272 11277 catalog_manager.cc:5697] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 1 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:21.719856 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:21.703622 11647 tablet_bootstrap.cc:654] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.694780 11813 consensus_queue.cc:1048] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:16:21.776542 11417 leader_election.cc:304] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:21.778106 11766 raft_consensus.cc:2804] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:21.778645 11766 raft_consensus.cc:697] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 1 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:16:21.779615 11766 consensus_queue.cc:237] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:21.792994 11659 raft_consensus.cc:493] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:21.793946 11659 raft_consensus.cc:515] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:21.797211 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390e91331fd04f97a5235133a34875ee" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:16:21.799086 11418 leader_election.cc:343] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:21.806185 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390e91331fd04f97a5235133a34875ee" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:21.807219 11659 leader_election.cc:290] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:21.807708 11602 raft_consensus.cc:2468] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 0.
I20260709 12:16:21.771188 11646 consensus_queue.cc:260] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:21.809053 11417 leader_election.cc:304] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:21.810467 11647 tablet_bootstrap.cc:492] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671: No bootstrap required, opened a new log
I20260709 12:16:21.810647 11659 raft_consensus.cc:2804] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:21.811040 11647 ts_tablet_manager.cc:1403] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671: Time spent bootstrapping tablet: real 0.171s	user 0.008s	sys 0.002s
I20260709 12:16:21.814801 11647 raft_consensus.cc:359] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:21.815794 11659 raft_consensus.cc:493] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:21.817097 11659 raft_consensus.cc:3060] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.815709 11647 raft_consensus.cc:385] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.818150 11647 raft_consensus.cc:740] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.818854 11646 ts_tablet_manager.cc:1434] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.001s
I20260709 12:16:21.823592 11898 raft_consensus.cc:493] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:21.824273 11898 raft_consensus.cc:515] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
W20260709 12:16:21.824482 11343 leader_election.cc:343] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:21.825214 11343 leader_election.cc:304] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:21.826210 11700 raft_consensus.cc:2749] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:21.826956 11898 leader_election.cc:290] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:21.819022 11647 consensus_queue.cc:260] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:21.829087 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:21.829933 11647 ts_tablet_manager.cc:1434] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:16:21.831040 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:21.831805 11602 raft_consensus.cc:2468] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 0.
I20260709 12:16:21.832844 11342 leader_election.cc:304] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:21.834067 11898 raft_consensus.cc:2804] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:21.834465 11898 raft_consensus.cc:493] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:21.834956 11898 raft_consensus.cc:3060] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.829900 11454 raft_consensus.cc:2468] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 0.
I20260709 12:16:21.837294 11274 catalog_manager.cc:5697] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 1 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:21.822795 11646 tablet_bootstrap.cc:492] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:21.845536 11898 raft_consensus.cc:515] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:21.852377 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:21.853008 11602 raft_consensus.cc:3060] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.846098 11647 tablet_bootstrap.cc:492] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671: Bootstrap starting.
I20260709 12:16:21.863173 11602 raft_consensus.cc:2468] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 1.
I20260709 12:16:21.871783 11898 leader_election.cc:290] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:21.873718 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:21.874557 11451 raft_consensus.cc:3060] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.877490 11342 leader_election.cc:304] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:21.891844 11647 tablet_bootstrap.cc:654] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.883281 11898 raft_consensus.cc:2804] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:21.944172 11898 raft_consensus.cc:697] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 1 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:16:21.978027 11647 tablet_bootstrap.cc:492] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671: No bootstrap required, opened a new log
W20260709 12:16:21.978278 11343 consensus_peers.cc:597] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de -> Peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Couldn't send request to peer a03223e9e41247c3a36b7b7c3d476671. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:21.979831 11647 ts_tablet_manager.cc:1403] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671: Time spent bootstrapping tablet: real 0.134s	user 0.016s	sys 0.007s
I20260709 12:16:21.981446 11884 consensus_queue.cc:1048] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:21.985208 11647 raft_consensus.cc:359] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:21.986375 11647 raft_consensus.cc:385] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.986713 11647 raft_consensus.cc:740] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.987475 11647 consensus_queue.cc:260] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:21.996989 11647 ts_tablet_manager.cc:1434] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.003s
I20260709 12:16:21.999547 11647 tablet_bootstrap.cc:492] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671: Bootstrap starting.
I20260709 12:16:22.006801 11651 tablet_bootstrap.cc:492] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d: No bootstrap required, opened a new log
I20260709 12:16:22.007356 11651 ts_tablet_manager.cc:1403] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d: Time spent bootstrapping tablet: real 0.264s	user 0.031s	sys 0.057s
I20260709 12:16:22.008989 11898 consensus_queue.cc:237] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:22.010936 11651 raft_consensus.cc:359] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:22.011808 11651 raft_consensus.cc:385] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:22.012152 11651 raft_consensus.cc:740] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.012833 11651 consensus_queue.cc:260] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:22.013228 11659 raft_consensus.cc:515] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:22.015092 11651 ts_tablet_manager.cc:1434] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:16:22.016108 11651 tablet_bootstrap.cc:492] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d: Bootstrap starting.
I20260709 12:16:22.016745 11659 leader_election.cc:290] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:22.017189 11646 tablet_bootstrap.cc:654] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:22.020579 11649 tablet_bootstrap.cc:492] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8: No bootstrap required, opened a new log
I20260709 12:16:22.021090 11649 ts_tablet_manager.cc:1403] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8: Time spent bootstrapping tablet: real 0.288s	user 0.065s	sys 0.131s
I20260709 12:16:22.023260 11651 tablet_bootstrap.cc:654] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:22.023941 11649 raft_consensus.cc:359] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:22.024742 11649 raft_consensus.cc:385] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:22.025137 11649 raft_consensus.cc:740] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.087440 11451 raft_consensus.cc:2468] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 1.
I20260709 12:16:22.096200 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390e91331fd04f97a5235133a34875ee" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:22.126408 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390e91331fd04f97a5235133a34875ee" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:22.127512 11601 raft_consensus.cc:3060] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:22.141835 11935 consensus_queue.cc:1048] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:16:22.148778 11273 catalog_manager.cc:5697] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 1 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:22.124140 11274 catalog_manager.cc:5697] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 0 to 1, leader changed from <none> to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 1 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } }
W20260709 12:16:22.162564 11418 leader_election.cc:343] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:22.165910 11766 raft_consensus.cc:493] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:22.107352 11649 consensus_queue.cc:260] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
W20260709 12:16:22.201751 11325 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:22.206108 11788 raft_consensus.cc:493] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:22.206934 11788 raft_consensus.cc:515] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:22.208765 11935 raft_consensus.cc:493] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:22.210047 11788 leader_election.cc:290] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:22.210565 11659 consensus_queue.cc:1048] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260709 12:16:22.218947 11937 raft_consensus.cc:493] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:22.219830 11937 raft_consensus.cc:515] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:22.222363 11647 tablet_bootstrap.cc:654] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:22.204919 11710 raft_consensus.cc:493] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:22.229876 11710 raft_consensus.cc:515] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:22.232924 11710 leader_election.cc:290] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:22.209751 11935 raft_consensus.cc:515] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:22.166746 11766 raft_consensus.cc:515] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:22.265009 11651 tablet_bootstrap.cc:492] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d: No bootstrap required, opened a new log
W20260709 12:16:22.262744 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 94995.3us
I20260709 12:16:22.281327 11937 leader_election.cc:290] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:22.285908 11813 raft_consensus.cc:493] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:22.297281 11651 ts_tablet_manager.cc:1403] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d: Time spent bootstrapping tablet: real 0.281s	user 0.011s	sys 0.003s
I20260709 12:16:22.320484 11935 leader_election.cc:290] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:22.321537 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:22.339627 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8741606df54c3f8b5cc5c1141862ea" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:22.317989 11948 raft_consensus.cc:493] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:22.340710 11948 raft_consensus.cc:515] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
W20260709 12:16:22.342411 11418 leader_election.cc:343] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:22.301262 11813 raft_consensus.cc:515] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:22.343892 11947 consensus_queue.cc:1048] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:22.344353 11646 tablet_bootstrap.cc:492] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de: No bootstrap required, opened a new log
I20260709 12:16:22.344995 11766 leader_election.cc:290] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:22.350247 11524 raft_consensus.cc:3060] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:22.364836 11948 leader_election.cc:290] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:22.365600 11374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:22.367641 11646 ts_tablet_manager.cc:1403] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.545s	user 0.022s	sys 0.011s
I20260709 12:16:22.368686 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:22.376312 11647 tablet_bootstrap.cc:492] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671: No bootstrap required, opened a new log
I20260709 12:16:22.321602 11378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:16:22.370466 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 99067.9us
I20260709 12:16:22.385453 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:22.386408 11454 raft_consensus.cc:2468] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 0.
W20260709 12:16:22.391302 11379 consensus_meta.cc:287] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de: Time spent flushing consensus metadata: real 0.669s	user 0.007s	sys 0.014s
I20260709 12:16:22.392616 11651 raft_consensus.cc:359] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:22.393759 11651 raft_consensus.cc:385] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:22.394160 11651 raft_consensus.cc:740] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.369942 11813 leader_election.cc:290] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:22.377355 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:22.402588 11649 ts_tablet_manager.cc:1434] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8: Time spent starting tablet: real 0.381s	user 0.007s	sys 0.010s
I20260709 12:16:22.405791 11649 tablet_bootstrap.cc:492] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8: Bootstrap starting.
W20260709 12:16:22.408529 11418 leader_election.cc:343] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:22.409868 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:22.416523 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:22.420364 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8741606df54c3f8b5cc5c1141862ea" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:22.421909 11601 raft_consensus.cc:2468] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 1.
W20260709 12:16:22.427196 11566 leader_election.cc:343] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:22.435292 11417 leader_election.cc:343] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:22.435691 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:22.435985 11417 leader_election.cc:304] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:22.436723 11598 raft_consensus.cc:2393] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 1: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:16:22.441802 11884 raft_consensus.cc:2749] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:16:22.445466 11567 leader_election.cc:343] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:22.446022 11567 leader_election.cc:304] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:22.452389 11866 raft_consensus.cc:2749] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:22.452083 11651 consensus_queue.cc:260] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:22.455701 11651 ts_tablet_manager.cc:1434] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d: Time spent starting tablet: real 0.158s	user 0.006s	sys 0.002s
I20260709 12:16:22.456875 11651 tablet_bootstrap.cc:492] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d: Bootstrap starting.
I20260709 12:16:22.457717 11647 ts_tablet_manager.cc:1403] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671: Time spent bootstrapping tablet: real 0.459s	user 0.011s	sys 0.016s
I20260709 12:16:22.461988 11417 leader_election.cc:304] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:22.463912 11884 raft_consensus.cc:2804] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:22.464556 11884 raft_consensus.cc:697] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [term 1 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:16:22.465876 11884 consensus_queue.cc:237] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:22.472177 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:16:22.473565 11417 leader_election.cc:343] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:22.475028 11646 raft_consensus.cc:359] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:22.475914 11646 raft_consensus.cc:385] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:22.476332 11646 raft_consensus.cc:740] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.477238 11646 consensus_queue.cc:260] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:22.393193 11379 raft_consensus.cc:2468] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 1.
I20260709 12:16:22.489741 11491 leader_election.cc:304] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:16:22.491197 11710 raft_consensus.cc:2749] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:22.461166 11647 raft_consensus.cc:359] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:22.499116 11647 raft_consensus.cc:385] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:22.499513 11647 raft_consensus.cc:740] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Initialized, Role: FOLLOWER
W20260709 12:16:22.504647 11342 leader_election.cc:343] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:22.504262 11646 ts_tablet_manager.cc:1434] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.124s	user 0.004s	sys 0.004s
I20260709 12:16:22.505911 11813 consensus_queue.cc:1048] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:22.510088 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:22.511476 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:22.512248 11493 leader_election.cc:304] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:22.536219 11651 tablet_bootstrap.cc:654] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:22.559023 11375 raft_consensus.cc:2468] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 0.
I20260709 12:16:22.538385 11525 raft_consensus.cc:3060] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:22.517833 11647 consensus_queue.cc:260] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:22.515951 11342 leader_election.cc:304] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8
W20260709 12:16:22.563189 11342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 48770.1us
I20260709 12:16:22.565699 11700 consensus_queue.cc:1048] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:22.561231 11646 tablet_bootstrap.cc:492] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:22.560396 11379 raft_consensus.cc:2468] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 0.
I20260709 12:16:22.567802 11941 raft_consensus.cc:2804] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:22.571789 11788 raft_consensus.cc:2749] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:22.572836 11649 tablet_bootstrap.cc:654] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:22.580186 11813 consensus_queue.cc:1048] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:16:22.591032 11647 ts_tablet_manager.cc:1434] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671: Time spent starting tablet: real 0.133s	user 0.011s	sys 0.006s
I20260709 12:16:22.595772 11647 tablet_bootstrap.cc:492] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671: Bootstrap starting.
W20260709 12:16:22.596892 11631 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.IsCreateTableDone -> {remote=127.3.212.190:40671, user_credentials={real_user=slave}} blocked reactor thread for 62411.5us
I20260709 12:16:22.610570 11866 consensus_queue.cc:1048] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:16:22.619180 11959 raft_consensus.cc:493] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:22.619984 11959 raft_consensus.cc:515] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:22.623184 11941 raft_consensus.cc:493] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:22.623718 11941 raft_consensus.cc:3060] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:22.626302 11646 tablet_bootstrap.cc:654] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:22.623569 11959 leader_election.cc:290] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:22.633571 11948 consensus_queue.cc:1048] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:22.635208 11373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:22.635251 11275 catalog_manager.cc:5697] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 1 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:22.657986 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:22.637681 11274 catalog_manager.cc:5697] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 0 to 1, leader changed from <none> to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 1 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:22.660778 11454 raft_consensus.cc:2393] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 1: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:16:22.664606 11949 consensus_queue.cc:1048] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:22.670800 11700 consensus_queue.cc:1048] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:22.672013 11651 tablet_bootstrap.cc:492] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d: No bootstrap required, opened a new log
I20260709 12:16:22.672577 11651 ts_tablet_manager.cc:1403] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d: Time spent bootstrapping tablet: real 0.216s	user 0.020s	sys 0.004s
I20260709 12:16:22.678007 11698 consensus_queue.cc:1048] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 12:16:22.679461 11876 raft_consensus.cc:493] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:22.680055 11876 raft_consensus.cc:515] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:22.680809 11647 tablet_bootstrap.cc:654] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:22.682427 11419 leader_election.cc:304] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:22.682766 11876 leader_election.cc:290] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:22.683727 11698 raft_consensus.cc:2804] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:22.684114 11698 raft_consensus.cc:493] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:22.684434 11698 raft_consensus.cc:3060] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:22.691084 11419 leader_election.cc:304] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:16:22.692066 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:22.694561 11651 raft_consensus.cc:359] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:22.698364 11651 raft_consensus.cc:385] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:22.698714 11651 raft_consensus.cc:740] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.701591 11659 raft_consensus.cc:2804] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:22.702095 11659 raft_consensus.cc:493] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:22.702450 11659 raft_consensus.cc:3060] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:22.703713 11491 leader_election.cc:304] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:22.706831 11788 raft_consensus.cc:3060] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:22.714612 11651 consensus_queue.cc:260] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:22.719386 11651 ts_tablet_manager.cc:1434] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.001s
I20260709 12:16:22.720553 11651 tablet_bootstrap.cc:492] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d: Bootstrap starting.
I20260709 12:16:22.705747 11601 raft_consensus.cc:2468] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 0.
I20260709 12:16:22.737340 11941 raft_consensus.cc:515] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:22.750348 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:16:22.758734 11343 leader_election.cc:343] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:22.765751 11788 raft_consensus.cc:2749] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:22.771304 11342 leader_election.cc:304] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:22.775130 11942 raft_consensus.cc:2804] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:22.775556 11942 raft_consensus.cc:493] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:22.775883 11942 raft_consensus.cc:3060] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:22.770196 11947 raft_consensus.cc:493] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:22.793798 11947 raft_consensus.cc:515] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:22.797046 11947 leader_election.cc:290] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:22.797712 11898 consensus_queue.cc:1048] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 12:16:22.846303 11659 raft_consensus.cc:515] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:22.848656 11659 leader_election.cc:290] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:22.850435 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:22.853899 11651 tablet_bootstrap.cc:654] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:22.843389 11698 raft_consensus.cc:515] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:22.838888 11941 leader_election.cc:290] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:22.871409 11649 tablet_bootstrap.cc:492] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8: No bootstrap required, opened a new log
I20260709 12:16:22.872171 11649 ts_tablet_manager.cc:1403] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8: Time spent bootstrapping tablet: real 0.468s	user 0.019s	sys 0.009s
I20260709 12:16:22.873366 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:22.877717 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:22.878799 11375 raft_consensus.cc:2393] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 1: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:16:22.900041 11646 tablet_bootstrap.cc:492] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de: No bootstrap required, opened a new log
I20260709 12:16:22.900650 11646 ts_tablet_manager.cc:1403] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.340s	user 0.012s	sys 0.009s
I20260709 12:16:22.901491 11698 leader_election.cc:290] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:16:22.926554 11342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 140640us
I20260709 12:16:22.929107 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:22.930081 11452 raft_consensus.cc:2393] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 1: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
W20260709 12:16:22.956089 11418 leader_election.cc:343] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:22.957501 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:22.925580 11942 raft_consensus.cc:515] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:22.960107 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
W20260709 12:16:22.968822 11418 consensus_peers.cc:597] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d -> Peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Couldn't send request to peer a03223e9e41247c3a36b7b7c3d476671. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:22.969866 11418 leader_election.cc:343] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:22.973119 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
W20260709 12:16:22.975111 11343 leader_election.cc:343] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:22.978560 11649 raft_consensus.cc:359] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:22.979446 11649 raft_consensus.cc:385] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:22.983707 11649 raft_consensus.cc:740] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.966185 11942 leader_election.cc:290] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:22.988863 11649 consensus_queue.cc:260] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:22.991285 11649 ts_tablet_manager.cc:1434] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8: Time spent starting tablet: real 0.119s	user 0.006s	sys 0.001s
I20260709 12:16:23.000275 11647 tablet_bootstrap.cc:492] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671: No bootstrap required, opened a new log
I20260709 12:16:23.000921 11647 ts_tablet_manager.cc:1403] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671: Time spent bootstrapping tablet: real 0.409s	user 0.010s	sys 0.009s
W20260709 12:16:23.002468 11342 leader_election.cc:343] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:23.003294 11374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:23.003973 11374 raft_consensus.cc:3060] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:23.004060 11935 raft_consensus.cc:493] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.004594 11935 raft_consensus.cc:515] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:23.008637 11935 leader_election.cc:290] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:23.009963 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:23.010963 11647 raft_consensus.cc:359] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
W20260709 12:16:23.011600 11418 leader_election.cc:343] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:23.015431 11647 raft_consensus.cc:385] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.015798 11647 raft_consensus.cc:740] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.016415 11647 consensus_queue.cc:260] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:23.017686 11342 leader_election.cc:304] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:16:23.018548 11700 raft_consensus.cc:2749] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:16:23.018642 11647 ts_tablet_manager.cc:1434] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.003s
I20260709 12:16:23.018801 11373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:23.020149 11647 tablet_bootstrap.cc:492] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671: Bootstrap starting.
W20260709 12:16:23.020246 11417 leader_election.cc:343] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:23.020780 11417 leader_election.cc:304] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:23.022142 11943 raft_consensus.cc:2749] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:23.033125 11647 tablet_bootstrap.cc:654] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:23.035063 11419 leader_election.cc:343] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:23.035744 11419 leader_election.cc:304] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:23.036809 11935 raft_consensus.cc:2749] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:22.992408 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:23.061080 11599 raft_consensus.cc:3060] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:23.078100 11646 raft_consensus.cc:359] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:23.079052 11646 raft_consensus.cc:385] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.084721 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:23.085498 11601 raft_consensus.cc:3060] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:23.091100 11646 raft_consensus.cc:740] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.104053 11601 raft_consensus.cc:2468] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 1.
I20260709 12:16:23.106735 11646 consensus_queue.cc:260] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:23.144804 11646 ts_tablet_manager.cc:1434] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.244s	user 0.005s	sys 0.003s
I20260709 12:16:23.145649 11651 tablet_bootstrap.cc:492] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d: No bootstrap required, opened a new log
I20260709 12:16:23.146430 11651 ts_tablet_manager.cc:1403] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d: Time spent bootstrapping tablet: real 0.426s	user 0.017s	sys 0.017s
I20260709 12:16:23.147379 11647 tablet_bootstrap.cc:492] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671: No bootstrap required, opened a new log
I20260709 12:16:23.147935 11647 ts_tablet_manager.cc:1403] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671: Time spent bootstrapping tablet: real 0.128s	user 0.015s	sys 0.037s
I20260709 12:16:23.149238 11374 raft_consensus.cc:2468] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 1.
I20260709 12:16:23.150902 11419 leader_election.cc:304] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:23.151888 11698 raft_consensus.cc:2804] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:23.151963 11884 consensus_queue.cc:1048] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:23.152454 11698 raft_consensus.cc:697] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 1 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:16:23.153299 11649 tablet_bootstrap.cc:492] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8: Bootstrap starting.
I20260709 12:16:23.153716 11342 leader_election.cc:304] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:23.155764 11964 raft_consensus.cc:2804] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:23.156301 11964 raft_consensus.cc:697] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 1 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:16:23.157137 11964 consensus_queue.cc:237] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:23.149964 11599 raft_consensus.cc:2468] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 1.
I20260709 12:16:23.153622 11698 consensus_queue.cc:237] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:23.159818 11651 raft_consensus.cc:359] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:23.160559 11651 raft_consensus.cc:385] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.160833 11651 raft_consensus.cc:740] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.162441 11647 raft_consensus.cc:359] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:23.163084 11417 leader_election.cc:304] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:23.164675 11943 raft_consensus.cc:2804] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:23.163293 11647 raft_consensus.cc:385] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.165304 11943 raft_consensus.cc:697] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 1 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:16:23.166333 11943 consensus_queue.cc:237] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:23.164791 11651 consensus_queue.cc:260] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:23.178287 11646 tablet_bootstrap.cc:492] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:23.179103 11649 tablet_bootstrap.cc:654] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.165329 11647 raft_consensus.cc:740] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.186582 11647 consensus_queue.cc:260] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:23.195173 11649 tablet_bootstrap.cc:492] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8: No bootstrap required, opened a new log
I20260709 12:16:23.206162 11649 ts_tablet_manager.cc:1403] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8: Time spent bootstrapping tablet: real 0.113s	user 0.008s	sys 0.008s
I20260709 12:16:23.209064 11649 raft_consensus.cc:359] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:23.209870 11649 raft_consensus.cc:385] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.210150 11649 raft_consensus.cc:740] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.210847 11649 consensus_queue.cc:260] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:23.217667 11649 ts_tablet_manager.cc:1434] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:16:23.220701 11649 tablet_bootstrap.cc:492] T da8741606df54c3f8b5cc5c1141862ea P 9da53be18b0f446aaa406216e20b0ec8: Bootstrap starting.
I20260709 12:16:23.221616 11647 ts_tablet_manager.cc:1434] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671: Time spent starting tablet: real 0.073s	user 0.007s	sys 0.002s
I20260709 12:16:23.222831 11647 tablet_bootstrap.cc:492] T da8741606df54c3f8b5cc5c1141862ea P a03223e9e41247c3a36b7b7c3d476671: Bootstrap starting.
I20260709 12:16:23.230420 11651 ts_tablet_manager.cc:1434] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d: Time spent starting tablet: real 0.084s	user 0.006s	sys 0.001s
I20260709 12:16:23.231814 11651 tablet_bootstrap.cc:492] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d: Bootstrap starting.
I20260709 12:16:23.238749 11647 tablet_bootstrap.cc:654] T da8741606df54c3f8b5cc5c1141862ea P a03223e9e41247c3a36b7b7c3d476671: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.240166 11276 catalog_manager.cc:5697] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 1 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:23.242661 11276 catalog_manager.cc:5697] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 1 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:23.243759 11649 tablet_bootstrap.cc:654] T da8741606df54c3f8b5cc5c1141862ea P 9da53be18b0f446aaa406216e20b0ec8: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.260507 11651 tablet_bootstrap.cc:654] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.263260 11646 tablet_bootstrap.cc:654] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.299049 11524 raft_consensus.cc:3060] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:23.302107 11325 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:23.319169 11274 catalog_manager.cc:5697] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 0 to 1, leader changed from <none> to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 1 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:23.342046 11647 tablet_bootstrap.cc:492] T da8741606df54c3f8b5cc5c1141862ea P a03223e9e41247c3a36b7b7c3d476671: No bootstrap required, opened a new log
I20260709 12:16:23.342635 11647 ts_tablet_manager.cc:1403] T da8741606df54c3f8b5cc5c1141862ea P a03223e9e41247c3a36b7b7c3d476671: Time spent bootstrapping tablet: real 0.120s	user 0.010s	sys 0.007s
I20260709 12:16:23.347715 11647 raft_consensus.cc:359] T da8741606df54c3f8b5cc5c1141862ea P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:23.348453 11647 raft_consensus.cc:385] T da8741606df54c3f8b5cc5c1141862ea P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.348755 11647 raft_consensus.cc:740] T da8741606df54c3f8b5cc5c1141862ea P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.354775 11647 consensus_queue.cc:260] T da8741606df54c3f8b5cc5c1141862ea P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:23.360124 11647 ts_tablet_manager.cc:1434] T da8741606df54c3f8b5cc5c1141862ea P a03223e9e41247c3a36b7b7c3d476671: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:16:23.366354 11647 tablet_bootstrap.cc:492] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671: Bootstrap starting.
I20260709 12:16:23.376861 11646 tablet_bootstrap.cc:492] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de: No bootstrap required, opened a new log
I20260709 12:16:23.377553 11646 ts_tablet_manager.cc:1403] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.200s	user 0.030s	sys 0.040s
I20260709 12:16:23.380681 11646 raft_consensus.cc:359] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:23.381572 11646 raft_consensus.cc:385] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.381858 11646 raft_consensus.cc:740] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.382803 11646 consensus_queue.cc:260] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:23.385963 11646 ts_tablet_manager.cc:1434] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 12:16:23.387648 11646 tablet_bootstrap.cc:492] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:23.394182 11698 raft_consensus.cc:493] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.394896 11698 raft_consensus.cc:515] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:23.395438 11646 tablet_bootstrap.cc:654] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.398324 11698 leader_election.cc:290] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:23.398726 11374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:23.399930 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:16:23.400611 11419 leader_election.cc:343] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:23.376863 11649 tablet_bootstrap.cc:492] T da8741606df54c3f8b5cc5c1141862ea P 9da53be18b0f446aaa406216e20b0ec8: No bootstrap required, opened a new log
I20260709 12:16:23.401985 11649 ts_tablet_manager.cc:1403] T da8741606df54c3f8b5cc5c1141862ea P 9da53be18b0f446aaa406216e20b0ec8: Time spent bootstrapping tablet: real 0.182s	user 0.022s	sys 0.017s
W20260709 12:16:23.402163 11417 leader_election.cc:343] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:23.405413 11417 leader_election.cc:304] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:23.410893 11651 tablet_bootstrap.cc:492] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d: No bootstrap required, opened a new log
I20260709 12:16:23.411444 11651 ts_tablet_manager.cc:1403] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d: Time spent bootstrapping tablet: real 0.180s	user 0.018s	sys 0.016s
I20260709 12:16:23.411898 11649 raft_consensus.cc:359] T da8741606df54c3f8b5cc5c1141862ea P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:23.412569 11649 raft_consensus.cc:385] T da8741606df54c3f8b5cc5c1141862ea P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.412782 11649 raft_consensus.cc:740] T da8741606df54c3f8b5cc5c1141862ea P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.413571 11649 consensus_queue.cc:260] T da8741606df54c3f8b5cc5c1141862ea P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:23.411420 11698 raft_consensus.cc:2749] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:23.414815 11651 raft_consensus.cc:359] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:23.415560 11651 raft_consensus.cc:385] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.415889 11649 ts_tablet_manager.cc:1434] T da8741606df54c3f8b5cc5c1141862ea P 9da53be18b0f446aaa406216e20b0ec8: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.003s
I20260709 12:16:23.415727 11647 tablet_bootstrap.cc:654] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.417196 11649 tablet_bootstrap.cc:492] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8: Bootstrap starting.
I20260709 12:16:23.415834 11651 raft_consensus.cc:740] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.419138 11898 raft_consensus.cc:493] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.420148 11651 consensus_queue.cc:260] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:23.420842 11898 raft_consensus.cc:515] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:23.423755 11651 ts_tablet_manager.cc:1434] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:16:23.424855 11649 tablet_bootstrap.cc:654] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.425266 11898 leader_election.cc:290] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:23.425467 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:23.426195 11453 raft_consensus.cc:2468] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 0.
I20260709 12:16:23.426252 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:23.427714 11342 leader_election.cc:304] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:23.428560 11898 raft_consensus.cc:2804] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:23.428967 11898 raft_consensus.cc:493] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:23.429313 11898 raft_consensus.cc:3060] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:23.432909 11646 tablet_bootstrap.cc:492] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de: No bootstrap required, opened a new log
I20260709 12:16:23.433490 11646 ts_tablet_manager.cc:1403] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.046s	user 0.014s	sys 0.000s
I20260709 12:16:23.424894 11651 tablet_bootstrap.cc:492] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d: Bootstrap starting.
I20260709 12:16:23.436264 11646 raft_consensus.cc:359] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:23.437026 11646 raft_consensus.cc:385] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.437288 11646 raft_consensus.cc:740] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.445362 11651 tablet_bootstrap.cc:654] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.446023 11646 consensus_queue.cc:260] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:23.449712 11649 tablet_bootstrap.cc:492] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8: No bootstrap required, opened a new log
W20260709 12:16:23.469661 11343 leader_election.cc:343] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:23.470513 11649 ts_tablet_manager.cc:1403] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8: Time spent bootstrapping tablet: real 0.054s	user 0.005s	sys 0.007s
I20260709 12:16:23.472769 11898 raft_consensus.cc:515] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:23.473865 11649 raft_consensus.cc:359] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:23.474673 11649 raft_consensus.cc:385] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.474985 11649 raft_consensus.cc:740] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.475355 11646 ts_tablet_manager.cc:1434] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260709 12:16:23.475898 11649 consensus_queue.cc:260] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:23.477315 11646 tablet_bootstrap.cc:492] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:23.478873 11649 ts_tablet_manager.cc:1434] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:16:23.488185 11646 tablet_bootstrap.cc:654] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.490573 11649 tablet_bootstrap.cc:492] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8: Bootstrap starting.
I20260709 12:16:23.499284 11651 tablet_bootstrap.cc:492] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d: No bootstrap required, opened a new log
I20260709 12:16:23.499871 11651 ts_tablet_manager.cc:1403] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d: Time spent bootstrapping tablet: real 0.075s	user 0.014s	sys 0.000s
I20260709 12:16:23.503053 11651 raft_consensus.cc:359] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:23.503785 11651 raft_consensus.cc:385] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.504413 11651 raft_consensus.cc:740] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.505115 11651 consensus_queue.cc:260] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:23.506036 11647 tablet_bootstrap.cc:492] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671: No bootstrap required, opened a new log
I20260709 12:16:23.506560 11647 ts_tablet_manager.cc:1403] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671: Time spent bootstrapping tablet: real 0.141s	user 0.017s	sys 0.010s
I20260709 12:16:23.507342 11651 ts_tablet_manager.cc:1434] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:16:23.507575 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:23.508536 11651 tablet_bootstrap.cc:492] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d: Bootstrap starting.
W20260709 12:16:23.510331 11343 leader_election.cc:343] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:23.511196 11964 raft_consensus.cc:493] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.511754 11964 raft_consensus.cc:515] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:23.514842 11651 tablet_bootstrap.cc:654] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.519785 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:23.520503 11453 raft_consensus.cc:3060] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:23.513652 11647 raft_consensus.cc:359] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:23.525765 11647 raft_consensus.cc:385] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.526182 11647 raft_consensus.cc:740] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.528659 11647 consensus_queue.cc:260] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:23.532126 11647 ts_tablet_manager.cc:1434] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.003s
I20260709 12:16:23.542071 11647 tablet_bootstrap.cc:492] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671: Bootstrap starting.
I20260709 12:16:23.542740 11964 leader_election.cc:290] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:23.542996 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:23.543584 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:16:23.545344 11343 leader_election.cc:343] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:23.543684 11600 raft_consensus.cc:2468] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 0.
I20260709 12:16:23.548134 11342 leader_election.cc:304] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:23.550275 11963 raft_consensus.cc:2804] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:23.550741 11963 raft_consensus.cc:493] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:23.551122 11963 raft_consensus.cc:3060] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:23.556485 11866 raft_consensus.cc:493] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.503767 11898 leader_election.cc:290] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:23.564534 11453 raft_consensus.cc:2468] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 1.
I20260709 12:16:23.564718 11948 consensus_queue.cc:1048] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:23.571200 11342 leader_election.cc:304] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:23.572891 11975 raft_consensus.cc:2804] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:23.574026 11948 raft_consensus.cc:493] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.574594 11948 raft_consensus.cc:515] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:23.557118 11866 raft_consensus.cc:515] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:23.587965 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:23.588824 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:16:23.589727 11417 leader_election.cc:343] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:23.591315 11948 leader_election.cc:290] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
W20260709 12:16:23.592298 11418 leader_election.cc:343] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:23.594230 11418 leader_election.cc:304] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:23.594965 11943 raft_consensus.cc:2749] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:23.597289 11651 tablet_bootstrap.cc:492] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d: No bootstrap required, opened a new log
I20260709 12:16:23.597971 11651 ts_tablet_manager.cc:1403] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d: Time spent bootstrapping tablet: real 0.090s	user 0.030s	sys 0.028s
I20260709 12:16:23.598898 11646 tablet_bootstrap.cc:492] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de: No bootstrap required, opened a new log
I20260709 12:16:23.599934 11646 ts_tablet_manager.cc:1403] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.123s	user 0.039s	sys 0.034s
I20260709 12:16:23.612783 11646 raft_consensus.cc:359] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:23.613561 11646 raft_consensus.cc:385] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.613844 11646 raft_consensus.cc:740] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.614681 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:23.615356 11646 consensus_queue.cc:260] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:23.615983 11651 raft_consensus.cc:359] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:23.617004 11651 raft_consensus.cc:385] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.617260 11651 raft_consensus.cc:740] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.615401 11451 raft_consensus.cc:2468] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 0.
I20260709 12:16:23.619740 11565 leader_election.cc:304] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:16:23.621171 11646 ts_tablet_manager.cc:1434] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260709 12:16:23.621347 11946 raft_consensus.cc:2804] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:23.622213 11946 raft_consensus.cc:493] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:23.622565 11946 raft_consensus.cc:3060] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:23.622375 11646 tablet_bootstrap.cc:492] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:23.623246 11866 leader_election.cc:290] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:23.624986 11963 raft_consensus.cc:515] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:23.626693 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:16:23.628245 11566 leader_election.cc:343] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:23.633285 11649 tablet_bootstrap.cc:654] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.620543 11975 raft_consensus.cc:697] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 1 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:16:23.636461 11942 raft_consensus.cc:493] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.650223 11942 raft_consensus.cc:515] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:23.651511 11963 leader_election.cc:290] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:23.620257 11651 consensus_queue.cc:260] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:23.652364 11942 leader_election.cc:290] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:23.643404 11525 raft_consensus.cc:3060] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:23.653657 11651 ts_tablet_manager.cc:1434] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d: Time spent starting tablet: real 0.055s	user 0.006s	sys 0.000s
I20260709 12:16:23.651799 11946 raft_consensus.cc:515] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:23.650679 11647 tablet_bootstrap.cc:654] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.657859 11651 tablet_bootstrap.cc:492] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d: Bootstrap starting.
I20260709 12:16:23.661646 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:23.662169 11646 tablet_bootstrap.cc:654] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.662356 11600 raft_consensus.cc:3060] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:23.663446 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:23.664083 11451 raft_consensus.cc:3060] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:23.667253 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:23.677618 11453 raft_consensus.cc:2468] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 0.
I20260709 12:16:23.668145 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:23.678958 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:23.637341 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
W20260709 12:16:23.681130 11566 leader_election.cc:343] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:23.681274 11343 leader_election.cc:343] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:23.681993 11342 leader_election.cc:343] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:23.682668 11342 leader_election.cc:304] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:16:23.684049 11946 leader_election.cc:290] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:23.676791 11451 raft_consensus.cc:2468] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 1.
I20260709 12:16:23.686156 11565 leader_election.cc:304] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:23.686766 11649 tablet_bootstrap.cc:492] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8: No bootstrap required, opened a new log
I20260709 12:16:23.687381 11649 ts_tablet_manager.cc:1403] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8: Time spent bootstrapping tablet: real 0.197s	user 0.010s	sys 0.005s
I20260709 12:16:23.687728 11937 raft_consensus.cc:2804] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:23.688269 11937 raft_consensus.cc:697] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:23.683724 11942 raft_consensus.cc:2804] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:23.695441 11942 raft_consensus.cc:493] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:23.691668 11651 tablet_bootstrap.cc:654] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.692680 11937 consensus_queue.cc:237] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:23.693908 11972 raft_consensus.cc:493] T da8741606df54c3f8b5cc5c1141862ea P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.644924 11975 consensus_queue.cc:237] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:23.701417 11646 tablet_bootstrap.cc:492] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de: No bootstrap required, opened a new log
I20260709 12:16:23.702210 11646 ts_tablet_manager.cc:1403] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.080s	user 0.014s	sys 0.000s
I20260709 12:16:23.697994 11972 raft_consensus.cc:515] T da8741606df54c3f8b5cc5c1141862ea P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:23.705065 11963 consensus_queue.cc:1048] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:23.696311 11942 raft_consensus.cc:3060] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:23.712550 11972 leader_election.cc:290] T da8741606df54c3f8b5cc5c1141862ea P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:23.712742 11647 tablet_bootstrap.cc:492] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671: No bootstrap required, opened a new log
I20260709 12:16:23.713305 11647 ts_tablet_manager.cc:1403] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671: Time spent bootstrapping tablet: real 0.172s	user 0.011s	sys 0.004s
I20260709 12:16:23.714885 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8741606df54c3f8b5cc5c1141862ea" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:23.715601 11598 raft_consensus.cc:2468] T da8741606df54c3f8b5cc5c1141862ea P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 0.
I20260709 12:16:23.710496 11649 raft_consensus.cc:359] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:23.716682 11649 raft_consensus.cc:385] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.716845 11491 leader_election.cc:304] T da8741606df54c3f8b5cc5c1141862ea P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:16:23.715916 11647 raft_consensus.cc:359] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:23.718016 11972 raft_consensus.cc:2804] T da8741606df54c3f8b5cc5c1141862ea P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:23.718358 11647 raft_consensus.cc:385] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.718868 11647 raft_consensus.cc:740] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.716971 11649 raft_consensus.cc:740] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.718417 11972 raft_consensus.cc:493] T da8741606df54c3f8b5cc5c1141862ea P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:23.721074 11972 raft_consensus.cc:3060] T da8741606df54c3f8b5cc5c1141862ea P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:23.721167 11999 raft_consensus.cc:493] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.721783 11999 raft_consensus.cc:515] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:23.720427 11646 raft_consensus.cc:359] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:23.724138 11646 raft_consensus.cc:385] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.724366 11646 raft_consensus.cc:740] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.724917 11646 consensus_queue.cc:260] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:23.723454 11647 consensus_queue.cc:260] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:23.721366 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8741606df54c3f8b5cc5c1141862ea" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:23.727118 11451 raft_consensus.cc:2468] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 0.
I20260709 12:16:23.727793 11647 ts_tablet_manager.cc:1434] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.000s
I20260709 12:16:23.729050 11647 tablet_bootstrap.cc:492] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671: Bootstrap starting.
I20260709 12:16:23.734889 11943 consensus_queue.cc:1048] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:23.737115 11999 leader_election.cc:290] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:23.737716 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:23.742066 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:23.744702 11649 consensus_queue.cc:260] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:23.745900 11491 leader_election.cc:304] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:23.755946 11649 ts_tablet_manager.cc:1434] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8: Time spent starting tablet: real 0.068s	user 0.009s	sys 0.001s
I20260709 12:16:23.752120 11999 raft_consensus.cc:2749] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:23.757954 11646 ts_tablet_manager.cc:1434] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.000s
I20260709 12:16:23.768227 11649 tablet_bootstrap.cc:492] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8: Bootstrap starting.
I20260709 12:16:23.770411 11646 tablet_bootstrap.cc:492] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:23.754182 11898 consensus_queue.cc:1048] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 12:16:23.781344 11600 raft_consensus.cc:2468] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 1.
I20260709 12:16:23.771054 11943 consensus_queue.cc:1048] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:16:23.785101 11342 leader_election.cc:304] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:23.785445 11646 tablet_bootstrap.cc:654] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.786206 11275 catalog_manager.cc:5697] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 1 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:23.797101 11647 tablet_bootstrap.cc:654] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.797089 11898 raft_consensus.cc:2804] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:23.811789 11898 raft_consensus.cc:697] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 1 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:16:23.812943 11898 consensus_queue.cc:237] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:23.809252 11942 raft_consensus.cc:515] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:23.815110 11525 raft_consensus.cc:3060] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:23.821074 11942 leader_election.cc:290] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:23.828032 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:23.828831 11451 raft_consensus.cc:3060] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:23.821310 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:23.846300 11943 raft_consensus.cc:493] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.847007 11943 raft_consensus.cc:515] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
W20260709 12:16:23.846527 11342 leader_election.cc:343] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:23.852129 11943 leader_election.cc:290] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:23.855664 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:23.864830 11651 tablet_bootstrap.cc:492] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d: No bootstrap required, opened a new log
I20260709 12:16:23.865134 11649 tablet_bootstrap.cc:654] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.865425 11651 ts_tablet_manager.cc:1403] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d: Time spent bootstrapping tablet: real 0.208s	user 0.015s	sys 0.015s
I20260709 12:16:23.865535 11972 raft_consensus.cc:515] T da8741606df54c3f8b5cc5c1141862ea P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:23.867901 11972 leader_election.cc:290] T da8741606df54c3f8b5cc5c1141862ea P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:23.868330 11651 raft_consensus.cc:359] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:23.869086 11651 raft_consensus.cc:385] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.869405 11651 raft_consensus.cc:740] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.870177 11451 raft_consensus.cc:2468] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 1.
I20260709 12:16:23.870210 11651 consensus_queue.cc:260] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:23.872642 11342 leader_election.cc:304] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8
W20260709 12:16:23.861033 11417 leader_election.cc:343] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:23.877910 11698 consensus_queue.cc:1048] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:23.877681 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8741606df54c3f8b5cc5c1141862ea" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:23.871959 11274 catalog_manager.cc:5697] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 0 to 1, leader changed from <none> to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 1 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:23.884289 11651 ts_tablet_manager.cc:1434] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 12:16:23.871225 11373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:23.879050 11942 raft_consensus.cc:2804] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:23.889247 11602 raft_consensus.cc:3060] T da8741606df54c3f8b5cc5c1141862ea P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:23.906296 11937 raft_consensus.cc:493] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.906941 11937 raft_consensus.cc:515] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:23.909307 11937 leader_election.cc:290] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:23.911242 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:23.891292 11999 raft_consensus.cc:493] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:23.918534 11566 leader_election.cc:343] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:23.920271 11999 raft_consensus.cc:515] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:23.920231 11969 raft_consensus.cc:493] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.925987 11969 raft_consensus.cc:515] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:23.927371 11999 leader_election.cc:290] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:23.928042 11969 leader_election.cc:290] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:23.921918 11942 raft_consensus.cc:697] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 1 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:16:23.932885 11942 consensus_queue.cc:237] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:23.901989 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8741606df54c3f8b5cc5c1141862ea" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:23.936077 11451 raft_consensus.cc:3060] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:23.942860 12011 raft_consensus.cc:493] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.943477 12011 raft_consensus.cc:515] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:23.947017 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:23.948115 12011 leader_election.cc:290] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:23.954260 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:23.955308 11598 raft_consensus.cc:2468] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 0.
I20260709 12:16:23.960800 11342 leader_election.cc:304] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:23.963155 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:23.966122 11375 raft_consensus.cc:2468] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 0.
W20260709 12:16:23.965137 11419 leader_election.cc:343] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:23.967294 11419 leader_election.cc:304] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:23.968636 11943 raft_consensus.cc:2749] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:23.974031 12011 raft_consensus.cc:2804] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:23.975631 11698 raft_consensus.cc:493] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.975876 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:23.976488 11698 raft_consensus.cc:515] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:23.978988 11451 raft_consensus.cc:2468] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 1.
I20260709 12:16:23.979808 11698 leader_election.cc:290] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:23.980042 11651 tablet_bootstrap.cc:492] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d: Bootstrap starting.
I20260709 12:16:23.981290 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:23.985582 12011 raft_consensus.cc:493] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:23.985893 11649 tablet_bootstrap.cc:492] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8: No bootstrap required, opened a new log
I20260709 12:16:24.004155 11373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:16:23.991004 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 78901.9us
I20260709 12:16:23.998505 11646 tablet_bootstrap.cc:492] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de: No bootstrap required, opened a new log
I20260709 12:16:24.008003 11646 ts_tablet_manager.cc:1403] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.248s	user 0.015s	sys 0.036s
I20260709 12:16:24.006217 11649 ts_tablet_manager.cc:1403] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8: Time spent bootstrapping tablet: real 0.245s	user 0.022s	sys 0.002s
I20260709 12:16:23.988025 11647 tablet_bootstrap.cc:492] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671: No bootstrap required, opened a new log
I20260709 12:16:24.009645 11647 ts_tablet_manager.cc:1403] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671: Time spent bootstrapping tablet: real 0.281s	user 0.034s	sys 0.009s
I20260709 12:16:24.013216 11373 raft_consensus.cc:2468] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 0.
I20260709 12:16:24.015044 11374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:24.016387 11646 raft_consensus.cc:359] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:24.017148 11646 raft_consensus.cc:385] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.018951 11649 raft_consensus.cc:359] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:24.019757 11649 raft_consensus.cc:385] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.020159 11649 raft_consensus.cc:740] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.020879 11649 consensus_queue.cc:260] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:24.019443 11491 leader_election.cc:304] T da8741606df54c3f8b5cc5c1141862ea P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:16:24.019071 11646 raft_consensus.cc:740] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.006559 12011 raft_consensus.cc:3060] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.026165 11646 consensus_queue.cc:260] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:24.009008 11602 raft_consensus.cc:2468] T da8741606df54c3f8b5cc5c1141862ea P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 1.
I20260709 12:16:24.053943 11646 ts_tablet_manager.cc:1434] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.046s	user 0.008s	sys 0.000s
I20260709 12:16:24.049207 11275 catalog_manager.cc:5697] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 0 to 1, leader changed from <none> to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 1 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:24.056788 11275 catalog_manager.cc:5697] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 0 to 1, leader changed from <none> to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 1 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:24.058223 11647 raft_consensus.cc:359] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:24.059058 11647 raft_consensus.cc:385] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.059386 11647 raft_consensus.cc:740] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.060119 11647 consensus_queue.cc:260] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:24.052063 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:24.061578 11599 raft_consensus.cc:2393] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 1: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
W20260709 12:16:24.063127 11418 leader_election.cc:343] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.027613 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:24.070658 11651 tablet_bootstrap.cc:654] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.028782 11972 raft_consensus.cc:2804] T da8741606df54c3f8b5cc5c1141862ea P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:16:24.072679 11343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 61646.1us
W20260709 12:16:24.073094 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 47535.5us
W20260709 12:16:24.073695 11343 leader_election.cc:343] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.076849 11419 leader_election.cc:304] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:24.081045 11649 ts_tablet_manager.cc:1434] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8: Time spent starting tablet: real 0.072s	user 0.004s	sys 0.010s
I20260709 12:16:24.082278 11698 raft_consensus.cc:2804] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:24.082723 11698 raft_consensus.cc:493] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:24.083081 11698 raft_consensus.cc:3060] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.087183 11567 leader_election.cc:304] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:24.088737 11493 leader_election.cc:304] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:24.090152 11493 leader_election.cc:304] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:24.090708 11647 ts_tablet_manager.cc:1434] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671: Time spent starting tablet: real 0.081s	user 0.008s	sys 0.000s
I20260709 12:16:24.091087 11937 raft_consensus.cc:2804] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:24.091529 11937 raft_consensus.cc:493] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:24.091881 11937 raft_consensus.cc:3060] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.093334 11647 tablet_bootstrap.cc:492] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671: Bootstrap starting.
I20260709 12:16:24.094501 11969 raft_consensus.cc:3060] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.080538 11972 raft_consensus.cc:697] T da8741606df54c3f8b5cc5c1141862ea P a03223e9e41247c3a36b7b7c3d476671 [term 1 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:16:24.084408 12034 raft_consensus.cc:493] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.115324 12034 raft_consensus.cc:515] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:24.118469 11972 consensus_queue.cc:237] T da8741606df54c3f8b5cc5c1141862ea P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:24.121104 11646 tablet_bootstrap.cc:492] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:24.125487 11647 tablet_bootstrap.cc:654] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.129709 11649 tablet_bootstrap.cc:492] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8: Bootstrap starting.
I20260709 12:16:24.135514 12011 raft_consensus.cc:515] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:24.142288 11698 raft_consensus.cc:515] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:24.172040 11698 leader_election.cc:290] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:24.154130 12034 leader_election.cc:290] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
W20260709 12:16:24.189047 11493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 47512.8us
I20260709 12:16:24.189633 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:24.194075 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:24.198611 12011 leader_election.cc:290] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:24.198190 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:24.215036 11454 raft_consensus.cc:2393] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 1: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
W20260709 12:16:24.224411 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 45472.2us
W20260709 12:16:24.194089 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 107020us
I20260709 12:16:24.231462 11375 raft_consensus.cc:3060] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.249670 11999 raft_consensus.cc:2749] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:24.251921 11647 tablet_bootstrap.cc:492] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671: No bootstrap required, opened a new log
I20260709 12:16:24.252566 11647 ts_tablet_manager.cc:1403] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671: Time spent bootstrapping tablet: real 0.159s	user 0.013s	sys 0.019s
I20260709 12:16:24.258212 11649 tablet_bootstrap.cc:654] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.258212 11646 tablet_bootstrap.cc:654] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.258674 11647 raft_consensus.cc:359] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:24.259613 11647 raft_consensus.cc:385] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.259847 11647 raft_consensus.cc:740] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.260483 11647 consensus_queue.cc:260] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:24.238314 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
W20260709 12:16:24.240754 11418 leader_election.cc:343] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.273176 11969 raft_consensus.cc:2749] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:24.295346 11647 ts_tablet_manager.cc:1434] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671: Time spent starting tablet: real 0.042s	user 0.009s	sys 0.000s
I20260709 12:16:24.304991 11647 tablet_bootstrap.cc:492] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671: Bootstrap starting.
I20260709 12:16:24.289702 12041 consensus_queue.cc:1048] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
W20260709 12:16:24.292192 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 54132.9us
I20260709 12:16:24.324585 11943 raft_consensus.cc:493] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.325232 11943 raft_consensus.cc:515] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:24.344760 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:24.345891 11375 raft_consensus.cc:2468] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 1.
I20260709 12:16:24.355242 11419 leader_election.cc:304] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:24.356140 11698 raft_consensus.cc:2804] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:24.356607 11698 raft_consensus.cc:697] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 1 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:16:24.361284 11943 leader_election.cc:290] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:24.363807 11374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:16:24.365430 11325 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:24.357344 11698 consensus_queue.cc:237] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:24.371915 11524 raft_consensus.cc:3060] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.372720 11651 tablet_bootstrap.cc:492] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d: No bootstrap required, opened a new log
I20260709 12:16:24.373265 11651 ts_tablet_manager.cc:1403] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d: Time spent bootstrapping tablet: real 0.394s	user 0.016s	sys 0.008s
I20260709 12:16:24.383682 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
W20260709 12:16:24.361629 11418 leader_election.cc:343] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.390524 11937 raft_consensus.cc:515] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
W20260709 12:16:24.407855 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 50550.1us
I20260709 12:16:24.412523 11651 raft_consensus.cc:359] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:24.413339 11651 raft_consensus.cc:385] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.413656 11651 raft_consensus.cc:740] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.377626 11964 consensus_queue.cc:1048] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 12:16:24.415642 11649 tablet_bootstrap.cc:492] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8: No bootstrap required, opened a new log
I20260709 12:16:24.416436 11649 ts_tablet_manager.cc:1403] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8: Time spent bootstrapping tablet: real 0.294s	user 0.023s	sys 0.018s
I20260709 12:16:24.416721 11651 consensus_queue.cc:260] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:24.431370 11646 tablet_bootstrap.cc:492] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de: No bootstrap required, opened a new log
I20260709 12:16:24.431929 11646 ts_tablet_manager.cc:1403] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.325s	user 0.014s	sys 0.005s
I20260709 12:16:24.435047 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:24.429826 11599 raft_consensus.cc:2393] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 1: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:16:24.440910 11651 ts_tablet_manager.cc:1434] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d: Time spent starting tablet: real 0.067s	user 0.005s	sys 0.003s
I20260709 12:16:24.450019 11274 catalog_manager.cc:5697] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 1 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:24.452013 11937 leader_election.cc:290] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:24.442461 11525 raft_consensus.cc:3060] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.453771 11651 tablet_bootstrap.cc:492] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d: Bootstrap starting.
I20260709 12:16:24.464766 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
W20260709 12:16:24.466236 11417 leader_election.cc:343] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.466784 11417 leader_election.cc:304] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:24.445709 11600 raft_consensus.cc:3060] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:24.468824 11566 leader_election.cc:343] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.469019 11948 raft_consensus.cc:2749] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:24.470909 11647 tablet_bootstrap.cc:654] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.471390 11651 tablet_bootstrap.cc:654] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.479558 11646 raft_consensus.cc:359] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:24.480396 11646 raft_consensus.cc:385] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.480701 11646 raft_consensus.cc:740] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.481426 11646 consensus_queue.cc:260] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:24.484757 11649 raft_consensus.cc:359] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:24.485584 11649 raft_consensus.cc:385] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.485873 11649 raft_consensus.cc:740] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Initialized, Role: FOLLOWER
W20260709 12:16:24.494174 11343 leader_election.cc:343] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.494614 11343 leader_election.cc:304] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:24.497602 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:24.498257 11379 raft_consensus.cc:2393] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 1: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
W20260709 12:16:24.505991 12051 log.cc:927] Time spent T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:16:24.502703 11649 consensus_queue.cc:260] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:24.509466 12052 raft_consensus.cc:2749] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:16:24.501056 11646 ts_tablet_manager.cc:1434] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.069s	user 0.007s	sys 0.002s
I20260709 12:16:24.520736 11646 tablet_bootstrap.cc:492] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:24.523783 11567 leader_election.cc:304] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:24.525064 11937 raft_consensus.cc:2749] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:24.526515 11649 ts_tablet_manager.cc:1434] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8: Time spent starting tablet: real 0.110s	user 0.008s	sys 0.000s
I20260709 12:16:24.530613 11999 raft_consensus.cc:493] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.531539 11649 tablet_bootstrap.cc:492] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8: Bootstrap starting.
I20260709 12:16:24.531189 11999 raft_consensus.cc:515] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:24.492771 12032 consensus_queue.cc:1048] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.043s
I20260709 12:16:24.535192 11999 leader_election.cc:290] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:24.530243 12029 consensus_queue.cc:1048] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:24.537722 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:24.537770 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:24.545117 11567 leader_election.cc:304] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:24.547443 12029 raft_consensus.cc:2749] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:16:24.550083 11646 tablet_bootstrap.cc:654] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.559098 11491 leader_election.cc:304] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:16:24.562137 11651 tablet_bootstrap.cc:492] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d: No bootstrap required, opened a new log
I20260709 12:16:24.562937 11651 ts_tablet_manager.cc:1403] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d: Time spent bootstrapping tablet: real 0.109s	user 0.015s	sys 0.003s
I20260709 12:16:24.564070 11649 tablet_bootstrap.cc:654] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.517481 11273 catalog_manager.cc:5697] T da8741606df54c3f8b5cc5c1141862ea P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 0 to 1, leader changed from <none> to a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131). New cstate: current_term: 1 leader_uuid: "a03223e9e41247c3a36b7b7c3d476671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:24.566829 12011 consensus_queue.cc:1048] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:16:24.568483 11342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 51700.1us
I20260709 12:16:24.570552 11942 raft_consensus.cc:493] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.571265 11942 raft_consensus.cc:515] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:24.573674 11942 leader_election.cc:290] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:24.578219 11972 raft_consensus.cc:2749] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:24.586040 11647 tablet_bootstrap.cc:492] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671: No bootstrap required, opened a new log
I20260709 12:16:24.586678 11647 ts_tablet_manager.cc:1403] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671: Time spent bootstrapping tablet: real 0.282s	user 0.019s	sys 0.019s
I20260709 12:16:24.589771 11647 raft_consensus.cc:359] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:24.590557 11647 raft_consensus.cc:385] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.590889 11647 raft_consensus.cc:740] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.590634 12053 consensus_queue.cc:1048] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:24.603858 11942 consensus_queue.cc:1048] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:24.611485 11647 consensus_queue.cc:260] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:24.615024 11646 tablet_bootstrap.cc:492] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de: No bootstrap required, opened a new log
I20260709 12:16:24.615700 11646 ts_tablet_manager.cc:1403] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.095s	user 0.010s	sys 0.017s
I20260709 12:16:24.616487 12053 consensus_queue.cc:1048] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:24.618623 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:24.618721 11646 raft_consensus.cc:359] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:24.619642 11646 raft_consensus.cc:385] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.620004 11646 raft_consensus.cc:740] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.620743 11646 consensus_queue.cc:260] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:24.615123 11647 ts_tablet_manager.cc:1434] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 12:16:24.622723 11646 ts_tablet_manager.cc:1434] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:16:24.622814 11647 tablet_bootstrap.cc:492] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671: Bootstrap starting.
I20260709 12:16:24.625610 11646 tablet_bootstrap.cc:492] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:24.625399 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:24.626267 11452 raft_consensus.cc:2468] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 0.
I20260709 12:16:24.566843 11651 raft_consensus.cc:359] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:24.629932 11651 raft_consensus.cc:385] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.630304 11651 raft_consensus.cc:740] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.632779 11646 tablet_bootstrap.cc:654] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.648204 11647 tablet_bootstrap.cc:654] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.651671 11649 tablet_bootstrap.cc:492] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8: No bootstrap required, opened a new log
I20260709 12:16:24.651678 11999 consensus_queue.cc:1048] T da8741606df54c3f8b5cc5c1141862ea P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:24.656277 11649 ts_tablet_manager.cc:1403] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8: Time spent bootstrapping tablet: real 0.125s	user 0.018s	sys 0.004s
I20260709 12:16:24.662261 11649 raft_consensus.cc:359] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:24.663154 11649 raft_consensus.cc:385] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.663457 11649 raft_consensus.cc:740] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.666608 11999 consensus_queue.cc:1048] T da8741606df54c3f8b5cc5c1141862ea P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:24.672868 11649 consensus_queue.cc:260] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:24.676836 12049 raft_consensus.cc:493] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.677500 12049 raft_consensus.cc:515] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:24.679493 11649 ts_tablet_manager.cc:1434] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:16:24.680670 11649 tablet_bootstrap.cc:492] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8: Bootstrap starting.
I20260709 12:16:24.680841 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:24.683682 11646 tablet_bootstrap.cc:492] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de: No bootstrap required, opened a new log
W20260709 12:16:24.684028 11417 leader_election.cc:343] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.682700 12049 leader_election.cc:290] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:24.687954 11373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:24.682104 11342 leader_election.cc:304] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:24.697345 11649 tablet_bootstrap.cc:654] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.699723 11651 consensus_queue.cc:260] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:24.684221 11646 ts_tablet_manager.cc:1403] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.059s	user 0.015s	sys 0.003s
I20260709 12:16:24.717653 11647 tablet_bootstrap.cc:492] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671: No bootstrap required, opened a new log
I20260709 12:16:24.718266 11647 ts_tablet_manager.cc:1403] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671: Time spent bootstrapping tablet: real 0.096s	user 0.016s	sys 0.000s
W20260709 12:16:24.729712 11342 leader_election.cc:343] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.719123 12029 raft_consensus.cc:493] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.720206 12053 raft_consensus.cc:2804] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:24.746628 11651 ts_tablet_manager.cc:1434] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d: Time spent starting tablet: real 0.183s	user 0.008s	sys 0.000s
I20260709 12:16:24.746305 11646 raft_consensus.cc:359] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:24.747164 11646 raft_consensus.cc:385] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.747532 11646 raft_consensus.cc:740] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
W20260709 12:16:24.749269 11419 leader_election.cc:343] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.749872 11419 leader_election.cc:304] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:24.753011 11647 raft_consensus.cc:359] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:24.753974 11647 raft_consensus.cc:385] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.754323 11647 raft_consensus.cc:740] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.756116 11647 consensus_queue.cc:260] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:24.759337 11646 consensus_queue.cc:260] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:24.747977 12053 raft_consensus.cc:493] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:24.765690 11698 raft_consensus.cc:2749] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:24.783766 11647 ts_tablet_manager.cc:1434] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671: Time spent starting tablet: real 0.065s	user 0.008s	sys 0.000s
I20260709 12:16:24.749516 12029 raft_consensus.cc:515] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:24.786890 11651 tablet_bootstrap.cc:492] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d: Bootstrap starting.
I20260709 12:16:24.768136 12053 raft_consensus.cc:3060] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.792315 11647 tablet_bootstrap.cc:492] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671: Bootstrap starting.
I20260709 12:16:24.798620 11646 ts_tablet_manager.cc:1434] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.093s	user 0.007s	sys 0.002s
I20260709 12:16:24.838378 11937 raft_consensus.cc:493] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.838997 11937 raft_consensus.cc:515] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:24.843076 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:24.843891 11523 raft_consensus.cc:2468] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 0.
I20260709 12:16:24.845243 11566 leader_election.cc:304] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:16:24.846374 12045 raft_consensus.cc:2804] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:24.846859 12045 raft_consensus.cc:493] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:24.847196 12045 raft_consensus.cc:3060] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.850687 11948 raft_consensus.cc:493] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.851261 11948 raft_consensus.cc:515] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:24.867117 12029 leader_election.cc:290] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:24.868417 11646 tablet_bootstrap.cc:492] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:24.878903 11373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:24.885937 11948 leader_election.cc:290] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:24.841238 11937 leader_election.cc:290] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:24.894479 11651 tablet_bootstrap.cc:654] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.903466 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:16:24.904999 11418 leader_election.cc:343] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.913257 11964 raft_consensus.cc:493] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.913892 11964 raft_consensus.cc:515] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:24.917003 11374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:24.917809 11374 raft_consensus.cc:2468] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 0.
I20260709 12:16:24.918278 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:24.916173 11964 leader_election.cc:290] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
W20260709 12:16:24.920655 11343 leader_election.cc:343] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.926654 11646 tablet_bootstrap.cc:654] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:24.929884 11342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 135771us
I20260709 12:16:24.951094 11419 leader_election.cc:304] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:24.919982 12053 raft_consensus.cc:515] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:24.950416 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:24.959479 11453 raft_consensus.cc:2468] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 0.
I20260709 12:16:24.924417 12045 raft_consensus.cc:515] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:24.962725 12049 raft_consensus.cc:2804] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:24.995319 11565 leader_election.cc:304] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:16:24.968134 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:24.982852 12049 raft_consensus.cc:493] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:25.000209 11373 raft_consensus.cc:2393] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 1: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:16:24.996904 11946 raft_consensus.cc:2804] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:25.019708 11651 tablet_bootstrap.cc:492] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d: No bootstrap required, opened a new log
I20260709 12:16:25.020321 11651 ts_tablet_manager.cc:1403] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d: Time spent bootstrapping tablet: real 0.252s	user 0.012s	sys 0.008s
I20260709 12:16:24.996122 12050 consensus_queue.cc:1048] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 12:16:25.017027 11946 raft_consensus.cc:493] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:25.021510 11946 raft_consensus.cc:3060] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:25.021700 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:25.022464 11448 raft_consensus.cc:3060] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:25.024580 11647 tablet_bootstrap.cc:654] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:25.028570 12045 leader_election.cc:290] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:25.029486 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:25.020972 11649 tablet_bootstrap.cc:492] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8: No bootstrap required, opened a new log
I20260709 12:16:25.033958 11649 ts_tablet_manager.cc:1403] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8: Time spent bootstrapping tablet: real 0.354s	user 0.015s	sys 0.004s
I20260709 12:16:25.007135 12049 raft_consensus.cc:3060] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:25.039539 11946 raft_consensus.cc:515] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:25.043793 12053 leader_election.cc:290] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
W20260709 12:16:25.044831 11418 consensus_peers.cc:597] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d -> Peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Couldn't send request to peer a03223e9e41247c3a36b7b7c3d476671. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:25.053013 11448 raft_consensus.cc:2468] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 1.
I20260709 12:16:25.077713 11946 leader_election.cc:290] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:25.079445 11565 leader_election.cc:304] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:16:25.087917 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:25.088712 11454 raft_consensus.cc:3060] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:25.089087 11649 raft_consensus.cc:359] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:25.089869 11649 raft_consensus.cc:385] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:25.090157 11649 raft_consensus.cc:740] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Initialized, Role: FOLLOWER
I20260709 12:16:25.090835 11649 consensus_queue.cc:260] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:25.094348 11649 ts_tablet_manager.cc:1434] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8: Time spent starting tablet: real 0.060s	user 0.006s	sys 0.000s
I20260709 12:16:25.095885 12043 raft_consensus.cc:493] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:25.096593 12043 raft_consensus.cc:515] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:25.099198 12043 leader_election.cc:290] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:25.111676 11649 tablet_bootstrap.cc:492] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8: Bootstrap starting.
I20260709 12:16:25.114327 11866 raft_consensus.cc:493] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:25.114842 11651 raft_consensus.cc:359] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:25.115610 11651 raft_consensus.cc:385] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:25.115876 11651 raft_consensus.cc:740] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Initialized, Role: FOLLOWER
I20260709 12:16:25.116679 11651 consensus_queue.cc:260] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:25.102308 11946 raft_consensus.cc:2804] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:25.130636 11651 ts_tablet_manager.cc:1434] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d: Time spent starting tablet: real 0.110s	user 0.008s	sys 0.002s
W20260709 12:16:25.135740 11342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 55352.3us
W20260709 12:16:25.140161 11343 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 56978.9us
I20260709 12:16:25.122179 12032 raft_consensus.cc:493] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:25.144960 11342 leader_election.cc:343] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:25.145459 11342 leader_election.cc:304] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:25.133769 11946 raft_consensus.cc:697] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:25.114910 11866 raft_consensus.cc:515] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:25.143465 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:25.169538 11647 tablet_bootstrap.cc:492] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671: No bootstrap required, opened a new log
I20260709 12:16:25.190310 11647 ts_tablet_manager.cc:1403] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671: Time spent bootstrapping tablet: real 0.398s	user 0.014s	sys 0.037s
I20260709 12:16:25.171178 11948 raft_consensus.cc:493] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:25.149813 12032 raft_consensus.cc:515] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:25.173795 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:25.176229 11373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:25.178479 11946 consensus_queue.cc:237] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:25.146076 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:25.155254 12053 raft_consensus.cc:2749] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:25.185760 11649 tablet_bootstrap.cc:654] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:25.179976 12049 raft_consensus.cc:515] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:25.151888 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:25.205803 12049 leader_election.cc:290] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:25.208518 11651 tablet_bootstrap.cc:492] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d: Bootstrap starting.
I20260709 12:16:25.209830 11602 raft_consensus.cc:2393] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 1: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:16:25.213508 11454 raft_consensus.cc:2468] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 1.
I20260709 12:16:25.214010 12032 leader_election.cc:290] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:25.215454 11342 leader_election.cc:304] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:25.223362 11646 tablet_bootstrap.cc:492] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de: No bootstrap required, opened a new log
I20260709 12:16:25.223857 11646 ts_tablet_manager.cc:1403] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.356s	user 0.017s	sys 0.011s
I20260709 12:16:25.203472 11524 raft_consensus.cc:3060] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:25.231489 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:25.232290 11379 raft_consensus.cc:3060] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:25.228068 11866 leader_election.cc:290] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:25.229322 11647 raft_consensus.cc:359] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:25.222864 11597 raft_consensus.cc:2393] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 1: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:16:25.195493 11948 raft_consensus.cc:515] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:25.245143 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:25.247489 11948 leader_election.cc:290] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:25.226069 11373 raft_consensus.cc:2393] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 1: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:16:25.252874 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:25.259117 11375 raft_consensus.cc:2393] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 1: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:16:25.256537 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e4724ed93a467ea47763eec9a6de2e" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:25.257581 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e4724ed93a467ea47763eec9a6de2e" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:25.235879 11647 raft_consensus.cc:385] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:25.258314 12032 raft_consensus.cc:2804] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:25.268210 11647 raft_consensus.cc:740] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Initialized, Role: FOLLOWER
I20260709 12:16:25.235378 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
W20260709 12:16:25.277100 11342 leader_election.cc:343] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:25.283730 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:25.284472 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:25.284514 11450 raft_consensus.cc:2468] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 0.
I20260709 12:16:25.293066 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:25.294464 11647 consensus_queue.cc:260] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:25.285660 11454 raft_consensus.cc:2468] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 0.
I20260709 12:16:25.301766 11379 raft_consensus.cc:2468] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 1.
I20260709 12:16:25.302073 11524 raft_consensus.cc:2468] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 1.
I20260709 12:16:25.304467 11493 leader_election.cc:304] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:25.305444 12032 raft_consensus.cc:697] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 1 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:16:25.308447 11972 raft_consensus.cc:3060] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:25.308811 12032 consensus_queue.cc:237] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:25.313335 11647 ts_tablet_manager.cc:1434] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671: Time spent starting tablet: real 0.123s	user 0.008s	sys 0.001s
W20260709 12:16:25.313539 11417 leader_election.cc:343] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:25.311858 11565 leader_election.cc:304] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
W20260709 12:16:25.315341 11566 leader_election.cc:343] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:25.319219 11937 raft_consensus.cc:2804] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:25.319866 11937 raft_consensus.cc:493] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:25.290390 11567 leader_election.cc:304] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:25.322405 12074 raft_consensus.cc:2749] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:16:25.324450 11342 leader_election.cc:304] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8
W20260709 12:16:25.324981 11418 leader_election.cc:343] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:25.328521 11418 leader_election.cc:304] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:25.329563 11948 raft_consensus.cc:2749] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:25.330725 11651 tablet_bootstrap.cc:654] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:25.334905 11647 tablet_bootstrap.cc:492] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671: Bootstrap starting.
W20260709 12:16:25.335391 11418 leader_election.cc:343] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:25.325969 11964 raft_consensus.cc:2804] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:25.340036 11964 raft_consensus.cc:493] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:25.340548 11964 raft_consensus.cc:3060] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:25.324250 11937 raft_consensus.cc:3060] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:25.355695 11419 leader_election.cc:304] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:25.348388 11646 raft_consensus.cc:359] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:25.356732 11646 raft_consensus.cc:385] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:25.357031 11646 raft_consensus.cc:740] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:25.360164 11943 raft_consensus.cc:2804] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:25.361063 11943 raft_consensus.cc:697] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 1 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:16:25.362437 11943 consensus_queue.cc:237] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:25.383982 11649 tablet_bootstrap.cc:492] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8: No bootstrap required, opened a new log
I20260709 12:16:25.386337 11649 ts_tablet_manager.cc:1403] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8: Time spent bootstrapping tablet: real 0.275s	user 0.008s	sys 0.015s
I20260709 12:16:25.386648 11647 tablet_bootstrap.cc:654] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:25.369802 11646 consensus_queue.cc:260] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:25.428406 11649 raft_consensus.cc:359] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:25.429278 11649 raft_consensus.cc:385] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:25.457110 11972 raft_consensus.cc:2749] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:25.476411 11651 tablet_bootstrap.cc:492] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d: No bootstrap required, opened a new log
I20260709 12:16:25.477906 11651 ts_tablet_manager.cc:1403] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d: Time spent bootstrapping tablet: real 0.270s	user 0.027s	sys 0.022s
I20260709 12:16:25.483803 11937 raft_consensus.cc:515] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:25.489928 11646 ts_tablet_manager.cc:1434] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.266s	user 0.008s	sys 0.000s
I20260709 12:16:25.497198 11646 tablet_bootstrap.cc:492] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:25.492861 11964 raft_consensus.cc:515] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:25.439409 11649 raft_consensus.cc:740] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Initialized, Role: FOLLOWER
I20260709 12:16:25.500126 11649 consensus_queue.cc:260] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:25.500811 11651 raft_consensus.cc:359] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:25.501544 11651 raft_consensus.cc:385] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:25.501817 11651 raft_consensus.cc:740] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Initialized, Role: FOLLOWER
I20260709 12:16:25.502445 11651 consensus_queue.cc:260] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:25.506527 11649 ts_tablet_manager.cc:1434] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8: Time spent starting tablet: real 0.120s	user 0.008s	sys 0.000s
I20260709 12:16:25.508018 11649 tablet_bootstrap.cc:492] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8: Bootstrap starting.
I20260709 12:16:25.508683 11937 leader_election.cc:290] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:25.510424 11651 ts_tablet_manager.cc:1434] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:16:25.512848 11964 leader_election.cc:290] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:25.520972 11649 tablet_bootstrap.cc:654] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:25.522712 11651 tablet_bootstrap.cc:492] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d: Bootstrap starting.
I20260709 12:16:25.526335 11273 catalog_manager.cc:5697] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 1 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:25.533293 11646 tablet_bootstrap.cc:654] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:25.514243 11647 tablet_bootstrap.cc:492] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671: No bootstrap required, opened a new log
I20260709 12:16:25.534139 11647 ts_tablet_manager.cc:1403] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671: Time spent bootstrapping tablet: real 0.214s	user 0.012s	sys 0.007s
I20260709 12:16:25.534693 11649 tablet_bootstrap.cc:492] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8: No bootstrap required, opened a new log
I20260709 12:16:25.535331 11649 ts_tablet_manager.cc:1403] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8: Time spent bootstrapping tablet: real 0.028s	user 0.007s	sys 0.009s
I20260709 12:16:25.532490 11651 tablet_bootstrap.cc:654] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:25.540370 11647 raft_consensus.cc:359] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:25.540532 11649 raft_consensus.cc:359] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:25.541267 11647 raft_consensus.cc:385] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:25.541530 11649 raft_consensus.cc:385] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:25.541827 11647 raft_consensus.cc:740] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Initialized, Role: FOLLOWER
I20260709 12:16:25.541997 11649 raft_consensus.cc:740] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Initialized, Role: FOLLOWER
I20260709 12:16:25.542908 11647 consensus_queue.cc:260] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:25.543107 11649 consensus_queue.cc:260] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:25.545603 11647 ts_tablet_manager.cc:1434] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 12:16:25.546794 11649 ts_tablet_manager.cc:1434] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:16:25.550065 11649 tablet_bootstrap.cc:492] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8: Bootstrap starting.
I20260709 12:16:25.548657 11647 tablet_bootstrap.cc:492] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671: Bootstrap starting.
I20260709 12:16:25.551054 11651 tablet_bootstrap.cc:492] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d: No bootstrap required, opened a new log
I20260709 12:16:25.551622 11651 ts_tablet_manager.cc:1403] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.001s
I20260709 12:16:25.556962 11651 raft_consensus.cc:359] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:25.557441 11649 tablet_bootstrap.cc:654] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:25.557806 11651 raft_consensus.cc:385] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:25.558105 11651 raft_consensus.cc:740] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Initialized, Role: FOLLOWER
I20260709 12:16:25.558889 11651 consensus_queue.cc:260] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:25.561544 11651 ts_tablet_manager.cc:1434] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 12:16:25.573334 11647 tablet_bootstrap.cc:654] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:25.575241 11646 tablet_bootstrap.cc:492] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de: No bootstrap required, opened a new log
I20260709 12:16:25.575806 11646 ts_tablet_manager.cc:1403] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.079s	user 0.008s	sys 0.009s
I20260709 12:16:25.578719 11646 raft_consensus.cc:359] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:25.579473 11646 raft_consensus.cc:385] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:25.579784 11646 raft_consensus.cc:740] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:25.580643 11646 consensus_queue.cc:260] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:25.582273 11646 ts_tablet_manager.cc:1434] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 12:16:25.583528 11646 tablet_bootstrap.cc:492] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:25.587638 11647 tablet_bootstrap.cc:492] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671: No bootstrap required, opened a new log
I20260709 12:16:25.588160 11647 ts_tablet_manager.cc:1403] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671: Time spent bootstrapping tablet: real 0.040s	user 0.010s	sys 0.007s
I20260709 12:16:25.589406 11646 tablet_bootstrap.cc:654] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:25.589921 12041 raft_consensus.cc:493] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:25.590502 12041 raft_consensus.cc:515] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:25.591544 11647 raft_consensus.cc:359] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:25.592324 11647 raft_consensus.cc:385] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:25.592598 11647 raft_consensus.cc:740] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Initialized, Role: FOLLOWER
I20260709 12:16:25.592823 12041 leader_election.cc:290] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:25.593271 11647 consensus_queue.cc:260] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:25.593868 11649 tablet_bootstrap.cc:492] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8: No bootstrap required, opened a new log
I20260709 12:16:25.594385 11649 ts_tablet_manager.cc:1403] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8: Time spent bootstrapping tablet: real 0.045s	user 0.008s	sys 0.003s
I20260709 12:16:25.597282 11649 raft_consensus.cc:359] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:25.597975 11649 raft_consensus.cc:385] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:25.598219 11649 raft_consensus.cc:740] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Initialized, Role: FOLLOWER
I20260709 12:16:25.599094 11647 ts_tablet_manager.cc:1434] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:16:25.598882 11649 consensus_queue.cc:260] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:25.600521 11647 tablet_bootstrap.cc:492] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671: Bootstrap starting.
I20260709 12:16:25.601082 11649 ts_tablet_manager.cc:1434] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:16:25.601732 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:25.602551 11379 raft_consensus.cc:2393] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 1: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:16:25.603104 11649 tablet_bootstrap.cc:492] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8: Bootstrap starting.
I20260709 12:16:25.607652 11647 tablet_bootstrap.cc:654] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:25.609153 11649 tablet_bootstrap.cc:654] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:25.616606 11647 tablet_bootstrap.cc:492] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671: No bootstrap required, opened a new log
I20260709 12:16:25.617062 11646 tablet_bootstrap.cc:492] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de: No bootstrap required, opened a new log
I20260709 12:16:25.617318 11647 ts_tablet_manager.cc:1403] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.002s
I20260709 12:16:25.617779 11646 ts_tablet_manager.cc:1403] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.002s
I20260709 12:16:25.620442 11647 raft_consensus.cc:359] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:25.621297 11647 raft_consensus.cc:385] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:25.621618 11647 raft_consensus.cc:740] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Initialized, Role: FOLLOWER
I20260709 12:16:25.621897 11646 raft_consensus.cc:359] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:25.622320 11647 consensus_queue.cc:260] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:25.622812 11646 raft_consensus.cc:385] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:25.623286 11646 raft_consensus.cc:740] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:25.624081 11646 consensus_queue.cc:260] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:25.625065 11647 ts_tablet_manager.cc:1434] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:16:25.626139 11646 ts_tablet_manager.cc:1434] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:16:25.627342 11646 tablet_bootstrap.cc:492] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:25.626266 11647 tablet_bootstrap.cc:492] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671: Bootstrap starting.
I20260709 12:16:25.629371 11649 tablet_bootstrap.cc:492] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8: No bootstrap required, opened a new log
I20260709 12:16:25.630019 11649 ts_tablet_manager.cc:1403] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.014s
I20260709 12:16:25.633080 11649 raft_consensus.cc:359] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:25.633903 11649 raft_consensus.cc:385] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:25.634208 11649 raft_consensus.cc:740] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Initialized, Role: FOLLOWER
I20260709 12:16:25.634366 11647 tablet_bootstrap.cc:654] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:25.635433 11646 tablet_bootstrap.cc:654] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:25.635099 11649 consensus_queue.cc:260] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:25.637754 11649 ts_tablet_manager.cc:1434] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:16:25.640035 11649 tablet_bootstrap.cc:492] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8: Bootstrap starting.
I20260709 12:16:25.646274 11647 tablet_bootstrap.cc:492] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671: No bootstrap required, opened a new log
I20260709 12:16:25.646853 11647 ts_tablet_manager.cc:1403] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.007s
I20260709 12:16:25.651176 11649 tablet_bootstrap.cc:654] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:25.656426 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 302742us
I20260709 12:16:25.657750 11646 tablet_bootstrap.cc:492] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de: No bootstrap required, opened a new log
I20260709 12:16:25.658308 11646 ts_tablet_manager.cc:1403] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.013s
I20260709 12:16:25.659642 11649 tablet_bootstrap.cc:492] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8: No bootstrap required, opened a new log
I20260709 12:16:25.660207 11649 ts_tablet_manager.cc:1403] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.000s
I20260709 12:16:25.660079 11647 raft_consensus.cc:359] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:25.694746 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:25.798818 11449 raft_consensus.cc:3060] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:25.671264 11647 raft_consensus.cc:385] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:25.800066 11647 raft_consensus.cc:740] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Initialized, Role: FOLLOWER
I20260709 12:16:25.800750 11647 consensus_queue.cc:260] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:25.661360 11646 raft_consensus.cc:359] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:25.803442 11646 raft_consensus.cc:385] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:25.803764 11646 raft_consensus.cc:740] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:25.804478 11646 consensus_queue.cc:260] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
W20260709 12:16:25.745260 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 431260us
I20260709 12:16:25.778882 12091 raft_consensus.cc:493] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:25.809774 12091 raft_consensus.cc:515] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:25.812415 12091 leader_election.cc:290] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:25.664670 11649 raft_consensus.cc:359] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:25.815331 11649 raft_consensus.cc:385] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:25.815608 11649 raft_consensus.cc:740] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Initialized, Role: FOLLOWER
I20260709 12:16:25.816438 11649 consensus_queue.cc:260] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:25.797235 12074 consensus_queue.cc:1048] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 12:16:25.818984 12077 raft_consensus.cc:493] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:25.819703 12077 raft_consensus.cc:515] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:25.706835 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:25.822630 11448 raft_consensus.cc:2468] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 0.
I20260709 12:16:25.823770 11449 raft_consensus.cc:2468] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 1.
I20260709 12:16:25.825979 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:25.826701 11646 ts_tablet_manager.cc:1434] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.168s	user 0.008s	sys 0.003s
I20260709 12:16:25.827042 12077 leader_election.cc:290] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:16:25.830473 11343 leader_election.cc:343] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:25.832121 11325 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:25.813843 11377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:25.832827 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:25.834231 11491 leader_election.cc:304] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:25.835685 12110 raft_consensus.cc:2749] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:25.832015 11649 ts_tablet_manager.cc:1434] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8: Time spent starting tablet: real 0.171s	user 0.006s	sys 0.001s
I20260709 12:16:25.837854 11649 tablet_bootstrap.cc:492] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8: Bootstrap starting.
I20260709 12:16:25.841053 11647 ts_tablet_manager.cc:1434] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671: Time spent starting tablet: real 0.194s	user 0.026s	sys 0.010s
I20260709 12:16:25.842381 11647 tablet_bootstrap.cc:492] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671: Bootstrap starting.
I20260709 12:16:25.844902 11649 tablet_bootstrap.cc:654] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:25.847982 12041 raft_consensus.cc:493] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:25.854524 11647 tablet_bootstrap.cc:654] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:25.854503 12041 raft_consensus.cc:515] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:25.859877 11565 leader_election.cc:304] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:25.861583 11946 raft_consensus.cc:2804] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:25.862028 11946 raft_consensus.cc:493] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:25.862385 11946 raft_consensus.cc:3060] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:25.862597 11565 leader_election.cc:304] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:16:25.864068 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:25.864787 11522 raft_consensus.cc:3060] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:25.869825 12074 consensus_queue.cc:1048] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:25.871583 12074 raft_consensus.cc:2804] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:25.872152 12074 raft_consensus.cc:697] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:25.873075 12074 consensus_queue.cc:237] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:25.875644 11946 raft_consensus.cc:515] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:25.878340 11946 leader_election.cc:290] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:25.894443 11522 raft_consensus.cc:2468] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 1.
I20260709 12:16:25.903270 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:25.904145 11454 raft_consensus.cc:3060] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:25.887588 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:25.930795 11377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:26.135572 11964 raft_consensus.cc:493] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.113673 11526 raft_consensus.cc:2468] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 0.
I20260709 12:16:26.163861 12011 raft_consensus.cc:493] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.164747 12011 raft_consensus.cc:515] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:26.167114 12011 leader_election.cc:290] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:26.171782 11454 raft_consensus.cc:2468] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 1.
I20260709 12:16:26.145740 12041 leader_election.cc:290] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:26.174039 12041 raft_consensus.cc:493] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.174530 12041 raft_consensus.cc:515] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:26.174928 11377 raft_consensus.cc:2393] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 1: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:16:26.175693 11647 tablet_bootstrap.cc:492] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671: No bootstrap required, opened a new log
I20260709 12:16:26.179792 11647 ts_tablet_manager.cc:1403] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671: Time spent bootstrapping tablet: real 0.338s	user 0.023s	sys 0.044s
I20260709 12:16:26.168852 11946 raft_consensus.cc:493] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.182891 11565 leader_election.cc:304] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:16:26.182552 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:26.187160 11948 raft_consensus.cc:493] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.195919 11602 raft_consensus.cc:2393] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 1: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:16:26.195809 11948 raft_consensus.cc:515] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:26.186873 11946 raft_consensus.cc:515] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:26.176244 11964 raft_consensus.cc:515] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:26.214593 11649 tablet_bootstrap.cc:492] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8: No bootstrap required, opened a new log
I20260709 12:16:26.215189 11649 ts_tablet_manager.cc:1403] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8: Time spent bootstrapping tablet: real 0.378s	user 0.009s	sys 0.011s
I20260709 12:16:26.222419 12117 raft_consensus.cc:493] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.223016 12117 raft_consensus.cc:515] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:26.224072 11649 raft_consensus.cc:359] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:26.224835 11649 raft_consensus.cc:385] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:26.225126 11649 raft_consensus.cc:740] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Initialized, Role: FOLLOWER
I20260709 12:16:26.216163 12078 raft_consensus.cc:493] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.225144 12117 leader_election.cc:290] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:26.248350 11972 raft_consensus.cc:493] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.228842 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:26.270120 11649 consensus_queue.cc:260] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:26.277036 11649 ts_tablet_manager.cc:1434] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8: Time spent starting tablet: real 0.062s	user 0.007s	sys 0.001s
I20260709 12:16:26.224148 11964 leader_election.cc:290] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:26.269186 12041 leader_election.cc:290] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
W20260709 12:16:26.273908 12115 log.cc:927] Time spent T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:16:26.262110 12078 raft_consensus.cc:515] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
W20260709 12:16:26.286221 11343 leader_election.cc:343] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:26.292972 11946 leader_election.cc:290] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:16:26.295377 12116 log.cc:927] Time spent T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:16:26.297932 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:26.298777 11594 raft_consensus.cc:2468] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 0.
I20260709 12:16:26.300374 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:26.261850 11972 raft_consensus.cc:515] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:26.301081 12118 raft_consensus.cc:2804] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:26.301810 12118 raft_consensus.cc:697] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:26.302850 11972 leader_election.cc:290] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:26.302732 12118 consensus_queue.cc:237] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:26.285411 11948 leader_election.cc:290] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:26.309125 12078 leader_election.cc:290] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:26.310487 11647 raft_consensus.cc:359] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:26.311316 11647 raft_consensus.cc:385] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:26.311582 11647 raft_consensus.cc:740] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Initialized, Role: FOLLOWER
I20260709 12:16:26.314781 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:26.314922 11647 consensus_queue.cc:260] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:26.315521 11375 raft_consensus.cc:2468] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 0.
I20260709 12:16:26.301112 11452 raft_consensus.cc:2468] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 0.
I20260709 12:16:26.324322 11647 ts_tablet_manager.cc:1434] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671: Time spent starting tablet: real 0.144s	user 0.005s	sys 0.003s
I20260709 12:16:26.325423 11647 tablet_bootstrap.cc:492] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671: Bootstrap starting.
I20260709 12:16:26.326057 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e4724ed93a467ea47763eec9a6de2e" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:26.326792 11449 raft_consensus.cc:2468] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 0.
I20260709 12:16:26.330277 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a841f2f09ced40a4bbf33594e11bd7ad" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:26.331045 11452 raft_consensus.cc:2468] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 0.
I20260709 12:16:26.329102 11566 leader_election.cc:304] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:16:26.346587 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e4724ed93a467ea47763eec9a6de2e" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:26.347419 11522 raft_consensus.cc:2468] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 0.
I20260709 12:16:26.340791 11376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a841f2f09ced40a4bbf33594e11bd7ad" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:26.347976 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:26.347456 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:26.348786 11526 raft_consensus.cc:2468] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 0.
I20260709 12:16:26.348652 11376 raft_consensus.cc:2468] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 0.
I20260709 12:16:26.357959 11374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:26.358757 11374 raft_consensus.cc:2468] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 0.
I20260709 12:16:26.352774 11342 leader_election.cc:304] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:26.359182 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a841f2f09ced40a4bbf33594e11bd7ad" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:26.373979 11601 raft_consensus.cc:2468] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 0.
I20260709 12:16:26.376268 11647 tablet_bootstrap.cc:654] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:26.377061 11567 leader_election.cc:304] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:26.377988 11567 leader_election.cc:304] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:26.378350 12088 raft_consensus.cc:2804] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:26.378747 12088 raft_consensus.cc:493] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:26.379071 12088 raft_consensus.cc:3060] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.379725 12029 raft_consensus.cc:2804] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:26.380141 12029 raft_consensus.cc:493] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:26.380458 12029 raft_consensus.cc:3060] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.368520 12053 raft_consensus.cc:2804] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:26.385758 12053 raft_consensus.cc:493] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:26.385792 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a841f2f09ced40a4bbf33594e11bd7ad" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:26.386222 12053 raft_consensus.cc:3060] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.386633 11448 raft_consensus.cc:2468] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 0.
I20260709 12:16:26.387797 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:26.388546 11375 raft_consensus.cc:2468] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 0.
I20260709 12:16:26.381695 12121 raft_consensus.cc:2804] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:26.389828 12121 raft_consensus.cc:493] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:26.390173 12121 raft_consensus.cc:3060] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.399016 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a841f2f09ced40a4bbf33594e11bd7ad" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:26.405354 11493 leader_election.cc:304] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:26.406008 12045 raft_consensus.cc:493] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:16:26.406563 12045 raft_consensus.cc:515] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:26.408083 12091 raft_consensus.cc:2804] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:26.408519 12091 raft_consensus.cc:493] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:26.408867 12091 raft_consensus.cc:3060] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.409571 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:26.410737 12053 raft_consensus.cc:515] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:26.414034 12125 raft_consensus.cc:493] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.414631 12125 raft_consensus.cc:515] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:26.415354 12029 raft_consensus.cc:515] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:26.417682 12029 leader_election.cc:290] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:26.418632 12109 raft_consensus.cc:493] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:16:26.419260 12109 raft_consensus.cc:515] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:26.420284 12091 raft_consensus.cc:515] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:26.421981 12088 raft_consensus.cc:515] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:26.422400 12125 leader_election.cc:290] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:26.423705 12091 leader_election.cc:290] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:26.424321 12088 leader_election.cc:290] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:26.426137 11594 raft_consensus.cc:2393] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 1: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:16:26.408797 12045 leader_election.cc:290] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:26.430095 12121 raft_consensus.cc:515] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:26.431119 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a841f2f09ced40a4bbf33594e11bd7ad" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:26.433692 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:26.434576 11597 raft_consensus.cc:2393] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 1: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:16:26.434882 11528 raft_consensus.cc:3060] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.434993 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:26.431828 11449 raft_consensus.cc:3060] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.435191 12121 leader_election.cc:290] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:26.431988 12109 leader_election.cc:290] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:26.445164 11521 raft_consensus.cc:3060] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.413009 12053 leader_election.cc:290] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:26.455623 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:26.456686 11450 raft_consensus.cc:2393] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 1: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:16:26.462855 11273 catalog_manager.cc:5697] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 0 to 1, leader changed from <none> to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 1 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:26.476115 11449 raft_consensus.cc:2468] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 1.
I20260709 12:16:26.490833 11373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:26.491531 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a841f2f09ced40a4bbf33594e11bd7ad" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:26.492139 11375 raft_consensus.cc:3060] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.492499 11378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:26.490150 11565 leader_election.cc:304] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:16:26.495150 11866 raft_consensus.cc:2804] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:26.495579 11866 raft_consensus.cc:493] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:26.495893 11866 raft_consensus.cc:3060] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.490713 12077 consensus_queue.cc:1048] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:16:26.496630 12087 consensus_queue.cc:1048] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:26.499754 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:26.500455 11379 raft_consensus.cc:3060] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.499812 11376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:26.502398 11376 raft_consensus.cc:2468] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 1.
I20260709 12:16:26.491537 11373 raft_consensus.cc:3060] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.505477 11565 leader_election.cc:304] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:16:26.511111 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:26.512054 12125 raft_consensus.cc:2804] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:26.512591 12125 raft_consensus.cc:697] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:26.513509 12125 consensus_queue.cc:237] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:26.506162 11342 leader_election.cc:304] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:26.510043 11377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:26.493552 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:26.516878 11342 leader_election.cc:304] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:26.518622 12077 raft_consensus.cc:2804] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:26.520480 12077 raft_consensus.cc:493] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:26.521044 12077 raft_consensus.cc:3060] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.521822 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:26.522693 11597 raft_consensus.cc:2393] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 1: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:16:26.518002 11379 raft_consensus.cc:2468] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 1.
I20260709 12:16:26.536151 11342 leader_election.cc:304] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:16:26.505949 11866 raft_consensus.cc:515] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
W20260709 12:16:26.545055 11343 leader_election.cc:343] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:26.548493 11493 leader_election.cc:304] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:26.548707 11567 leader_election.cc:304] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:26.550285 11567 leader_election.cc:304] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:26.551144 12087 raft_consensus.cc:2804] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:26.551542 12087 raft_consensus.cc:493] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:26.551880 12087 raft_consensus.cc:3060] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:26.553675 12029 raft_consensus.cc:2804] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:26.549490 12110 raft_consensus.cc:2749] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:26.555371 12029 raft_consensus.cc:697] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:26.543483 12078 raft_consensus.cc:2749] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:16:26.557729 11377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a841f2f09ced40a4bbf33594e11bd7ad" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:26.557610 11493 leader_election.cc:304] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:26.559741 11972 raft_consensus.cc:2749] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:16:26.542830 11375 raft_consensus.cc:2468] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 1.
I20260709 12:16:26.560680 12083 raft_consensus.cc:2764] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
W20260709 12:16:26.560848 12126 log.cc:927] Time spent T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:16:26.556807 11373 raft_consensus.cc:2468] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 1.
I20260709 12:16:26.560621 12029 consensus_queue.cc:237] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:26.566839 11647 tablet_bootstrap.cc:492] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671: No bootstrap required, opened a new log
I20260709 12:16:26.567472 11647 ts_tablet_manager.cc:1403] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671: Time spent bootstrapping tablet: real 0.242s	user 0.027s	sys 0.020s
I20260709 12:16:26.558480 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:26.570636 11647 raft_consensus.cc:359] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:26.571519 11647 raft_consensus.cc:385] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:26.571851 11647 raft_consensus.cc:740] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Initialized, Role: FOLLOWER
I20260709 12:16:26.570228 11594 raft_consensus.cc:3060] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.573076 11647 consensus_queue.cc:260] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:26.576339 11647 ts_tablet_manager.cc:1434] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 12:16:26.584028 11972 raft_consensus.cc:493] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.584728 11972 raft_consensus.cc:515] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:26.585557 11943 consensus_queue.cc:1048] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:26.592365 11972 leader_election.cc:290] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:26.593958 11647 tablet_bootstrap.cc:492] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671: Bootstrap starting.
I20260709 12:16:26.600700 11567 leader_election.cc:304] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:26.605813 11342 leader_election.cc:304] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:26.606593 11417 leader_election.cc:304] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:16:26.568986 12087 raft_consensus.cc:515] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:26.606092 12118 raft_consensus.cc:2804] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:26.627664 11376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:26.638290 11376 raft_consensus.cc:2468] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 1.
I20260709 12:16:26.639425 11493 leader_election.cc:304] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:26.640344 11972 raft_consensus.cc:2804] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:26.626072 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:26.640736 11972 raft_consensus.cc:493] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:26.641348 11972 raft_consensus.cc:3060] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:26.610989 12050 raft_consensus.cc:2764] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:16:26.613773 12122 raft_consensus.cc:2749] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:26.608259 12083 consensus_queue.cc:1048] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.036s
I20260709 12:16:26.656214 11647 tablet_bootstrap.cc:654] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:26.658142 12087 leader_election.cc:290] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:26.644845 12118 raft_consensus.cc:697] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
W20260709 12:16:26.667214 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 56856.2us
W20260709 12:16:26.667403 11342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 54534.1us
I20260709 12:16:26.678298 11376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:26.684512 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:26.685734 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:26.686380 11519 raft_consensus.cc:3060] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.687481 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:26.688195 11524 raft_consensus.cc:2468] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 1.
I20260709 12:16:26.690621 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:26.691278 11523 raft_consensus.cc:3060] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:26.692129 12118 consensus_queue.cc:237] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:26.685752 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:26.682701 11376 raft_consensus.cc:3060] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:26.694072 11522 raft_consensus.cc:2393] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 1: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:16:26.695449 11866 leader_election.cc:290] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:26.699110 11594 raft_consensus.cc:2468] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 1.
I20260709 12:16:26.704357 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e4724ed93a467ea47763eec9a6de2e" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:26.705096 11528 raft_consensus.cc:3060] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:26.706616 11549 debug-util.cc:398] Leaking SignalData structure 0x7b080027bc80 after lost signal to thread 3925
W20260709 12:16:26.707823 11549 debug-util.cc:398] Leaking SignalData structure 0x7b0800149b60 after lost signal to thread 11311
W20260709 12:16:26.709363 11549 debug-util.cc:398] Leaking SignalData structure 0x7b080028f120 after lost signal to thread 11403
I20260709 12:16:26.717926 11972 raft_consensus.cc:515] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
W20260709 12:16:26.719806 11549 debug-util.cc:398] Leaking SignalData structure 0x7b08003b2000 after lost signal to thread 11478
W20260709 12:16:26.724589 11549 debug-util.cc:398] Leaking SignalData structure 0x7b080028fc20 after lost signal to thread 11552
I20260709 12:16:26.694003 12077 raft_consensus.cc:515] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:26.717025 11866 consensus_queue.cc:1048] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:16:26.727483 11525 raft_consensus.cc:1240] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:16:26.716742 11566 leader_election.cc:304] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
W20260709 12:16:26.734618 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 103073us
I20260709 12:16:26.719547 11523 raft_consensus.cc:2468] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 2.
I20260709 12:16:26.739280 11342 leader_election.cc:304] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:26.722993 11519 raft_consensus.cc:2468] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 1.
I20260709 12:16:26.743294 12011 raft_consensus.cc:2804] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:26.743818 12011 raft_consensus.cc:697] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 1 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:16:26.744668 12011 consensus_queue.cc:237] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:26.745343 11972 leader_election.cc:290] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:26.737892 12091 raft_consensus.cc:493] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.749711 12091 raft_consensus.cc:515] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:26.752113 12091 leader_election.cc:290] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:26.754187 11376 raft_consensus.cc:2468] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 2.
I20260709 12:16:26.749178 11528 raft_consensus.cc:2468] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 1.
I20260709 12:16:26.755944 12137 consensus_queue.cc:1059] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:26.756852 12137 raft_consensus.cc:3055] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:26.757263 12137 raft_consensus.cc:740] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:16:26.758170 12137 consensus_queue.cc:260] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:26.759238 11373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:26.757011 12077 leader_election.cc:290] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:26.739241 12125 raft_consensus.cc:2749] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:26.760473 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:26.761490 11375 raft_consensus.cc:2393] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 1: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:16:26.760048 11373 raft_consensus.cc:3060] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:26.762825 11567 leader_election.cc:304] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:26.767442 12125 raft_consensus.cc:2804] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:26.768044 12125 raft_consensus.cc:697] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 2 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:26.768926 12125 consensus_queue.cc:237] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:26.772166 11647 tablet_bootstrap.cc:492] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671: No bootstrap required, opened a new log
I20260709 12:16:26.772773 11647 ts_tablet_manager.cc:1403] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671: Time spent bootstrapping tablet: real 0.189s	user 0.017s	sys 0.009s
I20260709 12:16:26.776954 11566 leader_election.cc:304] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:16:26.759464 12137 raft_consensus.cc:3060] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:26.789885 12029 raft_consensus.cc:2804] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:26.791896 12029 raft_consensus.cc:697] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:26.793345 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:26.793045 12029 consensus_queue.cc:237] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:26.794009 11445 raft_consensus.cc:3060] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.795156 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e4724ed93a467ea47763eec9a6de2e" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:26.795861 11449 raft_consensus.cc:3060] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.795774 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
W20260709 12:16:26.799947 11549 debug-util.cc:398] Leaking SignalData structure 0x7b080025eb80 after lost signal to thread 11626
I20260709 12:16:26.809418 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:26.810137 11528 raft_consensus.cc:3060] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.811959 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:26.812592 11647 raft_consensus.cc:359] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:26.814564 11373 raft_consensus.cc:2468] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 2.
I20260709 12:16:26.819659 11647 raft_consensus.cc:385] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:26.821545 11647 raft_consensus.cc:740] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Initialized, Role: FOLLOWER
I20260709 12:16:26.823028 11491 leader_election.cc:304] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:26.825172 11375 raft_consensus.cc:1240] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:26.845639 11445 raft_consensus.cc:2468] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 1.
I20260709 12:16:26.823671 11647 consensus_queue.cc:260] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:26.853273 11342 leader_election.cc:304] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:26.859270 11493 leader_election.cc:304] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:26.860448 12109 raft_consensus.cc:2804] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:26.861016 12109 raft_consensus.cc:697] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 2 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:16:26.861963 12109 consensus_queue.cc:237] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:26.870083 12078 raft_consensus.cc:2804] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:26.894100 11647 ts_tablet_manager.cc:1434] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671: Time spent starting tablet: real 0.121s	user 0.009s	sys 0.002s
I20260709 12:16:26.866504 11449 raft_consensus.cc:2468] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 1.
I20260709 12:16:26.897776 12078 raft_consensus.cc:697] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 1 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:16:26.901443 12078 consensus_queue.cc:237] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:26.916682 11972 raft_consensus.cc:493] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:26.920814 11972 raft_consensus.cc:515] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:26.923336 11972 leader_election.cc:290] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:26.927595 11273 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57416 (request call id 80) took 1001 ms. Trace:
I20260709 12:16:26.931622 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:26.932575 11597 raft_consensus.cc:2393] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 1: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:16:26.928092 11273 rpcz_store.cc:276] 0709 12:16:25.928663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:25.928849 (+   186us) service_pool.cc:224] Handling call
0709 12:16:26.927528 (+998679us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:16:26.586743 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:16:26.587298 (+   555us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:16:26.587327 (+    29us) write_op.cc:435] Acquired schema lock
0709 12:16:26.587344 (+    17us) tablet.cc:662] Decoding operations
0709 12:16:26.587681 (+   337us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:16:26.587753 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 12:16:26.587784 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:16:26.587973 (+   189us) tablet.cc:701] Row locks acquired
0709 12:16:26.587992 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:16:26.588358 (+   366us) write_op.cc:270] Start()
0709 12:16:26.588466 (+   108us) write_op.cc:276] Timestamp: P: 1783599386588309 usec, L: 0
0709 12:16:26.588486 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:16:26.615833 (+ 27347us) log.cc:844] Serialized 540 byte log entry
0709 12:16:26.828139 (+212306us) op_driver.cc:464] REPLICATION: finished
0709 12:16:26.920098 (+ 91959us) write_op.cc:301] APPLY: starting
0709 12:16:26.920197 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 12:16:26.920290 (+    93us) tablet.cc:1370] finished BulkCheckPresence
0709 12:16:26.920413 (+   123us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:16:26.920656 (+   243us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:16:26.920820 (+   164us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:16:26.920877 (+    57us) write_op.cc:312] APPLY: finished
0709 12:16:26.921104 (+   227us) log.cc:844] Serialized 22 byte log entry
0709 12:16:26.921275 (+   171us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:26.921355 (+    80us) write_op.cc:454] Released schema lock
0709 12:16:26.921436 (+    81us) write_op.cc:341] FINISH: Updating metrics
0709 12:16:26.921807 (+   371us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:26.921835 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":91688,"apply.run_cpu_time_us":1713,"apply.run_wall_time_us":1713,"num_ops":1,"prepare.queue_time_us":109805,"prepare.run_cpu_time_us":3322,"prepare.run_wall_time_us":42944,"replication_time_us":234776,"thread_start_us":131064,"threads_started":2}]]}
I20260709 12:16:26.947144 11275 catalog_manager.cc:5697] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 1 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:26.955354 12087 consensus_queue.cc:1048] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:26.956403 11376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:26.958460 11493 leader_election.cc:304] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:26.959255 11972 raft_consensus.cc:3060] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:26.963615 11446 raft_consensus.cc:2410] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 12:16:26.961020 11528 raft_consensus.cc:2468] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 1.
I20260709 12:16:26.968649 12091 raft_consensus.cc:2749] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:27.010046 12087 consensus_queue.cc:1048] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:27.010903 12121 consensus_queue.cc:1048] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:27.014111 11972 raft_consensus.cc:2749] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:27.030668 12087 consensus_queue.cc:1048] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:27.033073 11274 catalog_manager.cc:5697] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 1 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:27.044739 11274 catalog_manager.cc:5697] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 1 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } }
W20260709 12:16:27.062225 11325 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:27.092926 11276 catalog_manager.cc:5697] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 1 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:27.117709 12087 consensus_queue.cc:1048] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:27.120841 11276 catalog_manager.cc:5697] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 1 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:27.123080 11276 catalog_manager.cc:5697] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 1 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:27.125326 11276 catalog_manager.cc:5697] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 0 to 2, leader changed from <none> to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 2 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:27.127526 11276 catalog_manager.cc:5697] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 1 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:27.133993 12125 consensus_queue.cc:1048] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:27.176460 12125 consensus_queue.cc:1048] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:27.168787 11275 catalog_manager.cc:5697] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 1 to 2, leader changed from 1c101e338f954ef086338e251deed19d (127.3.212.130) to a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131). New cstate: current_term: 2 leader_uuid: "a03223e9e41247c3a36b7b7c3d476671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:27.193162 12087 consensus_queue.cc:1048] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:27.200860 11528 raft_consensus.cc:1275] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:16:27.206557 12029 consensus_queue.cc:1048] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:27.206928 11273 catalog_manager.cc:5697] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 0 to 1, leader changed from <none> to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 1 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:27.211716 11273 catalog_manager.cc:5697] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 0 to 1, leader changed from <none> to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 1 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:27.233682 12121 consensus_queue.cc:1048] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:27.249970 11975 consensus_queue.cc:1048] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:27.253679 11376 raft_consensus.cc:1275] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:16:27.255633 12121 consensus_queue.cc:1048] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:27.297443 12087 consensus_queue.cc:1048] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:27.331982 11975 consensus_queue.cc:1048] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:27.337224 11964 consensus_queue.cc:1048] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:27.378093 12078 consensus_queue.cc:1048] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:27.403519 11451 raft_consensus.cc:1275] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 12:16:27.404057 11451 pending_rounds.cc:85] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d: Aborting all ops after (but not including) 0
I20260709 12:16:27.404389 11451 pending_rounds.cc:107] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:16:27.404762 11451 raft_consensus.cc:2889] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:27.406495 11972 consensus_queue.cc:1048] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:27.482441 11376 raft_consensus.cc:1275] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:16:27.484252 11972 consensus_queue.cc:1048] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:16:28.962708 11417 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.006s	sys 0.051s
W20260709 12:16:28.963088 11417 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.006s	sys 0.051s
W20260709 12:16:29.074216 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 43624.5us
W20260709 12:16:29.081261 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 63969.3us
I20260709 12:16:29.212836  3922 tablet_server.cc:179] TabletServer@127.3.212.129:0 shutting down...
I20260709 12:16:29.249469  3922 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:29.250494  3922 tablet_replica.cc:333] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de: stopping tablet replica
I20260709 12:16:29.251180  3922 raft_consensus.cc:2243] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:29.251742  3922 raft_consensus.cc:2272] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.253820  3922 tablet_replica.cc:333] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de: stopping tablet replica
I20260709 12:16:29.254411  3922 raft_consensus.cc:2243] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:29.254827  3922 raft_consensus.cc:2272] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.256572  3922 tablet_replica.cc:333] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de: stopping tablet replica
I20260709 12:16:29.257166  3922 raft_consensus.cc:2243] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:29.257969  3922 raft_consensus.cc:2272] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.259780  3922 tablet_replica.cc:333] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de: stopping tablet replica
I20260709 12:16:29.260432  3922 raft_consensus.cc:2243] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:29.260933  3922 raft_consensus.cc:2272] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:29.262460 11567 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
I20260709 12:16:29.263124  3922 tablet_replica.cc:333] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de: stopping tablet replica
I20260709 12:16:29.264045  3922 raft_consensus.cc:2243] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:29.264662  3922 raft_consensus.cc:2272] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:29.266244 11567 consensus_peers.cc:597] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:29.266965  3922 tablet_replica.cc:333] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de: stopping tablet replica
I20260709 12:16:29.267655  3922 raft_consensus.cc:2243] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:29.268427  3922 raft_consensus.cc:2272] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.271206  3922 tablet_replica.cc:333] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de: stopping tablet replica
I20260709 12:16:29.272032  3922 raft_consensus.cc:2243] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:29.272562  3922 raft_consensus.cc:2272] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.275317  3922 tablet_replica.cc:333] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de: stopping tablet replica
I20260709 12:16:29.276254  3922 raft_consensus.cc:2243] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:29.277197  3922 raft_consensus.cc:2272] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.279345  3922 tablet_replica.cc:333] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de: stopping tablet replica
I20260709 12:16:29.280012  3922 raft_consensus.cc:2243] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:29.280853  3922 raft_consensus.cc:2272] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.282801  3922 tablet_replica.cc:333] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de: stopping tablet replica
I20260709 12:16:29.283378  3922 raft_consensus.cc:2243] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:29.284153  3922 raft_consensus.cc:2272] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.286113  3922 tablet_replica.cc:333] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de: stopping tablet replica
I20260709 12:16:29.286772  3922 raft_consensus.cc:2243] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:29.287518  3922 raft_consensus.cc:2272] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.289669  3922 tablet_replica.cc:333] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de: stopping tablet replica
I20260709 12:16:29.290333  3922 raft_consensus.cc:2243] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:29.291326  3922 raft_consensus.cc:2272] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.293987  3922 tablet_replica.cc:333] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de: stopping tablet replica
I20260709 12:16:29.294800  3922 raft_consensus.cc:2243] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:29.295317  3922 raft_consensus.cc:2272] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.297837  3922 tablet_replica.cc:333] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de: stopping tablet replica
I20260709 12:16:29.298699  3922 raft_consensus.cc:2243] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:29.299749  3922 raft_consensus.cc:2272] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.302510  3922 tablet_replica.cc:333] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de: stopping tablet replica
I20260709 12:16:29.303329  3922 raft_consensus.cc:2243] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:29.304284  3922 raft_consensus.cc:2272] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.306886  3922 tablet_replica.cc:333] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de: stopping tablet replica
I20260709 12:16:29.307706  3922 raft_consensus.cc:2243] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:29.308166  3922 raft_consensus.cc:2272] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.310647  3922 tablet_replica.cc:333] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de: stopping tablet replica
W20260709 12:16:29.310689 11567 consensus_peers.cc:597] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:29.311458  3922 raft_consensus.cc:2243] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:29.312037  3922 raft_consensus.cc:2272] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.314278  3922 tablet_replica.cc:333] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de: stopping tablet replica
I20260709 12:16:29.314917  3922 raft_consensus.cc:2243] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:29.315354  3922 raft_consensus.cc:2272] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.317819  3922 tablet_replica.cc:333] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de: stopping tablet replica
I20260709 12:16:29.318887  3922 raft_consensus.cc:2243] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:29.320513  3922 raft_consensus.cc:2272] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.323755  3922 tablet_replica.cc:333] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de: stopping tablet replica
I20260709 12:16:29.324648  3922 raft_consensus.cc:2243] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:29.325368  3922 raft_consensus.cc:2272] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:29.326179 11419 consensus_peers.cc:597] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:29.328661  3922 tablet_replica.cc:333] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de: stopping tablet replica
I20260709 12:16:29.329722  3922 raft_consensus.cc:2243] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:29.330796  3922 raft_consensus.cc:2272] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:29.332149 11493 consensus_peers.cc:597] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:29.333366  3922 tablet_replica.cc:333] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de: stopping tablet replica
I20260709 12:16:29.334071  3922 raft_consensus.cc:2243] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:29.334574  3922 raft_consensus.cc:2272] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.337699  3922 tablet_replica.cc:333] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de: stopping tablet replica
I20260709 12:16:29.338478  3922 raft_consensus.cc:2243] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:29.339709  3922 raft_consensus.cc:2272] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.342694  3922 tablet_replica.cc:333] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de: stopping tablet replica
I20260709 12:16:29.343565  3922 raft_consensus.cc:2243] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:29.344202  3922 raft_consensus.cc:2272] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.347452  3922 tablet_replica.cc:333] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de: stopping tablet replica
I20260709 12:16:29.348333  3922 raft_consensus.cc:2243] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:29.348866  3922 raft_consensus.cc:2272] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.351713  3922 tablet_replica.cc:333] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de: stopping tablet replica
I20260709 12:16:29.352555  3922 raft_consensus.cc:2243] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:29.353148  3922 raft_consensus.cc:2272] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.355932  3922 tablet_replica.cc:333] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de: stopping tablet replica
I20260709 12:16:29.356696  3922 raft_consensus.cc:2243] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:29.357760  3922 raft_consensus.cc:2272] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.360574  3922 tablet_replica.cc:333] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de: stopping tablet replica
W20260709 12:16:29.360934 11567 consensus_peers.cc:597] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:29.361436  3922 raft_consensus.cc:2243] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:29.362107  3922 raft_consensus.cc:2272] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.364822  3922 tablet_replica.cc:333] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de: stopping tablet replica
I20260709 12:16:29.365643  3922 raft_consensus.cc:2243] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:29.366338  3922 raft_consensus.cc:2272] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.368976  3922 tablet_replica.cc:333] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de: stopping tablet replica
I20260709 12:16:29.369930  3922 raft_consensus.cc:2243] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:29.370457  3922 raft_consensus.cc:2272] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:29.371426 11567 consensus_peers.cc:597] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:29.372176 11567 consensus_peers.cc:597] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:29.373106  3922 tablet_replica.cc:333] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de: stopping tablet replica
I20260709 12:16:29.373981  3922 raft_consensus.cc:2243] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:29.374799  3922 raft_consensus.cc:2272] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.376857  3922 tablet_replica.cc:333] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de: stopping tablet replica
I20260709 12:16:29.377473  3922 raft_consensus.cc:2243] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:29.377966  3922 raft_consensus.cc:2272] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.380800  3922 tablet_replica.cc:333] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de: stopping tablet replica
I20260709 12:16:29.381675  3922 raft_consensus.cc:2243] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:29.382259  3922 raft_consensus.cc:2272] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.385149  3922 tablet_replica.cc:333] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de: stopping tablet replica
W20260709 12:16:29.385291 11419 consensus_peers.cc:597] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:29.385972  3922 raft_consensus.cc:2243] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:29.386754  3922 raft_consensus.cc:2272] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.388563  3922 tablet_replica.cc:333] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de: stopping tablet replica
I20260709 12:16:29.389127  3922 raft_consensus.cc:2243] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:29.389611  3922 raft_consensus.cc:2272] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.392355  3922 tablet_replica.cc:333] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de: stopping tablet replica
I20260709 12:16:29.393273  3922 raft_consensus.cc:2243] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:29.394106  3922 raft_consensus.cc:2272] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.397370  3922 tablet_replica.cc:333] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de: stopping tablet replica
I20260709 12:16:29.398334  3922 raft_consensus.cc:2243] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:29.398890  3922 raft_consensus.cc:2272] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.401896  3922 tablet_replica.cc:333] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de: stopping tablet replica
I20260709 12:16:29.402693  3922 raft_consensus.cc:2243] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:29.403296  3922 raft_consensus.cc:2272] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.407954  3922 tablet_replica.cc:333] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de: stopping tablet replica
I20260709 12:16:29.409147  3922 raft_consensus.cc:2243] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:29.410578  3922 raft_consensus.cc:2272] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:29.410892 11567 consensus_peers.cc:597] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:29.413796  3922 tablet_replica.cc:333] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de: stopping tablet replica
I20260709 12:16:29.414647  3922 raft_consensus.cc:2243] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:29.415218  3922 raft_consensus.cc:2272] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:29.415755 11419 consensus_peers.cc:597] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:29.418073  3922 tablet_replica.cc:333] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de: stopping tablet replica
W20260709 12:16:29.418836 11419 consensus_peers.cc:597] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:29.418993  3922 raft_consensus.cc:2243] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:29.420181  3922 raft_consensus.cc:2272] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.423030  3922 tablet_replica.cc:333] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de: stopping tablet replica
W20260709 12:16:29.423339 11419 consensus_peers.cc:597] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:29.423777  3922 raft_consensus.cc:2243] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:29.424490  3922 raft_consensus.cc:2272] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.427194  3922 tablet_replica.cc:333] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de: stopping tablet replica
I20260709 12:16:29.428005  3922 raft_consensus.cc:2243] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:29.428535  3922 raft_consensus.cc:2272] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.431823  3922 tablet_replica.cc:333] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de: stopping tablet replica
I20260709 12:16:29.432549  3922 raft_consensus.cc:2243] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:16:29.433001 11493 consensus_peers.cc:597] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:29.433710  3922 raft_consensus.cc:2272] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.436316  3922 tablet_replica.cc:333] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de: stopping tablet replica
I20260709 12:16:29.437181  3922 raft_consensus.cc:2243] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:29.437808  3922 raft_consensus.cc:2272] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:29.440070 11567 consensus_peers.cc:597] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:29.453089 11419 consensus_peers.cc:597] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:29.454685 11419 consensus_peers.cc:597] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:29.497458 11419 consensus_peers.cc:597] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:29.521275 11567 consensus_peers.cc:597] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:29.527181 11567 consensus_peers.cc:597] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:29.527683 11567 consensus_peers.cc:597] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:29.532200 11567 consensus_peers.cc:597] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:29.535169  3922 tablet_server.cc:196] TabletServer@127.3.212.129:0 shutdown complete.
W20260709 12:16:29.541326 11419 consensus_peers.cc:597] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:29.541962 11419 consensus_peers.cc:597] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:29.583667 11567 consensus_peers.cc:597] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:29.587978 11567 consensus_peers.cc:597] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:29.591323 11567 consensus_peers.cc:597] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:29.618911 11493 consensus_peers.cc:597] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:29.626016  3927 debug-util.cc:398] Leaking SignalData structure 0x7b080000f320 after lost signal to thread 11417
I20260709 12:16:29.646839  3922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:29.655723 12194 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:29.656041 12195 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:29.660383  3922 server_base.cc:1061] running on GCE node
W20260709 12:16:29.660532 12197 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:29.662321  3922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:29.662652  3922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:29.662878  3922 hybrid_clock.cc:648] HybridClock initialized: now 1783599389662861 us; error 0 us; skew 500 ppm
I20260709 12:16:29.663626  3922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:29.667443  3922 webserver.cc:533] Webserver started at http://127.3.212.129:41499/ using document root <none> and password file <none>
I20260709 12:16:29.668174  3922 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:29.668426  3922 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:16:29.675743  3922 fs_manager.cc:714] Time spent opening directory manager: real 0.006s	user 0.002s	sys 0.004s
I20260709 12:16:29.686826 12202 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:29.687747  3922 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.001s
I20260709 12:16:29.688145  3922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599103767690-3922-0/minicluster-data/ts-0-root
uuid: "b126028166e8480ba25541bf8f7fc6de"
format_stamp: "Formatted at 2026-07-09 12:16:15 on dist-test-slave-442x"
I20260709 12:16:29.688629  3922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599103767690-3922-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599103767690-3922-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599103767690-3922-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:29.724157  3922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:29.725890  3922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:29.732662  3922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:29.740188 12209 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 12:16:29.996619 11623 debug-util.cc:398] Leaking SignalData structure 0x7b080006f860 after lost signal to thread 3925
W20260709 12:16:29.997782 11623 debug-util.cc:398] Leaking SignalData structure 0x7b08000cba00 after lost signal to thread 11311
W20260709 12:16:30.033699 11623 debug-util.cc:398] Leaking SignalData structure 0x7b0800108660 after lost signal to thread 11403
W20260709 12:16:30.035048 11623 debug-util.cc:398] Leaking SignalData structure 0x7b0800417c60 after lost signal to thread 11478
W20260709 12:16:30.036389 11623 debug-util.cc:398] Leaking SignalData structure 0x7b0800030d60 after lost signal to thread 11552
W20260709 12:16:30.039759 11623 debug-util.cc:398] Leaking SignalData structure 0x7b08001d9ae0 after lost signal to thread 11626
I20260709 12:16:30.253830  3922 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 12:16:30.254268  3922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.516s	user 0.008s	sys 0.001s
I20260709 12:16:30.254637  3922 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 12:16:30.264003 12209 tablet_bootstrap.cc:492] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:30.332558 12209 tablet_bootstrap.cc:492] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:30.333695 12209 tablet_bootstrap.cc:492] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de: Bootstrap complete.
I20260709 12:16:30.334434 12209 ts_tablet_manager.cc:1403] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.071s	user 0.012s	sys 0.008s
I20260709 12:16:30.353153 12209 raft_consensus.cc:359] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:30.353996 12209 raft_consensus.cc:740] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:30.355072 12209 consensus_queue.cc:260] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:30.382223 12209 ts_tablet_manager.cc:1434] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.008s
I20260709 12:16:30.383543 12209 tablet_bootstrap.cc:492] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:30.449700 12212 raft_consensus.cc:493] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:30.450420 12212 raft_consensus.cc:515] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:30.455160 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:30.456190 12212 leader_election.cc:290] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
W20260709 12:16:30.470763 11493 leader_election.cc:336] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:16:30.471342 11493 leader_election.cc:304] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:30.478787 12212 raft_consensus.cc:2749] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:30.506428 12211 raft_consensus.cc:493] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:30.507046 12211 raft_consensus.cc:515] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:30.509310 12211 leader_election.cc:290] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:30.509954 12211 raft_consensus.cc:493] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:30.510392 12211 raft_consensus.cc:515] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:30.518117 12212 raft_consensus.cc:493] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:30.519975 12211 leader_election.cc:290] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:30.522431 12212 raft_consensus.cc:515] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:30.532585 11972 raft_consensus.cc:493] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:30.533293 11972 raft_consensus.cc:515] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:30.535597 11972 leader_election.cc:290] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:30.532590 12212 leader_election.cc:290] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:30.553566 12211 raft_consensus.cc:493] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:30.558116 12211 raft_consensus.cc:515] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:30.556300 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:30.561159 12226 raft_consensus.cc:493] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:30.561757 12226 raft_consensus.cc:515] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:30.555027 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:30.556974 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:30.559293 11972 raft_consensus.cc:493] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:30.564574 11972 raft_consensus.cc:515] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:30.565371 12223 raft_consensus.cc:493] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:30.569666 11972 leader_election.cc:290] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:30.569571 12223 raft_consensus.cc:515] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:30.572090 12211 leader_election.cc:290] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:30.573673 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:30.568998 12228 raft_consensus.cc:493] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:30.575953 12228 raft_consensus.cc:515] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:30.582008 12228 leader_election.cc:290] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:30.583822 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:30.564070 12226 leader_election.cc:290] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:30.584408 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:30.585583 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:30.577172 12223 leader_election.cc:290] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:30.586550 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:30.588831 12210 raft_consensus.cc:493] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:30.595573 12175 raft_consensus.cc:493] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:30.596982 12218 raft_consensus.cc:493] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
W20260709 12:16:30.544116 11493 leader_election.cc:336] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:16:30.616360 11600 raft_consensus.cc:2468] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 1.
W20260709 12:16:30.637218 11493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 93133.8us
W20260709 12:16:30.637815 11493 leader_election.cc:336] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:16:30.638232 11493 leader_election.cc:304] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:30.595139 12176 raft_consensus.cc:493] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
W20260709 12:16:30.639192 11493 leader_election.cc:336] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:16:30.640048 11491 leader_election.cc:304] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:30.641804 11493 leader_election.cc:304] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
W20260709 12:16:30.642293 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 46259.5us
I20260709 12:16:30.640625 11450 raft_consensus.cc:2468] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 1.
I20260709 12:16:30.642845 12226 raft_consensus.cc:2749] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:30.592726 12217 raft_consensus.cc:493] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:30.593466 12187 raft_consensus.cc:493] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:30.644266 12187 raft_consensus.cc:515] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:30.597363 12225 raft_consensus.cc:493] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:30.646124 12225 raft_consensus.cc:515] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:30.646529 12187 leader_election.cc:290] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:30.647161 12187 raft_consensus.cc:493] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:30.647626 12187 raft_consensus.cc:515] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:30.648646 12225 leader_election.cc:290] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:30.590055 12178 raft_consensus.cc:493] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:30.643708 12223 raft_consensus.cc:2749] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:30.651396 11491 leader_election.cc:304] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:16:30.595749 12215 raft_consensus.cc:493] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
W20260709 12:16:30.654819 11493 leader_election.cc:336] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:16:30.653568 12225 raft_consensus.cc:493] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:30.661134 11493 leader_election.cc:304] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:30.643905 12217 raft_consensus.cc:515] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:30.662626 12229 raft_consensus.cc:2749] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:30.658278 11972 raft_consensus.cc:2804] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:30.663499 11972 raft_consensus.cc:493] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:30.663722 12230 raft_consensus.cc:493] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:30.663465 12225 raft_consensus.cc:515] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:30.664089 11972 raft_consensus.cc:3060] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:30.664270 12230 raft_consensus.cc:515] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:30.665829 12225 leader_election.cc:290] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:30.667765 11491 leader_election.cc:304] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:16:30.668656 12229 raft_consensus.cc:2804] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:30.669153 12229 raft_consensus.cc:493] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:30.669786 12229 raft_consensus.cc:3060] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:30.670378 12238 raft_consensus.cc:493] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:30.671029 12238 raft_consensus.cc:515] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:30.672063 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:30.672812 11446 raft_consensus.cc:2468] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 1.
I20260709 12:16:30.674593 12236 raft_consensus.cc:493] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:30.673334 12238 leader_election.cc:290] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:30.677796 12236 raft_consensus.cc:515] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:30.668334 12230 leader_election.cc:290] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:30.654219 12176 raft_consensus.cc:515] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:30.679764 12178 raft_consensus.cc:515] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:30.659468 12234 raft_consensus.cc:493] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:30.660669 12228 raft_consensus.cc:2749] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:30.659228 12187 leader_election.cc:290] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:30.682808 11491 leader_election.cc:304] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:16:30.694640 12232 raft_consensus.cc:493] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:30.694939 12227 raft_consensus.cc:2804] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:30.697513 12217 leader_election.cc:290] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:30.695283 12232 raft_consensus.cc:515] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:30.698534 12209 tablet_bootstrap.cc:492] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:16:30.699158 11419 leader_election.cc:336] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
W20260709 12:16:30.699820 11419 leader_election.cc:336] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:16:30.699752 11972 raft_consensus.cc:515] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
W20260709 12:16:30.700374 11419 leader_election.cc:336] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:16:30.715770 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:30.716475 11600 raft_consensus.cc:2468] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 1.
I20260709 12:16:30.716635 12237 raft_consensus.cc:493] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:30.713832 12223 raft_consensus.cc:493] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:30.719559 12209 tablet_bootstrap.cc:492] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de: Bootstrap complete.
I20260709 12:16:30.720335 12209 ts_tablet_manager.cc:1403] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.337s	user 0.049s	sys 0.031s
I20260709 12:16:30.720569 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:30.721490 11972 leader_election.cc:290] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:30.721205 11600 raft_consensus.cc:2468] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 1.
I20260709 12:16:30.701054 12227 raft_consensus.cc:493] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:30.641111 12218 raft_consensus.cc:515] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:30.725561 11417 leader_election.cc:304] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:30.722309 12223 raft_consensus.cc:515] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:30.741140 12235 raft_consensus.cc:2804] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:30.729686 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:30.741575 12235 raft_consensus.cc:493] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:30.731024 12229 raft_consensus.cc:515] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:30.731326 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:16:30.731477 11419 leader_election.cc:336] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:16:30.731937 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:30.741988 12235 raft_consensus.cc:3060] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:30.742532 11446 raft_consensus.cc:2468] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 1.
I20260709 12:16:30.741845 11521 raft_consensus.cc:2468] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 1.
I20260709 12:16:30.735756 12236 leader_election.cc:290] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:30.654460 12175 raft_consensus.cc:515] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:30.741233 11417 leader_election.cc:304] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:30.744690 12187 raft_consensus.cc:2804] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:30.745074 12187 raft_consensus.cc:493] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:30.733446 12232 leader_election.cc:290] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:30.701293 12234 raft_consensus.cc:515] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:30.747308 11566 leader_election.cc:304] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:16:30.748121 12234 leader_election.cc:290] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:30.748303 12217 raft_consensus.cc:2804] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:30.748760 12217 raft_consensus.cc:493] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:30.748970 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:30.718425 12237 raft_consensus.cc:515] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:30.682694 11448 raft_consensus.cc:2468] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 2.
I20260709 12:16:30.751303 12237 leader_election.cc:290] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:30.641295 12210 raft_consensus.cc:515] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:30.753595 12240 raft_consensus.cc:493] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:30.754246 12210 leader_election.cc:290] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:30.736287 12233 raft_consensus.cc:493] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:30.754714 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:30.742004 12223 leader_election.cc:290] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:30.755119 12233 raft_consensus.cc:515] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:30.753101 12175 leader_election.cc:290] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
W20260709 12:16:30.739275 11493 leader_election.cc:336] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
W20260709 12:16:30.757097 11493 leader_election.cc:336] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
W20260709 12:16:30.757798 11493 leader_election.cc:336] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:16:30.681737 12215 raft_consensus.cc:515] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:30.736804 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:30.737344 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:30.742671 11520 raft_consensus.cc:2393] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 2: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:16:30.754282 12240 raft_consensus.cc:515] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:30.725587 12227 raft_consensus.cc:3060] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:30.760792 12240 leader_election.cc:290] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:30.739384 12218 leader_election.cc:290] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:30.745493 12187 raft_consensus.cc:3060] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:30.761940 11521 raft_consensus.cc:2468] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 1.
W20260709 12:16:30.764261 11567 leader_election.cc:336] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
W20260709 12:16:30.765039 11567 leader_election.cc:336] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
W20260709 12:16:30.754848 11419 leader_election.cc:336] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
W20260709 12:16:30.766405 11419 leader_election.cc:336] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:16:30.767447 11491 leader_election.cc:304] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:30.768111 12229 leader_election.cc:290] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:30.739190 12178 leader_election.cc:290] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:30.736630 12176 leader_election.cc:290] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:30.769050 11522 raft_consensus.cc:2393] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 2: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:16:30.769183 12242 raft_consensus.cc:493] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:30.771059 12242 raft_consensus.cc:515] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:30.771987 12215 leader_election.cc:290] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:30.772641 11595 raft_consensus.cc:2468] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 1.
I20260709 12:16:30.735569 12209 raft_consensus.cc:359] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:30.757545 12233 leader_election.cc:290] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:30.766131 11600 raft_consensus.cc:2468] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 1.
I20260709 12:16:30.766285 12217 raft_consensus.cc:3060] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:30.774703 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:30.773568 12209 raft_consensus.cc:740] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:30.777168 11448 raft_consensus.cc:3060] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:30.778693 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:30.779433 11521 raft_consensus.cc:2468] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 1.
I20260709 12:16:30.781482 12209 consensus_queue.cc:260] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
W20260709 12:16:30.774150 11419 leader_election.cc:336] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:16:30.775210 12223 raft_consensus.cc:2804] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:30.782833 12223 raft_consensus.cc:493] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:30.783212 12223 raft_consensus.cc:3060] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:30.777182 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:30.784261 11522 raft_consensus.cc:2468] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 1.
W20260709 12:16:30.769342 11567 leader_election.cc:336] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:16:30.785737 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:30.792428 11521 raft_consensus.cc:2468] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 1.
W20260709 12:16:30.792912 11419 leader_election.cc:336] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:16:30.793326 12209 ts_tablet_manager.cc:1434] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.073s	user 0.008s	sys 0.000s
I20260709 12:16:30.805629 12209 tablet_bootstrap.cc:492] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
W20260709 12:16:30.775432 11493 leader_election.cc:336] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
W20260709 12:16:30.806557 11493 leader_election.cc:336] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:16:30.806617 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:30.807363 11595 raft_consensus.cc:2468] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 1.
I20260709 12:16:30.807461 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:30.808033 11600 raft_consensus.cc:3060] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:30.808831 11565 leader_election.cc:304] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: b126028166e8480ba25541bf8f7fc6de
W20260709 12:16:30.810405 11493 leader_election.cc:336] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:16:30.810643 12229 raft_consensus.cc:493] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:30.811257 12229 raft_consensus.cc:515] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:30.795285 11418 leader_election.cc:304] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:30.795917 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:30.796221 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:30.813704 12229 leader_election.cc:290] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
W20260709 12:16:30.807622 11419 leader_election.cc:336] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:16:30.814134 11527 raft_consensus.cc:2468] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 1.
I20260709 12:16:30.815083 11520 raft_consensus.cc:2468] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 1.
I20260709 12:16:30.816680 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:30.817553 11446 raft_consensus.cc:2468] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 1.
I20260709 12:16:30.819639 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:30.797456 12187 raft_consensus.cc:515] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
W20260709 12:16:30.822978 11493 leader_election.cc:336] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
W20260709 12:16:30.823572 11493 leader_election.cc:336] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:16:30.825161 12187 leader_election.cc:290] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:30.801429 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:16:30.826143 11493 leader_election.cc:336] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:16:30.795563 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:30.819097 11418 leader_election.cc:304] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:30.802695 11417 leader_election.cc:304] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:30.826933 11522 raft_consensus.cc:2468] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 1.
I20260709 12:16:30.804562 11566 leader_election.cc:304] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:30.773356 12242 leader_election.cc:290] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:30.800135 12235 raft_consensus.cc:515] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:30.828490 12210 raft_consensus.cc:2804] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:30.828896 12210 raft_consensus.cc:493] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:30.829293 12210 raft_consensus.cc:3060] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:30.830853 12235 leader_election.cc:290] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
W20260709 12:16:30.802551 11567 leader_election.cc:336] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:16:30.831931 11491 leader_election.cc:304] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:30.832763 12229 raft_consensus.cc:2804] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:30.833128 12229 raft_consensus.cc:493] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
W20260709 12:16:30.832012 11567 leader_election.cc:336] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:16:30.826064 11600 raft_consensus.cc:2468] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 2.
I20260709 12:16:30.833570 12229 raft_consensus.cc:3060] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:30.834750 12239 raft_consensus.cc:2749] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:30.837775 11491 leader_election.cc:304] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:30.810472 12244 raft_consensus.cc:2804] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:30.838531 12244 raft_consensus.cc:493] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:30.838673 11972 raft_consensus.cc:2804] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:30.839156 11972 raft_consensus.cc:493] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:30.840080 11972 raft_consensus.cc:3060] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:30.840274 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d43eecbad746fd9ddce50c5b9fc3e8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:30.840945 11447 raft_consensus.cc:2468] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 1.
I20260709 12:16:30.839285 12210 raft_consensus.cc:515] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:30.839131 12244 raft_consensus.cc:3060] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:30.842645 11566 leader_election.cc:304] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:30.844564 11566 leader_election.cc:304] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:16:30.845742 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:30.849541 12239 raft_consensus.cc:2804] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:30.850170 11491 leader_election.cc:304] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:30.851945 12215 raft_consensus.cc:2804] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:30.852089 11447 raft_consensus.cc:2393] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 2: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:16:30.852092 11566 leader_election.cc:304] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:16:30.852929 12226 raft_consensus.cc:2804] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:30.853915 12226 raft_consensus.cc:493] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:30.854343 12226 raft_consensus.cc:3060] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:30.851861 12239 raft_consensus.cc:493] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:30.854377 11418 leader_election.cc:304] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:30.855515 12235 raft_consensus.cc:2804] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:30.855894 12235 raft_consensus.cc:493] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:30.856254 12235 raft_consensus.cc:3060] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:30.856467 12242 raft_consensus.cc:2804] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:30.856973 12242 raft_consensus.cc:493] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:30.857424 12242 raft_consensus.cc:3060] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:30.861013 12229 raft_consensus.cc:515] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:30.855062 12239 raft_consensus.cc:3060] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:30.863914 12229 leader_election.cc:290] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:30.870922 12223 raft_consensus.cc:515] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:30.872334 11521 raft_consensus.cc:2393] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 3: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:16:30.872980 12244 raft_consensus.cc:515] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:30.873045 12187 raft_consensus.cc:493] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:30.875464 12244 leader_election.cc:290] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:30.875730 12187 raft_consensus.cc:515] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:30.869853 12226 raft_consensus.cc:515] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:30.878300 11418 leader_election.cc:304] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:30.879207 12226 leader_election.cc:290] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:30.879877 12234 raft_consensus.cc:3060] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:30.880723 12217 raft_consensus.cc:515] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:30.882961 12217 leader_election.cc:290] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:30.883837 11448 raft_consensus.cc:2468] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 2.
I20260709 12:16:30.881664 12235 raft_consensus.cc:515] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:30.884415 12178 raft_consensus.cc:2749] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:16:30.850757 11567 leader_election.cc:336] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
W20260709 12:16:30.885764 11567 leader_election.cc:336] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:16:30.775954 12227 raft_consensus.cc:515] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:30.853226 12215 raft_consensus.cc:493] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
W20260709 12:16:30.886473 11567 leader_election.cc:336] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:16:30.886488 12215 raft_consensus.cc:3060] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:16:30.887459 11567 leader_election.cc:336] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:16:30.853435 12233 raft_consensus.cc:2804] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:30.889328 12227 leader_election.cc:290] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:30.889742 11519 raft_consensus.cc:2393] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 2: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:16:30.892261 12239 raft_consensus.cc:515] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:30.893486 12233 raft_consensus.cc:493] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:30.853480 11566 leader_election.cc:304] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:16:30.893790 12234 raft_consensus.cc:2749] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:30.894176 12233 raft_consensus.cc:3060] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:30.889343 11972 raft_consensus.cc:515] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:30.894727 12227 raft_consensus.cc:493] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:30.895264 12227 raft_consensus.cc:515] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:30.896715 12218 raft_consensus.cc:2804] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:30.897106 12218 raft_consensus.cc:493] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:30.897467 12218 raft_consensus.cc:3060] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:30.898077 12227 leader_election.cc:290] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:30.899559 11491 leader_election.cc:304] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:30.900133 12223 leader_election.cc:290] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:30.900772 12223 raft_consensus.cc:2804] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:30.843375 12210 leader_election.cc:290] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:30.902767 12215 raft_consensus.cc:515] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:30.908130 11972 leader_election.cc:290] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
W20260709 12:16:30.905632 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 52259.8us
I20260709 12:16:30.909730 12187 leader_election.cc:290] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
W20260709 12:16:30.894115 11493 leader_election.cc:336] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:16:30.905455 12233 raft_consensus.cc:515] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:30.907248 11418 leader_election.cc:304] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:30.905336 12218 raft_consensus.cc:515] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:30.910049 12215 leader_election.cc:290] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:30.915766 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:30.920290 11519 raft_consensus.cc:2393] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 2: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:16:30.916251 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:30.911321 12223 raft_consensus.cc:697] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 2 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
W20260709 12:16:30.921520 11493 leader_election.cc:336] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:16:30.914199 12187 raft_consensus.cc:3060] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:30.922560 12223 consensus_queue.cc:237] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:30.923137 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:30.923800 11600 raft_consensus.cc:3060] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:30.911924 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:30.926951 11448 raft_consensus.cc:2393] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 2: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:16:30.927172 12239 leader_election.cc:290] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:30.912670 11566 leader_election.cc:304] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:16:30.918392 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
W20260709 12:16:30.928146 11493 leader_election.cc:336] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
W20260709 12:16:30.928301 11419 leader_election.cc:336] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:16:30.928356 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:16:30.928985 11419 leader_election.cc:336] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:16:30.929240 11595 raft_consensus.cc:2468] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 1.
I20260709 12:16:30.913627 12233 leader_election.cc:290] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
W20260709 12:16:30.930980 11419 leader_election.cc:336] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:16:30.932516 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d43eecbad746fd9ddce50c5b9fc3e8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:30.916266 12218 leader_election.cc:290] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:30.911267 12242 raft_consensus.cc:515] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:30.934346 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:30.934868 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:30.907644 12235 leader_election.cc:290] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:30.935527 11597 raft_consensus.cc:3060] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:30.936347 11491 leader_election.cc:304] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:30.933204 11596 raft_consensus.cc:2468] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 1.
I20260709 12:16:30.935179 11594 raft_consensus.cc:2393] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 2: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:16:30.935670 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:30.938593 11601 raft_consensus.cc:3060] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:30.939638 12187 raft_consensus.cc:2749] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:30.937417 12242 leader_election.cc:290] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:30.939422 11445 raft_consensus.cc:2468] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 3.
I20260709 12:16:30.937146 12227 raft_consensus.cc:2804] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:30.942737 12227 raft_consensus.cc:697] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 2 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:16:30.943581 12227 consensus_queue.cc:237] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:30.943984 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:30.944613 11519 raft_consensus.cc:3060] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:30.946951 11601 raft_consensus.cc:2468] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 2.
I20260709 12:16:30.947618 11447 raft_consensus.cc:2468] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 2.
I20260709 12:16:30.947777 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:30.948575 11596 raft_consensus.cc:2468] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 1.
W20260709 12:16:30.936882 11493 leader_election.cc:336] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
W20260709 12:16:30.950439 11493 leader_election.cc:336] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
W20260709 12:16:30.950883 11493 leader_election.cc:336] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:16:30.956039 11519 raft_consensus.cc:2468] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 2.
I20260709 12:16:30.957896 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:30.957980 12209 tablet_bootstrap.cc:492] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:30.961481 11565 leader_election.cc:304] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:30.961941 12209 tablet_bootstrap.cc:492] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de: Bootstrap complete.
I20260709 12:16:30.962724 12209 ts_tablet_manager.cc:1403] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.157s	user 0.015s	sys 0.002s
I20260709 12:16:30.963107 11491 leader_election.cc:304] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:30.963244 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:30.963881 11521 raft_consensus.cc:3060] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:30.964471 11491 leader_election.cc:304] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:30.964658 12223 raft_consensus.cc:2749] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:30.965435 12223 raft_consensus.cc:2804] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:30.959837 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:30.966300 12223 raft_consensus.cc:697] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 3 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:16:30.966836 11447 raft_consensus.cc:2393] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 2: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:16:30.965665 11491 leader_election.cc:304] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:30.967849 12223 consensus_queue.cc:237] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:30.968564 12226 raft_consensus.cc:2804] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:30.965978 12209 raft_consensus.cc:359] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:30.969316 12226 raft_consensus.cc:697] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 2 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:16:30.965998 11595 raft_consensus.cc:2393] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 2: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:16:30.971149 11600 raft_consensus.cc:2468] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 2.
I20260709 12:16:30.969659 12209 raft_consensus.cc:740] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:30.972409 12209 consensus_queue.cc:260] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:30.973258 11565 leader_election.cc:304] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:30.975165 12226 consensus_queue.cc:237] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:30.976042 11597 raft_consensus.cc:2468] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 2.
I20260709 12:16:30.978756 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:30.981244 11417 leader_election.cc:304] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:30.981717 11565 leader_election.cc:304] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:30.982555 11525 raft_consensus.cc:2393] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 2: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:16:30.983413 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:30.983592 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:30.983748 12242 raft_consensus.cc:2749] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:30.984233 11523 raft_consensus.cc:3060] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:30.985319 12241 raft_consensus.cc:2749] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:16:30.985705 11419 leader_election.cc:336] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:16:30.986233 11527 raft_consensus.cc:3060] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:30.986317 11419 leader_election.cc:304] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:30.987216 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:30.987864 11522 raft_consensus.cc:3060] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:30.988118 12187 raft_consensus.cc:2749] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:16:30.989635 11419 leader_election.cc:336] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
W20260709 12:16:30.990176 11419 leader_election.cc:336] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:16:30.991525 12239 raft_consensus.cc:2804] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:30.992065 12239 raft_consensus.cc:493] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:30.992642 11523 raft_consensus.cc:2468] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 2.
I20260709 12:16:30.979588 12218 raft_consensus.cc:2749] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:30.994926 11418 leader_election.cc:304] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:30.996081 12187 raft_consensus.cc:2804] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:30.996606 12187 raft_consensus.cc:697] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 2 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
W20260709 12:16:30.980327 11567 leader_election.cc:336] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:16:30.994954 12239 raft_consensus.cc:3060] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:30.997555 12187 consensus_queue.cc:237] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:30.979225 12215 raft_consensus.cc:2764] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
W20260709 12:16:31.000365 11567 leader_election.cc:336] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:16:31.002303 11417 leader_election.cc:304] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:31.002223 12209 ts_tablet_manager.cc:1434] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 12:16:31.003806 11417 leader_election.cc:304] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:31.004873 12210 raft_consensus.cc:2804] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:31.005259 12209 tablet_bootstrap.cc:492] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:31.005420 12210 raft_consensus.cc:493] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:31.005954 12210 raft_consensus.cc:3060] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:31.008749 11417 leader_election.cc:304] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: b126028166e8480ba25541bf8f7fc6de
W20260709 12:16:31.011111 11567 leader_election.cc:336] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
W20260709 12:16:31.011801 11567 leader_election.cc:336] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
W20260709 12:16:31.012288 11567 leader_election.cc:336] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:16:31.015753 12178 raft_consensus.cc:2804] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:31.016248 12178 raft_consensus.cc:493] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:31.016660 12178 raft_consensus.cc:3060] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:31.019433 12234 raft_consensus.cc:2804] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:31.019771 11491 leader_election.cc:304] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:31.020059 12234 raft_consensus.cc:697] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 2 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:16:31.021061 12234 consensus_queue.cc:237] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:31.021580 12228 raft_consensus.cc:2804] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:31.022063 12228 raft_consensus.cc:493] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:31.022502 12228 raft_consensus.cc:3060] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:31.021090 11491 leader_election.cc:304] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:31.024179 11491 leader_election.cc:304] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:31.025952 12229 raft_consensus.cc:2749] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:31.026628 12229 raft_consensus.cc:2804] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:31.027213 12229 raft_consensus.cc:697] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 2 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:16:31.028038 12229 consensus_queue.cc:237] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:31.029268 11521 raft_consensus.cc:2468] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 2.
I20260709 12:16:31.039173 11417 leader_election.cc:304] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:31.040886 12235 raft_consensus.cc:2804] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:31.041437 12235 raft_consensus.cc:697] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 2 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:16:31.042244 12235 consensus_queue.cc:237] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:31.047247 12228 raft_consensus.cc:515] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:31.051625 11527 raft_consensus.cc:2468] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 2.
I20260709 12:16:31.055752 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:31.056396 11600 raft_consensus.cc:3060] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:31.063745 11600 raft_consensus.cc:2468] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 2.
W20260709 12:16:31.064512 11567 leader_election.cc:336] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:16:31.065799 11491 leader_election.cc:304] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:16:31.068768 11566 leader_election.cc:304] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:31.062134 11276 catalog_manager.cc:5697] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 1 to 2, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 2 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } }
W20260709 12:16:31.068846 11567 leader_election.cc:336] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:16:31.072505 11567 leader_election.cc:304] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:31.068117 12226 raft_consensus.cc:2804] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:31.076011 11566 leader_election.cc:304] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
W20260709 12:16:31.073566 11567 leader_election.cc:336] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:16:31.075222 12241 raft_consensus.cc:2749] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:31.080153 11566 leader_election.cc:304] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:31.086177 12178 raft_consensus.cc:515] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:31.074167 12218 raft_consensus.cc:2749] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:31.079609 12226 raft_consensus.cc:697] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 2 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:16:31.088122 12226 consensus_queue.cc:237] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:31.089937 12237 raft_consensus.cc:2804] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:31.090555 12237 raft_consensus.cc:697] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:31.091193 12233 raft_consensus.cc:2804] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:31.091459 12237 consensus_queue.cc:237] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:31.092587 12210 raft_consensus.cc:515] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:31.071846 12228 leader_election.cc:290] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:31.098610 12178 leader_election.cc:290] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
W20260709 12:16:31.117012 11493 leader_election.cc:336] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
W20260709 12:16:31.120066 11419 leader_election.cc:336] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:16:31.127733 12233 raft_consensus.cc:697] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 2 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:31.129573 12233 consensus_queue.cc:237] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:31.119743 12239 raft_consensus.cc:515] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:31.140069 11566 leader_election.cc:304] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:31.142589 11522 raft_consensus.cc:2468] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 2.
I20260709 12:16:31.159127 12175 raft_consensus.cc:2804] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:31.143060 12210 leader_election.cc:290] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
W20260709 12:16:31.148515 11419 leader_election.cc:336] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:16:31.159917 11566 leader_election.cc:304] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:31.161588 12175 raft_consensus.cc:697] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 2 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:31.163429 12176 raft_consensus.cc:2804] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:31.164019 12176 raft_consensus.cc:697] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:31.164906 12176 consensus_queue.cc:237] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:31.167003 12239 leader_election.cc:290] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:31.180969 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d43eecbad746fd9ddce50c5b9fc3e8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:31.181870 11597 raft_consensus.cc:2393] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 2: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:16:31.181999 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d43eecbad746fd9ddce50c5b9fc3e8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:31.182377 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:31.182833 11448 raft_consensus.cc:2393] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 2: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:16:31.187999 11417 leader_election.cc:304] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:31.193140 11595 raft_consensus.cc:3060] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:31.193548 12225 raft_consensus.cc:2749] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:31.162606 12175 consensus_queue.cc:237] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
W20260709 12:16:31.209331 11567 leader_election.cc:336] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:16:31.210144 11567 leader_election.cc:304] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:31.212551 12217 raft_consensus.cc:2749] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:31.222878 11595 raft_consensus.cc:2468] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 2.
I20260709 12:16:31.240942 11417 leader_election.cc:304] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:31.240805  3922 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 12:16:31.251441  3922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.997s	user 0.298s	sys 0.014s
I20260709 12:16:31.254707 12210 raft_consensus.cc:2804] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:31.272203 12209 tablet_bootstrap.cc:492] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:31.274828 12209 tablet_bootstrap.cc:492] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de: Bootstrap complete.
I20260709 12:16:31.275794 12209 ts_tablet_manager.cc:1403] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.271s	user 0.018s	sys 0.024s
I20260709 12:16:31.266885 12210 raft_consensus.cc:697] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 2 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:16:31.283877 12210 consensus_queue.cc:237] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:31.294970 12209 raft_consensus.cc:359] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:31.296923 12209 raft_consensus.cc:740] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:31.297762 12209 consensus_queue.cc:260] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:31.300160 12209 ts_tablet_manager.cc:1434] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:16:31.301059 12209 tablet_bootstrap.cc:492] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:31.307389 11273 catalog_manager.cc:5697] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 1 to 2, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131). New cstate: current_term: 2 leader_uuid: "a03223e9e41247c3a36b7b7c3d476671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:31.305050 11275 catalog_manager.cc:5697] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 1 to 2, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 2 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:31.308784 11273 catalog_manager.cc:5697] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 1 to 2, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131). New cstate: current_term: 2 leader_uuid: "a03223e9e41247c3a36b7b7c3d476671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:31.312948 11273 catalog_manager.cc:5697] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 2 to 3, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131). New cstate: current_term: 3 leader_uuid: "a03223e9e41247c3a36b7b7c3d476671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:31.318176 11273 catalog_manager.cc:5697] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 1 to 2, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131). New cstate: current_term: 2 leader_uuid: "a03223e9e41247c3a36b7b7c3d476671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:31.319368 11273 catalog_manager.cc:5697] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 1 to 2, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131). New cstate: current_term: 2 leader_uuid: "a03223e9e41247c3a36b7b7c3d476671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:31.320590 11273 catalog_manager.cc:5697] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 1 to 2, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131). New cstate: current_term: 2 leader_uuid: "a03223e9e41247c3a36b7b7c3d476671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:31.341284 12209 tablet_bootstrap.cc:492] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:31.342402 12209 tablet_bootstrap.cc:492] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de: Bootstrap complete.
I20260709 12:16:31.343148 12209 ts_tablet_manager.cc:1403] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.042s	user 0.019s	sys 0.000s
I20260709 12:16:31.345809 12209 raft_consensus.cc:359] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:31.346674 12209 raft_consensus.cc:740] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:31.347482 12209 consensus_queue.cc:260] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:31.349630 12209 ts_tablet_manager.cc:1434] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:16:31.350750 12209 tablet_bootstrap.cc:492] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
W20260709 12:16:31.386806 11493 consensus_peers.cc:597] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:31.425560 11275 catalog_manager.cc:5697] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 1 to 2, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 2 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:31.427649 11275 catalog_manager.cc:5697] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 1 to 2, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 2 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:31.429564 11275 catalog_manager.cc:5697] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 1 to 2, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 2 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:31.454783 11595 raft_consensus.cc:1275] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:16:31.457147 11493 consensus_peers.cc:597] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:31.467692 11448 raft_consensus.cc:1275] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:31.472133 12209 tablet_bootstrap.cc:492] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:31.477582 12229 consensus_queue.cc:1048] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:31.473212 12209 tablet_bootstrap.cc:492] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de: Bootstrap complete.
I20260709 12:16:31.479894 12209 ts_tablet_manager.cc:1403] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.129s	user 0.030s	sys 0.008s
I20260709 12:16:31.482300 11596 raft_consensus.cc:1275] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:31.484524 12226 consensus_queue.cc:1048] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:31.484913 12209 raft_consensus.cc:359] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:31.485961 12209 raft_consensus.cc:740] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:31.487181 12226 consensus_queue.cc:1048] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:31.489751 11595 raft_consensus.cc:1275] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:31.489827 12209 consensus_queue.cc:260] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:31.492573 12210 consensus_queue.cc:1048] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:31.495369 12209 ts_tablet_manager.cc:1434] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:16:31.496272 12209 tablet_bootstrap.cc:492] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:31.528180 11275 catalog_manager.cc:5697] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 1 to 2, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 2 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:31.531524 11451 raft_consensus.cc:1275] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:31.530616 11275 catalog_manager.cc:5697] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 1 to 2, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 2 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:31.534114 11275 catalog_manager.cc:5697] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 1 to 2, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 2 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } }
W20260709 12:16:31.538324 11419 consensus_peers.cc:597] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:31.538928 11419 consensus_peers.cc:597] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:31.542867 12229 consensus_queue.cc:1048] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
W20260709 12:16:31.562323 11493 consensus_peers.cc:597] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:31.566062 11600 raft_consensus.cc:1275] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:31.570969 12225 consensus_queue.cc:1048] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:16:31.603158 11527 raft_consensus.cc:1275] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:31.608055 12255 consensus_queue.cc:1048] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:31.610598 11448 raft_consensus.cc:1275] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:16:31.614621 11419 consensus_peers.cc:597] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:31.619630 11493 consensus_peers.cc:597] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:31.619081 12227 consensus_queue.cc:1048] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
W20260709 12:16:31.640744 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 50858.4us
I20260709 12:16:31.641809 11519 raft_consensus.cc:1275] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:16:31.662585 11493 consensus_peers.cc:597] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:31.665079 11493 consensus_peers.cc:597] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:31.665952 11567 consensus_peers.cc:597] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:31.673071 11567 consensus_peers.cc:597] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:31.680236 11521 raft_consensus.cc:1275] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:16:31.680914 12278 log.cc:927] Time spent T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 12:16:31.682322 12240 consensus_queue.cc:1048] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:31.721179 11522 raft_consensus.cc:1275] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:31.724612 12237 consensus_queue.cc:1048] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
W20260709 12:16:31.772567 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 83123us
I20260709 12:16:31.764400 11520 raft_consensus.cc:1275] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:16:31.791242 11567 consensus_peers.cc:597] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:31.791949 11567 consensus_peers.cc:597] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:31.799314 11567 consensus_peers.cc:597] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:31.838694 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 60967.4us
I20260709 12:16:31.880641 12209 tablet_bootstrap.cc:492] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:31.807827 12233 consensus_queue.cc:1048] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:16:31.903401 12209 tablet_bootstrap.cc:492] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de: Bootstrap complete.
I20260709 12:16:31.904536 12209 ts_tablet_manager.cc:1403] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.408s	user 0.022s	sys 0.013s
I20260709 12:16:31.900389 11596 raft_consensus.cc:1275] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:16:31.928231 12291 log.cc:927] Time spent T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
W20260709 12:16:31.954357 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 70084us
I20260709 12:16:31.918479 12299 consensus_queue.cc:1048] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.088s
I20260709 12:16:32.019799 12209 raft_consensus.cc:359] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:32.020895 12209 raft_consensus.cc:740] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
W20260709 12:16:32.028360 11567 consensus_peers.cc:597] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:32.042222 11419 consensus_peers.cc:597] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:32.043437 11419 consensus_peers.cc:597] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:32.043870 11419 consensus_peers.cc:597] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:32.042026 11567 consensus_peers.cc:597] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:32.059484 12209 consensus_queue.cc:260] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:32.092293 12306 consensus_queue.cc:1048] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:16:32.098016 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 46934.2us
W20260709 12:16:32.104907 11567 consensus_peers.cc:597] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:32.110760 11493 consensus_peers.cc:597] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:32.151636 11493 consensus_peers.cc:597] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:32.157053 11419 consensus_peers.cc:597] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:32.157871 11419 consensus_peers.cc:597] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:32.158406 11419 consensus_peers.cc:597] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:32.158962 11419 consensus_peers.cc:597] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:32.159583 11595 raft_consensus.cc:1275] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:32.161366 12187 consensus_queue.cc:1048] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:16:32.167613 11419 consensus_peers.cc:597] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:32.168116 11419 consensus_peers.cc:597] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:32.174180 11567 consensus_peers.cc:597] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:32.174835 11567 consensus_peers.cc:597] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:32.175238 11567 consensus_peers.cc:597] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:32.184664 11567 consensus_peers.cc:597] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:32.237797 11567 consensus_peers.cc:597] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:32.256147 12324 raft_consensus.cc:493] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.272536 12209 ts_tablet_manager.cc:1434] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.368s	user 0.010s	sys 0.007s
I20260709 12:16:32.273644 12209 tablet_bootstrap.cc:492] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:32.268791 12324 raft_consensus.cc:515] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
W20260709 12:16:32.308197 11567 consensus_peers.cc:597] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:32.309865 11567 consensus_peers.cc:597] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:32.337817 12324 leader_election.cc:290] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
W20260709 12:16:32.387393 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 113244us
I20260709 12:16:32.435688 12324 raft_consensus.cc:493] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.437129 12324 raft_consensus.cc:515] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:32.454068 12324 leader_election.cc:290] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:32.466109 12324 raft_consensus.cc:493] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.467033 12324 raft_consensus.cc:515] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:32.491312 12324 leader_election.cc:290] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:16:32.503840 11419 consensus_peers.cc:597] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:32.504549 11419 consensus_peers.cc:597] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:32.520248 12225 raft_consensus.cc:493] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.521334 12225 raft_consensus.cc:515] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:32.531842 12209 tablet_bootstrap.cc:492] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:32.540663 12209 tablet_bootstrap.cc:492] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de: Bootstrap complete.
I20260709 12:16:32.543208 12225 leader_election.cc:290] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
W20260709 12:16:32.551604 11567 consensus_peers.cc:597] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:32.568958 12209 ts_tablet_manager.cc:1403] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.296s	user 0.029s	sys 0.005s
I20260709 12:16:32.587563 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:32.588667 11596 raft_consensus.cc:2468] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 2.
I20260709 12:16:32.597065 11417 leader_election.cc:304] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
W20260709 12:16:32.598585 11567 consensus_peers.cc:597] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:32.610221 12324 raft_consensus.cc:493] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.611173 12324 raft_consensus.cc:515] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:32.611855 12187 raft_consensus.cc:2804] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:32.612366 12187 raft_consensus.cc:493] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:32.617115 12324 leader_election.cc:290] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:32.612771 12187 raft_consensus.cc:3060] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:16:32.627411 11493 consensus_peers.cc:597] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:32.636977 11419 leader_election.cc:336] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:16:32.637712 12209 raft_consensus.cc:359] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:32.646186 12209 raft_consensus.cc:740] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.648046 12209 consensus_queue.cc:260] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:32.649963 12315 raft_consensus.cc:493] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.650988 12315 raft_consensus.cc:515] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:32.656627 12225 raft_consensus.cc:493] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.657467 12225 raft_consensus.cc:515] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:32.660204 12209 ts_tablet_manager.cc:1434] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.091s	user 0.009s	sys 0.000s
I20260709 12:16:32.660480 12225 leader_election.cc:290] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:32.670264 12315 leader_election.cc:290] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:32.689169 12209 tablet_bootstrap.cc:492] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
W20260709 12:16:32.691354 11419 leader_election.cc:336] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
W20260709 12:16:32.694692 11567 consensus_peers.cc:597] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:32.705298 11493 leader_election.cc:336] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:16:32.721022 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:32.721864 11445 raft_consensus.cc:2468] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 2.
I20260709 12:16:32.732244 12187 raft_consensus.cc:515] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:32.734858 12187 leader_election.cc:290] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:32.740646 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:32.741163 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d43eecbad746fd9ddce50c5b9fc3e8" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:32.742156 11450 raft_consensus.cc:2393] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 2: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:16:32.750861 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:32.751994 11523 raft_consensus.cc:2468] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 2.
I20260709 12:16:32.757125 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:32.758121 11596 raft_consensus.cc:3060] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:16:32.778102 11419 leader_election.cc:336] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:16:32.802814 11418 leader_election.cc:304] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:32.803982 12225 raft_consensus.cc:2804] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:32.804421 12225 raft_consensus.cc:493] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:32.804798 12225 raft_consensus.cc:3060] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:32.808035 11596 raft_consensus.cc:2468] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 3.
I20260709 12:16:32.809965 11491 leader_election.cc:304] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:32.813694 12284 raft_consensus.cc:2804] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:32.814224 12284 raft_consensus.cc:493] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:32.814689 12284 raft_consensus.cc:3060] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:32.818308 11417 leader_election.cc:304] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:32.821682 12210 raft_consensus.cc:2804] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:32.822224 12210 raft_consensus.cc:697] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 3 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:16:32.823305 12210 consensus_queue.cc:237] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:32.823702 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:32.824446 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:32.829079 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d43eecbad746fd9ddce50c5b9fc3e8" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:32.830212 11595 raft_consensus.cc:2393] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 2: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:16:32.838986 12315 raft_consensus.cc:493] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.839738 12315 raft_consensus.cc:515] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:32.857748 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:32.856797 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:32.863698 12204 leader_election.cc:304] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:32.864080 12315 leader_election.cc:290] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:32.867017 12203 leader_election.cc:304] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:16:32.868717 12324 raft_consensus.cc:3060] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:32.869006 12284 raft_consensus.cc:515] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:32.868638 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:32.870723 11596 raft_consensus.cc:2468] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 2.
I20260709 12:16:32.871487 12284 leader_election.cc:290] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:32.874486 11491 leader_election.cc:304] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:16:32.875203 12284 raft_consensus.cc:2804] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:32.875679 12284 raft_consensus.cc:493] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:16:32.876547 11493 leader_election.cc:336] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:16:32.882038 12284 raft_consensus.cc:3060] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:32.862541 12225 raft_consensus.cc:515] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:32.890913 12360 raft_consensus.cc:2749] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:32.895093 12209 tablet_bootstrap.cc:492] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:16:32.895249 11493 leader_election.cc:336] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:16:32.896262 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:32.897223 11519 raft_consensus.cc:2393] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 3: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:16:32.898838 12225 leader_election.cc:290] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:32.901672 12324 raft_consensus.cc:2749] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:32.905452 12209 tablet_bootstrap.cc:492] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de: Bootstrap complete.
I20260709 12:16:32.903120 12204 leader_election.cc:304] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:32.907948 12284 raft_consensus.cc:515] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:32.915134 12209 ts_tablet_manager.cc:1403] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.226s	user 0.023s	sys 0.006s
I20260709 12:16:32.919054 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:32.921066 11596 raft_consensus.cc:3060] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:32.924367 12209 raft_consensus.cc:359] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:32.927274 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:32.929122 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:32.930027 11445 raft_consensus.cc:2393] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 3: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:16:32.925184 12209 raft_consensus.cc:740] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:32.931326 12284 leader_election.cc:290] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:32.933266 11491 leader_election.cc:304] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
W20260709 12:16:32.934615 11419 leader_election.cc:336] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:16:32.936748 12209 consensus_queue.cc:260] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
W20260709 12:16:32.936112 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 90519.7us
I20260709 12:16:32.936512 11419 leader_election.cc:304] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:32.931233 12204 leader_election.cc:304] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:32.934995 12324 raft_consensus.cc:2749] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:32.949440 12311 raft_consensus.cc:493] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.953539 12360 raft_consensus.cc:2749] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:32.953230 12311 raft_consensus.cc:515] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:32.946067 12284 raft_consensus.cc:2749] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:16:32.956414 12209 ts_tablet_manager.cc:1434] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 12:16:32.961831 12311 leader_election.cc:290] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:32.962212 11596 raft_consensus.cc:2468] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 3.
I20260709 12:16:32.963557 11491 leader_election.cc:304] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:16:32.964461 12226 raft_consensus.cc:2804] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:32.964938 12226 raft_consensus.cc:697] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 3 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:16:32.966125 12226 consensus_queue.cc:237] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:32.968713 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d43eecbad746fd9ddce50c5b9fc3e8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:32.969652 11596 raft_consensus.cc:2468] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 2.
I20260709 12:16:32.975912 11417 leader_election.cc:304] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:16:32.977059 12242 raft_consensus.cc:2804] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:32.977460 12242 raft_consensus.cc:493] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:32.977777 12242 raft_consensus.cc:3060] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:32.979537 12360 raft_consensus.cc:493] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:32.980206 12360 raft_consensus.cc:515] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:32.971376 12209 tablet_bootstrap.cc:492] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:32.954905 12210 raft_consensus.cc:2749] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:16:32.982769 11493 leader_election.cc:336] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
W20260709 12:16:33.010565 11419 leader_election.cc:336] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:16:33.020371 12242 raft_consensus.cc:515] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:33.020519 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:33.038861 12360 leader_election.cc:290] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:33.041240 12242 leader_election.cc:290] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:33.055289 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:16:33.083127 11419 leader_election.cc:336] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:16:33.088680 11276 catalog_manager.cc:5697] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 1 to 3, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 3 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:33.111084 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d43eecbad746fd9ddce50c5b9fc3e8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:33.111853 11600 raft_consensus.cc:3060] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:33.130734 11273 catalog_manager.cc:5697] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 1 to 3, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131). New cstate: current_term: 3 leader_uuid: "a03223e9e41247c3a36b7b7c3d476671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:33.132452 11600 raft_consensus.cc:2468] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 3.
I20260709 12:16:33.136732 12203 leader_election.cc:304] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:33.141673 12360 raft_consensus.cc:2749] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:16:33.147220 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 51868.1us
I20260709 12:16:33.143728 11417 leader_election.cc:304] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:33.159731 12311 raft_consensus.cc:2804] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:33.163823 12311 raft_consensus.cc:697] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 3 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:16:33.164849 12311 consensus_queue.cc:237] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
W20260709 12:16:33.230314 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 88444.8us
I20260709 12:16:33.264832 12360 raft_consensus.cc:493] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.265560 12360 raft_consensus.cc:515] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:33.268262 12360 leader_election.cc:290] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:33.269964 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:33.277192 12209 tablet_bootstrap.cc:492] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:33.277441 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:33.280900 12204 leader_election.cc:304] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:33.282239 12360 raft_consensus.cc:2749] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:33.284587 12209 tablet_bootstrap.cc:492] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de: Bootstrap complete.
I20260709 12:16:33.285790 12209 ts_tablet_manager.cc:1403] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.315s	user 0.028s	sys 0.001s
I20260709 12:16:33.297086 11595 raft_consensus.cc:1275] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:33.299733 12311 consensus_queue.cc:1048] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:33.307611 12209 raft_consensus.cc:359] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:33.308622 12209 raft_consensus.cc:740] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:33.311007 12209 consensus_queue.cc:260] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:33.326210 12209 ts_tablet_manager.cc:1434] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.001s
I20260709 12:16:33.328697 12209 tablet_bootstrap.cc:492] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:33.377911 11275 catalog_manager.cc:5697] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 1 to 3, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 3 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } }
W20260709 12:16:33.391427 11419 consensus_peers.cc:597] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:33.401225 12209 tablet_bootstrap.cc:492] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:33.406719 12209 tablet_bootstrap.cc:492] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de: Bootstrap complete.
I20260709 12:16:33.407490 12209 ts_tablet_manager.cc:1403] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.079s	user 0.020s	sys 0.000s
I20260709 12:16:33.410405 12209 raft_consensus.cc:359] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:33.411166 12209 raft_consensus.cc:740] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:33.412824 12209 consensus_queue.cc:260] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:33.416513 12209 ts_tablet_manager.cc:1434] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 12:16:33.417618 12209 tablet_bootstrap.cc:492] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:33.462724 11595 raft_consensus.cc:1275] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:33.465750 12226 consensus_queue.cc:1048] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:33.552618 12209 tablet_bootstrap.cc:492] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:33.553970 12209 tablet_bootstrap.cc:492] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de: Bootstrap complete.
I20260709 12:16:33.556442 12209 ts_tablet_manager.cc:1403] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.139s	user 0.018s	sys 0.009s
W20260709 12:16:33.567312 11493 consensus_peers.cc:597] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:33.568606 12209 raft_consensus.cc:359] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:33.570919 12209 raft_consensus.cc:740] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:33.572831 12209 consensus_queue.cc:260] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:33.577795 12209 ts_tablet_manager.cc:1434] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260709 12:16:33.580160 12209 tablet_bootstrap.cc:492] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:33.614714 12209 tablet_bootstrap.cc:492] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:33.615793 12209 tablet_bootstrap.cc:492] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de: Bootstrap complete.
I20260709 12:16:33.616593 12209 ts_tablet_manager.cc:1403] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.038s	user 0.011s	sys 0.014s
I20260709 12:16:33.629953 12209 raft_consensus.cc:359] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:33.630800 12209 raft_consensus.cc:740] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:33.631613 12209 consensus_queue.cc:260] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:33.634229 12209 ts_tablet_manager.cc:1434] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 12:16:33.635473 12209 tablet_bootstrap.cc:492] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:33.669521 12209 tablet_bootstrap.cc:492] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:33.670635 12209 tablet_bootstrap.cc:492] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de: Bootstrap complete.
I20260709 12:16:33.671339 12209 ts_tablet_manager.cc:1403] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.036s	user 0.018s	sys 0.012s
I20260709 12:16:33.676075 12209 raft_consensus.cc:359] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:33.679044 12209 raft_consensus.cc:740] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:33.681682 12405 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.212.129:37935 every 8 connection(s)
I20260709 12:16:33.679906 12209 consensus_queue.cc:260] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:33.681670  3922 rpc_server.cc:307] RPC server started. Bound to: 127.3.212.129:37935
I20260709 12:16:33.683852 12209 ts_tablet_manager.cc:1434] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.004s
I20260709 12:16:33.684989 12209 tablet_bootstrap.cc:492] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:33.692792 11595 raft_consensus.cc:1275] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:33.697927 12210 consensus_queue.cc:1048] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:33.711030 12360 raft_consensus.cc:493] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:33.711768 12360 raft_consensus.cc:515] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:33.759644 12209 tablet_bootstrap.cc:492] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:33.769824 12209 tablet_bootstrap.cc:492] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de: Bootstrap complete.
I20260709 12:16:33.770473 12209 ts_tablet_manager.cc:1403] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.086s	user 0.050s	sys 0.019s
I20260709 12:16:33.778797 12360 leader_election.cc:290] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:33.779973 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:33.799767 12209 raft_consensus.cc:359] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:33.800863 12209 raft_consensus.cc:740] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:33.801709 12209 consensus_queue.cc:260] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:33.805300 12209 ts_tablet_manager.cc:1434] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.034s	user 0.002s	sys 0.004s
I20260709 12:16:33.814040 12356 raft_consensus.cc:3060] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:33.846973 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:33.853785 12209 tablet_bootstrap.cc:492] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:33.851240 12203 leader_election.cc:304] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:33.868072 12360 raft_consensus.cc:2749] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:33.872208 12356 raft_consensus.cc:1275] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:33.875397 12414 consensus_queue.cc:1048] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:33.877411 12407 heartbeater.cc:344] Connected to a master server at 127.3.212.190:40671
I20260709 12:16:33.878154 12407 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:33.879045 12407 heartbeater.cc:507] Master 127.3.212.190:40671 requested a full tablet report, sending...
I20260709 12:16:33.882718 12352 raft_consensus.cc:3060] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:33.905015 12209 tablet_bootstrap.cc:492] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:33.906198 12209 tablet_bootstrap.cc:492] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de: Bootstrap complete.
I20260709 12:16:33.906884 12209 ts_tablet_manager.cc:1403] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.063s	user 0.019s	sys 0.000s
I20260709 12:16:33.909785 12209 raft_consensus.cc:359] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:33.910609 12361 raft_consensus.cc:3060] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:33.910562 12209 raft_consensus.cc:740] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:33.918341 12209 consensus_queue.cc:260] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:33.921535 12209 ts_tablet_manager.cc:1434] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:16:33.922336 12209 tablet_bootstrap.cc:492] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:33.926110 12359 raft_consensus.cc:3060] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:33.929478 12349 raft_consensus.cc:3060] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:16:33.944960 11493 consensus_peers.cc:597] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:33.956756 12348 raft_consensus.cc:3060] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Advancing to term 3
W20260709 12:16:33.991994 11493 consensus_peers.cc:597] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:33.997164 11419 consensus_peers.cc:597] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:34.017307 12209 tablet_bootstrap.cc:492] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:34.020071 12209 tablet_bootstrap.cc:492] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de: Bootstrap complete.
I20260709 12:16:34.020937 12209 ts_tablet_manager.cc:1403] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.099s	user 0.048s	sys 0.028s
I20260709 12:16:34.024017 12209 raft_consensus.cc:359] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:34.024796 12209 raft_consensus.cc:740] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:34.025629 12209 consensus_queue.cc:260] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:34.027899 12209 ts_tablet_manager.cc:1434] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:16:34.028818 12209 tablet_bootstrap.cc:492] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:34.032217 11273 ts_manager.cc:194] Re-registered known tserver with Master: b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:34.057243 12348 raft_consensus.cc:3060] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:16:34.066820 11493 consensus_peers.cc:597] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:34.069516 11419 consensus_peers.cc:597] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:34.083073 12209 tablet_bootstrap.cc:492] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:34.084254 12209 tablet_bootstrap.cc:492] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de: Bootstrap complete.
I20260709 12:16:34.085070 12209 ts_tablet_manager.cc:1403] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.056s	user 0.033s	sys 0.012s
I20260709 12:16:34.089435 12209 raft_consensus.cc:359] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:34.091058 12209 raft_consensus.cc:740] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:34.092420 12209 consensus_queue.cc:260] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:34.096773 12209 ts_tablet_manager.cc:1434] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:16:34.097831 12209 tablet_bootstrap.cc:492] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:34.126403 12209 tablet_bootstrap.cc:492] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:34.139394 12209 tablet_bootstrap.cc:492] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de: Bootstrap complete.
I20260709 12:16:34.140096 12209 ts_tablet_manager.cc:1403] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.043s	user 0.023s	sys 0.000s
I20260709 12:16:34.140941 11273 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39286
I20260709 12:16:34.142938 12209 raft_consensus.cc:359] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:34.143709 12209 raft_consensus.cc:740] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:34.147074 12407 heartbeater.cc:499] Master 127.3.212.190:40671 was elected leader, sending a full tablet report...
I20260709 12:16:34.157888 12209 consensus_queue.cc:260] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:34.166427 12209 ts_tablet_manager.cc:1434] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 12:16:34.186076 12209 tablet_bootstrap.cc:492] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:34.241585 12209 tablet_bootstrap.cc:492] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:34.242810 12209 tablet_bootstrap.cc:492] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de: Bootstrap complete.
I20260709 12:16:34.243527 12209 ts_tablet_manager.cc:1403] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.076s	user 0.025s	sys 0.000s
W20260709 12:16:34.245536 11567 consensus_peers.cc:597] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:16:34.247762 12209 raft_consensus.cc:359] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:34.248620 12209 raft_consensus.cc:740] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:34.249567 12209 consensus_queue.cc:260] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
W20260709 12:16:34.250589 11419 consensus_peers.cc:597] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:16:34.252242 12209 ts_tablet_manager.cc:1434] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:16:34.253218 12209 tablet_bootstrap.cc:492] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:34.254060 12359 raft_consensus.cc:3060] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:34.283872 12209 tablet_bootstrap.cc:492] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:34.284907 12209 tablet_bootstrap.cc:492] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de: Bootstrap complete.
I20260709 12:16:34.285624 12209 ts_tablet_manager.cc:1403] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.010s
W20260709 12:16:34.291126 11419 consensus_peers.cc:597] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:16:34.295811 12209 raft_consensus.cc:359] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:34.296641 12209 raft_consensus.cc:740] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:34.300092 12209 consensus_queue.cc:260] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:34.308465 12209 ts_tablet_manager.cc:1434] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.002s
I20260709 12:16:34.310482 12209 tablet_bootstrap.cc:492] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
W20260709 12:16:34.335369 11567 consensus_peers.cc:597] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:34.359298 11419 consensus_peers.cc:597] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:34.369160 11567 consensus_peers.cc:597] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:16:34.369364 12209 tablet_bootstrap.cc:492] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:34.370455 12209 tablet_bootstrap.cc:492] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de: Bootstrap complete.
I20260709 12:16:34.371055 12209 ts_tablet_manager.cc:1403] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.061s	user 0.015s	sys 0.007s
I20260709 12:16:34.373531 12209 raft_consensus.cc:359] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:34.374261 12209 raft_consensus.cc:740] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:34.374948 12209 consensus_queue.cc:260] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:34.377269 12209 ts_tablet_manager.cc:1434] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:16:34.378118 12209 tablet_bootstrap.cc:492] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:34.423712 12348 raft_consensus.cc:3060] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:16:34.501746 11419 consensus_peers.cc:597] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:34.506887 11567 consensus_peers.cc:597] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:16:34.512609 11493 consensus_peers.cc:597] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:16:34.516765 12209 tablet_bootstrap.cc:492] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:34.517886 12209 tablet_bootstrap.cc:492] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de: Bootstrap complete.
I20260709 12:16:34.518642 12209 ts_tablet_manager.cc:1403] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.141s	user 0.008s	sys 0.019s
I20260709 12:16:34.521504 12209 raft_consensus.cc:359] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:34.522226 12209 raft_consensus.cc:740] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:34.523200 12209 consensus_queue.cc:260] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:34.525674 12209 ts_tablet_manager.cc:1434] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:16:34.526553 12209 tablet_bootstrap.cc:492] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:34.565841 12209 tablet_bootstrap.cc:492] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:34.566633 12209 tablet_bootstrap.cc:492] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de: Bootstrap complete.
I20260709 12:16:34.567175 12209 ts_tablet_manager.cc:1403] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.041s	user 0.015s	sys 0.004s
I20260709 12:16:34.569162 12209 raft_consensus.cc:359] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:34.569873 12209 raft_consensus.cc:740] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:34.570480 12209 consensus_queue.cc:260] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:34.575452 12209 ts_tablet_manager.cc:1434] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:16:34.576360 12209 tablet_bootstrap.cc:492] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:34.632951 12209 tablet_bootstrap.cc:492] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:34.634078 12209 tablet_bootstrap.cc:492] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de: Bootstrap complete.
I20260709 12:16:34.638697 12209 ts_tablet_manager.cc:1403] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.063s	user 0.035s	sys 0.011s
I20260709 12:16:34.641736 12209 raft_consensus.cc:359] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:34.642314 12209 raft_consensus.cc:740] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:34.642987 12209 consensus_queue.cc:260] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:34.645274 12209 ts_tablet_manager.cc:1434] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.000s
I20260709 12:16:34.646358 12209 tablet_bootstrap.cc:492] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
W20260709 12:16:34.652822 11567 consensus_peers.cc:597] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:16:34.684517 12414 raft_consensus.cc:493] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:34.685091 12414 raft_consensus.cc:515] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:34.688226 12414 leader_election.cc:290] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:34.688979 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:34.690043 11525 raft_consensus.cc:2468] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 3.
I20260709 12:16:34.691505 11418 leader_election.cc:304] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:16:34.691588 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:34.692282 12352 raft_consensus.cc:2468] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 1.
I20260709 12:16:34.692423 12414 raft_consensus.cc:2804] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:34.692862 12414 raft_consensus.cc:493] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:34.693207 12414 raft_consensus.cc:3060] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:34.709698 12209 tablet_bootstrap.cc:492] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:34.710947 12209 tablet_bootstrap.cc:492] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de: Bootstrap complete.
I20260709 12:16:34.711647 12209 ts_tablet_manager.cc:1403] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.066s	user 0.012s	sys 0.024s
I20260709 12:16:34.715480 12414 raft_consensus.cc:515] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:34.719672 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:34.720549 12348 raft_consensus.cc:3060] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Advancing to term 4
I20260709 12:16:34.722142 12209 raft_consensus.cc:359] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:34.722931 12209 raft_consensus.cc:740] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:34.723459 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:34.723820 12209 consensus_queue.cc:260] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:34.728696 12348 raft_consensus.cc:2468] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 4.
I20260709 12:16:34.731230 12209 ts_tablet_manager.cc:1434] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.002s
I20260709 12:16:34.732198 12209 tablet_bootstrap.cc:492] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:34.733702 11419 leader_election.cc:304] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:34.736394 11525 raft_consensus.cc:3060] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:34.737250 12242 raft_consensus.cc:2804] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:34.767051 12352 raft_consensus.cc:3060] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:34.768603 12242 raft_consensus.cc:697] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 4 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:16:34.771579 12242 consensus_queue.cc:237] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:34.719676 12414 leader_election.cc:290] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:16:34.777666 11419 consensus_peers.cc:597] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:34.799886 11567 consensus_peers.cc:597] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:34.802349 11419 consensus_peers.cc:597] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:16:34.810986 11525 raft_consensus.cc:2468] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 4.
W20260709 12:16:34.812789 11419 consensus_peers.cc:597] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:16:34.863833 11567 consensus_peers.cc:597] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:16:34.879997 11273 catalog_manager.cc:5697] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 1 to 4, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 4 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:34.889241 12209 tablet_bootstrap.cc:492] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:34.890920 12209 tablet_bootstrap.cc:492] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de: Bootstrap complete.
I20260709 12:16:34.891877 12209 ts_tablet_manager.cc:1403] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.160s	user 0.015s	sys 0.009s
I20260709 12:16:34.896385 12209 raft_consensus.cc:359] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:34.897253 12209 raft_consensus.cc:740] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:34.898335 12209 consensus_queue.cc:260] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:34.907644 12209 ts_tablet_manager.cc:1434] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:16:34.910142 12209 tablet_bootstrap.cc:492] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:34.944410 12209 tablet_bootstrap.cc:492] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:34.945585 12209 tablet_bootstrap.cc:492] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de: Bootstrap complete.
I20260709 12:16:34.946359 12209 ts_tablet_manager.cc:1403] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.005s
I20260709 12:16:34.949102 12209 raft_consensus.cc:359] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:34.950301 12209 raft_consensus.cc:740] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:34.951225 12209 consensus_queue.cc:260] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:34.955241 12209 ts_tablet_manager.cc:1434] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:16:34.957100 12209 tablet_bootstrap.cc:492] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
W20260709 12:16:34.971006 11493 consensus_peers.cc:597] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:16:34.979130 12352 raft_consensus.cc:3060] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:16:34.998034 12209 tablet_bootstrap.cc:492] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:35.001334 12209 tablet_bootstrap.cc:492] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de: Bootstrap complete.
I20260709 12:16:35.009840 12209 ts_tablet_manager.cc:1403] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.053s	user 0.016s	sys 0.005s
I20260709 12:16:35.080772 12209 raft_consensus.cc:359] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:35.081713 12209 raft_consensus.cc:740] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
W20260709 12:16:35.088937 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 76107.3us
I20260709 12:16:35.105618 12359 raft_consensus.cc:3060] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:35.110906 12209 consensus_queue.cc:260] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:35.119576 12209 ts_tablet_manager.cc:1434] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.048s	user 0.005s	sys 0.000s
I20260709 12:16:35.137131 12209 tablet_bootstrap.cc:492] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:35.155267 12348 raft_consensus.cc:3060] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:35.240311 12209 tablet_bootstrap.cc:492] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:35.241323 12209 tablet_bootstrap.cc:492] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de: Bootstrap complete.
I20260709 12:16:35.242069 12209 ts_tablet_manager.cc:1403] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.105s	user 0.017s	sys 0.017s
I20260709 12:16:35.244781 12209 raft_consensus.cc:359] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:35.245560 12209 raft_consensus.cc:740] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:35.246426 12209 consensus_queue.cc:260] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:35.248821 12209 ts_tablet_manager.cc:1434] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:16:35.250126 12209 tablet_bootstrap.cc:492] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:35.290242 12209 tablet_bootstrap.cc:492] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:35.291293 12209 tablet_bootstrap.cc:492] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de: Bootstrap complete.
I20260709 12:16:35.292024 12209 ts_tablet_manager.cc:1403] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.042s	user 0.015s	sys 0.017s
I20260709 12:16:35.295644 12209 raft_consensus.cc:359] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:35.296378 12209 raft_consensus.cc:740] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:35.297091 12209 consensus_queue.cc:260] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:35.299521 12209 ts_tablet_manager.cc:1434] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:16:35.301005 12209 tablet_bootstrap.cc:492] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:35.356731 11527 raft_consensus.cc:1275] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:16:35.365554 12460 consensus_queue.cc:1048] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:35.383599 12349 raft_consensus.cc:1275] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:16:35.385136 12460 consensus_queue.cc:1048] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:35.457883 12209 tablet_bootstrap.cc:492] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:35.474357 12209 tablet_bootstrap.cc:492] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de: Bootstrap complete.
I20260709 12:16:35.475194 12209 ts_tablet_manager.cc:1403] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.174s	user 0.024s	sys 0.030s
I20260709 12:16:35.478355 12209 raft_consensus.cc:359] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:35.479139 12209 raft_consensus.cc:740] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:35.479897 12209 consensus_queue.cc:260] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:35.483083 12209 ts_tablet_manager.cc:1434] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:16:35.485951 12209 tablet_bootstrap.cc:492] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:35.531586 12209 tablet_bootstrap.cc:492] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:35.532568 12209 tablet_bootstrap.cc:492] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de: Bootstrap complete.
I20260709 12:16:35.533223 12209 ts_tablet_manager.cc:1403] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.047s	user 0.014s	sys 0.007s
I20260709 12:16:35.540181 12209 raft_consensus.cc:359] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:35.540891 12209 raft_consensus.cc:740] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:35.541628 12209 consensus_queue.cc:260] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:35.544392 12209 ts_tablet_manager.cc:1434] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:16:35.550372 12209 tablet_bootstrap.cc:492] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:35.607517 12209 tablet_bootstrap.cc:492] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:35.608865 12209 tablet_bootstrap.cc:492] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de: Bootstrap complete.
I20260709 12:16:35.609826 12209 ts_tablet_manager.cc:1403] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.060s	user 0.021s	sys 0.009s
I20260709 12:16:35.613358 12209 raft_consensus.cc:359] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:35.614217 12209 raft_consensus.cc:740] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:35.615118 12209 consensus_queue.cc:260] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:35.622375 12209 ts_tablet_manager.cc:1434] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:16:35.623436 12209 tablet_bootstrap.cc:492] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:35.690088 12209 tablet_bootstrap.cc:492] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:35.691335 12209 tablet_bootstrap.cc:492] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de: Bootstrap complete.
I20260709 12:16:35.692113 12209 ts_tablet_manager.cc:1403] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.069s	user 0.023s	sys 0.004s
I20260709 12:16:35.695191 12209 raft_consensus.cc:359] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:35.695937 12209 raft_consensus.cc:740] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:35.697053 12209 consensus_queue.cc:260] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:35.699491 12209 ts_tablet_manager.cc:1434] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:16:35.705224 12209 tablet_bootstrap.cc:492] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:35.735004 12209 tablet_bootstrap.cc:492] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:35.736388 12209 tablet_bootstrap.cc:492] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de: Bootstrap complete.
I20260709 12:16:35.737241 12209 ts_tablet_manager.cc:1403] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.003s
I20260709 12:16:35.741658 12209 raft_consensus.cc:359] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:35.742503 12209 raft_consensus.cc:740] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:35.743278 12209 consensus_queue.cc:260] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:35.748145 12209 ts_tablet_manager.cc:1434] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:16:35.753436 12209 tablet_bootstrap.cc:492] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:35.817238 12209 tablet_bootstrap.cc:492] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:35.818748 12209 tablet_bootstrap.cc:492] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de: Bootstrap complete.
I20260709 12:16:35.821429 12209 ts_tablet_manager.cc:1403] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.068s	user 0.037s	sys 0.008s
I20260709 12:16:35.827044 12209 raft_consensus.cc:359] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:35.827847 12209 raft_consensus.cc:740] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:35.828703 12209 consensus_queue.cc:260] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:35.831265 12209 ts_tablet_manager.cc:1434] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:16:35.833689 12209 tablet_bootstrap.cc:492] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:35.840505 12348 raft_consensus.cc:3060] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:35.858144 12209 tablet_bootstrap.cc:492] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:35.859190 12209 tablet_bootstrap.cc:492] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de: Bootstrap complete.
I20260709 12:16:35.859839 12209 ts_tablet_manager.cc:1403] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.007s
I20260709 12:16:35.863281 12209 raft_consensus.cc:359] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:35.864051 12349 raft_consensus.cc:3060] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:35.864116 12209 raft_consensus.cc:740] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:35.886340 12209 consensus_queue.cc:260] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:35.888899 12209 ts_tablet_manager.cc:1434] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 12:16:35.890002 12209 tablet_bootstrap.cc:492] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:35.925925 12209 tablet_bootstrap.cc:492] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:35.926916 12209 tablet_bootstrap.cc:492] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de: Bootstrap complete.
I20260709 12:16:35.927711 12209 ts_tablet_manager.cc:1403] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.038s	user 0.023s	sys 0.004s
I20260709 12:16:35.940011 12209 raft_consensus.cc:359] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:35.940747 12209 raft_consensus.cc:740] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:35.941489 12209 consensus_queue.cc:260] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:35.966212 12209 ts_tablet_manager.cc:1434] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 12:16:35.967278 12209 tablet_bootstrap.cc:492] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:36.260856 12209 tablet_bootstrap.cc:492] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:36.262020 12209 tablet_bootstrap.cc:492] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de: Bootstrap complete.
I20260709 12:16:36.262706 12209 ts_tablet_manager.cc:1403] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.296s	user 0.077s	sys 0.138s
I20260709 12:16:36.268932 12209 raft_consensus.cc:359] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:36.269738 12209 raft_consensus.cc:740] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:36.271682 12209 consensus_queue.cc:260] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:36.282441 12209 ts_tablet_manager.cc:1434] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:16:36.283318 12209 tablet_bootstrap.cc:492] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:36.334406 12209 tablet_bootstrap.cc:492] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:36.335485 12209 tablet_bootstrap.cc:492] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de: Bootstrap complete.
I20260709 12:16:36.336210 12209 ts_tablet_manager.cc:1403] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.053s	user 0.014s	sys 0.008s
I20260709 12:16:36.338836 12209 raft_consensus.cc:359] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:36.339567 12209 raft_consensus.cc:740] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:36.340257 12209 consensus_queue.cc:260] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:36.342598 12209 ts_tablet_manager.cc:1434] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:16:36.399938 12209 tablet_bootstrap.cc:492] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:36.443147 12209 tablet_bootstrap.cc:492] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:36.443878 12348 raft_consensus.cc:3060] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:36.444190 12209 tablet_bootstrap.cc:492] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de: Bootstrap complete.
I20260709 12:16:36.446947 12209 ts_tablet_manager.cc:1403] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.047s	user 0.009s	sys 0.014s
I20260709 12:16:36.454978 12209 raft_consensus.cc:359] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:36.455736 12209 raft_consensus.cc:740] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:36.456579 12209 consensus_queue.cc:260] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:36.495451 12209 ts_tablet_manager.cc:1434] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.048s	user 0.005s	sys 0.001s
I20260709 12:16:36.496382 12209 tablet_bootstrap.cc:492] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:36.667100 12209 tablet_bootstrap.cc:492] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:36.688721 12209 tablet_bootstrap.cc:492] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de: Bootstrap complete.
I20260709 12:16:36.689640 12209 ts_tablet_manager.cc:1403] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.193s	user 0.011s	sys 0.010s
I20260709 12:16:36.698275 12209 raft_consensus.cc:359] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:36.699133 12209 raft_consensus.cc:740] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:36.699927 12209 consensus_queue.cc:260] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:36.702466 12209 ts_tablet_manager.cc:1434] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.012s	user 0.001s	sys 0.004s
I20260709 12:16:36.716447 12209 tablet_bootstrap.cc:492] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:36.823614 12209 tablet_bootstrap.cc:492] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:36.824674 12209 tablet_bootstrap.cc:492] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de: Bootstrap complete.
I20260709 12:16:36.825424 12209 ts_tablet_manager.cc:1403] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.109s	user 0.017s	sys 0.000s
I20260709 12:16:36.827829 12209 raft_consensus.cc:359] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:36.828557 12209 raft_consensus.cc:740] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:36.829246 12209 consensus_queue.cc:260] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:36.840395 12209 ts_tablet_manager.cc:1434] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:16:36.848497 12209 tablet_bootstrap.cc:492] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de: Bootstrap starting.
I20260709 12:16:36.897773 12209 tablet_bootstrap.cc:492] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:36.898962 12209 tablet_bootstrap.cc:492] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de: Bootstrap complete.
I20260709 12:16:36.899740 12209 ts_tablet_manager.cc:1403] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de: Time spent bootstrapping tablet: real 0.051s	user 0.012s	sys 0.011s
I20260709 12:16:36.902653 12209 raft_consensus.cc:359] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:36.903463 12209 raft_consensus.cc:740] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Initialized, Role: FOLLOWER
I20260709 12:16:36.904184 12209 consensus_queue.cc:260] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:36.907546 12209 ts_tablet_manager.cc:1434] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:16:36.924554 12361 raft_consensus.cc:3060] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:16:39.684171 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 55897us
W20260709 12:16:41.369264 11623 debug-util.cc:398] Leaking SignalData structure 0x7b08002b90c0 after lost signal to thread 3925
W20260709 12:16:41.370721 11623 debug-util.cc:398] Leaking SignalData structure 0x7b0800172c40 after lost signal to thread 11311
W20260709 12:16:41.372175 11623 debug-util.cc:398] Leaking SignalData structure 0x7b08000c9b60 after lost signal to thread 11478
W20260709 12:16:41.373591 11623 debug-util.cc:398] Leaking SignalData structure 0x7b08000c0980 after lost signal to thread 11552
W20260709 12:16:41.374871 11623 debug-util.cc:398] Leaking SignalData structure 0x7b08000af720 after lost signal to thread 11626
W20260709 12:16:41.376396 11623 debug-util.cc:398] Leaking SignalData structure 0x7b08000f5720 after lost signal to thread 12405
I20260709 12:16:41.929903 12529 raft_consensus.cc:493] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:16:41.930470 12529 raft_consensus.cc:515] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:41.936777 12529 leader_election.cc:290] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:41.940044 12526 raft_consensus.cc:493] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:16:41.940593 12526 raft_consensus.cc:515] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:41.942977 12526 leader_election.cc:290] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:41.946125 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:41.959251 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:41.961280 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:41.969410 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:41.984614 11491 leader_election.cc:304] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:41.985519 12527 raft_consensus.cc:2749] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:41.989364 11491 leader_election.cc:304] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:41.990232 12527 raft_consensus.cc:2749] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:16:42.534459 11549 debug-util.cc:398] Leaking SignalData structure 0x7b080010bea0 after lost signal to thread 3925
W20260709 12:16:42.537062 11549 debug-util.cc:398] Leaking SignalData structure 0x7b08003d92a0 after lost signal to thread 11311
W20260709 12:16:42.539575 11549 debug-util.cc:398] Leaking SignalData structure 0x7b08001b4d40 after lost signal to thread 11478
W20260709 12:16:42.541788 11549 debug-util.cc:398] Leaking SignalData structure 0x7b08001e9b80 after lost signal to thread 11552
W20260709 12:16:42.543963 11549 debug-util.cc:398] Leaking SignalData structure 0x7b080006f7e0 after lost signal to thread 11626
W20260709 12:16:42.545485 11549 debug-util.cc:398] Leaking SignalData structure 0x7b08000c9c80 after lost signal to thread 12405
I20260709 12:16:45.570624  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:45.625110 11448 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c"
dest_uuid: "1c101e338f954ef086338e251deed19d"
mode: GRACEFUL
new_leader_uuid: "b126028166e8480ba25541bf8f7fc6de"
 from {username='slave'} at 127.0.0.1:50370
I20260709 12:16:45.625996 11448 raft_consensus.cc:606] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 2 LEADER]: Received request to transfer leadership to TS b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:45.637801 11600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "b126028166e8480ba25541bf8f7fc6de"
 from {username='slave'} at 127.0.0.1:37992
I20260709 12:16:45.638314 11600 raft_consensus.cc:606] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Received request to transfer leadership to TS b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:45.640918 11448 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "390e91331fd04f97a5235133a34875ee"
dest_uuid: "1c101e338f954ef086338e251deed19d"
mode: GRACEFUL
new_leader_uuid: "a03223e9e41247c3a36b7b7c3d476671"
 from {username='slave'} at 127.0.0.1:50370
I20260709 12:16:45.641453 11448 raft_consensus.cc:606] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [term 1 LEADER]: Received request to transfer leadership to TS a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:45.643949 11448 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ffe47647c274723808482c166efa21c"
dest_uuid: "1c101e338f954ef086338e251deed19d"
mode: GRACEFUL
new_leader_uuid: "b126028166e8480ba25541bf8f7fc6de"
 from {username='slave'} at 127.0.0.1:50370
I20260709 12:16:45.644385 11448 raft_consensus.cc:606] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 1 LEADER]: Received request to transfer leadership to TS b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:45.646812 11448 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74b107ce07924505acbedf93698833e7"
dest_uuid: "1c101e338f954ef086338e251deed19d"
mode: GRACEFUL
new_leader_uuid: "b126028166e8480ba25541bf8f7fc6de"
 from {username='slave'} at 127.0.0.1:50370
I20260709 12:16:45.647276 11448 raft_consensus.cc:606] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 1 LEADER]: Received request to transfer leadership to TS b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:45.649632 11448 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5"
dest_uuid: "1c101e338f954ef086338e251deed19d"
mode: GRACEFUL
new_leader_uuid: "b126028166e8480ba25541bf8f7fc6de"
 from {username='slave'} at 127.0.0.1:50370
I20260709 12:16:45.650074 11448 raft_consensus.cc:606] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 2 LEADER]: Received request to transfer leadership to TS b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:45.651486  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:16:45.652855  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:45.653718  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:45.735594 12511 raft_consensus.cc:993] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d: : Instructing follower b126028166e8480ba25541bf8f7fc6de to start an election
I20260709 12:16:45.746121 12550 raft_consensus.cc:1081] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 2 LEADER]: Signalling peer b126028166e8480ba25541bf8f7fc6de to start an election
I20260709 12:16:45.746863 12511 raft_consensus.cc:993] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d: : Instructing follower b126028166e8480ba25541bf8f7fc6de to start an election
I20260709 12:16:45.748150 12543 raft_consensus.cc:1081] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 2 LEADER]: Signalling peer b126028166e8480ba25541bf8f7fc6de to start an election
I20260709 12:16:45.750465 12347 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c"
dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
 from {username='slave'} at 127.0.0.1:51698
I20260709 12:16:45.751228 12347 raft_consensus.cc:493] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:45.751695 12347 raft_consensus.cc:3060] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:45.754920 12356 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5"
dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
 from {username='slave'} at 127.0.0.1:51698
I20260709 12:16:45.755604 12356 raft_consensus.cc:493] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:45.755999 12356 raft_consensus.cc:3060] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:45.761369 12347 raft_consensus.cc:515] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:45.763799 12347 leader_election.cc:290] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:45.764093 12356 raft_consensus.cc:515] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:45.764925 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:45.765035 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:45.765911 11600 raft_consensus.cc:3060] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:45.766010 11448 raft_consensus.cc:3055] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:45.766443 11448 raft_consensus.cc:740] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:16:45.766696 12356 leader_election.cc:290] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:45.767333 11448 consensus_queue.cc:260] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:45.767935 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:45.768576 11450 raft_consensus.cc:3055] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:45.768767 11448 raft_consensus.cc:3060] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:45.768865 11450 raft_consensus.cc:740] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:16:45.769326 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:45.770030 11520 raft_consensus.cc:3060] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:45.769899 11450 consensus_queue.cc:260] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:45.771242 11450 raft_consensus.cc:3060] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:45.773968 11600 raft_consensus.cc:2468] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 3.
I20260709 12:16:45.775540 12203 leader_election.cc:304] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:45.776955 11448 raft_consensus.cc:2468] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 3.
I20260709 12:16:45.779054 12552 raft_consensus.cc:2804] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:45.779709 11520 raft_consensus.cc:2468] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 3.
I20260709 12:16:45.780604 12552 raft_consensus.cc:697] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 3 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:16:45.781131 12204 leader_election.cc:304] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:45.782101 12553 raft_consensus.cc:2804] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:45.781946 12552 consensus_queue.cc:237] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:45.784646 11450 raft_consensus.cc:2468] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 3.
I20260709 12:16:45.786098 12553 raft_consensus.cc:697] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 3 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:16:45.787434 12553 consensus_queue.cc:237] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:45.805645 11274 catalog_manager.cc:5697] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 2 to 3, leader changed from 1c101e338f954ef086338e251deed19d (127.3.212.130) to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 3 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:45.838829 11274 catalog_manager.cc:5697] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 2 to 3, leader changed from 1c101e338f954ef086338e251deed19d (127.3.212.130) to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 3 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:45.917559 12509 raft_consensus.cc:993] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8: : Instructing follower b126028166e8480ba25541bf8f7fc6de to start an election
I20260709 12:16:45.918234 12561 raft_consensus.cc:1081] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Signalling peer b126028166e8480ba25541bf8f7fc6de to start an election
I20260709 12:16:45.919903 12356 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0"
dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
 from {username='slave'} at 127.0.0.1:51706
I20260709 12:16:45.920393 12356 raft_consensus.cc:493] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:45.920656 12356 raft_consensus.cc:3060] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:45.926321 12356 raft_consensus.cc:515] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:45.928169 12356 leader_election.cc:290] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:45.929205 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:45.929450 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:45.929973 11595 raft_consensus.cc:3055] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:45.930081 11448 raft_consensus.cc:3060] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:45.930460 11595 raft_consensus.cc:740] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:45.931247 11595 consensus_queue.cc:260] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:45.932367 11595 raft_consensus.cc:3060] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:45.936772 11448 raft_consensus.cc:2468] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 2.
I20260709 12:16:45.938347 12203 leader_election.cc:304] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:45.939374 12553 raft_consensus.cc:2804] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:45.939870 12553 raft_consensus.cc:697] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [term 2 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:16:45.940747 12553 consensus_queue.cc:237] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:45.943814 11595 raft_consensus.cc:2468] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 2.
I20260709 12:16:45.948864 12551 raft_consensus.cc:993] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d: : Instructing follower b126028166e8480ba25541bf8f7fc6de to start an election
I20260709 12:16:45.949415 12551 raft_consensus.cc:1081] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 1 LEADER]: Signalling peer b126028166e8480ba25541bf8f7fc6de to start an election
I20260709 12:16:45.951790 12356 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "74b107ce07924505acbedf93698833e7"
dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
 from {username='slave'} at 127.0.0.1:51698
I20260709 12:16:45.953022 12356 raft_consensus.cc:493] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:45.953534 12356 raft_consensus.cc:3060] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:45.956687 11274 catalog_manager.cc:5697] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 1 to 2, leader changed from 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132) to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 2 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:45.962270 12356 raft_consensus.cc:515] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:45.970319 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:45.970665 12356 leader_election.cc:290] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:45.971071 11448 raft_consensus.cc:3055] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:45.971719 11448 raft_consensus.cc:740] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:16:45.971871 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:45.972455 11522 raft_consensus.cc:3060] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:45.972513 11448 consensus_queue.cc:260] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:45.973714 11448 raft_consensus.cc:3060] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:45.979104 11522 raft_consensus.cc:2468] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 2.
I20260709 12:16:45.979771 11448 raft_consensus.cc:2468] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 2.
I20260709 12:16:45.980330 12204 leader_election.cc:304] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:45.981598 12553 raft_consensus.cc:2804] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:45.981998 12553 raft_consensus.cc:697] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 2 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:16:45.982812 12553 consensus_queue.cc:237] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:45.993103 11274 catalog_manager.cc:5697] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 1 to 2, leader changed from 1c101e338f954ef086338e251deed19d (127.3.212.130) to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 2 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:46.020999 12550 raft_consensus.cc:993] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d: : Instructing follower a03223e9e41247c3a36b7b7c3d476671 to start an election
I20260709 12:16:46.021536 12551 raft_consensus.cc:1081] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [term 1 LEADER]: Signalling peer a03223e9e41247c3a36b7b7c3d476671 to start an election
I20260709 12:16:46.022939 11520 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "390e91331fd04f97a5235133a34875ee"
dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
 from {username='slave'} at 127.0.0.1:33456
I20260709 12:16:46.023411 11520 raft_consensus.cc:493] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:46.023681 11520 raft_consensus.cc:3060] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:46.028350 11520 raft_consensus.cc:515] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:46.029948 11520 leader_election.cc:290] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:46.030851 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390e91331fd04f97a5235133a34875ee" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:46.031172 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390e91331fd04f97a5235133a34875ee" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:46.031503 11450 raft_consensus.cc:3055] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:46.031738 11595 raft_consensus.cc:3060] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:46.031848 11450 raft_consensus.cc:740] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:16:46.032747 11450 consensus_queue.cc:260] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:46.033987 11450 raft_consensus.cc:3060] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:46.038937 11595 raft_consensus.cc:2468] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 2.
I20260709 12:16:46.040608 11491 leader_election.cc:304] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:16:46.040720 11450 raft_consensus.cc:2468] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 2.
I20260709 12:16:46.041946 12537 raft_consensus.cc:2804] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:46.042367 12537 raft_consensus.cc:697] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671 [term 2 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:16:46.043275 12537 consensus_queue.cc:237] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:46.053273 11274 catalog_manager.cc:5697] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 1 to 2, leader changed from 1c101e338f954ef086338e251deed19d (127.3.212.130) to a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131). New cstate: current_term: 2 leader_uuid: "a03223e9e41247c3a36b7b7c3d476671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:46.123732 12550 raft_consensus.cc:993] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d: : Instructing follower b126028166e8480ba25541bf8f7fc6de to start an election
I20260709 12:16:46.124177 12551 raft_consensus.cc:1081] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 1 LEADER]: Signalling peer b126028166e8480ba25541bf8f7fc6de to start an election
I20260709 12:16:46.126277 12345 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ffe47647c274723808482c166efa21c"
dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
 from {username='slave'} at 127.0.0.1:51698
I20260709 12:16:46.126938 12345 raft_consensus.cc:493] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:46.127408 12345 raft_consensus.cc:3060] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:46.136065 12345 raft_consensus.cc:515] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:46.138576 12345 leader_election.cc:290] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:46.139201 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffe47647c274723808482c166efa21c" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:46.139739 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffe47647c274723808482c166efa21c" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:46.139879 11595 raft_consensus.cc:3060] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:46.140394 11450 raft_consensus.cc:3055] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:46.140801 11450 raft_consensus.cc:740] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:16:46.141557 11450 consensus_queue.cc:260] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:46.143838 11450 raft_consensus.cc:3060] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:46.147086 11595 raft_consensus.cc:2468] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 2.
I20260709 12:16:46.148444 12203 leader_election.cc:304] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:46.149297 12553 raft_consensus.cc:2804] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:46.149803 12553 raft_consensus.cc:697] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [term 2 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:16:46.150694 12553 consensus_queue.cc:237] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:46.150632 11450 raft_consensus.cc:2468] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 2.
I20260709 12:16:46.161538 11274 catalog_manager.cc:5697] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 1 to 2, leader changed from 1c101e338f954ef086338e251deed19d (127.3.212.130) to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 2 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:46.188405 11520 raft_consensus.cc:1275] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:46.189628 12553 consensus_queue.cc:1048] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:46.203821 11448 raft_consensus.cc:1275] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:46.205546 12553 consensus_queue.cc:1048] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:46.315843 11448 raft_consensus.cc:1275] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:46.317291 12553 consensus_queue.cc:1048] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:46.329820 11595 raft_consensus.cc:1275] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:46.331295 12552 consensus_queue.cc:1048] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:46.340724 11450 raft_consensus.cc:1275] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:46.342357 12554 consensus_queue.cc:1048] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:46.358482 11600 raft_consensus.cc:1275] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:46.373868 12552 consensus_queue.cc:1048] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:46.378295 11520 raft_consensus.cc:1275] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:46.383618 12554 consensus_queue.cc:1048] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:46.396759 11450 raft_consensus.cc:1275] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:46.398387 12552 consensus_queue.cc:1048] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:46.492543 11450 raft_consensus.cc:1275] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:46.493976 12537 consensus_queue.cc:1048] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:46.504029 11600 raft_consensus.cc:1275] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:46.506047 12579 consensus_queue.cc:1048] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:46.649108 11600 raft_consensus.cc:1275] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:46.650507 12554 consensus_queue.cc:1048] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:46.661257 11448 raft_consensus.cc:1275] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:46.663025 12554 consensus_queue.cc:1048] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:46.688247  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:46.729298 11600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "b126028166e8480ba25541bf8f7fc6de"
 from {username='slave'} at 127.0.0.1:37992
I20260709 12:16:46.729779 11600 raft_consensus.cc:606] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 2 LEADER]: Received request to transfer leadership to TS b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:46.732151 11600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "b126028166e8480ba25541bf8f7fc6de"
 from {username='slave'} at 127.0.0.1:37992
I20260709 12:16:46.732781 11600 raft_consensus.cc:606] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Received request to transfer leadership to TS b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:46.734990 11600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "a03223e9e41247c3a36b7b7c3d476671"
 from {username='slave'} at 127.0.0.1:37992
I20260709 12:16:46.735517 11600 raft_consensus.cc:606] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Received request to transfer leadership to TS a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:46.738050 11448 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78"
dest_uuid: "1c101e338f954ef086338e251deed19d"
mode: GRACEFUL
new_leader_uuid: "b126028166e8480ba25541bf8f7fc6de"
 from {username='slave'} at 127.0.0.1:50370
I20260709 12:16:46.738579 11448 raft_consensus.cc:606] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 1 LEADER]: Received request to transfer leadership to TS b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:46.741091 11600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "b126028166e8480ba25541bf8f7fc6de"
 from {username='slave'} at 127.0.0.1:37992
I20260709 12:16:46.741686 11600 raft_consensus.cc:606] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 2 LEADER]: Received request to transfer leadership to TS b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:46.742853  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:16:46.744551  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:46.745254  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:46.778493 12509 raft_consensus.cc:993] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8: : Instructing follower a03223e9e41247c3a36b7b7c3d476671 to start an election
I20260709 12:16:46.779150 12540 raft_consensus.cc:1081] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Signalling peer a03223e9e41247c3a36b7b7c3d476671 to start an election
I20260709 12:16:46.780632 11522 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5"
dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
 from {username='slave'} at 127.0.0.1:33446
I20260709 12:16:46.781118 11522 raft_consensus.cc:493] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:46.781416 11522 raft_consensus.cc:3060] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:46.787050 11522 raft_consensus.cc:515] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:46.789017 11522 leader_election.cc:290] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:46.789979 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:46.790549 11595 raft_consensus.cc:3055] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:46.790769 11595 raft_consensus.cc:740] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:46.791491 11595 consensus_queue.cc:260] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:46.792397 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:46.792729 11595 raft_consensus.cc:3060] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:46.793076 11448 raft_consensus.cc:3060] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:46.800619 11448 raft_consensus.cc:2468] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 2.
I20260709 12:16:46.804142 11491 leader_election.cc:304] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:16:46.807003 12537 raft_consensus.cc:2804] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:46.807252 11595 raft_consensus.cc:2468] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 2.
I20260709 12:16:46.807567 12537 raft_consensus.cc:697] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 2 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:16:46.808807 12537 consensus_queue.cc:237] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:46.823415 11274 catalog_manager.cc:5697] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 1 to 2, leader changed from 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132) to a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131). New cstate: current_term: 2 leader_uuid: "a03223e9e41247c3a36b7b7c3d476671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:47.095158 12561 raft_consensus.cc:993] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8: : Instructing follower b126028166e8480ba25541bf8f7fc6de to start an election
I20260709 12:16:47.095728 12540 raft_consensus.cc:1081] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 2 LEADER]: Signalling peer b126028166e8480ba25541bf8f7fc6de to start an election
I20260709 12:16:47.097288 12356 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff"
dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
 from {username='slave'} at 127.0.0.1:51706
I20260709 12:16:47.097854 12356 raft_consensus.cc:493] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:47.098150 12356 raft_consensus.cc:3060] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:47.103323 12551 raft_consensus.cc:993] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d: : Instructing follower b126028166e8480ba25541bf8f7fc6de to start an election
I20260709 12:16:47.103888 12550 raft_consensus.cc:1081] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 1 LEADER]: Signalling peer b126028166e8480ba25541bf8f7fc6de to start an election
I20260709 12:16:47.103991 12356 raft_consensus.cc:515] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:47.105579 12345 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78"
dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
 from {username='slave'} at 127.0.0.1:51698
I20260709 12:16:47.106127 12345 raft_consensus.cc:493] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:47.106361 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:47.106441 12356 leader_election.cc:290] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:47.106626 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:47.106479 12345 raft_consensus.cc:3060] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:47.107179 11522 raft_consensus.cc:3060] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:47.107402 11595 raft_consensus.cc:3055] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:47.108175 11595 raft_consensus.cc:740] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:47.108860 11595 consensus_queue.cc:260] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:47.110170 11595 raft_consensus.cc:3060] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:47.114315 12345 raft_consensus.cc:515] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:47.115233 11522 raft_consensus.cc:2468] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 3.
I20260709 12:16:47.115885 11595 raft_consensus.cc:2468] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 3.
I20260709 12:16:47.117051 12203 leader_election.cc:304] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:47.117558 12345 leader_election.cc:290] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:47.117897 12552 raft_consensus.cc:2804] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:47.118430 12552 raft_consensus.cc:697] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 3 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:16:47.119406 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:47.119405 12552 consensus_queue.cc:237] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:47.121953 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:47.120133 11448 raft_consensus.cc:3055] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:47.122603 11522 raft_consensus.cc:3060] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:47.122916 11448 raft_consensus.cc:740] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:16:47.127069 11448 consensus_queue.cc:260] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:47.128692 11448 raft_consensus.cc:3060] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:47.130375 11522 raft_consensus.cc:2468] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 2.
I20260709 12:16:47.131557 12204 leader_election.cc:304] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:47.132578 12554 raft_consensus.cc:2804] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:47.133069 12554 raft_consensus.cc:697] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 2 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:16:47.134053 12554 consensus_queue.cc:237] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:47.149616 11448 raft_consensus.cc:2468] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 2.
I20260709 12:16:47.157125 12561 raft_consensus.cc:993] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8: : Instructing follower b126028166e8480ba25541bf8f7fc6de to start an election
I20260709 12:16:47.157670 12561 raft_consensus.cc:1081] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Signalling peer b126028166e8480ba25541bf8f7fc6de to start an election
I20260709 12:16:47.158155 11274 catalog_manager.cc:5697] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 2 to 3, leader changed from 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132) to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 3 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:47.159366 12356 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4"
dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
 from {username='slave'} at 127.0.0.1:51706
I20260709 12:16:47.159993 12356 raft_consensus.cc:493] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:47.160523 12356 raft_consensus.cc:3060] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:47.159933 11274 catalog_manager.cc:5697] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 1 to 2, leader changed from 1c101e338f954ef086338e251deed19d (127.3.212.130) to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 2 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:47.167292 12356 raft_consensus.cc:515] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:47.169862 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:47.170101 12356 leader_election.cc:290] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:47.170480 11595 raft_consensus.cc:3055] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:47.170804 11595 raft_consensus.cc:740] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:47.171692 11595 consensus_queue.cc:260] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:47.172173 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:47.172755 11595 raft_consensus.cc:3060] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:47.172855 11450 raft_consensus.cc:3060] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:47.180627 11595 raft_consensus.cc:2468] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 2.
I20260709 12:16:47.180627 11450 raft_consensus.cc:2468] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 2.
I20260709 12:16:47.181988 12203 leader_election.cc:304] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:47.183696 12554 raft_consensus.cc:2804] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:47.184216 12554 raft_consensus.cc:697] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 2 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:16:47.185500 12554 consensus_queue.cc:237] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:47.195039 11274 catalog_manager.cc:5697] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 1 to 2, leader changed from 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132) to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 2 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:47.200313 11448 raft_consensus.cc:1275] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:47.202057 12579 consensus_queue.cc:1048] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:47.221175 11595 raft_consensus.cc:1275] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:47.223294 12579 consensus_queue.cc:1048] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:47.304711 12561 raft_consensus.cc:993] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8: : Instructing follower b126028166e8480ba25541bf8f7fc6de to start an election
I20260709 12:16:47.305146 12509 raft_consensus.cc:1081] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 2 LEADER]: Signalling peer b126028166e8480ba25541bf8f7fc6de to start an election
I20260709 12:16:47.306680 12356 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b"
dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
 from {username='slave'} at 127.0.0.1:51706
I20260709 12:16:47.307149 12356 raft_consensus.cc:493] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:47.307423 12356 raft_consensus.cc:3060] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:47.312563 12356 raft_consensus.cc:515] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:47.315454 12356 leader_election.cc:290] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:47.315732 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:47.316381 11520 raft_consensus.cc:3060] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:47.319250 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:47.319919 11595 raft_consensus.cc:3055] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:47.320164 11595 raft_consensus.cc:740] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:47.320914 11595 consensus_queue.cc:260] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:47.322103 11595 raft_consensus.cc:3060] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:47.322966 11520 raft_consensus.cc:2468] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 3.
I20260709 12:16:47.324076 12204 leader_election.cc:304] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:47.324960 12554 raft_consensus.cc:2804] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:47.325454 12554 raft_consensus.cc:697] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 3 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:16:47.326356 12554 consensus_queue.cc:237] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:47.328822 11595 raft_consensus.cc:2468] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 3.
I20260709 12:16:47.342396 11275 catalog_manager.cc:5697] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 2 to 3, leader changed from 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132) to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 3 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:47.525174 11522 raft_consensus.cc:1275] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:47.526238 12554 consensus_queue.cc:1048] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:47.535030 11595 raft_consensus.cc:1275] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:47.537132 12554 consensus_queue.cc:1048] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:47.537237 11450 raft_consensus.cc:1275] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:47.539511 12553 consensus_queue.cc:1048] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:47.558653 11522 raft_consensus.cc:1275] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:47.560614 12552 consensus_queue.cc:1048] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:47.607543 11600 raft_consensus.cc:1275] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:47.608875 12552 consensus_queue.cc:1048] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:47.620621 11448 raft_consensus.cc:1275] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:47.627161 12554 consensus_queue.cc:1048] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:47.786594  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:47.826128 11595 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "a03223e9e41247c3a36b7b7c3d476671"
 from {username='slave'} at 127.0.0.1:37992
I20260709 12:16:47.826680 11595 raft_consensus.cc:606] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Received request to transfer leadership to TS a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:47.829156 11595 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "b126028166e8480ba25541bf8f7fc6de"
 from {username='slave'} at 127.0.0.1:37992
I20260709 12:16:47.829668 11595 raft_consensus.cc:606] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 LEADER]: Received request to transfer leadership to TS b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:47.832448 11595 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "b126028166e8480ba25541bf8f7fc6de"
 from {username='slave'} at 127.0.0.1:37992
I20260709 12:16:47.833031 11595 raft_consensus.cc:606] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 LEADER]: Received request to transfer leadership to TS b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:47.838814 11595 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "b126028166e8480ba25541bf8f7fc6de"
 from {username='slave'} at 127.0.0.1:37992
I20260709 12:16:47.839473 11595 raft_consensus.cc:606] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Received request to transfer leadership to TS b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:47.842175 11595 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "b126028166e8480ba25541bf8f7fc6de"
 from {username='slave'} at 127.0.0.1:37992
I20260709 12:16:47.842744 11595 raft_consensus.cc:606] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Received request to transfer leadership to TS b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:47.843771  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:16:47.845342  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:47.846027  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:47.849877 12509 raft_consensus.cc:993] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8: : Instructing follower b126028166e8480ba25541bf8f7fc6de to start an election
I20260709 12:16:47.850425 12540 raft_consensus.cc:1081] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 LEADER]: Signalling peer b126028166e8480ba25541bf8f7fc6de to start an election
I20260709 12:16:47.853483 12347 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5"
dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
 from {username='slave'} at 127.0.0.1:51706
I20260709 12:16:47.854068 12347 raft_consensus.cc:493] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:47.854425 12347 raft_consensus.cc:3060] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:47.860211 12347 raft_consensus.cc:515] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:47.863839 12347 leader_election.cc:290] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:47.865907 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:47.866482 11520 raft_consensus.cc:3060] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:47.877177 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:47.877878 11595 raft_consensus.cc:3055] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:47.878188 11595 raft_consensus.cc:740] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:47.878911 11595 consensus_queue.cc:260] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:47.879865 11520 raft_consensus.cc:2468] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 3.
I20260709 12:16:47.880127 11595 raft_consensus.cc:3060] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:47.881173 12204 leader_election.cc:304] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:47.882082 12554 raft_consensus.cc:2804] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:47.883260 12554 raft_consensus.cc:697] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 3 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:16:47.884264 12554 consensus_queue.cc:237] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:47.887487 11595 raft_consensus.cc:2468] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 3.
I20260709 12:16:47.895841 11275 catalog_manager.cc:5697] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 2 to 3, leader changed from 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132) to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 3 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:47.905892 11595 raft_consensus.cc:1275] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:47.907155 12554 consensus_queue.cc:1048] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:47.917371 11520 raft_consensus.cc:1275] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:47.919466 12552 consensus_queue.cc:1048] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:48.189816 12561 raft_consensus.cc:993] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8: : Instructing follower a03223e9e41247c3a36b7b7c3d476671 to start an election
I20260709 12:16:48.190256 12540 raft_consensus.cc:1081] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Signalling peer a03223e9e41247c3a36b7b7c3d476671 to start an election
I20260709 12:16:48.191563 11522 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568"
dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
 from {username='slave'} at 127.0.0.1:33446
I20260709 12:16:48.192009 11522 raft_consensus.cc:493] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:48.192276 11522 raft_consensus.cc:3060] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:48.198185 11522 raft_consensus.cc:515] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:48.200556 11522 leader_election.cc:290] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:48.205193 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:48.205513 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:48.206005 11448 raft_consensus.cc:3060] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:48.206153 11595 raft_consensus.cc:3055] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:48.206562 11595 raft_consensus.cc:740] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:48.207281 11595 consensus_queue.cc:260] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:48.208508 11595 raft_consensus.cc:3060] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:48.214143 11448 raft_consensus.cc:2468] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 2.
I20260709 12:16:48.214694 11595 raft_consensus.cc:2468] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 2.
I20260709 12:16:48.215638 11491 leader_election.cc:304] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:16:48.216491 12537 raft_consensus.cc:2804] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:48.217028 12537 raft_consensus.cc:697] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 2 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:16:48.217971 12537 consensus_queue.cc:237] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:48.229033 11273 catalog_manager.cc:5697] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 1 to 2, leader changed from 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132) to a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131). New cstate: current_term: 2 leader_uuid: "a03223e9e41247c3a36b7b7c3d476671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:48.230033 12561 raft_consensus.cc:993] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8: : Instructing follower b126028166e8480ba25541bf8f7fc6de to start an election
I20260709 12:16:48.230592 12540 raft_consensus.cc:1081] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Signalling peer b126028166e8480ba25541bf8f7fc6de to start an election
I20260709 12:16:48.231894 12347 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109"
dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
 from {username='slave'} at 127.0.0.1:51706
I20260709 12:16:48.232388 12347 raft_consensus.cc:493] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:48.232726 12347 raft_consensus.cc:3060] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:48.238916 12347 raft_consensus.cc:515] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:48.241043 12347 leader_election.cc:290] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:48.241727 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:48.241901 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:48.242343 11595 raft_consensus.cc:3055] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:48.242453 11448 raft_consensus.cc:3060] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:48.242614 11595 raft_consensus.cc:740] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:48.243443 11595 consensus_queue.cc:260] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:48.244374 11595 raft_consensus.cc:3060] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:48.248989 11448 raft_consensus.cc:2468] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 2.
I20260709 12:16:48.250516 12203 leader_election.cc:304] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:48.251299 12554 raft_consensus.cc:2804] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:48.251771 12554 raft_consensus.cc:697] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 2 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:16:48.252782 12554 consensus_queue.cc:237] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:48.254681 11595 raft_consensus.cc:2468] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 2.
I20260709 12:16:48.264484 11273 catalog_manager.cc:5697] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 1 to 2, leader changed from 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132) to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 2 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:48.284950 12561 raft_consensus.cc:993] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8: : Instructing follower b126028166e8480ba25541bf8f7fc6de to start an election
I20260709 12:16:48.285458 12561 raft_consensus.cc:1081] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Signalling peer b126028166e8480ba25541bf8f7fc6de to start an election
I20260709 12:16:48.287039 12347 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb"
dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
 from {username='slave'} at 127.0.0.1:51706
I20260709 12:16:48.287549 12347 raft_consensus.cc:493] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:48.287863 12347 raft_consensus.cc:3060] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:48.293131 12347 raft_consensus.cc:515] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:48.294849 12347 leader_election.cc:290] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:48.295635 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:48.295835 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:48.296173 11595 raft_consensus.cc:3055] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:48.296428 11450 raft_consensus.cc:3060] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:48.296586 11595 raft_consensus.cc:740] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:48.297325 11595 consensus_queue.cc:260] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:48.298296 11595 raft_consensus.cc:3060] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:48.302109 11450 raft_consensus.cc:2468] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 2.
I20260709 12:16:48.303246 12203 leader_election.cc:304] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:48.304059 12554 raft_consensus.cc:2804] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:48.304579 12554 raft_consensus.cc:697] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 2 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:16:48.304983 11595 raft_consensus.cc:2468] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 2.
I20260709 12:16:48.305465 12554 consensus_queue.cc:237] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:48.314937 11273 catalog_manager.cc:5697] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 1 to 2, leader changed from 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132) to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 2 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:48.332383 12540 raft_consensus.cc:993] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8: : Instructing follower b126028166e8480ba25541bf8f7fc6de to start an election
I20260709 12:16:48.332821 12561 raft_consensus.cc:1081] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 LEADER]: Signalling peer b126028166e8480ba25541bf8f7fc6de to start an election
I20260709 12:16:48.334682 12347 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48"
dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
 from {username='slave'} at 127.0.0.1:51706
I20260709 12:16:48.335294 12347 raft_consensus.cc:493] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:48.335999 12347 raft_consensus.cc:3060] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:48.338260 11522 raft_consensus.cc:1275] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:48.340235 12554 consensus_queue.cc:1048] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:48.344655 12347 raft_consensus.cc:515] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:48.347595 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:48.347713 12347 leader_election.cc:290] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:48.347874 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:48.348212 11520 raft_consensus.cc:3060] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:48.348506 11600 raft_consensus.cc:3055] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:48.348821 11600 raft_consensus.cc:740] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:48.349591 11600 consensus_queue.cc:260] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:48.350798 11600 raft_consensus.cc:3060] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:48.355331 11520 raft_consensus.cc:2468] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 3.
I20260709 12:16:48.356580 12204 leader_election.cc:304] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:48.357014 11595 raft_consensus.cc:1275] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:48.357446 12613 raft_consensus.cc:2804] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:48.358002 12613 raft_consensus.cc:697] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 3 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:16:48.358839 12613 consensus_queue.cc:237] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:48.359789 12552 consensus_queue.cc:1048] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:48.364065 11600 raft_consensus.cc:2468] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 3.
I20260709 12:16:48.373287 11275 catalog_manager.cc:5697] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 2 to 3, leader changed from 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132) to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 3 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:48.691612 11600 raft_consensus.cc:1275] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:48.692819 12537 consensus_queue.cc:1048] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:48.698945 11450 raft_consensus.cc:1275] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:48.703676 11450 raft_consensus.cc:1275] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:48.701275 12552 consensus_queue.cc:1048] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:16:48.706202 12537 consensus_queue.cc:1048] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:48.723904 11600 raft_consensus.cc:1275] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:48.725593 12552 consensus_queue.cc:1048] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:48.757218 11595 raft_consensus.cc:1275] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:48.761094 12552 consensus_queue.cc:1048] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:48.772526 11448 raft_consensus.cc:1275] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:48.773887 12553 consensus_queue.cc:1048] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:48.848789 11600 raft_consensus.cc:1275] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:48.850270 12553 consensus_queue.cc:1048] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:48.861069 11522 raft_consensus.cc:1275] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:48.862661 12554 consensus_queue.cc:1048] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:48.892652  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:48.928870 11595 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "1c101e338f954ef086338e251deed19d"
 from {username='slave'} at 127.0.0.1:37992
I20260709 12:16:48.929523 11595 raft_consensus.cc:606] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Received request to transfer leadership to TS 1c101e338f954ef086338e251deed19d
I20260709 12:16:48.930737  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:16:48.932637  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:48.933393  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:49.089025 12540 raft_consensus.cc:993] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8: : Instructing follower 1c101e338f954ef086338e251deed19d to start an election
I20260709 12:16:49.089676 12540 raft_consensus.cc:1081] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Signalling peer 1c101e338f954ef086338e251deed19d to start an election
I20260709 12:16:49.091403 11448 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8"
dest_uuid: "1c101e338f954ef086338e251deed19d"
 from {username='slave'} at 127.0.0.1:58868
I20260709 12:16:49.091952 11448 raft_consensus.cc:493] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:49.092327 11448 raft_consensus.cc:3060] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:49.097661 11448 raft_consensus.cc:515] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:49.100234 11448 leader_election.cc:290] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:49.100392 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:49.100813 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:49.101011 11522 raft_consensus.cc:3060] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:49.101446 11600 raft_consensus.cc:3055] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:49.101881 11600 raft_consensus.cc:740] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:49.102555 11600 consensus_queue.cc:260] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:49.103469 11600 raft_consensus.cc:3060] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:49.106734 11522 raft_consensus.cc:2468] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 2.
I20260709 12:16:49.107914 11418 leader_election.cc:304] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:16:49.108796 12629 raft_consensus.cc:2804] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:49.109692 12629 raft_consensus.cc:697] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 2 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:16:49.110642 12629 consensus_queue.cc:237] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:49.112079 11600 raft_consensus.cc:2468] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 2.
I20260709 12:16:49.122933 11273 catalog_manager.cc:5697] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 1 to 2, leader changed from 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132) to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 2 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } }
W20260709 12:16:49.350631 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 160868us
I20260709 12:16:49.988327  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:50.143401 12636 raft_consensus.cc:493] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:16:50.144536 12636 raft_consensus.cc:515] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:50.148582 12636 leader_election.cc:290] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:50.320870 12641 raft_consensus.cc:493] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:50.562568 12641 raft_consensus.cc:515] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:50.564889 12647 raft_consensus.cc:493] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:16:50.508142 12638 raft_consensus.cc:493] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:16:50.570673 12648 raft_consensus.cc:493] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:16:50.570835 12638 raft_consensus.cc:515] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:50.571316 12648 raft_consensus.cc:515] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:50.574141 12638 leader_election.cc:290] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:50.574911 12638 raft_consensus.cc:493] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:50.575579 12638 raft_consensus.cc:515] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:50.578164 12638 leader_election.cc:290] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:50.578900 12648 leader_election.cc:290] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:50.553890 12637 raft_consensus.cc:493] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:16:50.602308 12637 raft_consensus.cc:515] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:50.604887 12637 leader_election.cc:290] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:50.606863 12637 raft_consensus.cc:493] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:16:50.607486 12637 raft_consensus.cc:515] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:50.610242 12637 leader_election.cc:290] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:50.610916 12637 raft_consensus.cc:493] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:16:50.611701 12637 raft_consensus.cc:515] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:50.613946 12637 leader_election.cc:290] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:50.615588 12637 raft_consensus.cc:493] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:50.557271 12561 raft_consensus.cc:493] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:16:50.616822 12561 raft_consensus.cc:515] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:50.619645 12561 leader_election.cc:290] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:50.558140 12537 raft_consensus.cc:493] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:16:50.620940 12537 raft_consensus.cc:515] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:50.623757 12537 leader_election.cc:290] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:50.561779 12643 raft_consensus.cc:493] T da8741606df54c3f8b5cc5c1141862ea P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:16:50.459761 12636 raft_consensus.cc:493] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:16:50.626628 12636 raft_consensus.cc:515] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:50.628971 12636 leader_election.cc:290] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:50.629951 12643 raft_consensus.cc:515] T da8741606df54c3f8b5cc5c1141862ea P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:50.632485 12643 leader_election.cc:290] T da8741606df54c3f8b5cc5c1141862ea P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:50.566008 12641 leader_election.cc:290] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:50.488638 12642 raft_consensus.cc:493] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:16:50.633831 12642 raft_consensus.cc:515] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:50.636636 12642 leader_election.cc:290] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:50.569443 12644 raft_consensus.cc:493] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:16:50.643661 12644 raft_consensus.cc:515] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:50.581067 12620 raft_consensus.cc:493] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:50.648041 12620 raft_consensus.cc:515] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:50.650188 12620 leader_election.cc:290] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:50.600461 12658 raft_consensus.cc:493] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:16:50.652233 12658 raft_consensus.cc:515] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:50.655835 12659 raft_consensus.cc:493] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:16:50.657820 12659 raft_consensus.cc:515] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:50.582674 12640 raft_consensus.cc:493] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:16:50.665820 12640 raft_consensus.cc:515] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:50.667395 12658 leader_election.cc:290] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:50.670861 12658 raft_consensus.cc:493] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:16:50.592280 12552 raft_consensus.cc:493] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:16:50.672304 12653 raft_consensus.cc:493] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:16:50.672885 12552 raft_consensus.cc:515] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:50.674180 12636 raft_consensus.cc:493] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:16:50.674823 12636 raft_consensus.cc:515] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:50.554890 12645 raft_consensus.cc:493] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:16:50.579743 12638 raft_consensus.cc:493] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:16:50.583176 12647 raft_consensus.cc:515] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:50.677328 12636 leader_election.cc:290] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:50.595541 12655 raft_consensus.cc:493] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:16:50.680562 12655 raft_consensus.cc:515] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:50.646683 12648 raft_consensus.cc:493] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:50.668183 12640 leader_election.cc:290] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:50.681938 12648 raft_consensus.cc:515] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:50.684268 12648 leader_election.cc:290] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:50.687281 12655 leader_election.cc:290] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:50.687933 12655 raft_consensus.cc:493] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:16:50.690886 12655 raft_consensus.cc:515] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:50.671670 12620 raft_consensus.cc:493] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:50.673003 12653 raft_consensus.cc:515] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:50.702620 12620 raft_consensus.cc:515] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:50.704115 12653 leader_election.cc:290] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:50.704707 12620 leader_election.cc:290] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:50.681173 12647 leader_election.cc:290] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:50.660892 12637 raft_consensus.cc:515] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:50.709895 12637 leader_election.cc:290] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:50.678994 12552 leader_election.cc:290] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:50.679085 12553 raft_consensus.cc:493] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:16:50.679301 12645 raft_consensus.cc:515] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:50.710071 12648 raft_consensus.cc:493] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:50.710829 12648 raft_consensus.cc:515] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:50.712738 12553 raft_consensus.cc:515] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:50.662755 12644 leader_election.cc:290] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:50.552583 12639 raft_consensus.cc:493] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:50.713901 12639 raft_consensus.cc:515] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:50.714807 12553 leader_election.cc:290] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:50.712055 12645 leader_election.cc:290] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:50.679670 12638 raft_consensus.cc:515] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:50.716169 12639 leader_election.cc:290] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:50.717099 12638 leader_election.cc:290] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:50.720281 12655 leader_election.cc:290] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:50.723901 12658 raft_consensus.cc:515] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:50.726722 12658 leader_election.cc:290] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:50.727334 12658 raft_consensus.cc:493] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:16:50.727865 12658 raft_consensus.cc:515] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:50.731860 12648 leader_election.cc:290] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:50.669623 12659 leader_election.cc:290] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:50.584916 12650 raft_consensus.cc:493] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:16:50.745090 12650 raft_consensus.cc:515] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:50.751231 12650 leader_election.cc:290] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:50.754856 12620 raft_consensus.cc:493] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:50.755620 12620 raft_consensus.cc:515] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:50.757896 12620 leader_election.cc:290] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:50.758296 12593 raft_consensus.cc:493] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:16:50.758832 12593 raft_consensus.cc:515] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:50.760715 12638 raft_consensus.cc:493] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:50.761523 12620 raft_consensus.cc:493] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:16:50.761657 12637 raft_consensus.cc:493] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:16:50.762276 12637 raft_consensus.cc:515] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:50.761482 12638 raft_consensus.cc:515] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:50.764633 12637 leader_election.cc:290] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:50.765252 12638 leader_election.cc:290] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:50.765471 12659 raft_consensus.cc:493] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:16:50.766099 12659 raft_consensus.cc:515] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:50.766898 12647 raft_consensus.cc:493] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:16:50.767450 12647 raft_consensus.cc:515] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:50.768934 12661 raft_consensus.cc:493] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:50.778980 12641 raft_consensus.cc:493] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:50.778930 12661 raft_consensus.cc:515] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:50.760910 12593 leader_election.cc:290] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:50.779855 12641 raft_consensus.cc:515] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:50.769510 12553 raft_consensus.cc:493] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:16:50.781747 12553 raft_consensus.cc:515] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:50.782397 12641 leader_election.cc:290] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:50.779124 12639 raft_consensus.cc:493] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:16:50.783452 12639 raft_consensus.cc:515] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:50.783870 12553 leader_election.cc:290] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:50.784233 11275 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57430 (request call id 147) took 1379 ms. Trace:
I20260709 12:16:50.784723 11275 rpcz_store.cc:276] 0709 12:16:49.404730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:50.559172 (+1154442us) service_pool.cc:224] Handling call
0709 12:16:50.784119 (+224947us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 12:16:50.785416 12659 leader_election.cc:290] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:50.769110 12655 raft_consensus.cc:493] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:16:50.790447 12648 raft_consensus.cc:493] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:16:50.794472 12639 leader_election.cc:290] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:50.795190 12639 raft_consensus.cc:493] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:50.797008 12639 raft_consensus.cc:515] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:50.799938 12639 leader_election.cc:290] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:50.796329 12509 raft_consensus.cc:493] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:16:50.792440 12641 raft_consensus.cc:493] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:16:50.787155 12637 raft_consensus.cc:493] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:16:50.784643 12647 leader_election.cc:290] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:50.817721 11273 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39286 (request call id 104) took 1442 ms. Trace:
I20260709 12:16:50.762257 12620 raft_consensus.cc:515] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:50.786695 12650 raft_consensus.cc:493] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:16:50.842705 12646 raft_consensus.cc:493] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:50.817575 12648 raft_consensus.cc:515] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:50.846089 12646 raft_consensus.cc:515] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:50.803887 12653 raft_consensus.cc:493] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:16:50.847507 12653 raft_consensus.cc:515] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:50.848312 12646 leader_election.cc:290] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:50.804127 12593 raft_consensus.cc:493] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:16:50.849092 12593 raft_consensus.cc:515] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:50.849620 12653 leader_election.cc:290] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:50.850401 12661 leader_election.cc:290] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:50.851080 12620 leader_election.cc:290] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:50.851389 12658 leader_election.cc:290] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:50.851560 12650 raft_consensus.cc:515] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:50.813170 12655 raft_consensus.cc:515] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:50.853713 12655 leader_election.cc:290] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:50.856942 12593 leader_election.cc:290] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:50.818095 11273 rpcz_store.cc:276] 0709 12:16:49.361451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:50.243263 (+881812us) service_pool.cc:224] Handling call
0709 12:16:50.803653 (+560390us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4818,"reported_tablets":1}
I20260709 12:16:50.801296 12509 raft_consensus.cc:515] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:50.844640 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:50.866820 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:50.853721 12650 leader_election.cc:290] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:50.890605 12561 raft_consensus.cc:493] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:16:50.892005 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:50.841094 12637 raft_consensus.cc:515] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:50.893011 12356 raft_consensus.cc:2468] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 2.
I20260709 12:16:50.819027 12641 raft_consensus.cc:515] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:50.874827 12638 raft_consensus.cc:493] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:16:50.893775 12509 leader_election.cc:290] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:50.879729 12642 raft_consensus.cc:493] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:50.882560 12643 raft_consensus.cc:493] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:50.894383 12561 raft_consensus.cc:515] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:50.895865 12509 raft_consensus.cc:493] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:16:50.898115 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:50.886657 12554 raft_consensus.cc:493] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:16:50.888646 12658 raft_consensus.cc:493] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:16:50.900686 12537 raft_consensus.cc:493] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:16:50.897913 12509 raft_consensus.cc:515] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:50.902904 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:50.903587 11600 raft_consensus.cc:2468] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 1.
I20260709 12:16:50.906649 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:50.906836 12537 raft_consensus.cc:515] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:50.902459 12643 raft_consensus.cc:515] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:50.909785 12643 leader_election.cc:290] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:50.906220 12650 raft_consensus.cc:493] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:16:50.896250 12653 raft_consensus.cc:493] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:16:50.922189 12653 raft_consensus.cc:515] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:50.915302 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:50.910333 12662 raft_consensus.cc:493] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:16:50.904234 12636 raft_consensus.cc:493] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:16:50.904611 12640 raft_consensus.cc:493] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:16:50.913932 12655 raft_consensus.cc:493] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:16:50.917850 12650 raft_consensus.cc:515] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:50.917050 12620 raft_consensus.cc:493] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:16:50.911162 12554 raft_consensus.cc:515] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:50.918860 12656 raft_consensus.cc:493] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:16:50.897655 12638 raft_consensus.cc:515] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:50.919536 12657 raft_consensus.cc:493] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:16:50.910192 12663 raft_consensus.cc:493] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:16:50.920018 12648 leader_election.cc:290] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:50.916922 12654 raft_consensus.cc:493] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:16:50.949682 12644 raft_consensus.cc:493] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:16:50.906543 12658 raft_consensus.cc:515] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:50.920197 12552 raft_consensus.cc:493] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:16:50.940950 12347 raft_consensus.cc:2468] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 2.
I20260709 12:16:50.944238 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:50.947129 12561 leader_election.cc:290] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:50.948508 12537 leader_election.cc:290] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:50.919188 12553 raft_consensus.cc:493] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:16:50.919876 12637 leader_election.cc:290] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:50.953877 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:50.949208 12640 raft_consensus.cc:515] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:50.946830 12636 raft_consensus.cc:515] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:50.964715 12554 leader_election.cc:290] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:16:50.965256 11308 debug-util.cc:398] Leaking SignalData structure 0x7b0800049880 after lost signal to thread 3925
I20260709 12:16:50.965926 12660 raft_consensus.cc:493] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:16:50.947080 12647 raft_consensus.cc:493] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:16:50.899005 12642 raft_consensus.cc:515] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:50.996877 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:50.963197 12656 raft_consensus.cc:515] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:50.986759 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:50.952301 12659 raft_consensus.cc:493] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:16:50.986122 12663 raft_consensus.cc:515] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:51.022810 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:50.967818 12653 leader_election.cc:290] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:51.003247 12356 raft_consensus.cc:2468] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 1.
I20260709 12:16:50.958693 12509 leader_election.cc:290] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:51.004237 12561 raft_consensus.cc:493] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:51.044591 12561 raft_consensus.cc:515] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:51.046851 12561 leader_election.cc:290] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:50.950793 12655 raft_consensus.cc:515] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:50.956598 12620 raft_consensus.cc:515] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:51.051734 12620 leader_election.cc:290] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:51.013856 12664 raft_consensus.cc:493] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:51.052536 12664 raft_consensus.cc:515] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:51.014153 12666 raft_consensus.cc:493] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:16:51.014449 12647 raft_consensus.cc:515] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:51.070902 12666 raft_consensus.cc:515] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:51.015064 12636 leader_election.cc:290] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:51.015259 12648 raft_consensus.cc:493] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:16:50.978351 12654 raft_consensus.cc:515] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:51.016515 12641 leader_election.cc:290] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:51.011869 12554 raft_consensus.cc:493] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:16:51.012378 12646 raft_consensus.cc:493] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:16:51.017863 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:51.005558 12644 raft_consensus.cc:515] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:51.010885 12661 raft_consensus.cc:493] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:16:50.949469 12662 raft_consensus.cc:515] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:51.015961 12665 raft_consensus.cc:493] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:51.073318 12647 leader_election.cc:290] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:51.082413 12648 raft_consensus.cc:515] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:51.084100 12654 leader_election.cc:290] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:51.084609 12554 raft_consensus.cc:515] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:51.204419 12554 leader_election.cc:290] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:51.084890 12646 raft_consensus.cc:515] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:51.207170 12646 leader_election.cc:290] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:51.085659 12661 raft_consensus.cc:515] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:51.210000 12661 leader_election.cc:290] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:51.211993 12666 leader_election.cc:290] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:51.024160 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:51.017771 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:51.025175 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:51.026006 12642 leader_election.cc:290] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:51.026595 12656 leader_election.cc:290] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:51.006664 12552 raft_consensus.cc:515] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:51.027411 12663 leader_election.cc:290] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:51.027945 12659 raft_consensus.cc:515] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:50.976923 12657 raft_consensus.cc:515] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:51.299844 12552 leader_election.cc:290] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:51.031083 12640 leader_election.cc:290] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:51.034888 12650 leader_election.cc:290] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:51.299880 12659 leader_election.cc:290] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:51.036355 12658 leader_election.cc:290] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:51.004694 12553 raft_consensus.cc:515] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:51.087603 12662 leader_election.cc:290] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:51.089318 12644 leader_election.cc:290] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:51.270493 12655 leader_election.cc:290] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:51.303068 12553 leader_election.cc:290] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:51.303774 12345 raft_consensus.cc:2468] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 1.
I20260709 12:16:51.201192 12648 leader_election.cc:290] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:51.020179 12660 raft_consensus.cc:515] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:51.165966 12664 leader_election.cc:290] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:51.308918 12660 leader_election.cc:290] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:51.006001 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:16:52.080658 11308 debug-util.cc:398] Leaking SignalData structure 0x7b080005fea0 after lost signal to thread 11311
I20260709 12:16:53.036413 11520 raft_consensus.cc:2468] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 1.
W20260709 12:16:53.037429 11520 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38272 (request call id 54) took 2031 ms (client timeout 1565 ms). Trace:
W20260709 12:16:53.037896 11520 rpcz_store.cc:269] 0709 12:16:51.005563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:51.005783 (+   220us) service_pool.cc:224] Handling call
0709 12:16:53.037233 (+2031450us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:16:53.038717 11308 debug-util.cc:398] Leaking SignalData structure 0x7b08003ab000 after lost signal to thread 11478
I20260709 12:16:53.039760 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:53.040977 11520 raft_consensus.cc:2468] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 2.
W20260709 12:16:53.041420 11308 debug-util.cc:398] Leaking SignalData structure 0x7b0800260880 after lost signal to thread 11552
I20260709 12:16:53.042481 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:53.042810 11566 leader_election.cc:304] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:16:51.016178 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:53.097191 11519 raft_consensus.cc:2468] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 2.
W20260709 12:16:53.098453 11519 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38272 (request call id 57) took 2089 ms (client timeout 2148 ms). Trace:
I20260709 12:16:51.013972 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:53.109444 11521 raft_consensus.cc:2468] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 1.
W20260709 12:16:53.110117 11521 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38272 (request call id 56) took 2101 ms (client timeout 1865 ms). Trace:
W20260709 12:16:53.110467 11521 rpcz_store.cc:269] 0709 12:16:51.008805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:51.008930 (+   125us) service_pool.cc:224] Handling call
0709 12:16:53.110007 (+2101077us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:53.111802 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:51.008906 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:16:53.115262 11522 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38272 (request call id 55) took 2106 ms (client timeout 1611 ms). Trace:
W20260709 12:16:53.115667 11522 rpcz_store.cc:269] 0709 12:16:51.008527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:51.008657 (+   130us) service_pool.cc:224] Handling call
0709 12:16:53.115080 (+2106423us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:51.026243 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:16:53.119994 11523 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38272 (request call id 58) took 2106 ms (client timeout 1653 ms). Trace:
W20260709 12:16:53.120407 11523 rpcz_store.cc:269] 0709 12:16:51.013124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:51.025869 (+ 12745us) service_pool.cc:224] Handling call
0709 12:16:53.119805 (+2093936us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:51.034469 11594 raft_consensus.cc:2468] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 3.
I20260709 12:16:51.012123 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e4724ed93a467ea47763eec9a6de2e" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:51.028371 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:53.125259 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:16:53.126087 11597 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55250 (request call id 369) took 2118 ms (client timeout 1828 ms). Trace:
I20260709 12:16:51.000764 11600 raft_consensus.cc:2468] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 1.
I20260709 12:16:51.018150 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:51.018671 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:51.085196 12361 raft_consensus.cc:2468] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 3.
W20260709 12:16:52.693738 11419 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.791s	user 0.009s	sys 0.014s
I20260709 12:16:52.772485 12638 leader_election.cc:290] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:51.300412 12657 leader_election.cc:290] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:53.132266 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:51.087911 12665 raft_consensus.cc:515] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:53.135955 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9fe9a94294836aec652338f44367d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:52.973348 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:52.984232 12346 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 513) took 1967 ms. Trace:
I20260709 12:16:53.137969 12346 rpcz_store.cc:276] 0709 12:16:51.016809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:51.021014 (+  4205us) service_pool.cc:224] Handling call
0709 12:16:51.025689 (+  4675us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:51.207857 (+182168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:51.207889 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:51.207938 (+    49us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:16:51.207969 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:52.983644 (+1775675us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b540000c8d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:16:52.983741 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:52.984008 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":418421632}
I20260709 12:16:53.139359 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:53.139950 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:53.140830 12346 raft_consensus.cc:2468] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 1.
W20260709 12:16:53.141827 11419 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.239s	user 0.009s	sys 0.014s
I20260709 12:16:53.142277 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:52.986634 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:16:53.142874 12361 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 508) took 2117 ms (client timeout 1978 ms). Trace:
I20260709 12:16:52.992213 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ed4eeff0ae44d0bc1ebb8cbe3adea5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:16:52.994407 11565 connection.cc:256] RPC call timeout handler was delayed by -1.0130695970001398s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1532s for a response
W20260709 12:16:53.143457 12361 rpcz_store.cc:269] 0709 12:16:51.015077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:51.017490 (+  2413us) service_pool.cc:224] Handling call
0709 12:16:53.132839 (+2115349us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11648}
I20260709 12:16:53.144047 12352 raft_consensus.cc:2468] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 1.
W20260709 12:16:53.145149 11565 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.212.130:41579 timed out after 1.505s (SENT) [suppressed 359 similar messages]
I20260709 12:16:53.146701 11493 leader_election.cc:304] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:53.147176 12665 leader_election.cc:290] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:53.007637 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:53.148206 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:53.148933 12361 raft_consensus.cc:2468] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 1.
I20260709 12:16:53.149346 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:53.141163 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:53.150646 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:53.151093 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:53.151854 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:53.152623 11528 raft_consensus.cc:2468] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 1.
I20260709 12:16:53.152988 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c355b3902a4e7fb72bac6a91ea3316" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:16:53.024652 11418 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.004s	user 0.027s	sys 0.013s
W20260709 12:16:53.156136 11418 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.143s	user 0.028s	sys 0.013s
I20260709 12:16:53.145573 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:53.025214 12680 raft_consensus.cc:493] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:16:53.157847 12680 raft_consensus.cc:515] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:53.157853 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:53.159981 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:53.160856 12352 raft_consensus.cc:2468] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 1.
I20260709 12:16:53.026974 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:16:53.162041 12357 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 516) took 2119 ms (client timeout 2222 ms). Trace:
I20260709 12:16:53.162110 12346 raft_consensus.cc:2468] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 1.
W20260709 12:16:53.162461 12357 rpcz_store.cc:269] 0709 12:16:52.772560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:53.026428 (+253868us) service_pool.cc:224] Handling call
0709 12:16:53.161964 (+135536us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:53.163573 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:53.163847 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:53.164449 12357 raft_consensus.cc:2468] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 1.
I20260709 12:16:53.164608 11528 raft_consensus.cc:2468] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 3.
I20260709 12:16:53.029137 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ed4eeff0ae44d0bc1ebb8cbe3adea5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:53.165980 11527 raft_consensus.cc:2468] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 1.
I20260709 12:16:53.167176 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:53.167706 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:53.167985 11527 raft_consensus.cc:2468] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 1.
I20260709 12:16:53.030663 12683 raft_consensus.cc:493] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
W20260709 12:16:53.044049 11308 debug-util.cc:398] Leaking SignalData structure 0x7b0800394560 after lost signal to thread 11626
I20260709 12:16:53.169937 12683 raft_consensus.cc:515] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
W20260709 12:16:53.171593 11308 debug-util.cc:398] Leaking SignalData structure 0x7b08000d5f60 after lost signal to thread 12405
I20260709 12:16:53.044216 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:53.175186 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:53.176575 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8741606df54c3f8b5cc5c1141862ea" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:53.044394 12681 raft_consensus.cc:2804] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:53.176882 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:53.047816 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:53.177811 12357 raft_consensus.cc:2468] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 2.
I20260709 12:16:53.178406 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:53.178978 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:53.179636 12347 raft_consensus.cc:2468] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 1.
I20260709 12:16:53.180143 12357 raft_consensus.cc:2468] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 4.
I20260709 12:16:53.180727 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:53.061982 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:53.181869 12359 raft_consensus.cc:2468] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 3.
I20260709 12:16:53.169092 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:16:53.064177 11491 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.118s	user 0.014s	sys 0.026s
I20260709 12:16:53.177219 12681 raft_consensus.cc:493] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:53.183480 12681 raft_consensus.cc:3060] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:16:53.183748 11491 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.238s	user 0.015s	sys 0.026s
I20260709 12:16:53.184121 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:16:53.184317 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 2.23837e+06us
I20260709 12:16:53.073757 12679 raft_consensus.cc:493] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:53.074659 12678 raft_consensus.cc:493] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
W20260709 12:16:53.079630 11417 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.517s	user 0.028s	sys 0.069s
I20260709 12:16:53.081353 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:53.081449 11567 leader_election.cc:304] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:53.085667 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:53.087121 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:53.088536 12677 raft_consensus.cc:493] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:16:53.093945 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:53.101558 11596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40784 (request call id 68) took 2094 ms. Trace:
I20260709 12:16:53.105813 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d43eecbad746fd9ddce50c5b9fc3e8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:16:53.107256 12204 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.086s	user 0.012s	sys 0.017s
W20260709 12:16:53.123929 11594 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55250 (request call id 367) took 2169 ms (client timeout 1619 ms). Trace:
I20260709 12:16:53.116775 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:16:53.125325 11595 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55250 (request call id 368) took 2147 ms (client timeout 1522 ms). Trace:
I20260709 12:16:53.126377 11523 raft_consensus.cc:2468] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 3.
W20260709 12:16:53.098857 11519 rpcz_store.cc:269] 0709 12:16:51.009072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:51.015762 (+  6690us) service_pool.cc:224] Handling call
0709 12:16:53.098376 (+2082614us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:16:53.131462 11597 rpcz_store.cc:269] 0709 12:16:51.007750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:51.019826 (+ 12076us) service_pool.cc:224] Handling call
0709 12:16:53.125883 (+2106057us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:16:53.132302 11600 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55250 (request call id 366) took 2188 ms (client timeout 1881 ms). Trace:
I20260709 12:16:53.134238 11602 raft_consensus.cc:2468] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 3.
W20260709 12:16:53.134840 11601 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55250 (request call id 370) took 2117 ms (client timeout 1732 ms). Trace:
I20260709 12:16:53.186026 12679 raft_consensus.cc:515] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:53.207018 12679 leader_election.cc:290] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:53.186409 12678 raft_consensus.cc:515] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:53.210350 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:53.211107 12347 raft_consensus.cc:2468] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 2.
I20260709 12:16:53.211702 12678 leader_election.cc:290] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:53.186203 12680 leader_election.cc:290] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:16:53.186810 11417 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.625s	user 0.029s	sys 0.070s
W20260709 12:16:53.187341 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 106286us
I20260709 12:16:53.188046 12349 raft_consensus.cc:2468] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 2.
I20260709 12:16:53.188325 12593 raft_consensus.cc:2804] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:53.219228 12593 raft_consensus.cc:493] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:16:53.219628 12593 raft_consensus.cc:3060] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:53.188441 12677 raft_consensus.cc:515] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:53.215189 11491 leader_election.cc:304] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:16:53.189800 11596 rpcz_store.cc:276] 0709 12:16:51.007311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:51.021080 (+ 13769us) service_pool.cc:224] Handling call
0709 12:16:51.029187 (+  8107us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:52.547608 (+1518421us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:52.547648 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:52.547699 (+    51us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:52.547736 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:53.100904 (+553168us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b54005bb154. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:16:53.101002 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:53.101319 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3491128192}
I20260709 12:16:53.226400 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9fe9a94294836aec652338f44367d" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:53.227264 11596 raft_consensus.cc:2468] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 1.
I20260709 12:16:53.189646 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:53.228219 11524 raft_consensus.cc:2468] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 3.
W20260709 12:16:53.190524 12204 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.170s	user 0.012s	sys 0.017s
I20260709 12:16:53.190138 12348 raft_consensus.cc:2468] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 3.
W20260709 12:16:53.190681 11594 rpcz_store.cc:269] 0709 12:16:50.954776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:50.975912 (+ 21136us) service_pool.cc:224] Handling call
0709 12:16:53.123707 (+2147795us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:53.231405 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:53.232685 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:53.191047 11522 raft_consensus.cc:2468] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 1.
I20260709 12:16:53.234194 12690 raft_consensus.cc:2804] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:53.236429 12690 raft_consensus.cc:493] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:16:53.236934 12690 raft_consensus.cc:3060] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:16:53.191233 11595 rpcz_store.cc:269] 0709 12:16:50.979450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:51.002789 (+ 23339us) service_pool.cc:224] Handling call
0709 12:16:53.125108 (+2122319us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:53.242723 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:53.243508 11595 raft_consensus.cc:2468] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 2.
I20260709 12:16:53.244561 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:53.168599 12346 raft_consensus.cc:2468] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 1.
W20260709 12:16:53.198946 11600 rpcz_store.cc:269] 0709 12:16:50.943831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:50.943988 (+   157us) service_pool.cc:224] Handling call
0709 12:16:53.132101 (+2188113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:53.246604 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:53.137233 11521 raft_consensus.cc:2468] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 1.
I20260709 12:16:53.014529 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:53.247851 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ed4eeff0ae44d0bc1ebb8cbe3adea5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:53.249565 11594 raft_consensus.cc:2468] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 1.
W20260709 12:16:53.229108 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 2.20826e+06us
W20260709 12:16:53.255118 11493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 108856us
I20260709 12:16:53.256125 11493 leader_election.cc:304] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
W20260709 12:16:53.200302 11602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55250 (request call id 371) took 2182 ms (client timeout 2186 ms). Trace:
W20260709 12:16:53.257326 11602 rpcz_store.cc:269] 0709 12:16:51.017910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:51.018296 (+   386us) service_pool.cc:224] Handling call
0709 12:16:53.200218 (+2181922us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:16:53.259845 12691 raft_consensus.cc:2804] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:53.260460 12691 raft_consensus.cc:493] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
W20260709 12:16:53.200428 11601 rpcz_store.cc:269] 0709 12:16:51.017511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:51.017793 (+   282us) service_pool.cc:224] Handling call
0709 12:16:53.134618 (+2116825us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:16:53.197644 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 75943.3us
I20260709 12:16:53.187695 11526 raft_consensus.cc:2468] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 1.
I20260709 12:16:53.215278 11567 leader_election.cc:304] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
W20260709 12:16:53.264302 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 49126.5us
I20260709 12:16:53.247856 11525 raft_consensus.cc:2468] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 1.
I20260709 12:16:53.224344 12677 leader_election.cc:290] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:53.267035 12680 raft_consensus.cc:2804] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:53.267925 12680 raft_consensus.cc:493] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:16:53.268517 12680 raft_consensus.cc:3060] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:53.260859 12691 raft_consensus.cc:3060] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:53.186542 12683 leader_election.cc:290] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:53.274076 11493 leader_election.cc:304] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:53.147815 12665 raft_consensus.cc:493] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:16:53.154459 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:53.277336 12356 raft_consensus.cc:2468] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 1.
I20260709 12:16:53.277462 12678 raft_consensus.cc:2804] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:53.182799 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffe47647c274723808482c166efa21c" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:53.277994 12678 raft_consensus.cc:493] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:16:53.278426 12678 raft_consensus.cc:3060] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:53.063503 11599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40784 (request call id 69) took 2039 ms. Trace:
I20260709 12:16:53.279958 11599 rpcz_store.cc:276] 0709 12:16:51.023951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:53.061832 (+2037881us) service_pool.cc:224] Handling call
0709 12:16:53.062424 (+   592us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:53.062919 (+   495us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:53.062959 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:53.063041 (+    82us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:16:53.063074 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:53.063140 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:53.063277 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:16:53.068444 12345 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 515) took 2050 ms (client timeout 1957 ms). Trace:
I20260709 12:16:53.228480 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:53.001513 12682 raft_consensus.cc:493] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:16:53.281569 12682 raft_consensus.cc:515] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:53.283565 12665 raft_consensus.cc:515] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:53.284505 12682 leader_election.cc:290] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
W20260709 12:16:53.281157 12345 rpcz_store.cc:269] 0709 12:16:51.020636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:51.022538 (+  1902us) service_pool.cc:224] Handling call
0709 12:16:53.067892 (+2045354us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b5400524254. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:16:53.068162 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":644314496}
W20260709 12:16:53.289909 11491 connection.cc:256] RPC call timeout handler was delayed by -1.0570264689999931s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1522s for a response
W20260709 12:16:53.327791 11491 connection.cc:256] RPC call timeout handler was delayed by -1.0570264689999931s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1522s for a response
W20260709 12:16:53.331158 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 66131.1us
I20260709 12:16:53.202768 12361 raft_consensus.cc:2468] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 1.
I20260709 12:16:53.154325 11598 raft_consensus.cc:2468] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 2.
I20260709 12:16:53.224282 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:53.321585 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390e91331fd04f97a5235133a34875ee" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:53.322427 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:53.323745 12691 raft_consensus.cc:515] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:53.185343 11527 raft_consensus.cc:2468] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 3.
W20260709 12:16:53.337610 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 53514.9us
I20260709 12:16:53.342994 12689 raft_consensus.cc:493] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:16:53.181180 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:53.343716 11567 leader_election.cc:304] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:53.359910 11493 leader_election.cc:304] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:53.199819 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:53.253260 12681 raft_consensus.cc:515] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:53.341164 12638 raft_consensus.cc:2804] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:16:53.370776 11493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 80290.8us
I20260709 12:16:53.325596 12688 raft_consensus.cc:493] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:53.327368 12690 raft_consensus.cc:515] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
W20260709 12:16:53.370000 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 224872us
W20260709 12:16:53.377221 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 124527us
I20260709 12:16:53.370806 11597 raft_consensus.cc:2468] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 2.
I20260709 12:16:53.379026 12686 raft_consensus.cc:493] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:16:53.343884 12689 raft_consensus.cc:515] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
W20260709 12:16:53.406395 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 251727us
I20260709 12:16:53.379554 11593 raft_consensus.cc:2393] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 3: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:16:53.413687 11493 leader_election.cc:304] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:53.448572 12665 leader_election.cc:290] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:53.380165 12681 leader_election.cc:290] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:53.442795 12638 raft_consensus.cc:493] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:16:53.382380 12680 raft_consensus.cc:515] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:53.470432 12690 leader_election.cc:290] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:53.469549 12638 raft_consensus.cc:3060] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:53.471407 12680 leader_election.cc:290] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:53.441871 12692 raft_consensus.cc:493] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
W20260709 12:16:53.472306 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 96570.4us
W20260709 12:16:53.474867 11493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 100596us
I20260709 12:16:53.472277 12593 raft_consensus.cc:515] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:53.476270 12690 raft_consensus.cc:2804] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:53.476963 11567 leader_election.cc:304] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:53.380775 12691 leader_election.cc:290] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:53.406174 12696 raft_consensus.cc:2804] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:53.406761 12697 raft_consensus.cc:2804] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:53.452577 12678 raft_consensus.cc:515] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:53.433116 12688 raft_consensus.cc:515] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:53.493366 12678 leader_election.cc:290] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:53.493644 12688 leader_election.cc:290] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:53.494230 12204 leader_election.cc:304] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:53.487569 12690 raft_consensus.cc:493] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:16:53.494968 12690 raft_consensus.cc:3060] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:53.495411 12684 raft_consensus.cc:2804] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:53.495889 12684 raft_consensus.cc:493] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:16:53.496286 12684 raft_consensus.cc:3060] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:53.498747 11567 leader_election.cc:304] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:53.499600 12683 raft_consensus.cc:2804] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:53.500679 12683 raft_consensus.cc:493] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:16:53.501111 12683 raft_consensus.cc:3060] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:53.501853 12692 raft_consensus.cc:515] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:53.501984 12638 raft_consensus.cc:515] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:53.494357 12593 leader_election.cc:290] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:53.504261 12638 leader_election.cc:290] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:53.504379 12692 leader_election.cc:290] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:53.505182 12680 raft_consensus.cc:2804] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:53.495581 12204 leader_election.cc:304] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
W20260709 12:16:53.506299 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 124813us
I20260709 12:16:53.488051 12686 raft_consensus.cc:515] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:53.510842 12665 raft_consensus.cc:493] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:16:53.511901 12686 leader_election.cc:290] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:53.508212 12680 raft_consensus.cc:493] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:16:53.512773 12680 raft_consensus.cc:3060] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:53.508039 11567 leader_election.cc:304] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:53.514586 11567 leader_election.cc:304] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:53.515620 11567 leader_election.cc:304] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:53.516798 12681 raft_consensus.cc:2804] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:53.517218 12681 raft_consensus.cc:493] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:16:53.517642 12681 raft_consensus.cc:3060] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:53.511637 12665 raft_consensus.cc:515] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:53.520449 12686 raft_consensus.cc:493] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:16:53.523033 12703 raft_consensus.cc:493] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:53.524103 12695 raft_consensus.cc:2804] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:53.523977 12703 raft_consensus.cc:515] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:53.524617 12695 raft_consensus.cc:493] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:16:53.524926 12686 raft_consensus.cc:515] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:53.526470 12703 leader_election.cc:290] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:53.527135 12703 raft_consensus.cc:493] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:53.527556 12686 leader_election.cc:290] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:53.527693 12703 raft_consensus.cc:515] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:53.530201 12703 leader_election.cc:290] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:53.531199 11566 leader_election.cc:304] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:16:53.531518 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ed4eeff0ae44d0bc1ebb8cbe3adea5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:53.532505 12694 raft_consensus.cc:2804] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:53.532966 12694 raft_consensus.cc:493] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:53.533421 12694 raft_consensus.cc:3060] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:53.533867 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:53.534907 12665 leader_election.cc:290] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:53.535787 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c355b3902a4e7fb72bac6a91ea3316" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:53.536075 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:53.535668 12700 raft_consensus.cc:2804] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:53.536780 12700 raft_consensus.cc:493] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:16:53.537241 12700 raft_consensus.cc:3060] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:53.538957 11598 raft_consensus.cc:1240] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:53.540663 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:53.542373 11567 leader_election.cc:304] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:53.543253 12682 raft_consensus.cc:2804] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:53.543658 12682 raft_consensus.cc:493] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:16:53.544008 12682 raft_consensus.cc:3060] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:53.493605 12699 raft_consensus.cc:493] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:16:53.546444 12699 raft_consensus.cc:515] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:53.518617 12692 raft_consensus.cc:493] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:53.525121 12695 raft_consensus.cc:3060] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:53.548892 12692 raft_consensus.cc:515] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:53.551494 12692 leader_election.cc:290] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:53.553668 12682 raft_consensus.cc:515] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:53.505146 12689 leader_election.cc:290] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:53.489676 12696 raft_consensus.cc:493] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1c101e338f954ef086338e251deed19d)
W20260709 12:16:53.559329 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 69005.2us
I20260709 12:16:53.548974 12699 leader_election.cc:290] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
W20260709 12:16:53.560632 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 65190us
I20260709 12:16:53.561280 12693 raft_consensus.cc:2804] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:53.571434 12703 raft_consensus.cc:493] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:16:53.572822 12693 raft_consensus.cc:493] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:16:53.489588 12697 raft_consensus.cc:493] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:16:53.573146 12703 raft_consensus.cc:515] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:53.573338 12693 raft_consensus.cc:3060] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:53.575521 12703 leader_election.cc:290] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:53.572178 12696 raft_consensus.cc:3060] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:53.577540 12682 leader_election.cc:290] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:53.568077 12665 raft_consensus.cc:493] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:16:53.571674 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:53.573622 12697 raft_consensus.cc:3060] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:53.586046 11526 raft_consensus.cc:3060] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:53.562608 12690 raft_consensus.cc:515] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:53.590423 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:53.591671 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:53.591439 12694 raft_consensus.cc:515] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:53.588940 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:53.592485 11523 raft_consensus.cc:2393] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 2: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:16:53.595880 12695 raft_consensus.cc:515] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:53.577780 12204 leader_election.cc:304] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:53.598114 12695 leader_election.cc:290] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:53.598526 12667 raft_consensus.cc:2804] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:53.593003 12665 raft_consensus.cc:515] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:53.599912 12204 leader_election.cc:304] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:53.600998 12685 raft_consensus.cc:2804] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:53.601413 12685 raft_consensus.cc:493] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:16:53.601783 12685 raft_consensus.cc:3060] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:53.604295 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.605603 12665 leader_election.cc:290] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:53.583880 12683 raft_consensus.cc:515] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:53.565676 11493 leader_election.cc:304] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:16:53.589722 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:53.589874 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:53.608608 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.608907 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.609282 12694 leader_election.cc:290] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:53.611265 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.613590 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e4724ed93a467ea47763eec9a6de2e" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.614221 11452 raft_consensus.cc:2468] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 1.
I20260709 12:16:53.614950 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:53.616608 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:53.618376 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9fe9a94294836aec652338f44367d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:53.619182 11528 raft_consensus.cc:2468] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 1.
I20260709 12:16:53.618873 12696 raft_consensus.cc:515] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:53.620307 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:53.620918 11523 raft_consensus.cc:2468] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 3.
I20260709 12:16:53.621930 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.622354 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:53.622572 11450 raft_consensus.cc:2468] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 1.
I20260709 12:16:53.622977 11525 raft_consensus.cc:2468] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 3.
I20260709 12:16:53.592352 12690 leader_election.cc:290] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:53.598990 12667 raft_consensus.cc:493] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:16:53.624219 12667 raft_consensus.cc:3060] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:53.624403 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.625144 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.577801 12703 raft_consensus.cc:493] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:16:53.580574 12680 raft_consensus.cc:515] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:53.606997 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.625737 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.581847 12684 raft_consensus.cc:515] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:53.645624 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:53.653337 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:53.654053 12348 raft_consensus.cc:3060] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:53.569625 12681 raft_consensus.cc:515] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:53.656167 12681 leader_election.cc:290] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:53.657073 11598 raft_consensus.cc:2393] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 3: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:16:53.657972 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:53.658830 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:53.660059 11598 raft_consensus.cc:2393] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 4: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
W20260709 12:16:53.638213 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 52227us
I20260709 12:16:53.662772 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:53.663450 12359 raft_consensus.cc:3060] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:53.665774 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:53.654023 11594 raft_consensus.cc:3060] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:53.672206 12697 raft_consensus.cc:515] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:53.674810 12697 leader_election.cc:290] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:53.683813 12700 raft_consensus.cc:515] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:53.639441 11526 raft_consensus.cc:2468] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 3.
I20260709 12:16:53.625061 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9fe9a94294836aec652338f44367d" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.697434 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:53.697751 12707 raft_consensus.cc:493] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:53.698312 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.698318 12707 raft_consensus.cc:515] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:53.699738 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.700989 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e4724ed93a467ea47763eec9a6de2e" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.640247 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:53.701713 11447 raft_consensus.cc:2468] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 1.
I20260709 12:16:53.701912 11595 raft_consensus.cc:2393] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 4: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:16:53.702709 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.702837 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e4724ed93a467ea47763eec9a6de2e" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:53.640602 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.640878 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:53.640630 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:53.704113 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.704741 11593 raft_consensus.cc:2393] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 3: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:16:53.641450 11448 raft_consensus.cc:2468] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 1.
W20260709 12:16:53.641906 11493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 76358.6us
I20260709 12:16:53.642241 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:53.705489 11525 raft_consensus.cc:2468] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 1.
I20260709 12:16:53.705577 11493 leader_election.cc:304] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:53.704109 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:53.642432 12690 raft_consensus.cc:2804] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:53.642844 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8741606df54c3f8b5cc5c1141862ea" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:53.707086 12690 raft_consensus.cc:493] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:16:53.643422 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:53.706833 11593 raft_consensus.cc:1240] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:53.707801 11524 raft_consensus.cc:2468] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 3.
I20260709 12:16:53.707763 12697 raft_consensus.cc:2804] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:53.705677 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.707491 12690 raft_consensus.cc:3060] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:53.644357 11522 raft_consensus.cc:1240] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:53.708666 12697 raft_consensus.cc:493] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:16:53.621093 12696 leader_election.cc:290] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:53.644940 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ed4eeff0ae44d0bc1ebb8cbe3adea5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:53.709589 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:53.709834 12697 raft_consensus.cc:3060] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:53.710760 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.687835 12684 leader_election.cc:290] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:53.711809 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.712371 11448 raft_consensus.cc:2468] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 2.
I20260709 12:16:53.645253 12680 leader_election.cc:290] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:53.645741 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.625929 11446 raft_consensus.cc:2468] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 1.
I20260709 12:16:53.713762 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.714043 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d43eecbad746fd9ddce50c5b9fc3e8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.647614 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:53.714448 11454 raft_consensus.cc:2468] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 1.
I20260709 12:16:53.648248 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:53.648663 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a841f2f09ced40a4bbf33594e11bd7ad" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:53.715435 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.648914 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7937e0cff84ef7a26c84247c8ffc08" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:53.649657 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:53.716562 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9fe9a94294836aec652338f44367d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.717152 11602 raft_consensus.cc:2393] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 2: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:16:53.650373 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.708626 12707 leader_election.cc:290] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:53.718123 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.718581 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:53.719242 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9fe9a94294836aec652338f44367d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.719727 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.720275 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.720819 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.651096 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d43eecbad746fd9ddce50c5b9fc3e8" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:53.651590 11567 leader_election.cc:304] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:53.722077 11599 raft_consensus.cc:2393] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 4: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
W20260709 12:16:53.722298 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 70820.3us
I20260709 12:16:53.722798 11451 raft_consensus.cc:2468] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 3.
I20260709 12:16:53.724310 12696 raft_consensus.cc:2749] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:53.691901 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:53.726768 11597 raft_consensus.cc:1240] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:53.726889 12690 raft_consensus.cc:515] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:53.721283 12697 raft_consensus.cc:515] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:53.729709 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:53.730417 12356 raft_consensus.cc:3060] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:53.704790 11447 raft_consensus.cc:2468] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 2.
I20260709 12:16:53.732370 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:53.732707 11601 raft_consensus.cc:1240] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:53.733111 12700 leader_election.cc:290] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:53.733682 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8741606df54c3f8b5cc5c1141862ea" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.717669 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.734519 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:53.734910 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.730576 12204 leader_election.cc:304] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:53.735838 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:16:53.736388 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 47933.3us
I20260709 12:16:53.730345 11602 raft_consensus.cc:1240] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:53.737087 12204 leader_election.cc:304] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:53.738068 12204 leader_election.cc:304] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:53.738231 11601 raft_consensus.cc:1240] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:53.739415 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.695030 12359 raft_consensus.cc:2468] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 2.
I20260709 12:16:53.625833 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.706813 11493 leader_election.cc:304] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:53.628906 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:53.643899 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.707808 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.644223 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.723017 12707 raft_consensus.cc:493] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:16:53.652047 12703 raft_consensus.cc:515] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:53.723943 12702 raft_consensus.cc:493] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:53.724187 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.652652 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:53.744937 11567 leader_election.cc:304] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:53.746730 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d43eecbad746fd9ddce50c5b9fc3e8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:53.744973 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:53.745316 12348 raft_consensus.cc:2468] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 3.
I20260709 12:16:53.751439 12349 raft_consensus.cc:3060] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:53.721320 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.752424 11567 leader_election.cc:304] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:53.745930 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.752827 11454 raft_consensus.cc:2468] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 2.
I20260709 12:16:53.755771 12680 raft_consensus.cc:2804] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:53.746234 12593 raft_consensus.cc:2804] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:53.746215 11445 raft_consensus.cc:2468] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 1.
I20260709 12:16:53.756415 12680 raft_consensus.cc:697] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:53.746501 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.758034 12696 raft_consensus.cc:2804] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:53.748577 12702 raft_consensus.cc:515] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:53.758543 12696 raft_consensus.cc:697] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:53.759768 12677 raft_consensus.cc:2804] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:53.750265 11453 raft_consensus.cc:2468] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 2.
I20260709 12:16:53.757318 11449 raft_consensus.cc:2468] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 3.
I20260709 12:16:53.746444 12707 raft_consensus.cc:515] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:53.760203 12593 raft_consensus.cc:493] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:16:53.761271 12593 raft_consensus.cc:3060] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:53.759572 12696 consensus_queue.cc:237] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:53.748265 12703 leader_election.cc:290] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:53.766626 11448 raft_consensus.cc:2468] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 3.
I20260709 12:16:53.756155 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:53.780454 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a841f2f09ced40a4bbf33594e11bd7ad" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:53.781124 11566 leader_election.cc:304] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:53.782474 12356 raft_consensus.cc:2468] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 3.
I20260709 12:16:53.784451 11567 leader_election.cc:304] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:53.757740 12680 consensus_queue.cc:237] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:53.789851 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9fe9a94294836aec652338f44367d" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.746838 12684 raft_consensus.cc:2804] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:53.791857 12349 raft_consensus.cc:2468] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 4.
I20260709 12:16:53.771117 12677 raft_consensus.cc:493] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:16:53.773003 12667 raft_consensus.cc:515] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:53.795537 12681 raft_consensus.cc:2749] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:16:53.795924 11567 leader_election.cc:304] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:53.802448 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:53.803000 11519 raft_consensus.cc:1240] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:53.803133 11528 raft_consensus.cc:2468] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 2.
I20260709 12:16:53.803586 11566 leader_election.cc:304] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:16:53.802902 12681 raft_consensus.cc:2804] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:53.687549 12685 raft_consensus.cc:515] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:53.796669 11520 raft_consensus.cc:1240] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:53.799448 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:53.795590 12695 raft_consensus.cc:2804] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:53.798650 11594 raft_consensus.cc:2468] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 2.
I20260709 12:16:53.791347 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.794498 12684 raft_consensus.cc:493] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:16:53.796690 12677 raft_consensus.cc:3060] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:53.821969 12593 raft_consensus.cc:515] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:53.822552 12684 raft_consensus.cc:3060] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:53.823581 12683 leader_election.cc:290] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:53.796602 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.824745 11447 raft_consensus.cc:2468] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 2.
I20260709 12:16:53.822585 11452 raft_consensus.cc:2468] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 2.
I20260709 12:16:53.825989 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.806978 12681 raft_consensus.cc:697] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:53.826356 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffe47647c274723808482c166efa21c" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.826704 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.827143 11452 raft_consensus.cc:2468] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 2.
I20260709 12:16:53.827291 12681 consensus_queue.cc:237] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:53.827848 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.828083 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.828766 11452 raft_consensus.cc:2468] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 2.
I20260709 12:16:53.794199 12690 leader_election.cc:290] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:53.818100 11600 raft_consensus.cc:1240] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:53.805541 12667 leader_election.cc:290] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:53.818101 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.819128 11565 leader_election.cc:304] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:53.835428 11453 raft_consensus.cc:2468] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 1.
I20260709 12:16:53.819923 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:53.820521 11597 raft_consensus.cc:1240] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 LEADER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:53.839737 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.824782 12702 leader_election.cc:290] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:53.815409 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.841563 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:53.819028 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:53.824870 12657 raft_consensus.cc:2804] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:53.842741 12657 raft_consensus.cc:493] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:16:53.843155 12657 raft_consensus.cc:3060] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:53.843607 11528 raft_consensus.cc:1240] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:53.843932 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390e91331fd04f97a5235133a34875ee" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.844290 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.846814 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.847482 11453 raft_consensus.cc:2468] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 2.
I20260709 12:16:53.847749 12685 leader_election.cc:290] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:53.850194 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:53.850407 12693 raft_consensus.cc:515] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:53.851768 12657 raft_consensus.cc:515] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:53.852694 12693 leader_election.cc:290] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:53.854024 12657 leader_election.cc:290] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:53.854586 11528 raft_consensus.cc:1240] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:53.855995 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:53.857566 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:53.831331 12707 leader_election.cc:290] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
W20260709 12:16:53.792886 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 106293us
I20260709 12:16:53.832276 12593 leader_election.cc:290] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:53.828943 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8741606df54c3f8b5cc5c1141862ea" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.860069 11528 raft_consensus.cc:1240] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:53.860996 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.861727 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.862311 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.836687 11519 raft_consensus.cc:2468] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 2.
I20260709 12:16:53.862610 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:53.863147 11449 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215"
dest_uuid: "1c101e338f954ef086338e251deed19d"
mode: GRACEFUL
new_leader_uuid: "b126028166e8480ba25541bf8f7fc6de"
 from {username='slave'} at 127.0.0.1:50370
I20260709 12:16:53.863932 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.864177 11449 raft_consensus.cc:606] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 2 LEADER]: Received request to transfer leadership to TS b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:53.864543 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:53.865199 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.865458 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.838796 12701 raft_consensus.cc:2804] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:53.842341 11520 raft_consensus.cc:1240] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:53.857630 12349 raft_consensus.cc:1240] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:53.872030 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.858414 11493 leader_election.cc:304] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:53.836854 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.866366 11523 raft_consensus.cc:1240] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:53.866884 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.860890 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.845185 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.830787 12684 raft_consensus.cc:515] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:53.872051 12701 raft_consensus.cc:493] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:16:53.875720 12695 raft_consensus.cc:697] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:53.877174 12683 raft_consensus.cc:2749] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:53.884964 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.885299 12683 consensus_queue.cc:1059] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:53.886655 12683 raft_consensus.cc:3055] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:53.887048 12683 raft_consensus.cc:740] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:53.887773 12707 consensus_queue.cc:1059] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:16:53.878047 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 59077.3us
I20260709 12:16:53.878712 12593 raft_consensus.cc:2804] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:53.888796 12593 raft_consensus.cc:493] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:16:53.889221 12593 raft_consensus.cc:3060] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:53.889442 12701 raft_consensus.cc:3060] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:53.890576 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ed4eeff0ae44d0bc1ebb8cbe3adea5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:53.890911 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:53.891433 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:53.892241 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:53.893086 11594 raft_consensus.cc:2393] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 3: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:16:53.893327 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.893676 12702 raft_consensus.cc:3055] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:53.894095 12702 raft_consensus.cc:740] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:16:53.888309 12683 consensus_queue.cc:260] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:53.902021 12683 raft_consensus.cc:3060] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:53.836211 12697 leader_election.cc:290] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:53.881047 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
W20260709 12:16:53.881409 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 87369.7us
I20260709 12:16:53.881335 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:53.881824 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.895010 12702 consensus_queue.cc:260] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
W20260709 12:16:53.879145 11493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 44551.7us
I20260709 12:16:53.897755 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a841f2f09ced40a4bbf33594e11bd7ad" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.885224 12695 consensus_queue.cc:237] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:53.898356 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.902850 11565 leader_election.cc:304] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:53.880244 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.910990 12347 raft_consensus.cc:1240] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:53.911595 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:53.915642 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:53.916735 11566 leader_election.cc:304] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
W20260709 12:16:53.923861 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 185900us
I20260709 12:16:53.916663 12356 raft_consensus.cc:3060] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:53.922343 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.914693 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8741606df54c3f8b5cc5c1141862ea" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:53.913519 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:53.938967 12203 leader_election.cc:304] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:53.914963 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d43eecbad746fd9ddce50c5b9fc3e8" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.941607 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:53.921625 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:53.922665 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7937e0cff84ef7a26c84247c8ffc08" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.943111 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.923259 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.912993 12684 leader_election.cc:290] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:53.945030 12708 consensus_queue.cc:1059] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:53.946110 12708 raft_consensus.cc:3055] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:53.946429 12708 raft_consensus.cc:740] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:16:53.947204 12708 consensus_queue.cc:260] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:53.948464 12708 raft_consensus.cc:3060] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:53.949816 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:53.950765 11519 raft_consensus.cc:2393] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 2: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:16:53.951785 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:53.952368 11600 raft_consensus.cc:1240] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:53.957161 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:53.958981 12356 raft_consensus.cc:2468] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 4.
I20260709 12:16:53.959187 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:53.910296 12707 consensus_queue.cc:1059] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 12:16:53.921990 12702 raft_consensus.cc:3060] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:53.963147 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:16:53.963713 12401 debug-util.cc:398] Leaking SignalData structure 0x7b0800081b20 after lost signal to thread 3922
W20260709 12:16:54.062203 12401 debug-util.cc:398] Leaking SignalData structure 0x7b080013bd80 after lost signal to thread 3925
I20260709 12:16:54.062431 11524 raft_consensus.cc:2393] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 2: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
W20260709 12:16:54.063380 12401 debug-util.cc:398] Leaking SignalData structure 0x7b0800331de0 after lost signal to thread 11311
I20260709 12:16:54.063616 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:54.064670 11602 raft_consensus.cc:2393] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 3: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
W20260709 12:16:54.064924 12401 debug-util.cc:398] Leaking SignalData structure 0x7b0800333780 after lost signal to thread 11478
W20260709 12:16:54.066399 12401 debug-util.cc:398] Leaking SignalData structure 0x7b080017a8e0 after lost signal to thread 11552
W20260709 12:16:54.067754 12401 debug-util.cc:398] Leaking SignalData structure 0x7b08003bd400 after lost signal to thread 11626
I20260709 12:16:54.067867 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
W20260709 12:16:54.069041 12401 debug-util.cc:398] Leaking SignalData structure 0x7b08000ce680 after lost signal to thread 12405
I20260709 12:16:53.952171 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:53.963212 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:53.898428 12677 raft_consensus.cc:515] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
W20260709 12:16:54.069350 12401 debug-util.cc:398] Leaking SignalData structure 0x7b0800200780 after lost signal to thread 12407
I20260709 12:16:53.961056 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:16:54.070521 11420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:53.962621 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:53.966111 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ed4eeff0ae44d0bc1ebb8cbe3adea5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:53.962384 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:53.968930 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:54.072872 11523 raft_consensus.cc:2393] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 2: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:16:53.976289 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:53.907668 12593 raft_consensus.cc:515] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:53.917201 12701 raft_consensus.cc:515] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:53.979256 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:54.055374 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:54.073429 12677 leader_election.cc:290] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:54.055707 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
W20260709 12:16:54.077579 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 138662us
I20260709 12:16:54.077768 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e4724ed93a467ea47763eec9a6de2e" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:54.055998 12684 raft_consensus.cc:2749] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:54.056809 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:54.057482 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:54.057574 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:53.965052 11493 leader_election.cc:304] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:54.058576 12703 raft_consensus.cc:3055] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:54.059221 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:54.059773 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:54.059520 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:54.084909 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:53.960502 12700 raft_consensus.cc:2749] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:16:54.061425 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 144750us
I20260709 12:16:54.088615 12203 leader_election.cc:304] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:54.089267 11566 leader_election.cc:304] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:54.075148 11567 leader_election.cc:304] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:54.079592 11522 raft_consensus.cc:2393] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 5: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:16:54.086881 12349 raft_consensus.cc:1240] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:54.058713 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:54.088387 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
W20260709 12:16:54.090530 11493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 150436us
W20260709 12:16:54.092590 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 189800us
I20260709 12:16:54.093706 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:54.096076 11525 raft_consensus.cc:2393] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 2: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:16:54.080965 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:54.085021 12703 raft_consensus.cc:740] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:16:54.097975 12709 raft_consensus.cc:3060] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:54.094763 12697 raft_consensus.cc:2804] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:54.093267 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:54.098489 12696 raft_consensus.cc:2804] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:16:54.100487 11417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:54.099150 11565 leader_election.cc:304] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:54.109736 12356 raft_consensus.cc:1240] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:54.101521  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:16:54.101246 12680 raft_consensus.cc:2804] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:54.105922 11493 leader_election.cc:304] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:54.104852 12593 leader_election.cc:290] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:54.114358 12680 raft_consensus.cc:493] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:54.112771 12696 raft_consensus.cc:697] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 4 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:54.114941 12680 raft_consensus.cc:3060] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:54.102293 12701 leader_election.cc:290] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:54.119601 12696 consensus_queue.cc:237] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:54.120476  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:54.122080  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:54.111045 12713 consensus_queue.cc:1059] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:16:54.124903 12713 raft_consensus.cc:3055] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:54.125278 12713 raft_consensus.cc:740] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:16:54.126178 12713 consensus_queue.cc:260] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:54.109747 12697 raft_consensus.cc:493] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:16:54.122735 12593 raft_consensus.cc:2804] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:54.104394 12714 raft_consensus.cc:2804] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:54.127296 12593 raft_consensus.cc:493] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:16:54.127637 12714 raft_consensus.cc:493] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:54.123556 11493 leader_election.cc:304] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:54.127874 12593 raft_consensus.cc:3060] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:54.127210 12697 raft_consensus.cc:3060] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:54.122730 12703 consensus_queue.cc:260] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:54.128847 11601 raft_consensus.cc:2468] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 2.
I20260709 12:16:54.129364 12703 raft_consensus.cc:3060] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:54.128063 12714 raft_consensus.cc:3060] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:54.110630 12638 consensus_queue.cc:1059] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:16:54.137971 12349 raft_consensus.cc:1240] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:54.108011 11418 leader_election.cc:304] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:16:54.140508 12347 raft_consensus.cc:1240] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:54.141072 12713 raft_consensus.cc:3060] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:54.140523 12349 raft_consensus.cc:1240] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:54.143471 12690 raft_consensus.cc:2804] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:54.143944 12690 raft_consensus.cc:493] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:16:54.144327 12690 raft_consensus.cc:3060] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:16:54.145536 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 51149.3us
I20260709 12:16:54.146445 11565 leader_election.cc:304] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:54.147240 12705 raft_consensus.cc:2804] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:54.147699 12705 raft_consensus.cc:493] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:54.148066 12705 raft_consensus.cc:3060] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:54.153664 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:54.158546 12680 raft_consensus.cc:515] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:54.159437 12709 raft_consensus.cc:2749] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:16:54.160343 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 59350.3us
I20260709 12:16:54.161192 12349 raft_consensus.cc:1240] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:54.161711 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:54.162012 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:54.162557 12347 raft_consensus.cc:1240] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:54.161322 12705 raft_consensus.cc:515] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:54.163897 12348 raft_consensus.cc:1240] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:54.164197 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:54.165004 12708 consensus_queue.cc:1059] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:54.166596 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:54.170146 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ed4eeff0ae44d0bc1ebb8cbe3adea5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:54.172506 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:54.174031 12681 raft_consensus.cc:2804] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:54.174659 12681 raft_consensus.cc:493] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:54.175076 12681 raft_consensus.cc:3060] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:54.176397 12705 leader_election.cc:290] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:54.177107 12705 consensus_queue.cc:1059] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:54.179114 12680 leader_election.cc:290] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:54.180673 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffe47647c274723808482c166efa21c" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:54.180931 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:54.181648 12701 raft_consensus.cc:2749] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:54.182392 12701 consensus_queue.cc:1059] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:54.182662 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:16:54.183399 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 71200.8us
I20260709 12:16:54.183794 12683 raft_consensus.cc:3055] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:16:54.193655 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 77302.1us
W20260709 12:16:54.183956 11568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:54.196285 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:54.198673 12349 raft_consensus.cc:2393] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 2: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:16:54.199725 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a841f2f09ced40a4bbf33594e11bd7ad" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:54.202505 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:54.203357 12356 raft_consensus.cc:3060] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:54.202272 12348 raft_consensus.cc:1240] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:54.194988 12683 raft_consensus.cc:740] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:54.207069 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
W20260709 12:16:54.202090 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 85909.4us
I20260709 12:16:54.207803 11565 leader_election.cc:304] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:54.208433 11566 leader_election.cc:304] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d
I20260709 12:16:54.209708 12349 raft_consensus.cc:2393] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 2: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:16:54.149144 12714 raft_consensus.cc:515] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:54.210839 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:54.159448 12697 raft_consensus.cc:515] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:54.215174 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:54.204537 12700 raft_consensus.cc:3055] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:54.215363 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:54.215822 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:54.216562 12203 leader_election.cc:304] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:54.217180 11566 leader_election.cc:304] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d
I20260709 12:16:54.217519 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:54.217972 12719 raft_consensus.cc:3055] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:54.225314 12697 leader_election.cc:290] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:54.225591 12701 raft_consensus.cc:2804] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:54.241490 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:54.216418 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:54.243646 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7937e0cff84ef7a26c84247c8ffc08" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:54.226536 12690 raft_consensus.cc:515] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:54.220731 12681 raft_consensus.cc:515] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:54.229274 12348 raft_consensus.cc:2393] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 2: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:16:54.231932 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:54.232280 12683 consensus_queue.cc:260] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:54.227506 12700 raft_consensus.cc:740] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:54.232928 12352 raft_consensus.cc:1240] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:54.237944 12677 raft_consensus.cc:2749] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:54.253074 12680 raft_consensus.cc:2749] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:54.260583 11418 leader_election.cc:304] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:54.228942 12719 raft_consensus.cc:740] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:16:54.261549 12703 consensus_queue.cc:1059] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:54.238333 12698 consensus_queue.cc:1059] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:54.239756 12203 leader_election.cc:304] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:16:54.240422 12593 raft_consensus.cc:515] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:54.237238 12356 raft_consensus.cc:2468] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 2.
I20260709 12:16:54.248284 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:54.248358 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:54.253798 12204 leader_election.cc:304] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:54.255659 11493 leader_election.cc:304] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:54.252880 12696 raft_consensus.cc:2804] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:54.241503 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:54.276633 12347 raft_consensus.cc:3060] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:16:54.275311 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 45618.7us
I20260709 12:16:54.278421 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:54.279201 12690 leader_election.cc:290] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:54.279740 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:54.280957 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:54.282061 12349 raft_consensus.cc:1240] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:54.282660 12700 consensus_queue.cc:260] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:54.283280 12349 raft_consensus.cc:1240] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:54.283648 11450 raft_consensus.cc:2468] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 3.
I20260709 12:16:54.283968 12700 raft_consensus.cc:3060] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:54.285524 12696 raft_consensus.cc:493] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:16:54.285986 12696 raft_consensus.cc:3060] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:54.286645 12707 raft_consensus.cc:3055] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:54.287037 12707 raft_consensus.cc:740] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:16:54.287135 11565 leader_election.cc:304] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:54.287529 12346 raft_consensus.cc:2393] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 2: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:16:54.288390 11565 leader_election.cc:304] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:54.288676 12683 raft_consensus.cc:3060] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:54.289239 12682 raft_consensus.cc:2749] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:54.265761 12695 consensus_queue.cc:1059] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:16:54.290592 12695 raft_consensus.cc:3055] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:54.290953 12695 raft_consensus.cc:740] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:54.291826 12695 consensus_queue.cc:260] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:54.293040 12695 raft_consensus.cc:3060] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:54.278568 12718 raft_consensus.cc:2749] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:54.262185 12719 consensus_queue.cc:260] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:54.294699 12719 raft_consensus.cc:3060] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:54.295792 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ed4eeff0ae44d0bc1ebb8cbe3adea5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:54.296495 11594 raft_consensus.cc:2376] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 2. Re-sending same reply.
I20260709 12:16:54.296762 11601 raft_consensus.cc:1240] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:54.297971 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:54.298224 12708 consensus_queue.cc:1059] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:54.298827 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:16:54.300160 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 83027us
W20260709 12:16:54.301139 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 47420.5us
I20260709 12:16:54.301095 11566 leader_election.cc:304] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:54.288722 12347 raft_consensus.cc:2468] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 2.
I20260709 12:16:54.303117 12349 raft_consensus.cc:1240] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:54.297798 12698 raft_consensus.cc:2749] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:16:54.308471 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 64741.4us
I20260709 12:16:54.263522 12701 raft_consensus.cc:697] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:54.311780 12204 leader_election.cc:304] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:54.308732 12709 raft_consensus.cc:2749] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:54.313032 12204 leader_election.cc:304] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:54.314009 11599 raft_consensus.cc:1240] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:54.314563 12707 consensus_queue.cc:260] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:54.315534 12684 raft_consensus.cc:3060] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:54.315964 12707 raft_consensus.cc:3060] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:54.316565 12714 leader_election.cc:290] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:54.313032 12685 raft_consensus.cc:2749] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:16:54.314986 12204 leader_election.cc:304] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:54.317420 12682 raft_consensus.cc:2804] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:54.317849 12701 consensus_queue.cc:237] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:54.318790 11566 leader_election.cc:304] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:54.319671 12694 raft_consensus.cc:2749] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:54.320194 12685 raft_consensus.cc:3060] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:54.320340 12694 raft_consensus.cc:2804] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:54.320823 12694 raft_consensus.cc:493] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:54.321200 12694 raft_consensus.cc:3060] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:54.313114 12693 raft_consensus.cc:2749] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:54.317876 12682 raft_consensus.cc:493] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:54.322357 12682 raft_consensus.cc:3060] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:54.323133 12681 leader_election.cc:290] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:54.326877 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:54.329811 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:54.318893 12696 raft_consensus.cc:515] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:54.334658 12204 leader_election.cc:304] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:54.335318 12696 leader_election.cc:290] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:54.335474 12693 raft_consensus.cc:2749] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:54.329140 12694 raft_consensus.cc:515] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:54.336360 11418 leader_election.cc:304] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:16:54.334429 12720 consensus_queue.cc:1059] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:54.357796 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
W20260709 12:16:54.358268 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 118578us
I20260709 12:16:54.357553 12359 raft_consensus.cc:1275] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:16:54.362896 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 74562.3us
I20260709 12:16:54.365700 12683 consensus_queue.cc:1048] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:54.338287 12694 leader_election.cc:290] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:54.335736 12593 leader_election.cc:290] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:54.377869 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:54.363809 11565 leader_election.cc:304] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: b126028166e8480ba25541bf8f7fc6de
W20260709 12:16:54.380053 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 58743.3us
I20260709 12:16:54.380857 11566 leader_election.cc:304] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:54.382908 12203 leader_election.cc:304] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
W20260709 12:16:54.380311 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 118060us
I20260709 12:16:54.385818 11566 leader_election.cc:304] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:54.375320 12684 raft_consensus.cc:2749] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:54.387862 11566 leader_election.cc:304] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
W20260709 12:16:54.388940 11493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 89763.4us
I20260709 12:16:54.383839 12678 raft_consensus.cc:3055] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:54.387362 12694 raft_consensus.cc:2804] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:54.403832 12345 raft_consensus.cc:1275] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:54.398411 12708 consensus_queue.cc:1059] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:54.398952 11522 raft_consensus.cc:1240] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:54.399444 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9fe9a94294836aec652338f44367d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:54.400290 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:54.400854 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:54.400982 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:54.402966 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:54.386885 12714 raft_consensus.cc:2749] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:16:54.396414 11493 leader_election.cc:304] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:54.389977 12681 raft_consensus.cc:2749] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:16:54.411732 12705 raft_consensus.cc:3055] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:54.394616 12678 raft_consensus.cc:740] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:16:54.405015 12694 raft_consensus.cc:493] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:54.412698 12678 consensus_queue.cc:260] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:54.413355 12694 raft_consensus.cc:3060] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:54.414013 12678 raft_consensus.cc:3060] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:54.392531 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:54.390209 12703 raft_consensus.cc:2804] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:54.413465 12705 raft_consensus.cc:740] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:16:54.417470 12703 raft_consensus.cc:493] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:54.418706 12703 raft_consensus.cc:3060] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:54.395701 11565 leader_election.cc:304] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:54.391075 12667 raft_consensus.cc:2749] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:54.422919 12696 raft_consensus.cc:2804] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:54.423347 12696 raft_consensus.cc:493] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:54.423738 12696 raft_consensus.cc:3060] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:54.384410 12682 raft_consensus.cc:515] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:54.392277 12680 raft_consensus.cc:2749] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:16:54.426028 11565 leader_election.cc:304] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:54.387034 12702 consensus_queue.cc:1059] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
W20260709 12:16:54.441884 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 48185.6us
I20260709 12:16:54.438866 12690 raft_consensus.cc:2804] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:54.444487 11493 leader_election.cc:304] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:54.445036 12718 raft_consensus.cc:3055] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:54.445283 12682 leader_election.cc:290] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:54.446295 11524 raft_consensus.cc:1240] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 2. Current term is 3. Ops: []
W20260709 12:16:54.450881 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 44575.4us
I20260709 12:16:54.454604 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:54.461933 12203 leader_election.cc:304] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:54.436399 12683 consensus_queue.cc:1048] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:16:54.461961 12725 consensus_queue.cc:1059] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:16:54.445477 12718 raft_consensus.cc:740] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:16:54.465581 12718 consensus_queue.cc:260] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:54.467042 12718 raft_consensus.cc:3060] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:54.467895 12685 raft_consensus.cc:2749] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:54.462572 11565 leader_election.cc:304] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:54.471678 12682 raft_consensus.cc:2804] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:54.472155 12682 raft_consensus.cc:493] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:54.472402 12722 consensus_queue.cc:1059] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:54.473852 12722 raft_consensus.cc:3055] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:54.474234 12722 raft_consensus.cc:740] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:16:54.476845 12690 raft_consensus.cc:697] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 2 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:16:54.475219 12722 consensus_queue.cc:260] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:54.442729 12681 raft_consensus.cc:2749] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:54.472522 12682 raft_consensus.cc:3060] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:54.483119 11596 raft_consensus.cc:2468] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 3.
I20260709 12:16:54.484082 11419 leader_election.cc:304] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:54.494503 12685 raft_consensus.cc:2749] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:16:54.494794 11417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:54.494647 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 51761.3us
I20260709 12:16:54.494686 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:54.495606 12203 leader_election.cc:304] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:16:54.495981 12346 raft_consensus.cc:2393] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 2: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:16:54.496838 11565 leader_election.cc:304] T da8741606df54c3f8b5cc5c1141862ea P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:54.503538 12719 raft_consensus.cc:3055] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:16:54.504066 12719 raft_consensus.cc:740] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:16:54.480850 12705 consensus_queue.cc:260] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:54.477933 12690 consensus_queue.cc:237] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
W20260709 12:16:54.512101 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 173943us
I20260709 12:16:54.506338 12705 raft_consensus.cc:3060] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:54.495018 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c355b3902a4e7fb72bac6a91ea3316" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
W20260709 12:16:54.514974 11418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:54.517275 12203 leader_election.cc:304] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:16:54.517944 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:54.493783 12702 consensus_queue.cc:1059] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:16:54.504930 12719 consensus_queue.cc:260] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:54.511631 12638 raft_consensus.cc:2749] T da8741606df54c3f8b5cc5c1141862ea P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:54.493355 12708 consensus_queue.cc:1059] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:16:54.526297 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:54.522871 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:54.528473 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:54.529690 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:54.529191 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:54.542749 12203 leader_election.cc:304] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:54.543918 11596 raft_consensus.cc:2468] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 2.
I20260709 12:16:54.544574 12713 raft_consensus.cc:2749] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:54.544754 12684 raft_consensus.cc:3060] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:54.545539 12703 raft_consensus.cc:515] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:54.548125 12703 leader_election.cc:290] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:54.549299 12719 raft_consensus.cc:3060] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:54.552198 11273 catalog_manager.cc:5697] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 1 to 2, leader changed from 1c101e338f954ef086338e251deed19d (127.3.212.130) to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 2 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:54.526324 12722 raft_consensus.cc:3060] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:54.553870 11453 raft_consensus.cc:2468] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 2.
I20260709 12:16:54.554905 12348 raft_consensus.cc:1240] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:54.531447 12694 raft_consensus.cc:515] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:54.526075 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:54.532347 12682 raft_consensus.cc:515] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:54.544054 12203 leader_election.cc:304] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:16:54.535261 12723 raft_consensus.cc:3055] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:54.538055 12727 raft_consensus.cc:2749] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:16:54.540283 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 133230us
I20260709 12:16:54.525826 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9fe9a94294836aec652338f44367d" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:54.560890 11273 catalog_manager.cc:5697] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 3 to 4, leader changed from 1c101e338f954ef086338e251deed19d (127.3.212.130) to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 4 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:54.522912 12724 raft_consensus.cc:2804] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:54.568104 12723 raft_consensus.cc:740] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:16:54.568092 12685 raft_consensus.cc:2749] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:54.569907 12694 leader_election.cc:290] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:54.570621 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:54.569111 12723 consensus_queue.cc:260] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:54.573477 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:54.573478 12723 raft_consensus.cc:3060] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:54.575764 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:54.577126 12729 raft_consensus.cc:2749] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:54.578603 12724 raft_consensus.cc:697] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 2 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:16:54.579873 12730 raft_consensus.cc:3055] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:54.580018 12697 consensus_queue.cc:1059] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:54.581306 12697 raft_consensus.cc:3055] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:54.574335 12203 leader_election.cc:304] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:54.581681 12697 raft_consensus.cc:740] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:16:54.581925 12682 leader_election.cc:290] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:54.582659 12203 leader_election.cc:304] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:54.582535 12729 raft_consensus.cc:2749] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:54.583427 12685 raft_consensus.cc:3060] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:54.583896 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:54.568876 11273 catalog_manager.cc:5697] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 2 to 3, leader changed from 1c101e338f954ef086338e251deed19d (127.3.212.130) to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 3 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:54.586004 12203 leader_election.cc:304] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:54.594153 11273 catalog_manager.cc:5697] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 2 to 3, leader changed from 1c101e338f954ef086338e251deed19d (127.3.212.130) to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 3 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:54.598251 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:54.593837 12730 raft_consensus.cc:740] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:16:54.599831 12730 consensus_queue.cc:260] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:54.599732 12729 raft_consensus.cc:2749] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:54.600289 12203 leader_election.cc:304] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:54.601848 12729 raft_consensus.cc:2749] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:54.598209 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:54.598143 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:54.579766 12684 raft_consensus.cc:2749] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:16:54.604904 11491 leader_election.cc:304] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:16:54.586040 12720 raft_consensus.cc:3055] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:54.605885 12720 raft_consensus.cc:740] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:16:54.579707 12724 consensus_queue.cc:237] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:54.606786 12720 consensus_queue.cc:260] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:54.608291 12720 raft_consensus.cc:3060] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:54.601662 12348 raft_consensus.cc:1275] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:54.603289 12203 leader_election.cc:304] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
W20260709 12:16:54.609366 11417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:54.597029 11273 catalog_manager.cc:5697] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 3 to 4, leader changed from 1c101e338f954ef086338e251deed19d (127.3.212.130) to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 4 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:54.601164 12730 raft_consensus.cc:3060] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:54.582585 12697 consensus_queue.cc:260] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:54.622627 12697 raft_consensus.cc:3060] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:16:54.625864 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 141870us
I20260709 12:16:54.627177 12682 consensus_queue.cc:1048] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:54.629166 12684 raft_consensus.cc:2749] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:54.631839 11419 leader_election.cc:304] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:54.636333 12721 raft_consensus.cc:2804] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:54.637754 11419 leader_election.cc:304] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:54.641532 12718 raft_consensus.cc:2749] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:54.643507 12696 raft_consensus.cc:515] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:54.647444 12203 leader_election.cc:304] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
W20260709 12:16:54.649140 11417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:54.649912 11417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:54.660475 12203 leader_election.cc:304] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:16:54.661828 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:54.662346 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:54.662683 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:54.640853 12722 raft_consensus.cc:2749] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:54.664870 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:54.665427 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
W20260709 12:16:54.663759 11417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:54.663718 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:54.666417 11565 leader_election.cc:304] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:54.640609 12721 raft_consensus.cc:493] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:16:54.650887 12713 raft_consensus.cc:2749] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:54.669667 11565 leader_election.cc:304] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:54.658265 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffe47647c274723808482c166efa21c" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:54.671120 11454 raft_consensus.cc:1275] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:54.672869 11491 leader_election.cc:304] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:16:54.640607 12719 consensus_queue.cc:1059] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:16:54.676028 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d43eecbad746fd9ddce50c5b9fc3e8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:54.678570 12203 leader_election.cc:304] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:54.679585 12677 raft_consensus.cc:2749] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:54.680274 12203 leader_election.cc:304] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:54.666661 12723 consensus_queue.cc:1059] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 12:16:54.682487 12723 raft_consensus.cc:3055] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:54.682864 12723 raft_consensus.cc:740] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:16:54.683820 12682 raft_consensus.cc:2749] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:16:54.684312 12677 raft_consensus.cc:2749] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:54.667848 12729 raft_consensus.cc:2764] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:16:54.688475 11447 raft_consensus.cc:2468] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 4.
I20260709 12:16:54.689514 11451 raft_consensus.cc:1275] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:54.692662 12203 leader_election.cc:304] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:54.695771 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:54.694180 12719 raft_consensus.cc:3055] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:54.700528 12719 raft_consensus.cc:740] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:16:54.701462 12719 consensus_queue.cc:260] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:54.702616 11565 leader_election.cc:304] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:54.700556 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:54.674780 12696 leader_election.cc:290] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:54.704154 12696 raft_consensus.cc:2749] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:16:54.704377 12682 consensus_queue.cc:1048] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:54.704653 12690 raft_consensus.cc:2804] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:54.705500 12690 raft_consensus.cc:493] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:16:54.705466 12683 consensus_queue.cc:1048] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:54.705946 11599 raft_consensus.cc:2468] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 3.
I20260709 12:16:54.706105 12345 raft_consensus.cc:1275] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:54.701057 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:54.707175 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffe47647c274723808482c166efa21c" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:54.702428 12695 raft_consensus.cc:2749] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:16:54.706128 12690 raft_consensus.cc:3060] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:54.668794 12721 raft_consensus.cc:3060] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:54.709648 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:54.711277 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:54.702720 12719 raft_consensus.cc:3060] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:54.699090 12713 raft_consensus.cc:3060] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:54.691841 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9fe9a94294836aec652338f44367d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:54.713547 12346 raft_consensus.cc:1275] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:54.714073 12700 consensus_queue.cc:1048] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:54.716250 12695 consensus_queue.cc:1048] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:54.716313 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffe47647c274723808482c166efa21c" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:54.719394 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:16:54.722539 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 49738.2us
W20260709 12:16:54.725292 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 43922.9us
I20260709 12:16:54.726020 12203 leader_election.cc:304] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:16:54.719122 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:54.728442 11565 leader_election.cc:304] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:54.727594 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:54.729313 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:54.708564 12685 raft_consensus.cc:2749] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:54.734423 11446 raft_consensus.cc:1275] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:54.731693 12696 raft_consensus.cc:2749] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:16:54.732774 12684 raft_consensus.cc:2749] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:54.735958 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8741606df54c3f8b5cc5c1141862ea" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:54.740170 12203 leader_election.cc:304] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:16:54.740294 11491 leader_election.cc:304] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:54.741679 12724 raft_consensus.cc:2804] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:54.741941 11491 leader_election.cc:304] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:16:54.742125 12724 raft_consensus.cc:493] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:54.742578 12724 raft_consensus.cc:3060] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:54.742825 12593 raft_consensus.cc:2804] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:54.743305 12593 raft_consensus.cc:493] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:16:54.743727 12593 raft_consensus.cc:3060] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:54.743510 11491 leader_election.cc:304] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
W20260709 12:16:54.744181 12739 log.cc:927] Time spent T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:16:54.744702 12732 raft_consensus.cc:2749] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:54.744980 11491 leader_election.cc:304] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
W20260709 12:16:54.745299 12738 log.cc:927] Time spent T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:16:54.745820 12691 raft_consensus.cc:2804] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:54.746186 12691 raft_consensus.cc:493] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:54.746553 12691 raft_consensus.cc:3060] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:54.748088 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:54.741833 11600 raft_consensus.cc:1240] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:54.746357 11596 raft_consensus.cc:1240] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 LEADER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:54.749845 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:54.683755 12723 consensus_queue.cc:260] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:54.751189 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:54.753245 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:54.755167 11491 leader_election.cc:304] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:54.756685 12713 raft_consensus.cc:2749] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:54.756958 12691 raft_consensus.cc:515] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:54.759330 12691 leader_election.cc:290] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:54.759904 12697 raft_consensus.cc:2804] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:54.761634 12697 raft_consensus.cc:493] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:54.762032 12697 raft_consensus.cc:3060] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:54.763782 12593 raft_consensus.cc:515] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:54.764900 12723 raft_consensus.cc:3060] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:54.766969 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:54.769672 12667 raft_consensus.cc:2749] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:54.760938 11491 leader_election.cc:304] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:16:54.770776 12732 raft_consensus.cc:2804] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:54.771149 12732 raft_consensus.cc:493] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:16:54.771478 12732 raft_consensus.cc:3060] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:54.772382 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e4724ed93a467ea47763eec9a6de2e" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:54.773314 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7937e0cff84ef7a26c84247c8ffc08" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:54.773787 11491 leader_election.cc:304] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:16:54.774598 11599 raft_consensus.cc:1240] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:54.775238 12697 raft_consensus.cc:515] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:54.775722 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390e91331fd04f97a5235133a34875ee" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:54.775249 11596 raft_consensus.cc:1240] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 4 LEADER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:54.774864 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:54.783489 11417 leader_election.cc:304] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:54.784909 11417 leader_election.cc:304] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:54.771360 12203 leader_election.cc:304] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:16:54.775799 11598 raft_consensus.cc:1240] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:54.786126 11417 leader_election.cc:304] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:54.786880 12718 raft_consensus.cc:2749] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:54.787367 11417 leader_election.cc:304] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
W20260709 12:16:54.787863 11493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:54.787680 12718 raft_consensus.cc:2749] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:54.789507 12667 raft_consensus.cc:2749] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:54.792538 12203 leader_election.cc:304] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:54.788224 12737 raft_consensus.cc:2749] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:54.794361 12690 raft_consensus.cc:515] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:54.795442 12737 raft_consensus.cc:2749] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:54.797138 12667 raft_consensus.cc:2804] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:54.787045 12721 raft_consensus.cc:515] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:54.798007 12667 raft_consensus.cc:697] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [term 2 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:16:54.799438 12721 leader_election.cc:290] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:54.799245 12667 consensus_queue.cc:237] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:54.800536 11417 leader_election.cc:304] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
W20260709 12:16:54.801441 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 73061.8us
I20260709 12:16:54.802794 11565 leader_election.cc:304] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:54.801529 12737 raft_consensus.cc:2749] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:54.806707 11453 raft_consensus.cc:2468] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 4.
I20260709 12:16:54.808480 11445 raft_consensus.cc:1275] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:54.809273 12593 leader_election.cc:290] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:54.810739 12713 consensus_queue.cc:1059] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:54.811864 12684 raft_consensus.cc:3055] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:54.815541 12684 raft_consensus.cc:740] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:16:54.811501 12696 consensus_queue.cc:1048] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:54.807854 12680 raft_consensus.cc:2749] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:16:54.815439 12677 consensus_queue.cc:1059] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:54.815035 12690 leader_election.cc:290] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:54.818292 12684 consensus_queue.cc:260] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:54.818323 12677 raft_consensus.cc:3055] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:54.820211 11598 raft_consensus.cc:1240] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:54.820595 12677 raft_consensus.cc:740] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:16:54.820923 12680 consensus_queue.cc:1048] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:54.814885 11446 raft_consensus.cc:1275] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:54.821411 12732 raft_consensus.cc:515] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:54.822561 11523 raft_consensus.cc:1240] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:54.821758 12677 consensus_queue.cc:260] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:54.822959 11417 leader_election.cc:304] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:54.823781 12677 raft_consensus.cc:3060] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:54.824493 12737 raft_consensus.cc:2749] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:54.824333 11417 leader_election.cc:304] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:54.828444 11417 leader_election.cc:304] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:54.831074 11595 raft_consensus.cc:1240] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:54.831949 12694 consensus_queue.cc:1059] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:54.833290 12694 raft_consensus.cc:3055] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:54.833549 12737 raft_consensus.cc:2749] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:54.820305 12684 raft_consensus.cc:3060] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:54.832093 11566 leader_election.cc:304] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:54.836194 11566 leader_election.cc:304] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:54.805792 12724 raft_consensus.cc:515] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:54.837983 11598 raft_consensus.cc:1240] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:54.838639 11454 raft_consensus.cc:1240] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:54.829345 12696 consensus_queue.cc:1048] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 12:16:54.839831 11417 leader_election.cc:304] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:54.807149 12691 raft_consensus.cc:2749] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:16:54.840621 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 63753.3us
I20260709 12:16:54.842463 11417 leader_election.cc:304] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:54.842667 11566 leader_election.cc:304] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:54.844883 11491 leader_election.cc:304] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:54.846252 11491 leader_election.cc:304] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:54.848708 11566 leader_election.cc:304] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:54.851913 12593 raft_consensus.cc:2749] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:54.852458 11491 leader_election.cc:304] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:54.836908 12695 raft_consensus.cc:2749] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:16:54.852792 11566 leader_election.cc:304] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:54.858053 12696 raft_consensus.cc:2749] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:16:54.858436 12724 leader_election.cc:290] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:54.833873 12694 raft_consensus.cc:740] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:54.854490 11417 leader_election.cc:304] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:54.855392 11448 raft_consensus.cc:1240] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:54.855752 11524 raft_consensus.cc:1240] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:54.855836 12732 leader_election.cc:290] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:54.843166 12700 raft_consensus.cc:2749] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:16:54.843888 12723 raft_consensus.cc:2749] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:54.895466 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:54.860992 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390e91331fd04f97a5235133a34875ee" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:54.861694 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:54.862699 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:54.867053 11519 raft_consensus.cc:1240] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:54.841408 12719 raft_consensus.cc:2749] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:54.870901 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:54.871883 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:54.855842 12735 raft_consensus.cc:2749] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:54.907802 11521 raft_consensus.cc:1240] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:54.880177 12593 raft_consensus.cc:2749] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:16:54.851055 12690 raft_consensus.cc:2749] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:54.888756 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:54.892313 11491 leader_election.cc:304] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:54.892722 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:54.893476 11528 raft_consensus.cc:1275] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:54.849830 12683 raft_consensus.cc:2749] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:54.855969 12737 raft_consensus.cc:2749] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:54.894807 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:54.898298 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:54.890601 11417 leader_election.cc:304] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:54.911091 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
W20260709 12:16:54.916011 11420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:54.889984 12722 raft_consensus.cc:2749] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:54.895203 12696 consensus_queue.cc:1059] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:16:54.925156 11417 leader_election.cc:304] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:54.913565 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e4724ed93a467ea47763eec9a6de2e" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:54.907835 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:54.932600 11417 leader_election.cc:304] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:54.931293 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:54.931037 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e4724ed93a467ea47763eec9a6de2e" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:54.938278 12697 leader_election.cc:290] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:54.929773 12690 raft_consensus.cc:2749] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:54.941437 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:54.942233 12681 consensus_queue.cc:1048] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:54.942909 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:54.930415 12719 raft_consensus.cc:2749] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:54.944262 12683 raft_consensus.cc:3055] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:54.944808 12683 raft_consensus.cc:740] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:54.934474 11596 raft_consensus.cc:1240] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:54.945735 12683 consensus_queue.cc:260] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:54.948832 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
W20260709 12:16:54.951056 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 58799.1us
I20260709 12:16:54.924340 12694 consensus_queue.cc:260] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:54.955775 12694 raft_consensus.cc:3060] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:54.959616 11491 leader_election.cc:304] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:54.926015 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:54.981424 12690 consensus_queue.cc:1059] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:54.960662 12713 consensus_queue.cc:1059] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:16:54.986969 11417 leader_election.cc:304] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:54.934055 12723 raft_consensus.cc:2749] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:54.989866 11453 raft_consensus.cc:2468] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 2.
I20260709 12:16:54.936172 12710 consensus_queue.cc:1059] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 12:16:54.991384 11600 raft_consensus.cc:2468] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 2.
I20260709 12:16:54.993546 12713 raft_consensus.cc:3055] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:55.005139 11417 leader_election.cc:304] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:54.960776 12719 raft_consensus.cc:2749] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:55.009814 11450 raft_consensus.cc:2468] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 2.
I20260709 12:16:55.012099 11417 leader_election.cc:304] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
W20260709 12:16:55.015517 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 90283.4us
I20260709 12:16:54.991492 12732 raft_consensus.cc:2749] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:55.015961 12727 raft_consensus.cc:2749] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:54.988415 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:55.019035 11491 leader_election.cc:304] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d
I20260709 12:16:55.021907 11491 leader_election.cc:304] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:55.023128 12593 raft_consensus.cc:2804] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:55.023721 12593 raft_consensus.cc:697] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 2 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:16:55.009593 12737 raft_consensus.cc:2749] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:55.004596 12713 raft_consensus.cc:740] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:16:55.032253 11526 raft_consensus.cc:1240] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:55.032581 12713 consensus_queue.cc:260] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:55.033998 12713 raft_consensus.cc:3060] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:55.038889 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c355b3902a4e7fb72bac6a91ea3316" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:55.039124 12593 consensus_queue.cc:237] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:55.041839 12683 raft_consensus.cc:3060] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:55.014143 12730 raft_consensus.cc:2749] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:55.018110 12722 consensus_queue.cc:1059] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:16:55.048895 12722 raft_consensus.cc:3055] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:55.049273 12722 raft_consensus.cc:740] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:16:55.050386 12722 consensus_queue.cc:260] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:55.025303 12727 consensus_queue.cc:1059] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:16:55.053853 12727 raft_consensus.cc:3055] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:55.054267 12727 raft_consensus.cc:740] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:16:55.054399 11275 catalog_manager.cc:5697] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 1 to 2, leader changed from 1c101e338f954ef086338e251deed19d (127.3.212.130) to a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131). New cstate: current_term: 2 leader_uuid: "a03223e9e41247c3a36b7b7c3d476671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:55.057818 12694 consensus_queue.cc:1059] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:55.059244 12694 raft_consensus.cc:3055] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:55.059641 12694 raft_consensus.cc:740] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:55.063612 11491 leader_election.cc:304] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:55.072775 11445 raft_consensus.cc:1275] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:16:55.077059 11445 pending_rounds.cc:85] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d: Aborting all ops after (but not including) 1
I20260709 12:16:55.078059 11445 pending_rounds.cc:107] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:16:55.091123 11445 raft_consensus.cc:2889] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:55.025460 12732 consensus_queue.cc:1059] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 12:16:55.071950 12722 raft_consensus.cc:3060] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:55.071590 12691 raft_consensus.cc:2749] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:55.092846 12721 raft_consensus.cc:2749] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:55.130151 11600 raft_consensus.cc:1240] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:55.118381 12714 consensus_queue.cc:1048] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.077s
I20260709 12:16:55.094970 12694 consensus_queue.cc:260] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
W20260709 12:16:55.175027 12744 log.cc:927] Time spent T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
W20260709 12:16:55.196342 12746 log.cc:927] Time spent T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 12:16:55.234452 11418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:55.234920 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 119070us
W20260709 12:16:55.236011 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 140458us
I20260709 12:16:55.116374 12727 consensus_queue.cc:260] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:55.094877 12729 consensus_queue.cc:1059] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:16:55.134414 12657 consensus_queue.cc:1059] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.083s
I20260709 12:16:55.125780 12709 consensus_queue.cc:1059] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.078s
I20260709 12:16:55.268111 11491 leader_election.cc:304] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:16:55.279557 11526 raft_consensus.cc:1240] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 3. Current term is 4. Ops: []
W20260709 12:16:55.290606 11493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:55.292503 12766 raft_consensus.cc:2749] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:16:55.300177 12761 log.cc:927] Time spent T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 12:16:55.309828 12724 raft_consensus.cc:3055] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:55.310385 12724 raft_consensus.cc:740] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
W20260709 12:16:55.311443 11417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:55.313547 12723 raft_consensus.cc:493] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:16:55.314082 12723 raft_consensus.cc:515] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:55.316148 12723 leader_election.cc:290] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:55.316656 12723 raft_consensus.cc:493] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:16:55.290594 11491 leader_election.cc:304] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:16:55.324121 12359 raft_consensus.cc:1275] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:55.289186 12727 raft_consensus.cc:3060] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:16:55.337138 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 46574.6us
I20260709 12:16:55.339171 11491 leader_election.cc:304] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:16:55.339787 12345 raft_consensus.cc:1275] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:55.340466 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:55.322003 12677 raft_consensus.cc:3055] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:55.317148 12723 raft_consensus.cc:515] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:55.341038 12359 raft_consensus.cc:2468] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 1.
W20260709 12:16:55.343205 11420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:55.345737 11419 leader_election.cc:304] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:55.358352 11491 leader_election.cc:304] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:55.364087 11594 raft_consensus.cc:2468] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 2.
I20260709 12:16:55.372859 11521 raft_consensus.cc:1240] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:55.374090 11528 raft_consensus.cc:1275] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:55.374782 11526 raft_consensus.cc:1240] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:55.376998 12667 consensus_queue.cc:1059] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:55.378121 12667 raft_consensus.cc:3055] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:55.378461 12667 raft_consensus.cc:740] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:16:55.378583 12723 leader_election.cc:290] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:55.379326 12667 consensus_queue.cc:260] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:55.380604 12667 raft_consensus.cc:3060] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:16:55.382457 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 206579us
I20260709 12:16:55.383062  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:16:55.392279 12203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:55.338805 12690 raft_consensus.cc:2749] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:55.395684 11491 leader_election.cc:304] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:55.344045 12721 raft_consensus.cc:2749] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:55.399623 11594 raft_consensus.cc:1240] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:55.396668 12691 raft_consensus.cc:2749] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:55.400969 11453 raft_consensus.cc:1240] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 2. Current term is 3. Ops: []
W20260709 12:16:55.413084 11565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:55.344280 12677 raft_consensus.cc:740] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:16:55.347271 12730 raft_consensus.cc:2804] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:16:55.461139 11420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:55.479143 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 83545.8us
I20260709 12:16:55.341838 12763 consensus_queue.cc:1048] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.123s
I20260709 12:16:55.397991 12710 consensus_queue.cc:1059] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.092s
I20260709 12:16:55.465605 12730 raft_consensus.cc:493] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting leader election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:16:55.397187 12756 consensus_queue.cc:1048] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.093s
I20260709 12:16:55.468324 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:55.496397 11491 leader_election.cc:304] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:55.457728 12683 consensus_queue.cc:1059] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
W20260709 12:16:55.499893 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 84642.6us
I20260709 12:16:55.455545 12766 consensus_queue.cc:1048] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.090s
I20260709 12:16:55.489460 12721 raft_consensus.cc:2804] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:55.504500 12774 raft_consensus.cc:2804] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:55.491516 12713 consensus_queue.cc:1059] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:16:55.553787 12713 raft_consensus.cc:3055] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:55.554196 12713 raft_consensus.cc:740] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:16:55.555020 12713 consensus_queue.cc:260] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:55.560359 12721 raft_consensus.cc:697] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 3 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:16:55.561506 12774 raft_consensus.cc:697] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 2 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:16:55.562513 12774 consensus_queue.cc:237] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:55.525600 12694 raft_consensus.cc:3060] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:55.526419 12729 raft_consensus.cc:3055] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:55.531106 12709 consensus_queue.cc:1059] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:55.551329 12724 consensus_queue.cc:260] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:55.499300 12730 raft_consensus.cc:3060] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:16:55.620334 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 123994us
I20260709 12:16:55.621052 12345 raft_consensus.cc:1240] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:55.621150 11491 leader_election.cc:304] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:55.600348 12750 raft_consensus.cc:3055] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:55.626520 11526 raft_consensus.cc:1240] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:55.628520 12770 raft_consensus.cc:3055] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:55.628955 12770 raft_consensus.cc:740] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:55.629781 12770 consensus_queue.cc:260] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:55.630277 12713 raft_consensus.cc:3060] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:55.631161 12770 raft_consensus.cc:3060] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:55.568994 12721 consensus_queue.cc:237] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:55.600052 12729 raft_consensus.cc:740] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:16:55.650122 11418 leader_election.cc:304] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:55.654774 11418 leader_election.cc:304] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:55.640759 12724 raft_consensus.cc:3060] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:55.639429 12750 raft_consensus.cc:740] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:16:55.665449 11418 leader_election.cc:304] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:55.676671 11418 leader_election.cc:304] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:55.669234 11450 raft_consensus.cc:1275] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:55.670959 11445 raft_consensus.cc:1275] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:55.685832 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:55.654623 12727 raft_consensus.cc:2749] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:55.656215 12697 raft_consensus.cc:2804] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:55.674839 12737 raft_consensus.cc:2749] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:16:55.683100 12678 raft_consensus.cc:3055] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:55.683599 12723 raft_consensus.cc:2749] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:55.683228 12722 raft_consensus.cc:2749] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:55.683032 12681 raft_consensus.cc:493] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.698778 11418 leader_election.cc:304] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:55.696614 12678 raft_consensus.cc:740] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:16:55.702710 12697 raft_consensus.cc:697] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [term 2 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:16:55.663714 12691 consensus_queue.cc:1059] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:16:55.704008 12750 consensus_queue.cc:260] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:55.673889 12677 consensus_queue.cc:260] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:55.784828 12727 raft_consensus.cc:493] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.819388 12723 raft_consensus.cc:493] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.829471 12722 raft_consensus.cc:2749] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:16:55.787570 12681 raft_consensus.cc:515] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:55.694973 12729 consensus_queue.cc:260] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:55.854141 12754 raft_consensus.cc:493] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.904866 12737 raft_consensus.cc:493] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.849287 12727 raft_consensus.cc:515] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:55.926222 12766 raft_consensus.cc:493] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:55.958649 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 259957us
W20260709 12:16:55.961066 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 441531us
I20260709 12:16:55.905915 12723 raft_consensus.cc:515] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:55.928369 12678 consensus_queue.cc:260] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:55.960569 12729 raft_consensus.cc:3060] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:55.975379 11600 raft_consensus.cc:1240] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:55.975008 12685 raft_consensus.cc:493] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.978678 12685 raft_consensus.cc:515] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:55.931696 12697 consensus_queue.cc:237] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:55.937907 12754 raft_consensus.cc:515] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:55.953994 12737 raft_consensus.cc:515] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:55.979967 12681 leader_election.cc:290] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:55.974771 12667 raft_consensus.cc:493] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.962718 12766 raft_consensus.cc:515] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
W20260709 12:16:55.994369 12786 log.cc:927] Time spent T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 12:16:55.995381 12727 leader_election.cc:290] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:55.989753 12793 consensus_queue.cc:1059] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:16:56.003793 12723 leader_election.cc:290] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:55.993299 12678 raft_consensus.cc:3060] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:55.992018 12667 raft_consensus.cc:515] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:56.009083 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:56.009763 11600 raft_consensus.cc:2468] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 4.
I20260709 12:16:56.013358 12638 raft_consensus.cc:493] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.019183 12638 raft_consensus.cc:515] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:56.019831 11593 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "167448b175c040d180318f81f6d10c8d"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "1c101e338f954ef086338e251deed19d"
 from {username='slave'} at 127.0.0.1:37992
I20260709 12:16:56.020524 11593 raft_consensus.cc:606] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 4 LEADER]: Received request to transfer leadership to TS 1c101e338f954ef086338e251deed19d
I20260709 12:16:56.023543 12766 leader_election.cc:290] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:56.020004 11600 raft_consensus.cc:1240] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:56.025141 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:56.026226 12345 raft_consensus.cc:2468] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 3.
I20260709 12:16:56.027624 11493 leader_election.cc:304] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:56.027675 11274 catalog_manager.cc:5697] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 1 to 2, leader changed from 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132) to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 2 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:56.032214 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:56.024161 11273 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57440 (request call id 178) took 1500 ms. Trace:
I20260709 12:16:56.032650 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:56.033635 12348 raft_consensus.cc:2468] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 2.
I20260709 12:16:56.040361 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ed4eeff0ae44d0bc1ebb8cbe3adea5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:56.041729 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:16:56.044399 12205 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:56.006129 12685 leader_election.cc:290] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:56.044059 11419 leader_election.cc:304] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:56.052913 12723 raft_consensus.cc:2804] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:56.053360 12723 raft_consensus.cc:493] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:56.053772 12723 raft_consensus.cc:3060] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:56.033145 11273 rpcz_store.cc:276] 0709 12:16:54.523439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:54.523594 (+   155us) service_pool.cc:224] Handling call
0709 12:16:56.024079 (+1500485us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:16:54.830350 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:16:54.893076 (+ 62726us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:16:54.901652 (+  8576us) write_op.cc:435] Acquired schema lock
0709 12:16:54.913864 (+ 12212us) tablet.cc:662] Decoding operations
0709 12:16:54.945411 (+ 31547us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:16:54.945524 (+   113us) write_op.cc:641] Partition lock acquired for write op
0709 12:16:54.945549 (+    25us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:16:54.946152 (+   603us) tablet.cc:701] Row locks acquired
0709 12:16:54.946202 (+    50us) write_op.cc:260] PREPARE: finished
0709 12:16:54.946366 (+   164us) write_op.cc:270] Start()
0709 12:16:54.946516 (+   150us) write_op.cc:276] Timestamp: P: 1783599414946308 usec, L: 0
0709 12:16:54.946546 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 12:16:54.947275 (+   729us) log.cc:844] Serialized 2093 byte log entry
0709 12:16:55.313199 (+365924us) op_driver.cc:464] REPLICATION: finished
0709 12:16:55.359810 (+ 46611us) write_op.cc:301] APPLY: starting
0709 12:16:55.456542 (+ 96732us) tablet.cc:1367] starting BulkCheckPresence
0709 12:16:55.467301 (+ 10759us) tablet.cc:1370] finished BulkCheckPresence
0709 12:16:55.501182 (+ 33881us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:16:55.553259 (+ 52077us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:16:55.554950 (+  1691us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:16:55.555176 (+   226us) write_op.cc:312] APPLY: finished
0709 12:16:55.557305 (+  2129us) log.cc:844] Serialized 46 byte log entry
0709 12:16:55.559035 (+  1730us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:55.559497 (+   462us) write_op.cc:454] Released schema lock
0709 12:16:55.559655 (+   158us) write_op.cc:341] FINISH: Updating metrics
0709 12:16:55.562298 (+  2643us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:55.562481 (+   183us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":102,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":46251,"apply.run_cpu_time_us":4193,"apply.run_wall_time_us":202020,"num_ops":5,"prepare.queue_time_us":139135,"prepare.run_cpu_time_us":14734,"prepare.run_wall_time_us":186209,"raft.queue_time_us":414186,"raft.run_cpu_time_us":27491,"raft.run_wall_time_us":248663,"replication_time_us":366471,"thread_start_us":293675,"threads_started":4,"wal-append.queue_time_us":102853}]]}
I20260709 12:16:56.039040 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:56.098253 11519 raft_consensus.cc:2468] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 3.
I20260709 12:16:56.060339 12680 consensus_queue.cc:1059] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:56.099668 12680 raft_consensus.cc:3055] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:56.100052 12680 raft_consensus.cc:740] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:56.062299 11594 raft_consensus.cc:1275] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:56.062968 12693 raft_consensus.cc:3055] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:56.064369 11275 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57430 (request call id 150) took 1170 ms. Trace:
I20260709 12:16:56.068704 12737 leader_election.cc:290] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
W20260709 12:16:56.038673 12788 log.cc:927] Time spent T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:16:56.069774 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ed4eeff0ae44d0bc1ebb8cbe3adea5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:56.070183 12754 leader_election.cc:290] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
W20260709 12:16:56.104902 12204 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:56.082352 12667 leader_election.cc:290] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:56.074817 12638 leader_election.cc:290] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:56.030908 12766 raft_consensus.cc:2804] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:56.075434 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:56.083984 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:56.102211 12693 raft_consensus.cc:740] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:16:56.085628 11491 leader_election.cc:304] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:56.085924 12755 raft_consensus.cc:493] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:16:56.086894 12682 raft_consensus.cc:493] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.100894 12680 consensus_queue.cc:260] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:56.106516 11528 raft_consensus.cc:1240] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:56.087347 12695 raft_consensus.cc:493] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:16:56.089433 11593 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "1c101e338f954ef086338e251deed19d"
 from {username='slave'} at 127.0.0.1:37992
I20260709 12:16:56.077930 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:56.079968 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:56.080266 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:56.073945 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:56.094727 12750 raft_consensus.cc:3060] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:56.095041 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:56.096453 12677 raft_consensus.cc:3060] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:56.091741 12730 raft_consensus.cc:515] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:56.089493 12349 raft_consensus.cc:1275] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:56.081758 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:56.102259 11275 rpcz_store.cc:276] 0709 12:16:54.893912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:54.894051 (+   139us) service_pool.cc:224] Handling call
0709 12:16:56.064308 (+1170257us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:16:55.057726 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:16:55.058377 (+   651us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:16:55.058403 (+    26us) write_op.cc:435] Acquired schema lock
0709 12:16:55.058421 (+    18us) tablet.cc:662] Decoding operations
0709 12:16:55.058743 (+   322us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:16:55.058786 (+    43us) write_op.cc:641] Partition lock acquired for write op
0709 12:16:55.058811 (+    25us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:16:55.058992 (+   181us) tablet.cc:701] Row locks acquired
0709 12:16:55.059008 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:16:55.059136 (+   128us) write_op.cc:270] Start()
0709 12:16:55.059276 (+   140us) write_op.cc:276] Timestamp: P: 1783599415059085 usec, L: 0
0709 12:16:55.059295 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:16:55.061800 (+  2505us) log.cc:844] Serialized 540 byte log entry
0709 12:16:55.472748 (+410948us) op_driver.cc:464] REPLICATION: finished
0709 12:16:55.623834 (+151086us) write_op.cc:301] APPLY: starting
0709 12:16:55.623923 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 12:16:55.624063 (+   140us) tablet.cc:1370] finished BulkCheckPresence
0709 12:16:55.627655 (+  3592us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:16:55.655454 (+ 27799us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:16:55.685560 (+ 30106us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:16:55.689089 (+  3529us) write_op.cc:312] APPLY: finished
0709 12:16:55.706942 (+ 17853us) log.cc:844] Serialized 22 byte log entry
0709 12:16:55.784637 (+ 77695us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:55.792379 (+  7742us) write_op.cc:454] Released schema lock
0709 12:16:55.815426 (+ 23047us) write_op.cc:341] FINISH: Updating metrics
0709 12:16:55.849002 (+ 33576us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:55.852367 (+  3365us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":201025,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":120959,"apply.run_cpu_time_us":2588,"apply.run_wall_time_us":216261,"num_ops":1,"prepare.queue_time_us":229,"prepare.run_cpu_time_us":2527,"prepare.run_wall_time_us":4373,"replication_time_us":399760,"thread_start_us":155885,"threads_started":1}]]}
I20260709 12:16:56.075546 12723 raft_consensus.cc:515] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:56.121676 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:56.122304 12349 raft_consensus.cc:3060] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:56.122920 12723 leader_election.cc:290] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:56.107069 12766 raft_consensus.cc:493] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:56.108047 12755 raft_consensus.cc:515] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:56.107836 12693 consensus_queue.cc:260] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:56.126525 12693 raft_consensus.cc:3060] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:56.127203 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:56.127978 12348 raft_consensus.cc:2468] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 3.
I20260709 12:16:56.108295 12682 raft_consensus.cc:515] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:56.123975 12766 raft_consensus.cc:3060] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:56.131911 12682 leader_election.cc:290] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:56.108752 12680 raft_consensus.cc:3060] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:56.109675 12695 raft_consensus.cc:515] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:56.109804 11593 raft_consensus.cc:606] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Received request to transfer leadership to TS 1c101e338f954ef086338e251deed19d
I20260709 12:16:56.110404 12678 raft_consensus.cc:2749] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:16:56.142427 12695 leader_election.cc:290] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:56.109431 11491 leader_election.cc:304] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:16:56.111982 11600 raft_consensus.cc:2468] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 2.
I20260709 12:16:56.144472 11491 leader_election.cc:304] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:56.144941 12678 raft_consensus.cc:2749] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:56.143095 12755 leader_election.cc:290] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:56.145115 11417 leader_election.cc:304] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:16:56.146085 12678 raft_consensus.cc:2749] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:16:56.110076 11522 raft_consensus.cc:2468] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 2.
I20260709 12:16:56.153183 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:56.170266 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:56.184024 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390e91331fd04f97a5235133a34875ee" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:56.184316 12345 raft_consensus.cc:2468] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 3.
I20260709 12:16:56.118044 11524 raft_consensus.cc:2468] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 3.
I20260709 12:16:56.182317 12349 raft_consensus.cc:2468] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 2.
I20260709 12:16:56.149665 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390e91331fd04f97a5235133a34875ee" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:56.149432 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:56.169188 11491 leader_election.cc:304] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:16:56.117612 12203 leader_election.cc:304] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:56.188475 11491 leader_election.cc:304] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:16:56.187834 11522 raft_consensus.cc:2468] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 2.
W20260709 12:16:56.190002 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 72644us
I20260709 12:16:56.190651 11491 leader_election.cc:304] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:56.191531 11566 leader_election.cc:304] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:16:56.115517 12730 leader_election.cc:290] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:56.181931 12729 consensus_queue.cc:1059] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:16:56.184885 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
W20260709 12:16:56.194108 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 60668.7us
I20260709 12:16:56.194454 12793 raft_consensus.cc:2804] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:56.194952 12793 raft_consensus.cc:493] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:56.195434 12793 raft_consensus.cc:3060] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:56.197782 12777 raft_consensus.cc:3055] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:56.198246 12777 raft_consensus.cc:740] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:16:56.198526 11419 leader_election.cc:304] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:56.199087 12777 consensus_queue.cc:260] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:56.200615 12777 raft_consensus.cc:3060] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:56.194788 12754 raft_consensus.cc:2804] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:56.201926 12754 raft_consensus.cc:493] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:56.202273 12754 raft_consensus.cc:3060] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:56.202939 12737 raft_consensus.cc:2804] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:56.203542 12737 raft_consensus.cc:493] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:56.203980 12737 raft_consensus.cc:3060] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:56.197559 12678 raft_consensus.cc:2749] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:56.206379 12724 raft_consensus.cc:2749] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:56.206229 12730 raft_consensus.cc:2804] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:56.209416 12713 raft_consensus.cc:3055] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:56.209643 12727 raft_consensus.cc:493] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.210436 12727 raft_consensus.cc:515] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:56.209766 12730 raft_consensus.cc:697] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 2 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:16:56.213539 12730 consensus_queue.cc:237] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:56.217262 11565 leader_election.cc:304] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:56.221784 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:56.222564 12345 raft_consensus.cc:3060] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:56.227517 11567 leader_election.cc:304] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
W20260709 12:16:56.228592 12205 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:56.228876 11567 leader_election.cc:304] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:56.232566 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:56.233352 12348 raft_consensus.cc:2468] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 2.
I20260709 12:16:56.191375 12723 raft_consensus.cc:493] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.236577 11567 leader_election.cc:304] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:56.209993 12713 raft_consensus.cc:740] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:16:56.237476 11419 leader_election.cc:304] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:56.220165 12667 raft_consensus.cc:493] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:16:56.242189 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:56.244925 12349 raft_consensus.cc:2468] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 2.
I20260709 12:16:56.221416 12784 raft_consensus.cc:2749] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:16:56.236974 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 46408.2us
I20260709 12:16:56.251827 11491 leader_election.cc:304] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:16:56.238003 11565 leader_election.cc:304] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:56.254487 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:56.255179 11600 raft_consensus.cc:2468] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 2.
I20260709 12:16:56.240108 12683 raft_consensus.cc:2749] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:56.241729 12770 raft_consensus.cc:2804] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:56.245167 12657 raft_consensus.cc:493] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.245694 12724 raft_consensus.cc:2804] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:56.261821 12203 leader_election.cc:304] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:56.247347 12694 raft_consensus.cc:2804] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:56.270123 12694 raft_consensus.cc:493] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:56.270545 12694 raft_consensus.cc:3060] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:56.274047 12346 raft_consensus.cc:1240] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:56.274297 11593 raft_consensus.cc:1240] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:56.247299 12792 raft_consensus.cc:2804] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:56.275941 12792 raft_consensus.cc:493] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:56.276436 12792 raft_consensus.cc:3060] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:56.277092 12693 raft_consensus.cc:493] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.277745 12693 raft_consensus.cc:515] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:56.252894 12727 leader_election.cc:290] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:56.249513 12667 raft_consensus.cc:515] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:56.245716 12723 raft_consensus.cc:515] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:56.280831 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:56.252694 12794 raft_consensus.cc:493] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.281548 11524 raft_consensus.cc:2468] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 3.
I20260709 12:16:56.253222 12710 raft_consensus.cc:493] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.282944 12710 raft_consensus.cc:515] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:56.283540 12204 leader_election.cc:304] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:56.284541 12756 raft_consensus.cc:2804] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:56.284917 12756 raft_consensus.cc:493] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:56.285274 12756 raft_consensus.cc:3060] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:56.285706 12724 raft_consensus.cc:697] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 2 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:16:56.286768 12724 consensus_queue.cc:237] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:56.242146 12729 consensus_queue.cc:1048] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:16:56.267654 12657 raft_consensus.cc:515] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:56.280834 12713 consensus_queue.cc:260] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:56.285328 12685 raft_consensus.cc:493] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.291253 12685 raft_consensus.cc:515] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:56.263895 12770 raft_consensus.cc:493] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:56.280388 12765 raft_consensus.cc:2749] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:56.290786 12784 raft_consensus.cc:993] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8: : Instructing follower 1c101e338f954ef086338e251deed19d to start an election
I20260709 12:16:56.299572 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:56.302755 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:56.303356 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:56.303534 12346 raft_consensus.cc:2468] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 5.
I20260709 12:16:56.304118 11524 raft_consensus.cc:2468] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 2.
I20260709 12:16:56.301188 11445 raft_consensus.cc:2468] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 2.
I20260709 12:16:56.299487 12770 raft_consensus.cc:3060] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:56.305787 12204 leader_election.cc:304] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:56.306625 12684 raft_consensus.cc:2804] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:56.280064 12693 leader_election.cc:290] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:56.306996 12684 raft_consensus.cc:493] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:56.307394 12684 raft_consensus.cc:3060] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:56.308692 11419 leader_election.cc:304] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:56.282703 12723 leader_election.cc:290] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:56.312752 12727 raft_consensus.cc:2804] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:56.313185 12727 raft_consensus.cc:493] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:56.313578 12727 raft_consensus.cc:3060] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:56.313594 12693 raft_consensus.cc:493] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.301266 12769 raft_consensus.cc:2804] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:56.314177 12693 raft_consensus.cc:515] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:56.302839 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:56.315541 11593 raft_consensus.cc:2468] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 4.
I20260709 12:16:56.315678 12685 leader_election.cc:290] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:56.316985 12667 leader_election.cc:290] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:56.311201 12755 raft_consensus.cc:1081] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 4 LEADER]: Signalling peer 1c101e338f954ef086338e251deed19d to start an election
I20260709 12:16:56.281728 12794 raft_consensus.cc:515] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:56.318324 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c355b3902a4e7fb72bac6a91ea3316" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:56.319478 12737 raft_consensus.cc:515] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:56.319968 12794 leader_election.cc:290] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:56.320974 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:56.321669 11522 raft_consensus.cc:2468] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 4.
I20260709 12:16:56.285000 12710 leader_election.cc:290] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:56.321703 12657 leader_election.cc:290] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:56.325839 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:56.296667 12713 raft_consensus.cc:3060] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:56.326558 11524 raft_consensus.cc:2468] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 5.
I20260709 12:16:56.326915 12693 leader_election.cc:290] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:56.314896 12769 raft_consensus.cc:493] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:56.330273 12769 raft_consensus.cc:3060] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:56.330504 12204 leader_election.cc:304] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:56.331506 12204 leader_election.cc:304] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:56.332263 12750 raft_consensus.cc:2804] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:56.332551 12677 raft_consensus.cc:2804] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:16:56.332314 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:56.333154 12677 raft_consensus.cc:493] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:56.333719 12677 raft_consensus.cc:3060] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:56.334712 12770 raft_consensus.cc:515] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:56.337786 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:56.338398 11527 raft_consensus.cc:3060] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:56.338820 12792 raft_consensus.cc:515] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:56.332706 12750 raft_consensus.cc:493] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:56.332981 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:56.347759 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:56.382211 12359 raft_consensus.cc:3060] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:56.347844 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c355b3902a4e7fb72bac6a91ea3316" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:56.348253 11527 raft_consensus.cc:2468] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 4.
I20260709 12:16:56.384738 11566 leader_election.cc:304] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:16:56.349125 11522 raft_consensus.cc:2468] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 2.
I20260709 12:16:56.353816 12345 raft_consensus.cc:2468] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 3.
W20260709 12:16:56.380342 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 128583us
I20260709 12:16:56.346710 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:56.393234 12784 raft_consensus.cc:2804] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:56.341099 12792 leader_election.cc:290] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:56.393824 12784 raft_consensus.cc:697] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:56.341781 12754 raft_consensus.cc:515] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:56.386190 11600 raft_consensus.cc:2393] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 2: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:16:56.358520 12793 raft_consensus.cc:515] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:56.396045 12754 leader_election.cc:290] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:56.394769 12784 consensus_queue.cc:237] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:56.396826 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:56.346223 12737 leader_election.cc:290] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:56.350246 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:56.397961 12790 consensus_queue.cc:1048] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:56.345536 11524 raft_consensus.cc:2468] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 3.
I20260709 12:16:56.356592 12766 raft_consensus.cc:515] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:56.398806 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:56.387015 11419 leader_election.cc:304] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:56.351524 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:56.341507 12770 leader_election.cc:290] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:56.381315 12778 raft_consensus.cc:2749] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:56.400563 11527 raft_consensus.cc:3060] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:16:56.341418 12750 raft_consensus.cc:3060] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:56.385360 12755 raft_consensus.cc:493] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.356014 12727 raft_consensus.cc:515] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:56.401425 12755 raft_consensus.cc:515] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:56.364279 12681 raft_consensus.cc:493] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.350349 11446 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "167448b175c040d180318f81f6d10c8d"
dest_uuid: "1c101e338f954ef086338e251deed19d"
 from {username='slave'} at 127.0.0.1:58868
I20260709 12:16:56.402563 12681 raft_consensus.cc:515] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:56.403255 11446 raft_consensus.cc:493] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:56.381072 12723 raft_consensus.cc:493] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:16:56.394843 12791 raft_consensus.cc:493] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:16:56.404115 12723 raft_consensus.cc:515] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:56.350857 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:56.363687 12782 raft_consensus.cc:993] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8: : Instructing follower 1c101e338f954ef086338e251deed19d to start an election
I20260709 12:16:56.346738 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:56.397490 12346 raft_consensus.cc:3060] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:56.404688 12681 leader_election.cc:290] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:56.407238 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:56.407346 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:56.408449 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:56.408826 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:56.400256 11526 raft_consensus.cc:2393] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 4: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:16:56.408016 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:56.409611 12345 raft_consensus.cc:3060] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:56.400125 11453 raft_consensus.cc:2468] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 3.
I20260709 12:16:56.409490 12203 leader_election.cc:304] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:56.408425 11523 raft_consensus.cc:3060] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:56.411166 11528 raft_consensus.cc:2468] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 2.
I20260709 12:16:56.412241 11491 leader_election.cc:304] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:56.409092 11450 raft_consensus.cc:2468] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 1.
I20260709 12:16:56.348361 12684 raft_consensus.cc:515] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:56.418964 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:56.410102 11520 raft_consensus.cc:2468] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 4.
I20260709 12:16:56.414820 11565 leader_election.cc:304] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:16:56.416007 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:56.397572 12793 leader_election.cc:290] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:56.404891 11602 raft_consensus.cc:2468] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 4.
I20260709 12:16:56.405179 12791 raft_consensus.cc:515] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:56.413594 11527 raft_consensus.cc:2468] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 5.
I20260709 12:16:56.417698 11593 raft_consensus.cc:3060] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:56.403129 12727 leader_election.cc:290] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:56.417534 12771 consensus_queue.cc:1059] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:56.424762 11445 raft_consensus.cc:2393] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 6: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:16:56.400766 12737 raft_consensus.cc:2804] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:56.385363 12765 raft_consensus.cc:493] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:16:56.422295 11600 raft_consensus.cc:3060] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:56.436132 12203 leader_election.cc:304] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:56.438728 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:56.438864 12204 leader_election.cc:304] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:56.440112 11566 leader_election.cc:304] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:16:56.445906 12347 raft_consensus.cc:3060] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:56.403576 12755 leader_election.cc:290] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:56.389600 12680 raft_consensus.cc:493] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.420007 12782 raft_consensus.cc:1081] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Signalling peer 1c101e338f954ef086338e251deed19d to start an election
I20260709 12:16:56.400770 12766 leader_election.cc:290] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:56.450980 12204 leader_election.cc:304] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:56.475690 11600 raft_consensus.cc:2468] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 5.
I20260709 12:16:56.444546 12345 raft_consensus.cc:2468] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 3.
I20260709 12:16:56.414104 11446 raft_consensus.cc:3060] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:56.417537 12693 raft_consensus.cc:3060] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:56.467336 12347 raft_consensus.cc:2468] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 4.
I20260709 12:16:56.470185 12794 raft_consensus.cc:2804] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:56.385488 12769 raft_consensus.cc:515] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:56.458135 12765 raft_consensus.cc:515] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:56.342974 12694 raft_consensus.cc:515] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:56.431149 12779 raft_consensus.cc:493] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.419667 12678 consensus_queue.cc:1048] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 12:16:56.470444 12690 raft_consensus.cc:493] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:56.470299 12682 raft_consensus.cc:493] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:16:56.449994 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:56.476095 12638 raft_consensus.cc:493] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.471437 12737 raft_consensus.cc:697] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 3 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:16:56.496500 12638 raft_consensus.cc:515] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:56.497517 12737 consensus_queue.cc:237] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:56.501101 12684 leader_election.cc:290] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:56.501991 12763 raft_consensus.cc:3055] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:56.502489 12763 raft_consensus.cc:740] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:16:56.444128 12727 raft_consensus.cc:493] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:16:56.503165 12727 raft_consensus.cc:515] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:56.503332 12763 consensus_queue.cc:260] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:56.504734 12763 raft_consensus.cc:3060] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:56.429780 12754 raft_consensus.cc:493] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:16:56.417475 12778 consensus_queue.cc:1048] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 12:16:56.498921 11523 raft_consensus.cc:2468] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 3.
I20260709 12:16:56.483990 11567 leader_election.cc:304] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:56.508702 11493 leader_election.cc:304] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:56.443945 12793 raft_consensus.cc:493] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.432811 12681 raft_consensus.cc:2804] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:56.394708 12756 raft_consensus.cc:515] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:56.470211 12680 raft_consensus.cc:515] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:56.534794 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:56.535434 11522 raft_consensus.cc:3060] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:16:56.536661 12346 raft_consensus.cc:2468] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 4.
I20260709 12:16:56.537273 12791 leader_election.cc:290] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:56.537853 12791 raft_consensus.cc:493] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:16:56.458320 12657 raft_consensus.cc:2804] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:56.341009 12677 raft_consensus.cc:515] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:56.423210 12792 raft_consensus.cc:493] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:16:56.518244 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:56.479055 12794 raft_consensus.cc:493] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:56.519752 12638 leader_election.cc:290] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:56.480964 12769 leader_election.cc:290] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:56.521525 12770 raft_consensus.cc:2804] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:56.484725 12765 leader_election.cc:290] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:56.523171 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:56.523981 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:56.524516 12681 raft_consensus.cc:493] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:56.526197 12750 raft_consensus.cc:515] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:56.530624 12729 raft_consensus.cc:2804] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:56.530869 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:56.477880 12757 raft_consensus.cc:2804] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:56.505409 12727 leader_election.cc:290] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:16:56.473318 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 61151.8us
I20260709 12:16:56.514606 12359 raft_consensus.cc:2468] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 3.
I20260709 12:16:56.516991 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:56.577555 12357 raft_consensus.cc:2393] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 4: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:16:56.686090 11526 raft_consensus.cc:3060] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:56.516633 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:56.510529 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:56.565644 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:56.689680 11600 raft_consensus.cc:3060] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:56.691391 11454 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb"
dest_uuid: "1c101e338f954ef086338e251deed19d"
 from {username='slave'} at 127.0.0.1:58868
I20260709 12:16:56.692054 11454 raft_consensus.cc:493] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:56.692390 11454 raft_consensus.cc:3060] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:56.475966 12790 raft_consensus.cc:2749] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:16:56.486526 12695 raft_consensus.cc:493] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.505810 12754 raft_consensus.cc:515] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:56.573947 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:56.486231 12694 leader_election.cc:290] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:56.541721 12678 raft_consensus.cc:2804] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:56.571756 11602 raft_consensus.cc:2468] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 1.
I20260709 12:16:56.541551 12657 raft_consensus.cc:493] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:56.538321 12791 raft_consensus.cc:515] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:56.519637 12793 raft_consensus.cc:515] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:56.507083 12723 leader_election.cc:290] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:56.485039 12779 raft_consensus.cc:515] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:56.542129 12756 leader_election.cc:290] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:56.488633 12682 raft_consensus.cc:515] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:56.726171 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:56.567561 12794 raft_consensus.cc:3060] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:56.677026 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:56.567816 12755 raft_consensus.cc:493] T da8741606df54c3f8b5cc5c1141862ea P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:16:56.487780 12690 raft_consensus.cc:515] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:56.726655 12657 raft_consensus.cc:3060] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:56.696763 11527 raft_consensus.cc:2468] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 2.
I20260709 12:16:56.698499 11600 raft_consensus.cc:2468] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 5.
I20260709 12:16:56.569792 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:56.564155 11598 raft_consensus.cc:2468] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 2.
I20260709 12:16:56.706154 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:56.708630 11520 raft_consensus.cc:2468] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 2.
I20260709 12:16:56.705257 11526 raft_consensus.cc:2468] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 3.
I20260709 12:16:56.711619 11418 leader_election.cc:304] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:56.596371 12730 raft_consensus.cc:493] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.594251 12681 raft_consensus.cc:3060] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:56.716329 11522 raft_consensus.cc:2468] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 5.
I20260709 12:16:56.727506 12352 raft_consensus.cc:2393] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 6: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:16:56.701647 12727 raft_consensus.cc:493] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:16:56.570547 12792 raft_consensus.cc:515] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:56.609539 11599 raft_consensus.cc:3060] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:56.676937 12757 raft_consensus.cc:493] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:56.722412 11419 leader_election.cc:304] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:56.727697 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:56.729512 12678 raft_consensus.cc:697] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 4 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:16:56.730953 11449 raft_consensus.cc:1240] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 2 LEADER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:56.693915 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:56.734618 11445 raft_consensus.cc:3060] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:56.701040 12729 raft_consensus.cc:697] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 5 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:16:56.743764 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:56.705622 11593 raft_consensus.cc:2468] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 3.
I20260709 12:16:56.711990 12770 raft_consensus.cc:697] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:56.757489 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:56.763350 12203 leader_election.cc:304] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:56.764019 12756 raft_consensus.cc:493] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.737826 12680 leader_election.cc:290] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:56.719322 12348 raft_consensus.cc:2393] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 5: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:16:56.768347 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:16:56.769781 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 58270.6us
I20260709 12:16:56.774983 12723 raft_consensus.cc:2749] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:56.745276 11454 raft_consensus.cc:515] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:56.734855 12755 raft_consensus.cc:515] T da8741606df54c3f8b5cc5c1141862ea P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
W20260709 12:16:56.774318 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 60368us
I20260709 12:16:56.809640 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:56.810325 11527 raft_consensus.cc:2468] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 5.
W20260709 12:16:56.775085 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 52763us
I20260709 12:16:56.734133 12682 leader_election.cc:290] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:56.735929 12793 leader_election.cc:290] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:56.729558 12809 raft_consensus.cc:493] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:56.821656 12809 raft_consensus.cc:515] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:56.823000 12693 raft_consensus.cc:2749] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:56.823977 12809 leader_election.cc:290] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:56.717451 12695 raft_consensus.cc:515] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:56.800530 11600 raft_consensus.cc:2468] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 4.
I20260709 12:16:56.788213 12729 consensus_queue.cc:237] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:56.828317 12359 raft_consensus.cc:1275] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:56.829332 12792 leader_election.cc:290] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:56.802879 11418 leader_election.cc:304] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:56.830562 12779 leader_election.cc:290] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:56.794510 12756 raft_consensus.cc:515] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:56.833905 12791 leader_election.cc:290] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:56.772014 11417 leader_election.cc:304] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:16:56.835299 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:56.836229 11452 raft_consensus.cc:2393] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 6: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:16:56.778208 12757 raft_consensus.cc:3060] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:16:56.835348 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 63443us
I20260709 12:16:56.837989 12754 leader_election.cc:290] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:56.726636 11448 raft_consensus.cc:1275] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:56.807071 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:56.838923 12693 raft_consensus.cc:493] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.808179 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:56.839589 12693 raft_consensus.cc:515] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:56.840097 11526 raft_consensus.cc:3060] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:56.808969 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:56.838937 11417 leader_election.cc:304] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:16:56.812600 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:56.842995 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8741606df54c3f8b5cc5c1141862ea" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:56.843559 12809 raft_consensus.cc:2804] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:56.814288 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:56.784415 11447 raft_consensus.cc:2468] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 1.
I20260709 12:16:56.844102 12809 raft_consensus.cc:697] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 3 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:16:56.843974 11446 raft_consensus.cc:515] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:56.845052 12809 consensus_queue.cc:237] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:56.845656 11453 raft_consensus.cc:1240] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:56.841424 11520 raft_consensus.cc:2468] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 2.
I20260709 12:16:56.794660 12811 raft_consensus.cc:2804] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:56.846908 12811 raft_consensus.cc:697] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 3 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:16:56.848191 12819 raft_consensus.cc:493] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.847944 12811 consensus_queue.cc:237] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:56.848672 12737 raft_consensus.cc:493] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.849203 12737 raft_consensus.cc:515] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:56.850755 12677 leader_election.cc:290] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:56.851289 12737 leader_election.cc:290] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:56.776966 12727 raft_consensus.cc:515] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:56.852371 11450 raft_consensus.cc:2468] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 1.
I20260709 12:16:56.811851 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:56.818456 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:56.853440 12727 leader_election.cc:290] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
W20260709 12:16:56.819162 12806 log.cc:927] Time spent T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:16:56.853888 11596 raft_consensus.cc:2393] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 4: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:16:56.794683 12667 raft_consensus.cc:2804] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:56.854550 12667 raft_consensus.cc:697] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 5 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:16:56.855397 12667 consensus_queue.cc:237] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:56.856349 11526 raft_consensus.cc:2468] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 3.
I20260709 12:16:56.794662 12678 consensus_queue.cc:237] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:56.858479 12657 raft_consensus.cc:515] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:56.859751 12750 leader_election.cc:290] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:56.860841 11593 raft_consensus.cc:1275] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:56.848706 12819 raft_consensus.cc:515] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:56.769966 12730 raft_consensus.cc:515] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:56.864241 12819 leader_election.cc:290] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:56.864878 12730 leader_election.cc:290] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:56.824949 12755 leader_election.cc:290] T da8741606df54c3f8b5cc5c1141862ea P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:56.817564 11597 raft_consensus.cc:1240] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:56.802457 11445 raft_consensus.cc:2468] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 3.
I20260709 12:16:56.813061 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:56.826437 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:56.867846 11600 raft_consensus.cc:2393] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 4: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:16:56.866590 12756 leader_election.cc:290] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:56.813434 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:56.868749 11523 raft_consensus.cc:3060] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:16:56.868940 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:56.822589 12770 consensus_queue.cc:237] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:56.864895 12791 raft_consensus.cc:2749] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:56.826444 12203 leader_election.cc:304] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
W20260709 12:16:56.871774 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 45411.5us
I20260709 12:16:56.874579 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:56.875087 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:56.875795 11445 raft_consensus.cc:2468] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 2.
I20260709 12:16:56.869732 12346 raft_consensus.cc:2468] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 4.
I20260709 12:16:56.880015 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:56.885917 12347 raft_consensus.cc:2468] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 3.
I20260709 12:16:56.861040 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:56.847944 12695 leader_election.cc:290] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:56.911037 11566 leader_election.cc:304] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:16:56.891894 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:56.896926 11599 raft_consensus.cc:2468] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 3.
I20260709 12:16:56.871068 12794 raft_consensus.cc:515] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:56.897544 12778 consensus_queue.cc:1048] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:56.898343 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:56.899312 12690 leader_election.cc:290] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:56.899444 11446 leader_election.cc:290] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:56.892947 12756 raft_consensus.cc:2804] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:56.901227 12681 raft_consensus.cc:515] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:56.904510 11521 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35be292dd086433e8b50b99e6f150395"
dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
mode: GRACEFUL
new_leader_uuid: "b126028166e8480ba25541bf8f7fc6de"
 from {username='slave'} at 127.0.0.1:42478
I20260709 12:16:56.905314 12203 leader_election.cc:304] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:56.885579 12792 raft_consensus.cc:2804] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:56.907836 12680 raft_consensus.cc:493] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.935422 11565 leader_election.cc:304] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:56.935685 11567 leader_election.cc:304] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:56.908064 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8741606df54c3f8b5cc5c1141862ea" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:56.909477 12359 raft_consensus.cc:1275] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:56.910135 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:56.912865 12361 raft_consensus.cc:3060] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:56.913797 11419 leader_election.cc:304] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:56.916209 12347 raft_consensus.cc:1240] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:56.937991 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:56.934403 12203 leader_election.cc:304] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:56.940507 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:56.919468 11566 leader_election.cc:304] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
W20260709 12:16:56.927480 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 43898.2us
I20260709 12:16:56.889679 12730 raft_consensus.cc:493] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.943699 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:56.950320 11599 raft_consensus.cc:3055] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:16:56.950150 12730 raft_consensus.cc:515] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:56.950771 11599 raft_consensus.cc:740] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:56.951651 11599 consensus_queue.cc:260] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:56.952360 12730 leader_election.cc:290] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:56.952965 11599 raft_consensus.cc:3060] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:56.954190 12657 leader_election.cc:290] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:56.956372 12792 raft_consensus.cc:493] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting leader election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:16:56.956935 12792 raft_consensus.cc:3060] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:56.957298 11448 raft_consensus.cc:1240] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 3 LEADER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:16:56.961508 12680 raft_consensus.cc:515] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:56.962225 12693 leader_election.cc:290] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:56.962894 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:56.963093 11599 raft_consensus.cc:2468] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 5.
I20260709 12:16:56.963728 12680 leader_election.cc:290] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:56.965005 12357 raft_consensus.cc:2393] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 3: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:16:56.966252 12684 raft_consensus.cc:2804] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:56.931274 12638 raft_consensus.cc:493] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.966821 12684 raft_consensus.cc:697] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 3 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:16:56.918285 12737 raft_consensus.cc:493] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:56.967128 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:56.967481 12737 raft_consensus.cc:515] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:56.967724 12684 consensus_queue.cc:237] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:56.937108 12756 raft_consensus.cc:493] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:56.969880 12756 raft_consensus.cc:3060] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:56.906416 11523 raft_consensus.cc:2468] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 6.
I20260709 12:16:56.924237 11522 raft_consensus.cc:2468] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 2.
I20260709 12:16:56.941270 11526 raft_consensus.cc:2468] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 3.
W20260709 12:16:56.978483 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 64758.9us
I20260709 12:16:56.918016 12677 raft_consensus.cc:493] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.941996 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:56.942330 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:56.983352 12677 raft_consensus.cc:515] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:56.942778 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9fe9a94294836aec652338f44367d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:56.943305 11602 raft_consensus.cc:1240] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:56.984459 11597 raft_consensus.cc:2468] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 2.
I20260709 12:16:56.973282 12765 raft_consensus.cc:2804] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:56.985081 12765 raft_consensus.cc:493] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:56.982581 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:56.943615 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:56.937789 12695 raft_consensus.cc:493] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.986341 11454 leader_election.cc:290] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:56.986491 12695 raft_consensus.cc:515] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:56.988811 12695 leader_election.cc:290] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:56.948803 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:16:56.989296 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 76945.6us
I20260709 12:16:56.989724 11598 raft_consensus.cc:2393] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 4: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:16:56.943239 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:56.942555 12750 raft_consensus.cc:2804] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:56.991226 12750 raft_consensus.cc:493] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:56.991621 12750 raft_consensus.cc:3060] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:56.979615 11525 raft_consensus.cc:3060] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:56.994105 11519 raft_consensus.cc:1275] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:56.995501 11519 raft_consensus.cc:1275] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:56.996459 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:56.997748 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9fe9a94294836aec652338f44367d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:56.998418 11526 raft_consensus.cc:2468] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 1.
I20260709 12:16:57.000360 12681 leader_election.cc:290] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:57.000488 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:56.967141 12638 raft_consensus.cc:515] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:57.003101 12638 leader_election.cc:290] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:56.998293 12820 consensus_queue.cc:1048] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:16:57.003993 11596 raft_consensus.cc:2393] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 4: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:16:56.943308 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:57.005108 11601 raft_consensus.cc:2468] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 2.
I20260709 12:16:56.963639 11452 raft_consensus.cc:2468] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 3.
I20260709 12:16:56.986162 11527 raft_consensus.cc:2393] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 6: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
W20260709 12:16:56.949488 12804 log.cc:927] Time spent T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.155s	user 0.003s	sys 0.001s
I20260709 12:16:56.971980 11593 raft_consensus.cc:3055] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:56.982537 11599 raft_consensus.cc:1275] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:56.986147 12700 raft_consensus.cc:2804] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:57.007347 12700 raft_consensus.cc:493] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:16:57.007714 12700 raft_consensus.cc:3060] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.008256 11593 raft_consensus.cc:740] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:56.952365 12794 leader_election.cc:290] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:57.009095 11593 consensus_queue.cc:260] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:57.010258 11593 raft_consensus.cc:3060] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:57.012396 12776 consensus_queue.cc:1059] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:57.012633 12690 consensus_queue.cc:1048] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:57.014077 12817 raft_consensus.cc:3055] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:57.003187 12677 leader_election.cc:290] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:56.980607 12810 raft_consensus.cc:2749] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:56.985478 12765 raft_consensus.cc:3060] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:57.014457 12817 raft_consensus.cc:740] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:16:57.017007 12737 leader_election.cc:290] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
W20260709 12:16:56.981050 11568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:16:57.017958 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 82329.4us
I20260709 12:16:57.021622 12779 raft_consensus.cc:2804] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:57.005198 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:57.022349 12779 raft_consensus.cc:493] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:57.017513 12817 consensus_queue.cc:260] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:57.023787 12817 raft_consensus.cc:3060] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:57.022958 12779 raft_consensus.cc:3060] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:57.028165 12203 leader_election.cc:304] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:57.030026 12693 raft_consensus.cc:2804] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:57.030606 12693 raft_consensus.cc:697] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 3 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:16:57.031626 11453 raft_consensus.cc:3060] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:57.032156 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:57.032943 12693 consensus_queue.cc:237] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:57.033855 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:57.034248 12638 raft_consensus.cc:2804] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:57.034713 12638 raft_consensus.cc:493] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:57.035187 12638 raft_consensus.cc:3060] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:57.035404 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:57.036139 11596 raft_consensus.cc:2468] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 3.
I20260709 12:16:57.017625 12680 raft_consensus.cc:493] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.038213 12680 raft_consensus.cc:515] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:57.029045 12757 raft_consensus.cc:515] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:57.040107 11600 raft_consensus.cc:2393] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 5: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:16:56.979261 11419 leader_election.cc:304] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
W20260709 12:16:57.041039 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 61854.2us
I20260709 12:16:57.041720 12737 raft_consensus.cc:2804] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:57.042358 12737 raft_consensus.cc:493] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:57.042778 12737 raft_consensus.cc:3060] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:16:57.033946 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 114564us
I20260709 12:16:57.049477 11417 leader_election.cc:304] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:57.049958 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:57.050662 12810 raft_consensus.cc:2749] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:57.052160 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:57.053051 12348 raft_consensus.cc:2468] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 3.
I20260709 12:16:57.054201 11417 leader_election.cc:304] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:16:57.050714 12357 raft_consensus.cc:3060] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:57.055238 12810 raft_consensus.cc:2804] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:57.055778 12810 raft_consensus.cc:697] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 5 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:16:57.058348 11417 leader_election.cc:304] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:16:57.059199 12723 raft_consensus.cc:2804] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:57.059593 12723 raft_consensus.cc:493] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:57.059942 12723 raft_consensus.cc:3060] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:57.061522 12820 consensus_queue.cc:1059] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:57.062516 12721 raft_consensus.cc:3055] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:57.062875 12721 raft_consensus.cc:740] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:16:57.063643 12721 consensus_queue.cc:260] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:57.067189 12721 raft_consensus.cc:3060] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:57.056627 12810 consensus_queue.cc:237] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:57.067873 12203 leader_election.cc:304] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:57.068874 12677 raft_consensus.cc:2804] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:57.069298 12677 raft_consensus.cc:493] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:57.069710 12677 raft_consensus.cc:3060] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:57.070482 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:57.071218 11523 raft_consensus.cc:2468] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 1.
I20260709 12:16:57.071785 11418 leader_election.cc:304] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:57.032898 11522 raft_consensus.cc:2393] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 2: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:16:57.072623 12791 raft_consensus.cc:2749] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:57.074572 12757 leader_election.cc:290] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:57.082487 11567 leader_election.cc:304] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:57.084630 12695 raft_consensus.cc:2804] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:57.085145 12695 raft_consensus.cc:493] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:57.085564 12695 raft_consensus.cc:3060] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:57.094408 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:57.095261 12359 raft_consensus.cc:2468] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 4.
W20260709 12:16:57.096238 11493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:57.098768 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:57.099603 12359 raft_consensus.cc:2468] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 4.
I20260709 12:16:57.102542 11525 raft_consensus.cc:2468] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 5.
I20260709 12:16:57.102682 12680 leader_election.cc:290] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:57.104508 12361 raft_consensus.cc:2468] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 4.
I20260709 12:16:57.105727 11418 leader_election.cc:304] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
W20260709 12:16:57.112962 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 45181.7us
I20260709 12:16:57.113117 11417 leader_election.cc:304] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:16:57.117631 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8741606df54c3f8b5cc5c1141862ea" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:57.112516 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:57.119269 12348 raft_consensus.cc:1275] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:57.124549 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:57.125311 11454 raft_consensus.cc:2468] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 2.
W20260709 12:16:57.114434 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 53674.3us
I20260709 12:16:57.120174 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:57.127036 12203 leader_election.cc:304] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:57.132421 12791 raft_consensus.cc:2804] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:16:57.132727 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:57.133049 12730 raft_consensus.cc:493] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:16:57.133621 12730 raft_consensus.cc:515] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:57.134917 12657 raft_consensus.cc:2804] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:57.135385 12657 raft_consensus.cc:493] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:57.135748 12657 raft_consensus.cc:3060] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:57.136716 12755 raft_consensus.cc:493] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.137238 12755 raft_consensus.cc:515] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:57.120133 11567 leader_election.cc:304] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:57.143823 11567 leader_election.cc:304] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:57.145447 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:57.147423 11418 leader_election.cc:304] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:57.147720 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:57.148669 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:57.151093 12348 raft_consensus.cc:2468] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 3.
I20260709 12:16:57.145463 11453 raft_consensus.cc:2468] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 4.
I20260709 12:16:57.161645 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:57.160668 12361 raft_consensus.cc:1275] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:57.163244 11521 raft_consensus.cc:606] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 4 LEADER]: Received request to transfer leadership to TS b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:57.164899 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:57.168821 11601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "1c101e338f954ef086338e251deed19d"
 from {username='slave'} at 127.0.0.1:37992
I20260709 12:16:57.169569 11601 raft_consensus.cc:606] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Received request to transfer leadership to TS 1c101e338f954ef086338e251deed19d
I20260709 12:16:57.172863 11601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "b126028166e8480ba25541bf8f7fc6de"
 from {username='slave'} at 127.0.0.1:37992
I20260709 12:16:57.173543 11601 raft_consensus.cc:606] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Received request to transfer leadership to TS b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:57.138029 12809 raft_consensus.cc:2804] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:57.162392 11567 leader_election.cc:304] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:57.135804 12730 leader_election.cc:290] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:57.178489 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:57.138346 12757 raft_consensus.cc:493] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.101218 12700 raft_consensus.cc:515] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:57.197124 11523 raft_consensus.cc:1275] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:57.153506 12680 raft_consensus.cc:2804] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:57.179689 12793 raft_consensus.cc:493] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.201165 11454 raft_consensus.cc:1240] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:16:57.196290 11521 raft_consensus.cc:2468] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 1.
I20260709 12:16:57.202853 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:57.204202 11523 raft_consensus.cc:3060] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:57.203215 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:57.207367 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:57.208117 11453 raft_consensus.cc:2468] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 2.
I20260709 12:16:57.137681 12756 raft_consensus.cc:515] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:57.216079 12204 leader_election.cc:304] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:57.207002 11448 raft_consensus.cc:2468] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 2.
I20260709 12:16:57.147042 12778 consensus_queue.cc:1048] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 12:16:57.217274 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:57.223366 11521 raft_consensus.cc:2393] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 5: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:16:57.219591 11601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e896afa1887146dfade142338e2fc407"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "1c101e338f954ef086338e251deed19d"
 from {username='slave'} at 127.0.0.1:37992
I20260709 12:16:57.160143 12819 raft_consensus.cc:2804] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:57.216079 11566 leader_election.cc:304] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:57.222604 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:57.218694 12204 leader_election.cc:304] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:16:57.194339 12809 raft_consensus.cc:493] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:57.154397 12727 consensus_queue.cc:1048] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 12:16:57.198819 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8741606df54c3f8b5cc5c1141862ea" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:57.233042 12349 raft_consensus.cc:2368] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for earlier term 4. Current term is 5.
I20260709 12:16:57.224612 11601 raft_consensus.cc:606] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Received request to transfer leadership to TS 1c101e338f954ef086338e251deed19d
I20260709 12:16:57.151455 12811 consensus_queue.cc:1048] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 12:16:57.151722 12766 consensus_queue.cc:1048] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 12:16:57.226377 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:57.234526 11448 raft_consensus.cc:3060] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:16:57.194120 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:57.202801 12782 raft_consensus.cc:2804] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:57.211499 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:57.235702 11523 raft_consensus.cc:2468] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 3.
I20260709 12:16:57.223865 12667 raft_consensus.cc:2749] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:16:57.227640 12819 raft_consensus.cc:493] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:57.253461 12819 raft_consensus.cc:3060] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:57.254323 12755 leader_election.cc:290] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:57.256995 12700 leader_election.cc:290] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:57.257963 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffe47647c274723808482c166efa21c" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:57.258662 12349 raft_consensus.cc:2468] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 3.
I20260709 12:16:57.259033 12638 raft_consensus.cc:515] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:57.259984 11567 leader_election.cc:304] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:57.265703 11448 raft_consensus.cc:2468] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 3.
I20260709 12:16:57.266693 12737 raft_consensus.cc:515] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:57.269734 12784 raft_consensus.cc:2804] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:57.270248 12784 raft_consensus.cc:493] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:57.270587 12784 raft_consensus.cc:3060] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:57.274982 12750 raft_consensus.cc:515] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:57.276325 12345 raft_consensus.cc:1240] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:16:57.280557 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:57.281291 11453 raft_consensus.cc:2468] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 4.
I20260709 12:16:57.206645 12757 raft_consensus.cc:515] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:57.284982 12757 leader_election.cc:290] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:57.238895 12728 raft_consensus.cc:2749] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:57.206457 12682 consensus_queue.cc:1048] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:16:57.240268 11419 leader_election.cc:304] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
W20260709 12:16:57.286317 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 46129.9us
I20260709 12:16:57.287334 11419 leader_election.cc:304] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:57.288189 11599 raft_consensus.cc:2393] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 3: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:16:57.291139 12756 leader_election.cc:290] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:57.292122 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffe47647c274723808482c166efa21c" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:57.293964 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:57.241662 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:57.225013 12730 raft_consensus.cc:2749] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:57.295858 12730 consensus_queue.cc:1048] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:57.238176 12723 raft_consensus.cc:515] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:57.246296  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:16:57.300072 12723 leader_election.cc:290] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:57.300257  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:57.238155 12357 raft_consensus.cc:2468] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 5.
I20260709 12:16:57.210966 12680 raft_consensus.cc:493] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:57.269588 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:57.238081 12792 raft_consensus.cc:515] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
W20260709 12:16:57.302316 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 67721.8us
I20260709 12:16:57.305215 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:57.311122 11601 raft_consensus.cc:3060] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:57.306785 12348 raft_consensus.cc:1275] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:57.301085 11596 raft_consensus.cc:2468] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 2.
I20260709 12:16:57.301259 12680 raft_consensus.cc:3060] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:57.303429 11565 leader_election.cc:304] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:16:57.232307 12809 raft_consensus.cc:3060] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:57.235373 12729 raft_consensus.cc:2804] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:57.328528 12348 raft_consensus.cc:1275] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:57.296967 12657 raft_consensus.cc:515] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:57.334529 11565 leader_election.cc:304] T da8741606df54c3f8b5cc5c1141862ea P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:57.336232 11453 raft_consensus.cc:1275] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:57.241055 12782 raft_consensus.cc:493] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:57.219165 12793 raft_consensus.cc:515] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:57.286563 12727 raft_consensus.cc:2804] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:57.352468 12793 leader_election.cc:290] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:57.346854 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:57.261227 12779 raft_consensus.cc:515] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:57.354156 11449 raft_consensus.cc:2468] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 1.
I20260709 12:16:57.355180 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:57.355809 12779 leader_election.cc:290] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:57.356005 11522 raft_consensus.cc:3060] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:16:57.357573 11601 raft_consensus.cc:2468] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 5.
W20260709 12:16:57.339432 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 192059us
I20260709 12:16:57.342305 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:57.359195 12345 raft_consensus.cc:2393] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 3: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:16:57.343264 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:57.359642 11523 raft_consensus.cc:3060] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:57.343549 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:57.261248 12638 leader_election.cc:290] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:57.365579 11565 leader_election.cc:304] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:16:57.368716 11523 raft_consensus.cc:2468] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 4.
I20260709 12:16:57.363422 11521 raft_consensus.cc:2468] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 4.
I20260709 12:16:57.332361 12700 raft_consensus.cc:493] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.238196 12765 raft_consensus.cc:515] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:57.380091 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:57.385736 11521 raft_consensus.cc:2468] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 3.
I20260709 12:16:57.360148 12203 leader_election.cc:304] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:57.345054 12754 raft_consensus.cc:2804] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:57.347283 12782 raft_consensus.cc:3060] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:57.392490 12750 leader_election.cc:290] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:57.346763 12701 raft_consensus.cc:2749] T da8741606df54c3f8b5cc5c1141862ea P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:57.389966 12700 raft_consensus.cc:515] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:57.347359 12729 raft_consensus.cc:697] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 5 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:16:57.395339 12677 raft_consensus.cc:515] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:57.397591 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:57.385248 12727 raft_consensus.cc:697] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 4 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:16:57.339076 12770 consensus_queue.cc:1048] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 12:16:57.403307 11595 raft_consensus.cc:2368] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 2. Current term is 3.
I20260709 12:16:57.404844 12204 leader_election.cc:304] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:57.405334 11522 raft_consensus.cc:2468] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 5.
I20260709 12:16:57.410887 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:57.420085 11453 raft_consensus.cc:3060] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:57.421027 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:57.390185 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
W20260709 12:16:57.399838 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 178101us
I20260709 12:16:57.402397 12728 raft_consensus.cc:2804] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:57.441427 11453 raft_consensus.cc:2468] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 3.
I20260709 12:16:57.421700 11523 raft_consensus.cc:1275] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:16:57.398758 12754 raft_consensus.cc:493] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:16:57.444597 12754 raft_consensus.cc:3060] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:57.406783 12791 raft_consensus.cc:697] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 6 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:16:57.413268 11451 raft_consensus.cc:2468] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 3.
I20260709 12:16:57.425259 12204 leader_election.cc:304] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:57.427525 12785 raft_consensus.cc:2804] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:57.427647 11524 raft_consensus.cc:3060] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:57.386999 12723 consensus_queue.cc:1048] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:16:57.461526 11493 leader_election.cc:400] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Vote denied by peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935) with higher term. Message: Invalid argument: T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for earlier term 4. Current term is 5.
I20260709 12:16:57.461936 11493 leader_election.cc:403] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:16:57.453370 12693 raft_consensus.cc:2804] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:57.428267 12727 consensus_queue.cc:237] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:57.406240 11593 raft_consensus.cc:2468] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 4.
W20260709 12:16:57.411765 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 77387.4us
I20260709 12:16:57.398448 12793 raft_consensus.cc:2804] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:57.446760 12203 leader_election.cc:304] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:57.447052 12347 raft_consensus.cc:2368] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 3. Current term is 4.
I20260709 12:16:57.412880 12737 leader_election.cc:290] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:57.466678 11566 leader_election.cc:304] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:57.468581 11524 raft_consensus.cc:2468] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 3.
I20260709 12:16:57.450096 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9fe9a94294836aec652338f44367d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:57.469538 11527 raft_consensus.cc:3060] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:16:57.470117 11566 leader_election.cc:304] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
W20260709 12:16:57.453465 12827 log.cc:927] Time spent T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:16:57.415851 12730 raft_consensus.cc:2749] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:57.430321 12701 raft_consensus.cc:993] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8: : Instructing follower 1c101e338f954ef086338e251deed19d to start an election
I20260709 12:16:57.447633 12835 consensus_queue.cc:1048] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:16:57.450598 12785 raft_consensus.cc:493] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:16:57.467566 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 99173.1us
I20260709 12:16:57.450635 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:57.472576 11566 leader_election.cc:304] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:57.465754 12693 raft_consensus.cc:697] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 5 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:16:57.504949 11522 raft_consensus.cc:2393] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 2: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:16:57.476140 11524 raft_consensus.cc:1275] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:16:57.454206 12728 raft_consensus.cc:697] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:57.498437 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:57.508149 11524 pending_rounds.cc:85] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671: Aborting all ops after (but not including) 1
I20260709 12:16:57.508538 11524 pending_rounds.cc:107] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:16:57.508977 11524 raft_consensus.cc:2889] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:57.510419 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:57.511157 11446 raft_consensus.cc:3060] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:16:57.510695 12693 consensus_queue.cc:237] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:57.511538 12682 raft_consensus.cc:1081] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Signalling peer 1c101e338f954ef086338e251deed19d to start an election
I20260709 12:16:57.512533 12803 raft_consensus.cc:2749] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:16:57.470183 12721 raft_consensus.cc:2749] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935) with higher term. Message: Invalid argument: T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for earlier term 4. Current term is 5.
I20260709 12:16:57.471366 12684 raft_consensus.cc:2804] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:57.479792 12793 raft_consensus.cc:697] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 4 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
W20260709 12:16:57.533690 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 61183.3us
I20260709 12:16:57.536736 11527 raft_consensus.cc:2468] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 3.
I20260709 12:16:57.538244 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:57.539166 11527 raft_consensus.cc:2393] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 3: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:16:57.538976 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:57.478801 12840 raft_consensus.cc:2749] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:57.506567 12785 raft_consensus.cc:3060] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:57.480316 12842 raft_consensus.cc:2804] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:57.540154 11523 raft_consensus.cc:2468] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 2.
I20260709 12:16:57.501588 12737 raft_consensus.cc:493] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:57.541167 11417 leader_election.cc:304] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:57.538146 11418 leader_election.cc:304] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:16:57.482957 12757 consensus_queue.cc:1048] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 12:16:57.550151 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:57.463394 12791 consensus_queue.cc:237] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:57.537837 12684 raft_consensus.cc:697] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 3 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:16:57.561159 11601 raft_consensus.cc:1275] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:57.521430 12723 raft_consensus.cc:493] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:57.563079 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c355b3902a4e7fb72bac6a91ea3316" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:57.564164 11566 leader_election.cc:304] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:57.525341 12771 consensus_queue.cc:1059] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:16:57.545262 12842 raft_consensus.cc:493] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:57.497784 12729 consensus_queue.cc:237] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:57.583833 11566 leader_election.cc:304] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:16:57.584465 12832 consensus_queue.cc:1048] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 12:16:57.585264 12838 raft_consensus.cc:2804] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:57.585638 12840 raft_consensus.cc:2749] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:16:57.586220 12818 raft_consensus.cc:493] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:57.586416 12840 raft_consensus.cc:2804] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:57.587170 12840 raft_consensus.cc:493] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:16:57.587397 12830 log.cc:927] Time spent T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:16:57.587509 12840 raft_consensus.cc:3060] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:57.585011 11566 leader_election.cc:304] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:57.558945 12811 raft_consensus.cc:2804] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:16:57.586599 12828 log.cc:927] Time spent T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 12:16:57.570595 12792 leader_election.cc:290] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:57.560904 12657 leader_election.cc:290] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:57.582849 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:57.600512 12811 raft_consensus.cc:697] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [term 3 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
W20260709 12:16:57.601845 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 94160.3us
I20260709 12:16:57.548388 12819 raft_consensus.cc:515] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:57.605281 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:57.549798 12737 raft_consensus.cc:515] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:57.585806 12838 raft_consensus.cc:493] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:16:57.589795 12765 leader_election.cc:290] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:57.583621 12842 raft_consensus.cc:3060] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:57.594556 12818 raft_consensus.cc:515] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:57.579936 12723 raft_consensus.cc:515] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:57.629402 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:57.635764 11522 raft_consensus.cc:3060] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:57.637636 11520 raft_consensus.cc:3060] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:57.664253 12848 raft_consensus.cc:2749] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:16:57.670552 12837 log.cc:927] Time spent T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 12:16:57.597783 12793 consensus_queue.cc:237] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:57.622948 12677 leader_election.cc:290] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:57.624567 12838 raft_consensus.cc:3060] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.643052 12700 leader_election.cc:290] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:57.660756 12757 raft_consensus.cc:493] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.592871 12728 consensus_queue.cc:237] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:57.685825 11599 raft_consensus.cc:2368] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 4. Current term is 5.
I20260709 12:16:57.698550 11453 raft_consensus.cc:1240] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:57.708388 11524 raft_consensus.cc:1275] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:57.698060 11522 raft_consensus.cc:2468] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 3.
I20260709 12:16:57.677230 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:57.710026 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:57.699407 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c355b3902a4e7fb72bac6a91ea3316" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:57.714138 11451 raft_consensus.cc:3060] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:16:57.714480 11566 leader_election.cc:304] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:16:57.689968 11597 raft_consensus.cc:1240] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:57.719060 12833 consensus_queue.cc:1048] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:16:57.720986 12737 leader_election.cc:290] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:57.721527 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:57.723470 12851 raft_consensus.cc:493] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
W20260709 12:16:57.725183 12813 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.952s	user 0.014s	sys 0.011s
I20260709 12:16:57.725692 12792 raft_consensus.cc:493] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:57.726764 12809 raft_consensus.cc:515] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:57.728655 12694 raft_consensus.cc:993] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8: : Instructing follower 1c101e338f954ef086338e251deed19d to start an election
W20260709 12:16:57.721056 12695 consensus_meta.cc:287] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8: Time spent flushing consensus metadata: real 0.635s	user 0.013s	sys 0.000s
I20260709 12:16:57.733732 11596 raft_consensus.cc:1275] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:16:57.644148 12684 consensus_queue.cc:237] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:57.724750 12782 raft_consensus.cc:515] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:57.736368 12851 raft_consensus.cc:515] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:57.731997 12352 raft_consensus.cc:3060] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:57.737483 11452 raft_consensus.cc:3060] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:16:57.703171 11449 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d"
dest_uuid: "1c101e338f954ef086338e251deed19d"
 from {username='slave'} at 127.0.0.1:58868
I20260709 12:16:57.744124 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
W20260709 12:16:57.729678 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 120781us
I20260709 12:16:57.736794 12723 leader_election.cc:290] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:57.748572 12359 raft_consensus.cc:1275] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:57.736435 12819 leader_election.cc:290] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:57.752729 12841 raft_consensus.cc:1081] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Signalling peer 1c101e338f954ef086338e251deed19d to start an election
I20260709 12:16:57.734556 12700 raft_consensus.cc:2804] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:57.764415 11453 raft_consensus.cc:3060] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:57.765880 11417 leader_election.cc:304] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
W20260709 12:16:57.737965 12813 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.965s	user 0.016s	sys 0.011s
I20260709 12:16:57.710811 12757 raft_consensus.cc:515] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:57.731014 12681 consensus_queue.cc:1048] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:16:57.778497 11417 leader_election.cc:400] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Vote denied by peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973) with higher term. Message: Invalid argument: T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 2. Current term is 3.
I20260709 12:16:57.779138 11417 leader_election.cc:403] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:16:57.709161 12811 consensus_queue.cc:237] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:57.774948 12678 raft_consensus.cc:493] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.788123 12678 raft_consensus.cc:515] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:57.746765 12792 raft_consensus.cc:515] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:57.775811 11449 raft_consensus.cc:493] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:57.791385 12754 raft_consensus.cc:515] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:57.789588 11447 raft_consensus.cc:2393] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 3: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:16:57.822808 12851 leader_election.cc:290] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:57.751156 12695 raft_consensus.cc:515] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:57.828475 11451 raft_consensus.cc:2468] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 3.
I20260709 12:16:57.826191 11449 raft_consensus.cc:3060] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.830310 11446 raft_consensus.cc:2468] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 5.
I20260709 12:16:57.780946 12737 raft_consensus.cc:2749] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:16:57.839048 11453 raft_consensus.cc:2468] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 5.
I20260709 12:16:57.851876 11520 raft_consensus.cc:1275] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:57.785547 12700 raft_consensus.cc:697] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:57.858209 11600 raft_consensus.cc:2368] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 3. Current term is 4.
I20260709 12:16:57.863862 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:57.864717 12359 raft_consensus.cc:2468] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 4.
I20260709 12:16:57.869200 11567 leader_election.cc:304] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:57.831442 12818 leader_election.cc:290] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:57.840601 12853 raft_consensus.cc:2749] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973) with higher term. Message: Invalid argument: T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 2. Current term is 3.
W20260709 12:16:57.870481 12784 consensus_meta.cc:287] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8: Time spent flushing consensus metadata: real 0.599s	user 0.008s	sys 0.003s
I20260709 12:16:57.878075 12681 raft_consensus.cc:2749] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:16:57.866209 12842 raft_consensus.cc:515] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
W20260709 12:16:57.884797 12680 consensus_meta.cc:287] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8: Time spent flushing consensus metadata: real 0.544s	user 0.011s	sys 0.001s
I20260709 12:16:57.905920 12790 consensus_queue.cc:1048] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:57.908030 12754 leader_election.cc:290] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:57.908933 12695 leader_election.cc:290] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:57.909672 12792 leader_election.cc:290] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:57.912537 12757 leader_election.cc:290] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:57.913038 11449 raft_consensus.cc:515] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:57.913842 12840 raft_consensus.cc:515] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:57.915475 11449 leader_election.cc:290] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:57.916105 12840 leader_election.cc:290] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:57.890877 12775 consensus_queue.cc:1059] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.200s
W20260709 12:16:57.950906 11493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 70345.8us
I20260709 12:16:57.891778 12784 raft_consensus.cc:515] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:57.948907 12809 leader_election.cc:290] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:57.977362 11417 leader_election.cc:400] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 election: Vote denied by peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973) with higher term. Message: Invalid argument: T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 4. Current term is 5.
I20260709 12:16:57.978189 11417 leader_election.cc:403] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:16:57.978331 11493 leader_election.cc:304] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:57.917840 12680 raft_consensus.cc:515] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:57.946138 12792 consensus_queue.cc:1048] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:16:57.953928 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:57.903560 12700 consensus_queue.cc:237] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:57.980238 12678 leader_election.cc:290] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:57.979025 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:57.979679 12782 leader_election.cc:290] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
W20260709 12:16:58.012485 12859 log.cc:927] Time spent T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:16:57.981490 12727 raft_consensus.cc:2749] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973) with higher term. Message: Invalid argument: T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 4. Current term is 5.
I20260709 12:16:57.982460 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:58.030411 11598 raft_consensus.cc:2368] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 3. Current term is 4.
I20260709 12:16:58.031538 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:58.032379 11598 raft_consensus.cc:2393] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 3: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:16:58.035169 11417 leader_election.cc:400] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Vote denied by peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973) with higher term. Message: Invalid argument: T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 3. Current term is 4.
I20260709 12:16:58.035796 11417 leader_election.cc:403] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:16:58.037714 12810 raft_consensus.cc:3060] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:16:58.040547 11452 raft_consensus.cc:2468] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 4.
I20260709 12:16:58.030303 11273 catalog_manager.cc:5697] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 2 to 3, leader changed from 1c101e338f954ef086338e251deed19d (127.3.212.130) to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 3 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:58.033249 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffe47647c274723808482c166efa21c" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:58.051614 11417 leader_election.cc:400] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Vote denied by peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973) with higher term. Message: Invalid argument: T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 3. Current term is 4.
I20260709 12:16:58.052083 11417 leader_election.cc:403] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:16:58.053519 11600 raft_consensus.cc:1275] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:16:58.054253 11493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 76001.8us
I20260709 12:16:58.055179 11598 raft_consensus.cc:2368] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 3. Current term is 4.
I20260709 12:16:58.055220 11596 raft_consensus.cc:2368] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 3. Current term is 4.
I20260709 12:16:58.056581 12852 raft_consensus.cc:3060] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:16:58.046866 11599 raft_consensus.cc:3055] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:58.060729 11417 leader_election.cc:400] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Vote denied by peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973) with higher term. Message: Invalid argument: T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 3. Current term is 4.
I20260709 12:16:58.061110 11417 leader_election.cc:403] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:16:58.046561 12867 raft_consensus.cc:2804] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:16:58.052384 12845 log.cc:927] Time spent T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.487s	user 0.008s	sys 0.015s
I20260709 12:16:58.063078 12820 raft_consensus.cc:3055] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:58.063839 12727 consensus_queue.cc:1048] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:58.069139 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:58.076593 12359 raft_consensus.cc:3060] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:58.069963 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:58.074095 11417 leader_election.cc:400] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Vote denied by peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973) with higher term. Message: Invalid argument: T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 3. Current term is 4.
I20260709 12:16:58.077407 12348 raft_consensus.cc:3060] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:58.077656 11417 leader_election.cc:403] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:16:58.093415 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:58.061407 11599 raft_consensus.cc:740] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:58.095636 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e4724ed93a467ea47763eec9a6de2e" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:58.097673 11527 raft_consensus.cc:2468] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 2.
I20260709 12:16:58.098769 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:58.072909 12867 raft_consensus.cc:493] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:58.076073 12820 raft_consensus.cc:740] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:16:58.078717 12723 raft_consensus.cc:3060] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:16:58.112051 11523 raft_consensus.cc:3060] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:58.084000 12811 raft_consensus.cc:2749] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973) with higher term. Message: Invalid argument: T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 3. Current term is 4.
I20260709 12:16:58.116828 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:58.119138 11524 raft_consensus.cc:3060] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:16:58.114315 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffe47647c274723808482c166efa21c" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:58.123478 12361 raft_consensus.cc:3060] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:58.117967 11566 leader_election.cc:304] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:16:58.138800 11523 raft_consensus.cc:2468] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 3.
I20260709 12:16:58.098879 12842 leader_election.cc:290] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:58.179247 11274 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39286 (request call id 107) took 3051 ms. Trace:
W20260709 12:16:58.183079 12860 log.cc:927] Time spent T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.313s	user 0.000s	sys 0.002s
I20260709 12:16:58.183645 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9fe9a94294836aec652338f44367d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:58.184653 11593 raft_consensus.cc:3060] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:58.185442 12680 leader_election.cc:290] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:58.100289 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:58.152258 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:58.154085 12784 leader_election.cc:290] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
W20260709 12:16:58.155061 12872 log.cc:927] Time spent T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 12:16:58.194756 12359 raft_consensus.cc:2468] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 5.
I20260709 12:16:58.156643 11566 leader_election.cc:304] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:16:58.195991 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:58.196657 12359 raft_consensus.cc:3060] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:58.197727 11567 leader_election.cc:304] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:58.114799 12867 raft_consensus.cc:3060] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:58.173626 12810 raft_consensus.cc:2749] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973) with higher term. Message: Invalid argument: T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 3. Current term is 4.
I20260709 12:16:58.152084 12848 raft_consensus.cc:2804] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:58.202572 11524 raft_consensus.cc:2468] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 3.
I20260709 12:16:58.163609 12361 raft_consensus.cc:2468] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 4.
I20260709 12:16:58.206012 12359 raft_consensus.cc:2468] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 5.
I20260709 12:16:58.215201 11567 leader_election.cc:304] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:58.199069 12348 raft_consensus.cc:2468] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 4.
I20260709 12:16:58.216214 11566 leader_election.cc:304] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:16:58.179816 11274 rpcz_store.cc:276] 0709 12:16:55.128256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:55.129121 (+   865us) service_pool.cc:224] Handling call
0709 12:16:58.179125 (+3050004us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:16:56.470551 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:16:56.493808 (+ 23257us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:16:56.493841 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:16:56.493858 (+    17us) tablet.cc:662] Decoding operations
0709 12:16:56.494177 (+   319us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:16:56.494225 (+    48us) write_op.cc:641] Partition lock acquired for write op
0709 12:16:56.494255 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:16:56.494448 (+   193us) tablet.cc:701] Row locks acquired
0709 12:16:56.494465 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:16:56.494606 (+   141us) write_op.cc:270] Start()
0709 12:16:56.494845 (+   239us) write_op.cc:276] Timestamp: P: 1783599416494562 usec, L: 0
0709 12:16:56.494866 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:16:56.495543 (+   677us) log.cc:844] Serialized 540 byte log entry
0709 12:16:56.773028 (+277485us) op_driver.cc:464] REPLICATION: finished
0709 12:16:56.942432 (+169404us) spinlock_profiling.cc:243] Waited 2.65 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e3ab90ac 00007f84ec9139a9 00007f84e3ad569b 00007f84e3ad393f 00007f84e3ad5c02 00007f84ea5f9ef0
0709 12:16:57.351792 (+409360us) write_op.cc:301] APPLY: starting
0709 12:16:57.351873 (+    81us) tablet.cc:1367] starting BulkCheckPresence
0709 12:16:57.351972 (+    99us) tablet.cc:1370] finished BulkCheckPresence
0709 12:16:57.351990 (+    18us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:16:57.352252 (+   262us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:16:57.352398 (+   146us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:16:57.352442 (+    44us) write_op.cc:312] APPLY: finished
0709 12:16:57.352626 (+   184us) log.cc:844] Serialized 22 byte log entry
0709 12:16:57.352791 (+   165us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:57.352863 (+    72us) write_op.cc:454] Released schema lock
0709 12:16:57.352903 (+    40us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":386175,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":578515,"apply.run_cpu_time_us":1441,"apply.run_wall_time_us":1441,"num_ops":1,"prepare.queue_time_us":355979,"prepare.run_cpu_time_us":2747,"prepare.run_wall_time_us":53594,"replication_time_us":278009,"spinlock_wait_cycles":6090112,"thread_start_us":1205845,"threads_started":2}]]}
I20260709 12:16:58.217532 11567 leader_election.cc:304] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:58.220686 11567 leader_election.cc:304] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:58.188177 11599 consensus_queue.cc:260] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:58.126536 12838 raft_consensus.cc:515] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:58.218590 12842 raft_consensus.cc:2804] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:58.234493 12842 raft_consensus.cc:697] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 5 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:58.224622 12856 raft_consensus.cc:2804] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:58.207942 12784 raft_consensus.cc:2804] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:58.224532 12683 raft_consensus.cc:2804] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:58.224471 12755 raft_consensus.cc:2804] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:58.220108 12770 raft_consensus.cc:2804] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:58.212055 12848 raft_consensus.cc:493] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:58.222265 12357 raft_consensus.cc:2393] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 4: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
W20260709 12:16:58.223564 12785 consensus_meta.cc:287] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de: Time spent flushing consensus metadata: real 0.674s	user 0.010s	sys 0.003s
I20260709 12:16:58.239822 12683 raft_consensus.cc:697] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:58.223985 12852 raft_consensus.cc:2749] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973) with higher term. Message: Invalid argument: T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 3. Current term is 4.
I20260709 12:16:58.235208 12856 raft_consensus.cc:697] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:58.241955 12848 raft_consensus.cc:3060] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:58.241847 12784 raft_consensus.cc:697] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:58.216075 12820 consensus_queue.cc:260] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:58.247635 11599 raft_consensus.cc:3060] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:58.244367 12770 raft_consensus.cc:697] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 4 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:58.247536 12755 raft_consensus.cc:697] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:58.257313 12842 consensus_queue.cc:237] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:58.262094 12856 consensus_queue.cc:237] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:58.263062 12784 consensus_queue.cc:237] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:58.248363 12785 raft_consensus.cc:515] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:58.274276 12785 leader_election.cc:290] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:58.282024 11450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58856 (request call id 433) took 1386 ms. Trace:
I20260709 12:16:58.282141 11593 raft_consensus.cc:2468] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 3.
I20260709 12:16:58.282658 11450 rpcz_store.cc:276] 0709 12:16:56.891009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:56.891146 (+   137us) service_pool.cc:224] Handling call
0709 12:16:56.891471 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:56.971218 (+ 79747us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:56.971248 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:56.971740 (+   492us) log.cc:844] Serialized 26 byte log entry
0709 12:16:57.326505 (+354765us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:57.413312 (+ 86807us) log.cc:844] Serialized 14 byte log entry
0709 12:16:57.413551 (+   239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:57.672206 (+258655us) spinlock_profiling.cc:243] Waited 2.79 ms on lock 0x7b18003813a0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3aa42a6 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419
0709 12:16:58.276987 (+604781us) spinlock_profiling.cc:243] Waited 79.4 ms on lock 0x7b54001aa754. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:16:58.277040 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:58.277083 (+    43us) raft_consensus.cc:1685] finished
0709 12:16:58.277095 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:58.277266 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17043,"prepare.queue_time_us":179319,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":8745,"raft.queue_time_us":1190,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":25666,"spinlock_wait_cycles":188950656,"thread_start_us":427334,"threads_started":2,"wal-append.queue_time_us":411177}
I20260709 12:16:58.285353 12770 consensus_queue.cc:237] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:58.287626 12755 consensus_queue.cc:237] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:58.289173 12818 raft_consensus.cc:3055] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:58.289659 12818 raft_consensus.cc:740] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:16:58.290556 12818 consensus_queue.cc:260] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:58.268064 12683 consensus_queue.cc:237] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:58.305074 12723 raft_consensus.cc:2749] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973) with higher term. Message: Invalid argument: T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 3. Current term is 4.
I20260709 12:16:58.270638 12820 raft_consensus.cc:3060] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:16:58.308533 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 859897us
I20260709 12:16:58.321590 12204 leader_election.cc:304] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:16:58.322505 12793 consensus_queue.cc:1048] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:58.324376 12793 raft_consensus.cc:2804] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:58.324908 12793 raft_consensus.cc:697] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 3 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:16:58.327538 11522 raft_consensus.cc:1275] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:16:58.329842 12727 raft_consensus.cc:493] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:16:58.330520 12727 raft_consensus.cc:515] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:58.332363 12810 consensus_queue.cc:1048] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:58.332803 12727 leader_election.cc:290] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:58.337749 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e4724ed93a467ea47763eec9a6de2e" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:58.338550 11449 raft_consensus.cc:2468] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 1.
I20260709 12:16:58.346978 11523 raft_consensus.cc:1275] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:16:58.347456 11523 pending_rounds.cc:85] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671: Aborting all ops after (but not including) 1
I20260709 12:16:58.347681 11523 pending_rounds.cc:107] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:16:58.347893 11523 raft_consensus.cc:2889] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:58.348961 11419 leader_election.cc:400] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Vote denied by peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935) with higher term. Message: Invalid argument: T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 3. Current term is 4.
I20260709 12:16:58.349314 11521 raft_consensus.cc:1275] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:16:58.349728 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:58.355391 11525 raft_consensus.cc:3060] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:58.247923 12352 raft_consensus.cc:2468] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 4.
I20260709 12:16:58.337771 12793 consensus_queue.cc:237] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:58.364753 12359 raft_consensus.cc:1275] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:16:58.370327 11524 raft_consensus.cc:1275] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:58.373634 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:58.374145 12359 raft_consensus.cc:1275] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:58.374452 12361 raft_consensus.cc:2368] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 3. Current term is 4.
I20260709 12:16:58.377213 11525 raft_consensus.cc:2468] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 4.
I20260709 12:16:58.377969 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffe47647c274723808482c166efa21c" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:58.410629 12361 raft_consensus.cc:2368] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 3. Current term is 4.
I20260709 12:16:58.378698 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:58.412070 12347 raft_consensus.cc:2368] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 3. Current term is 4.
I20260709 12:16:58.380072 12359 raft_consensus.cc:1275] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:58.385316 12684 consensus_queue.cc:1048] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:58.385692 12727 consensus_queue.cc:1048] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:58.385854 11491 leader_election.cc:304] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:16:58.417286 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e4724ed93a467ea47763eec9a6de2e" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:58.418210 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:58.418911 11519 raft_consensus.cc:3060] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:58.419720 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:58.420545 11528 raft_consensus.cc:2393] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 3: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:16:58.421561 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:58.386089 12729 consensus_queue.cc:1048] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:58.386826 11419 leader_election.cc:400] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Vote denied by peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935) with higher term. Message: Invalid argument: T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 3. Current term is 4.
I20260709 12:16:58.427727 11519 raft_consensus.cc:2468] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 2.
I20260709 12:16:58.429251 11519 raft_consensus.cc:1275] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:16:58.387953 12756 consensus_queue.cc:1048] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:58.389266 12693 consensus_queue.cc:1048] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:58.393503  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:58.399927 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:58.449759 11522 raft_consensus.cc:3060] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:58.386677 12792 consensus_queue.cc:1048] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:58.418201 11525 raft_consensus.cc:2393] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 2: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:16:58.438028 11418 leader_election.cc:304] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:58.451162 11521 raft_consensus.cc:1275] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:16:58.452272 11494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:58.455932 11521 raft_consensus.cc:1275] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:58.462242 11567 leader_election.cc:304] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:58.459645 11418 leader_election.cc:304] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:16:58.472076 12811 consensus_queue.cc:1048] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:16:58.437031 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
W20260709 12:16:58.466647 12876 log.cc:927] Time spent T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:16:58.465497 12723 raft_consensus.cc:2749] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:16:58.469892 12790 raft_consensus.cc:2804] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:16:58.472795 12833 raft_consensus.cc:2804] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:58.474742 12682 raft_consensus.cc:2804] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:58.489074 11449 raft_consensus.cc:1240] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:16:58.475400 12852 consensus_queue.cc:1048] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:16:58.523991 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:58.518967 12784 raft_consensus.cc:493] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:58.526350 12784 raft_consensus.cc:515] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:58.528748 12849 raft_consensus.cc:993] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8: : Instructing follower b126028166e8480ba25541bf8f7fc6de to start an election
I20260709 12:16:58.529295 12849 raft_consensus.cc:1081] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Signalling peer b126028166e8480ba25541bf8f7fc6de to start an election
I20260709 12:16:58.530104 12203 leader_election.cc:304] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:58.531190 12756 raft_consensus.cc:493] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:16:58.531760 12756 raft_consensus.cc:515] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:58.536507 12867 raft_consensus.cc:515] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:58.540113 11595 raft_consensus.cc:1275] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:58.541813 12756 leader_election.cc:290] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:58.542299 12848 raft_consensus.cc:515] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:58.542445 12785 raft_consensus.cc:2804] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:58.543251 12838 leader_election.cc:290] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:58.544900 11599 raft_consensus.cc:2468] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 2.
I20260709 12:16:58.516701 12682 raft_consensus.cc:697] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:58.518289 12357 raft_consensus.cc:2368] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 4. Current term is 5.
I20260709 12:16:58.517874 12833 raft_consensus.cc:697] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 2 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:16:58.577730 11522 raft_consensus.cc:2468] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 5.
I20260709 12:16:58.584858 11524 raft_consensus.cc:1275] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:16:58.600065 11524 pending_rounds.cc:85] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671: Aborting all ops after (but not including) 1
I20260709 12:16:58.600404 11524 pending_rounds.cc:107] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:16:58.600660 11524 raft_consensus.cc:2889] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:16:58.601567 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 216592us
I20260709 12:16:58.586053 11527 raft_consensus.cc:3060] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:58.602762 11419 leader_election.cc:400] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Vote denied by peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935) with higher term. Message: Invalid argument: T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 3. Current term is 4.
I20260709 12:16:58.606065 11419 leader_election.cc:400] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Vote denied by peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935) with higher term. Message: Invalid argument: T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 3. Current term is 4.
I20260709 12:16:58.608637 11419 leader_election.cc:304] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:58.609541 12204 leader_election.cc:304] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:16:58.621708 12792 raft_consensus.cc:2749] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:58.576268 12785 raft_consensus.cc:697] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 5 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:16:58.632251 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:58.632491 11419 leader_election.cc:400] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 election: Vote denied by peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935) with higher term. Message: Invalid argument: T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 4. Current term is 5.
I20260709 12:16:58.633841 12684 raft_consensus.cc:2804] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:58.635155 12833 consensus_queue.cc:237] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:58.641155 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:58.642011 11595 raft_consensus.cc:2393] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 4: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
W20260709 12:16:58.646314 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 178291us
I20260709 12:16:58.641346 12832 raft_consensus.cc:493] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:16:58.630748 12346 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 634) took 1512 ms. Trace:
W20260709 12:16:58.643285 12885 log.cc:927] Time spent T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 12:16:58.622767 12838 consensus_queue.cc:1048] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 12:16:58.656518 11595 raft_consensus.cc:1275] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:16:58.658385 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:58.659219 12792 raft_consensus.cc:493] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:16:58.662930 12785 consensus_queue.cc:237] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:58.664539 12848 leader_election.cc:290] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:58.666209 11599 raft_consensus.cc:1275] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:16:58.642355 12684 raft_consensus.cc:697] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 4 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:16:58.670338 12867 leader_election.cc:290] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:58.642122 12729 consensus_queue.cc:1048] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:16:58.687968 12832 raft_consensus.cc:515] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:58.721716 12729 consensus_queue.cc:1048] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:58.633891 12682 consensus_queue.cc:237] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:58.645505 12357 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a"
dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
 from {username='slave'} at 127.0.0.1:51706
I20260709 12:16:58.672629 12817 raft_consensus.cc:993] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671: : Instructing follower b126028166e8480ba25541bf8f7fc6de to start an election
I20260709 12:16:58.679980 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:16:58.685158 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:58.686480 11527 raft_consensus.cc:2468] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 5.
I20260709 12:16:58.736052 11526 raft_consensus.cc:2368] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 2. Current term is 3.
I20260709 12:16:58.736632 12361 raft_consensus.cc:2368] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for earlier term 4. Current term is 5.
I20260709 12:16:58.725823 12357 raft_consensus.cc:493] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:58.738370 12357 raft_consensus.cc:3060] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:58.740386 12817 raft_consensus.cc:1081] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 4 LEADER]: Signalling peer b126028166e8480ba25541bf8f7fc6de to start an election
I20260709 12:16:58.739094 11493 leader_election.cc:400] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 election: Vote denied by peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935) with higher term. Message: Invalid argument: T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for earlier term 4. Current term is 5.
I20260709 12:16:58.741304 11493 leader_election.cc:403] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:16:58.742388 12874 raft_consensus.cc:2749] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935) with higher term. Message: Invalid argument: T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for earlier term 4. Current term is 5.
I20260709 12:16:58.745759 12361 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35be292dd086433e8b50b99e6f150395"
dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
 from {username='slave'} at 127.0.0.1:51690
I20260709 12:16:58.687481 12346 rpcz_store.cc:276] 0709 12:16:57.116155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.146174 (+ 30019us) service_pool.cc:224] Handling call
0709 12:16:58.618994 (+1472820us) spinlock_profiling.cc:243] Waited 711 ms on lock 0x7b5400005ad4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:16:58.628370 (+  9376us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1635672832}
I20260709 12:16:58.714632 12792 raft_consensus.cc:515] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:58.756637 12902 raft_consensus.cc:493] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:16:58.813047 12361 raft_consensus.cc:493] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:58.813664 12361 raft_consensus.cc:3060] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:58.821606 11450 raft_consensus.cc:1275] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:58.821929 11445 raft_consensus.cc:1275] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:58.811190 12690 raft_consensus.cc:493] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:58.845687 12361 raft_consensus.cc:515] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:58.838135 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:58.850365 11602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55250 (request call id 429) took 1223 ms. Trace:
I20260709 12:16:58.850885 11602 rpcz_store.cc:276] 0709 12:16:57.626626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.628950 (+  2324us) service_pool.cc:224] Handling call
0709 12:16:58.399934 (+770984us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b5800220b98. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9ee9c 00007f84e3a9ea5b 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb9cfc0 00007f84ebb87929 00007f84ebb873d2 00007f84e50febd4
0709 12:16:58.400164 (+   230us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:58.400604 (+   440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:58.400641 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:58.401228 (+   587us) log.cc:844] Serialized 26 byte log entry
0709 12:16:58.555071 (+153843us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:16:58.801881 (+246810us) log.cc:844] Serialized 14 byte log entry
0709 12:16:58.822895 (+ 21014us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:58.830937 (+  8042us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:16:58.834402 (+  3465us) raft_consensus.cc:1685] finished
0709 12:16:58.844451 (+ 10049us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:16:58.847181 (+  2730us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":82774,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":8077,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":34181,"spinlock_wait_cycles":36446080,"thread_start_us":321541,"threads_started":2,"wal-append.queue_time_us":240191}
I20260709 12:16:58.798501 12684 consensus_queue.cc:237] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:58.855340 12347 raft_consensus.cc:1275] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:16:58.858067 12723 consensus_queue.cc:1048] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:58.858938 11449 raft_consensus.cc:2468] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 4.
I20260709 12:16:58.837324 12853 raft_consensus.cc:493] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:16:58.811005 12902 raft_consensus.cc:515] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:58.876360 12784 leader_election.cc:290] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:58.842329 12690 raft_consensus.cc:515] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
W20260709 12:16:58.868453 12895 log.cc:927] Time spent T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:16:58.909858 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:58.910662 11452 raft_consensus.cc:3060] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:58.925632 12790 raft_consensus.cc:493] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:58.925401 12357 raft_consensus.cc:515] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:58.926239 12790 raft_consensus.cc:3060] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:58.928309 12357 leader_election.cc:290] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:58.869119 12853 raft_consensus.cc:515] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:58.931702 12853 leader_election.cc:290] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:58.933574 12810 raft_consensus.cc:493] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:58.934154 12810 raft_consensus.cc:515] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:58.937031 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:58.944484 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:16:58.942128 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 237428us
I20260709 12:16:58.942845 12833 raft_consensus.cc:493] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:58.940014 12853 raft_consensus.cc:493] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:16:58.962888 12203 leader_election.cc:304] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:16:58.975989 12911 raft_consensus.cc:2804] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:58.976975 12911 raft_consensus.cc:697] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 4 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
W20260709 12:16:59.012733 11565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:58.992671 11418 leader_election.cc:400] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 election: Vote denied by peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063) with higher term. Message: Invalid argument: T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 2. Current term is 3.
I20260709 12:16:59.014886 11418 leader_election.cc:403] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:16:59.018249 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:59.025813 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:59.029729 11448 raft_consensus.cc:2393] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 4: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:16:59.027925 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e4724ed93a467ea47763eec9a6de2e" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:59.030934 11454 raft_consensus.cc:2468] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 1.
I20260709 12:16:59.032007 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:58.955848 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:59.044984 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffe47647c274723808482c166efa21c" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:59.048813 11453 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e896afa1887146dfade142338e2fc407"
dest_uuid: "1c101e338f954ef086338e251deed19d"
 from {username='slave'} at 127.0.0.1:58868
I20260709 12:16:59.049682 11453 raft_consensus.cc:493] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:59.050099 11453 raft_consensus.cc:3060] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:58.963725 12793 consensus_queue.cc:1048] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.090s
I20260709 12:16:58.961997 12906 raft_consensus.cc:493] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:59.042678 12916 log.cc:927] Time spent T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 12:16:59.055819 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:59.070653 11526 raft_consensus.cc:2468] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 3.
I20260709 12:16:59.057839 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e4724ed93a467ea47763eec9a6de2e" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:58.961995 12756 raft_consensus.cc:493] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:16:59.062026 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:59.065768 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e4724ed93a467ea47763eec9a6de2e" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:59.071914 11448 raft_consensus.cc:3060] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Advancing to term 3
W20260709 12:16:59.073287 11494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:59.051702 12858 raft_consensus.cc:3060] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:59.017025 12811 raft_consensus.cc:493] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:58.965955 12893 consensus_queue.cc:1048] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.104s
I20260709 12:16:58.966660 12833 raft_consensus.cc:515] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:59.078323 12906 raft_consensus.cc:515] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:59.069808 12757 raft_consensus.cc:493] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:58.987401 12810 leader_election.cc:290] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:59.105688 11565 leader_election.cc:304] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:59.078825 11595 raft_consensus.cc:2393] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 3: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:16:58.977095 12792 leader_election.cc:290] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:59.087811 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:59.051369 11452 raft_consensus.cc:2468] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 4.
I20260709 12:16:58.991107 12853 raft_consensus.cc:515] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:59.108507 11565 leader_election.cc:304] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:59.056797 11449 raft_consensus.cc:3060] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.068712 11453 raft_consensus.cc:515] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:59.099424 11454 raft_consensus.cc:2468] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 4.
I20260709 12:16:59.103145 11450 raft_consensus.cc:2468] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 4.
I20260709 12:16:59.075452 11418 leader_election.cc:304] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:16:59.095436 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:59.114020 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:59.114784 11454 raft_consensus.cc:2393] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 3: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:16:59.111323 12784 raft_consensus.cc:2749] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:16:59.115664 12803 raft_consensus.cc:2749] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:16:59.063671 12817 consensus_queue.cc:1048] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 12:16:59.054003 12790 raft_consensus.cc:515] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:59.109423 12867 raft_consensus.cc:493] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.082010 12756 raft_consensus.cc:515] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:59.093904 12811 raft_consensus.cc:515] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:59.116055 12810 raft_consensus.cc:2804] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:59.132157 11448 raft_consensus.cc:2468] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 3.
I20260709 12:16:59.139622 11448 raft_consensus.cc:1275] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:59.129194 12902 leader_election.cc:290] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:59.108814 12757 raft_consensus.cc:515] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:59.161281 11445 raft_consensus.cc:1275] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:59.136505 12810 raft_consensus.cc:493] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:59.163946 11448 raft_consensus.cc:1275] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:16:59.159706 12920 log.cc:927] Time spent T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 12:16:59.160144 12869 raft_consensus.cc:493] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.135465 12867 raft_consensus.cc:515] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:59.167477 12810 raft_consensus.cc:3060] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:59.194453 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:59.182710 12723 raft_consensus.cc:493] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.112097 12911 consensus_queue.cc:237] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:59.210218 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e4724ed93a467ea47763eec9a6de2e" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:59.211138 11594 raft_consensus.cc:2368] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 2. Current term is 3.
I20260709 12:16:59.211625 11594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 565) took 1291 ms. Trace:
I20260709 12:16:59.211964 11594 rpcz_store.cc:276] 0709 12:16:57.920343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:57.945012 (+ 24669us) service_pool.cc:224] Handling call
0709 12:16:59.210007 (+1264995us) spinlock_profiling.cc:243] Waited 2.44 ms on lock 0x7b5800220b98. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb890a0 00007f84ebb88984 00007f84e51036d4 00007f84e5103662
0709 12:16:59.211531 (+  1524us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5608832}
I20260709 12:16:59.213078 12811 leader_election.cc:290] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:59.194231 12906 leader_election.cc:290] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:59.216302 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:59.217114 11528 raft_consensus.cc:2468] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 4.
I20260709 12:16:59.214123 12833 leader_election.cc:290] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
W20260709 12:16:59.217868 12923 log.cc:927] Time spent T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:16:59.219633 11418 leader_election.cc:304] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:16:59.172112 12869 raft_consensus.cc:515] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:59.205798 12723 raft_consensus.cc:515] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:59.226624 12690 leader_election.cc:290] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
W20260709 12:16:59.230398 12927 log.cc:927] Time spent T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.095s	user 0.003s	sys 0.001s
I20260709 12:16:59.230724 12867 leader_election.cc:290] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:59.212004 12853 leader_election.cc:290] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:59.234730 12756 leader_election.cc:290] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:59.238731 12869 leader_election.cc:290] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:59.240996 12723 leader_election.cc:290] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:59.246513 12899 raft_consensus.cc:493] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:16:59.247291 12899 raft_consensus.cc:515] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:59.249166 12792 raft_consensus.cc:2804] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:16:59.249720 12792 raft_consensus.cc:493] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:59.250078 12792 raft_consensus.cc:3060] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:16:59.246644 12900 log.cc:927] Time spent T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.437s	user 0.002s	sys 0.000s
I20260709 12:16:59.251209 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:59.252820 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:59.221371 12757 leader_election.cc:290] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:59.255014 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:59.255681 11526 raft_consensus.cc:2468] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 3.
I20260709 12:16:59.250780 12899 leader_election.cc:290] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:59.260188 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:59.261580 12723 raft_consensus.cc:493] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:16:59.262394 12723 raft_consensus.cc:515] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:59.267764 12723 leader_election.cc:290] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:59.271011 11418 leader_election.cc:304] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:16:59.271584 12818 raft_consensus.cc:3060] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.271778 12792 raft_consensus.cc:515] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:59.262748 11449 raft_consensus.cc:2468] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 2.
I20260709 12:16:59.250741 12352 raft_consensus.cc:1240] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 4. Current term is 5. Ops: []
I20260709 12:16:59.278465 12810 raft_consensus.cc:515] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:59.279794 12858 raft_consensus.cc:2749] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063) with higher term. Message: Invalid argument: T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 2. Current term is 3.
W20260709 12:16:59.373313 11494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:59.404475 11450 raft_consensus.cc:1240] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:16:59.404018 11452 raft_consensus.cc:1240] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:59.382390 12856 raft_consensus.cc:493] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:16:59.412947 12681 raft_consensus.cc:493] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.415058 12730 raft_consensus.cc:2804] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:59.405606 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:59.427587 11451 raft_consensus.cc:2468] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 3.
I20260709 12:16:59.434569 12681 raft_consensus.cc:515] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:59.457638 12681 leader_election.cc:290] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:59.432427 12810 leader_election.cc:290] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:59.422930 12771 consensus_queue.cc:1059] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:16:59.449458 11599 raft_consensus.cc:2468] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 3.
I20260709 12:16:59.434302 12856 raft_consensus.cc:515] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:59.469358 12856 leader_election.cc:290] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:59.473928 12792 leader_election.cc:290] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:59.482829 12730 raft_consensus.cc:493] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:16:59.483475 12730 raft_consensus.cc:3060] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:59.491032 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9fe9a94294836aec652338f44367d" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:59.491981 11594 raft_consensus.cc:2468] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 3.
I20260709 12:16:59.503849 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:59.505578 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e4724ed93a467ea47763eec9a6de2e" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:59.506402 11519 raft_consensus.cc:2393] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 3: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:16:59.514434 11527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33446 (request call id 973) took 1362 ms. Trace:
I20260709 12:16:59.515065 11527 rpcz_store.cc:276] 0709 12:16:58.151594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:58.151864 (+   270us) service_pool.cc:224] Handling call
0709 12:16:59.514245 (+1362381us) spinlock_profiling.cc:243] Waited 396 ms on lock 0x7b54001365d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:16:59.514362 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":911392128}
I20260709 12:16:59.503971 12919 consensus_queue.cc:1048] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:16:59.537799 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:59.557996 11527 raft_consensus.cc:1275] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:59.560036 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390e91331fd04f97a5235133a34875ee" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:59.517841 12818 raft_consensus.cc:493] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:16:59.562825 11527 raft_consensus.cc:1275] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:16:59.565460 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 62255.2us
I20260709 12:16:59.567010 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:59.567796 11527 raft_consensus.cc:2468] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 3.
I20260709 12:16:59.574429 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:59.587330 11526 raft_consensus.cc:1275] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:59.589493 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:16:59.591425 11524 raft_consensus.cc:1275] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:59.565404 12818 raft_consensus.cc:515] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:59.598704 12818 leader_election.cc:290] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:59.599500 12730 raft_consensus.cc:515] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:59.600452 11521 raft_consensus.cc:1275] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:16:59.611609 11566 leader_election.cc:304] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:16:59.595978 12684 raft_consensus.cc:493] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:16:59.627033 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:59.639475 11595 raft_consensus.cc:3055] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:59.628973 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:59.636298 11454 raft_consensus.cc:1275] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:59.599632 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:59.643200 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:59.638568 11417 leader_election.cc:400] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Vote denied by peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973) with higher term. Message: Invalid argument: T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 2. Current term is 3.
I20260709 12:16:59.645939 11417 leader_election.cc:403] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:16:59.648383 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:59.639864 11595 raft_consensus.cc:740] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:59.661433 11595 consensus_queue.cc:260] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:59.664657 11595 raft_consensus.cc:3060] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.666337 11450 raft_consensus.cc:1275] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:16:59.667882 12347 raft_consensus.cc:1240] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:59.668680 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:59.649281 12681 raft_consensus.cc:2804] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:16:59.663700 12809 raft_consensus.cc:2749] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973) with higher term. Message: Invalid argument: T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 2. Current term is 3.
I20260709 12:16:59.649699 12810 raft_consensus.cc:493] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:16:59.681406 12347 raft_consensus.cc:1275] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:59.665163 12693 raft_consensus.cc:493] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:16:59.616274 12842 consensus_queue.cc:1048] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 12:16:59.687763 12356 raft_consensus.cc:1275] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:59.638371 12938 consensus_queue.cc:1048] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 12:16:59.675123 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:59.678526 12681 raft_consensus.cc:493] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:59.680641 12730 leader_election.cc:290] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:59.695917 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:59.676769 12893 consensus_queue.cc:1048] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:16:59.697686 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:59.699167 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:59.699697 11600 raft_consensus.cc:1275] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:59.699949 12947 consensus_queue.cc:1048] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:59.700583 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a841f2f09ced40a4bbf33594e11bd7ad" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:59.701433 12835 raft_consensus.cc:3055] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:16:59.701879 12835 raft_consensus.cc:740] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:16:59.684316 12941 consensus_queue.cc:1048] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 12:16:59.702700 12835 consensus_queue.cc:260] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:59.703712 11597 raft_consensus.cc:1275] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:16:59.704795 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 599633us
I20260709 12:16:59.696099 12681 raft_consensus.cc:3060] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:59.691077 12693 raft_consensus.cc:515] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:59.689291 12810 raft_consensus.cc:515] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:59.712042 12810 leader_election.cc:290] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:59.710232 12693 leader_election.cc:290] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:59.659310 12684 raft_consensus.cc:515] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
W20260709 12:16:59.714557 11493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:59.715010 11417 leader_election.cc:304] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:59.716902 11522 raft_consensus.cc:1275] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:59.718588 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:59.720005 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7937e0cff84ef7a26c84247c8ffc08" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:16:59.723068 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:16:59.727680 11600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40784 (request call id 150) took 1073 ms. Trace:
I20260709 12:16:59.736338 11600 rpcz_store.cc:276] 0709 12:16:58.654427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:58.654740 (+   313us) service_pool.cc:224] Handling call
0709 12:16:59.699135 (+1044395us) spinlock_profiling.cc:243] Waited 937 us on lock 0x7b5800220b98. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb9cfc0 00007f84ebb87929 00007f84ebb873d2 00007f84e50febd4
0709 12:16:59.699326 (+   191us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:59.713205 (+ 13879us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:16:59.727620 (+ 14415us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2154752}
I20260709 12:16:59.728839 12356 raft_consensus.cc:1275] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:16:59.688663 12803 raft_consensus.cc:493] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.747279 12361 leader_election.cc:290] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:59.747282 11595 raft_consensus.cc:2468] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 2.
I20260709 12:16:59.749928 11417 leader_election.cc:304] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:59.750203 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:59.750875 11595 raft_consensus.cc:3055] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:59.751197 11595 raft_consensus.cc:740] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:59.751471 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:59.752365 11445 raft_consensus.cc:2393] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 5: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:16:59.751912 11595 consensus_queue.cc:260] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:59.752944 11595 raft_consensus.cc:3060] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:59.753991 11450 raft_consensus.cc:1240] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:59.762224 11565 leader_election.cc:304] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:59.768353 11595 raft_consensus.cc:2468] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 2.
I20260709 12:16:59.775200 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e4724ed93a467ea47763eec9a6de2e" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:16:59.775902 11454 raft_consensus.cc:2393] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 3: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:16:59.755183 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:16:59.777693 12361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:51690 (request call id 413) took 1011 ms. Trace:
I20260709 12:16:59.778187 12361 rpcz_store.cc:276] 0709 12:16:58.745458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:58.745615 (+   157us) service_pool.cc:224] Handling call
0709 12:16:59.626639 (+881024us) spinlock_profiling.cc:243] Waited 66.6 ms on lock 0x7b54004448d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bbaa3d 00007f84ebb8acd0 00007f84e510f254 00007f84e510f1e2 00007f84e510f111 00007f84e510f08c 00007f84e510e342 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:16:59.726307 (+ 99668us) spinlock_profiling.cc:243] Waited 5.04 ms on lock 0x7b4c003d6300. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e4e8fa20 00007f84e4ea0a29 00007f84e4ea113f 00007f84e4e652ab 00007f84e4e92f3c 00007f84e4e933fe 00007f84e512088b 00007f84e6b1f495 00007f84e6b7030f 00007f84e6bbaa55 00007f84ebb8acd0
0709 12:16:59.756824 (+ 30517us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":164728832}
I20260709 12:16:59.705282 11597 raft_consensus.cc:1275] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:16:59.793001 11595 raft_consensus.cc:1275] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:16:59.794595 11417 leader_election.cc:304] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:16:59.798861 11601 raft_consensus.cc:1275] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:16:59.799278 11567 leader_election.cc:304] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:16:59.735638 12835 raft_consensus.cc:3060] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:59.774008 12803 raft_consensus.cc:515] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:59.747409 12818 raft_consensus.cc:493] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.761843 12693 raft_consensus.cc:493] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.774219 12809 raft_consensus.cc:493] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.773751 12723 raft_consensus.cc:2749] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:59.803197 12727 raft_consensus.cc:2749] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:16:59.825405 12951 raft_consensus.cc:493] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.826009 12951 raft_consensus.cc:515] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:59.826406 11596 raft_consensus.cc:1240] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 2. Current term is 3. Ops: []
I20260709 12:16:59.827293 12684 leader_election.cc:290] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:59.827730 12723 raft_consensus.cc:493] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.828323 12723 raft_consensus.cc:515] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:59.831144 12790 leader_election.cc:290] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
W20260709 12:16:59.842859 11494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:16:59.811777 12842 raft_consensus.cc:2804] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:59.854322 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:59.858673 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:16:59.861603 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 251150us
I20260709 12:16:59.876492 12204 leader_election.cc:304] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:16:59.802228 12730 consensus_queue.cc:1048] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 12:16:59.888875 12951 leader_election.cc:290] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:16:59.901708 12723 leader_election.cc:290] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:16:59.822544 12818 raft_consensus.cc:515] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:59.852415 12858 raft_consensus.cc:2804] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:59.824365 12693 raft_consensus.cc:515] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:16:59.842070 12809 raft_consensus.cc:515] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:16:59.855327 12939 consensus_queue.cc:1048] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.115s
I20260709 12:16:59.917814 12842 raft_consensus.cc:697] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:16:59.982722 12842 consensus_queue.cc:237] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:16:59.917577 12684 consensus_queue.cc:1048] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.070s
I20260709 12:16:59.990216 12684 raft_consensus.cc:493] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:16:59.992174 12820 raft_consensus.cc:493] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.974611 12858 raft_consensus.cc:697] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [term 2 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:16:59.993745 12858 consensus_queue.cc:237] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:16:59.997463 12803 leader_election.cc:290] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:16:59.998646 11453 leader_election.cc:290] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
W20260709 12:16:59.972476 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 86248.1us
I20260709 12:16:59.967795 12893 raft_consensus.cc:493] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.981477 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:16:59.905279 12818 leader_election.cc:290] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:16:59.970402 12792 raft_consensus.cc:493] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.991878 12684 raft_consensus.cc:515] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:00.002538 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:16:59.882277 12770 raft_consensus.cc:2749] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:00.005402 11491 leader_election.cc:304] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:00.008677 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:00.009013 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:00.016538 12681 raft_consensus.cc:515] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:00.006232 12792 raft_consensus.cc:515] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:00.019045 12681 leader_election.cc:290] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:00.019366 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:00.020607 12792 leader_election.cc:290] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:00.024223 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:00.025161 12352 raft_consensus.cc:2468] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 3.
I20260709 12:17:00.027918 12684 leader_election.cc:290] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:00.028420 12809 leader_election.cc:290] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:17:00.006148 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 241911us
I20260709 12:17:00.029595 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:00.030325 12352 raft_consensus.cc:3060] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:00.032078 11595 raft_consensus.cc:1240] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:00.034866 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:00.036500 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a841f2f09ced40a4bbf33594e11bd7ad" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:00.028533 12906 raft_consensus.cc:3060] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:00.046412 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:00.049571 11525 raft_consensus.cc:1275] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:00.050721 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:00.055836 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:00.057562 12832 leader_election.cc:290] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:00.059274 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:00.060204 11593 raft_consensus.cc:2393] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 2: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:17:00.061890 12729 raft_consensus.cc:493] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:00.062490 12729 raft_consensus.cc:515] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:00.063983 11273 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57440 (request call id 179) took 3952 ms. Trace:
I20260709 12:17:00.064597 12729 leader_election.cc:290] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:00.057439 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:00.067067 11525 raft_consensus.cc:2468] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 2.
I20260709 12:17:00.064390 11273 rpcz_store.cc:276] 0709 12:16:56.111346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:56.111498 (+   152us) service_pool.cc:224] Handling call
0709 12:17:00.063916 (+3952418us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:16:58.659681 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:16:58.660274 (+   593us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:16:58.660308 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:16:58.660327 (+    19us) tablet.cc:662] Decoding operations
0709 12:16:58.660694 (+   367us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:16:58.660753 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 12:16:58.660783 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:16:58.660975 (+   192us) tablet.cc:701] Row locks acquired
0709 12:16:58.660989 (+    14us) write_op.cc:260] PREPARE: finished
0709 12:16:58.661137 (+   148us) write_op.cc:270] Start()
0709 12:16:58.661236 (+    99us) write_op.cc:276] Timestamp: P: 1783599418661090 usec, L: 0
0709 12:16:58.661259 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:16:58.662034 (+   775us) log.cc:844] Serialized 540 byte log entry
0709 12:16:59.175863 (+513829us) op_driver.cc:464] REPLICATION: finished
0709 12:16:59.455635 (+279772us) write_op.cc:301] APPLY: starting
0709 12:16:59.455724 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 12:16:59.455819 (+    95us) tablet.cc:1370] finished BulkCheckPresence
0709 12:16:59.455938 (+   119us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:16:59.456143 (+   205us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:16:59.456355 (+   212us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:16:59.456420 (+    65us) write_op.cc:312] APPLY: finished
0709 12:16:59.456607 (+   187us) log.cc:844] Serialized 22 byte log entry
0709 12:16:59.456778 (+   171us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:59.456859 (+    81us) write_op.cc:454] Released schema lock
0709 12:16:59.456898 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 12:16:59.457269 (+   371us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:16:59.457299 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":793519,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":269435,"apply.run_cpu_time_us":1617,"apply.run_wall_time_us":1624,"num_ops":1,"prepare.queue_time_us":470968,"prepare.run_cpu_time_us":13100,"prepare.run_wall_time_us":183524,"raft.queue_time_us":183162,"raft.run_cpu_time_us":188901,"raft.run_wall_time_us":265539,"replication_time_us":507003,"thread_start_us":872950,"threads_started":4,"wal-append.queue_time_us":245718}]]}
I20260709 12:16:59.992772 12820 raft_consensus.cc:515] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:00.073275 11418 leader_election.cc:304] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:00.074512 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
W20260709 12:17:00.071779 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 277254us
I20260709 12:17:00.030356 12693 leader_election.cc:290] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:00.075958 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
W20260709 12:17:00.076242 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 277048us
I20260709 12:17:00.001186 12893 raft_consensus.cc:515] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
W20260709 12:17:00.080541 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 414504us
I20260709 12:17:00.085278 12203 leader_election.cc:304] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
W20260709 12:17:00.086068 11568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:00.093875 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:00.099260 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e4724ed93a467ea47763eec9a6de2e" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:00.079581 12832 raft_consensus.cc:2804] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:00.112512 12730 raft_consensus.cc:493] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.113253 12730 raft_consensus.cc:515] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:00.115628 12730 leader_election.cc:290] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:00.089824 11567 leader_election.cc:304] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:00.093302 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:00.120390 11526 raft_consensus.cc:2468] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 5.
I20260709 12:17:00.122918 11418 leader_election.cc:304] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:00.124066 12730 raft_consensus.cc:2804] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:00.124548 12730 raft_consensus.cc:493] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:00.125146 12730 raft_consensus.cc:3060] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:00.136219 12856 consensus_queue.cc:1048] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:00.140156 12856 consensus_queue.cc:1048] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:00.134850 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:00.144749 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:00.162600 11526 raft_consensus.cc:2468] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 2.
I20260709 12:17:00.146684 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:00.101697 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7937e0cff84ef7a26c84247c8ffc08" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:17:00.151103 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 47917us
W20260709 12:17:00.209043 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 101784us
I20260709 12:17:00.207916 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:00.208691 11600 raft_consensus.cc:2468] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 5.
I20260709 12:17:00.209858 12203 leader_election.cc:304] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:00.084581 12899 raft_consensus.cc:493] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:00.093546 12809 raft_consensus.cc:493] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.151520 11567 leader_election.cc:304] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:00.083621 12782 consensus_queue.cc:1048] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.078s
I20260709 12:17:00.102320 12810 raft_consensus.cc:493] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:00.221170 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 69738.4us
I20260709 12:17:00.103358 12693 raft_consensus.cc:2749] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:17:00.222323 11566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:00.110008 12832 raft_consensus.cc:493] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:00.236449 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390e91331fd04f97a5235133a34875ee" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:00.276353 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:00.102008 12838 consensus_queue.cc:1048] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.128s
I20260709 12:17:00.271485 11448 raft_consensus.cc:1275] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:00.271422 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:00.209276 12818 raft_consensus.cc:493] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:00.096975 12770 consensus_queue.cc:1048] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.125s
I20260709 12:17:00.282001 12361 raft_consensus.cc:2468] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 4.
W20260709 12:17:00.271095 12928 log.cc:927] Time spent T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:17:00.286458 11451 raft_consensus.cc:1275] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:00.234050 12779 raft_consensus.cc:2749] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:00.290550 12345 raft_consensus.cc:1275] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:00.259896 11419 leader_election.cc:304] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:00.276400 12832 raft_consensus.cc:3060] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:00.278272 12941 raft_consensus.cc:2804] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:00.302625 11566 leader_election.cc:304] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:00.305239 12345 raft_consensus.cc:1275] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:17:00.308565 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 48771.8us
I20260709 12:17:00.254668 12856 consensus_queue.cc:1048] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.070s
I20260709 12:17:00.305962 12684 raft_consensus.cc:493] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.305831 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:00.228312 12809 raft_consensus.cc:515] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:00.323530 11447 raft_consensus.cc:1275] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:00.319330 11451 raft_consensus.cc:1275] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:00.303925 12955 consensus_queue.cc:1059] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 12:17:00.231226 12899 raft_consensus.cc:515] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:00.255319 12810 raft_consensus.cc:515] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:00.293601 12693 consensus_queue.cc:1048] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
W20260709 12:17:00.364310 12977 log.cc:927] Time spent T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
W20260709 12:17:00.354076 12958 log.cc:927] Time spent T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.300s	user 0.001s	sys 0.000s
I20260709 12:17:00.373158 11419 leader_election.cc:304] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
W20260709 12:17:00.524686 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 151625us
I20260709 12:17:00.525465 11419 leader_election.cc:304] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
W20260709 12:17:00.402667 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 100099us
I20260709 12:17:00.231839 12948 consensus_queue.cc:1048] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.067s
I20260709 12:17:00.531718 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:00.458684 12359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51698 (request call id 523) took 2077 ms. Trace:
I20260709 12:17:00.515224 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:00.296654 12818 raft_consensus.cc:515] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:00.527612 11419 leader_election.cc:304] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:00.528447 11453 raft_consensus.cc:1240] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [term 2 LEADER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:00.537974 12359 rpcz_store.cc:276] 0709 12:16:58.381194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:58.413550 (+ 32356us) service_pool.cc:224] Handling call
0709 12:16:59.881822 (+1468272us) spinlock_profiling.cc:243] Waited 23.5 ms on lock 0x7b5800003f98. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb9cfc0 00007f84ebb87929 00007f84ebb873d2 00007f84e50febd4
0709 12:16:59.882033 (+   211us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:59.882232 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:16:59.886861 (+  4629us) log.cc:844] Serialized 14 byte log entry
0709 12:17:00.458105 (+571244us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:00.458166 (+    61us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:00.458212 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:00.458475 (+   263us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:00.458611 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70210,"prepare.queue_time_us":18243,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"spinlock_wait_cycles":53946240,"thread_start_us":498474,"threads_started":1}
W20260709 12:17:00.533525 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 129978us
W20260709 12:17:00.561988 11528 consensus_meta.cc:287] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671: Time spent flushing consensus metadata: real 0.558s	user 0.010s	sys 0.000s
I20260709 12:17:00.562644 11528 raft_consensus.cc:2468] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 5.
I20260709 12:17:00.504338 12919 raft_consensus.cc:493] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.502168 12793 raft_consensus.cc:2749] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:00.501926 12938 raft_consensus.cc:2804] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:17:00.596416 11521 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.023s	sys 0.017s
I20260709 12:17:00.529211 12953 raft_consensus.cc:493] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:00.595300 11567 leader_election.cc:304] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
W20260709 12:17:00.626168 11521 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.026s	sys 0.018s
I20260709 12:17:00.566165 12820 leader_election.cc:290] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:00.581435 12792 raft_consensus.cc:2749] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:00.407099 12684 raft_consensus.cc:515] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:00.592988 12727 raft_consensus.cc:2804] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:00.641916 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:00.591969 12938 raft_consensus.cc:493] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:00.567521 12682 consensus_queue.cc:1048] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
W20260709 12:17:00.653911 12347 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.017s	sys 0.013s
I20260709 12:17:00.670883 11522 raft_consensus.cc:1275] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:00.587801 12803 consensus_queue.cc:1048] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 12:17:00.639706 12779 raft_consensus.cc:2749] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:00.676185 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:17:00.678545 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 396315us
I20260709 12:17:00.628422 12960 raft_consensus.cc:2749] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:00.593323 12919 raft_consensus.cc:515] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:00.685576 11527 raft_consensus.cc:1275] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:00.642607 12893 leader_election.cc:290] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:00.656746 12938 raft_consensus.cc:3060] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:00.646221 12727 raft_consensus.cc:493] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:00.638641 12953 raft_consensus.cc:515] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:00.670807 12792 raft_consensus.cc:2749] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:00.673957 12755 raft_consensus.cc:2749] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:00.680524 12683 raft_consensus.cc:493] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:00.674805 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 444114us
W20260709 12:17:00.920814 12979 log.cc:927] Time spent T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.271s	user 0.000s	sys 0.000s
I20260709 12:17:00.922531 12955 consensus_queue.cc:1048] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:00.923574 12810 leader_election.cc:290] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
W20260709 12:17:00.922554 12972 log.cc:927] Time spent T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.288s	user 0.000s	sys 0.000s
I20260709 12:17:00.536113 12730 raft_consensus.cc:515] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:00.943496 11491 leader_election.cc:304] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:00.946359 12960 raft_consensus.cc:493] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.946530 12953 leader_election.cc:290] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:00.946987 12960 raft_consensus.cc:515] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
W20260709 12:17:00.939991 12971 log.cc:927] Time spent T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.291s	user 0.000s	sys 0.000s
I20260709 12:17:00.874779 12779 raft_consensus.cc:493] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:00.928421 12963 raft_consensus.cc:493] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:00.929665 12683 raft_consensus.cc:515] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
W20260709 12:17:00.911612 12967 log.cc:927] Time spent T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.558s	user 0.001s	sys 0.000s
I20260709 12:17:00.903213 12727 raft_consensus.cc:3060] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:00.945472 11491 leader_election.cc:304] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:00.953343 12683 leader_election.cc:290] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:17:00.876268 12902 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.027s	sys 0.062s
I20260709 12:17:00.956112 12893 raft_consensus.cc:493] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:00.962983 12906 consensus_meta.cc:287] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671: Time spent flushing consensus metadata: real 0.908s	user 0.005s	sys 0.006s
I20260709 12:17:00.949344 12960 leader_election.cc:290] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:00.952765 12684 leader_election.cc:290] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:00.942296 12792 raft_consensus.cc:493] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:00.951368 12729 raft_consensus.cc:493] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:00.950412 12779 raft_consensus.cc:515] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:00.996742 12983 raft_consensus.cc:2804] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:00.992879 12803 raft_consensus.cc:493] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
W20260709 12:17:00.997530 12982 log.cc:927] Time spent T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.311s	user 0.001s	sys 0.000s
I20260709 12:17:00.996927 12919 leader_election.cc:290] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
W20260709 12:17:00.994771 12968 log.cc:927] Time spent T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.633s	user 0.000s	sys 0.001s
I20260709 12:17:00.950946 12963 raft_consensus.cc:515] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
W20260709 12:17:00.992233 12902 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.027s	sys 0.062s
I20260709 12:17:01.002153 12906 raft_consensus.cc:2749] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:01.004643 12809 leader_election.cc:290] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
W20260709 12:17:01.022977 12345 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.000s	sys 0.014s
W20260709 12:17:01.027086 12345 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.000s	sys 0.015s
I20260709 12:17:01.022711 12988 raft_consensus.cc:2804] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:01.028324 12988 raft_consensus.cc:493] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:01.015759 12983 raft_consensus.cc:493] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:01.009482 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ed4eeff0ae44d0bc1ebb8cbe3adea5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:17:01.019711 12352 consensus_meta.cc:287] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de: Time spent flushing consensus metadata: real 0.980s	user 0.011s	sys 0.000s
I20260709 12:17:01.001339 12893 raft_consensus.cc:515] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
W20260709 12:17:01.023442 12941 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.004s	sys 0.009s
W20260709 12:17:01.023097 11417 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.749s	user 0.000s	sys 0.015s
I20260709 12:17:01.028698 12988 raft_consensus.cc:3060] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:01.029160 12818 leader_election.cc:290] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:01.012080 12792 raft_consensus.cc:515] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
W20260709 12:17:01.064806 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 379891us
I20260709 12:17:01.014894 12729 raft_consensus.cc:515] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
W20260709 12:17:01.068889 11417 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.794s	user 0.000s	sys 0.015s
W20260709 12:17:01.073630 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 799278us
W20260709 12:17:01.051753 11494 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.935s	user 0.091s	sys 0.108s
W20260709 12:17:01.076606 11494 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.960s	user 0.092s	sys 0.108s
W20260709 12:17:01.069489 11419 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.002s	sys 0.012s
I20260709 12:17:01.021534 12803 raft_consensus.cc:515] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:01.033861 12983 raft_consensus.cc:3060] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:01.069307 12811 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.001s	sys 0.017s
I20260709 12:17:01.045881 12352 raft_consensus.cc:2468] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 2.
W20260709 12:17:01.137127 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 65123.2us
W20260709 12:17:01.078927 11419 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.002s	sys 0.013s
I20260709 12:17:01.067582 12809 raft_consensus.cc:493] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.067322 12902 raft_consensus.cc:493] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
W20260709 12:17:01.128294 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 48180.3us
W20260709 12:17:01.139214 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 611597us
I20260709 12:17:01.143996 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:01.144747 11451 raft_consensus.cc:2468] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 2.
I20260709 12:17:01.080768 12984 raft_consensus.cc:493] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:01.147349 11419 leader_election.cc:304] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:01.079610 12960 raft_consensus.cc:493] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:01.067981 12941 raft_consensus.cc:697] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [term 2 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:01.115190 12818 raft_consensus.cc:493] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:01.144183 12976 log.cc:927] Time spent T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.260s	user 0.000s	sys 0.001s
I20260709 12:17:01.127933 12867 raft_consensus.cc:493] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:01.143324 12352 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51698 (request call id 533) took 1116 ms. Trace:
W20260709 12:17:01.163086 11566 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.041s	sys 0.014s
W20260709 12:17:01.163476 11566 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.041s	sys 0.014s
I20260709 12:17:01.159175 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:01.164049 11451 raft_consensus.cc:2468] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 4.
I20260709 12:17:01.142481 12986 raft_consensus.cc:493] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:01.177791 12997 raft_consensus.cc:493] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:01.178690 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:01.178465 12997 raft_consensus.cc:515] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:01.156297 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:01.156529 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
W20260709 12:17:01.136544 12811 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.002s	sys 0.017s
I20260709 12:17:01.146322 12902 raft_consensus.cc:515] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:01.145239 12809 raft_consensus.cc:515] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:01.173905 12856 raft_consensus.cc:493] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.154804 12960 raft_consensus.cc:515] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:01.200502 12992 consensus_queue.cc:1048] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:01.200917 12919 consensus_queue.cc:1048] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:01.203894 12995 raft_consensus.cc:2749] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:17:01.204941 12990 log.cc:927] Time spent T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 12:17:01.206322 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:01.194388 11447 raft_consensus.cc:2468] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 5.
I20260709 12:17:01.153631 12993 consensus_queue.cc:1048] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 12:17:01.160411 12818 raft_consensus.cc:515] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:01.181289 12357 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 672) took 1534 ms. Trace:
I20260709 12:17:01.220059 12203 leader_election.cc:304] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:01.162863 12352 rpcz_store.cc:276] 0709 12:17:00.026613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:00.028356 (+  1743us) service_pool.cc:224] Handling call
0709 12:17:01.141338 (+1112982us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:17:01.218254 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 256650us
I20260709 12:17:01.382956 11491 leader_election.cc:304] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
W20260709 12:17:01.220814 11600 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.019s	sys 0.006s
W20260709 12:17:01.387856 11600 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.838s	user 0.019s	sys 0.006s
I20260709 12:17:01.168706 12867 raft_consensus.cc:515] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:01.195693 11598 raft_consensus.cc:3060] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:01.229584 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 82381.3us
I20260709 12:17:01.249630 12203 leader_election.cc:304] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:01.405954 11419 leader_election.cc:304] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:01.232318 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:01.152526 12984 raft_consensus.cc:515] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:01.195535 12820 raft_consensus.cc:493] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:01.478576 12347 raft_consensus.cc:2393] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 5: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
W20260709 12:17:01.414384 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 164821us
I20260709 12:17:01.481411 11523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33446 (request call id 989) took 1672 ms. Trace:
I20260709 12:17:01.481952 11523 rpcz_store.cc:276] 0709 12:16:59.711885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:59.712024 (+   139us) service_pool.cc:224] Handling call
0709 12:16:59.712372 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:16:59.712691 (+   319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:59.712719 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:16:59.725640 (+ 12921us) log.cc:844] Serialized 26 byte log entry
0709 12:17:00.001300 (+275660us) spinlock_profiling.cc:243] Waited 2.2 ms on lock 0x7b1800320da0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3ab8e07 00007f84ec9139a9 00007f84e3ad569b 00007f84e3ad393f 00007f84e3ad5c02 00007f84e675d20b 00007f84e6762d23 00007f84e67630d1 00007f84e6b7ea0f
0709 12:17:00.372519 (+371219us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:00.372566 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:00.372650 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:01.228790 (+856140us) raft_consensus.cc:1685] finished
0709 12:17:01.228811 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:01.384459 (+155648us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":284,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":49524,"spinlock_wait_cycles":5070208,"thread_start_us":371002,"threads_started":1,"wal-append.queue_time_us":915449}
W20260709 12:17:01.484027 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 101158us
I20260709 12:17:01.176388 12986 raft_consensus.cc:515] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:01.222633 12779 leader_election.cc:290] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:01.532384 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:01.533275 11451 raft_consensus.cc:2468] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 4.
I20260709 12:17:01.384610 12963 leader_election.cc:290] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:01.549584 11491 leader_election.cc:304] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:01.490159 12693 raft_consensus.cc:2804] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:01.215274 12856 raft_consensus.cc:515] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:01.557139 11491 leader_election.cc:304] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:01.566131 11521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38272 (request call id 162) took 1555 ms. Trace:
I20260709 12:17:01.523777 13004 raft_consensus.cc:493] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:01.576427 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c355b3902a4e7fb72bac6a91ea3316" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:01.497567 12953 raft_consensus.cc:493] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:01.577203  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:01.580605 12981 raft_consensus.cc:2749] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:01.582820 12998 raft_consensus.cc:493] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:01.593535 12902 leader_election.cc:290] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:01.590737 12961 raft_consensus.cc:493] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.697564 12991 raft_consensus.cc:493] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:01.697402 12961 raft_consensus.cc:515] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:01.581945 12964 raft_consensus.cc:493] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:01.698153 12991 raft_consensus.cc:515] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:01.698438 12964 raft_consensus.cc:515] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
W20260709 12:17:01.694190 13007 log.cc:927] Time spent T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.353s	user 0.001s	sys 0.000s
W20260709 12:17:01.697602 13001 log.cc:927] Time spent T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:17:01.700510 12991 leader_election.cc:290] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:01.702653 12961 leader_election.cc:290] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:01.583354 12994 raft_consensus.cc:2804] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:01.703758 12994 raft_consensus.cc:493] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting leader election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:01.704173 12994 raft_consensus.cc:3060] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:01.595194 12818 leader_election.cc:290] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:01.522737 12811 raft_consensus.cc:493] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:01.581171 13003 consensus_queue.cc:1048] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.359s
W20260709 12:17:01.636978 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 79917.9us
I20260709 12:17:01.700412 12998 raft_consensus.cc:515] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:01.714525 13020 raft_consensus.cc:493] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:01.715166 13020 raft_consensus.cc:515] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:01.715723 12998 leader_election.cc:290] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:01.716141 12345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 689) took 1259 ms. Trace:
I20260709 12:17:01.594419 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:01.637986 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffe47647c274723808482c166efa21c" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:01.716566 12345 rpcz_store.cc:276] 0709 12:17:00.456599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:00.457085 (+   486us) service_pool.cc:224] Handling call
0709 12:17:00.457482 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:01.027593 (+570111us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:01.027623 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:01.029196 (+  1573us) log.cc:844] Serialized 26 byte log entry
0709 12:17:01.292492 (+263296us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:01.292536 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:01.292614 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:01.715918 (+423304us) raft_consensus.cc:1685] finished
0709 12:17:01.715941 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:01.716081 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":424819,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":8008,"thread_start_us":826212,"threads_started":2,"wal-append.queue_time_us":618924}
I20260709 12:17:01.717597 11451 raft_consensus.cc:2468] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 4.
I20260709 12:17:01.645277 12906 consensus_queue.cc:1059] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:01.651114 12790 raft_consensus.cc:2804] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:01.706442 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:17:01.671468 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 265587us
W20260709 12:17:01.723511 11491 connection.cc:256] RPC call timeout handler was delayed by -1.0461139560002266s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16690000000000002s for a response
I20260709 12:17:01.724071 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:01.724526 11419 leader_election.cc:304] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:01.716079 12994 raft_consensus.cc:515] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:01.725525 12818 raft_consensus.cc:493] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.726257 12981 raft_consensus.cc:493] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:01.726044 12818 raft_consensus.cc:515] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:01.635188 11521 rpcz_store.cc:276] 0709 12:17:00.010870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:00.643296 (+632426us) service_pool.cc:224] Handling call
0709 12:17:00.646821 (+  3525us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:00.647067 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:17:01.067037 (+419970us) log.cc:844] Serialized 14 byte log entry
0709 12:17:01.565722 (+498685us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:01.565796 (+    74us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:01.565853 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:01.565930 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:01.566063 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":544665,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":63028,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":28572,"thread_start_us":885590,"threads_started":3}
I20260709 12:17:01.569257 12693 raft_consensus.cc:493] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:01.726769 12981 raft_consensus.cc:515] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:01.722059 12790 raft_consensus.cc:493] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:01.727823 12790 raft_consensus.cc:3060] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:01.600311 12792 leader_election.cc:290] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:01.676736 11601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40784 (request call id 157) took 1878 ms. Trace:
I20260709 12:17:01.731873 11601 rpcz_store.cc:276] 0709 12:16:59.798876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:59.807896 (+  9020us) service_pool.cc:224] Handling call
0709 12:16:59.808230 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:00.090744 (+282514us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:00.090778 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:00.111645 (+ 20867us) log.cc:844] Serialized 26 byte log entry
0709 12:17:00.671097 (+559452us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:00.671135 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:00.671215 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:01.676496 (+1005281us) raft_consensus.cc:1685] finished
0709 12:17:01.676518 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:01.676673 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":78230,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":146,"thread_start_us":719900,"threads_started":2,"wal-append.queue_time_us":806387}
I20260709 12:17:01.221767 12941 consensus_queue.cc:237] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:01.647630 12803 leader_election.cc:290] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:01.677246 12756 raft_consensus.cc:493] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:01.733841 12906 raft_consensus.cc:3055] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:01.761482 12906 raft_consensus.cc:740] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:01.716506 12811 raft_consensus.cc:515] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:01.723368 11593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 591) took 1450 ms. Trace:
I20260709 12:17:01.762444 12906 consensus_queue.cc:260] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:01.763027 11593 rpcz_store.cc:276] 0709 12:17:00.272731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:00.276166 (+  3435us) service_pool.cc:224] Handling call
0709 12:17:01.594242 (+1318076us) spinlock_profiling.cc:243] Waited 5.23 ms on lock 0x7b5800220b98. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9ee9c 00007f84e3a9ea5b 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb890a0 00007f84ebb88984 00007f84e51036d4 00007f84e5103662
0709 12:17:01.723301 (+129059us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12022656}
I20260709 12:17:01.764518 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffe47647c274723808482c166efa21c" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:01.765882 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:01.725298 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:01.654634 13004 raft_consensus.cc:515] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:01.496874 12820 raft_consensus.cc:515] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:01.234921 12357 rpcz_store.cc:276] 0709 12:16:59.646456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:59.649194 (+  2738us) service_pool.cc:224] Handling call
0709 12:17:01.178499 (+1529305us) spinlock_profiling.cc:243] Waited 4.28 ms on lock 0x7b5800003f98. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb890a0 00007f84ebb88984 00007f84e51036d4 00007f84e5103662
0709 12:17:01.181206 (+  2707us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9846144}
I20260709 12:17:01.592557 12984 leader_election.cc:290] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:01.585453 13008 raft_consensus.cc:2749] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:01.694837 12953 raft_consensus.cc:515] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:01.705271 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:01.702380 12730 leader_election.cc:290] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:01.712059 13019 raft_consensus.cc:2749] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:01.727152 12693 raft_consensus.cc:3060] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:01.546460 12729 leader_election.cc:290] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:01.729458 12994 leader_election.cc:290] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:01.733244 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:01.734766 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:01.700605 12964 leader_election.cc:290] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:01.807790 11519 raft_consensus.cc:1275] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:17:02.040439 11491 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.212.130:41579 timed out after 1.669s (SENT) [suppressed 60 similar messages]
W20260709 12:17:01.780815 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 62043.8us
I20260709 12:17:01.766191 11451 raft_consensus.cc:1240] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 12:17:02.035953 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 311476us
I20260709 12:17:02.044870 11419 leader_election.cc:304] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:02.040238 11521 raft_consensus.cc:2468] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 3.
I20260709 12:17:02.038467 11450 raft_consensus.cc:2468] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 2.
W20260709 12:17:01.762647 12832 consensus_meta.cc:287] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d: Time spent flushing consensus metadata: real 1.391s	user 0.003s	sys 0.009s
W20260709 12:17:02.092039 11492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:01.730141 12960 leader_election.cc:290] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:01.729117 12981 leader_election.cc:290] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
W20260709 12:17:01.798076 13012 log.cc:927] Time spent T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 12:17:02.105103 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:17:01.798237 13009 log.cc:927] Time spent T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
W20260709 12:17:01.928200 13013 log.cc:927] Time spent T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.209s	user 0.000s	sys 0.000s
I20260709 12:17:01.803118 13020 leader_election.cc:290] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
W20260709 12:17:01.797986 13006 log.cc:927] Time spent T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
W20260709 12:17:01.867123 13005 log.cc:927] Time spent T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260709 12:17:01.765455 12818 leader_election.cc:290] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:02.113467 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:01.867511 12803 raft_consensus.cc:493] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.094336 12835 raft_consensus.cc:493] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:02.108862 13008 raft_consensus.cc:493] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:02.132464 11450 raft_consensus.cc:1240] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:17:01.780159 12756 raft_consensus.cc:515] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:02.103538 12832 raft_consensus.cc:515] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:02.091940 12961 raft_consensus.cc:493] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.029248 12757 raft_consensus.cc:493] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
W20260709 12:17:02.139532 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 99111.3us
I20260709 12:17:01.968207 12997 leader_election.cc:290] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:01.929606 12856 leader_election.cc:290] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
W20260709 12:17:01.932353 12938 consensus_meta.cc:287] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8: Time spent flushing consensus metadata: real 1.025s	user 0.010s	sys 0.001s
I20260709 12:17:02.048352 12906 raft_consensus.cc:3060] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:01.810896 11453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58868 (request call id 994) took 1574 ms. Trace:
W20260709 12:17:02.096756 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 51995.4us
I20260709 12:17:01.797816 12959 raft_consensus.cc:493] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:01.931008 12986 leader_election.cc:290] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:01.866797 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:17:02.123838 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 82094.4us
I20260709 12:17:02.091339 13017 raft_consensus.cc:493] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.125792 12348 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 680) took 2398 ms. Trace:
I20260709 12:17:02.094380 12792 raft_consensus.cc:2749] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:17:02.118227 12727 consensus_meta.cc:287] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d: Time spent flushing consensus metadata: real 1.128s	user 0.008s	sys 0.004s
I20260709 12:17:02.123795 12964 raft_consensus.cc:493] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.921798 12867 leader_election.cc:290] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:02.173772 11418 leader_election.cc:304] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:02.140285 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:02.145260 12349 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 694) took 1155 ms. Trace:
I20260709 12:17:02.146306 11445 raft_consensus.cc:2393] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 3: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
W20260709 12:17:02.139627 12988 consensus_meta.cc:287] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671: Time spent flushing consensus metadata: real 1.025s	user 0.010s	sys 0.002s
I20260709 12:17:02.171028 11600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 590) took 1898 ms. Trace:
I20260709 12:17:02.169893 12348 rpcz_store.cc:276] 0709 12:16:59.717509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:59.717801 (+   292us) service_pool.cc:224] Handling call
0709 12:16:59.718129 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:59.802888 (+ 84759us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:16:59.802925 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:16:59.802973 (+    48us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:16:59.803005 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:02.115234 (+2312229us) spinlock_profiling.cc:243] Waited 84.5 ms on lock 0x7b5400524254. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:17:02.115295 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:02.115442 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":194438912}
I20260709 12:17:02.177917 11600 rpcz_store.cc:276] 0709 12:17:00.272429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:00.272560 (+   131us) service_pool.cc:224] Handling call
0709 12:17:00.272915 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:00.273273 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:00.273300 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:00.549066 (+275766us) spinlock_profiling.cc:243] Waited 5.57 ms on lock 0x7b2c0014f6c8. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e54bca11 00007f84e54cc372 00007f84e6bfea01 00007f84e6bc343a 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2
0709 12:17:00.549606 (+   540us) log.cc:844] Serialized 26 byte log entry
0709 12:17:01.388308 (+838702us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:01.388365 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:01.388459 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:02.148166 (+759707us) raft_consensus.cc:1685] finished
0709 12:17:02.148186 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:02.170955 (+ 22769us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":40692,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":35968,"spinlock_wait_cycles":12801408,"thread_start_us":838317,"threads_started":1,"wal-append.queue_time_us":672993}
I20260709 12:17:02.142167 12818 raft_consensus.cc:493] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:02.147576 11453 rpcz_store.cc:276] 0709 12:17:00.236318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:00.240841 (+  4523us) service_pool.cc:224] Handling call
0709 12:17:00.253917 (+ 13076us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:00.537597 (+283680us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:01.810589 (+1272992us) spinlock_profiling.cc:243] Waited 274 ms on lock 0x7b54005c58d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:17:01.810816 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":630847360}
I20260709 12:17:02.177572 12349 rpcz_store.cc:276] 0709 12:17:00.989478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:01.034098 (+ 44620us) service_pool.cc:224] Handling call
0709 12:17:01.034522 (+   424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:01.034929 (+   407us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:01.034960 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:01.040514 (+  5554us) log.cc:844] Serialized 26 byte log entry
0709 12:17:01.220468 (+179954us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:01.220511 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:01.220573 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:02.145035 (+924462us) raft_consensus.cc:1685] finished
0709 12:17:02.145055 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:02.145194 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43412,"raft.queue_time_us":12107,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":21827,"thread_start_us":179528,"threads_started":1,"wal-append.queue_time_us":546293}
I20260709 12:17:02.136139 12803 raft_consensus.cc:515] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:02.138043 12835 raft_consensus.cc:515] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
W20260709 12:17:02.190045 11419 connection.cc:256] RPC call timeout handler was delayed by -1.048926222000091s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15660000000000002s for a response
I20260709 12:17:02.142544 12961 raft_consensus.cc:515] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:02.216607 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:02.187160 13024 raft_consensus.cc:2804] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:02.227982 11565 leader_election.cc:304] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:02.193094 13018 raft_consensus.cc:493] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:02.228260 11454 raft_consensus.cc:2468] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 3.
I20260709 12:17:02.228672 13018 raft_consensus.cc:515] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:02.230237 12939 raft_consensus.cc:2749] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:02.231004 12939 consensus_queue.cc:1048] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:02.231807 13024 raft_consensus.cc:493] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:02.232260 13024 raft_consensus.cc:3060] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:02.182768 12988 raft_consensus.cc:515] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:02.233006 13018 leader_election.cc:290] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:02.233800 11524 raft_consensus.cc:1240] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:02.233898 13018 raft_consensus.cc:493] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.234508 13018 raft_consensus.cc:515] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:02.235160 12988 leader_election.cc:290] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:02.235750 12988 raft_consensus.cc:493] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.236122 12988 raft_consensus.cc:515] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:02.236737 13018 leader_election.cc:290] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:02.187098 13020 raft_consensus.cc:493] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:02.198410 11520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38272 (request call id 161) took 2187 ms. Trace:
I20260709 12:17:02.179656 12964 raft_consensus.cc:515] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:02.136986 13008 raft_consensus.cc:515] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
W20260709 12:17:02.226786 12983 consensus_meta.cc:287] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671: Time spent flushing consensus metadata: real 1.089s	user 0.008s	sys 0.003s
I20260709 12:17:02.216121 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:02.239751 12356 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 688) took 1873 ms. Trace:
I20260709 12:17:02.244786 11274 catalog_manager.cc:5697] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 1 to 2, leader changed from 1c101e338f954ef086338e251deed19d (127.3.212.130) to a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131). New cstate: current_term: 2 leader_uuid: "a03223e9e41247c3a36b7b7c3d476671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:02.147784 12938 raft_consensus.cc:515] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:02.283692 11274 catalog_manager.cc:5697] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 1 to 2, leader changed from 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132) to a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131). New cstate: current_term: 2 leader_uuid: "a03223e9e41247c3a36b7b7c3d476671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:02.193545 12984 raft_consensus.cc:493] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.242398 11526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38272 (request call id 160) took 2232 ms. Trace:
I20260709 12:17:02.243383 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:02.144199 12757 raft_consensus.cc:515] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:02.187088 13022 raft_consensus.cc:2749] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:02.174964 12727 raft_consensus.cc:515] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:02.267747 11520 rpcz_store.cc:276] 0709 12:17:00.010626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:00.628733 (+618107us) service_pool.cc:224] Handling call
0709 12:17:00.629088 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:00.638019 (+  8931us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:00.638050 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:00.654133 (+ 16083us) log.cc:844] Serialized 26 byte log entry
0709 12:17:01.151789 (+497656us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:01.151831 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:01.151901 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:02.198141 (+1046240us) raft_consensus.cc:1685] finished
0709 12:17:02.198163 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:02.198320 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16571,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":21937,"thread_start_us":276446,"threads_started":1,"wal-append.queue_time_us":831501}
I20260709 12:17:02.170948 12959 raft_consensus.cc:515] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:02.188591 12818 raft_consensus.cc:515] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:02.173003 13017 raft_consensus.cc:515] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:02.227221 12960 raft_consensus.cc:493] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:02.240394 13004 leader_election.cc:290] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:02.276058 11597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40784 (request call id 164) took 1121 ms. Trace:
I20260709 12:17:02.282706 12356 rpcz_store.cc:276] 0709 12:17:00.366346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:00.369078 (+  2732us) service_pool.cc:224] Handling call
0709 12:17:00.516852 (+147774us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:00.916689 (+399837us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:00.916717 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:00.917198 (+   481us) log.cc:844] Serialized 26 byte log entry
0709 12:17:00.951084 (+ 33886us) spinlock_profiling.cc:243] Waited 3.53 ms on lock 0x7b480084dbd8. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ebaecaa1 00007f84ebae3b37 00007f84ebae39ca 00007f84ebbdb26f 00007f84ebbdaf37 00007f84ebbef55c 00007f84ebbef508 00007f84ebbef488 00007f84ebbef443 00007f84ebbee6ec 00007f84eab18a96
0709 12:17:01.149994 (+198910us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:01.150032 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:02.239415 (+1089383us) spinlock_profiling.cc:243] Waited 391 ms on lock 0x7b540031f454. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:17:02.239480 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:02.239532 (+    52us) raft_consensus.cc:1685] finished
0709 12:17:02.239545 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:02.239688 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1686,"raft.queue_time_us":9911,"raft.run_cpu_time_us":2010,"raft.run_wall_time_us":26342,"spinlock_wait_cycles":907429120,"thread_start_us":229548,"threads_started":1,"wal-append.queue_time_us":761752}
I20260709 12:17:02.330860 11419 leader_election.cc:304] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:02.318444 11274 catalog_manager.cc:5697] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 1 to 2, leader changed from 1c101e338f954ef086338e251deed19d (127.3.212.130) to a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131). New cstate: current_term: 2 leader_uuid: "a03223e9e41247c3a36b7b7c3d476671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:02.404211 11274 catalog_manager.cc:5697] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 2 to 3, leader changed from 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132) to a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131). New cstate: current_term: 3 leader_uuid: "a03223e9e41247c3a36b7b7c3d476671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } }
W20260709 12:17:02.402858 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 72090.8us
I20260709 12:17:02.408301 11419 leader_election.cc:304] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:02.331772 11491 leader_election.cc:304] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:02.311098 11594 raft_consensus.cc:2393] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 3: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:17:02.250327 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9fe9a94294836aec652338f44367d" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:02.250072 12951 raft_consensus.cc:493] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
W20260709 12:17:02.346378 11598 consensus_meta.cc:287] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8: Time spent flushing consensus metadata: real 0.849s	user 0.012s	sys 0.000s
I20260709 12:17:02.247722 12981 raft_consensus.cc:493] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:02.418505 11274 catalog_manager.cc:5697] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "a03223e9e41247c3a36b7b7c3d476671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:02.311933 12938 leader_election.cc:290] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:02.244995 12832 leader_election.cc:290] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:02.280481 13020 raft_consensus.cc:515] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:02.238478 12988 leader_election.cc:290] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:02.299825 11526 rpcz_store.cc:276] 0709 12:17:00.010396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:00.163985 (+153589us) service_pool.cc:224] Handling call
0709 12:17:00.208996 (+ 45011us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:00.591422 (+382426us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:17:01.025475 (+434053us) log.cc:844] Serialized 14 byte log entry
0709 12:17:01.223576 (+198101us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:01.223630 (+    54us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:01.223677 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:02.242147 (+1018470us) spinlock_profiling.cc:243] Waited 382 ms on lock 0x7b5400829bd4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:17:02.242201 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:02.242330 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":589779,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":2720,"raft.queue_time_us":278010,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":139,"spinlock_wait_cycles":885512320,"thread_start_us":593230,"threads_started":2,"wal-append.queue_time_us":670021}
I20260709 12:17:02.366864 11446 raft_consensus.cc:1275] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:02.301743 12756 leader_election.cc:290] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:02.307402 12961 leader_election.cc:290] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:02.250767 12994 raft_consensus.cc:493] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:02.244002 12803 leader_election.cc:290] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:02.419900 13019 raft_consensus.cc:2804] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:02.351974 12820 leader_election.cc:290] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:02.310061 13008 leader_election.cc:290] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:02.308408 13026 raft_consensus.cc:493] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:02.302134 12835 leader_election.cc:290] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:02.444204 13030 raft_consensus.cc:493] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:02.310696 12964 leader_election.cc:290] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:02.417697 12867 raft_consensus.cc:493] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:02.420157 12986 raft_consensus.cc:2749] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:02.418335 13028 raft_consensus.cc:493] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:02.436167 12981 raft_consensus.cc:515] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:02.250319 12911 raft_consensus.cc:493] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:02.299582 12983 raft_consensus.cc:515] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:02.402045 11597 rpcz_store.cc:276] 0709 12:17:01.154852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:02.143452 (+988600us) service_pool.cc:224] Handling call
0709 12:17:02.179725 (+ 36273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:02.193002 (+ 13277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:02.196414 (+  3412us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:02.226507 (+ 30093us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:02.248397 (+ 21890us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:02.248468 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:02.255434 (+  6966us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:02.474555 12810 raft_consensus.cc:493] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:02.330495 12984 raft_consensus.cc:515] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
W20260709 12:17:02.440910 12790 consensus_meta.cc:287] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671: Time spent flushing consensus metadata: real 0.713s	user 0.006s	sys 0.005s
I20260709 12:17:02.417759 12960 raft_consensus.cc:515] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:02.511687 12790 raft_consensus.cc:515] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
W20260709 12:17:02.434691 11449 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58856 (request call id 470) took 2681 ms (client timeout 2025 ms). Trace:
I20260709 12:17:02.431032 11598 raft_consensus.cc:2468] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 5.
I20260709 12:17:02.440596 12729 raft_consensus.cc:493] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:02.333487 12811 leader_election.cc:290] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:02.431516 12951 raft_consensus.cc:515] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:02.476704 13019 raft_consensus.cc:493] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:02.481714 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 150007us
W20260709 12:17:02.482120 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 252917us
I20260709 12:17:02.489063 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:02.489495 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:02.531294 11527 raft_consensus.cc:2468] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 5.
W20260709 12:17:02.523229 13027 log.cc:927] Time spent T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 12:17:02.491812 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:02.491847 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:02.492619 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:02.535467 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:02.535518 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:17:02.493516 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 236170us
I20260709 12:17:02.493994 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:02.536128 12348 raft_consensus.cc:2468] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 2.
I20260709 12:17:02.536580 12361 raft_consensus.cc:2393] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 3: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:17:02.494609 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:02.473105 12756 raft_consensus.cc:493] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:02.427105 13024 raft_consensus.cc:515] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:02.497773 12941 raft_consensus.cc:493] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:02.501439 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:02.506165 12346 raft_consensus.cc:1275] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:02.499946 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:02.482177 12820 raft_consensus.cc:2804] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:02.507987 12818 leader_election.cc:290] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:02.508481 12810 raft_consensus.cc:515] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:02.484618 11446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58868 (request call id 996) took 2221 ms. Trace:
I20260709 12:17:02.515130 12911 raft_consensus.cc:515] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:02.557866 11446 rpcz_store.cc:276] 0709 12:17:00.256409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:00.271152 (+ 14743us) service_pool.cc:224] Handling call
0709 12:17:02.366203 (+2095051us) spinlock_profiling.cc:243] Waited 6.2 ms on lock 0x7b5800003998. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb9cfc0 00007f84ebb87929 00007f84ebb873d2 00007f84e50febd4
0709 12:17:02.366451 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:02.468649 (+102198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:02.477754 (+  9105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14251904}
I20260709 12:17:02.559407 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9fe9a94294836aec652338f44367d" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:02.559898 12911 leader_election.cc:290] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:02.560881 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:02.514127 11526 raft_consensus.cc:1240] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:17:02.514741 11453 raft_consensus.cc:2468] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 3.
W20260709 12:17:02.513103 11449 rpcz_store.cc:269] 0709 12:16:59.752984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:59.761562 (+  8578us) service_pool.cc:224] Handling call
0709 12:17:02.250168 (+2488606us) spinlock_profiling.cc:243] Waited 4.4 ms on lock 0x7b5800003998. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb890a0 00007f84ebb88984 00007f84e51036d4 00007f84e5103662
0709 12:17:02.434582 (+184414us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10116352}
I20260709 12:17:02.572105 12951 leader_election.cc:290] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:02.576573 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:02.576772 12981 leader_election.cc:290] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
W20260709 12:17:02.577807 13014 log.cc:927] Time spent T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.884s	user 0.018s	sys 0.004s
I20260709 12:17:02.550444 12820 raft_consensus.cc:493] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:02.498750 13028 raft_consensus.cc:515] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:02.579121 12820 raft_consensus.cc:3060] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:02.578310 12693 raft_consensus.cc:515] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:02.579931 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:02.572868 11452 raft_consensus.cc:2468] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 3.
W20260709 12:17:02.582060 11452 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58856 (request call id 466) took 2831 ms (client timeout 1669 ms). Trace:
W20260709 12:17:02.582513 11452 rpcz_store.cc:269] 0709 12:16:59.750257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:59.762824 (+ 12567us) service_pool.cc:224] Handling call
0709 12:17:02.486845 (+2724021us) spinlock_profiling.cc:243] Waited 4.39 ms on lock 0x7b5800003998. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb890a0 00007f84ebb88984 00007f84e51036d4 00007f84e5103662
0709 12:17:02.581992 (+ 95147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10101120}
I20260709 12:17:02.583140 12983 leader_election.cc:290] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:02.475765 12994 raft_consensus.cc:515] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:02.528879 11520 raft_consensus.cc:1240] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:02.532368 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:02.490475 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:02.533512 11595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40784 (request call id 156) took 2747 ms. Trace:
I20260709 12:17:02.537034 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:02.522332 12790 leader_election.cc:290] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:02.581195 13028 leader_election.cc:290] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:02.581982 12727 leader_election.cc:290] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:02.482214 13026 raft_consensus.cc:515] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:02.533454 13019 raft_consensus.cc:3060] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:02.539309 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d43eecbad746fd9ddce50c5b9fc3e8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:17:02.528173 11598 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40784 (request call id 159) took 1383 ms (client timeout 1736 ms). Trace:
I20260709 12:17:02.486191 12867 raft_consensus.cc:515] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:02.540549 13020 leader_election.cc:290] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:02.578279 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:02.562192 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:02.562441 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9fe9a94294836aec652338f44367d" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:02.581341 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:02.563262 13017 leader_election.cc:290] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:02.549757 12682 consensus_queue.cc:1048] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 12:17:02.565752 12810 leader_election.cc:290] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:02.539649 12906 raft_consensus.cc:493] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:02.549839 13029 consensus_queue.cc:1048] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:17:02.545887 13034 consensus_queue.cc:1048] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:17:02.626767 12906 raft_consensus.cc:515] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:02.571982 11451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35814 (request call id 157) took 1355 ms. Trace:
I20260709 12:17:02.627708 11451 rpcz_store.cc:276] 0709 12:17:01.216773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:02.094520 (+877747us) service_pool.cc:224] Handling call
0709 12:17:02.094859 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:02.124575 (+ 29716us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:02.124605 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:02.135588 (+ 10983us) log.cc:844] Serialized 26 byte log entry
0709 12:17:02.285242 (+149654us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:02.285283 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:02.285345 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:02.571774 (+286429us) raft_consensus.cc:1685] finished
0709 12:17:02.571796 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:02.571922 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33098,"raft.queue_time_us":37335,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":10447,"thread_start_us":112762,"threads_started":1,"wal-append.queue_time_us":214060}
I20260709 12:17:02.628891 12906 leader_election.cc:290] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:02.629539 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9fe9a94294836aec652338f44367d" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:02.623553 11597 raft_consensus.cc:3060] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:02.630636 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:02.631282 11451 raft_consensus.cc:2468] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 2.
I20260709 12:17:02.631660 12994 leader_election.cc:290] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:02.632108 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:02.632741 11451 raft_consensus.cc:2468] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 2.
I20260709 12:17:02.633565 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:02.634137 11451 raft_consensus.cc:2468] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 3.
I20260709 12:17:02.634930 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:02.635911 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:02.636900 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:02.540549 12352 raft_consensus.cc:2468] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 2.
I20260709 12:17:02.540372 12941 raft_consensus.cc:515] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:02.638441 13026 leader_election.cc:290] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:02.573174 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:02.639151 12941 leader_election.cc:290] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:02.549919 12959 leader_election.cc:290] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:02.593428 12359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 693) took 1635 ms. Trace:
I20260709 12:17:02.594976 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:02.642243 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:02.642650 13024 leader_election.cc:290] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:02.642913 11522 raft_consensus.cc:2468] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 3.
I20260709 12:17:02.643229 11601 raft_consensus.cc:2468] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 5.
I20260709 12:17:02.583760 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:02.644205 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:02.604591 12348 raft_consensus.cc:2468] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 2.
I20260709 12:17:02.645105 12867 leader_election.cc:290] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:02.604174 11595 rpcz_store.cc:276] 0709 12:16:59.780479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:59.800781 (+ 20302us) service_pool.cc:224] Handling call
0709 12:16:59.801163 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:00.032591 (+231428us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:02.528010 (+2495419us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b540016cbd4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:17:02.528257 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":530507520}
I20260709 12:17:02.645324 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:02.646100 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:02.646714 11595 raft_consensus.cc:2468] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 5.
I20260709 12:17:02.528038 12729 raft_consensus.cc:515] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:02.607929 11523 raft_consensus.cc:2410] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:17:02.606142 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:02.678974 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
W20260709 12:17:02.611938 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 88753.9us
I20260709 12:17:02.679454 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:02.678974 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:02.682395 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:02.612437 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:02.551365 12965 raft_consensus.cc:493] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:02.511031 12984 leader_election.cc:290] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:02.487378 13030 raft_consensus.cc:515] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:02.644941 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9fe9a94294836aec652338f44367d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:02.606549 12693 leader_election.cc:290] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:02.545892 12756 raft_consensus.cc:515] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:02.640043 12359 rpcz_store.cc:276] 0709 12:17:00.957719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:01.017872 (+ 60153us) service_pool.cc:224] Handling call
0709 12:17:01.018354 (+   482us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:01.025527 (+  7173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:01.025561 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:01.031457 (+  5896us) log.cc:844] Serialized 26 byte log entry
0709 12:17:01.382065 (+350608us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:01.382105 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:01.382176 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:02.577104 (+1194928us) spinlock_profiling.cc:243] Waited 9.71 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e675e86e 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221 00007f84e67671d9 00007f84e6767169
0709 12:17:02.593060 (+ 15956us) raft_consensus.cc:1685] finished
0709 12:17:02.593085 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:02.593322 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7218,"raft.queue_time_us":7302,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":7679,"spinlock_wait_cycles":22322944,"thread_start_us":301916,"threads_started":1,"wal-append.queue_time_us":598725}
W20260709 12:17:02.615797 11598 rpcz_store.cc:269] 0709 12:17:01.142211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:01.143904 (+  1693us) service_pool.cc:224] Handling call
0709 12:17:02.525851 (+1381947us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:02.680855 12204 leader_election.cc:304] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:02.685052 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:02.686568 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:02.707546 11451 raft_consensus.cc:2468] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 4.
I20260709 12:17:02.639091 11597 raft_consensus.cc:2468] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 4.
I20260709 12:17:02.578640 12953 leader_election.cc:290] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:17:02.689989 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 106155us
W20260709 12:17:02.637322 11594 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 593) took 2363 ms (client timeout 2177 ms). Trace:
I20260709 12:17:02.630121 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:02.697463 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:02.696709 12965 raft_consensus.cc:515] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:02.649888 11447 raft_consensus.cc:2468] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 3.
I20260709 12:17:02.646102 11601 raft_consensus.cc:3060] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:02.688550 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:02.706195 11418 leader_election.cc:304] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:02.711588 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e4724ed93a467ea47763eec9a6de2e" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:02.717623 11595 raft_consensus.cc:3060] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:02.713601 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390e91331fd04f97a5235133a34875ee" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:02.689416 11446 raft_consensus.cc:2468] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 2.
I20260709 12:17:02.722344 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:02.714994 11527 raft_consensus.cc:3060] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:02.712844 12994 raft_consensus.cc:2804] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:02.719108 11521 raft_consensus.cc:2468] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 3.
I20260709 12:17:02.714147 12347 raft_consensus.cc:2468] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 3.
I20260709 12:17:02.727095 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:02.727766 11521 raft_consensus.cc:2468] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 3.
I20260709 12:17:02.723275 11525 raft_consensus.cc:2468] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 3.
I20260709 12:17:02.714466 11491 leader_election.cc:304] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:02.729162 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:02.729362 11491 leader_election.cc:304] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:02.731746 11491 leader_election.cc:304] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:02.732033 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:02.733358 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8741606df54c3f8b5cc5c1141862ea" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:02.735428 11418 leader_election.cc:304] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:02.722018 13024 raft_consensus.cc:2804] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:02.741034 11418 leader_election.cc:304] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:02.726014 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ed4eeff0ae44d0bc1ebb8cbe3adea5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:02.748855 12204 leader_election.cc:304] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:02.742218 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:02.752732 12965 leader_election.cc:290] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:02.754005 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:02.755965 13030 leader_election.cc:290] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:02.738489 12906 raft_consensus.cc:2804] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:02.757858 12906 raft_consensus.cc:697] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [term 4 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:02.735594 12869 raft_consensus.cc:2804] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:02.747763 11418 leader_election.cc:304] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
W20260709 12:17:02.714866 11594 rpcz_store.cc:269] 0709 12:17:00.273433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:00.276302 (+  2869us) service_pool.cc:224] Handling call
0709 12:17:02.243186 (+1966884us) spinlock_profiling.cc:243] Waited 9.45 ms on lock 0x7b5800220b98. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb890a0 00007f84ebb88984 00007f84e51036d4 00007f84e5103662
0709 12:17:02.637093 (+393907us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b540054b854. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:02.637231 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45130368}
I20260709 12:17:02.733855 13026 raft_consensus.cc:2804] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:02.769196 11450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35814 (request call id 155) took 1622 ms. Trace:
I20260709 12:17:02.769650 11450 rpcz_store.cc:276] 0709 12:17:01.146436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:02.094230 (+947794us) service_pool.cc:224] Handling call
0709 12:17:02.094597 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:02.138700 (+ 44103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:02.768843 (+630143us) spinlock_profiling.cc:243] Waited 33.7 ms on lock 0x7b54000baed4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:17:02.769131 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":77566336}
I20260709 12:17:02.770769 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:02.771274 11601 raft_consensus.cc:2468] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 4.
I20260709 12:17:02.773694 11600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55250 (request call id 457) took 1055 ms. Trace:
I20260709 12:17:02.774194 11600 rpcz_store.cc:276] 0709 12:17:01.718234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:02.186239 (+468005us) service_pool.cc:224] Handling call
0709 12:17:02.186539 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:02.430753 (+244214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:02.430787 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:02.430827 (+    40us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:02.430856 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:02.773432 (+342576us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b54002e9354. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:17:02.773488 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:02.773624 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":560897408}
I20260709 12:17:02.775673 11527 raft_consensus.cc:2468] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 3.
I20260709 12:17:02.776579 11419 leader_election.cc:304] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:02.777944 11595 raft_consensus.cc:2468] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 6.
I20260709 12:17:02.785467 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:02.746150 12984 raft_consensus.cc:2804] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:02.747455 13024 raft_consensus.cc:493] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:02.787190 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c355b3902a4e7fb72bac6a91ea3316" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:02.804768 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:02.789299 12756 leader_election.cc:290] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:02.786716 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:02.790578 11449 raft_consensus.cc:1240] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 3. Current term is 4. Ops: []
W20260709 12:17:02.898226 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 121553us
I20260709 12:17:02.817936 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:02.794107 12984 raft_consensus.cc:493] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:02.767956 13026 raft_consensus.cc:493] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:02.827976 12951 consensus_queue.cc:1059] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:17:02.911111 12984 raft_consensus.cc:3060] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:02.911264 13026 raft_consensus.cc:3060] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:02.912474 12951 raft_consensus.cc:3055] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:02.912935 12951 raft_consensus.cc:740] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:02.823822 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:02.853818 12960 leader_election.cc:290] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:02.810783 12994 raft_consensus.cc:697] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 5 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:02.855113 12966 raft_consensus.cc:3055] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:17:02.813653 11602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 594) took 2539 ms (client timeout 3315 ms). Trace:
I20260709 12:17:02.915446 12966 raft_consensus.cc:740] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
W20260709 12:17:02.916005 11602 rpcz_store.cc:269] 0709 12:17:00.273764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:00.276340 (+  2576us) service_pool.cc:224] Handling call
0709 12:17:02.765446 (+2489106us) spinlock_profiling.cc:243] Waited 9.36 ms on lock 0x7b5800220b98. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb890a0 00007f84ebb88984 00007f84e51036d4 00007f84e5103662
0709 12:17:02.813586 (+ 48140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21521152}
I20260709 12:17:02.805574 13024 raft_consensus.cc:3060] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:02.917768 12966 consensus_queue.cc:260] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:02.767495 13017 raft_consensus.cc:2804] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:02.748790 12810 raft_consensus.cc:2804] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:02.920248 13017 raft_consensus.cc:493] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting leader election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:02.920557 12810 raft_consensus.cc:493] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:02.921059 13017 raft_consensus.cc:3060] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:02.791128 13019 raft_consensus.cc:515] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:02.797798 12906 consensus_queue.cc:237] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:02.799043 12809 leader_election.cc:290] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:02.856714 12757 leader_election.cc:290] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:02.809366 12988 raft_consensus.cc:493] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:02.927717 12988 raft_consensus.cc:515] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:02.792438 12899 leader_election.cc:290] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:02.767347 12869 raft_consensus.cc:493] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:02.916797 12994 consensus_queue.cc:237] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:02.930370 12869 raft_consensus.cc:3060] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:02.820679 12983 raft_consensus.cc:493] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:02.815624 12820 raft_consensus.cc:515] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:02.815442 12893 leader_election.cc:290] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
W20260709 12:17:02.844650 13010 log.cc:927] Time spent T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 1.127s	user 0.011s	sys 0.009s
I20260709 12:17:02.826669 13037 raft_consensus.cc:493] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:02.940578 11525 raft_consensus.cc:2393] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 4: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:17:02.940972 13037 raft_consensus.cc:515] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:02.942544 12820 leader_election.cc:290] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:02.944680 13037 leader_election.cc:290] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:02.765599 13047 raft_consensus.cc:493] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:02.946115 13047 raft_consensus.cc:515] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:02.947120 13019 leader_election.cc:290] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:02.911283 12902 raft_consensus.cc:2749] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:02.921224 12810 raft_consensus.cc:3060] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:02.948633 13047 leader_election.cc:290] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:02.921216 12966 raft_consensus.cc:3060] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:02.952756 12988 leader_election.cc:290] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:02.953837 11449 raft_consensus.cc:1240] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:17:02.938529 12983 raft_consensus.cc:515] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:02.957484 12951 consensus_queue.cc:260] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:02.959913 12951 raft_consensus.cc:3060] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:02.961443 11522 raft_consensus.cc:1240] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:02.964236 13024 raft_consensus.cc:515] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:02.965288 11419 leader_election.cc:304] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:02.966495 11519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33456 (request call id 824) took 1241 ms. Trace:
I20260709 12:17:02.969867 11452 raft_consensus.cc:1240] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:02.969837 11519 rpcz_store.cc:276] 0709 12:17:01.725117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:01.728253 (+  3136us) service_pool.cc:224] Handling call
0709 12:17:01.728692 (+   439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:02.039548 (+310856us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:02.965898 (+926350us) spinlock_profiling.cc:243] Waited 47.9 ms on lock 0x7b54001379d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:17:02.966241 (+   343us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":110136192}
I20260709 12:17:02.974229 11418 leader_election.cc:304] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:02.978605 12809 raft_consensus.cc:2804] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:02.983377 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:17:02.984719 11599 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40784 (request call id 158) took 1842 ms (client timeout 1804 ms). Trace:
W20260709 12:17:02.985203 11599 rpcz_store.cc:269] 0709 12:17:01.141860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:01.145513 (+  3653us) service_pool.cc:224] Handling call
0709 12:17:02.982968 (+1837455us) spinlock_profiling.cc:243] Waited 8.29 ms on lock 0x7b5800220b98. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb890a0 00007f84ebb88984 00007f84e51036d4 00007f84e5103662
0709 12:17:02.984597 (+  1629us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19071360}
I20260709 12:17:02.980545 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:17:02.993618 11596 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40784 (request call id 161) took 1850 ms (client timeout 2031 ms). Trace:
W20260709 12:17:02.999116 11596 rpcz_store.cc:269] 0709 12:17:01.142810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:01.145585 (+  2775us) service_pool.cc:224] Handling call
0709 12:17:02.980005 (+1834420us) spinlock_profiling.cc:243] Waited 2.54 ms on lock 0x7b5800220b98. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb890a0 00007f84ebb88984 00007f84e51036d4 00007f84e5103662
0709 12:17:02.993543 (+ 13538us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5832448}
W20260709 12:17:03.001021 12205 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:03.002056 13047 raft_consensus.cc:493] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:03.002782 13047 raft_consensus.cc:515] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:02.995281 11491 leader_election.cc:304] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:02.995777 12203 leader_election.cc:304] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:02.996307 12947 raft_consensus.cc:493] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.996635 12785 raft_consensus.cc:493] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:03.007287 13047 leader_election.cc:290] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:03.021605 12809 raft_consensus.cc:697] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 3 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:03.021826 12785 raft_consensus.cc:515] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:03.022989 12809 consensus_queue.cc:237] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:03.024928 12785 leader_election.cc:290] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:02.998571 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ed4eeff0ae44d0bc1ebb8cbe3adea5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:02.998404 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:03.014241 12947 raft_consensus.cc:515] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:03.025703 12858 raft_consensus.cc:2804] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:03.027099 12203 leader_election.cc:304] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:03.027470 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:03.030015 12361 raft_consensus.cc:1240] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:03.030047 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:03.030570 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:03.030066 13035 raft_consensus.cc:2749] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:17:03.028647 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 63589.6us
I20260709 12:17:02.996824 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:03.039987 11448 raft_consensus.cc:1240] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:03.041000 11448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58868 (request call id 999) took 2782 ms. Trace:
I20260709 12:17:02.996677 12983 leader_election.cc:290] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:03.041890 11528 raft_consensus.cc:2468] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 3.
I20260709 12:17:03.043119 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:03.044517 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:03.045918 12349 raft_consensus.cc:2468] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 2.
W20260709 12:17:03.046880 11445 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58868 (request call id 1001) took 2787 ms (client timeout 2813 ms). Trace:
W20260709 12:17:03.047365 11445 rpcz_store.cc:269] 0709 12:17:00.259549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:00.276069 (+ 16520us) service_pool.cc:224] Handling call
0709 12:17:03.046449 (+2770380us) spinlock_profiling.cc:243] Waited 1.87 s on lock 0x7b5400107a54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:03.046668 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4298018176}
I20260709 12:17:03.036077 12858 raft_consensus.cc:493] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting leader election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:03.048332 12858 raft_consensus.cc:3060] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:03.054762 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:03.065187 12893 raft_consensus.cc:2804] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:03.065802 12893 raft_consensus.cc:493] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:03.066273 12893 raft_consensus.cc:3060] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:03.068415 13035 raft_consensus.cc:493] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:03.069332 13035 raft_consensus.cc:515] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:03.055354 11520 raft_consensus.cc:2468] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 2.
I20260709 12:17:03.072932 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:03.074517 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:03.075752 11596 raft_consensus.cc:2393] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 4: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:17:03.075941 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9fe9a94294836aec652338f44367d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:03.081249 11524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33456 (request call id 825) took 1355 ms. Trace:
I20260709 12:17:03.081856 11524 rpcz_store.cc:276] 0709 12:17:01.729963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:01.734549 (+  4586us) service_pool.cc:224] Handling call
0709 12:17:01.734845 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:02.234265 (+499420us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:03.080766 (+846501us) spinlock_profiling.cc:243] Waited 499 ms on lock 0x7b54000d2854. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:17:03.081072 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1147046272}
I20260709 12:17:03.056313 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c355b3902a4e7fb72bac6a91ea3316" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:03.045035 12869 raft_consensus.cc:515] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:03.057837 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:03.061792 11448 rpcz_store.cc:276] 0709 12:17:00.258970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:00.283316 (+ 24346us) service_pool.cc:224] Handling call
0709 12:17:03.039087 (+2755771us) spinlock_profiling.cc:243] Waited 2.42 ms on lock 0x7b5800003998. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb9cfc0 00007f84ebb87929 00007f84ebb873d2 00007f84e50febd4
0709 12:17:03.039548 (+   461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:03.040628 (+  1080us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:03.040905 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5569408}
I20260709 12:17:03.064311 12203 leader_election.cc:304] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:03.083455 11419 leader_election.cc:304] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:03.085399 11528 raft_consensus.cc:2393] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 4: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:17:03.094012 12947 leader_election.cc:290] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
W20260709 12:17:03.103590 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 108650us
I20260709 12:17:03.113750 11521 raft_consensus.cc:2393] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 5: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:17:03.115202 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:03.116148 11521 raft_consensus.cc:2468] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 2.
I20260709 12:17:03.119752 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:03.121037 12948 consensus_queue.cc:1059] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:03.122155 12948 consensus_queue.cc:1059] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:03.123297 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:03.124500 12966 raft_consensus.cc:3055] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:03.126801 12869 leader_election.cc:290] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:03.106536 12983 raft_consensus.cc:2804] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:03.130308 12983 raft_consensus.cc:697] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 4 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:03.131894 12983 consensus_queue.cc:237] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:03.123401 13047 raft_consensus.cc:3055] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:03.136050 13047 raft_consensus.cc:740] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:03.137459 13047 consensus_queue.cc:260] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:03.139593 13047 raft_consensus.cc:3060] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:03.140447 12959 raft_consensus.cc:493] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:03.141613 12206 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:03.141461 12959 raft_consensus.cc:515] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:03.142474 13035 leader_election.cc:290] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:03.143129 11491 leader_election.cc:304] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:03.144229 12959 leader_election.cc:290] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:03.145289 12867 raft_consensus.cc:2804] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:03.146225 12867 raft_consensus.cc:697] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [term 6 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:03.147069 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:03.147979 12867 consensus_queue.cc:237] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:03.124924 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:03.130772 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:03.117233 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:03.156625 11526 raft_consensus.cc:2393] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 3: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:03.158789 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:03.159281 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:03.160002 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:03.160872 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:03.161566 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ed4eeff0ae44d0bc1ebb8cbe3adea5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:03.161846 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:03.158877 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:03.162734 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:03.160897 12346 raft_consensus.cc:2468] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 4.
W20260709 12:17:03.164024 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 80829.5us
I20260709 12:17:03.152567 11522 raft_consensus.cc:2468] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 3.
W20260709 12:17:03.169021 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 104894us
I20260709 12:17:03.124966 12966 raft_consensus.cc:740] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:03.181792 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:03.164043 12729 leader_election.cc:290] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:03.183247 12359 raft_consensus.cc:2468] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 1.
I20260709 12:17:03.185132 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:03.186039 12361 raft_consensus.cc:2468] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 3.
I20260709 12:17:03.187098 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:03.188431 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:03.189328 12347 raft_consensus.cc:2468] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 3.
I20260709 12:17:03.161746 12727 raft_consensus.cc:3060] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:03.190145 12959 raft_consensus.cc:493] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:03.190810 12959 raft_consensus.cc:515] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:03.182324 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:03.191586 12966 consensus_queue.cc:260] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:03.193280 12959 leader_election.cc:290] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:03.196732 11275 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57426 (request call id 163) took 7072 ms. Trace:
I20260709 12:17:03.199007 11274 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57430 (request call id 151) took 4773 ms. Trace:
I20260709 12:17:03.202103 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:03.202682 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:03.204047 12902 consensus_queue.cc:1048] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:03.205124 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:03.207437 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:03.208566 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:03.210902 12838 consensus_queue.cc:1048] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:03.208796 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:03.209215 12356 raft_consensus.cc:2468] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 4.
I20260709 12:17:03.218540 11520 raft_consensus.cc:1275] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:03.193145 12966 raft_consensus.cc:3060] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:03.220506 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:03.222244 11521 raft_consensus.cc:2468] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 3.
I20260709 12:17:03.222100 11419 leader_election.cc:304] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:03.226809 11525 raft_consensus.cc:1240] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:03.227154 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:03.227901 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:03.228500 12899 consensus_queue.cc:1048] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:03.221550 11418 leader_election.cc:304] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:03.225286 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:03.231042 12902 raft_consensus.cc:2804] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:03.230902 12899 consensus_queue.cc:1048] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:03.231500 12902 raft_consensus.cc:493] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:03.231662 12361 raft_consensus.cc:2468] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 5.
I20260709 12:17:03.231992 12902 raft_consensus.cc:3060] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:03.197234 11275 rpcz_store.cc:276] 0709 12:16:56.123664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:56.137552 (+ 13888us) service_pool.cc:224] Handling call
0709 12:17:03.196419 (+7058867us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":6}
I20260709 12:17:03.233093 13023 consensus_queue.cc:1059] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:03.246088 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:03.224261 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:03.242499 12203 leader_election.cc:304] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:03.237154 12994 raft_consensus.cc:2804] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:03.245137 13024 leader_election.cc:290] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:03.226835 13026 raft_consensus.cc:515] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:03.270586 12356 raft_consensus.cc:1240] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:03.254794 12994 raft_consensus.cc:493] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:03.199523 11274 rpcz_store.cc:276] 0709 12:16:58.425850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:58.439357 (+ 13507us) service_pool.cc:224] Handling call
0709 12:17:03.198766 (+4759409us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:02.621074 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:02.634322 (+ 13248us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:02.634359 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:17:02.634377 (+    18us) tablet.cc:662] Decoding operations
0709 12:17:02.635041 (+   664us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:02.635107 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:02.635133 (+    26us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:17:02.635657 (+   524us) tablet.cc:701] Row locks acquired
0709 12:17:02.635675 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:17:02.635816 (+   141us) write_op.cc:270] Start()
0709 12:17:02.635939 (+   123us) write_op.cc:276] Timestamp: P: 1783599422635770 usec, L: 0
0709 12:17:02.635959 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:17:02.636652 (+   693us) log.cc:844] Serialized 2093 byte log entry
0709 12:17:02.845082 (+208430us) op_driver.cc:464] REPLICATION: finished
0709 12:17:02.863619 (+ 18537us) write_op.cc:301] APPLY: starting
0709 12:17:02.863725 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:02.863931 (+   206us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:02.864129 (+   198us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:02.864834 (+   705us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:02.865052 (+   218us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:17:02.865100 (+    48us) write_op.cc:312] APPLY: finished
0709 12:17:02.865415 (+   315us) log.cc:844] Serialized 46 byte log entry
0709 12:17:02.865610 (+   195us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:02.865728 (+   118us) write_op.cc:454] Released schema lock
0709 12:17:02.865775 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:02.866184 (+   409us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:02.866212 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":51780,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":18216,"apply.run_cpu_time_us":2565,"apply.run_wall_time_us":2576,"num_ops":5,"prepare.queue_time_us":166632,"prepare.run_cpu_time_us":8103,"prepare.run_wall_time_us":85527,"raft.queue_time_us":99990,"raft.run_cpu_time_us":10977,"raft.run_wall_time_us":22531,"replication_time_us":208931,"thread_start_us":252821,"threads_started":4,"wal-append.queue_time_us":61335}]]}
W20260709 12:17:03.275918 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 58090.3us
I20260709 12:17:03.264815 13023 raft_consensus.cc:2804] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:03.259186 12357 raft_consensus.cc:2468] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 4.
I20260709 12:17:03.274765 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:03.288846 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:03.277269 12994 raft_consensus.cc:3060] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:03.294770 11520 raft_consensus.cc:3060] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:03.282871 13023 raft_consensus.cc:493] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting leader election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:03.304421 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:17:03.303833 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 90432.6us
I20260709 12:17:03.305195 12348 raft_consensus.cc:2468] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 2.
I20260709 12:17:03.306263 12203 leader_election.cc:304] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:03.319849 12729 raft_consensus.cc:2804] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:03.320339 12729 raft_consensus.cc:493] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting leader election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:03.320713 12729 raft_consensus.cc:3060] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:03.300798 11602 raft_consensus.cc:3060] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:03.303072 13023 raft_consensus.cc:3060] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:03.325553 11567 leader_election.cc:304] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:03.342473 11419 leader_election.cc:304] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:03.343941 11566 leader_election.cc:304] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:03.345134 12953 raft_consensus.cc:2804] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:17:03.345283 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 87580.5us
I20260709 12:17:03.345666 12953 raft_consensus.cc:493] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:03.348413 12953 raft_consensus.cc:3060] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:03.315177 12984 raft_consensus.cc:515] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:03.356238 12810 raft_consensus.cc:515] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:03.422369 11566 leader_election.cc:304] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:03.439781 12757 raft_consensus.cc:2804] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:03.440318 12757 raft_consensus.cc:493] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:03.440713 12757 raft_consensus.cc:3060] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:03.442086 13017 consensus_meta.cc:287] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d: Time spent flushing consensus metadata: real 0.520s	user 0.008s	sys 0.005s
I20260709 12:17:03.442544 13017 raft_consensus.cc:515] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
W20260709 12:17:03.445501 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 160705us
W20260709 12:17:03.445883 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 120615us
I20260709 12:17:03.446177 11493 leader_election.cc:304] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:03.447681 11493 leader_election.cc:304] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
W20260709 12:17:03.445883 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 111660us
I20260709 12:17:03.447988 11567 leader_election.cc:304] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:03.438519 13026 leader_election.cc:290] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:03.427402 13024 raft_consensus.cc:2804] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:03.447945 12869 raft_consensus.cc:2804] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:03.469838 11446 raft_consensus.cc:1240] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:03.472918 11419 leader_election.cc:304] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:03.474273 11449 raft_consensus.cc:1240] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:17:03.460162 12899 raft_consensus.cc:2749] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:03.490274 12770 raft_consensus.cc:2749] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:03.491914 13017 leader_election.cc:290] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:03.465850 12727 raft_consensus.cc:2749] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:03.493844 12349 raft_consensus.cc:2410] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 12:17:03.494956 13072 log.cc:927] Time spent T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 12:17:03.466564 13024 raft_consensus.cc:493] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting leader election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:03.483569 12790 raft_consensus.cc:2749] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:17:03.497886 13071 log.cc:927] Time spent T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 12:17:03.500149 11451 raft_consensus.cc:1240] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:03.495676 13024 raft_consensus.cc:3060] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:03.501134 12204 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:03.504978 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:03.487092 12858 raft_consensus.cc:515] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:03.505301 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:03.511983 12347 raft_consensus.cc:2468] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 2.
I20260709 12:17:03.484634 13019 raft_consensus.cc:2804] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:03.464577 13035 raft_consensus.cc:2804] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:03.475498 12869 raft_consensus.cc:493] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1c101e338f954ef086338e251deed19d)
W20260709 12:17:03.540958 13076 log.cc:927] Time spent T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:17:03.545828 13024 raft_consensus.cc:515] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:03.537415 12869 raft_consensus.cc:3060] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:03.547493 12810 leader_election.cc:290] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
W20260709 12:17:03.551451 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 103584us
I20260709 12:17:03.556449 12869 raft_consensus.cc:515] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:03.559299 12869 leader_election.cc:290] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:03.561658 13024 leader_election.cc:290] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:17:03.586421 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 228525us
I20260709 12:17:03.587442 11566 leader_election.cc:304] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:03.589013 11566 leader_election.cc:304] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
W20260709 12:17:03.600304 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 70129.7us
I20260709 12:17:03.519819 13019 raft_consensus.cc:493] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting leader election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:03.603659 11520 raft_consensus.cc:2468] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 4.
I20260709 12:17:03.616854 12939 raft_consensus.cc:2804] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:03.617432 12939 raft_consensus.cc:493] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:03.617789 12939 raft_consensus.cc:3060] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:03.495589 12906 consensus_queue.cc:1059] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.139s
I20260709 12:17:03.612212 13019 raft_consensus.cc:3060] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:03.631029 11567 leader_election.cc:304] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:03.626104 12683 raft_consensus.cc:2749] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:03.633075 12683 raft_consensus.cc:2804] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:03.633527 12683 raft_consensus.cc:493] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:03.633910 12683 raft_consensus.cc:3060] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:03.634246 12955 consensus_queue.cc:1059] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 12:17:03.635251 12955 raft_consensus.cc:3055] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:03.635630 12955 raft_consensus.cc:740] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:03.636547 12955 consensus_queue.cc:260] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:03.611130 13015 raft_consensus.cc:493] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:03.657651 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a841f2f09ced40a4bbf33594e11bd7ad" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:03.660907 12984 leader_election.cc:290] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:03.661551 11446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58868 (request call id 1005) took 1415 ms. Trace:
I20260709 12:17:03.662075 11446 rpcz_store.cc:276] 0709 12:17:02.245938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:02.748538 (+502600us) service_pool.cc:224] Handling call
0709 12:17:02.789728 (+ 41190us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:03.470471 (+680743us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:03.661142 (+190671us) spinlock_profiling.cc:243] Waited 649 ms on lock 0x7b5400109d54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:17:03.661472 (+   330us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1493223680}
I20260709 12:17:03.667476 13035 raft_consensus.cc:493] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:03.668061 13035 raft_consensus.cc:3060] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:03.646709 11602 raft_consensus.cc:2468] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 6.
I20260709 12:17:03.687708 12902 raft_consensus.cc:515] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:03.676779 12838 raft_consensus.cc:3055] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:03.688732 12838 raft_consensus.cc:740] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:03.689721 12838 consensus_queue.cc:260] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:03.690733 12838 raft_consensus.cc:3060] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:03.696004 13068 log.cc:927] Time spent T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.473s	user 0.004s	sys 0.000s
I20260709 12:17:03.696676 12757 raft_consensus.cc:515] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
W20260709 12:17:03.685631 12205 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:03.674614 13026 raft_consensus.cc:3055] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:03.735657 13026 raft_consensus.cc:740] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:03.736667 13026 consensus_queue.cc:260] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:03.670446 12955 raft_consensus.cc:3060] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:03.738113 13026 raft_consensus.cc:3060] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:03.683727 12858 leader_election.cc:290] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:03.741160 12757 leader_election.cc:290] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:03.653031 13015 raft_consensus.cc:515] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
W20260709 12:17:03.674489 13070 log.cc:927] Time spent T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.414s	user 0.002s	sys 0.000s
I20260709 12:17:03.714340 12352 raft_consensus.cc:2468] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 4.
W20260709 12:17:03.716992 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 63173.4us
I20260709 12:17:03.718221 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:03.719071 12729 raft_consensus.cc:515] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:03.719463 11566 leader_election.cc:304] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:03.734347 12902 leader_election.cc:290] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
W20260709 12:17:03.717069 12893 consensus_meta.cc:287] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de: Time spent flushing consensus metadata: real 0.650s	user 0.010s	sys 0.002s
I20260709 12:17:03.643600 12994 raft_consensus.cc:515] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:03.707854 12953 raft_consensus.cc:515] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:03.744421 12683 raft_consensus.cc:515] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:03.745565 13023 raft_consensus.cc:515] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
W20260709 12:17:03.766223 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 111032us
I20260709 12:17:03.772704 12899 raft_consensus.cc:2804] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:03.773250 12899 raft_consensus.cc:493] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:03.773685 12899 raft_consensus.cc:3060] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:03.779554 11567 leader_election.cc:304] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:03.781435 12203 leader_election.cc:304] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:03.782179 11566 leader_election.cc:304] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:03.784044 12994 leader_election.cc:290] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:03.784981 12361 raft_consensus.cc:1240] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 4. Current term is 5. Ops: []
W20260709 12:17:03.788379 11493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 340763us
I20260709 12:17:03.762887 12893 raft_consensus.cc:515] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:03.799736 12994 raft_consensus.cc:2749] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:17:03.810673 12204 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:03.812067 12848 raft_consensus.cc:2749] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:03.816061 12959 consensus_queue.cc:1048] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:17:03.816597 11521 raft_consensus.cc:1240] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:03.818605 12994 consensus_queue.cc:1059] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:03.819464 12966 raft_consensus.cc:3055] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:03.819842 12966 raft_consensus.cc:740] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
W20260709 12:17:03.829655 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 63646.6us
I20260709 12:17:03.832935 12203 leader_election.cc:304] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:03.834375 13023 leader_election.cc:290] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:03.808014 12757 raft_consensus.cc:2804] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:17:03.847432 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 86605.5us
I20260709 12:17:03.820837 12966 consensus_queue.cc:260] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:03.850180 12346 raft_consensus.cc:1240] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 5. Current term is 6. Ops: []
W20260709 12:17:03.840644 13047 consensus_meta.cc:287] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de: Time spent flushing consensus metadata: real 0.673s	user 0.005s	sys 0.011s
I20260709 12:17:03.841138 12955 raft_consensus.cc:2749] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:03.850390 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:03.837041 13015 leader_election.cc:290] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:03.844851 12757 raft_consensus.cc:493] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:03.846009 11275 catalog_manager.cc:5697] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 2 to 3, leader changed from a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131) to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 3 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } }
W20260709 12:17:03.865348 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 216465us
W20260709 12:17:03.868008 11418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:03.879817 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:03.881098 12947 consensus_queue.cc:1059] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:03.882351 11493 leader_election.cc:304] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:03.882519 12947 raft_consensus.cc:3055] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:03.883044 12947 raft_consensus.cc:740] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
W20260709 12:17:03.883826 12204 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:03.883962 11567 leader_election.cc:304] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:03.869894 12757 raft_consensus.cc:3060] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:03.883345 11275 catalog_manager.cc:5697] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 3 to 4, leader changed from 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132) to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 4 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } }
I20260709 12:17:03.873463 13026 raft_consensus.cc:493] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.860456 12899 raft_consensus.cc:515] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:03.888873 12966 raft_consensus.cc:3060] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:03.878065 11418 leader_election.cc:304] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:03.885480 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:03.891024 11275 catalog_manager.cc:5697] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 1 to 2, leader changed from a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131) to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 2 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } }
I20260709 12:17:03.882977 12683 leader_election.cc:290] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:03.897460 11275 catalog_manager.cc:5697] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 4 to 5, leader changed from 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132) to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 5 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } }
I20260709 12:17:03.894070 11567 leader_election.cc:304] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:03.899142 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:03.902422 13086 raft_consensus.cc:2804] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:03.893456 12770 raft_consensus.cc:2804] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:03.900749 11599 raft_consensus.cc:1240] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:03.902985 13086 raft_consensus.cc:697] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 4 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:03.904493 11446 raft_consensus.cc:1275] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:03.904400 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:03.905632 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:03.905349 13086 consensus_queue.cc:237] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:03.905345 12770 raft_consensus.cc:493] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:03.910923 11275 catalog_manager.cc:5697] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 3 to 5, leader changed from a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131) to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 5 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:03.889571 13026 raft_consensus.cc:515] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:03.897715 12729 leader_election.cc:290] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:03.885421 12939 raft_consensus.cc:515] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:03.900058 12953 leader_election.cc:290] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:03.910224 12770 raft_consensus.cc:3060] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:03.921922 11275 catalog_manager.cc:5697] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:03.905090 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390e91331fd04f97a5235133a34875ee" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:17:03.923637 11420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:03.917964 12683 raft_consensus.cc:2749] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:03.924469 11275 catalog_manager.cc:5697] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:03.927548 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:03.927611 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d43eecbad746fd9ddce50c5b9fc3e8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:03.926734 11275 catalog_manager.cc:5697] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 1 to 3, leader changed from 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132) to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 3 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:03.917706 12947 consensus_queue.cc:260] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:03.932518 12947 raft_consensus.cc:3060] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:03.931967 11275 catalog_manager.cc:5697] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:03.933753 11275 catalog_manager.cc:5697] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:03.935137 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:03.935380 11275 catalog_manager.cc:5697] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:03.927716 13085 raft_consensus.cc:2804] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:03.937008 13085 raft_consensus.cc:493] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:03.937464 13085 raft_consensus.cc:3060] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:03.924403 11602 raft_consensus.cc:2468] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 4.
I20260709 12:17:03.937175 11275 catalog_manager.cc:5697] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 2 to 4, leader changed from a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131) to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 4 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } }
W20260709 12:17:03.956892 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 163036us
I20260709 12:17:03.955539 11275 catalog_manager.cc:5697] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 1 to 3, leader changed from 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132) to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 3 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:03.903582 13019 raft_consensus.cc:515] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
W20260709 12:17:03.963846 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 75573us
W20260709 12:17:03.966557 12204 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:03.964668 11275 catalog_manager.cc:5697] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:03.969834 11275 catalog_manager.cc:5697] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:03.971935 12893 leader_election.cc:290] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:03.972121 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:03.973055 11596 raft_consensus.cc:1275] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:03.974534 12939 leader_election.cc:290] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:03.977533 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:03.977864 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:03.962824 11594 raft_consensus.cc:1240] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:03.986720 13026 leader_election.cc:290] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:03.979624 12203 leader_election.cc:304] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:03.989691 11493 leader_election.cc:304] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:03.991180 11493 leader_election.cc:304] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:03.992586 11493 leader_election.cc:304] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:03.993453 13084 raft_consensus.cc:2749] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:03.993541 13015 raft_consensus.cc:3060] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:03.994234 13084 raft_consensus.cc:2804] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:03.994619 13084 raft_consensus.cc:493] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:03.994985 13084 raft_consensus.cc:3060] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:03.997033 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:03.997797 11602 raft_consensus.cc:3060] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:04.002324 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:04.003165 12361 raft_consensus.cc:2393] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 5: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:17:04.005761 12770 raft_consensus.cc:515] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:04.007783 12893 raft_consensus.cc:2749] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:04.021690 11491 leader_election.cc:304] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:04.021936 12770 leader_election.cc:290] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:04.009759 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:04.010330 11521 raft_consensus.cc:1275] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:04.005761 13084 raft_consensus.cc:515] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:04.024868 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:04.010687 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7937e0cff84ef7a26c84247c8ffc08" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:04.025694 11450 raft_consensus.cc:2393] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 4: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:04.011409 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:04.012305 12955 consensus_queue.cc:1059] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:04.026152 12959 consensus_queue.cc:1048] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:04.026500 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:04.027175 12955 raft_consensus.cc:3055] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:04.027557 12955 raft_consensus.cc:740] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:04.027658 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:04.028575 11565 leader_election.cc:304] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:04.028447 12955 consensus_queue.cc:260] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:04.013538 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:04.012490 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:04.029652 12770 raft_consensus.cc:2804] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:04.014375 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:04.030074 12770 raft_consensus.cc:493] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:04.030629 11448 raft_consensus.cc:2393] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 4: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:04.031201 11454 raft_consensus.cc:1240] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:04.030646 12770 raft_consensus.cc:3060] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:04.014932 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:04.015053 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:04.016172 12947 consensus_queue.cc:1059] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:04.034583 12947 raft_consensus.cc:3055] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:04.034952 12947 raft_consensus.cc:740] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:04.035903 12947 consensus_queue.cc:260] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:04.019953 13015 raft_consensus.cc:2749] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:04.008827 11493 leader_election.cc:304] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:04.022670 13026 raft_consensus.cc:2749] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:04.013230 11602 raft_consensus.cc:2468] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 6.
I20260709 12:17:03.980223 11275 catalog_manager.cc:5697] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 1 to 3, leader changed from a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131) to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 3 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } }
I20260709 12:17:04.026216 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:04.030124 11449 raft_consensus.cc:2393] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 4: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:04.037359 12947 raft_consensus.cc:3060] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:04.038023 12899 leader_election.cc:290] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:04.023517 11491 leader_election.cc:304] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:04.039811 11493 leader_election.cc:304] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:04.039336 12869 raft_consensus.cc:2749] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:04.038985 11275 catalog_manager.cc:5697] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } }
I20260709 12:17:04.046758 12869 raft_consensus.cc:2804] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:04.025851 12893 consensus_queue.cc:1048] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:04.047168 12869 raft_consensus.cc:493] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:04.038213 12955 raft_consensus.cc:3060] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:04.047309 11275 catalog_manager.cc:5697] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } }
I20260709 12:17:04.028443 11450 raft_consensus.cc:2393] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 4: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:04.014676 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a841f2f09ced40a4bbf33594e11bd7ad" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:04.040306 11452 raft_consensus.cc:1240] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:04.030128 11565 leader_election.cc:304] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:04.050127 11275 catalog_manager.cc:5697] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } }
I20260709 12:17:04.061188 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:04.062580 11452 raft_consensus.cc:2393] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 5: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:04.062768 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:04.063688 11602 raft_consensus.cc:2368] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 3. Current term is 4.
I20260709 12:17:04.052778 12869 raft_consensus.cc:3060] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:04.039419 13019 leader_election.cc:290] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:04.039801 13084 leader_election.cc:290] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
W20260709 12:17:04.071947 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 177928us
I20260709 12:17:04.072121 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
W20260709 12:17:04.072378 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 49163.1us
I20260709 12:17:04.073462 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:04.075443 11452 raft_consensus.cc:2393] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 3: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:04.065563 12867 raft_consensus.cc:2749] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:04.045744 12757 raft_consensus.cc:515] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:04.052062 13035 raft_consensus.cc:515] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:04.078701 11453 raft_consensus.cc:1240] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:17:04.081146 11567 leader_election.cc:304] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:04.073431 12899 raft_consensus.cc:2804] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:04.081758 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:04.087334 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:04.044694 12770 raft_consensus.cc:515] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:04.085108 12953 raft_consensus.cc:2804] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:17:04.090274 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 60210us
I20260709 12:17:04.091207 11599 raft_consensus.cc:1240] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:04.085166 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:04.092327 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:04.092569 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:04.083912 12899 raft_consensus.cc:493] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:04.086756 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:04.098060 11594 raft_consensus.cc:2393] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 3: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:17:04.091943 12953 raft_consensus.cc:493] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:04.088717 12683 consensus_queue.cc:1059] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 12:17:04.117631 11493 leader_election.cc:304] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:04.100677 12899 raft_consensus.cc:3060] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:04.128274 11419 leader_election.cc:304] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
W20260709 12:17:04.135116 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 46287.2us
I20260709 12:17:04.101162 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
W20260709 12:17:04.150342 11493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 49227.2us
I20260709 12:17:04.117542 12953 raft_consensus.cc:3060] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:04.152401 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 67582.8us
I20260709 12:17:04.149427 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:04.136077 12770 leader_election.cc:290] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:04.132306 13086 raft_consensus.cc:493] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:04.154675 12203 leader_election.cc:304] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:04.157969 11451 raft_consensus.cc:1275] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:04.141803 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:04.163914 11595 raft_consensus.cc:1240] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 12:17:04.164880 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 50089.8us
I20260709 12:17:04.168380 12838 raft_consensus.cc:2804] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:04.170014 11567 leader_election.cc:304] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:04.170729 12838 raft_consensus.cc:493] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting leader election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:04.164703 13084 raft_consensus.cc:2804] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:17:04.181881 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 53794.8us
I20260709 12:17:04.182524 12838 raft_consensus.cc:3060] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:04.183233 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8741606df54c3f8b5cc5c1141862ea" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:04.168805 12729 raft_consensus.cc:2749] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:04.167270 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:04.182771 12683 raft_consensus.cc:2749] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:04.160277 12893 consensus_queue.cc:1048] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
W20260709 12:17:04.201730 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 47191.6us
I20260709 12:17:04.202705 12203 leader_election.cc:304] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:04.204109 11491 leader_election.cc:304] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:04.167410 13086 raft_consensus.cc:515] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:04.206885 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:04.184580 13084 raft_consensus.cc:493] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:04.200374 13035 leader_election.cc:290] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:04.198362 12757 leader_election.cc:290] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:17:04.243928 12205 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:04.270641 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:04.271574 12981 raft_consensus.cc:2804] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:04.208935 12848 consensus_queue.cc:1059] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 12:17:04.211637 12947 raft_consensus.cc:2749] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:04.225190 11519 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25"
dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
mode: GRACEFUL
new_leader_uuid: "1c101e338f954ef086338e251deed19d"
 from {username='slave'} at 127.0.0.1:42478
W20260709 12:17:04.293951 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 101764us
I20260709 12:17:04.279708 12838 raft_consensus.cc:515] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:04.291342 11565 leader_election.cc:304] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:04.294714 11595 raft_consensus.cc:2393] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 3: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:17:04.294490 11519 raft_consensus.cc:606] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 2 LEADER]: Received request to transfer leadership to TS 1c101e338f954ef086338e251deed19d
I20260709 12:17:04.219779 13084 raft_consensus.cc:3060] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:04.300074 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:04.300521 11491 leader_election.cc:304] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:04.294364 12981 raft_consensus.cc:493] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:04.302834 12356 raft_consensus.cc:1275] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:17:04.307816 12356 pending_rounds.cc:85] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de: Aborting all ops after (but not including) 3
I20260709 12:17:04.310134 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
W20260709 12:17:04.311285 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 102224us
I20260709 12:17:04.308148 12356 pending_rounds.cc:107] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:17:04.346920 12356 raft_consensus.cc:2889] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:17:04.347054 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 145687us
I20260709 12:17:04.298089 12902 raft_consensus.cc:493] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
W20260709 12:17:04.361248 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 158623us
I20260709 12:17:04.347798 12757 raft_consensus.cc:3055] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:04.312145 12858 raft_consensus.cc:493] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:04.308727 12981 raft_consensus.cc:3060] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:04.366905 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:17:04.354925 13095 log.cc:927] Time spent T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.163s	user 0.000s	sys 0.003s
I20260709 12:17:04.311731 12848 consensus_queue.cc:1059] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 12:17:04.314792 12867 raft_consensus.cc:493] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:04.370620 12347 raft_consensus.cc:2468] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 5.
I20260709 12:17:04.369436 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:04.306145 13085 raft_consensus.cc:515] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:04.357187 12770 raft_consensus.cc:2749] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:17:04.374387 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 154684us
I20260709 12:17:04.375303 11595 raft_consensus.cc:2468] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 5.
I20260709 12:17:04.375862 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:04.367460 13015 raft_consensus.cc:2749] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:04.381680 11493 leader_election.cc:304] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:04.368223 12757 raft_consensus.cc:740] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:04.373739 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e4724ed93a467ea47763eec9a6de2e" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:04.381546 12203 leader_election.cc:304] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
W20260709 12:17:04.393296 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 92932.4us
I20260709 12:17:04.367780 12902 raft_consensus.cc:515] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:04.394251 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:04.394536 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:04.396538 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:04.396739 11491 leader_election.cc:304] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:04.396955 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:04.398207 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ed4eeff0ae44d0bc1ebb8cbe3adea5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:04.398972 11597 raft_consensus.cc:1240] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:17:04.400061 11597 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "1c101e338f954ef086338e251deed19d"
 from {username='slave'} at 127.0.0.1:37992
I20260709 12:17:04.400648 11597 raft_consensus.cc:606] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Received request to transfer leadership to TS 1c101e338f954ef086338e251deed19d
I20260709 12:17:04.401553 11601 raft_consensus.cc:1275] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:04.395344 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:04.406288 12348 raft_consensus.cc:2468] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 6.
I20260709 12:17:04.375968 13026 consensus_queue.cc:1048] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 12:17:04.412045 12939 raft_consensus.cc:3055] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:04.412539 12939 raft_consensus.cc:740] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:04.412597 13026 raft_consensus.cc:2804] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:04.413065 13026 raft_consensus.cc:493] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:04.414050 11598 raft_consensus.cc:1240] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:17:04.414140 12349 raft_consensus.cc:1240] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:04.373898 12858 raft_consensus.cc:515] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:04.394657 13015 raft_consensus.cc:2804] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:04.390007 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a841f2f09ced40a4bbf33594e11bd7ad" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:04.378191 12867 raft_consensus.cc:515] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:04.423425 13103 consensus_queue.cc:1059] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:17:04.424013 13099 log.cc:927] Time spent T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:17:04.424906 12939 consensus_queue.cc:260] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:04.430131 13086 leader_election.cc:290] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:04.431159 12359 raft_consensus.cc:1275] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:04.412743 12902 leader_election.cc:290] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:04.439431 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
W20260709 12:17:04.440702 12204 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:04.423481 11600 raft_consensus.cc:1240] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:17:04.442512 11565 leader_election.cc:304] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:04.428719 12899 raft_consensus.cc:515] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:04.445828 13103 raft_consensus.cc:3055] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:04.430636 12757 consensus_queue.cc:260] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
W20260709 12:17:04.450352 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 81462us
I20260709 12:17:04.451464 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:04.453971 12939 raft_consensus.cc:3060] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:04.447932 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:17:04.463785 11420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:04.466826 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:04.416383 13026 raft_consensus.cc:3060] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:04.465791 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:04.417467 12966 raft_consensus.cc:2749] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:04.468863 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:04.469290 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:04.470534 11565 leader_election.cc:304] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
W20260709 12:17:04.470860 13093 log.cc:927] Time spent T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.291s	user 0.003s	sys 0.000s
I20260709 12:17:04.471222 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:04.446699 13015 raft_consensus.cc:493] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:04.477558 13086 raft_consensus.cc:493] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:04.481616 11593 raft_consensus.cc:2368] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 3. Current term is 4.
I20260709 12:17:04.492866 13015 raft_consensus.cc:3060] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:04.488287 12757 raft_consensus.cc:3060] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:04.492062 12959 raft_consensus.cc:3055] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:04.494525 12959 raft_consensus.cc:740] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:04.468731 13091 raft_consensus.cc:2804] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:04.495195 13091 raft_consensus.cc:493] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:04.495450 12959 consensus_queue.cc:260] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:04.484094 12848 raft_consensus.cc:2749] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:04.472502 13087 raft_consensus.cc:493] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:04.498165 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:04.496268 12359 raft_consensus.cc:2410] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:04.492626 13086 raft_consensus.cc:515] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:04.498006 13087 raft_consensus.cc:515] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:04.462071 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:04.499760 11524 raft_consensus.cc:1240] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:17:04.499332 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:04.495590 13091 raft_consensus.cc:3060] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:04.500797 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:04.501477 12959 raft_consensus.cc:3060] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:04.483549 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:17:04.503165 11418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:04.504550 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffe47647c274723808482c166efa21c" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:04.504987 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:04.505870 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d43eecbad746fd9ddce50c5b9fc3e8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:04.511698 11602 raft_consensus.cc:2393] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 3: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:17:04.437140 12953 raft_consensus.cc:515] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:04.507508 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:04.516481 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390e91331fd04f97a5235133a34875ee" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:04.516738 11593 raft_consensus.cc:2393] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 3: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:17:04.507251 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e4724ed93a467ea47763eec9a6de2e" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:04.517891 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:04.518688 11593 raft_consensus.cc:2368] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 3. Current term is 4.
I20260709 12:17:04.519860 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:04.517786 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:04.524216 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:04.535977 12203 leader_election.cc:304] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:04.538039 12203 leader_election.cc:304] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:04.466370 13103 raft_consensus.cc:740] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:04.550206 11519 raft_consensus.cc:1240] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:04.507300 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:04.517664 12899 leader_election.cc:290] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:04.555223 11599 raft_consensus.cc:1240] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:04.511057 13087 leader_election.cc:290] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:17:04.562019 11493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 88306.6us
I20260709 12:17:04.545926 12966 raft_consensus.cc:2749] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:04.563710 12203 leader_election.cc:304] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:04.554235 12893 raft_consensus.cc:2749] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:17:04.568646 12204 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:04.571484 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 87294.5us
I20260709 12:17:04.529601 13084 raft_consensus.cc:515] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
W20260709 12:17:04.587721 12204 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:04.574410 12838 leader_election.cc:290] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:04.574165 13103 consensus_queue.cc:260] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:04.591463 13103 raft_consensus.cc:3060] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:04.575032 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:04.575495 13104 consensus_queue.cc:1048] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:04.575681 13085 leader_election.cc:290] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
W20260709 12:17:04.576109 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 179459us
I20260709 12:17:04.577555 12683 raft_consensus.cc:993] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8: : Instructing follower 1c101e338f954ef086338e251deed19d to start an election
I20260709 12:17:04.570192 13102 consensus_queue.cc:1059] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:17:04.564781 13087 consensus_queue.cc:1059] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:17:04.578737 13086 leader_election.cc:290] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:04.587110 12994 raft_consensus.cc:3060] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:04.562547 12848 raft_consensus.cc:493] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:04.581892 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:04.623566 12939 consensus_queue.cc:1059] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:04.624543 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7937e0cff84ef7a26c84247c8ffc08" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:17:04.625371 11568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:04.626130 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e4724ed93a467ea47763eec9a6de2e" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:04.623588 12848 raft_consensus.cc:515] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:04.627488 11593 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "1c101e338f954ef086338e251deed19d"
 from {username='slave'} at 127.0.0.1:37992
I20260709 12:17:04.628067 11593 raft_consensus.cc:606] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Received request to transfer leadership to TS 1c101e338f954ef086338e251deed19d
I20260709 12:17:04.628396 11593 raft_consensus.cc:614] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:04.629956 12848 leader_election.cc:290] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:04.630612 12848 raft_consensus.cc:1081] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Signalling peer 1c101e338f954ef086338e251deed19d to start an election
I20260709 12:17:04.582269 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:04.582587 12899 consensus_queue.cc:1059] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:04.632164 12348 raft_consensus.cc:2393] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 5: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:17:04.632393 12899 raft_consensus.cc:3055] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:04.632813 12899 raft_consensus.cc:740] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
W20260709 12:17:04.634002 12869 consensus_meta.cc:287] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671: Time spent flushing consensus metadata: real 0.556s	user 0.011s	sys 0.000s
I20260709 12:17:04.633651 12899 consensus_queue.cc:260] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:04.634752 11595 raft_consensus.cc:2410] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:17:04.583650 12867 leader_election.cc:290] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:04.635078 12899 raft_consensus.cc:3060] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:04.635453 11593 raft_consensus.cc:1240] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:04.583673 13097 consensus_queue.cc:1059] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:04.581893 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffe47647c274723808482c166efa21c" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:04.636284 13084 leader_election.cc:290] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:04.585103 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:04.636873 11593 raft_consensus.cc:1275] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:04.583039 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:04.581938 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:04.589540 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:04.634773 11598 raft_consensus.cc:2410] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:04.638374 11593 raft_consensus.cc:1240] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:17:04.606295 12203 leader_election.cc:304] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:04.601541 11491 leader_election.cc:304] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
W20260709 12:17:05.487041 13114 log.cc:927] Time spent T 00000000000000000000000000000000 P eb02cb678b0c4f28932bfb6c2377165e: Append to log took a long time: real 0.780s	user 0.001s	sys 0.000s
I20260709 12:17:05.496203 13117 raft_consensus.cc:493] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:06.119132 13117 raft_consensus.cc:515] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:05.797511 13125 raft_consensus.cc:493] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:05.821655 13115 raft_consensus.cc:493] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:05.890443 13124 raft_consensus.cc:493] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:05.928732 13123 raft_consensus.cc:493] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:05.932431 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 1.34304e+06us
I20260709 12:17:06.122133 13115 raft_consensus.cc:515] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:06.123178 11417 leader_election.cc:304] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:06.125202 13115 leader_election.cc:290] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:06.125867 11417 leader_election.cc:304] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
W20260709 12:17:04.710919 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 124241us
I20260709 12:17:06.337679 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:06.338358 11528 raft_consensus.cc:3060] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:05.425534 11568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:06.398145 13141 raft_consensus.cc:493] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:06.398761 13141 raft_consensus.cc:515] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:06.399526 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:06.400859 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:04.637476 11596 raft_consensus.cc:2393] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 5: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
W20260709 12:17:06.403436 11596 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40784 (request call id 177) took 1830 ms (client timeout 2090 ms). Trace:
W20260709 12:17:06.403834 11596 rpcz_store.cc:269] 0709 12:17:04.573245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:04.584823 (+ 11578us) service_pool.cc:224] Handling call
0709 12:17:06.403365 (+1818542us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:06.406364 12683 raft_consensus.cc:493] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:06.406935 12683 raft_consensus.cc:515] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:06.409054 12683 leader_election.cc:290] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:06.410403 12899 raft_consensus.cc:493] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.410950 12899 raft_consensus.cc:515] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:06.413565 13122 raft_consensus.cc:493] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.414125 13122 raft_consensus.cc:515] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:06.416291 13122 leader_election.cc:290] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:05.604128 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:04.645664 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a841f2f09ced40a4bbf33594e11bd7ad" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:17:06.422758 11599 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40784 (request call id 180) took 1780 ms (client timeout 1633 ms). Trace:
W20260709 12:17:06.423348 11593 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40784 (request call id 182) took 1780 ms (client timeout 1561 ms). Trace:
W20260709 12:17:06.423835 11593 rpcz_store.cc:269] 0709 12:17:04.642654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:04.645412 (+  2758us) service_pool.cc:224] Handling call
0709 12:17:06.423275 (+1777863us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:17:06.424731 11593 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40784 (request call id 190) took 1743 ms (client timeout 1667 ms). Trace:
W20260709 12:17:06.425084 11593 rpcz_store.cc:269] 0709 12:17:04.681517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:06.424545 (+1743028us) service_pool.cc:211] Skipping call since client already timed out
0709 12:17:06.424675 (+   130us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:17:06.425954 11593 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40784 (request call id 188) took 1769 ms (client timeout 1742 ms). Trace:
W20260709 12:17:06.426294 11593 rpcz_store.cc:269] 0709 12:17:04.656963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:06.425796 (+1768833us) service_pool.cc:211] Skipping call since client already timed out
0709 12:17:06.425905 (+   109us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:17:06.427170 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:05.970144 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:17:06.430794 11594 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 624) took 2004 ms (client timeout 1718 ms). Trace:
W20260709 12:17:06.431187 11594 rpcz_store.cc:269] 0709 12:17:04.426760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:05.969738 (+1542978us) service_pool.cc:224] Handling call
0709 12:17:06.430717 (+460979us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:06.432406 11594 raft_consensus.cc:1240] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:06.434191 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:04.644696 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:06.435372 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:17:06.435636 11602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40784 (request call id 179) took 1794 ms (client timeout 1680 ms). Trace:
W20260709 12:17:06.436058 11602 rpcz_store.cc:269] 0709 12:17:04.641700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:04.644407 (+  2707us) service_pool.cc:224] Handling call
0709 12:17:06.435568 (+1791161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:04.647989 11601 raft_consensus.cc:2468] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 5.
I20260709 12:17:04.705709 12203 leader_election.cc:304] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
W20260709 12:17:05.456959 12204 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:04.712203 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
W20260709 12:17:06.445709 12348 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 736) took 1758 ms (client timeout 1847 ms). Trace:
W20260709 12:17:06.446090 12348 rpcz_store.cc:269] 0709 12:17:04.687651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:04.703547 (+ 15896us) service_pool.cc:224] Handling call
0709 12:17:06.445626 (+1742079us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:04.688776 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:06.447742 12356 raft_consensus.cc:3060] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:06.449043 11593 raft_consensus.cc:2468] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 5.
I20260709 12:17:04.705192 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:06.450460 12349 raft_consensus.cc:2410] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:04.578750 12770 consensus_queue.cc:1059] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:04.631569 12848 raft_consensus.cc:3055] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:06.454996 12848 raft_consensus.cc:740] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:04.585675 12858 leader_election.cc:290] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:04.634430 12869 raft_consensus.cc:515] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:06.462291 11519 raft_consensus.cc:1240] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:04.639258 12893 raft_consensus.cc:2749] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:06.467228 12893 raft_consensus.cc:2749] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:06.467922 12893 raft_consensus.cc:493] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.468425 11526 raft_consensus.cc:3060] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:06.468333 12893 raft_consensus.cc:515] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:04.625054 12939 consensus_queue.cc:1059] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 12:17:04.621006 12953 leader_election.cc:290] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:05.466818 12955 raft_consensus.cc:493] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:06.474730 12955 raft_consensus.cc:515] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:04.637837 12959 raft_consensus.cc:3055] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:04.706532 12947 consensus_queue.cc:1048] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:17:04.640545 12966 consensus_queue.cc:1048] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:04.715961 12981 raft_consensus.cc:515] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:06.484902 12981 leader_election.cc:290] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:04.678898 12994 raft_consensus.cc:2749] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:04.600585 13015 raft_consensus.cc:515] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:06.492973 13015 leader_election.cc:290] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:04.601711 13026 raft_consensus.cc:515] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:05.467166 13035 raft_consensus.cc:493] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:04.622011 13091 raft_consensus.cc:515] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:06.495965 13035 raft_consensus.cc:515] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:06.497772 11600 raft_consensus.cc:2393] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 5: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:17:06.498345 13091 leader_election.cc:290] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:05.875240 13097 raft_consensus.cc:493] T da8741606df54c3f8b5cc5c1141862ea P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:06.040179 13126 raft_consensus.cc:493] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.499907 13097 raft_consensus.cc:515] T da8741606df54c3f8b5cc5c1141862ea P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:06.500262 13126 raft_consensus.cc:515] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:06.126531 13125 raft_consensus.cc:515] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:06.127650 11417 leader_election.cc:304] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:06.128320 13123 raft_consensus.cc:515] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:06.122368 13124 raft_consensus.cc:515] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:06.130224 13130 raft_consensus.cc:2749] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:06.505230 13130 raft_consensus.cc:2749] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:06.131623 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ed4eeff0ae44d0bc1ebb8cbe3adea5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:06.135944 13131 raft_consensus.cc:2749] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:06.148041 13132 raft_consensus.cc:493] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.149554 13133 raft_consensus.cc:493] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.506283 11520 raft_consensus.cc:1240] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:06.506672 13133 raft_consensus.cc:515] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:06.507630 11520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33446 (request call id 1014) took 2011 ms. Trace:
W20260709 12:17:06.167245 13121 log.cc:927] Time spent T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.652s	user 0.011s	sys 0.006s
I20260709 12:17:06.193610 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:06.508011 11520 rpcz_store.cc:276] 0709 12:17:04.496635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:04.496748 (+   113us) service_pool.cc:224] Handling call
0709 12:17:04.497053 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:06.506739 (+2009686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:06.507406 (+   667us) spinlock_profiling.cc:243] Waited 2.01 s on lock 0x7b54003c0354. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:17:06.507577 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4620161792}
I20260709 12:17:06.505790 12361 raft_consensus.cc:2410] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:06.508635 11527 raft_consensus.cc:3060] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:06.230144 13019 raft_consensus.cc:493] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:06.499939 11524 raft_consensus.cc:1240] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:17:06.509775 13019 raft_consensus.cc:515] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
W20260709 12:17:06.231702 11493 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.667s	user 0.002s	sys 0.043s
W20260709 12:17:06.510998 11493 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.946s	user 0.003s	sys 0.044s
W20260709 12:17:06.511309 11493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 1.94664e+06us
I20260709 12:17:06.511932 11493 leader_election.cc:304] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
W20260709 12:17:06.265278 11419 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.670s	user 0.020s	sys 0.024s
I20260709 12:17:06.512156 13104 raft_consensus.cc:493] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
W20260709 12:17:06.512719 11419 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.918s	user 0.020s	sys 0.025s
W20260709 12:17:06.513063 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 1.91782e+06us
W20260709 12:17:06.281579 11595 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 626) took 1854 ms (client timeout 2035 ms). Trace:
I20260709 12:17:06.285926 13136 raft_consensus.cc:493] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:06.301918 11566 leader_election.cc:304] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:06.305922 13087 raft_consensus.cc:3055] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:06.523231 13087 raft_consensus.cc:740] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
W20260709 12:17:06.523676 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 221841us
I20260709 12:17:06.523949 13123 leader_election.cc:290] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
W20260709 12:17:06.316406 11420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:06.524341 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:06.525705 13091 raft_consensus.cc:2749] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:06.525527 13136 raft_consensus.cc:515] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:06.526211 13126 leader_election.cc:290] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:06.526628 12792 raft_consensus.cc:493] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:06.323693 12347 raft_consensus.cc:1240] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:06.527565 13035 leader_election.cc:290] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:06.527746 13136 leader_election.cc:290] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:06.525552 13113 raft_consensus.cc:2804] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:17:06.517552 11595 rpcz_store.cc:269] 0709 12:17:04.427269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:04.511520 (+ 84251us) service_pool.cc:224] Handling call
0709 12:17:06.281247 (+1769727us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b5400569d54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:06.281488 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":251613056}
I20260709 12:17:06.528481 13113 raft_consensus.cc:697] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 6 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:06.523175 13026 leader_election.cc:290] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:06.529261 13133 leader_election.cc:290] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:06.529446 13113 consensus_queue.cc:237] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:06.530618 12953 consensus_queue.cc:1059] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:06.325635 13139 raft_consensus.cc:493] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:06.531188 13130 raft_consensus.cc:493] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:06.336252 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffe47647c274723808482c166efa21c" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:06.531420 12953 consensus_queue.cc:1059] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:06.342403 13140 raft_consensus.cc:493] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:06.531726 13130 raft_consensus.cc:515] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:06.532461 12953 raft_consensus.cc:3055] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:06.532238 13140 raft_consensus.cc:515] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
W20260709 12:17:06.329334 11598 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 619) took 1904 ms (client timeout 2089 ms). Trace:
I20260709 12:17:06.349288 13117 leader_election.cc:290] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:06.355116 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c355b3902a4e7fb72bac6a91ea3316" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:17:06.533224 11598 rpcz_store.cc:269] 0709 12:17:04.425344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:04.506966 (+ 81622us) service_pool.cc:224] Handling call
0709 12:17:06.329168 (+1822202us) spinlock_profiling.cc:243] Waited 80.6 ms on lock 0x7b5400568954. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:06.329284 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":185454720}
I20260709 12:17:06.368904 13105 raft_consensus.cc:993] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671: : Instructing follower 1c101e338f954ef086338e251deed19d to start an election
I20260709 12:17:06.378247 12838 raft_consensus.cc:3055] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:17:06.391533 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 1.78987e+06us
I20260709 12:17:06.346180 11528 raft_consensus.cc:2468] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 3.
I20260709 12:17:06.394763 13084 raft_consensus.cc:3060] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:06.434597 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:06.437356 11602 raft_consensus.cc:1275] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:06.548936 11527 raft_consensus.cc:2468] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 4.
I20260709 12:17:06.549152 11602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40784 (request call id 184) took 1906 ms. Trace:
I20260709 12:17:06.549523 11602 rpcz_store.cc:276] 0709 12:17:04.643219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:06.436739 (+1793520us) service_pool.cc:224] Handling call
0709 12:17:06.437018 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:06.548882 (+111864us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:06.549098 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:06.438376 13108 raft_consensus.cc:493] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
W20260709 12:17:06.439489 11601 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40784 (request call id 175) took 1924 ms (client timeout 1509 ms). Trace:
I20260709 12:17:06.436061 12346 raft_consensus.cc:2468] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 6.
W20260709 12:17:06.423177 11599 rpcz_store.cc:269] 0709 12:17:04.642071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:05.603690 (+961619us) service_pool.cc:224] Handling call
0709 12:17:06.422645 (+818955us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:06.441565 11594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40784 (request call id 183) took 1798 ms. Trace:
I20260709 12:17:06.563496 11275 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39286 (request call id 108) took 2826 ms. Trace:
I20260709 12:17:06.532903 12953 raft_consensus.cc:740] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
W20260709 12:17:06.450873 12349 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 738) took 1762 ms (client timeout 2024 ms). Trace:
I20260709 12:17:06.451190 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:06.452654 12770 raft_consensus.cc:3055] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:17:06.453402 11593 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40784 (request call id 185) took 1809 ms (client timeout 2065 ms). Trace:
I20260709 12:17:06.463753 12869 leader_election.cc:290] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:06.471530 11519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33446 (request call id 1019) took 1912 ms. Trace:
I20260709 12:17:06.570549 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:06.477347 12959 raft_consensus.cc:740] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:06.478677 12757 raft_consensus.cc:3055] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:17:06.499181 11600 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 625) took 2072 ms (client timeout 1817 ms). Trace:
I20260709 12:17:06.510601 11524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33446 (request call id 1017) took 1997 ms. Trace:
I20260709 12:17:06.607985 11524 rpcz_store.cc:276] 0709 12:17:04.513031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:04.513241 (+   210us) service_pool.cc:224] Handling call
0709 12:17:04.513660 (+   419us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:06.509826 (+1996166us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:06.510344 (+   518us) spinlock_profiling.cc:243] Waited 1.99 s on lock 0x7b5400672854. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:17:06.510546 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4567185280}
W20260709 12:17:06.275202 11522 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.706s	user 0.008s	sys 0.019s
W20260709 12:17:06.609059 11522 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.040s	user 0.008s	sys 0.019s
I20260709 12:17:06.512818 13104 raft_consensus.cc:515] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:06.514122 13132 raft_consensus.cc:515] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
W20260709 12:17:06.517959 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 390356us
I20260709 12:17:06.520843 13097 leader_election.cc:290] T da8741606df54c3f8b5cc5c1141862ea P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:06.521112 12955 leader_election.cc:290] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:06.518904 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:06.521461 12893 leader_election.cc:290] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:06.522569 13125 leader_election.cc:290] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:06.522837 13019 leader_election.cc:290] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:06.323758 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:06.530751 11566 leader_election.cc:304] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:06.618263 12345 raft_consensus.cc:2468] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 5.
I20260709 12:17:06.529579 11595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40784 (request call id 186) took 1885 ms. Trace:
I20260709 12:17:06.367901 13103 raft_consensus.cc:493] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:06.401170 13141 leader_election.cc:290] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:06.607437 12757 raft_consensus.cc:740] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
W20260709 12:17:06.535938 11493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:06.547533 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:06.552471 12356 raft_consensus.cc:2410] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:17:06.405051 11596 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40784 (request call id 181) took 1762 ms (client timeout 1659 ms). Trace:
W20260709 12:17:06.622560 11596 rpcz_store.cc:269] 0709 12:17:04.642361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:06.404829 (+1762468us) service_pool.cc:211] Skipping call since client already timed out
0709 12:17:06.404972 (+   143us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:17:06.555613 11601 rpcz_store.cc:269] 0709 12:17:04.514608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:04.517518 (+  2910us) service_pool.cc:224] Handling call
0709 12:17:06.439310 (+1921792us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b54005bc054. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:06.439419 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":234456448}
I20260709 12:17:06.557336 11602 raft_consensus.cc:1240] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:06.623750 11602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40784 (request call id 189) took 1966 ms. Trace:
I20260709 12:17:06.561056 11598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40784 (request call id 187) took 1917 ms. Trace:
I20260709 12:17:04.637811 12357 raft_consensus.cc:2468] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 4.
I20260709 12:17:06.626829 12357 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51698 (request call id 580) took 2046 ms. Trace:
I20260709 12:17:06.627175 12357 rpcz_store.cc:276] 0709 12:17:04.580578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:04.582747 (+  2169us) service_pool.cc:224] Handling call
0709 12:17:06.626764 (+2044017us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:06.628259 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:06.629206 12357 raft_consensus.cc:2410] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:17:06.568110 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:17:06.568977 12349 rpcz_store.cc:269] 0709 12:17:04.688259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:04.688418 (+   159us) service_pool.cc:224] Handling call
0709 12:17:06.450815 (+1762397us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:06.550333 12838 raft_consensus.cc:740] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:06.531857 11447 raft_consensus.cc:3060] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:06.570566 11593 rpcz_store.cc:269] 0709 12:17:04.643515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:06.426888 (+1783373us) service_pool.cc:224] Handling call
0709 12:17:06.453314 (+ 26426us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:06.571228 11519 rpcz_store.cc:276] 0709 12:17:04.558623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:04.558793 (+   170us) service_pool.cc:224] Handling call
0709 12:17:04.559128 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:06.462761 (+1903633us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:06.465293 (+  2532us) spinlock_profiling.cc:243] Waited 1.9 s on lock 0x7b54003133d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:17:06.471462 (+  6169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4376148224}
I20260709 12:17:06.571549 11528 raft_consensus.cc:2410] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:06.574020 11452 raft_consensus.cc:1240] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:17:06.575963 11527 raft_consensus.cc:1240] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:06.563793 11594 rpcz_store.cc:276] 0709 12:17:04.642941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:06.431860 (+1788919us) service_pool.cc:224] Handling call
0709 12:17:06.432223 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:06.441234 (+  9011us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:06.441497 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:06.577699 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:06.565124 13105 raft_consensus.cc:1081] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 2 LEADER]: Signalling peer 1c101e338f954ef086338e251deed19d to start an election
I20260709 12:17:06.572774 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:06.648335 11453 raft_consensus.cc:3060] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:06.577431 13108 raft_consensus.cc:515] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:06.652503 11523 raft_consensus.cc:3060] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:06.653129 13108 leader_election.cc:290] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:06.581032 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:06.583067 11526 raft_consensus.cc:2468] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 4.
I20260709 12:17:06.583194 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:06.654598 12352 raft_consensus.cc:3060] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:06.654865 12838 consensus_queue.cc:260] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:06.534055 13130 leader_election.cc:290] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:06.547766 13139 raft_consensus.cc:515] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:06.659482 13139 leader_election.cc:290] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:06.584092 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:06.660215 11446 raft_consensus.cc:3060] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:06.661933 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8741606df54c3f8b5cc5c1141862ea" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:06.662672 11452 raft_consensus.cc:2468] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 1.
I20260709 12:17:06.663683 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:06.664011 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:06.664261 11452 raft_consensus.cc:2468] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 5.
I20260709 12:17:06.584645 11597 raft_consensus.cc:2468] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 2.
I20260709 12:17:06.591755 12959 consensus_queue.cc:260] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:06.548568 12899 leader_election.cc:290] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:06.594381 13140 leader_election.cc:290] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:06.527143 12792 raft_consensus.cc:515] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:06.669180 12792 leader_election.cc:290] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:06.596803 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:06.670588 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ed4eeff0ae44d0bc1ebb8cbe3adea5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:06.671033 11523 raft_consensus.cc:2468] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 3.
I20260709 12:17:06.671783 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:06.570389 12770 raft_consensus.cc:740] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:06.656015 12838 raft_consensus.cc:3060] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:06.524217 13087 consensus_queue.cc:260] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:06.598405 12953 consensus_queue.cc:260] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:06.525241 13124 leader_election.cc:290] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:06.563930 11275 rpcz_store.cc:276] 0709 12:17:03.727491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:03.727683 (+   192us) service_pool.cc:224] Handling call
0709 12:17:06.553322 (+2825639us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:04.396385 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:04.397081 (+   696us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:04.397129 (+    48us) write_op.cc:435] Acquired schema lock
0709 12:17:04.397155 (+    26us) tablet.cc:662] Decoding operations
0709 12:17:04.438907 (+ 41752us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:04.439041 (+   134us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:04.439072 (+    31us) tablet.cc:685] Acquiring locks for 19 operations
0709 12:17:04.440559 (+  1487us) tablet.cc:701] Row locks acquired
0709 12:17:04.440605 (+    46us) write_op.cc:260] PREPARE: finished
0709 12:17:04.440826 (+   221us) write_op.cc:270] Start()
0709 12:17:04.441004 (+   178us) write_op.cc:276] Timestamp: P: 1783599424440754 usec, L: 0
0709 12:17:04.441037 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 12:17:04.564503 (+123466us) log.cc:844] Serialized 7517 byte log entry
0709 12:17:06.119824 (+1555321us) op_driver.cc:464] REPLICATION: finished
0709 12:17:06.121224 (+  1400us) write_op.cc:301] APPLY: starting
0709 12:17:06.121298 (+    74us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:06.121644 (+   346us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:06.121770 (+   126us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:06.124538 (+  2768us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:06.124904 (+   366us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=19
0709 12:17:06.125053 (+   149us) write_op.cc:312] APPLY: finished
0709 12:17:06.125601 (+   548us) log.cc:844] Serialized 131 byte log entry
0709 12:17:06.126562 (+   961us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:06.126767 (+   205us) write_op.cc:454] Released schema lock
0709 12:17:06.126840 (+    73us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:06.127357 (+   517us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:06.127385 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4726,"reported_tablets":26,"spinlock_wait_cycles":2432,"child_traces":[["op",{"apply.queue_time_us":1194,"apply.run_cpu_time_us":5397,"apply.run_wall_time_us":6079,"num_ops":19,"prepare.queue_time_us":187591,"prepare.run_cpu_time_us":14967,"prepare.run_wall_time_us":257523,"raft.queue_time_us":1032,"raft.run_cpu_time_us":1210,"raft.run_wall_time_us":1210,"replication_time_us":1678652,"thread_start_us":194841,"threads_started":4,"wal-append.queue_time_us":80925}]]}
W20260709 12:17:06.607522 11600 rpcz_store.cc:269] 0709 12:17:04.427018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:04.469030 (+ 42012us) service_pool.cc:224] Handling call
0709 12:17:06.498932 (+2029902us) spinlock_profiling.cc:243] Waited 2.02 s on lock 0x7b5400a1f9d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:06.499098 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4645702912}
I20260709 12:17:06.611454 11522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33446 (request call id 1016) took 2112 ms. Trace:
W20260709 12:17:06.611529 12204 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:06.667176 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
W20260709 12:17:06.612169 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 1.90632e+06us
I20260709 12:17:06.600783 11274 catalog_manager.cc:5697] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:06.613474 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:06.613688 11417 leader_election.cc:304] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:06.614538 11599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7e4724ed93a467ea47763eec9a6de2e"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "1c101e338f954ef086338e251deed19d"
 from {username='slave'} at 127.0.0.1:37992
I20260709 12:17:06.619071 11595 rpcz_store.cc:276] 0709 12:17:04.643791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:06.528715 (+1884924us) service_pool.cc:224] Handling call
0709 12:17:06.529033 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:06.529230 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:06.529253 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:06.529291 (+    38us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:06.529318 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:06.529368 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:06.529524 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:06.619709 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
W20260709 12:17:06.619930 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 89251us
I20260709 12:17:06.620615 13084 raft_consensus.cc:2749] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:06.535154 11491 leader_election.cc:304] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
W20260709 12:17:06.624195 12356 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 737) took 1936 ms (client timeout 2028 ms). Trace:
I20260709 12:17:06.624137 11602 rpcz_store.cc:276] 0709 12:17:04.657497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:06.556878 (+1899381us) service_pool.cc:224] Handling call
0709 12:17:06.557184 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:06.623535 (+ 66351us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:06.623706 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:06.621994 13097 raft_consensus.cc:2749] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:06.565867 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:06.630789 13104 leader_election.cc:290] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:06.632251 13132 leader_election.cc:290] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:06.632125 11565 leader_election.cc:304] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:06.633036 12757 consensus_queue.cc:260] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:06.633862 12981 raft_consensus.cc:493] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.574436 12848 consensus_queue.cc:260] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:06.621138 13103 raft_consensus.cc:515] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:06.635210 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:06.636264 13143 raft_consensus.cc:493] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:06.644739 12347 raft_consensus.cc:2468] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 4.
I20260709 12:17:06.649536 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:06.642334 13141 raft_consensus.cc:493] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.624879 11598 rpcz_store.cc:276] 0709 12:17:04.644055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:06.547060 (+1903005us) service_pool.cc:224] Handling call
0709 12:17:06.547402 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:06.547666 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:17:06.559533 (+ 11867us) log.cc:844] Serialized 14 byte log entry
0709 12:17:06.560705 (+  1172us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:06.560757 (+    52us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:06.560806 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:06.560877 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:06.561002 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":11108,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":943,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"thread_start_us":12230,"threads_started":2,"wal-append.queue_time_us":1071}
W20260709 12:17:06.678114 12204 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:06.676632 11597 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40784 (request call id 176) took 2118 ms (client timeout 1720 ms). Trace:
I20260709 12:17:06.683559 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390e91331fd04f97a5235133a34875ee" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
W20260709 12:17:06.752455 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 217343us
W20260709 12:17:06.708391 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 166029us
I20260709 12:17:06.756577 12867 raft_consensus.cc:2749] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:06.769229 11452 raft_consensus.cc:2468] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 2.
I20260709 12:17:06.771013 11567 leader_election.cc:304] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:06.729846 11454 raft_consensus.cc:3060] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:06.727722 11566 leader_election.cc:304] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:06.685635 11447 raft_consensus.cc:2468] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 5.
I20260709 12:17:06.760452 12899 raft_consensus.cc:2749] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:17:06.752700 12356 rpcz_store.cc:269] 0709 12:17:04.687981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:04.688497 (+   516us) service_pool.cc:224] Handling call
0709 12:17:06.624130 (+1935633us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:06.781831 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:06.784878 11567 leader_election.cc:304] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:06.785529 11523 raft_consensus.cc:2468] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 6.
I20260709 12:17:06.777222 11419 leader_election.cc:304] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:06.696673 12352 raft_consensus.cc:2468] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 4.
I20260709 12:17:06.784614 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:06.682394 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:06.788455 11451 raft_consensus.cc:2468] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 5.
I20260709 12:17:06.762116 12981 raft_consensus.cc:515] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:06.789366 13125 raft_consensus.cc:493] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:06.789937 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:06.790956 12981 leader_election.cc:290] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:06.791184 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:06.787961 13124 raft_consensus.cc:2804] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:06.791889 13124 raft_consensus.cc:493] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:06.792132 11446 raft_consensus.cc:2468] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 3.
I20260709 12:17:06.673352 11453 raft_consensus.cc:2468] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 4.
I20260709 12:17:06.729625 11274 catalog_manager.cc:5697] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 2 to 4, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 4 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:06.761725 12345 raft_consensus.cc:3060] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:06.667201 12959 raft_consensus.cc:3060] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:06.855080 11568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:06.675367 12953 raft_consensus.cc:3060] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:06.762529 12349 raft_consensus.cc:2468] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 3.
I20260709 12:17:06.754334 13139 raft_consensus.cc:493] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.792448 13124 raft_consensus.cc:3060] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:06.625530 13113 raft_consensus.cc:493] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.766558 12203 leader_election.cc:304] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
W20260709 12:17:06.767316 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 153720us
W20260709 12:17:06.767863 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 135821us
I20260709 12:17:06.876472 11417 leader_election.cc:304] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
W20260709 12:17:06.773756 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 46132.5us
I20260709 12:17:06.681605 12348 raft_consensus.cc:2468] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 3.
I20260709 12:17:06.775851 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:06.869078 13132 raft_consensus.cc:2804] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:06.767246 13130 raft_consensus.cc:2749] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:06.674052 12770 consensus_queue.cc:260] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:06.778002 13146 raft_consensus.cc:493] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.779197 13103 leader_election.cc:290] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:06.768349 13141 raft_consensus.cc:515] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:06.780736 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:06.881141 13146 raft_consensus.cc:515] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:06.881893 12361 raft_consensus.cc:2468] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 6.
I20260709 12:17:06.882951 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:06.781158 12955 raft_consensus.cc:493] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:06.883785 12955 raft_consensus.cc:515] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:06.886143 12955 leader_election.cc:290] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:06.781855 12848 raft_consensus.cc:3060] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:06.782377 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:06.886474 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:06.782913 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:17:06.889130 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 122644us
I20260709 12:17:06.889672 11525 raft_consensus.cc:2468] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 5.
I20260709 12:17:06.673256 12346 raft_consensus.cc:1240] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 3. Current term is 4. Ops: []
W20260709 12:17:06.890543 13151 log.cc:927] Time spent T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
I20260709 12:17:06.674652 13087 raft_consensus.cc:3060] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:06.883802 13146 leader_election.cc:290] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:06.892724 13146 raft_consensus.cc:2749] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:06.877698 12683 raft_consensus.cc:2804] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:06.897152 12683 raft_consensus.cc:493] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:06.897601 12683 raft_consensus.cc:3060] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:06.903891 13141 leader_election.cc:290] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:06.907685 12770 raft_consensus.cc:3060] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:06.896876 12204 leader_election.cc:304] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:06.792495 11449 raft_consensus.cc:1240] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:06.881060 11417 leader_election.cc:304] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:06.877995 13139 raft_consensus.cc:515] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
W20260709 12:17:06.911813 11420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:06.912173 11417 leader_election.cc:400] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 election: Vote denied by peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973) with higher term. Message: Invalid argument: T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 3. Current term is 4.
I20260709 12:17:06.912532 11417 leader_election.cc:403] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:17:06.870873 11451 raft_consensus.cc:1240] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:17:06.781149 12893 raft_consensus.cc:493] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.914433 12893 raft_consensus.cc:515] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:06.915273 13130 raft_consensus.cc:2749] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973) with higher term. Message: Invalid argument: T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 3. Current term is 4.
W20260709 12:17:06.768708 11597 rpcz_store.cc:269] 0709 12:17:04.558276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:04.567756 (+  9480us) service_pool.cc:224] Handling call
0709 12:17:06.354917 (+1787161us) spinlock_profiling.cc:243] Waited 16.6 ms on lock 0x7b5800220b98. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb890a0 00007f84ebb88984 00007f84e51036d4 00007f84e5103662
0709 12:17:06.676410 (+321493us) spinlock_profiling.cc:243] Waited 42.5 ms on lock 0x7b540054bd54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:06.676542 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":136012544}
I20260709 12:17:06.916632 12893 leader_election.cc:290] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:06.677733 11522 rpcz_store.cc:276] 0709 12:17:04.497227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:04.497349 (+   122us) service_pool.cc:224] Handling call
0709 12:17:04.502958 (+  5609us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:04.505715 (+  2757us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:17:04.561657 (+ 55942us) log.cc:844] Serialized 14 byte log entry
0709 12:17:06.166434 (+1604777us) spinlock_profiling.cc:243] Waited 1 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e675e86e 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221 00007f84e67671d9 00007f84e6767169
0709 12:17:06.609535 (+443101us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:06.609592 (+    57us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:06.609636 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:06.609700 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:06.609827 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":169637,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":1564,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":6292,"spinlock_wait_cycles":2310400,"thread_start_us":2096446,"threads_started":2,"wal-append.queue_time_us":847961}
I20260709 12:17:06.780650 12757 raft_consensus.cc:3060] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:06.916530 11417 leader_election.cc:304] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:06.920040 13130 raft_consensus.cc:2749] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:06.791842 11521 raft_consensus.cc:2468] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 3.
W20260709 12:17:06.871505 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 85505us
I20260709 12:17:06.875413 12349 raft_consensus.cc:1240] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:06.921478 11417 leader_election.cc:304] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:06.777209 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:06.922654 11491 leader_election.cc:304] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:06.922745 11520 raft_consensus.cc:2468] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 3.
I20260709 12:17:06.783581 13140 raft_consensus.cc:2804] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:06.878031 11566 leader_election.cc:304] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:06.924156 13140 raft_consensus.cc:697] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
W20260709 12:17:06.924320 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 46378.8us
I20260709 12:17:06.923851 11491 leader_election.cc:304] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:06.925237 13140 consensus_queue.cc:237] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:06.926580 12953 raft_consensus.cc:2804] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:06.927183 12953 raft_consensus.cc:697] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:06.927425 12939 consensus_queue.cc:1059] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:06.877730 11528 raft_consensus.cc:2468] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 4.
I20260709 12:17:06.927994 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:06.808213 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:06.763945 13143 raft_consensus.cc:515] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:06.870069 11452 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4"
dest_uuid: "1c101e338f954ef086338e251deed19d"
 from {username='slave'} at 127.0.0.1:58868
I20260709 12:17:06.890010 12203 leader_election.cc:304] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:06.893543 11447 raft_consensus.cc:1240] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:17:06.894904 13144 consensus_queue.cc:1059] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:06.895148 11565 leader_election.cc:304] T da8741606df54c3f8b5cc5c1141862ea P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:17:06.895993 13132 raft_consensus.cc:493] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:06.879439 13113 raft_consensus.cc:515] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:06.790031 13125 raft_consensus.cc:515] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:06.792270 13147 raft_consensus.cc:493] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.783610 13097 consensus_queue.cc:1059] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.103s
I20260709 12:17:06.916503 13136 raft_consensus.cc:2804] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:06.927030 11566 leader_election.cc:304] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:06.794111 11493 leader_election.cc:304] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:06.925489 12867 raft_consensus.cc:2749] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:06.930614 11450 raft_consensus.cc:2468] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 5.
I20260709 12:17:06.873548 11274 catalog_manager.cc:5697] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 3 to 5, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 5 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:06.927970 13117 consensus_queue.cc:1059] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:17:06.928294 13108 consensus_queue.cc:1059] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:17:06.933128 12204 leader_election.cc:304] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:06.934304 11521 raft_consensus.cc:2368] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 3. Current term is 4.
I20260709 12:17:06.922793 11417 leader_election.cc:304] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:06.936237 11452 raft_consensus.cc:493] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:06.936724 11454 raft_consensus.cc:2468] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 3.
I20260709 12:17:06.937882 11520 raft_consensus.cc:1240] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:06.964711 11452 raft_consensus.cc:3060] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:06.939510 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:06.941306 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:06.964804 12204 leader_election.cc:304] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:06.965612 11525 raft_consensus.cc:2468] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 4.
I20260709 12:17:06.956149 13019 raft_consensus.cc:2749] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:06.966327 12955 raft_consensus.cc:2804] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:06.966585 11524 raft_consensus.cc:1240] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [term 4 LEADER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:06.967074 13108 raft_consensus.cc:3055] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:17:06.967310 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 44582.6us
I20260709 12:17:06.967519 13108 raft_consensus.cc:740] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:06.967800 12792 raft_consensus.cc:2749] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:06.968127 11417 leader_election.cc:304] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:06.968451 13108 consensus_queue.cc:260] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:06.969565 13131 raft_consensus.cc:2749] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:06.970134 12204 leader_election.cc:304] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:06.970754 13035 raft_consensus.cc:2804] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:06.954249 13146 raft_consensus.cc:2749] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:06.974321 11519 raft_consensus.cc:2393] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 3: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:17:06.928174 12953 consensus_queue.cc:237] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:06.912963 13139 leader_election.cc:290] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:06.955667 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:06.927084 13103 raft_consensus.cc:2749] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:06.977069 11522 raft_consensus.cc:2468] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 4.
I20260709 12:17:06.956970 11445 raft_consensus.cc:2468] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 4.
I20260709 12:17:06.957819 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:17:06.959151 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 69230.3us
I20260709 12:17:06.978101 13143 leader_election.cc:290] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:06.971155 13035 raft_consensus.cc:493] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:06.978804 12203 leader_election.cc:304] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:06.980103 12203 leader_election.cc:304] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
W20260709 12:17:06.959267 11493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 165258us
W20260709 12:17:06.981488 11418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:06.961333 11274 catalog_manager.cc:5697] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:06.961740 11599 raft_consensus.cc:606] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Received request to transfer leadership to TS 1c101e338f954ef086338e251deed19d
I20260709 12:17:06.981582 13139 raft_consensus.cc:2749] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:06.955595 13132 raft_consensus.cc:3060] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:06.954847 12838 raft_consensus.cc:2749] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:06.970263 13131 raft_consensus.cc:2749] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:06.971131 12204 leader_election.cc:304] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
W20260709 12:17:07.066215 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 95140.3us
I20260709 12:17:06.793408 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7937e0cff84ef7a26c84247c8ffc08" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:07.066473 13108 raft_consensus.cc:3060] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:06.874955 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 90175.4us
I20260709 12:17:06.987296 11452 raft_consensus.cc:515] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:06.960815 13136 raft_consensus.cc:493] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:06.971668 12955 raft_consensus.cc:493] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:06.950515 13130 consensus_queue.cc:1059] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:17:06.982074 13035 raft_consensus.cc:3060] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:06.952913 13091 consensus_queue.cc:1059] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:17:06.962363 13084 raft_consensus.cc:2804] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:06.982367 11599 raft_consensus.cc:614] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:06.994429 11417 leader_election.cc:400] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Vote denied by peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973) with higher term. Message: Invalid argument: T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 3. Current term is 4.
I20260709 12:17:06.994122 11274 catalog_manager.cc:5697] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:06.983472 13097 raft_consensus.cc:2804] T da8741606df54c3f8b5cc5c1141862ea P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:07.080767 11274 catalog_manager.cc:5697] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 1 to 3, leader changed from 1c101e338f954ef086338e251deed19d (127.3.212.130) to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 3 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } }
W20260709 12:17:07.081971 11420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:07.082432 11274 catalog_manager.cc:5697] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:06.981992 11493 leader_election.cc:304] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
W20260709 12:17:07.084403 11493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 102463us
I20260709 12:17:07.085064 11493 leader_election.cc:304] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:07.085901 11493 leader_election.cc:304] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:06.980036 12770 raft_consensus.cc:3055] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:06.981575 12947 raft_consensus.cc:3060] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:07.070104 11567 leader_election.cc:304] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:07.071365 12204 leader_election.cc:304] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:06.975143 13126 raft_consensus.cc:2804] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:07.070706 13136 raft_consensus.cc:3060] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:07.078806 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:07.072224 12955 raft_consensus.cc:3060] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:07.099196 12683 raft_consensus.cc:515] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:07.101595 12683 leader_election.cc:290] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:07.084028 11274 catalog_manager.cc:5697] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 2 to 4, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 4 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:07.080972 13117 raft_consensus.cc:2804] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:07.092960 12981 raft_consensus.cc:2804] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:07.094940 12867 raft_consensus.cc:2804] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:07.105568 12981 raft_consensus.cc:493] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:07.105829 11493 leader_election.cc:304] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:07.106057 12981 raft_consensus.cc:3060] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:07.093212 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:07.099196 13132 raft_consensus.cc:515] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:07.110783 13091 raft_consensus.cc:3055] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:07.111204 13091 raft_consensus.cc:740] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:07.111760 13132 leader_election.cc:290] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:07.112075 13091 consensus_queue.cc:260] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
W20260709 12:17:07.093967 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 99677.8us
I20260709 12:17:07.094172 12204 leader_election.cc:304] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:07.113092 13035 raft_consensus.cc:515] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:07.113734 13084 raft_consensus.cc:697] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 4 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:07.094724 13146 raft_consensus.cc:2804] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:07.075476 13123 consensus_queue.cc:1059] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:17:07.087045 13133 raft_consensus.cc:3055] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:07.087743 12770 raft_consensus.cc:740] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
W20260709 12:17:07.097520 11549 debug-util.cc:398] Leaking SignalData structure 0x7b08000c9ae0 after lost signal to thread 3925
W20260709 12:17:07.123083 11549 debug-util.cc:398] Leaking SignalData structure 0x7b08000cbc40 after lost signal to thread 11311
W20260709 12:17:07.124352 11549 debug-util.cc:398] Leaking SignalData structure 0x7b080037e7c0 after lost signal to thread 11478
I20260709 12:17:07.104916 13104 raft_consensus.cc:2804] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:07.116482 11417 leader_election.cc:304] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:07.072551 13139 raft_consensus.cc:2804] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:07.119065 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:07.129954 12356 raft_consensus.cc:3060] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:07.131702 12349 raft_consensus.cc:1240] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:07.089464 12939 raft_consensus.cc:3055] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:07.120788 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:07.121276 11274 catalog_manager.cc:5697] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 3 to 5, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 5 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:06.963788 13147 raft_consensus.cc:515] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
W20260709 12:17:07.126495 11549 debug-util.cc:398] Leaking SignalData structure 0x7b080012d2c0 after lost signal to thread 11552
W20260709 12:17:07.142597 11549 debug-util.cc:398] Leaking SignalData structure 0x7b08003afb00 after lost signal to thread 11553
W20260709 12:17:07.127750 11420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:07.143991 11549 debug-util.cc:398] Leaking SignalData structure 0x7b0800333300 after lost signal to thread 11626
I20260709 12:17:07.119656 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c355b3902a4e7fb72bac6a91ea3316" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:07.144758 12359 raft_consensus.cc:2468] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 2.
I20260709 12:17:07.084019 13097 raft_consensus.cc:493] T da8741606df54c3f8b5cc5c1141862ea P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:07.126880 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:17:07.146275 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 219301us
I20260709 12:17:07.115132 13035 leader_election.cc:290] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:07.148659 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:07.117529 12867 raft_consensus.cc:493] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:07.147157 11566 leader_election.cc:304] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:07.155539 12356 raft_consensus.cc:2468] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 6.
I20260709 12:17:07.156890 13125 leader_election.cc:290] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:17:07.158607 13156 log.cc:927] Time spent T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:17:07.136015 13091 raft_consensus.cc:3060] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:07.162380 13113 leader_election.cc:290] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:07.118031 13146 raft_consensus.cc:493] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.120384 13115 consensus_queue.cc:1059] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 12:17:07.167203 12347 raft_consensus.cc:2468] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 4.
I20260709 12:17:07.205639 12361 raft_consensus.cc:2468] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 3.
I20260709 12:17:07.114728 13084 consensus_queue.cc:237] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:07.116729 13126 raft_consensus.cc:493] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:07.168733 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e4724ed93a467ea47763eec9a6de2e" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
W20260709 12:17:07.190685 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 295568us
I20260709 12:17:07.118278 13133 raft_consensus.cc:740] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
W20260709 12:17:07.220520 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 81548.3us
I20260709 12:17:07.191294 13117 raft_consensus.cc:697] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:07.132375 13105 raft_consensus.cc:2804] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:17:07.193624 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 46577.1us
I20260709 12:17:07.130280 13144 raft_consensus.cc:2749] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:17:07.145853 11549 debug-util.cc:398] Leaking SignalData structure 0x7b080029fae0 after lost signal to thread 12405
W20260709 12:17:07.226285 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 245113us
I20260709 12:17:07.136482 12683 raft_consensus.cc:493] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.199431 11452 leader_election.cc:290] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:07.141690 12939 raft_consensus.cc:740] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:07.219051 13035 raft_consensus.cc:2804] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:07.219596 13126 raft_consensus.cc:3060] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:07.166237 13097 raft_consensus.cc:3060] T da8741606df54c3f8b5cc5c1141862ea P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:07.210616 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:07.214758 11522 raft_consensus.cc:2468] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 3.
I20260709 12:17:07.166086 13122 raft_consensus.cc:3055] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:07.149261 13104 raft_consensus.cc:697] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 4 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:07.193624 12867 raft_consensus.cc:3060] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:07.220391 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:07.296476 11519 raft_consensus.cc:2393] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 4: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:17:07.223177 11417 leader_election.cc:304] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:07.192493 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:07.227396 11565 leader_election.cc:304] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
W20260709 12:17:07.237345 11549 debug-util.cc:398] Leaking SignalData structure 0x7b08003609a0 after lost signal to thread 12407
I20260709 12:17:07.133142 13139 raft_consensus.cc:493] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.301699 11599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "1c101e338f954ef086338e251deed19d"
 from {username='slave'} at 127.0.0.1:37992
I20260709 12:17:07.302361 11599 raft_consensus.cc:606] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Received request to transfer leadership to TS 1c101e338f954ef086338e251deed19d
I20260709 12:17:07.302716 11599 raft_consensus.cc:614] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:17:07.241148 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 147035us
I20260709 12:17:07.212450 13146 raft_consensus.cc:3060] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:07.238133 12203 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Timed out: Call waited in the queue past client deadline [suppressed 31 similar messages]
I20260709 12:17:07.144078 13132 raft_consensus.cc:2749] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:07.236557 13105 raft_consensus.cc:493] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1c101e338f954ef086338e251deed19d)
W20260709 12:17:07.304276 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 66208us
I20260709 12:17:07.300045 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
W20260709 12:17:07.297953 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 70651us
I20260709 12:17:07.293463 13122 raft_consensus.cc:740] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:07.307449 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:07.308531 11565 leader_election.cc:304] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:07.309588 12203 leader_election.cc:304] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:07.316685 11565 leader_election.cc:304] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:07.237946 13130 consensus_queue.cc:1059] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.067s
I20260709 12:17:07.210644 12770 consensus_queue.cc:260] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:07.339969 11565 leader_election.cc:304] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:17:07.241518 13131 consensus_queue.cc:1059] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 12:17:07.312677 13105 raft_consensus.cc:3060] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:07.354038 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:17:07.353318 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 158104us
I20260709 12:17:07.348227 11565 leader_election.cc:304] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:07.351143 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:07.351418 11493 leader_election.cc:304] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:07.289463 12683 raft_consensus.cc:515] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:07.282065 13019 consensus_queue.cc:1048] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:17:07.300043 13139 raft_consensus.cc:3060] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:07.297194 13161 raft_consensus.cc:2804] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:07.330185 13132 raft_consensus.cc:3060] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:07.303957 13124 raft_consensus.cc:515] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:07.379213 11527 raft_consensus.cc:1275] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:07.304131 12959 consensus_queue.cc:1059] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 12:17:07.330374 13159 raft_consensus.cc:2749] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:17:07.358877 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 121859us
I20260709 12:17:07.344585 12899 raft_consensus.cc:2749] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:07.379078 11567 leader_election.cc:304] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:07.379151 11565 leader_election.cc:304] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:07.346704 13144 raft_consensus.cc:2749] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:07.354022 12953 raft_consensus.cc:2804] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:07.433967 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8741606df54c3f8b5cc5c1141862ea" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:07.385752 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390e91331fd04f97a5235133a34875ee" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:07.373981 13113 raft_consensus.cc:2804] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:07.354743 13165 raft_consensus.cc:3060] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:07.426978 13160 raft_consensus.cc:2804] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:07.420310 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:07.439079 11521 raft_consensus.cc:1240] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:07.376109 12792 raft_consensus.cc:3055] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:07.426851  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:17:07.428843 12357 raft_consensus.cc:1275] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:07.383805 12770 raft_consensus.cc:3060] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:07.439980 13169 consensus_queue.cc:1048] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
W20260709 12:17:07.435009 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 211891us
I20260709 12:17:07.435148 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c355b3902a4e7fb72bac6a91ea3316" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:17:07.436084 12345 consensus_meta.cc:287] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de: Time spent flushing consensus metadata: real 0.556s	user 0.006s	sys 0.009s
W20260709 12:17:07.435484 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 126903us
I20260709 12:17:07.434237 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:07.449995 11520 raft_consensus.cc:2410] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 12:17:07.438706 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 59630.8us
I20260709 12:17:07.450053 12345 raft_consensus.cc:2468] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 6.
W20260709 12:17:07.432917 12757 consensus_meta.cc:287] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8: Time spent flushing consensus metadata: real 0.514s	user 0.007s	sys 0.003s
I20260709 12:17:07.441077 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:07.450630 11419 leader_election.cc:304] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
W20260709 12:17:07.441629 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 62634.3us
I20260709 12:17:07.389297 13161 raft_consensus.cc:697] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:07.445333 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:07.390323 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:07.444197  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:17:07.437579 11493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 53417.6us
I20260709 12:17:07.451365 11565 leader_election.cc:304] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:07.452713 11599 raft_consensus.cc:1275] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:07.438515 13113 raft_consensus.cc:493] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.453764 11567 leader_election.cc:304] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:07.437170 12953 raft_consensus.cc:493] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:07.442548 12792 raft_consensus.cc:740] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:07.476455 12345 raft_consensus.cc:1240] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:07.446319 13159 raft_consensus.cc:2804] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:07.476130 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7937e0cff84ef7a26c84247c8ffc08" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:07.447674 13160 raft_consensus.cc:697] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:07.479748  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:07.437743 12981 raft_consensus.cc:515] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:07.419236 13117 consensus_queue.cc:237] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:07.498070 13125 raft_consensus.cc:3055] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:07.498541 13125 raft_consensus.cc:740] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:07.499336 13125 consensus_queue.cc:260] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:07.500335 13125 raft_consensus.cc:3060] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.482672 11523 raft_consensus.cc:1240] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:07.483654 13159 raft_consensus.cc:493] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:07.502396 12792 consensus_queue.cc:260] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:07.503134 13159 raft_consensus.cc:3060] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.495970 13133 consensus_queue.cc:260] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:07.419474 13104 consensus_queue.cc:237] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:07.505090 12939 consensus_queue.cc:260] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:07.506462 12939 raft_consensus.cc:3060] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:07.506944 12981 leader_election.cc:290] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:07.481709 12953 raft_consensus.cc:3060] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.507526 13124 leader_election.cc:290] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:07.507781 12792 raft_consensus.cc:3060] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.485888 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9fe9a94294836aec652338f44367d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:07.508574 11595 raft_consensus.cc:2468] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 4.
I20260709 12:17:07.430599 13122 consensus_queue.cc:260] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:07.477368 13144 raft_consensus.cc:2804] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:07.486186 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:07.479000 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:07.487159 13162 raft_consensus.cc:493] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.488300 12955 raft_consensus.cc:515] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:07.483630 13019 raft_consensus.cc:2804] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:07.490319 13160 consensus_queue.cc:237] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:07.491309 12947 raft_consensus.cc:2749] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:07.491853 13035 raft_consensus.cc:493] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.492226 12683 leader_election.cc:290] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:07.557281 13035 raft_consensus.cc:3060] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:07.565769 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:07.567590 13035 raft_consensus.cc:515] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:07.568660 13147 leader_election.cc:290] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:07.547638 13162 raft_consensus.cc:515] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:07.571874 13162 leader_election.cc:290] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:07.573738 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:07.574491 12357 raft_consensus.cc:3060] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:07.575018 13035 leader_election.cc:290] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:07.493506 13168 raft_consensus.cc:2804] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:07.485942 11597 raft_consensus.cc:1240] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:07.577874 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:07.590185 12345 raft_consensus.cc:2393] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 6: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
W20260709 12:17:07.495023 13164 log.cc:927] Time spent T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:17:07.495172 12848 raft_consensus.cc:3055] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:07.477877 13113 raft_consensus.cc:3060] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:07.513756 11493 leader_election.cc:304] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:07.526973 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:17:07.531432 11420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:07.487198 13167 log.cc:927] Time spent T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:17:07.615511 11528 raft_consensus.cc:2468] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 4.
W20260709 12:17:07.615931 11420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:07.482780 11566 leader_election.cc:304] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:07.547838 13019 raft_consensus.cc:493] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.552134 12955 leader_election.cc:290] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:07.552523 13122 raft_consensus.cc:3060] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:07.538689 13144 raft_consensus.cc:697] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 5 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:07.538655 13172 consensus_queue.cc:1059] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
W20260709 12:17:07.585924 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 100701us
I20260709 12:17:07.627172 11600 raft_consensus.cc:1240] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 LEADER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 3. Current term is 4. Ops: []
W20260709 12:17:07.592085 11568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:07.522620 13133 raft_consensus.cc:3060] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.596247 13168 raft_consensus.cc:697] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
W20260709 12:17:07.596876 11418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:07.601889 13136 consensus_meta.cc:287] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de: Time spent flushing consensus metadata: real 0.507s	user 0.007s	sys 0.003s
I20260709 12:17:07.603246 13139 raft_consensus.cc:515] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
W20260709 12:17:07.615463 11493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 101749us
I20260709 12:17:07.545718 11519 raft_consensus.cc:2468] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 4.
W20260709 12:17:07.618227 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 135505us
I20260709 12:17:07.647464 11566 leader_election.cc:304] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:07.648659 11566 leader_election.cc:304] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:07.485419 12757 raft_consensus.cc:2804] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:07.622810 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:07.624500 11524 raft_consensus.cc:1275] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:07.626281 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:07.620520 13140 raft_consensus.cc:2749] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:07.620579 12867 raft_consensus.cc:515] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
W20260709 12:17:07.627346 11417 connection.cc:256] RPC call timeout handler was delayed by -2.4103660259997923s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1718s for a response
I20260709 12:17:07.616482 12848 raft_consensus.cc:740] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:07.620390 13108 raft_consensus.cc:2804] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:07.623798 13019 raft_consensus.cc:3060] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:07.663919 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:07.654788 11520 raft_consensus.cc:2393] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 4: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:17:07.657807 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:07.663877 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:07.666080 11528 raft_consensus.cc:2468] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 3.
W20260709 12:17:07.656471 11417 connection.cc:256] RPC call timeout handler was delayed by -2.320477905999951s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1817s for a response
W20260709 12:17:07.666985 11417 connection.cc:256] RPC call timeout handler was delayed by -2.1242779059998611s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20350000000000001s for a response
I20260709 12:17:07.667984 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:07.668696 11528 raft_consensus.cc:2368] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 3. Current term is 4.
I20260709 12:17:07.668990 11566 leader_election.cc:304] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
W20260709 12:17:07.655834 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 180531us
I20260709 12:17:07.671033 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
W20260709 12:17:07.665558 11420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:07.665743 13160 raft_consensus.cc:2749] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:07.673882 12361 raft_consensus.cc:2368] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for earlier term 6. Current term is 7.
I20260709 12:17:07.674620 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:07.676556 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:07.677659 11522 raft_consensus.cc:1240] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:07.681767 13140 raft_consensus.cc:493] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.682405 13140 raft_consensus.cc:515] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:07.684899 13140 leader_election.cc:290] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:07.649762 13136 raft_consensus.cc:515] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:07.680961 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:07.652218 13117 raft_consensus.cc:2749] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:07.685568 13115 raft_consensus.cc:493] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.701293 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:07.701614 13115 raft_consensus.cc:515] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:07.701997 11523 raft_consensus.cc:2468] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 3.
I20260709 12:17:07.626852 13161 consensus_queue.cc:237] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:07.707082 13168 consensus_queue.cc:237] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:07.652354 13104 consensus_queue.cc:1048] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:17:07.714754 13139 leader_election.cc:290] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:07.716729 13159 raft_consensus.cc:515] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:07.717712 13144 consensus_queue.cc:237] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:07.718251 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:07.664152 12757 raft_consensus.cc:697] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:07.722366 13115 leader_election.cc:290] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
W20260709 12:17:07.722993 13091 consensus_meta.cc:287] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8: Time spent flushing consensus metadata: real 0.522s	user 0.007s	sys 0.002s
I20260709 12:17:07.688231 12953 raft_consensus.cc:515] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:07.726819 12953 leader_election.cc:290] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:07.727459 12357 raft_consensus.cc:2468] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 7.
I20260709 12:17:07.689390 11449 raft_consensus.cc:3060] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:17:07.687568 11417 leader_election.cc:304] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:07.722131 12757 consensus_queue.cc:237] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:07.694766 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
W20260709 12:17:07.709102 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 386954us
I20260709 12:17:07.729533 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:07.734272 12203 leader_election.cc:304] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:07.691177 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:07.700891 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:07.733982 12204 leader_election.cc:304] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:07.735044 11525 raft_consensus.cc:3060] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:07.692617 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:07.735894 12203 leader_election.cc:304] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d
I20260709 12:17:07.736152 11520 raft_consensus.cc:2468] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 4.
I20260709 12:17:07.729434 11528 raft_consensus.cc:1240] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:07.695503 11493 leader_election.cc:400] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 election: Vote denied by peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935) with higher term. Message: Invalid argument: T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for earlier term 6. Current term is 7.
I20260709 12:17:07.737581 11493 leader_election.cc:403] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:17:07.677215 11524 raft_consensus.cc:2376] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1c101e338f954ef086338e251deed19d in term 3. Re-sending same reply.
I20260709 12:17:07.732649 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c355b3902a4e7fb72bac6a91ea3316" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:07.732649 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390e91331fd04f97a5235133a34875ee" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:07.739500 11448 raft_consensus.cc:3060] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.733335 11567 leader_election.cc:304] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:07.686148 13132 raft_consensus.cc:2749] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:07.749251 11519 raft_consensus.cc:1240] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 12:17:07.746030 11493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 50747.2us
I20260709 12:17:07.752537 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:07.697271 13146 raft_consensus.cc:515] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:07.753392 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:07.754415 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:07.772728 11521 raft_consensus.cc:3060] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:07.757148 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 69654.2us
I20260709 12:17:07.774598 11417 leader_election.cc:304] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:07.767969 13091 raft_consensus.cc:2804] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:07.768267 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9fe9a94294836aec652338f44367d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:07.769198 12203 leader_election.cc:304] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d
I20260709 12:17:07.693333 12959 raft_consensus.cc:493] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.689618 13173 raft_consensus.cc:493] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.687608 13136 leader_election.cc:290] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:07.690907 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:07.690532 13162 raft_consensus.cc:3055] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:07.789811 11599 raft_consensus.cc:1240] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 5 LEADER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:07.786965 11417 leader_election.cc:304] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:07.699776 13108 raft_consensus.cc:697] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 6 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:07.747583 13169 raft_consensus.cc:2804] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:07.745048 13139 raft_consensus.cc:2749] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:07.741652 13159 leader_election.cc:290] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:07.783983 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:07.785058 11519 raft_consensus.cc:1275] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:07.806002 12203 leader_election.cc:304] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:07.781189 13123 raft_consensus.cc:2764] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 12:17:07.793057 12356 raft_consensus.cc:2393] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 5: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:17:07.693455 13140 raft_consensus.cc:493] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.813671 13140 raft_consensus.cc:515] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:07.815938 13140 leader_election.cc:290] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
W20260709 12:17:07.817556 13181 log.cc:927] Time spent T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:17:07.818969 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:07.819353 13108 consensus_queue.cc:237] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:07.821933 12348 raft_consensus.cc:1240] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:07.698649 12867 leader_election.cc:290] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:07.827464 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c355b3902a4e7fb72bac6a91ea3316" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:07.794180 11417 leader_election.cc:304] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:17:07.780388 13087 raft_consensus.cc:3060] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:07.833451 13146 leader_election.cc:290] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:07.802654 11446 raft_consensus.cc:3060] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:07.694612 13097 raft_consensus.cc:515] T da8741606df54c3f8b5cc5c1141862ea P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:07.685341 13105 raft_consensus.cc:515] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:07.784164 13126 raft_consensus.cc:515] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:07.784188 12959 raft_consensus.cc:515] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:07.793897 13162 raft_consensus.cc:740] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:07.796185 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:07.783759 12893 raft_consensus.cc:2804] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:07.807816 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390e91331fd04f97a5235133a34875ee" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:07.810791 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:07.802129 13131 raft_consensus.cc:2749] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:07.786943 12683 raft_consensus.cc:2804] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:07.859603 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e4724ed93a467ea47763eec9a6de2e" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:07.784466 13091 raft_consensus.cc:697] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 7 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:07.855402 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:07.832880 12838 raft_consensus.cc:2804] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:07.803287 13169 raft_consensus.cc:493] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.781852 12955 consensus_queue.cc:1059] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:17:07.831532 11417 leader_election.cc:304] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:07.821130 13165 raft_consensus.cc:2749] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:07.794873 13132 consensus_queue.cc:1048] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:17:07.854959 13139 raft_consensus.cc:493] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:07.861919 12893 raft_consensus.cc:697] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 5 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:07.863559 13105 leader_election.cc:290] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:07.856832 11527 raft_consensus.cc:2468] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 3.
I20260709 12:17:07.832235 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:07.787528 13173 raft_consensus.cc:515] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:07.837653 13123 raft_consensus.cc:2804] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:07.868904 12352 raft_consensus.cc:1240] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:07.861325 11451 raft_consensus.cc:1240] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:17:07.834813 13130 consensus_queue.cc:1059] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:17:07.880851 13123 raft_consensus.cc:493] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting leader election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:07.883242 13123 raft_consensus.cc:3060] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.884321 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:07.885146 11526 raft_consensus.cc:2393] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 4: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:17:07.866641 12838 raft_consensus.cc:493] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.876672 11448 raft_consensus.cc:2468] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 3.
I20260709 12:17:07.877291 11524 raft_consensus.cc:3060] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:07.867499 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 73322.8us
I20260709 12:17:07.868634 13169 raft_consensus.cc:3060] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:07.863557 13097 leader_election.cc:290] T da8741606df54c3f8b5cc5c1141862ea P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:07.902956 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:07.903631 11527 raft_consensus.cc:3060] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:07.903736 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:17:07.904881 13183 log.cc:927] Time spent T 00000000000000000000000000000000 P eb02cb678b0c4f28932bfb6c2377165e: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:17:07.905215 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8741606df54c3f8b5cc5c1141862ea" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:07.905911 13126 leader_election.cc:290] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:07.904956 11449 raft_consensus.cc:2468] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 7.
I20260709 12:17:07.908032 13172 raft_consensus.cc:2749] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:07.902956 11599 raft_consensus.cc:1240] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:17:07.905638 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:07.891764 13132 consensus_queue.cc:1059] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:07.894637 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:07.874994 13131 raft_consensus.cc:2749] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:07.885324 11566 leader_election.cc:304] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d
I20260709 12:17:07.892386 12683 raft_consensus.cc:493] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:07.898357 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:07.922149 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:07.933132 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:07.934445 11593 raft_consensus.cc:2468] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 6.
W20260709 12:17:07.936355 12203 connection.cc:256] RPC call timeout handler was delayed by -1.7538857600000028s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16670000000000001s for a response
I20260709 12:17:07.936792 11519 raft_consensus.cc:2410] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:17:07.937196 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:07.984010 11599 raft_consensus.cc:3060] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:07.938488 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:07.985250 11602 raft_consensus.cc:1275] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:07.985662 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:07.938023 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:07.922369 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:07.990091 11522 raft_consensus.cc:2393] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 4: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
W20260709 12:17:07.926980 11418 leader_election.cc:336] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Timed out: RequestConsensusVote RPC to 127.3.212.131:36063 timed out after 1.569s (SENT)
I20260709 12:17:07.987092 11600 raft_consensus.cc:2468] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 4.
I20260709 12:17:07.989261 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:07.931505 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8741606df54c3f8b5cc5c1141862ea" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:07.990438 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:07.940255 12203 leader_election.cc:304] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:07.991106 11418 leader_election.cc:304] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:07.880015 13139 raft_consensus.cc:515] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:07.992442 11602 raft_consensus.cc:1275] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:08.001708 11593 raft_consensus.cc:2393] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 3: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:17:07.937918 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffe47647c274723808482c166efa21c" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:07.990324 11601 raft_consensus.cc:3060] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:08.003613 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 76692.1us
I20260709 12:17:08.004297 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
W20260709 12:17:07.993533 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 108291us
I20260709 12:17:08.005023 11454 raft_consensus.cc:2393] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 4: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:07.995792 11527 raft_consensus.cc:2468] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 5.
W20260709 12:17:07.996501 11493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 45971us
I20260709 12:17:07.999291 13171 raft_consensus.cc:2804] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:07.999611 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:08.014518 11451 raft_consensus.cc:2393] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 4: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:07.999902 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
W20260709 12:17:08.000406 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 125731us
I20260709 12:17:07.933421 12683 raft_consensus.cc:3060] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:08.005239 11593 raft_consensus.cc:1240] T da8741606df54c3f8b5cc5c1141862ea P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:07.932085 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:07.935266 12867 raft_consensus.cc:493] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:07.894714 12838 raft_consensus.cc:3060] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:07.983639 13172 raft_consensus.cc:3055] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:08.048663 11600 raft_consensus.cc:1240] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:08.014986 11448 raft_consensus.cc:2468] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 5.
I20260709 12:17:07.991842 13168 raft_consensus.cc:493] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:08.055302 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:08.013947 11447 raft_consensus.cc:3060] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:08.069727 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:08.070025 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:08.102002 11454 raft_consensus.cc:2468] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 4.
I20260709 12:17:08.079371 13147 raft_consensus.cc:3055] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:08.060295 11449 raft_consensus.cc:1275] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:08.013587 13171 raft_consensus.cc:493] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:08.070336 13182 raft_consensus.cc:493] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:08.082186 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:08.013729 13131 raft_consensus.cc:2749] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:08.013443 13035 raft_consensus.cc:2804] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:07.988651 13091 consensus_queue.cc:237] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:08.082484 11446 raft_consensus.cc:2468] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 6.
I20260709 12:17:08.083277 11595 raft_consensus.cc:2468] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 5.
I20260709 12:17:08.085246 11524 raft_consensus.cc:2410] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:08.087281 11601 raft_consensus.cc:2468] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 5.
I20260709 12:17:07.935072 13133 consensus_queue.cc:1059] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.115s
I20260709 12:17:08.098289 11525 raft_consensus.cc:2468] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 7.
I20260709 12:17:08.099391 11521 raft_consensus.cc:2468] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 7.
I20260709 12:17:08.106139 12757 raft_consensus.cc:493] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.888912 12848 consensus_queue.cc:260] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
W20260709 12:17:08.106369 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 101057us
W20260709 12:17:08.116037 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 175838us
W20260709 12:17:08.104169 11418 leader_election.cc:336] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Timed out: RequestConsensusVote RPC to 127.3.212.131:36063 timed out after 1.679s (SENT)
I20260709 12:17:08.143711 11418 leader_election.cc:304] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:08.104548 13097 raft_consensus.cc:493] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:08.122859 13035 raft_consensus.cc:697] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [term 5 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:08.106025 13147 raft_consensus.cc:740] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:08.123538 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:08.208077 11446 raft_consensus.cc:3060] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:08.208187 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:07.931586 12893 consensus_queue.cc:237] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:08.125478 13141 raft_consensus.cc:2749] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935) with higher term. Message: Invalid argument: T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for earlier term 6. Current term is 7.
I20260709 12:17:08.135492 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:08.099359 13172 raft_consensus.cc:740] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:08.105417 11451 raft_consensus.cc:2393] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 3: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
W20260709 12:17:08.116163 13188 log.cc:927] Time spent T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:17:08.121694 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:08.145347 12203 leader_election.cc:304] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:08.146179 11566 leader_election.cc:304] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
W20260709 12:17:08.230926 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 84828.9us
I20260709 12:17:08.231612 11566 leader_election.cc:304] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:08.167516 12204 leader_election.cc:304] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
W20260709 12:17:08.117610 12792 consensus_meta.cc:287] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d: Time spent flushing consensus metadata: real 0.609s	user 0.005s	sys 0.005s
I20260709 12:17:08.123258 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:08.114614 13171 raft_consensus.cc:3060] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:08.209429 12899 raft_consensus.cc:493] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:08.107493 13168 raft_consensus.cc:515] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:08.098958 12867 raft_consensus.cc:515] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
W20260709 12:17:08.209563 11491 connection.cc:256] RPC call timeout handler was delayed by -3.1182514980000633s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18500000000000003s for a response
W20260709 12:17:08.251163 11491 connection.cc:256] RPC call timeout handler was delayed by -2.6060926089999157s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.195s for a response
I20260709 12:17:08.209489 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:08.227258 11602 raft_consensus.cc:2468] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 2.
I20260709 12:17:08.166756 12757 raft_consensus.cc:515] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
W20260709 12:17:08.233131 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 90599.3us
I20260709 12:17:08.255939 12204 leader_election.cc:304] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:08.101739 11598 raft_consensus.cc:2468] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 6.
I20260709 12:17:08.237665 11450 raft_consensus.cc:1275] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:17:08.238386 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 93106us
I20260709 12:17:08.239472 13193 raft_consensus.cc:2804] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:08.258685 12203 leader_election.cc:304] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:08.207144 13097 raft_consensus.cc:515] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:08.238169 13144 raft_consensus.cc:2749] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:08.120718 13113 raft_consensus.cc:515] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:08.235834 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:08.246456 11566 leader_election.cc:304] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:08.167405 13115 consensus_queue.cc:1059] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.063s
I20260709 12:17:08.246532 11446 raft_consensus.cc:2468] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 7.
I20260709 12:17:08.249254 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:08.241015 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:08.120610 13182 raft_consensus.cc:515] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:08.168862 13131 raft_consensus.cc:2749] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:08.169037 13126 consensus_queue.cc:1059] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 12:17:08.254869 11491 leader_election.cc:304] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:08.168862 13117 consensus_queue.cc:1048] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.072s
I20260709 12:17:08.241954 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:08.239815 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:08.284323 11448 raft_consensus.cc:3060] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:08.269202 11449 raft_consensus.cc:2393] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 5: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:08.230183 12959 leader_election.cc:290] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:08.218148 13084 raft_consensus.cc:493] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:08.239708 13146 raft_consensus.cc:2749] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:08.269309 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:08.275223 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
W20260709 12:17:08.278599 11566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:08.234099 13122 raft_consensus.cc:2749] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:08.285013 11595 raft_consensus.cc:2468] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 5.
I20260709 12:17:08.306124 13084 raft_consensus.cc:515] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:08.251665 12899 raft_consensus.cc:515] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
W20260709 12:17:08.280702 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 161277us
I20260709 12:17:08.287097 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ed4eeff0ae44d0bc1ebb8cbe3adea5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:08.288147 11523 raft_consensus.cc:2393] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 5: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
W20260709 12:17:08.287730 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 118385us
I20260709 12:17:08.291424 13193 raft_consensus.cc:697] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:08.292871 11525 raft_consensus.cc:1275] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:08.294656 11524 raft_consensus.cc:3055] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:08.329849 11524 raft_consensus.cc:740] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:08.264694 13173 leader_election.cc:290] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:08.289803 13035 consensus_queue.cc:237] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:08.302103 13139 leader_election.cc:290] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:08.302618 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:08.331091 11601 raft_consensus.cc:2468] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 5.
I20260709 12:17:08.336732 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:08.341195 11454 raft_consensus.cc:3060] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:08.307428 13104 consensus_queue.cc:1048] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:08.296067 12981 raft_consensus.cc:2764] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 12:17:08.339844 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:17:08.340036 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 81436us
I20260709 12:17:08.337456 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:08.346370 11446 raft_consensus.cc:2393] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 4: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:08.346252 12203 leader_election.cc:304] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:08.330657 11524 consensus_queue.cc:260] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
W20260709 12:17:08.344406 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 56937.3us
I20260709 12:17:08.306711 13113 leader_election.cc:290] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:08.355587 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:08.356182 11448 raft_consensus.cc:2468] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 5.
I20260709 12:17:08.357920 11524 raft_consensus.cc:3060] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:08.358803 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:08.360216 11593 raft_consensus.cc:2393] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 5: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
W20260709 12:17:08.361397 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 105513us
I20260709 12:17:08.308027 13159 consensus_queue.cc:1059] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 12:17:08.338886 13126 raft_consensus.cc:2804] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:08.367193 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:08.352095 13146 raft_consensus.cc:2749] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:08.348459 13139 raft_consensus.cc:2804] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:17:08.359138 13019 consensus_meta.cc:287] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d: Time spent flushing consensus metadata: real 0.685s	user 0.009s	sys 0.001s
I20260709 12:17:08.277729 13147 consensus_queue.cc:260] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:08.378160 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:08.384380 11448 raft_consensus.cc:2393] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 3: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:08.379508 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:08.391142 11521 raft_consensus.cc:2393] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 5: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:17:08.274660 13172 consensus_queue.cc:260] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:08.380164 11418 leader_election.cc:304] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:08.381140 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:08.381441 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:08.396040 11446 raft_consensus.cc:2376] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 7. Re-sending same reply.
I20260709 12:17:08.381841 11454 raft_consensus.cc:2468] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 6.
I20260709 12:17:08.399827 11524 raft_consensus.cc:1275] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:08.404217 11599 raft_consensus.cc:2468] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 7.
I20260709 12:17:08.357450 13173 consensus_queue.cc:1048] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:17:08.354352 13123 raft_consensus.cc:515] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:08.410858 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:08.413925 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:08.416384 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:08.417663 11454 raft_consensus.cc:2368] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for earlier term 6. Current term is 7.
I20260709 12:17:08.418128 11599 raft_consensus.cc:1275] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:08.374511 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:08.379510 13139 raft_consensus.cc:493] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting leader election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
W20260709 12:17:08.419453 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 52300.4us
I20260709 12:17:08.419876 13139 raft_consensus.cc:3060] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:08.423130 13126 raft_consensus.cc:697] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:08.423717 13191 raft_consensus.cc:2749] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:08.376770 12981 consensus_queue.cc:1059] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:17:08.384035 13133 consensus_queue.cc:1059] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 12:17:08.393537 13130 consensus_queue.cc:1048] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:17:08.414619 13140 raft_consensus.cc:2749] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:08.392916 13019 raft_consensus.cc:515] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:08.416875 13084 leader_election.cc:290] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:08.419190 13146 raft_consensus.cc:493] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:08.426784 13205 raft_consensus.cc:493] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:08.428709 13133 raft_consensus.cc:3055] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:08.426401 12361 raft_consensus.cc:2393] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 5: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:17:08.448407 13133 raft_consensus.cc:740] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:08.449308 13133 consensus_queue.cc:260] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:08.429512 12683 raft_consensus.cc:515] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:08.432245 12345 raft_consensus.cc:1240] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:08.430871 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:08.424156 13126 consensus_queue.cc:237] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:08.454061 11448 raft_consensus.cc:2393] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 4: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:08.432566 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
W20260709 12:17:08.443403 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 55265.6us
I20260709 12:17:08.431098 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:08.454715 12203 leader_election.cc:304] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:08.432770 11451 raft_consensus.cc:2393] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 4: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:08.444047 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:08.452525 12683 leader_election.cc:290] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:08.477260 12203 leader_election.cc:304] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:08.478677 11447 raft_consensus.cc:2468] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 2.
I20260709 12:17:08.479764 11447 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25"
dest_uuid: "1c101e338f954ef086338e251deed19d"
 from {username='slave'} at 127.0.0.1:58856
I20260709 12:17:08.480342 11447 raft_consensus.cc:493] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:08.480371 12838 raft_consensus.cc:515] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:08.481094 11453 raft_consensus.cc:1240] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:08.482098 11445 raft_consensus.cc:1240] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:08.483045 12838 leader_election.cc:290] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:08.484817 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:08.474304 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:08.488368 11599 raft_consensus.cc:1240] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:08.489996 11600 raft_consensus.cc:2468] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 4.
I20260709 12:17:08.492769 11450 raft_consensus.cc:1240] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:08.493847 11417 leader_election.cc:304] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:08.494451 11450 raft_consensus.cc:1240] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:08.496402 11565 leader_election.cc:304] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671
W20260709 12:17:08.445294 13195 log.cc:927] Time spent T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:17:08.500011 11454 raft_consensus.cc:1240] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:08.430497 12899 leader_election.cc:290] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:17:08.447366 13087 consensus_meta.cc:287] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d: Time spent flushing consensus metadata: real 0.614s	user 0.010s	sys 0.000s
W20260709 12:17:08.443810 13169 consensus_meta.cc:287] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de: Time spent flushing consensus metadata: real 0.523s	user 0.002s	sys 0.006s
I20260709 12:17:08.429464 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:08.433035 13123 leader_election.cc:290] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:08.505673 11448 raft_consensus.cc:1240] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:17:08.505782 11600 raft_consensus.cc:1275] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:08.444727 13182 leader_election.cc:290] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:08.512535 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:08.513026 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:08.432487 13019 leader_election.cc:290] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:08.513837 11525 raft_consensus.cc:2468] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 5.
W20260709 12:17:08.505342 11493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 66399.2us
W20260709 12:17:08.508857 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 128810us
I20260709 12:17:08.517035 11418 leader_election.cc:400] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 election: Vote denied by peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063) with higher term. Message: Invalid argument: T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 3. Current term is 4.
I20260709 12:17:08.510033 13218 raft_consensus.cc:2804] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:08.510397 13115 raft_consensus.cc:2804] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:08.511117 13117 raft_consensus.cc:493] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:08.511106 13091 consensus_queue.cc:1048] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:08.433177 13146 raft_consensus.cc:515] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:08.513731 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:08.514606 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:08.443583 13104 consensus_queue.cc:1048] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 12:17:08.493034 11447 raft_consensus.cc:3060] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:08.518126 11418 leader_election.cc:304] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:08.519328 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:08.501694 13204 raft_consensus.cc:2804] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:08.500241 13215 raft_consensus.cc:2749] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:08.520038 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:08.395498 13193 consensus_queue.cc:237] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:08.513342 11599 raft_consensus.cc:2393] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 5: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:17:08.521979 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:08.522450 11527 raft_consensus.cc:2468] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 4.
I20260709 12:17:08.524081 12356 raft_consensus.cc:1275] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:08.593551 12347 raft_consensus.cc:2468] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 4.
I20260709 12:17:08.519981 13097 leader_election.cc:290] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:08.448381 13205 raft_consensus.cc:515] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:08.507499 13087 raft_consensus.cc:2749] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:08.525291 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c355b3902a4e7fb72bac6a91ea3316" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:08.503788 12757 leader_election.cc:290] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:08.517524 13208 raft_consensus.cc:3055] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:08.641702 13208 raft_consensus.cc:740] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:08.642616 13208 consensus_queue.cc:260] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:08.643311 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:08.643652 13208 raft_consensus.cc:3060] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:08.644062 13205 leader_election.cc:290] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:08.644254 11596 raft_consensus.cc:2393] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 2: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:17:08.559773 11491 leader_election.cc:304] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:08.628729 12959 raft_consensus.cc:493] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:08.646445 12959 raft_consensus.cc:515] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:08.648494 12959 leader_election.cc:290] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:08.526078 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:08.585825 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c355b3902a4e7fb72bac6a91ea3316" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:08.649672 11526 raft_consensus.cc:3060] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:08.649875 11600 raft_consensus.cc:2393] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 3: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:17:08.650098 13216 consensus_queue.cc:1048] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.130s
I20260709 12:17:08.650758 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:08.537653 13122 consensus_queue.cc:1048] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.120s
W20260709 12:17:08.589919 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 71855.1us
I20260709 12:17:08.586136 11525 raft_consensus.cc:2393] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 2: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:17:08.626849 12356 raft_consensus.cc:1240] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:08.660254 11418 leader_election.cc:304] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:08.523949 11594 raft_consensus.cc:2468] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 4.
I20260709 12:17:08.520546 13218 raft_consensus.cc:493] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting leader election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:08.658083 13108 consensus_queue.cc:1048] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:08.662104 13212 raft_consensus.cc:2804] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:08.662739 13212 raft_consensus.cc:697] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 3 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:08.663178 13218 raft_consensus.cc:3060] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:08.663653 13212 consensus_queue.cc:237] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:08.658948 13204 raft_consensus.cc:697] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 5 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:08.665211 13204 consensus_queue.cc:237] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:08.665822 13173 consensus_queue.cc:1059] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:17:08.666306 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 106661us
I20260709 12:17:08.666944 13201 raft_consensus.cc:2749] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:08.667392 13146 leader_election.cc:290] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:08.594352 12838 raft_consensus.cc:2749] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:08.506565 13169 raft_consensus.cc:515] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:08.582350 13019 raft_consensus.cc:493] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:08.672959 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:08.673198 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:08.690286 11491 leader_election.cc:304] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:08.690845 11522 raft_consensus.cc:2468] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 4.
I20260709 12:17:08.661706 11418 leader_election.cc:304] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:08.596457 11567 leader_election.cc:304] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:08.679963 11526 raft_consensus.cc:2468] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 4.
W20260709 12:17:08.693195 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 96836.4us
I20260709 12:17:08.696421 11525 raft_consensus.cc:2468] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 3.
I20260709 12:17:08.645256 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:08.524762 13117 raft_consensus.cc:515] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:08.698444 12347 raft_consensus.cc:1275] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:08.692632 12204 leader_election.cc:304] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:08.700874 11418 leader_election.cc:304] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:08.702091 12204 leader_election.cc:304] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:08.701546 13104 raft_consensus.cc:2749] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:08.687908 12981 consensus_queue.cc:1059] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:17:08.701604 12838 raft_consensus.cc:2749] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:08.705696 12981 raft_consensus.cc:3055] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:08.706066 12981 raft_consensus.cc:740] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:08.706847 12981 consensus_queue.cc:260] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:08.707921 12981 raft_consensus.cc:3060] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:08.708381 12848 raft_consensus.cc:3060] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:08.710769 11418 leader_election.cc:304] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:08.725216 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:08.732443 11491 leader_election.cc:304] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:08.735095 11491 leader_election.cc:304] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:08.711619 12838 raft_consensus.cc:2749] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:08.736953 11491 leader_election.cc:304] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:08.732514 11418 leader_election.cc:304] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:08.711601 13180 raft_consensus.cc:2804] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:08.742650 11418 leader_election.cc:304] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:08.730753 13205 raft_consensus.cc:2804] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:08.745724 11418 leader_election.cc:304] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:08.730288 13115 raft_consensus.cc:697] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:08.734516 13208 raft_consensus.cc:2804] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:08.725436 11447 raft_consensus.cc:515] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:08.746074 13215 raft_consensus.cc:2749] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:08.727645 13108 consensus_queue.cc:1059] T da8741606df54c3f8b5cc5c1141862ea P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:17:08.786070 11565 leader_election.cc:304] T da8741606df54c3f8b5cc5c1141862ea P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:08.733778 13104 consensus_queue.cc:1048] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:17:08.787514 12356 raft_consensus.cc:1275] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:08.788590 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:08.742103 13219 raft_consensus.cc:2749] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:08.789333 12359 raft_consensus.cc:3060] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:17:08.789921 12939 consensus_queue.cc:1048] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:08.791312 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:08.792237 12346 raft_consensus.cc:2393] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 4: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:17:08.700549 13162 consensus_queue.cc:260] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:08.750075 11418 leader_election.cc:304] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:08.737762 13201 raft_consensus.cc:2804] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:08.699669 13019 raft_consensus.cc:515] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:08.740947 13180 raft_consensus.cc:493] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:08.735291 13173 raft_consensus.cc:2749] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:08.740163 13141 raft_consensus.cc:2749] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:08.758996 12348 raft_consensus.cc:1275] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:08.749534 13205 raft_consensus.cc:493] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:08.762645 13169 leader_election.cc:290] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:08.763175 13117 leader_election.cc:290] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:08.763729 13115 consensus_queue.cc:237] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:08.766194 13190 raft_consensus.cc:3055] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:08.805506 13190 raft_consensus.cc:740] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:08.806943 12867 leader_election.cc:290] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:08.807543 13198 consensus_queue.cc:1048] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 12:17:08.769631 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
W20260709 12:17:08.770100 11594 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 648) took 1292 ms (client timeout 1629 ms). Trace:
W20260709 12:17:08.773178 11492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:08.775439 13171 consensus_meta.cc:287] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8: Time spent flushing consensus metadata: real 0.524s	user 0.009s	sys 0.002s
I20260709 12:17:08.773056 13218 raft_consensus.cc:515] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:08.753677 13208 raft_consensus.cc:493] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:08.816987 13208 raft_consensus.cc:3060] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:08.810081 11594 rpcz_store.cc:269] 0709 12:17:07.477750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:07.481817 (+  4067us) service_pool.cc:224] Handling call
0709 12:17:08.769916 (+1288099us) spinlock_profiling.cc:243] Waited 535 ms on lock 0x7b540054c254. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:08.770036 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1229480704}
I20260709 12:17:08.753827 13130 raft_consensus.cc:2804] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:08.820191 13130 raft_consensus.cc:697] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 5 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:08.821234 13130 consensus_queue.cc:237] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:08.710983 13139 raft_consensus.cc:515] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:08.824026 11598 raft_consensus.cc:2410] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:17:08.782960 11493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:08.742039 13087 raft_consensus.cc:2749] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:08.825796 13222 raft_consensus.cc:2804] T da8741606df54c3f8b5cc5c1141862ea P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:08.827848 13222 raft_consensus.cc:697] T da8741606df54c3f8b5cc5c1141862ea P 9da53be18b0f446aaa406216e20b0ec8 [term 2 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:08.828184 13139 leader_election.cc:290] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:08.829443 12357 raft_consensus.cc:1240] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:08.840097 13113 raft_consensus.cc:3055] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:08.840480 13113 raft_consensus.cc:740] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:08.841344 13113 consensus_queue.cc:260] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:08.842618 13113 raft_consensus.cc:3060] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:08.843953 11523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38272 (request call id 226) took 1114 ms. Trace:
I20260709 12:17:08.844385 11523 rpcz_store.cc:276] 0709 12:17:07.729135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:07.729257 (+   122us) service_pool.cc:224] Handling call
0709 12:17:08.843743 (+1114486us) spinlock_profiling.cc:243] Waited 554 ms on lock 0x7b5400672354. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:08.843869 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1273170304}
I20260709 12:17:08.838189 13168 leader_election.cc:290] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:08.838500 13141 consensus_queue.cc:1059] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 12:17:08.828812 13222 consensus_queue.cc:237] T da8741606df54c3f8b5cc5c1141862ea P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:08.848799 13141 raft_consensus.cc:3055] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:08.849166 13141 raft_consensus.cc:740] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:08.849560 13132 raft_consensus.cc:493] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:08.830832 13108 consensus_queue.cc:1048] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 12:17:08.850013 13141 consensus_queue.cc:260] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:08.851308 13141 raft_consensus.cc:3060] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:08.852118 13191 raft_consensus.cc:493] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:08.852689 13191 raft_consensus.cc:515] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
W20260709 12:17:08.796303 11419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:08.797489 12838 raft_consensus.cc:493] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:08.802284 13205 raft_consensus.cc:3060] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:08.802960 13215 raft_consensus.cc:2749] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:08.807701 13223 consensus_queue.cc:1059] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.072s
I20260709 12:17:08.809290 11525 raft_consensus.cc:3060] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:08.768404 11447 leader_election.cc:290] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:08.799896 13180 raft_consensus.cc:3060] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:08.800051 13201 raft_consensus.cc:697] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 2 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:08.847379 13198 consensus_queue.cc:1059] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:08.835698 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:08.858538 11450 raft_consensus.cc:1275] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:17:08.800372 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 50379.1us
I20260709 12:17:08.868168 12359 raft_consensus.cc:2468] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 4.
I20260709 12:17:08.869071 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e4724ed93a467ea47763eec9a6de2e" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:08.869346 11451 raft_consensus.cc:1240] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:08.850091 13132 raft_consensus.cc:515] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:08.876940 11453 raft_consensus.cc:1240] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:08.903421 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:08.904641 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:08.905308 11453 raft_consensus.cc:2468] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 4.
I20260709 12:17:08.877492 13223 raft_consensus.cc:3055] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:08.885840 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:08.887705 12345 raft_consensus.cc:1240] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:08.891844 12349 raft_consensus.cc:1240] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:08.892228 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
W20260709 12:17:08.892742 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 375928us
I20260709 12:17:08.882333 13208 raft_consensus.cc:515] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:08.902223 11445 raft_consensus.cc:2393] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 4: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:08.813776 13171 raft_consensus.cc:515] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:08.869166 13087 raft_consensus.cc:493] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:08.905344 11451 raft_consensus.cc:1275] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:08.912930 11448 raft_consensus.cc:1275] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:08.916992 11417 leader_election.cc:304] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671
W20260709 12:17:08.907958 12203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:08.927839 11525 raft_consensus.cc:2468] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 4.
I20260709 12:17:08.909650 11446 raft_consensus.cc:2468] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 5.
I20260709 12:17:08.919226 11526 raft_consensus.cc:1275] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:08.919291 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:08.922188 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e4724ed93a467ea47763eec9a6de2e" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:08.935233 11528 raft_consensus.cc:2468] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 3.
I20260709 12:17:08.906675 11453 raft_consensus.cc:1275] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:17:08.949074 11445 raft_consensus.cc:1275] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:08.919214 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:08.951138 11521 raft_consensus.cc:1275] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:08.954624 11527 raft_consensus.cc:2468] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 4.
I20260709 12:17:08.953954 11566 leader_election.cc:304] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:08.952574 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e4724ed93a467ea47763eec9a6de2e" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:08.956298 11566 leader_election.cc:304] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:08.909641 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:08.956811 11454 raft_consensus.cc:2468] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 4.
I20260709 12:17:08.938011 12204 leader_election.cc:304] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:08.958024 12349 raft_consensus.cc:1275] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 12:17:08.958787 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 214936us
I20260709 12:17:08.958102 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:08.911199 13133 raft_consensus.cc:3060] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:08.906857 13162 raft_consensus.cc:3060] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:08.937279 12203 leader_election.cc:304] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:08.961494 11528 raft_consensus.cc:3060] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:08.929751 12939 raft_consensus.cc:493] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:08.982864 12939 raft_consensus.cc:515] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:08.983803 13131 raft_consensus.cc:493] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:08.984334 13131 raft_consensus.cc:515] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:08.988121 11594 raft_consensus.cc:1275] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:08.958297 13117 consensus_queue.cc:1048] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:17:08.989526 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:08.990250 11594 raft_consensus.cc:3060] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:08.907403 13218 leader_election.cc:290] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:08.997627 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:08.998356 12349 raft_consensus.cc:2468] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 4.
I20260709 12:17:09.001363 12867 raft_consensus.cc:3055] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:09.001852 12867 raft_consensus.cc:740] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:09.002791 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:09.003701 11454 raft_consensus.cc:2393] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 4: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:09.004577 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:08.911649 13220 consensus_queue.cc:1048] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.215s
I20260709 12:17:08.915413 13199 consensus_queue.cc:1059] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.091s
I20260709 12:17:09.007108 13199 raft_consensus.cc:3055] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:09.007462 13199 raft_consensus.cc:740] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:08.962530 11602 raft_consensus.cc:2393] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 5: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:17:08.872663 12838 raft_consensus.cc:515] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:08.963097 13125 raft_consensus.cc:2804] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:09.012696 13229 consensus_queue.cc:1048] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:17:09.013103 13125 raft_consensus.cc:697] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 4 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:08.960500 12959 raft_consensus.cc:2749] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:08.951632 13159 raft_consensus.cc:493] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:08.906183 13201 consensus_queue.cc:237] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:08.958128 13087 raft_consensus.cc:515] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:08.967104 12981 raft_consensus.cc:3055] T da8741606df54c3f8b5cc5c1141862ea P a03223e9e41247c3a36b7b7c3d476671 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:08.968253 13172 raft_consensus.cc:3060] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:08.971985 13196 log.cc:927] Time spent T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.560s	user 0.002s	sys 0.002s
W20260709 12:17:09.029613 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 73392.1us
I20260709 12:17:08.975931 13191 leader_election.cc:290] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:08.976671 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9fe9a94294836aec652338f44367d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:09.034603 11596 raft_consensus.cc:3060] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:08.921876 13208 leader_election.cc:290] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:08.909859 13132 leader_election.cc:290] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:08.980647 12347 raft_consensus.cc:1275] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:08.990959 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:08.991693 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:08.991998 11595 raft_consensus.cc:1240] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:17:09.047691 11600 raft_consensus.cc:3060] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:08.907124 11449 raft_consensus.cc:2468] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 4.
I20260709 12:17:08.906831 13223 raft_consensus.cc:740] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
W20260709 12:17:08.992951 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 55767us
I20260709 12:17:09.091312 12203 leader_election.cc:304] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:09.002629 12867 consensus_queue.cc:260] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:08.963673 13206 consensus_queue.cc:1059] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:17:08.996735 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:09.094839 11528 raft_consensus.cc:2468] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 4.
I20260709 12:17:09.009917 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:09.097029 11521 raft_consensus.cc:2393] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 4: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:17:08.983846 13171 leader_election.cc:290] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:09.010926 13212 raft_consensus.cc:2804] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:09.010732 13199 consensus_queue.cc:260] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:09.035969 13130 raft_consensus.cc:493] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:08.985096 12939 leader_election.cc:290] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:09.012337 12838 leader_election.cc:290] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:09.014850 11565 leader_election.cc:304] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:09.017251 11519 raft_consensus.cc:1240] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:17:09.018589 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9fe9a94294836aec652338f44367d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:09.019857 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:09.108273 11526 raft_consensus.cc:3055] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:09.108605 11526 raft_consensus.cc:740] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:09.021803 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:09.022145 11567 leader_election.cc:304] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:09.023185 11491 leader_election.cc:304] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:08.972574 11419 leader_election.cc:304] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:09.003397 13205 raft_consensus.cc:515] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:09.031447 11566 leader_election.cc:304] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d
I20260709 12:17:09.014379 13193 raft_consensus.cc:3060] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:08.962039 13115 consensus_queue.cc:1048] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 12:17:09.057943 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:09.084278 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:09.029160 12981 raft_consensus.cc:740] T da8741606df54c3f8b5cc5c1141862ea P a03223e9e41247c3a36b7b7c3d476671 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:09.122745 12981 consensus_queue.cc:260] T da8741606df54c3f8b5cc5c1141862ea P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:09.124039 12981 raft_consensus.cc:3060] T da8741606df54c3f8b5cc5c1141862ea P a03223e9e41247c3a36b7b7c3d476671 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:09.009353 11445 raft_consensus.cc:1240] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:09.098461 12204 leader_election.cc:304] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:09.098942 11522 raft_consensus.cc:2393] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 7: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:17:09.127225 13208 raft_consensus.cc:2804] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:09.127815 13208 raft_consensus.cc:697] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 4 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
W20260709 12:17:09.128108 13234 log.cc:927] Time spent T da8741606df54c3f8b5cc5c1141862ea P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
W20260709 12:17:09.129622 11494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:09.132043 13205 leader_election.cc:290] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:09.139055 13199 raft_consensus.cc:3060] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:09.036959 12848 raft_consensus.cc:2804] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:08.964380 13190 consensus_queue.cc:260] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:09.014019 13125 consensus_queue.cc:237] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:09.102479 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:09.109338 11526 consensus_queue.cc:260] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:09.023725 13159 raft_consensus.cc:515] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
W20260709 12:17:09.113746 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 90654.3us
W20260709 12:17:09.113982 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 99233.5us
W20260709 12:17:09.114930 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 83581.1us
I20260709 12:17:09.030439 13168 consensus_queue.cc:1048] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.069s
I20260709 12:17:09.030644 12757 consensus_queue.cc:1048] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 12:17:09.091604 13132 raft_consensus.cc:493] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:09.112736 13212 raft_consensus.cc:697] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 4 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:09.120781 11600 raft_consensus.cc:2468] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 5.
W20260709 12:17:09.119407 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 97331.1us
W20260709 12:17:09.123250 13225 log.cc:927] Time spent T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.351s	user 0.003s	sys 0.000s
I20260709 12:17:09.095357 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:09.143283 13140 raft_consensus.cc:2804] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:09.093109 11447 raft_consensus.cc:2468] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 4.
I20260709 12:17:09.101305 12893 raft_consensus.cc:3060] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:09.145931 11524 raft_consensus.cc:2468] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 4.
I20260709 12:17:09.171998 11565 leader_election.cc:304] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:17:09.145813 12939 raft_consensus.cc:2804] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:09.172730 11521 raft_consensus.cc:2468] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 3.
I20260709 12:17:09.173856 11526 raft_consensus.cc:3060] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:17:09.174024 11596 raft_consensus.cc:2468] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 5.
I20260709 12:17:09.199445 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e4724ed93a467ea47763eec9a6de2e" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:09.198982 13091 raft_consensus.cc:2804] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:09.128732 13208 consensus_queue.cc:237] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:09.142881 13117 raft_consensus.cc:2804] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:09.219650 13117 raft_consensus.cc:493] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:09.220106 13117 raft_consensus.cc:3060] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:09.220890 13147 raft_consensus.cc:3060] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:09.221894 13159 leader_election.cc:290] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
W20260709 12:17:09.223867 13230 log.cc:927] Time spent T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:17:09.119887 12357 raft_consensus.cc:1240] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 2. Current term is 4. Ops: []
I20260709 12:17:09.097790 12203 leader_election.cc:304] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:09.225754 13180 raft_consensus.cc:515] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:09.147162 13200 raft_consensus.cc:2804] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:09.226794 13200 raft_consensus.cc:697] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 4 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:09.112190 13130 raft_consensus.cc:515] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:09.145287 12848 raft_consensus.cc:493] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:09.121611 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 149128us
I20260709 12:17:09.195053 11491 leader_election.cc:400] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579) with higher term. Message: Invalid argument: T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for earlier term 6. Current term is 7.
I20260709 12:17:09.238035 11491 leader_election.cc:304] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:09.239439 11491 leader_election.cc:304] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:09.119963 13206 raft_consensus.cc:2749] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:09.202121 11595 raft_consensus.cc:1240] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:09.181316 13132 raft_consensus.cc:515] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:09.193259 11597 raft_consensus.cc:2376] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 5. Re-sending same reply.
I20260709 12:17:09.176474 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:09.259516 11528 raft_consensus.cc:3060] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:09.205096 11526 raft_consensus.cc:2468] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 4.
I20260709 12:17:09.206166 11596 raft_consensus.cc:1240] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:09.206847 11593 raft_consensus.cc:1240] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:17:09.207958 13091 raft_consensus.cc:493] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:09.214826 13084 raft_consensus.cc:3055] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:09.215342 12838 raft_consensus.cc:493] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:09.226071 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 128347us
I20260709 12:17:09.226130 13205 raft_consensus.cc:2749] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:09.228154 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:09.144429 12867 raft_consensus.cc:3060] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:09.179451 13115 consensus_queue.cc:1048] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 12:17:09.233048 11521 raft_consensus.cc:1275] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:17:09.196452 13140 raft_consensus.cc:493] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:09.191202 13229 consensus_queue.cc:1048] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 12:17:09.249076 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:09.203593 11600 raft_consensus.cc:1240] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 4. Current term is 5. Ops: [3.2-4.3]
I20260709 12:17:09.245998 13141 raft_consensus.cc:2749] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:09.214588 11598 raft_consensus.cc:1240] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 4. Current term is 5. Ops: [3.2-4.3]
I20260709 12:17:09.271788 12203 leader_election.cc:304] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:09.179600 13223 consensus_queue.cc:260] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:09.179194 13216 consensus_queue.cc:1048] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:17:09.229455 12939 raft_consensus.cc:697] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:09.199822 13222 consensus_queue.cc:1048] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:17:09.243311 12848 raft_consensus.cc:3060] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:09.282333 11491 leader_election.cc:304] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:09.246629 13131 leader_election.cc:290] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:09.272593 13084 raft_consensus.cc:740] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:09.259861 13180 leader_election.cc:290] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:09.288026 12203 leader_election.cc:304] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:09.271898 13091 raft_consensus.cc:3060] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:09.296197 11494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:09.291821 11528 raft_consensus.cc:2468] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 5.
I20260709 12:17:09.278144 12838 raft_consensus.cc:515] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:09.301782 13235 raft_consensus.cc:2749] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:09.303679 13132 leader_election.cc:290] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
W20260709 12:17:09.271481 11597 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40784 (request call id 194) took 1359 ms (client timeout 1572 ms). Trace:
I20260709 12:17:09.283933 12347 raft_consensus.cc:3060] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:17:09.278379 13087 leader_election.cc:290] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:09.310410 11418 leader_election.cc:304] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:09.227687 13200 consensus_queue.cc:237] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:09.285612 13140 raft_consensus.cc:3060] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:09.270145 13220 consensus_queue.cc:1059] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:17:09.316923 12203 leader_election.cc:304] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:09.309881 13113 raft_consensus.cc:2749] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:09.294673 13169 raft_consensus.cc:2749] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:09.322964 11528 raft_consensus.cc:1275] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:17:09.317203 11493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:09.286407 13206 consensus_queue.cc:1059] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:17:09.338295 11418 leader_election.cc:304] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:09.292368 13108 consensus_queue.cc:1059] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:17:09.341197 11418 leader_election.cc:304] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:09.345685 12203 leader_election.cc:304] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:09.322491 13205 raft_consensus.cc:2804] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:17:09.350502 11494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:09.275081 13212 consensus_queue.cc:237] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:09.314685 13141 consensus_queue.cc:1059] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:17:09.339187 13235 raft_consensus.cc:493] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:09.358063 11492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:09.344142 13132 raft_consensus.cc:2749] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:09.366063 12347 raft_consensus.cc:2468] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 6.
I20260709 12:17:09.343855 13131 raft_consensus.cc:2749] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:09.347715 13208 raft_consensus.cc:2749] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:09.349848 13191 raft_consensus.cc:2804] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:09.355736 12955 raft_consensus.cc:2749] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:09.375705 11567 leader_election.cc:304] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:09.386263 13130 leader_election.cc:290] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:09.386840 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:09.387732 12346 raft_consensus.cc:2468] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 4.
I20260709 12:17:09.388046 12357 raft_consensus.cc:1240] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 4 LEADER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:09.388469 12838 leader_election.cc:290] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:09.388798 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffe47647c274723808482c166efa21c" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:09.393745 13159 consensus_queue.cc:1048] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:09.389219 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:09.399909 12893 raft_consensus.cc:2749] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:09.402813 13117 raft_consensus.cc:515] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:09.393599 13229 raft_consensus.cc:2804] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:09.411216 13229 raft_consensus.cc:697] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:09.412214 13229 consensus_queue.cc:237] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
W20260709 12:17:09.322499 11597 rpcz_store.cc:269] 0709 12:17:07.912303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:07.919948 (+  7645us) service_pool.cc:224] Handling call
0709 12:17:09.083886 (+1163938us) spinlock_profiling.cc:243] Waited 3.76 ms on lock 0x7b5800220b98. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb890a0 00007f84ebb88984 00007f84e51036d4 00007f84e5103662
0709 12:17:09.269155 (+185269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8648576}
I20260709 12:17:09.416433 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:09.358430 13205 raft_consensus.cc:697] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 5 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:09.418681 11452 raft_consensus.cc:2468] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 4.
I20260709 12:17:09.347271 13084 consensus_queue.cc:260] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:09.424744 11594 raft_consensus.cc:2468] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 7.
I20260709 12:17:09.444032 11602 raft_consensus.cc:1240] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 6. Current term is 7. Ops: [5.4-6.5]
I20260709 12:17:09.445854 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:09.446735 11419 leader_election.cc:304] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:09.432140 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:09.432931 11491 leader_election.cc:304] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:09.377229 13191 raft_consensus.cc:493] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:09.378329 12203 leader_election.cc:304] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:09.448837 11565 leader_election.cc:304] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
W20260709 12:17:09.454643 12205 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:09.457736 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 79498.9us
I20260709 12:17:09.458707 12203 leader_election.cc:304] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:09.460016 12203 leader_election.cc:304] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
W20260709 12:17:09.465303 11493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 126086us
I20260709 12:17:09.470127 11445 raft_consensus.cc:1275] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:09.471997 11451 raft_consensus.cc:1275] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:09.474809 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:09.467790 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:09.479398 11448 raft_consensus.cc:2468] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 4.
W20260709 12:17:09.481609 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 48771.8us
W20260709 12:17:09.468237 13240 log.cc:927] Time spent T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 12:17:09.483659 11565 leader_election.cc:304] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:17:09.456642 13216 raft_consensus.cc:493] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:09.442770 13162 raft_consensus.cc:493] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:09.464501 13131 raft_consensus.cc:2804] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:09.456811 13191 raft_consensus.cc:3060] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:09.498040 11491 leader_election.cc:304] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:09.467243 12955 raft_consensus.cc:3060] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:09.371503 12939 consensus_queue.cc:237] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:09.368923 13235 raft_consensus.cc:515] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:09.504230 12361 raft_consensus.cc:1275] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:17:09.504653 12361 pending_rounds.cc:85] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de: Aborting all ops after (but not including) 1
I20260709 12:17:09.504875 12361 pending_rounds.cc:107] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:17:09.505131 12361 raft_consensus.cc:2889] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:09.484620 13206 raft_consensus.cc:3055] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:09.467375 13222 raft_consensus.cc:2749] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:09.493603 12203 leader_election.cc:304] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:09.467115 13117 leader_election.cc:290] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:09.499569 11491 leader_election.cc:304] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:09.478966 13125 raft_consensus.cc:2749] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:09.467773 12838 consensus_queue.cc:1059] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:17:09.465214 13208 raft_consensus.cc:2749] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:09.494175 12757 raft_consensus.cc:2804] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:09.539181 12757 raft_consensus.cc:493] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:09.539659 12757 raft_consensus.cc:3060] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:09.486938 12867 raft_consensus.cc:3055] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:09.534219 13220 raft_consensus.cc:2749] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:09.534621 13247 raft_consensus.cc:493] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:09.535953 13172 consensus_meta.cc:287] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d: Time spent flushing consensus metadata: real 0.501s	user 0.003s	sys 0.007s
I20260709 12:17:09.536105 13091 raft_consensus.cc:515] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:09.500834 13131 raft_consensus.cc:493] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:09.488188 13122 consensus_queue.cc:1048] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:17:09.537529 12838 consensus_queue.cc:1243] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [LEADER]: Peer b126028166e8480ba25541bf8f7fc6de log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:17:09.523547 12203 leader_election.cc:304] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:09.497951 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:17:09.548992 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 49526us
I20260709 12:17:09.531895 13147 raft_consensus.cc:2804] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:09.496790 13204 consensus_queue.cc:1048] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 12:17:09.553787 11491 leader_election.cc:304] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:09.508909 13206 raft_consensus.cc:740] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:09.501927 13162 raft_consensus.cc:515] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:09.542696 12867 raft_consensus.cc:740] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:09.497298 13216 raft_consensus.cc:515] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:09.562939 11599 raft_consensus.cc:2368] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for earlier term 4. Current term is 5.
I20260709 12:17:09.567332 11491 leader_election.cc:304] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:09.569800 13220 raft_consensus.cc:2804] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:09.570165 13206 consensus_queue.cc:260] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
W20260709 12:17:09.571429 11491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:09.572026 11491 leader_election.cc:304] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:09.572129 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:09.572777 11528 raft_consensus.cc:2468] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 4.
I20260709 12:17:09.572889 13220 raft_consensus.cc:493] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:09.573293 13220 raft_consensus.cc:3060] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:09.571446 13206 raft_consensus.cc:3060] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:09.573887 11594 raft_consensus.cc:1240] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 5. Current term is 6. Ops: []
W20260709 12:17:09.574343 13257 log.cc:927] Time spent T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:17:09.575443 11448 raft_consensus.cc:1275] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:09.580874 12867 consensus_queue.cc:260] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:09.582266 12867 raft_consensus.cc:3060] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:09.583050 13091 leader_election.cc:290] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:09.553409 13131 raft_consensus.cc:3060] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:09.508064 13205 consensus_queue.cc:237] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:09.581305 13122 raft_consensus.cc:493] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:09.594082 11602 raft_consensus.cc:1275] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:09.597623 11445 raft_consensus.cc:1275] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:09.579901 13191 raft_consensus.cc:515] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:09.595825 11450 raft_consensus.cc:1275] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:09.599898 13108 raft_consensus.cc:2804] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:09.600298 13260 consensus_queue.cc:1048] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:09.604863 13204 raft_consensus.cc:493] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:09.566056 13147 raft_consensus.cc:697] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 5 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:09.606527 11418 leader_election.cc:304] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:09.643066 11454 raft_consensus.cc:1240] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 4 LEADER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 2. Current term is 4. Ops: []
I20260709 12:17:09.584589 13248 raft_consensus.cc:2749] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:09.614212 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:09.586910 13251 raft_consensus.cc:2804] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:09.645641 11448 raft_consensus.cc:3060] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:09.598261 13193 raft_consensus.cc:2749] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:09.596848 13201 raft_consensus.cc:3060] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:09.650044 13251 raft_consensus.cc:697] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 5 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:09.659392 12352 raft_consensus.cc:1240] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:09.608875 13091 raft_consensus.cc:493] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:09.597329 13139 raft_consensus.cc:2804] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:09.551738 13247 raft_consensus.cc:515] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:09.609750 13108 raft_consensus.cc:493] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:09.644945 12955 raft_consensus.cc:2749] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:09.644861 13254 raft_consensus.cc:493] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:09.665838 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:09.666594 11450 raft_consensus.cc:2468] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 3.
I20260709 12:17:09.606035 13122 raft_consensus.cc:515] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:09.674093 13254 raft_consensus.cc:515] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:09.662487 13091 raft_consensus.cc:515] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:09.691681 13091 leader_election.cc:290] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:09.669056 13139 raft_consensus.cc:697] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:09.693110 13139 consensus_queue.cc:237] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
W20260709 12:17:09.695909 11417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:09.704218 13147 consensus_queue.cc:237] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:09.707309 13247 leader_election.cc:290] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:09.665196 13108 raft_consensus.cc:3060] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:09.644619 13204 raft_consensus.cc:515] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:09.746999 11448 raft_consensus.cc:2468] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 5.
I20260709 12:17:09.687474 11597 raft_consensus.cc:1240] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:17:09.713507 13191 leader_election.cc:290] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
W20260709 12:17:09.756547 13263 log.cc:927] Time spent T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:17:09.756870 13251 consensus_queue.cc:237] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:09.762216 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:09.755283 13235 leader_election.cc:290] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:09.785683 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:09.790318 12347 raft_consensus.cc:2468] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 3.
I20260709 12:17:09.765091 13254 leader_election.cc:290] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:09.764329 13199 raft_consensus.cc:3055] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:09.799177 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:09.754343 12848 raft_consensus.cc:515] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:09.803992 12345 raft_consensus.cc:1240] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 4 LEADER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:17:09.786463 13019 leader_election.cc:290] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:09.799422 13162 leader_election.cc:290] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:09.817250 13122 leader_election.cc:290] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
W20260709 12:17:09.819231 13249 log.cc:927] Time spent T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.317s	user 0.000s	sys 0.007s
I20260709 12:17:09.818979 12757 raft_consensus.cc:515] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:09.809834 13216 leader_election.cc:290] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:09.822672 12848 leader_election.cc:290] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:09.805190 13199 raft_consensus.cc:740] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:09.824108 13199 consensus_queue.cc:260] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:09.826970 13141 raft_consensus.cc:3055] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:09.827502 13141 raft_consensus.cc:740] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
W20260709 12:17:09.828398 11452 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58856 (request call id 509) took 1824 ms (client timeout 2236 ms). Trace:
I20260709 12:17:09.836205 13220 raft_consensus.cc:515] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:09.838217 12361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 777) took 1325 ms. Trace:
I20260709 12:17:09.838973 13204 leader_election.cc:290] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:09.838644 12361 rpcz_store.cc:276] 0709 12:17:08.512405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:08.514247 (+  1842us) service_pool.cc:224] Handling call
0709 12:17:08.521367 (+  7120us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:09.505736 (+984369us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:09.837915 (+332179us) spinlock_profiling.cc:243] Waited 981 ms on lock 0x7b54000046d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:17:09.838127 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2257004800}
I20260709 12:17:09.840144 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:09.840828 11448 raft_consensus.cc:2468] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 6.
I20260709 12:17:09.841820 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:09.842607 11599 raft_consensus.cc:2393] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 6: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:17:09.846022 12361 raft_consensus.cc:1275] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:17:09.828399 13141 consensus_queue.cc:260] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:09.848711 13141 raft_consensus.cc:3060] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:09.828902 11452 rpcz_store.cc:269] 0709 12:17:08.003632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:08.005966 (+  2334us) service_pool.cc:224] Handling call
0709 12:17:09.828192 (+1822226us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54001c11d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:09.828312 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3028460928}
I20260709 12:17:09.851604 12361 raft_consensus.cc:1275] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:17:09.854980 13253 log.cc:927] Time spent T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.352s	user 0.000s	sys 0.003s
W20260709 12:17:09.856222 11494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:09.860018 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 685116us
I20260709 12:17:09.861469 11566 leader_election.cc:304] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:09.864729 11417 leader_election.cc:304] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:09.864864 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
W20260709 12:17:09.866881 11494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:09.868211 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:09.869657 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:09.875141 11599 raft_consensus.cc:2468] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 3.
I20260709 12:17:09.857635 12757 leader_election.cc:290] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:09.876317 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:09.877347 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:09.879048 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:09.879556 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffe47647c274723808482c166efa21c" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:09.880244 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:09.880856 11417 leader_election.cc:304] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:17:09.881183 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:09.869704 13122 raft_consensus.cc:2804] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:09.882105 13122 raft_consensus.cc:493] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:09.882460 13122 raft_consensus.cc:3060] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:09.883486 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:09.885416 11417 leader_election.cc:304] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:09.878630 11599 raft_consensus.cc:2468] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 4.
I20260709 12:17:09.881686 12792 raft_consensus.cc:2804] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:17:09.875150 13140 consensus_meta.cc:287] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8: Time spent flushing consensus metadata: real 0.532s	user 0.011s	sys 0.000s
I20260709 12:17:09.888443 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:09.889561 13254 raft_consensus.cc:2749] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:09.874169 13162 raft_consensus.cc:2804] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:09.888840 11417 leader_election.cc:304] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:09.877347 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:09.895139 11600 raft_consensus.cc:1275] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:17:09.894006 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:09.859419 13131 raft_consensus.cc:515] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
W20260709 12:17:09.901539 13243 log.cc:927] Time spent T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.600s	user 0.012s	sys 0.000s
I20260709 12:17:09.902567 13131 leader_election.cc:290] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:09.897315 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e4724ed93a467ea47763eec9a6de2e" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:09.898408 11524 raft_consensus.cc:1275] T da8741606df54c3f8b5cc5c1141862ea P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:09.907317 11522 raft_consensus.cc:3060] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:17:09.867967 13117 consensus_queue.cc:1048] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:17:09.889648 12792 raft_consensus.cc:493] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:09.887653 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:09.899160 13190 raft_consensus.cc:3060] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:09.902735 11446 raft_consensus.cc:2393] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 5: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:09.914191 13254 raft_consensus.cc:2749] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:09.933310 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:09.934296 11520 raft_consensus.cc:3060] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:09.933293 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:09.935019 11524 raft_consensus.cc:2468] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 4.
I20260709 12:17:09.937958 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:09.938585 12359 raft_consensus.cc:3060] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:09.940944 11522 raft_consensus.cc:2468] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 5.
I20260709 12:17:09.899340 13162 raft_consensus.cc:697] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [term 5 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:09.916030 11417 leader_election.cc:304] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:09.916359 12792 raft_consensus.cc:3060] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:09.942152 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 45179.6us
I20260709 12:17:09.946775 11417 leader_election.cc:304] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:09.894681 13140 raft_consensus.cc:515] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:09.936354 13201 raft_consensus.cc:2749] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:09.952461 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:09.959765 11524 raft_consensus.cc:3060] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:09.960657 11520 raft_consensus.cc:2468] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 5.
I20260709 12:17:09.931648 13165 raft_consensus.cc:493] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:09.949488 13254 raft_consensus.cc:2749] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:17:09.961936 13271 log.cc:927] Time spent T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 12:17:09.962433 13220 leader_election.cc:290] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:09.967317 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:09.953496 13131 raft_consensus.cc:2749] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:09.980576 11601 raft_consensus.cc:2393] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 5: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:17:09.981117 12359 raft_consensus.cc:2468] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 5.
W20260709 12:17:09.971114 13272 log.cc:927] Time spent T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:17:09.989768 11449 raft_consensus.cc:1275] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:09.993350 11524 raft_consensus.cc:2468] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 5.
I20260709 12:17:09.995350 12203 leader_election.cc:304] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:09.978088 13133 raft_consensus.cc:493] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:09.997751 13133 raft_consensus.cc:515] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:10.000082 13133 leader_election.cc:290] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:09.999797 13122 raft_consensus.cc:515] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:10.000793 13139 raft_consensus.cc:2804] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:09.997046 13125 consensus_queue.cc:1048] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:17:10.001989 12955 consensus_queue.cc:1048] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:17:10.006582 13244 log.cc:927] Time spent T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.522s	user 0.006s	sys 0.000s
I20260709 12:17:10.006886 13133 raft_consensus.cc:493] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:09.989470 13274 log.cc:927] Time spent T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 12:17:09.994589 13204 consensus_queue.cc:1048] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 12:17:10.014077 13140 leader_election.cc:290] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:10.014806 11593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 651) took 1530 ms. Trace:
I20260709 12:17:10.015266 11593 rpcz_store.cc:276] 0709 12:17:08.484734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:08.486999 (+  2265us) service_pool.cc:224] Handling call
0709 12:17:09.206582 (+719583us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:09.261228 (+ 54646us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:10.014539 (+753311us) spinlock_profiling.cc:243] Waited 719 ms on lock 0x7b54001d51d0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc28ad 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:10.014701 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1653878144}
I20260709 12:17:10.004165 13108 raft_consensus.cc:515] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:10.018006 13108 leader_election.cc:290] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:10.018748 13162 consensus_queue.cc:237] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:10.025329 11491 leader_election.cc:304] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
W20260709 12:17:10.026305 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 358213us
I20260709 12:17:10.029701 12352 raft_consensus.cc:1275] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:10.029735 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:10.031155 12361 raft_consensus.cc:2468] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 3.
I20260709 12:17:10.031348 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:10.031900 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:10.033635 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:10.034294 11447 raft_consensus.cc:3060] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:10.035430 11445 raft_consensus.cc:1275] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:10.037743 11523 raft_consensus.cc:1240] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:10.010150 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:10.038829 11595 raft_consensus.cc:2410] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:10.052389 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:10.055687 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:10.037123 13199 raft_consensus.cc:3060] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:10.060907 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:10.061571 11522 raft_consensus.cc:1240] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:10.063997 11521 raft_consensus.cc:1275] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:10.062417 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:10.061967 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:10.065775 11522 raft_consensus.cc:1240] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:10.073354 12347 raft_consensus.cc:2393] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 5: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:10.075210 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:10.076301 11491 leader_election.cc:400] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973) with higher term. Message: Invalid argument: T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for earlier term 4. Current term is 5.
I20260709 12:17:10.076468 11519 raft_consensus.cc:2468] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 4.
W20260709 12:17:10.077497 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 81437.3us
I20260709 12:17:10.078488 12203 leader_election.cc:304] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:10.081601 13220 consensus_queue.cc:1048] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:10.081923 13280 raft_consensus.cc:2804] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:10.082579 13280 raft_consensus.cc:493] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:10.083017 13280 raft_consensus.cc:3060] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:10.083501 13220 consensus_queue.cc:1059] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:10.092227 13280 raft_consensus.cc:515] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:10.095575 13286 consensus_queue.cc:1059] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:17:10.102015 13287 consensus_queue.cc:1048] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:10.102797 13223 raft_consensus.cc:3060] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:10.110661 13280 leader_election.cc:290] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:10.119210 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:10.120138 12361 raft_consensus.cc:2410] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:17:10.035681 13265 log.cc:927] Time spent T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.265s	user 0.002s	sys 0.000s
I20260709 12:17:10.124655 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:10.124900 11452 raft_consensus.cc:1240] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:17:10.125109 11522 raft_consensus.cc:1275] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:17:10.125360 12359 raft_consensus.cc:2468] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 6.
I20260709 12:17:09.981896 13216 consensus_queue.cc:1048] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.082s
I20260709 12:17:10.118687 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:10.128199 11491 leader_election.cc:403] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:17:10.133749 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 75375.1us
I20260709 12:17:09.978736 13165 raft_consensus.cc:515] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:10.007465 13133 raft_consensus.cc:515] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:10.143714 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
W20260709 12:17:10.151258 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 65116.7us
I20260709 12:17:10.123934 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:10.063275 13104 raft_consensus.cc:2804] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:10.148762 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:10.152287 11418 leader_election.cc:304] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:10.164844 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e4724ed93a467ea47763eec9a6de2e" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:10.167929 11566 leader_election.cc:304] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:10.171906 11452 raft_consensus.cc:3060] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:10.171815 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 95674us
I20260709 12:17:10.135483 13171 raft_consensus.cc:493] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:10.184000 11491 leader_election.cc:304] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:10.063701 13204 consensus_queue.cc:1048] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.100s
I20260709 12:17:10.174860 11567 leader_election.cc:304] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
W20260709 12:17:10.191339 11491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:10.191947 11417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:10.072867 13252 consensus_queue.cc:1048] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.095s
I20260709 12:17:10.157891 13125 raft_consensus.cc:493] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:10.188807 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:10.198777 11448 raft_consensus.cc:2468] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 4.
I20260709 12:17:10.140933 13139 raft_consensus.cc:697] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 5 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:10.196429 11418 leader_election.cc:304] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:10.170488 13104 raft_consensus.cc:493] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:10.145277 13130 consensus_queue.cc:1059] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 12:17:10.209710 11418 leader_election.cc:304] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:10.192543 13235 raft_consensus.cc:493] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:10.193041 13278 log.cc:927] Time spent T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
I20260709 12:17:10.190546 13168 raft_consensus.cc:2749] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:10.194069 13108 raft_consensus.cc:2749] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:10.180248 13220 raft_consensus.cc:2749] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973) with higher term. Message: Invalid argument: T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for earlier term 4. Current term is 5.
I20260709 12:17:10.214761 13212 raft_consensus.cc:2804] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:10.184989 13254 raft_consensus.cc:2749] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:10.206602 13104 raft_consensus.cc:3060] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:10.225502 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:10.245950 11448 raft_consensus.cc:3060] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:10.221515 11491 leader_election.cc:304] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:10.189337 13171 raft_consensus.cc:515] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:10.218083 11597 raft_consensus.cc:2393] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 6: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:17:10.223047 13229 consensus_queue.cc:1048] T da8741606df54c3f8b5cc5c1141862ea P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:17:10.224435 13191 raft_consensus.cc:2749] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:10.208745 13280 consensus_queue.cc:1048] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:17:10.208535 13125 raft_consensus.cc:515] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:10.233067 13212 raft_consensus.cc:493] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:10.278267 11452 raft_consensus.cc:2468] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 5.
I20260709 12:17:10.227052 13132 consensus_queue.cc:1059] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:17:10.258136 13108 raft_consensus.cc:2749] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:10.220489 13235 raft_consensus.cc:515] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:10.315855 13125 leader_election.cc:290] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:10.316175 13235 leader_election.cc:290] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:10.317119 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:10.263099 13140 raft_consensus.cc:2804] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:10.241235 13019 consensus_queue.cc:1048] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:17:10.248420 13130 consensus_queue.cc:1048] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 12:17:10.296480 13254 raft_consensus.cc:493] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:10.301246 13279 log.cc:927] Time spent T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
W20260709 12:17:10.302014 13283 log.cc:927] Time spent T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:17:10.302181 12792 raft_consensus.cc:515] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:10.310163 13133 leader_election.cc:290] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:10.311065 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:10.310163 13165 leader_election.cc:290] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:10.313686 13139 consensus_queue.cc:237] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
W20260709 12:17:10.285844 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 88460.8us
I20260709 12:17:10.319371 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:10.336848 11452 raft_consensus.cc:2393] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 5: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:10.333842 12345 raft_consensus.cc:2468] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 3.
I20260709 12:17:10.287971 13212 raft_consensus.cc:3060] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:10.334153 11453 raft_consensus.cc:2468] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 4.
I20260709 12:17:10.294906 11448 raft_consensus.cc:2468] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 5.
W20260709 12:17:10.335047 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 154952us
I20260709 12:17:10.340509 11566 leader_election.cc:304] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:10.344854 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:10.345666 12347 raft_consensus.cc:3060] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:17:10.347738 11451 raft_consensus.cc:2393] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 4: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:10.324906 13122 leader_election.cc:290] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:10.359526 11566 leader_election.cc:304] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:10.360553 11566 leader_election.cc:304] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:10.361788 11566 leader_election.cc:304] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:10.324645 13254 raft_consensus.cc:515] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:10.364022 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:10.364790 11452 raft_consensus.cc:2468] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 5.
W20260709 12:17:10.354787 13141 consensus_meta.cc:287] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671: Time spent flushing consensus metadata: real 0.501s	user 0.009s	sys 0.001s
I20260709 12:17:10.366104 12939 raft_consensus.cc:2804] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:10.389274 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:10.425450 11452 raft_consensus.cc:3060] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:10.385566 13091 raft_consensus.cc:2804] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:17:10.395639 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 177223us
I20260709 12:17:10.363014 13284 raft_consensus.cc:2804] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:10.428830 13284 raft_consensus.cc:697] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [term 5 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:10.429576 12346 raft_consensus.cc:1240] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:10.429901 13284 consensus_queue.cc:237] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:10.374650 13298 raft_consensus.cc:2804] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:10.431088 13298 raft_consensus.cc:697] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:10.431982 13298 consensus_queue.cc:237] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
W20260709 12:17:10.405503 11494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:10.377089 12347 raft_consensus.cc:2468] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 5.
I20260709 12:17:10.383185 13168 consensus_queue.cc:1059] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 12:17:10.434054 13104 raft_consensus.cc:515] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:10.434631 13168 raft_consensus.cc:3055] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:10.435050 13168 raft_consensus.cc:740] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:10.435806 13141 consensus_queue.cc:1059] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:10.435943 13168 consensus_queue.cc:260] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:10.436684 13141 raft_consensus.cc:3055] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:10.437060 13141 raft_consensus.cc:740] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:10.420149 13254 leader_election.cc:290] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:10.437877 13141 consensus_queue.cc:260] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:10.441213 13171 leader_election.cc:290] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:10.441247 13141 raft_consensus.cc:3060] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:10.443420 11597 raft_consensus.cc:1275] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:10.425011 12939 raft_consensus.cc:493] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:10.443902 11526 raft_consensus.cc:1275] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:10.444236 12939 raft_consensus.cc:3060] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:10.446192 13104 leader_election.cc:290] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:10.447256 13122 consensus_queue.cc:1059] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:10.448361 13084 raft_consensus.cc:3060] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:10.449913 13159 raft_consensus.cc:3055] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:10.450315 13159 raft_consensus.cc:740] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:10.451076 13159 consensus_queue.cc:260] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:10.452437 13159 raft_consensus.cc:3060] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:10.453867 13162 raft_consensus.cc:493] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:10.428720 11447 raft_consensus.cc:2468] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 6.
I20260709 12:17:10.454422 13162 raft_consensus.cc:515] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:10.455371 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:10.456981 13162 leader_election.cc:290] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:10.446282 13297 consensus_queue.cc:1048] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:17:10.463130 11567 leader_election.cc:304] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:10.430428 12792 leader_election.cc:290] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:10.476969 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:10.489406 12345 raft_consensus.cc:1275] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:10.490988 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:10.491820 11527 raft_consensus.cc:2468] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 3.
I20260709 12:17:10.482156 12352 raft_consensus.cc:2468] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 2.
I20260709 12:17:10.494925 13313 raft_consensus.cc:2804] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:10.495589 13313 raft_consensus.cc:697] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 5 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:10.496614 13313 consensus_queue.cc:237] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
W20260709 12:17:10.500828 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 55418us
I20260709 12:17:10.503077 11565 leader_election.cc:304] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:10.503597 11452 raft_consensus.cc:2468] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 5.
I20260709 12:17:10.507110 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:10.507747 12345 raft_consensus.cc:3060] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:10.528935 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:10.529765 11452 raft_consensus.cc:3060] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:10.504992 13306 log.cc:927] Time spent T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.065s	user 0.001s	sys 0.001s
I20260709 12:17:10.481566 13201 raft_consensus.cc:493] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:10.505221 13300 log.cc:927] Time spent T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.075s	user 0.003s	sys 0.000s
W20260709 12:17:10.535995 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 61907us
W20260709 12:17:10.506613 13302 log.cc:927] Time spent T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.065s	user 0.002s	sys 0.000s
I20260709 12:17:10.537600 11491 leader_election.cc:304] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:09.178316  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:10.541715 11275 catalog_manager.cc:5697] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 2 to 4, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 4 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } }
I20260709 12:17:10.562668 11275 catalog_manager.cc:5697] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:10.565299 11275 catalog_manager.cc:5697] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 1 to 2, leader changed from 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132) to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 2 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:10.567852 11275 catalog_manager.cc:5697] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 1 to 2, leader changed from 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132) to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 2 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:10.559665 11418 leader_election.cc:304] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:10.540261 11274 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57440 (request call id 180) took 3956 ms. Trace:
I20260709 12:17:10.552433 12345 raft_consensus.cc:2468] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 4.
I20260709 12:17:10.553514 11452 raft_consensus.cc:2468] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 4.
I20260709 12:17:10.503780 13206 raft_consensus.cc:493] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:10.569810 11275 catalog_manager.cc:5697] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 1 to 3, leader changed from a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131) to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 3 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:10.571347 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:10.600812 11454 raft_consensus.cc:1275] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:17:10.601545 11454 pending_rounds.cc:85] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d: Aborting all ops after (but not including) 2
I20260709 12:17:10.601861 11454 pending_rounds.cc:107] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:17:10.602094 11454 raft_consensus.cc:2889] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:10.555686 13091 raft_consensus.cc:697] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:10.553210 13223 raft_consensus.cc:493] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
W20260709 12:17:10.605144 13305 log.cc:927] Time spent T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.067s	user 0.001s	sys 0.001s
I20260709 12:17:10.605885 13301 raft_consensus.cc:493] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:10.605578 13091 consensus_queue.cc:237] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:10.607589 11452 raft_consensus.cc:1240] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:17:10.555315 13201 raft_consensus.cc:515] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:10.575933 13222 raft_consensus.cc:2749] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:10.557106 13220 raft_consensus.cc:493] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:10.619366 11528 raft_consensus.cc:1275] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:10.570569 11274 rpcz_store.cc:276] 0709 12:17:06.583590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:06.583809 (+   219us) service_pool.cc:224] Handling call
0709 12:17:10.540110 (+3956301us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:07.454478 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:07.524456 (+ 69978us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:07.524508 (+    52us) write_op.cc:435] Acquired schema lock
0709 12:17:07.524547 (+    39us) tablet.cc:662] Decoding operations
0709 12:17:07.551295 (+ 26748us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:07.551358 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:07.551385 (+    27us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:17:07.552131 (+   746us) tablet.cc:701] Row locks acquired
0709 12:17:07.552151 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:17:07.552305 (+   154us) write_op.cc:270] Start()
0709 12:17:07.552428 (+   123us) write_op.cc:276] Timestamp: P: 1783599427552257 usec, L: 0
0709 12:17:07.552455 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:17:07.553269 (+   814us) log.cc:844] Serialized 3645 byte log entry
0709 12:17:08.360834 (+807565us) op_driver.cc:464] REPLICATION: finished
0709 12:17:08.629278 (+268444us) write_op.cc:301] APPLY: starting
0709 12:17:08.661631 (+ 32353us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:08.661827 (+   196us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:08.661963 (+   136us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:08.663304 (+  1341us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:08.663548 (+   244us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 12:17:08.663596 (+    48us) write_op.cc:312] APPLY: finished
0709 12:17:08.663876 (+   280us) log.cc:844] Serialized 70 byte log entry
0709 12:17:08.664052 (+   176us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:08.664191 (+   139us) write_op.cc:454] Released schema lock
0709 12:17:08.664236 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:08.664606 (+   370us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:08.664634 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1474,"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":219797,"apply.run_cpu_time_us":3108,"apply.run_wall_time_us":69528,"num_ops":9,"prepare.queue_time_us":135971,"prepare.run_cpu_time_us":81966,"prepare.run_wall_time_us":295339,"raft.queue_time_us":296321,"raft.run_cpu_time_us":42020,"raft.run_wall_time_us":207799,"replication_time_us":790341,"thread_start_us":459160,"threads_started":4,"wal-append.queue_time_us":238998,"wal-append.run_cpu_time_us":36543,"wal-append.run_wall_time_us":1869961}]]}
I20260709 12:17:10.601025 13254 raft_consensus.cc:2804] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:10.577031 11275 catalog_manager.cc:5697] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 3 to 4, leader changed from 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132) to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 4 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:10.626070 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 123063us
I20260709 12:17:10.595328 13206 raft_consensus.cc:515] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:10.623239 13254 raft_consensus.cc:493] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:10.627449 13104 consensus_queue.cc:1048] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:10.625818 13199 consensus_queue.cc:1048] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.002s
W20260709 12:17:10.634335 13277 log.cc:927] Time spent T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.444s	user 0.005s	sys 0.000s
I20260709 12:17:10.635088 11419 leader_election.cc:304] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:10.610185 13223 raft_consensus.cc:515] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:10.569347 13108 raft_consensus.cc:2749] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:10.653503 11419 leader_election.cc:304] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:10.659415 11419 leader_election.cc:304] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:10.643019 13254 raft_consensus.cc:3060] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:10.641305 11447 raft_consensus.cc:2468] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 6.
I20260709 12:17:10.606421 13301 raft_consensus.cc:515] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:10.625542 13220 raft_consensus.cc:515] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:10.658957 13162 raft_consensus.cc:2749] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:10.663707 13133 raft_consensus.cc:2749] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:10.648593 13212 raft_consensus.cc:515] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
W20260709 12:17:10.682998 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 105143us
I20260709 12:17:10.683801 11567 leader_election.cc:304] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:10.674265 12792 raft_consensus.cc:2804] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:10.693370 13319 consensus_queue.cc:1048] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:10.698146 13206 leader_election.cc:290] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:10.664541 13130 consensus_queue.cc:1048] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:17:10.664458 13019 consensus_queue.cc:1048] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:17:10.724012 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:10.720469 12792 raft_consensus.cc:697] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 5 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:10.733065 11596 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "b126028166e8480ba25541bf8f7fc6de"
 from {username='slave'} at 127.0.0.1:37992
I20260709 12:17:10.733842 11596 raft_consensus.cc:606] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 LEADER]: Received request to transfer leadership to TS b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:10.718245 13206 raft_consensus.cc:493] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
W20260709 12:17:10.743120 13322 log.cc:927] Time spent T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.086s	user 0.001s	sys 0.001s
I20260709 12:17:10.743613 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:10.744386 11597 raft_consensus.cc:2468] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 5.
I20260709 12:17:10.733700 12792 consensus_queue.cc:237] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:10.747174 13140 raft_consensus.cc:493] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:10.747833 13140 raft_consensus.cc:3060] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:10.753074 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:10.754709 11448 raft_consensus.cc:1275] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:17:10.756922 11453 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35814 (request call id 200) took 1781 ms (client timeout 2244 ms). Trace:
W20260709 12:17:10.757364 11453 rpcz_store.cc:269] 0709 12:17:08.975146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:08.982383 (+  7237us) service_pool.cc:224] Handling call
0709 12:17:10.756757 (+1774374us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b5400447fd4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:10.756865 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2740255104}
I20260709 12:17:10.758183 13223 leader_election.cc:290] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:10.760546 13212 leader_election.cc:290] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:10.762425 13220 leader_election.cc:290] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:10.763207 13201 leader_election.cc:290] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:10.765010 11565 leader_election.cc:304] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:10.740849 13206 raft_consensus.cc:515] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:10.769212 13319 raft_consensus.cc:2804] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:10.770443 13206 leader_election.cc:290] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:10.771142 12939 raft_consensus.cc:515] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:10.771792 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:10.772449 13289 raft_consensus.cc:3055] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:10.772892 13289 raft_consensus.cc:740] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:10.773307 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a841f2f09ced40a4bbf33594e11bd7ad" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:10.773849 13289 consensus_queue.cc:260] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:10.774842 13289 raft_consensus.cc:3060] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:10.777573 13297 consensus_queue.cc:1048] T da8741606df54c3f8b5cc5c1141862ea P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:10.779552 13301 leader_election.cc:290] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:10.783365 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:10.784276 11526 raft_consensus.cc:2468] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 4.
I20260709 12:17:10.792621 12939 leader_election.cc:290] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:10.797782 13131 raft_consensus.cc:3055] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:10.798457 13131 raft_consensus.cc:740] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:10.799515 13131 consensus_queue.cc:260] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:10.801957 13254 raft_consensus.cc:515] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:10.803115 13201 raft_consensus.cc:493] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:10.803685 13201 raft_consensus.cc:515] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:10.806537 13220 raft_consensus.cc:493] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:10.807118 13220 raft_consensus.cc:515] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:10.810118 11521 raft_consensus.cc:1275] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:10.810672 11527 raft_consensus.cc:1275] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:10.812022 13140 raft_consensus.cc:515] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:10.812777 13220 leader_election.cc:290] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:10.814595 13140 leader_election.cc:290] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:10.815434 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:10.857470 11522 raft_consensus.cc:3060] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:10.772814 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:10.858793 12345 raft_consensus.cc:3060] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:10.860066 11526 raft_consensus.cc:1275] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:10.772476 12349 raft_consensus.cc:2468] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 5.
I20260709 12:17:10.822126 13254 leader_election.cc:290] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:10.823422 13280 consensus_queue.cc:1048] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:10.825335 13193 consensus_queue.cc:1048] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:10.826618 11493 leader_election.cc:304] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
W20260709 12:17:10.873541 11493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 46997.1us
I20260709 12:17:10.828154 11521 raft_consensus.cc:1275] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:17:10.812698 11520 raft_consensus.cc:1275] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:17:10.875962 11520 pending_rounds.cc:85] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671: Aborting all ops after (but not including) 2
I20260709 12:17:10.876228 11520 pending_rounds.cc:107] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:17:10.876444 11520 raft_consensus.cc:2889] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:10.830457 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:10.831403 11528 raft_consensus.cc:1240] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:10.817078 12203 leader_election.cc:304] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:10.861629 11526 raft_consensus.cc:1275] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:10.877796 11419 leader_election.cc:304] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
W20260709 12:17:10.878253 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 61255.7us
I20260709 12:17:10.878892 12203 leader_election.cc:304] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:10.879204 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c355b3902a4e7fb72bac6a91ea3316" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:10.879870 12349 raft_consensus.cc:2468] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 3.
I20260709 12:17:10.884161 11522 raft_consensus.cc:2468] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 5.
W20260709 12:17:10.841018 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 62075.4us
I20260709 12:17:10.902452 11493 leader_election.cc:304] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:10.871881 12345 raft_consensus.cc:2468] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 4.
I20260709 12:17:10.843205 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:10.833103 11491 leader_election.cc:304] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
W20260709 12:17:10.888058 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 70715.3us
I20260709 12:17:10.829896 13223 raft_consensus.cc:493] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:10.890348 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:10.856747 13301 raft_consensus.cc:493] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:10.863601 13131 raft_consensus.cc:3060] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:10.891654 13190 raft_consensus.cc:2804] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:10.908270 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:10.898095 13206 raft_consensus.cc:2804] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:10.890763 13319 raft_consensus.cc:697] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:10.888738 13292 raft_consensus.cc:2804] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:17:10.907632 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 74640.4us
I20260709 12:17:10.925114 11594 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ffe47647c274723808482c166efa21c"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "1c101e338f954ef086338e251deed19d"
 from {username='slave'} at 127.0.0.1:37992
I20260709 12:17:10.925787 11594 raft_consensus.cc:606] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Received request to transfer leadership to TS 1c101e338f954ef086338e251deed19d
I20260709 12:17:10.926187 11594 raft_consensus.cc:614] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:10.926607 11491 leader_election.cc:304] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:10.915699 11419 leader_election.cc:304] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:10.910756 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:10.928982 11594 raft_consensus.cc:1275] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:17:10.908609 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:10.897414 13091 raft_consensus.cc:2804] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:10.931787 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:10.887717 13286 raft_consensus.cc:2804] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:10.902680 13201 leader_election.cc:290] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:10.930514 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390e91331fd04f97a5235133a34875ee" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:10.912853 13251 raft_consensus.cc:2804] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:10.906824 13220 raft_consensus.cc:2804] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:10.915973 13281 consensus_queue.cc:1048] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:17:10.904212 13204 consensus_queue.cc:1048] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:17:10.905913 13296 consensus_queue.cc:1048] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:17:10.904286 13208 consensus_queue.cc:1048] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:17:10.901870 13147 consensus_queue.cc:1048] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:17:10.934506 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:10.929582 11418 leader_election.cc:304] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:10.941412 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:10.970160 11418 leader_election.cc:304] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:10.943935 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:10.938102 11491 leader_election.cc:304] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:10.912573 13190 raft_consensus.cc:493] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:10.940656 13289 raft_consensus.cc:493] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:10.967306 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390e91331fd04f97a5235133a34875ee" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:10.970913 11448 raft_consensus.cc:2393] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 5: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:10.914113 13223 raft_consensus.cc:515] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:10.944558 13251 raft_consensus.cc:493] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:10.963274 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:10.955655 12792 raft_consensus.cc:2804] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:10.944190 13141 raft_consensus.cc:493] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:10.946403 13220 raft_consensus.cc:493] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:10.946682 13292 raft_consensus.cc:697] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 4 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:10.916702 13301 raft_consensus.cc:515] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:10.955300 13286 raft_consensus.cc:697] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 6 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:10.955116 13206 raft_consensus.cc:697] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 4 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:11.002952 11445 raft_consensus.cc:3060] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:11.003531 11418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:10.979153 13190 raft_consensus.cc:3060] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:11.012897 11567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:11.016019 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:11.017234 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:11.018126 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:11.112988 12359 raft_consensus.cc:3060] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:10.978890 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:11.113723 11598 raft_consensus.cc:2468] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 5.
I20260709 12:17:11.074033 11525 raft_consensus.cc:3060] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:11.012481 13084 raft_consensus.cc:2804] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:17:11.078274 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 141414us
W20260709 12:17:11.078866 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 140842us
I20260709 12:17:11.119112 11601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "1c101e338f954ef086338e251deed19d"
 from {username='slave'} at 127.0.0.1:37992
I20260709 12:17:11.119803 11601 raft_consensus.cc:606] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Received request to transfer leadership to TS 1c101e338f954ef086338e251deed19d
I20260709 12:17:11.009959 13251 raft_consensus.cc:3060] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:11.011018 13212 raft_consensus.cc:2804] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:17:11.108906 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 105484us
I20260709 12:17:10.979876 13162 raft_consensus.cc:2804] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:11.120998 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:11.140468 11524 raft_consensus.cc:3060] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:11.142498 11527 raft_consensus.cc:1275] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:17:11.143247 11527 pending_rounds.cc:85] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671: Aborting all ops after (but not including) 2
I20260709 12:17:11.143532 11527 pending_rounds.cc:107] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:17:11.060081 13220 raft_consensus.cc:3060] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:11.000937 13289 raft_consensus.cc:515] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:11.155223 11525 raft_consensus.cc:2468] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 5.
I20260709 12:17:11.143783 11527 raft_consensus.cc:2889] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:11.057889 13141 raft_consensus.cc:515] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
W20260709 12:17:11.129824 13305 log.cc:927] Time spent T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 12:17:11.146775 13340 log.cc:927] Time spent T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 12:17:11.127853 13084 raft_consensus.cc:493] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:11.155411 13300 log.cc:927] Time spent T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
W20260709 12:17:11.204216 13306 log.cc:927] Time spent T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:17:11.146601 13162 raft_consensus.cc:493] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:11.229744 11524 raft_consensus.cc:2468] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 4.
I20260709 12:17:11.230772 12359 raft_consensus.cc:2468] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 4.
W20260709 12:17:11.211673 13326 log.cc:927] Time spent T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 12:17:11.241677 11445 raft_consensus.cc:2468] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 7.
I20260709 12:17:11.058286 13319 consensus_queue.cc:237] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:11.206434 13212 raft_consensus.cc:697] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 5 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:11.222218 13084 raft_consensus.cc:3060] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:11.234887 13162 raft_consensus.cc:3060] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:11.309144 13329 log.cc:927] Time spent T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.302s	user 0.000s	sys 0.001s
I20260709 12:17:11.312536 13223 leader_election.cc:290] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:11.308889 13212 consensus_queue.cc:237] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:11.313238 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:11.314078 13281 raft_consensus.cc:493] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.314625 13281 raft_consensus.cc:515] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
W20260709 12:17:11.315145 13327 log.cc:927] Time spent T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.257s	user 0.001s	sys 0.000s
I20260709 12:17:11.304273 13205 raft_consensus.cc:493] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.319368 13205 raft_consensus.cc:515] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:11.330428 13147 raft_consensus.cc:493] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.331019 13147 raft_consensus.cc:515] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:11.333112 13147 leader_election.cc:290] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:11.334548 13205 leader_election.cc:290] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:11.341216 13281 leader_election.cc:290] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:11.343616 13084 raft_consensus.cc:515] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:11.283895 13104 raft_consensus.cc:493] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.283118 13345 raft_consensus.cc:493] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.348570 13223 raft_consensus.cc:493] T da8741606df54c3f8b5cc5c1141862ea P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.354173 13223 raft_consensus.cc:515] T da8741606df54c3f8b5cc5c1141862ea P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:11.358534 13301 leader_election.cc:290] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:17:11.359813 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 231189us
I20260709 12:17:11.363515 12203 leader_election.cc:304] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:11.265780 13206 consensus_queue.cc:237] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:11.283520 13286 consensus_queue.cc:237] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
W20260709 12:17:11.516700 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 290901us
I20260709 12:17:11.520407 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:11.521164 11596 raft_consensus.cc:3060] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:11.283341 13292 consensus_queue.cc:237] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:11.379528 12203 leader_election.cc:304] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
W20260709 12:17:11.501642 12206 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:11.563560 11493 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.000s	sys 0.009s
W20260709 12:17:11.567621 11493 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.000s	sys 0.009s
W20260709 12:17:11.567909 11493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 544122us
I20260709 12:17:11.352762 13345 raft_consensus.cc:515] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:11.600876 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:11.601765 11523 raft_consensus.cc:2468] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 3.
W20260709 12:17:11.562866 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 183419us
I20260709 12:17:11.355362 13104 raft_consensus.cc:515] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:11.599555 11600 raft_consensus.cc:1240] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 LEADER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:17:11.514307 13147 raft_consensus.cc:2749] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:11.607901 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7937e0cff84ef7a26c84247c8ffc08" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:11.365208 13205 consensus_queue.cc:1048] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.200s
I20260709 12:17:11.608184 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8741606df54c3f8b5cc5c1141862ea" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:17:11.659153 11567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:11.635471 13332 log.cc:927] Time spent T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.703s	user 0.001s	sys 0.007s
I20260709 12:17:11.525223 13353 raft_consensus.cc:493] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.696127 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:11.708930 12359 raft_consensus.cc:2393] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 5: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:17:11.696849 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:11.706728 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:11.525535 13350 raft_consensus.cc:493] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:11.569533 13296 raft_consensus.cc:2804] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:17:11.565183 12792 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.002s	sys 0.007s
I20260709 12:17:11.599581 13223 leader_election.cc:290] T da8741606df54c3f8b5cc5c1141862ea P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:11.602865 13132 raft_consensus.cc:493] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:11.609217 13352 raft_consensus.cc:493] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
W20260709 12:17:11.564827 11419 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.000s	sys 0.008s
W20260709 12:17:11.789554 11419 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.001s	sys 0.008s
W20260709 12:17:11.789968 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 804536us
I20260709 12:17:11.790934 11491 leader_election.cc:304] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:11.525806 13162 raft_consensus.cc:515] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:11.794032 11491 leader_election.cc:304] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
W20260709 12:17:11.782109 12792 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.002s	sys 0.008s
I20260709 12:17:11.846467 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8741606df54c3f8b5cc5c1141862ea" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:11.848328 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:11.858319 11445 raft_consensus.cc:1275] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:11.779153 13296 raft_consensus.cc:493] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:11.831758 11596 raft_consensus.cc:2468] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 6.
I20260709 12:17:11.868305 11601 raft_consensus.cc:1240] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:11.711723 13141 leader_election.cc:290] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
W20260709 12:17:11.844578 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 51111.9us
W20260709 12:17:11.833704 13212 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.004s	sys 0.017s
I20260709 12:17:11.894383 11450 raft_consensus.cc:1275] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:11.783878 13084 leader_election.cc:290] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:11.788785 13289 leader_election.cc:290] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
W20260709 12:17:11.911672 11451 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58868 (request call id 1095) took 1770 ms (client timeout 2055 ms). Trace:
I20260709 12:17:11.844684 13200 raft_consensus.cc:493] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.755353 13353 raft_consensus.cc:515] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
W20260709 12:17:11.912358 11451 rpcz_store.cc:269] 0709 12:17:10.141109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:10.148440 (+  7331us) service_pool.cc:224] Handling call
0709 12:17:11.911392 (+1762952us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b54005c58d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:11.911594 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":405339904}
W20260709 12:17:11.903390 13332 log.cc:927] Time spent T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:17:11.844728 13362 raft_consensus.cc:493] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:11.834394 13132 raft_consensus.cc:515] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:11.876135 13296 raft_consensus.cc:3060] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:11.849218 12792 raft_consensus.cc:697] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [term 4 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:11.903535 13354 raft_consensus.cc:493] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.903714 13141 raft_consensus.cc:493] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.784619 13350 raft_consensus.cc:515] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:11.955864 13362 raft_consensus.cc:515] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:11.966149 13355 raft_consensus.cc:493] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:11.966929 13351 raft_consensus.cc:493] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.967720 13362 leader_election.cc:290] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:11.943987 13133 raft_consensus.cc:493] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.968581 13133 raft_consensus.cc:515] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:11.970561 13361 raft_consensus.cc:2749] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:11.972681 11448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58868 (request call id 1111) took 1067 ms. Trace:
I20260709 12:17:11.973582 13162 leader_election.cc:290] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:11.972697 13353 leader_election.cc:290] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:11.967514 13351 raft_consensus.cc:515] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:11.975710 13353 raft_consensus.cc:493] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.976212 13353 raft_consensus.cc:515] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:11.973107 11448 rpcz_store.cc:276] 0709 12:17:10.905001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:11.001418 (+ 96417us) service_pool.cc:224] Handling call
0709 12:17:11.004731 (+  3313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:11.111768 (+107037us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:11.111831 (+    63us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:11.204572 (+ 92741us) log.cc:844] Serialized 26 byte log entry
0709 12:17:11.604969 (+400397us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:11.605010 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:11.605074 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:11.972446 (+367372us) raft_consensus.cc:1685] finished
0709 12:17:11.972474 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:11.972610 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":213984,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":34773,"thread_start_us":453098,"threads_started":2,"wal-append.queue_time_us":628489}
I20260709 12:17:11.943241 13364 raft_consensus.cc:493] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:11.982668 11602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40784 (request call id 226) took 1056 ms. Trace:
I20260709 12:17:11.838706 13352 raft_consensus.cc:515] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:11.970796 13133 leader_election.cc:290] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:11.988001 12352 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51698 (request call id 625) took 1216 ms. Trace:
W20260709 12:17:11.789045 13349 log.cc:927] Time spent T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 12:17:11.985461 11602 rpcz_store.cc:276] 0709 12:17:10.926721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:10.927701 (+   980us) service_pool.cc:224] Handling call
0709 12:17:10.928022 (+   321us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:10.956604 (+ 28582us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:10.956639 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:10.963243 (+  6604us) log.cc:844] Serialized 52 byte log entry
0709 12:17:11.106534 (+143291us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:11.142253 (+ 35719us) log.cc:844] Serialized 14 byte log entry
0709 12:17:11.215753 (+ 73500us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:11.215832 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:11.969603 (+753771us) spinlock_profiling.cc:243] Waited 5.6 ms on lock 0x7b18003476e0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3ad63f3 00007f84e3ad87c1 00007f84e3ad8779 00007f84e3ad8709 00007f84e3ad86d1 00007f84e3ad79cd 0000000000388634 0000000000388479 00007f84e3ab983a
0709 12:17:11.978272 (+  8669us) raft_consensus.cc:1685] finished
0709 12:17:11.982403 (+  4131us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:11.982587 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":138586,"prepare.queue_time_us":37342,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":55,"raft.queue_time_us":107677,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":22260,"spinlock_wait_cycles":51560192,"thread_start_us":103757,"threads_started":1,"wal-append.queue_time_us":264504}
I20260709 12:17:11.976648 13351 leader_election.cc:290] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:11.990512 12352 rpcz_store.cc:276] 0709 12:17:10.771377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:10.774299 (+  2922us) service_pool.cc:224] Handling call
0709 12:17:10.774618 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:10.774951 (+   333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:10.774978 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:10.775442 (+   464us) log.cc:844] Serialized 26 byte log entry
0709 12:17:10.890709 (+115267us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:10.906007 (+ 15298us) log.cc:844] Serialized 14 byte log entry
0709 12:17:10.913497 (+  7490us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:10.913583 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:11.634796 (+721213us) spinlock_profiling.cc:243] Waited 4.08 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e675e86e 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221 00007f84e67671d9 00007f84e6767169
0709 12:17:11.980321 (+345525us) raft_consensus.cc:1685] finished
0709 12:17:11.987765 (+  7444us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:11.987937 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7216,"prepare.queue_time_us":13236,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":38080,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":208,"spinlock_wait_cycles":9395072,"thread_start_us":114771,"threads_started":1,"wal-append.queue_time_us":132151}
I20260709 12:17:11.981145 13147 raft_consensus.cc:493] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
W20260709 12:17:11.987128 13343 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.005s	sys 0.000s
I20260709 12:17:11.963796 13084 raft_consensus.cc:2749] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:11.794816 13223 raft_consensus.cc:493] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:11.952790 13200 raft_consensus.cc:515] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
W20260709 12:17:12.003281 13323 log.cc:927] Time spent T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:17:12.032528 13147 raft_consensus.cc:515] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:12.039597 13147 leader_election.cc:290] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:11.978080 13141 raft_consensus.cc:515] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:12.045807 13223 raft_consensus.cc:515] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
W20260709 12:17:12.029469 13251 consensus_meta.cc:287] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671: Time spent flushing consensus metadata: real 0.875s	user 0.011s	sys 0.000s
I20260709 12:17:12.048472 13251 raft_consensus.cc:515] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:12.050441 13200 leader_election.cc:290] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:17:12.032931 13343 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.007s	sys 0.000s
I20260709 12:17:12.051122 11522 raft_consensus.cc:1240] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:17:12.051782 11452 raft_consensus.cc:2468] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 4.
W20260709 12:17:12.054705 13357 log.cc:927] Time spent T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.271s	user 0.000s	sys 0.000s
I20260709 12:17:12.057588 12792 consensus_queue.cc:237] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:12.058706 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c355b3902a4e7fb72bac6a91ea3316" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:12.058063 13370 raft_consensus.cc:493] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:11.978255 13354 raft_consensus.cc:515] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:12.059427 11597 raft_consensus.cc:2468] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 3.
I20260709 12:17:12.071353 11597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55250 (request call id 527) took 1156 ms. Trace:
I20260709 12:17:12.072011 13354 leader_election.cc:290] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:12.072172 11597 rpcz_store.cc:276] 0709 12:17:10.915079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:10.924319 (+  9240us) service_pool.cc:224] Handling call
0709 12:17:12.058527 (+1134208us) spinlock_profiling.cc:243] Waited 3.06 ms on lock 0x7b5800220b98. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb890a0 00007f84ebb88984 00007f84e51036d4 00007f84e5103662
0709 12:17:12.071287 (+ 12760us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7039360}
I20260709 12:17:12.072923 13345 leader_election.cc:290] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:12.059748 13370 raft_consensus.cc:515] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:12.074839 13296 raft_consensus.cc:515] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:12.075470 13132 leader_election.cc:290] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:11.982139 13355 raft_consensus.cc:515] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:12.025238 13318 raft_consensus.cc:493] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:12.075735 13370 leader_election.cc:290] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:12.067376 11519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33446 (request call id 1075) took 1209 ms. Trace:
I20260709 12:17:12.116183 11519 rpcz_store.cc:276] 0709 12:17:10.857680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:10.857821 (+   141us) service_pool.cc:224] Handling call
0709 12:17:10.858133 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:10.858339 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:17:10.936629 (+ 78290us) log.cc:844] Serialized 14 byte log entry
0709 12:17:12.066875 (+1130246us) spinlock_profiling.cc:243] Waited 2.37 ms on lock 0x7b18000b9620. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e676b4bc 00007f84e3ab948b 00007f84ec9139a9 00007f84e3ad569b 00007f84e3ad393f 00007f84e3ad3455 00007f84e6bbb060 00007f84e6bcd716 00007f84e6bde287
0709 12:17:12.066984 (+   109us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:12.067035 (+    51us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:12.067079 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:12.067163 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:12.067310 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":106790,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":177802,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":34190,"spinlock_wait_cycles":5453696,"thread_start_us":373739,"threads_started":3,"wal-append.queue_time_us":385217}
I20260709 12:17:12.077826 13353 leader_election.cc:290] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:11.989738 13364 raft_consensus.cc:515] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
W20260709 12:17:12.079154 11418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:12.068904 13220 consensus_meta.cc:287] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671: Time spent flushing consensus metadata: real 0.851s	user 0.006s	sys 0.001s
I20260709 12:17:12.088050 11525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33446 (request call id 1074) took 1258 ms. Trace:
W20260709 12:17:12.080945 13190 consensus_meta.cc:287] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d: Time spent flushing consensus metadata: real 0.941s	user 0.012s	sys 0.000s
I20260709 12:17:12.121969 11525 rpcz_store.cc:276] 0709 12:17:10.830030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:10.830192 (+   162us) service_pool.cc:224] Handling call
0709 12:17:12.087827 (+1257635us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b54006decd4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:12.087979 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":452093184}
I20260709 12:17:12.069073 13104 leader_election.cc:290] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:12.067845 13219 raft_consensus.cc:2749] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:12.128846 13220 raft_consensus.cc:515] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:12.129688 13364 leader_election.cc:290] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
W20260709 12:17:12.107722 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 313746us
I20260709 12:17:12.113742 13352 leader_election.cc:290] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
W20260709 12:17:12.115914 12206 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:12.125581 13373 raft_consensus.cc:493] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:12.126169 13375 raft_consensus.cc:493] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:12.126624 13354 consensus_queue.cc:1048] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:12.128129 13355 leader_election.cc:290] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:12.128516 13132 raft_consensus.cc:493] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:12.124498 11418 leader_election.cc:304] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:12.129611 13190 raft_consensus.cc:515] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:12.139438 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:12.146957 11491 leader_election.cc:304] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:12.149573 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:12.163141 11448 raft_consensus.cc:2468] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 5.
I20260709 12:17:12.149573 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:12.164268 11449 raft_consensus.cc:2468] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 4.
I20260709 12:17:12.153806 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:12.165522 11524 raft_consensus.cc:2393] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 5: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:12.155468 11519 raft_consensus.cc:1275] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:12.167665 11491 leader_election.cc:304] T da8741606df54c3f8b5cc5c1141862ea P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:12.169064 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9fe9a94294836aec652338f44367d" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:12.169781 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:12.172487 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:12.173645 11448 raft_consensus.cc:3060] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:12.172808 13364 raft_consensus.cc:2804] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:12.175350 13364 raft_consensus.cc:697] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 4 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:12.176268 13220 leader_election.cc:290] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:12.176270 13364 consensus_queue.cc:237] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
W20260709 12:17:12.178352 13369 log.cc:927] Time spent T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:17:12.169039 13375 raft_consensus.cc:515] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:12.179778 13190 leader_election.cc:290] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:12.162416 11418 leader_election.cc:304] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:12.161481 13373 raft_consensus.cc:515] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:12.121564 13318 raft_consensus.cc:515] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:12.148337 13353 raft_consensus.cc:493] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:12.183429 13318 leader_election.cc:290] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:12.183214 13353 raft_consensus.cc:515] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:12.160043 13352 raft_consensus.cc:493] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:12.184610 13352 raft_consensus.cc:515] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:12.147199 13104 raft_consensus.cc:493] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:12.185943 11453 raft_consensus.cc:2393] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 6: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:12.187363 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:12.192945 11449 raft_consensus.cc:1275] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:12.222950 11491 leader_election.cc:304] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:12.203153 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:12.224113 11525 raft_consensus.cc:2468] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 4.
I20260709 12:17:12.187180 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:12.224313 11491 leader_election.cc:304] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:12.188045 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7937e0cff84ef7a26c84247c8ffc08" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:12.226179 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:12.227576 11520 raft_consensus.cc:1275] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
I20260709 12:17:12.227962 11450 raft_consensus.cc:2468] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 4.
I20260709 12:17:12.195210 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:12.192274 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:12.203727 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:12.223176 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:12.233121 11449 raft_consensus.cc:2393] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 4: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:12.233343 11524 raft_consensus.cc:3060] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:12.235487 11448 raft_consensus.cc:2468] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 6.
I20260709 12:17:12.230453 13104 raft_consensus.cc:515] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:12.232846 11566 leader_election.cc:304] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:12.172341 13084 raft_consensus.cc:2804] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:12.186225 13132 raft_consensus.cc:515] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:12.226200 13318 consensus_queue.cc:1048] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:17:12.228370 13220 raft_consensus.cc:2804] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:12.243554 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:12.229315 11418 leader_election.cc:304] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:12.247172 12352 raft_consensus.cc:1275] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:17:12.266004 12352 pending_rounds.cc:85] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de: Aborting all ops after (but not including) 3
I20260709 12:17:12.266316 12352 pending_rounds.cc:107] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:17:12.266567 12352 raft_consensus.cc:2889] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:17:12.182773 13330 log.cc:927] Time spent T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 1.249s	user 0.012s	sys 0.016s
I20260709 12:17:12.231673 11521 raft_consensus.cc:2468] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 4.
I20260709 12:17:12.230340 13368 raft_consensus.cc:2804] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:12.252107 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8741606df54c3f8b5cc5c1141862ea" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:12.181362 13375 leader_election.cc:290] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:12.327847 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:12.328750 11521 raft_consensus.cc:2410] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:17:12.227787 13353 leader_election.cc:290] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:12.258308 11451 raft_consensus.cc:1240] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:12.263335 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:12.264567 11602 raft_consensus.cc:1275] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:12.269315 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:12.269523 11599 raft_consensus.cc:1240] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:17:12.330065 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a841f2f09ced40a4bbf33594e11bd7ad" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:12.324187 11527 raft_consensus.cc:1275] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:12.324491 11524 raft_consensus.cc:2468] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 5.
I20260709 12:17:12.182837 13373 leader_election.cc:290] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:12.325874 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:12.330817 11596 raft_consensus.cc:3060] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:12.326782 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 59548.6us
I20260709 12:17:12.264189 13298 raft_consensus.cc:2749] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:12.335135 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8741606df54c3f8b5cc5c1141862ea" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:12.371698 11524 raft_consensus.cc:1275] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:17:12.372255 11524 pending_rounds.cc:85] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671: Aborting all ops after (but not including) 3
I20260709 12:17:12.372526 11524 pending_rounds.cc:107] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:17:12.372788 11524 raft_consensus.cc:2889] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:12.330819 11445 raft_consensus.cc:2468] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 5.
W20260709 12:17:12.374490 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 44633us
I20260709 12:17:12.375340 11525 raft_consensus.cc:2468] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 4.
I20260709 12:17:12.375412 11565 leader_election.cc:304] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:17:12.265004 13220 raft_consensus.cc:493] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:12.379094 11565 leader_election.cc:304] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:12.379117 11418 leader_election.cc:304] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
W20260709 12:17:12.427841 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 48787.2us
I20260709 12:17:12.327594 13368 raft_consensus.cc:493] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:12.329510 13131 raft_consensus.cc:493] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:12.267431 13222 consensus_queue.cc:1048] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.113s
I20260709 12:17:12.333825 13084 raft_consensus.cc:697] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 6 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
W20260709 12:17:12.433514 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 54491.5us
I20260709 12:17:12.428906 11418 leader_election.cc:304] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:12.437160 13363 raft_consensus.cc:2804] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:12.384461 13220 raft_consensus.cc:3060] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:12.444960 11596 raft_consensus.cc:2468] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 4.
I20260709 12:17:12.330816 13355 raft_consensus.cc:2804] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:17:12.447965 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 306492us
I20260709 12:17:12.427058 13313 raft_consensus.cc:2804] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:12.436204 13368 raft_consensus.cc:3060] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:12.380720 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:12.451809 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:12.447824 13353 raft_consensus.cc:493] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:12.451509 13298 raft_consensus.cc:2749] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:12.436137 13373 raft_consensus.cc:2804] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:12.449807 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:12.449250 11418 leader_election.cc:304] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:12.458760 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:12.459899 11417 leader_election.cc:304] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:12.448527 13363 raft_consensus.cc:493] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:12.445227 13381 raft_consensus.cc:493] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:12.455276 13355 raft_consensus.cc:493] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:12.335057 13354 consensus_queue.cc:1048] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.123s
I20260709 12:17:12.448122 13296 leader_election.cc:290] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:12.467605 11596 raft_consensus.cc:2393] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 5: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:17:12.457939 13318 raft_consensus.cc:993] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8: : Instructing follower 1c101e338f954ef086338e251deed19d to start an election
I20260709 12:17:12.469776 13373 raft_consensus.cc:493] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:12.448132 13171 raft_consensus.cc:493] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:12.436371 12757 consensus_queue.cc:1048] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:17:12.474181 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:12.439783 13131 raft_consensus.cc:515] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:12.455518 12792 raft_consensus.cc:493] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:12.456990 13212 raft_consensus.cc:493] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:12.493897 11594 raft_consensus.cc:1275] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:12.464509 13313 raft_consensus.cc:697] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 7 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:12.471407 13363 raft_consensus.cc:3060] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:12.526058 13376 consensus_queue.cc:1048] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.093s
I20260709 12:17:12.526659 13318 raft_consensus.cc:1081] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Signalling peer 1c101e338f954ef086338e251deed19d to start an election
I20260709 12:17:12.501194 13373 raft_consensus.cc:3060] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:12.499600 11596 raft_consensus.cc:1275] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:12.494594 13371 raft_consensus.cc:2804] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:12.466008 11598 raft_consensus.cc:2468] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 5.
I20260709 12:17:12.461505 13254 consensus_queue.cc:1048] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:17:12.504387 11526 raft_consensus.cc:2468] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 3.
I20260709 12:17:12.507969 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:12.548251 11525 raft_consensus.cc:2468] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 5.
I20260709 12:17:12.491956 13199 raft_consensus.cc:2749] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:12.492722 13355 raft_consensus.cc:3060] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:12.493274 13362 raft_consensus.cc:493] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:12.493558 13162 raft_consensus.cc:493] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:12.511116 13364 raft_consensus.cc:493] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:12.492259 13381 raft_consensus.cc:515] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:12.495277 13377 consensus_queue.cc:1048] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:17:12.525652 13360 raft_consensus.cc:2804] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:12.525327 13313 consensus_queue.cc:237] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:12.497709 13206 raft_consensus.cc:493] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:12.466275 13353 raft_consensus.cc:515] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
W20260709 12:17:12.550755 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 112181us
I20260709 12:17:12.549860 11493 leader_election.cc:304] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:12.531894 13371 raft_consensus.cc:493] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:12.532408 13351 raft_consensus.cc:493] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:12.547423 13200 raft_consensus.cc:493] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:12.549741 13352 leader_election.cc:290] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:12.497912 13084 consensus_queue.cc:237] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:12.533026 13212 raft_consensus.cc:515] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:12.513641 13171 raft_consensus.cc:515] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
W20260709 12:17:12.572129 13386 log.cc:927] Time spent T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 12:17:12.573305 13297 raft_consensus.cc:993] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8: : Instructing follower b126028166e8480ba25541bf8f7fc6de to start an election
I20260709 12:17:12.573863 13381 leader_election.cc:290] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:12.579659 11493 leader_election.cc:304] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:12.529698 12792 raft_consensus.cc:515] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
W20260709 12:17:12.585549 13382 log.cc:927] Time spent T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 12:17:12.587240 12357 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 814) took 1790 ms. Trace:
I20260709 12:17:12.587541 13368 raft_consensus.cc:515] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:12.590983 13358 raft_consensus.cc:493] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:12.617831 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d43eecbad746fd9ddce50c5b9fc3e8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:12.618847 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:12.592624 13131 leader_election.cc:290] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:12.593204 13251 leader_election.cc:290] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:12.576890 13360 raft_consensus.cc:697] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 5 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:12.603928 13286 raft_consensus.cc:493] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
W20260709 12:17:12.597494 13383 log.cc:927] Time spent T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 12:17:12.561573 13362 raft_consensus.cc:515] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:12.563704 13162 raft_consensus.cc:515] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:12.613982 13377 raft_consensus.cc:1081] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 LEADER]: Signalling peer b126028166e8480ba25541bf8f7fc6de to start an election
I20260709 12:17:12.598815 13200 raft_consensus.cc:515] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:12.619295 11596 raft_consensus.cc:2468] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 5.
I20260709 12:17:12.567171 13364 raft_consensus.cc:515] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:12.635845 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:12.636116 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a841f2f09ced40a4bbf33594e11bd7ad" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:12.637172 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:12.581543 13371 raft_consensus.cc:3060] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:12.578401 13206 raft_consensus.cc:515] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:12.607035 13108 raft_consensus.cc:2749] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:12.627398 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:12.661592 11598 raft_consensus.cc:3060] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:12.596334 13351 raft_consensus.cc:515] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:12.666951 13362 leader_election.cc:290] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:12.641711 11594 raft_consensus.cc:1275] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 2. (term mismatch)
I20260709 12:17:12.668740 11594 pending_rounds.cc:85] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8: Aborting all ops after (but not including) 1
I20260709 12:17:12.669005 11594 pending_rounds.cc:107] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:17:12.669221 11594 raft_consensus.cc:2889] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:12.645136 13206 leader_election.cc:290] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:12.647037 13360 consensus_queue.cc:237] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
W20260709 12:17:12.647707 11417 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.212.132:34973 timed out after 1.936s (SENT) [suppressed 4 similar messages]
I20260709 12:17:12.648996 13171 leader_election.cc:290] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:12.623055 13358 raft_consensus.cc:515] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:12.629912 12757 raft_consensus.cc:493] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:12.651273 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:12.652519 13368 leader_election.cc:290] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:12.658728 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:12.658962 12359 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5"
dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
 from {username='slave'} at 127.0.0.1:51706
I20260709 12:17:12.658728 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:12.659977 12356 raft_consensus.cc:1275] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:12.610539 12357 rpcz_store.cc:276] 0709 12:17:10.797082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:10.856449 (+ 59367us) service_pool.cc:224] Handling call
0709 12:17:12.049338 (+1192889us) spinlock_profiling.cc:243] Waited 7.26 ms on lock 0x7b5800003f98. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb9cfc0 00007f84ebb87929 00007f84ebb873d2 00007f84e50febd4
0709 12:17:12.049592 (+   254us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:12.049970 (+   378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:12.050001 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:12.050588 (+   587us) log.cc:844] Serialized 26 byte log entry
0709 12:17:12.445656 (+395068us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:12.448212 (+  2556us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:12.455124 (+  6912us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:12.586909 (+131785us) raft_consensus.cc:1685] finished
0709 12:17:12.586938 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:12.587172 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1578,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"spinlock_wait_cycles":16696960,"thread_start_us":378450,"threads_started":1,"wal-append.queue_time_us":451220}
I20260709 12:17:12.682902 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:12.684026 13400 raft_consensus.cc:2749] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:12.843333 13212 leader_election.cc:290] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:12.843222 13363 raft_consensus.cc:515] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:12.844185 13353 leader_election.cc:290] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:12.837074 13404 raft_consensus.cc:493] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:12.846871 13363 leader_election.cc:290] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:12.637460 13364 leader_election.cc:290] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:12.687384 11521 raft_consensus.cc:2468] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 6.
I20260709 12:17:12.668187 13351 leader_election.cc:290] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
W20260709 12:17:12.690958 13393 log.cc:927] Time spent T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 12:17:12.842777 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:12.631321 13286 raft_consensus.cc:515] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:12.856122 13355 raft_consensus.cc:515] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:12.684319 13408 raft_consensus.cc:493] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:12.684216 11493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 104612us
I20260709 12:17:12.845230 13404 raft_consensus.cc:515] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:12.870527 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffe47647c274723808482c166efa21c" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:12.687429 13168 raft_consensus.cc:3060] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:12.939136 13286 leader_election.cc:290] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:12.903532 13084 raft_consensus.cc:493] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:12.941993 13084 raft_consensus.cc:515] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:12.942615 13358 leader_election.cc:290] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:12.681936 13296 raft_consensus.cc:493] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:12.944060 13084 leader_election.cc:290] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:12.944015 13296 raft_consensus.cc:515] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:12.946164 13296 leader_election.cc:290] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:12.839179 12359 raft_consensus.cc:493] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:12.948315 12359 raft_consensus.cc:3060] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:12.899313 11527 raft_consensus.cc:2468] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 4.
I20260709 12:17:12.950350 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:12.950932 11527 raft_consensus.cc:2468] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 4.
I20260709 12:17:12.951653 13404 leader_election.cc:290] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:12.952148 11527 raft_consensus.cc:1240] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:17:12.953719 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390e91331fd04f97a5235133a34875ee" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:12.954895 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:12.953132 13200 leader_election.cc:290] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:12.961983 13373 raft_consensus.cc:515] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:12.964362 13373 leader_election.cc:290] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:12.690689 12757 raft_consensus.cc:515] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:12.967978 12757 leader_election.cc:290] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:12.924220 12361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 817) took 2082 ms. Trace:
I20260709 12:17:12.925652 13408 raft_consensus.cc:515] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:12.927279 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:12.928159 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:12.929768 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:12.930213 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:12.930652 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:12.930960 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:12.965075 11598 raft_consensus.cc:2468] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 6.
I20260709 12:17:12.969367 12361 rpcz_store.cc:276] 0709 12:17:10.841930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:10.842886 (+   956us) service_pool.cc:224] Handling call
0709 12:17:12.923964 (+2081078us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b54001464d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:12.924148 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3504026368}
I20260709 12:17:12.670054 13220 raft_consensus.cc:515] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:13.047153 11521 raft_consensus.cc:2468] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 3.
I20260709 12:17:13.056413 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:13.057209 12345 raft_consensus.cc:2468] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 4.
I20260709 12:17:13.058657 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:13.059311 11594 raft_consensus.cc:2376] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1c101e338f954ef086338e251deed19d in term 6. Re-sending same reply.
I20260709 12:17:13.061960 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c355b3902a4e7fb72bac6a91ea3316" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:13.062177 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:13.062748 12356 raft_consensus.cc:3060] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:13.063050 13296 consensus_queue.cc:1048] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:13.064519 13296 consensus_queue.cc:1059] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:17:13.048404 12206 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:13.069067 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:13.052013 13286 raft_consensus.cc:493] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:13.045053 12757 raft_consensus.cc:493] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:13.076887 11519 raft_consensus.cc:2393] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 6: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:17:13.080984 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:12.687182 13319 consensus_queue.cc:1048] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.383s
I20260709 12:17:13.084815 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:13.090988 12356 raft_consensus.cc:2468] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 4.
I20260709 12:17:13.073459 12359 raft_consensus.cc:515] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:13.062862 11598 raft_consensus.cc:2376] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1c101e338f954ef086338e251deed19d in term 4. Re-sending same reply.
I20260709 12:17:13.125417 11446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58868 (request call id 1108) took 2445 ms. Trace:
I20260709 12:17:13.135202 11446 rpcz_store.cc:276] 0709 12:17:10.680020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:10.832638 (+152618us) service_pool.cc:224] Handling call
0709 12:17:13.096799 (+2264161us) spinlock_profiling.cc:243] Waited 1.56 ms on lock 0x7b5800003998. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb9cfc0 00007f84ebb87929 00007f84ebb873d2 00007f84e50febd4
0709 12:17:13.124766 (+ 27967us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:13.125008 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:13.125033 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:13.125077 (+    44us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:13.125107 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:13.125162 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:13.125330 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3587968}
I20260709 12:17:13.045849 13371 raft_consensus.cc:515] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
W20260709 12:17:13.171397 13406 log.cc:927] Time spent T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 12:17:13.173532 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:13.174319 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:17:13.176877 13312 log.cc:927] Time spent T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 2.571s	user 0.044s	sys 0.034s
I20260709 12:17:13.179152 13408 leader_election.cc:290] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:13.183758 13371 leader_election.cc:290] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:13.078400 13286 raft_consensus.cc:515] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:13.186592 13286 leader_election.cc:290] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:13.091523 12757 raft_consensus.cc:515] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:13.189924 12757 leader_election.cc:290] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:13.175572 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:13.193105 12356 raft_consensus.cc:2468] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 4.
I20260709 12:17:13.270902 12359 leader_election.cc:290] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:13.124714 13413 raft_consensus.cc:3055] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:17:13.272432 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 213346us
I20260709 12:17:13.367394 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:13.368263 12356 raft_consensus.cc:2468] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 2.
I20260709 12:17:13.370568 13405 raft_consensus.cc:493] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.371284 13405 raft_consensus.cc:515] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:13.277859 12757 raft_consensus.cc:493] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.373819 12757 raft_consensus.cc:515] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:13.376246 12757 leader_election.cc:290] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:13.378067 13220 leader_election.cc:290] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:13.410135 12348 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 806) took 3036 ms. Trace:
I20260709 12:17:13.410699 12348 rpcz_store.cc:276] 0709 12:17:10.344002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:10.344467 (+   465us) service_pool.cc:224] Handling call
0709 12:17:10.358525 (+ 14058us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:10.439207 (+ 80682us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:10.439242 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:10.439732 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 12:17:10.557162 (+117430us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:10.557211 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:10.557300 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:13.059320 (+2502020us) spinlock_profiling.cc:243] Waited 4.75 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e675e86e 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221 00007f84e67671d9 00007f84e6767169
0709 12:17:13.369822 (+310502us) raft_consensus.cc:1685] finished
0709 12:17:13.369872 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:13.380722 (+ 10850us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":80270,"raft.queue_time_us":82775,"raft.run_cpu_time_us":51,"raft.run_wall_time_us":52,"spinlock_wait_cycles":10934656,"thread_start_us":117014,"threads_started":1,"wal-append.queue_time_us":165464}
I20260709 12:17:13.325222 13319 raft_consensus.cc:493] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.274183 13371 raft_consensus.cc:493] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.325582 13084 raft_consensus.cc:493] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.279228 13413 raft_consensus.cc:740] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
W20260709 12:17:13.465109 13410 log.cc:927] Time spent T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 12:17:13.462340 13405 leader_election.cc:290] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:13.463739 13084 raft_consensus.cc:515] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:13.462750 13371 raft_consensus.cc:515] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:13.472432 13405 raft_consensus.cc:493] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.452056 13319 raft_consensus.cc:515] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:13.481598 13405 raft_consensus.cc:515] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:13.480857 13413 consensus_queue.cc:260] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
W20260709 12:17:13.508594 13168 consensus_meta.cc:287] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8: Time spent flushing consensus metadata: real 0.575s	user 0.009s	sys 0.000s
I20260709 12:17:13.510325 13084 leader_election.cc:290] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:13.513301 13405 leader_election.cc:290] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:13.515627 13413 raft_consensus.cc:3060] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:13.518239 13371 leader_election.cc:290] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:13.520103 13319 leader_election.cc:290] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:13.529029 13355 leader_election.cc:290] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:17:13.568476 11493 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.011s	sys 0.007s
W20260709 12:17:13.569684 11493 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.011s	sys 0.008s
W20260709 12:17:13.569017 11523 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.901s	user 0.017s	sys 0.007s
W20260709 12:17:13.571501 11523 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.903s	user 0.017s	sys 0.008s
I20260709 12:17:13.573411 11523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33456 (request call id 931) took 1006 ms. Trace:
W20260709 12:17:13.574671 12206 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:13.580886 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 295483us
I20260709 12:17:13.582569 13130 raft_consensus.cc:493] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.586680 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:17:13.586302 11493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 520454us
I20260709 12:17:13.586666 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:13.586876 13130 raft_consensus.cc:515] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:13.597082 11598 raft_consensus.cc:2410] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:13.597805 11447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58868 (request call id 1115) took 1744 ms. Trace:
I20260709 12:17:13.598497 11447 rpcz_store.cc:276] 0709 12:17:11.852834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:11.861184 (+  8350us) service_pool.cc:224] Handling call
0709 12:17:11.925792 (+ 64608us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:11.984320 (+ 58528us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:11.987636 (+  3316us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:11.993051 (+  5415us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:12.003771 (+ 10720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:13.597045 (+1593274us) spinlock_profiling.cc:243] Waited 51.5 ms on lock 0x7b5400108454. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:17:13.597145 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:13.597500 (+   355us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":118441728}
I20260709 12:17:13.601430 12348 raft_consensus.cc:2468] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 5.
I20260709 12:17:13.603715 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:13.604817 12356 raft_consensus.cc:2468] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 2.
I20260709 12:17:13.607014 12359 raft_consensus.cc:1275] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:13.607800 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:13.609638 13132 leader_election.cc:290] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:13.607043 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:13.609171 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7937e0cff84ef7a26c84247c8ffc08" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:13.614691 13141 leader_election.cc:290] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:13.574218 11523 rpcz_store.cc:276] 0709 12:17:12.566982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:12.567243 (+   261us) service_pool.cc:224] Handling call
0709 12:17:12.567607 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:12.568084 (+   477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:12.568112 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:12.667350 (+ 99238us) spinlock_profiling.cc:243] Waited 2.83 ms on lock 0x7b2c0019c098. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e54bca11 00007f84e54cc372 00007f84e6bfea01 00007f84e6bc343a 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2
0709 12:17:12.667809 (+   459us) log.cc:844] Serialized 26 byte log entry
0709 12:17:13.572423 (+904614us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:13.572554 (+   131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:13.572711 (+   157us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:13.572820 (+   109us) raft_consensus.cc:1685] finished
0709 12:17:13.572848 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:13.573234 (+   386us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49179,"raft.queue_time_us":33091,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":18250,"spinlock_wait_cycles":6512384,"thread_start_us":903777,"threads_started":1,"wal-append.queue_time_us":808907}
I20260709 12:17:13.621722 13104 leader_election.cc:290] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:13.622964 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:13.622663 13405 consensus_queue.cc:1059] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:13.625455 13413 raft_consensus.cc:3055] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:13.626771 13413 raft_consensus.cc:740] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:13.628630 13413 consensus_queue.cc:260] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:13.624078 13130 leader_election.cc:290] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:13.632386 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:13.636382 13413 raft_consensus.cc:3060] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:13.637833 13328 log.cc:927] Time spent T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 2.704s	user 0.012s	sys 0.039s
I20260709 12:17:13.642838 13319 raft_consensus.cc:493] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.643369 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:13.644321 13168 raft_consensus.cc:493] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.644289 13319 raft_consensus.cc:515] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:13.647374 12348 raft_consensus.cc:2468] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 4.
I20260709 12:17:13.645869 13168 raft_consensus.cc:515] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:13.647660 11593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55250 (request call id 523) took 2956 ms. Trace:
I20260709 12:17:13.654210 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9fe9a94294836aec652338f44367d" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:13.658365 11598 raft_consensus.cc:2468] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 5.
I20260709 12:17:13.656599 13216 raft_consensus.cc:493] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:13.660017 13216 raft_consensus.cc:515] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:13.663125 13216 leader_election.cc:290] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:13.665911 13319 leader_election.cc:290] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:13.666695 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:13.666858 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:17:13.669291 12349 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51690 (request call id 546) took 2780 ms (client timeout 1546 ms). Trace:
I20260709 12:17:13.670122 13168 leader_election.cc:290] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:13.654508 11593 rpcz_store.cc:276] 0709 12:17:10.691536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:10.691696 (+   160us) service_pool.cc:224] Handling call
0709 12:17:10.692063 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:10.715479 (+ 23416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:10.715564 (+    85us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:10.720935 (+  5371us) log.cc:844] Serialized 26 byte log entry
0709 12:17:10.891945 (+171010us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:10.891987 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:10.892053 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:13.636588 (+2744535us) spinlock_profiling.cc:243] Waited 8.76 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e675e86e 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221 00007f84e67671d9 00007f84e6767169
0709 12:17:13.646320 (+  9732us) raft_consensus.cc:1685] finished
0709 12:17:13.646341 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:13.647412 (+  1071us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22970,"raft.queue_time_us":25794,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":2827,"spinlock_wait_cycles":20140928,"thread_start_us":148765,"threads_started":1,"wal-append.queue_time_us":176924}
I20260709 12:17:13.671721 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:13.673447 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:13.674937 13091 raft_consensus.cc:493] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:13.675686 13091 raft_consensus.cc:3060] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:13.676311 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:17:13.669706 12349 rpcz_store.cc:269] 0709 12:17:10.889670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:10.889911 (+   241us) service_pool.cc:224] Handling call
0709 12:17:13.657302 (+2767391us) spinlock_profiling.cc:243] Waited 4.4 ms on lock 0x7b5800003f98. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb890a0 00007f84ebb88984 00007f84e51036d4 00007f84e5103662
0709 12:17:13.669143 (+ 11841us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10125696}
I20260709 12:17:13.680608 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:13.682956 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:13.683398 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ed4eeff0ae44d0bc1ebb8cbe3adea5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:13.684300 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:13.683396 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:13.683908 11599 raft_consensus.cc:2468] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 7.
I20260709 12:17:13.687153 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:13.687565 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c355b3902a4e7fb72bac6a91ea3316" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:13.688467 11597 raft_consensus.cc:3060] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:13.688591 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:13.689563 11599 raft_consensus.cc:2468] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 5.
I20260709 12:17:13.689999 12359 raft_consensus.cc:2468] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 5.
I20260709 12:17:13.691347 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:13.692384 12356 raft_consensus.cc:2468] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 6.
I20260709 12:17:13.698428 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:13.699925 12349 raft_consensus.cc:2393] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 6: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:17:13.683029 12357 raft_consensus.cc:2393] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 5: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:17:13.705745 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d43eecbad746fd9ddce50c5b9fc3e8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:13.706957 12349 raft_consensus.cc:2468] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 4.
I20260709 12:17:13.702597 11519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33456 (request call id 918) took 1510 ms. Trace:
I20260709 12:17:13.711294 11520 raft_consensus.cc:1240] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:13.711963 13350 leader_election.cc:290] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:13.712262 13400 raft_consensus.cc:493] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:13.715232 13400 raft_consensus.cc:515] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:13.715850 13345 raft_consensus.cc:2749] T da8741606df54c3f8b5cc5c1141862ea P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:13.718396 13400 leader_election.cc:290] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:13.709959 11519 rpcz_store.cc:276] 0709 12:17:12.191825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:12.191962 (+   137us) service_pool.cc:224] Handling call
0709 12:17:13.702031 (+1510069us) spinlock_profiling.cc:243] Waited 844 ms on lock 0x7b54003b7c54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:13.702335 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1941998336}
W20260709 12:17:13.721251 11452 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58856 (request call id 543) took 1863 ms (client timeout 1539 ms). Trace:
W20260709 12:17:13.721779 11452 rpcz_store.cc:269] 0709 12:17:11.846900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:11.847964 (+  1064us) service_pool.cc:224] Handling call
0709 12:17:13.697126 (+1849162us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b54001aa754. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:13.710127 (+ 13001us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":458175744}
I20260709 12:17:13.727878 13346 consensus_queue.cc:1048] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:17:13.729785 11417 leader_election.cc:304] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:17:13.732313 11596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 689) took 1107 ms. Trace:
I20260709 12:17:13.726895 13199 consensus_queue.cc:1048] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 12:17:13.743312 11451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35814 (request call id 227) took 1556 ms. Trace:
I20260709 12:17:13.747578 11451 rpcz_store.cc:276] 0709 12:17:12.186390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:12.186504 (+   114us) service_pool.cc:224] Handling call
0709 12:17:12.258123 (+ 71619us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:12.369242 (+111119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:13.742832 (+1373590us) spinlock_profiling.cc:243] Waited 71.3 ms on lock 0x7b54000baed0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc28ad 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:13.743114 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":164028288}
I20260709 12:17:13.744549 11596 rpcz_store.cc:276] 0709 12:17:12.624470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:12.637240 (+ 12770us) service_pool.cc:224] Handling call
0709 12:17:12.637567 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:12.643238 (+  5671us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:12.643267 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:12.660171 (+ 16904us) log.cc:844] Serialized 26 byte log entry
0709 12:17:12.995195 (+335024us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:13.731197 (+736002us) log.cc:844] Serialized 14 byte log entry
0709 12:17:13.731694 (+   497us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:13.731823 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:13.731903 (+    80us) raft_consensus.cc:1685] finished
0709 12:17:13.731918 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:13.732091 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":736980,"prepare.queue_time_us":739336,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":16998,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":252,"thread_start_us":334702,"threads_started":1,"wal-append.queue_time_us":471838}
I20260709 12:17:13.749464 13298 raft_consensus.cc:493] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:13.750473 13298 raft_consensus.cc:515] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
W20260709 12:17:13.751353 11453 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35814 (request call id 223) took 2867 ms (client timeout 1630 ms). Trace:
I20260709 12:17:13.743830 11597 raft_consensus.cc:2468] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 4.
I20260709 12:17:13.749716 13199 raft_consensus.cc:2804] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:17:13.751852 11453 rpcz_store.cc:269] 0709 12:17:10.884083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:10.908007 (+ 23924us) service_pool.cc:224] Handling call
0709 12:17:13.750871 (+2842864us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54001aa254. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:13.751132 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2926628736}
I20260709 12:17:13.766462 13117 raft_consensus.cc:493] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:13.767329 13117 raft_consensus.cc:515] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:13.771589 11519 raft_consensus.cc:1275] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:13.772086 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:13.773159 11523 raft_consensus.cc:2393] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 5: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:17:13.773651 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390e91331fd04f97a5235133a34875ee" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:13.766305 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7937e0cff84ef7a26c84247c8ffc08" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:17:13.775914 11595 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 677) took 1505 ms (client timeout 1653 ms). Trace:
W20260709 12:17:13.776363 11595 rpcz_store.cc:269] 0709 12:17:12.270041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:12.333109 (+ 63068us) service_pool.cc:224] Handling call
0709 12:17:13.765843 (+1432734us) spinlock_profiling.cc:243] Waited 1.69 ms on lock 0x7b5800220b98. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb890a0 00007f84ebb88984 00007f84e51036d4 00007f84e5103662
0709 12:17:13.775827 (+  9984us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3890432}
I20260709 12:17:13.777303 11522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33446 (request call id 1079) took 1625 ms. Trace:
I20260709 12:17:13.774681 11527 raft_consensus.cc:2468] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 3.
I20260709 12:17:13.779928 13117 leader_election.cc:290] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:13.780504 13298 leader_election.cc:290] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:13.753247 13199 raft_consensus.cc:493] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:13.785220 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:13.785583 13162 leader_election.cc:290] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:13.787448 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:13.788367 11521 raft_consensus.cc:3060] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:13.777833 11522 rpcz_store.cc:276] 0709 12:17:12.151578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:12.151697 (+   119us) service_pool.cc:224] Handling call
0709 12:17:12.152005 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:12.152380 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:12.152408 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:12.152917 (+   509us) log.cc:844] Serialized 26 byte log entry
0709 12:17:13.705626 (+1552709us) spinlock_profiling.cc:243] Waited 6.85 ms on lock 0x7b1800329620. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3ab8e07 00007f84ec9139a9 00007f84e3ad569b 00007f84e3ad393f 00007f84e3ad5c02 00007f84e675d20b 00007f84e6762d23 00007f84e67630d1 00007f84e6b7ea0f
0709 12:17:13.715404 (+  9778us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:13.715472 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:13.723721 (+  8249us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:13.760729 (+ 37008us) raft_consensus.cc:1685] finished
0709 12:17:13.760746 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:13.777040 (+ 16294us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":759,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":15371,"spinlock_wait_cycles":15749504,"thread_start_us":9019,"threads_started":1,"wal-append.queue_time_us":1586691}
I20260709 12:17:13.783536 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:13.782291 11595 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "1c101e338f954ef086338e251deed19d"
 from {username='slave'} at 127.0.0.1:37992
I20260709 12:17:13.782287 13199 raft_consensus.cc:3060] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:13.803097 12792 leader_election.cc:290] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:13.806927 11595 raft_consensus.cc:606] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Received request to transfer leadership to TS 1c101e338f954ef086338e251deed19d
I20260709 12:17:13.808128 11595 raft_consensus.cc:614] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:13.809228 11601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40784 (request call id 229) took 2204 ms. Trace:
I20260709 12:17:13.809722 11601 rpcz_store.cc:276] 0709 12:17:11.604731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:11.604885 (+   154us) service_pool.cc:224] Handling call
0709 12:17:11.868094 (+263209us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:11.868728 (+   634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:13.808807 (+1940079us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54003115d0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc28ad 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:13.809062 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":276982656}
I20260709 12:17:13.774719 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:13.817526 11601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "b126028166e8480ba25541bf8f7fc6de"
 from {username='slave'} at 127.0.0.1:37992
I20260709 12:17:13.818266 11601 raft_consensus.cc:606] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 LEADER]: Received request to transfer leadership to TS b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:13.820469  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:17:13.793289 13223 leader_election.cc:290] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:13.826298 11527 raft_consensus.cc:3060] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:13.805367 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:13.830147 11519 raft_consensus.cc:2468] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 7.
I20260709 12:17:13.831676 11525 raft_consensus.cc:2468] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 4.
W20260709 12:17:13.834121 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 82905.1us
I20260709 12:17:13.838032 13091 raft_consensus.cc:515] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:13.838378 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:13.844395 11595 raft_consensus.cc:3055] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:13.844935 11595 raft_consensus.cc:740] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:13.846109 11595 consensus_queue.cc:260] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:13.847396 11595 raft_consensus.cc:3060] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:13.839860 12792 raft_consensus.cc:493] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.858812 11417 leader_election.cc:304] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:13.860237 13190 raft_consensus.cc:2749] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:13.866139 12349 raft_consensus.cc:1275] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:13.867254 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:13.868250 11451 raft_consensus.cc:2368] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de for earlier term 3. Current term is 4.
I20260709 12:17:13.869230 12361 raft_consensus.cc:1275] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:13.853926 12792 raft_consensus.cc:515] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:13.867312 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffe47647c274723808482c166efa21c" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:13.871042 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:13.872696 11527 raft_consensus.cc:2468] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 4.
I20260709 12:17:13.873237 12357 raft_consensus.cc:2468] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 2.
I20260709 12:17:13.874128 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:13.874349 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:13.874498 13084 raft_consensus.cc:493] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:13.875003 12359 raft_consensus.cc:2468] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 7.
I20260709 12:17:13.875497 13084 raft_consensus.cc:515] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:13.885452 13084 leader_election.cc:290] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:13.885726 11491 leader_election.cc:304] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:13.886010 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:13.887092 11491 leader_election.cc:304] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
W20260709 12:17:13.887606 11445 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58856 (request call id 551) took 1663 ms (client timeout 1800 ms). Trace:
I20260709 12:17:13.891217 11521 raft_consensus.cc:2468] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 5.
I20260709 12:17:13.897302 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:13.898775 11519 raft_consensus.cc:2410] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:13.876075 13317 raft_consensus.cc:493] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.901736 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:13.902245 13317 raft_consensus.cc:515] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:13.903280 13220 raft_consensus.cc:2804] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:13.903951 13220 raft_consensus.cc:697] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [term 4 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:13.906108 13317 leader_election.cc:290] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:13.902665 13084 raft_consensus.cc:2804] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:13.906912 13084 raft_consensus.cc:493] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:13.907364 13084 raft_consensus.cc:3060] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:13.901767 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:13.876382 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:13.910977 12352 raft_consensus.cc:3060] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Advancing to term 4
W20260709 12:17:13.888096 11445 rpcz_store.cc:269] 0709 12:17:12.224218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:12.224769 (+   551us) service_pool.cc:224] Handling call
0709 12:17:13.887240 (+1662471us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b54000a5354. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:13.887435 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":236377344}
I20260709 12:17:13.914813 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:13.918916 12792 leader_election.cc:290] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:13.919665 11527 raft_consensus.cc:2393] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 5: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:17:13.922122 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:13.927404 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:13.926029 13301 raft_consensus.cc:493] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:13.929026 13190 raft_consensus.cc:493] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.928694 13301 raft_consensus.cc:515] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:13.929618 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e4724ed93a467ea47763eec9a6de2e" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:13.929840 13190 raft_consensus.cc:515] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:13.931246 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:13.932107 13301 leader_election.cc:290] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:13.932544 13190 leader_election.cc:290] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:13.937795  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:13.939097  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:13.916177 13220 consensus_queue.cc:237] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:13.944765 11493 leader_election.cc:304] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:13.927263 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:13.949805 11598 raft_consensus.cc:2468] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 5.
I20260709 12:17:13.933736 11600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40784 (request call id 224) took 3007 ms. Trace:
I20260709 12:17:13.950841 11600 rpcz_store.cc:276] 0709 12:17:10.926165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:10.926319 (+   154us) service_pool.cc:224] Handling call
0709 12:17:10.926636 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:11.604026 (+677390us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:13.933193 (+2329167us) spinlock_profiling.cc:243] Waited 673 ms on lock 0x7b54005bc054. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:17:13.933539 (+   346us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1546876288}
I20260709 12:17:13.951406 11493 leader_election.cc:304] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d
I20260709 12:17:13.933466 11418 leader_election.cc:304] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:13.953490 13380 raft_consensus.cc:2804] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:13.954017 13380 raft_consensus.cc:493] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:13.929689 11525 raft_consensus.cc:2410] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:13.935057 11520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38272 (request call id 267) took 1338 ms. Trace:
I20260709 12:17:13.936853 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:13.929910 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:13.949895 11451 raft_consensus.cc:2468] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 7.
I20260709 12:17:13.950030 13353 raft_consensus.cc:2749] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:13.955075 11594 raft_consensus.cc:2468] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 5.
I20260709 12:17:13.954515 13190 raft_consensus.cc:2804] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:13.955801 13190 raft_consensus.cc:493] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:13.956271 13190 raft_consensus.cc:3060] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:13.934206 11602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 678) took 1663 ms (client timeout 1734 ms). Trace:
W20260709 12:17:13.956867 11602 rpcz_store.cc:269] 0709 12:17:12.270316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:12.332575 (+ 62259us) service_pool.cc:224] Handling call
0709 12:17:13.927061 (+1594486us) spinlock_profiling.cc:243] Waited 2.19 ms on lock 0x7b5800220b98. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb890a0 00007f84ebb88984 00007f84e51036d4 00007f84e5103662
0709 12:17:13.934143 (+  7082us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5099264}
I20260709 12:17:13.954690 11520 rpcz_store.cc:276] 0709 12:17:12.596273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:12.994200 (+397927us) service_pool.cc:224] Handling call
0709 12:17:13.710586 (+716386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:13.711913 (+  1327us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:13.934822 (+222909us) spinlock_profiling.cc:243] Waited 648 ms on lock 0x7b54003b7c50. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc28ad 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:13.934972 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1490589568}
I20260709 12:17:13.953696 13162 consensus_queue.cc:1048] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:13.955127 11596 raft_consensus.cc:2393] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 6: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:13.955394 13199 raft_consensus.cc:515] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:13.962756 11520 raft_consensus.cc:1275] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:13.963696 13199 leader_election.cc:290] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:13.964552 13162 raft_consensus.cc:493] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.988224 13162 raft_consensus.cc:515] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:13.989776 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:13.990756 13162 leader_election.cc:290] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:13.991981 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:13.992920 11453 raft_consensus.cc:1275] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:13.993556 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:13.994040 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:13.994338 11448 raft_consensus.cc:2468] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 6.
I20260709 12:17:13.991225 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:13.996258 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:13.996811 11451 raft_consensus.cc:2393] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 6: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:13.997522 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:13.993708 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d43eecbad746fd9ddce50c5b9fc3e8" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:13.991899 11445 raft_consensus.cc:1240] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:13.985622 11275 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57426 (request call id 164) took 6506 ms. Trace:
W20260709 12:17:13.953564 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 63101.4us
W20260709 12:17:13.995550 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 62654.3us
I20260709 12:17:13.993698 13117 raft_consensus.cc:493] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:14.002295 11520 raft_consensus.cc:1240] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 6 LEADER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:17:13.999946 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:14.002960 11600 raft_consensus.cc:2468] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 4.
I20260709 12:17:14.000362 11275 rpcz_store.cc:276] 0709 12:17:07.478916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:07.485121 (+  6205us) service_pool.cc:224] Handling call
0709 12:17:07.827811 (+342690us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b5400a1dbd4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2d090 00007f84e6bcbf3a 00007f84ec981e9c 00007f84eca8004e 00007f84eaf412a4 00007f84eaf41232 00007f84eaf41161 00007f84eaf410dc 00007f84eaf40392 00007f84e4efe48c 00007f84e4efd8c6
0709 12:17:13.985312 (+6157501us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:10.749845 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:10.750461 (+   616us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:10.750505 (+    44us) write_op.cc:435] Acquired schema lock
0709 12:17:10.750525 (+    20us) tablet.cc:662] Decoding operations
0709 12:17:10.751376 (+   851us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:10.751465 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:10.751495 (+    30us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:17:10.752071 (+   576us) tablet.cc:701] Row locks acquired
0709 12:17:10.752092 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:17:10.752255 (+   163us) write_op.cc:270] Start()
0709 12:17:10.752392 (+   137us) write_op.cc:276] Timestamp: P: 1783599430752199 usec, L: 0
0709 12:17:10.752416 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:17:10.753360 (+   944us) log.cc:844] Serialized 2481 byte log entry
0709 12:17:11.262829 (+509469us) op_driver.cc:464] REPLICATION: finished
0709 12:17:12.088328 (+825499us) write_op.cc:301] APPLY: starting
0709 12:17:12.088420 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:12.088588 (+   168us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:12.088739 (+   151us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:12.115651 (+ 26912us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:12.132423 (+ 16772us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:17:12.134459 (+  2036us) write_op.cc:312] APPLY: finished
0709 12:17:12.155270 (+ 20811us) log.cc:844] Serialized 52 byte log entry
0709 12:17:12.465665 (+310395us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:12.486569 (+ 20904us) write_op.cc:454] Released schema lock
0709 12:17:12.491412 (+  4843us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:12.511051 (+ 19639us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:12.511096 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1414495,"reported_tablets":19,"spinlock_wait_cycles":355231488,"child_traces":[["op",{"apply.queue_time_us":822968,"apply.run_cpu_time_us":22997,"apply.run_wall_time_us":411136,"num_ops":6,"prepare.queue_time_us":104544,"prepare.run_cpu_time_us":18845,"prepare.run_wall_time_us":214588,"raft.queue_time_us":187816,"raft.run_cpu_time_us":8598,"raft.run_wall_time_us":904079,"replication_time_us":467590,"thread_start_us":1272880,"threads_started":5,"wal-append.queue_time_us":523273,"wal-append.run_cpu_time_us":9407,"wal-append.run_wall_time_us":2092886}]]}
I20260709 12:17:14.002007 13117 raft_consensus.cc:515] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:14.008985 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:13.995488 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:13.954447 13380 raft_consensus.cc:3060] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:13.993165 11418 leader_election.cc:304] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:14.005692 11417 leader_election.cc:304] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:17:14.009867 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:14.017661 12352 raft_consensus.cc:2468] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 4.
I20260709 12:17:14.022819 11595 raft_consensus.cc:1275] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:17:14.023296 11595 pending_rounds.cc:85] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8: Aborting all ops after (but not including) 2
W20260709 12:17:14.030660 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 106195us
I20260709 12:17:14.023514 11595 pending_rounds.cc:107] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:17:14.031783 11595 raft_consensus.cc:2889] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:14.030014 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:14.010121 13190 raft_consensus.cc:515] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:14.034837 12204 leader_election.cc:304] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:14.035542 11520 raft_consensus.cc:3060] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:14.036092 13341 raft_consensus.cc:2804] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:14.036252 13190 leader_election.cc:290] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:14.036599 13341 raft_consensus.cc:493] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:14.033048 11600 raft_consensus.cc:2468] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 7.
I20260709 12:17:14.037037 13341 raft_consensus.cc:3060] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:14.038329 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 45288.2us
I20260709 12:17:14.039736 13355 raft_consensus.cc:2804] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:14.040179 13355 raft_consensus.cc:493] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:14.040580 13355 raft_consensus.cc:3060] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:14.049721 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9fe9a94294836aec652338f44367d" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:14.025511 13091 leader_election.cc:290] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:14.009892 13317 consensus_queue.cc:1048] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:17:14.054658 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:17:14.044838 12206 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:14.057153 11600 raft_consensus.cc:2468] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 7.
I20260709 12:17:14.062038 11418 leader_election.cc:304] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:14.066673 13371 raft_consensus.cc:2804] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:14.053795 13147 consensus_queue.cc:1059] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:17:14.072618 11274 catalog_manager.cc:5697] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 3 to 5, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 5 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } }
I20260709 12:17:14.047829 13162 consensus_queue.cc:1048] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:17:14.080399 13301 raft_consensus.cc:3060] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:14.089330 11493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 117383us
I20260709 12:17:14.073727 13353 raft_consensus.cc:493] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:14.092660 11600 raft_consensus.cc:1240] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:14.080694 13371 raft_consensus.cc:697] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 6 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:14.104941 12204 leader_election.cc:304] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:14.107231 11526 raft_consensus.cc:1240] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 4. Current term is 5. Ops: [3.2-4.3]
I20260709 12:17:14.096449 11274 catalog_manager.cc:5697] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 4 to 5, leader changed from 1c101e338f954ef086338e251deed19d (127.3.212.130) to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 5 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } }
W20260709 12:17:14.109704 11566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:14.110895 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 54957us
I20260709 12:17:14.116367 13084 raft_consensus.cc:515] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
W20260709 12:17:14.116914 12204 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:14.117668 13289 raft_consensus.cc:2764] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:17:14.117359 11520 raft_consensus.cc:2468] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 6.
I20260709 12:17:14.120568 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:14.121594 12352 raft_consensus.cc:2468] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 6.
I20260709 12:17:14.127923 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:14.128185 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:14.129494 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:14.130887 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:14.133104 11567 leader_election.cc:304] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:14.134624 11567 leader_election.cc:304] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:14.134951 13140 consensus_queue.cc:1048] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:14.135442 13091 raft_consensus.cc:2804] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:14.135916 13091 raft_consensus.cc:493] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:14.136303 13091 raft_consensus.cc:3060] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:14.137509 13356 raft_consensus.cc:493] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:14.138199 13356 raft_consensus.cc:515] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:14.139724 11453 raft_consensus.cc:1240] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:17:14.141142 11449 raft_consensus.cc:1240] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:17:14.141495 13408 raft_consensus.cc:3055] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:14.141950 13408 raft_consensus.cc:740] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:14.142904 13408 consensus_queue.cc:260] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:14.143283 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:14.144272 13408 raft_consensus.cc:3060] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:14.144538 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:17:14.145920 12206 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:14.146025 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:14.146798 11523 raft_consensus.cc:2468] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 3.
W20260709 12:17:14.147858 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 68227.7us
I20260709 12:17:14.148718 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:14.148958 11419 leader_election.cc:304] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:14.150413 13204 raft_consensus.cc:493] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:14.148969 13371 consensus_queue.cc:237] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:14.151023 13204 raft_consensus.cc:515] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
W20260709 12:17:14.146271 13429 log.cc:927] Time spent T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:17:14.153432 11524 raft_consensus.cc:2468] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 5.
I20260709 12:17:14.155857 11526 raft_consensus.cc:1275] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:17:14.158110 12203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:14.158991 12203 connection.cc:256] RPC call timeout handler was delayed by -1.5132594649999191s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.163s for a response
I20260709 12:17:14.160868 13140 raft_consensus.cc:2804] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:14.105650 13353 raft_consensus.cc:515] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:14.140851 13356 leader_election.cc:290] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:14.163470 13084 leader_election.cc:290] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:14.132412 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:14.165349 13190 consensus_queue.cc:1048] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:14.165446 11599 raft_consensus.cc:2468] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 4.
I20260709 12:17:14.153177 11274 catalog_manager.cc:5697] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:14.184095 11418 leader_election.cc:304] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:14.187220 11491 leader_election.cc:304] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:14.147086 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:14.190832 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:17:14.201197 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 107909us
I20260709 12:17:14.205154 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:14.207638 11520 raft_consensus.cc:1275] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:14.211506 11524 raft_consensus.cc:2393] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 6: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
W20260709 12:17:14.211505 11493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 110570us
I20260709 12:17:14.196666 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:14.193353 11274 catalog_manager.cc:5697] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:14.189144 13117 leader_election.cc:290] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:14.185609 13130 raft_consensus.cc:2749] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:14.224177 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d43eecbad746fd9ddce50c5b9fc3e8" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:14.166412 13091 raft_consensus.cc:515] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
W20260709 12:17:14.226881 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 78073us
I20260709 12:17:14.221150 13319 raft_consensus.cc:993] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8: : Instructing follower b126028166e8480ba25541bf8f7fc6de to start an election
I20260709 12:17:14.216398 11274 catalog_manager.cc:5697] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 4 to 5, leader changed from 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132) to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 5 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:14.234579 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 66844us
I20260709 12:17:14.234978 11526 raft_consensus.cc:2410] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:17:14.205053 13190 raft_consensus.cc:2804] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:14.244993 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:14.248492 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:14.241451 11274 catalog_manager.cc:5697] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:14.248560 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:14.258369 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:14.260756 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ed4eeff0ae44d0bc1ebb8cbe3adea5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:14.259127 11528 raft_consensus.cc:2468] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 5.
I20260709 12:17:14.234477 13117 raft_consensus.cc:493] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:14.261487 12345 raft_consensus.cc:2468] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 3.
I20260709 12:17:14.239292 13190 raft_consensus.cc:493] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:14.271948 11419 leader_election.cc:304] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:14.272953 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:14.249157 13317 raft_consensus.cc:1081] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 LEADER]: Signalling peer b126028166e8480ba25541bf8f7fc6de to start an election
I20260709 12:17:14.277849 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
W20260709 12:17:14.281576 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 113184us
I20260709 12:17:14.281906 13117 raft_consensus.cc:515] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:14.284339 13117 leader_election.cc:290] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:14.285751 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7937e0cff84ef7a26c84247c8ffc08" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:17:14.286374 13428 log.cc:927] Time spent T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 12:17:14.272563 13190 raft_consensus.cc:3060] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:14.287269 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:14.287889 11602 raft_consensus.cc:3060] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:14.289253 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:14.286792 11594 raft_consensus.cc:1240] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 4. Current term is 5. Ops: []
W20260709 12:17:14.277597 13431 log.cc:927] Time spent T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:17:14.290592 11418 leader_election.cc:304] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:14.293677 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:14.299620 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:14.299969 11525 raft_consensus.cc:1240] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:14.302656 11595 raft_consensus.cc:3055] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:14.303077 11595 raft_consensus.cc:740] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:14.298799 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:14.304064 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:14.274441 13353 leader_election.cc:290] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:14.306877 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:14.290807 13199 consensus_queue.cc:1048] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:17:14.289572 13091 leader_election.cc:290] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:14.309684 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:17:14.310842 11568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:14.312610 13204 leader_election.cc:290] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:14.290170 13201 raft_consensus.cc:2804] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:14.313944 13201 raft_consensus.cc:697] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 6 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:14.314081 12349 raft_consensus.cc:3055] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:14.314442 12349 raft_consensus.cc:740] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:14.314925 13201 consensus_queue.cc:237] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:14.315234 12349 consensus_queue.cc:260] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:14.316155 12349 raft_consensus.cc:3060] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:14.307618 11600 raft_consensus.cc:2468] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 5.
I20260709 12:17:14.318778 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
W20260709 12:17:14.319317 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 51454.9us
I20260709 12:17:14.321043 11418 leader_election.cc:304] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:14.303417 11596 raft_consensus.cc:2468] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 5.
I20260709 12:17:14.271142 11274 catalog_manager.cc:5697] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 2 to 4, leader changed from a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131) to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 4 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:14.285646 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:14.333712 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:14.334354 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:14.314862 13301 raft_consensus.cc:2749] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:14.345342 13346 raft_consensus.cc:2804] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:14.345888 13346 raft_consensus.cc:493] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:14.346232 13346 raft_consensus.cc:3060] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:14.349726 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:14.350557 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:14.350791 13355 raft_consensus.cc:515] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:14.351872 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:14.352982 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:14.354384 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:14.302495 12792 raft_consensus.cc:2749] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:17:14.364658 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 67314.7us
I20260709 12:17:14.367220 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:14.368790 11418 leader_election.cc:304] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:14.359094 11274 catalog_manager.cc:5697] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 2 to 4, leader changed from a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131) to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 4 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:14.327630 13199 raft_consensus.cc:2804] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:14.372661 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:14.352962 13355 leader_election.cc:290] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
W20260709 12:17:14.384442 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 50974.2us
I20260709 12:17:14.386916 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:14.387699 11528 raft_consensus.cc:2393] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 6: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:17:14.387943 13286 consensus_queue.cc:1059] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.098s
I20260709 12:17:14.388556 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
W20260709 12:17:14.388918 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 121213us
I20260709 12:17:14.389205 13162 raft_consensus.cc:2804] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:14.389866 11419 leader_election.cc:304] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:14.393813 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:14.395447 11595 consensus_queue.cc:260] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:14.385442 11417 leader_election.cc:304] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:14.396677 11418 leader_election.cc:304] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:14.387756 11526 raft_consensus.cc:1275] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:14.374044 11274 catalog_manager.cc:5697] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } }
I20260709 12:17:14.414137 11274 catalog_manager.cc:5697] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } }
I20260709 12:17:14.411101 11491 leader_election.cc:304] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:14.416024 11274 catalog_manager.cc:5697] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 5 to 6, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131). New cstate: current_term: 6 leader_uuid: "a03223e9e41247c3a36b7b7c3d476671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } }
I20260709 12:17:14.377826 13199 raft_consensus.cc:493] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:14.417932 11274 catalog_manager.cc:5697] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:14.425101 11274 catalog_manager.cc:5697] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 4 to 6, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131). New cstate: current_term: 6 leader_uuid: "a03223e9e41247c3a36b7b7c3d476671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } }
I20260709 12:17:14.428706 11594 raft_consensus.cc:1275] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:17:14.434698 11493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 131819us
I20260709 12:17:14.435395 11567 leader_election.cc:304] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:14.436482 11567 leader_election.cc:304] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
W20260709 12:17:14.428424 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 51612.4us
I20260709 12:17:14.440349 13084 raft_consensus.cc:2749] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:14.426853 11274 catalog_manager.cc:5697] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 4 to 5, leader changed from a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131) to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 5 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:14.445415 11491 leader_election.cc:304] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:14.443895 11493 leader_election.cc:304] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
W20260709 12:17:14.449697 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 69095.2us
I20260709 12:17:14.450551 11417 leader_election.cc:304] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:14.442597 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffe47647c274723808482c166efa21c" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:14.452654 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:14.452105 11274 catalog_manager.cc:5697] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:14.422786 13199 raft_consensus.cc:3060] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:14.458413 12347 raft_consensus.cc:3060] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:14.458642 11418 leader_election.cc:304] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:14.459589 13140 raft_consensus.cc:493] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:14.460012 12361 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5"
dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
 from {username='slave'} at 127.0.0.1:51706
I20260709 12:17:14.460134 13140 raft_consensus.cc:3060] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:14.460110 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 70334.9us
I20260709 12:17:14.428798 13301 raft_consensus.cc:2749] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:14.461701 11595 raft_consensus.cc:3060] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:14.444592 13317 raft_consensus.cc:2804] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:14.470275 11274 catalog_manager.cc:5697] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } }
I20260709 12:17:14.449266 13355 raft_consensus.cc:2749] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:14.480334 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:14.481554 12349 raft_consensus.cc:1275] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:17:14.482048 12349 pending_rounds.cc:85] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de: Aborting all ops after (but not including) 4
I20260709 12:17:14.473867 11491 leader_election.cc:304] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:14.482306 12349 pending_rounds.cc:107] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:17:14.483028 12349 raft_consensus.cc:2889] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:14.493767 11418 leader_election.cc:304] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:14.468791 13353 raft_consensus.cc:2804] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:14.528486 13353 raft_consensus.cc:493] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:14.528906 13353 raft_consensus.cc:3060] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:14.530417 13414 log.cc:927] Time spent T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 12:17:14.532505 11493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 96586.5us
I20260709 12:17:14.533617 11493 leader_election.cc:304] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:14.534073 13287 consensus_queue.cc:1048] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:14.534466 13084 raft_consensus.cc:2804] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:14.534931 13084 raft_consensus.cc:493] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:14.535285 13084 raft_consensus.cc:3060] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:14.536803 13301 raft_consensus.cc:493] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:14.537467 13301 raft_consensus.cc:515] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:14.534106 12204 leader_election.cc:304] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:14.506790 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ed4eeff0ae44d0bc1ebb8cbe3adea5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:14.511480 12203 leader_election.cc:304] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:14.512259 13204 consensus_queue.cc:1059] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:14.513293 11595 raft_consensus.cc:2468] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 6.
I20260709 12:17:14.514605 13220 raft_consensus.cc:2804] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:17:14.515379 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 52972.1us
I20260709 12:17:14.475447 13223 raft_consensus.cc:2749] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:14.503947 11274 catalog_manager.cc:5697] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 3 to 4, leader changed from 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132) to a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131). New cstate: current_term: 4 leader_uuid: "a03223e9e41247c3a36b7b7c3d476671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } }
I20260709 12:17:14.520272 13352 raft_consensus.cc:2804] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:14.472820 13317 raft_consensus.cc:493] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:14.521541 13355 raft_consensus.cc:493] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:14.523911 11419 leader_election.cc:304] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:14.524395 13373 raft_consensus.cc:2804] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:14.574288 11491 leader_election.cc:304] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:14.524776 13310 raft_consensus.cc:2804] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:14.526849 12347 raft_consensus.cc:2468] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 5.
I20260709 12:17:14.524703 13341 raft_consensus.cc:515] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:14.485927 13162 raft_consensus.cc:697] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 4 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:14.570725 11274 catalog_manager.cc:5697] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 2 to 3, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 3 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } }
I20260709 12:17:14.487084 12792 raft_consensus.cc:2804] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:14.578109 12356 raft_consensus.cc:3055] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:14.490063 13371 raft_consensus.cc:2749] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:14.578337 13373 raft_consensus.cc:493] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:14.582701 13287 raft_consensus.cc:2749] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:14.589728 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:14.590026 13373 raft_consensus.cc:3060] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:14.584677 12356 raft_consensus.cc:740] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
W20260709 12:17:14.591089 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 79705us
I20260709 12:17:14.586694 13204 raft_consensus.cc:2749] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:14.591122 12356 consensus_queue.cc:260] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:14.593197 13356 raft_consensus.cc:3055] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:14.593673 13356 raft_consensus.cc:740] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:14.594614 13356 consensus_queue.cc:260] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:14.550586 13220 raft_consensus.cc:493] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:14.490959 13190 raft_consensus.cc:515] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:14.592396 12203 leader_election.cc:304] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
W20260709 12:17:14.593674 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 59672.5us
I20260709 12:17:14.600666 11602 raft_consensus.cc:2468] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 6.
I20260709 12:17:14.593513 12356 raft_consensus.cc:3060] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:14.566272 13317 raft_consensus.cc:3060] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:14.601192 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 148844us
I20260709 12:17:14.600142 11274 catalog_manager.cc:5697] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 1 to 5, leader changed from 1c101e338f954ef086338e251deed19d (127.3.212.130) to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 5 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:14.575402 13301 leader_election.cc:290] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:14.578544 13310 raft_consensus.cc:493] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
W20260709 12:17:14.615808 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 92023us
I20260709 12:17:14.618013 11567 leader_election.cc:304] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:14.615960 12359 raft_consensus.cc:2393] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 5: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:17:14.617847 12361 raft_consensus.cc:493] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:14.595180 11598 raft_consensus.cc:2468] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 5.
I20260709 12:17:14.625896 12361 raft_consensus.cc:3060] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:14.604070 13220 raft_consensus.cc:3060] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:14.597847 12792 raft_consensus.cc:493] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
W20260709 12:17:14.642670 11568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:14.563691 13346 raft_consensus.cc:515] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:14.585949 13355 raft_consensus.cc:515] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
W20260709 12:17:14.615281 13380 consensus_meta.cc:287] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671: Time spent flushing consensus metadata: real 0.563s	user 0.008s	sys 0.004s
I20260709 12:17:14.631822 11419 leader_election.cc:304] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:14.629719 13310 raft_consensus.cc:3060] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:14.631327 13356 raft_consensus.cc:3060] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:14.678267 12204 leader_election.cc:304] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:14.630862 13385 consensus_queue.cc:1048] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:17:14.652139 12792 raft_consensus.cc:3060] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:14.691993 13201 raft_consensus.cc:493] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:14.692696 13201 raft_consensus.cc:515] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
W20260709 12:17:14.697866 13434 log.cc:927] Time spent T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.472s	user 0.006s	sys 0.000s
I20260709 12:17:14.697714 13286 raft_consensus.cc:2804] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:14.676548 13125 raft_consensus.cc:2749] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:14.674765 13223 raft_consensus.cc:2804] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:14.677943 13301 raft_consensus.cc:2804] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:14.666174 13380 raft_consensus.cc:515] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:14.707631 12349 raft_consensus.cc:1275] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:14.706557 13229 raft_consensus.cc:2804] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:14.711036 13205 raft_consensus.cc:493] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:14.711772 13205 raft_consensus.cc:515] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
W20260709 12:17:14.713882 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 121618us
I20260709 12:17:14.716754 12203 leader_election.cc:400] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Vote denied by peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579) with higher term. Message: Invalid argument: T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de for earlier term 3. Current term is 4.
I20260709 12:17:14.718284 13341 leader_election.cc:290] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:17:14.719110 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 93592.7us
I20260709 12:17:14.719487 13355 leader_election.cc:290] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:14.719952 11419 leader_election.cc:304] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:14.720144 13355 consensus_queue.cc:1048] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:17:14.595746 13289 consensus_queue.cc:1175] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1c101e338f954ef086338e251deed19d" responder_term: 5 status { last_received { term: 3 index: 2 } last_committed_idx: 2 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 12:17:14.721681 12206 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:14.706976 13223 raft_consensus.cc:493] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:14.722970 13223 raft_consensus.cc:3060] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:14.725690 13229 raft_consensus.cc:697] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 5 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:14.708842 13286 raft_consensus.cc:697] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 6 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:14.699936 13455 consensus_queue.cc:1048] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:17:14.726989 13286 consensus_queue.cc:237] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:14.728672 13455 raft_consensus.cc:2749] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:14.729956 13459 raft_consensus.cc:2804] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:14.730455 13459 raft_consensus.cc:493] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:14.730944 13201 leader_election.cc:290] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:14.732136 13229 consensus_queue.cc:237] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:14.688287 13162 consensus_queue.cc:237] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:14.750753 13205 leader_election.cc:290] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:17:14.751279 11568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:14.722718 13084 raft_consensus.cc:515] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
W20260709 12:17:14.743799 12206 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:14.753646 13084 leader_election.cc:290] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:14.754563 13140 raft_consensus.cc:515] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:14.767858 13140 leader_election.cc:290] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:14.731168 13380 leader_election.cc:290] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:14.730902 13459 raft_consensus.cc:3060] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:14.757177 11419 leader_election.cc:304] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8
W20260709 12:17:14.757579 13453 log.cc:927] Time spent T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 12:17:14.758531 12203 leader_election.cc:304] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:14.759255 13373 raft_consensus.cc:515] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:14.767493 12792 raft_consensus.cc:515] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:14.755460 13199 raft_consensus.cc:515] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:14.742769 12361 raft_consensus.cc:515] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:14.704689 13368 raft_consensus.cc:493] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:14.706748 13301 raft_consensus.cc:493] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:14.805773 12356 raft_consensus.cc:1275] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:17:14.809068 12356 pending_rounds.cc:85] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de: Aborting all ops after (but not including) 3
I20260709 12:17:14.809370 12356 pending_rounds.cc:107] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:17:14.809653 12356 raft_consensus.cc:2889] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:14.726033 13346 leader_election.cc:290] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:17:14.799459 13458 log.cc:927] Time spent T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
W20260709 12:17:14.799619 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 225390us
I20260709 12:17:14.854195 11491 leader_election.cc:304] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:14.848809 13355 raft_consensus.cc:2804] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:14.856825 13475 raft_consensus.cc:493] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:14.857491 13475 raft_consensus.cc:515] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:14.856935 13355 raft_consensus.cc:493] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:14.859490 13355 raft_consensus.cc:3060] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:14.859552 12792 leader_election.cc:290] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:14.810693 13368 raft_consensus.cc:515] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:14.810657 13205 raft_consensus.cc:2804] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:14.862282 13205 raft_consensus.cc:493] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:14.862696 13205 raft_consensus.cc:3060] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:14.865178 13190 leader_election.cc:290] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:14.866060 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:14.868507 13199 leader_election.cc:290] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:14.870373 13373 leader_election.cc:290] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:14.863487 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:14.872994 11524 raft_consensus.cc:2393] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 5: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:14.812345 13301 raft_consensus.cc:3060] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:14.887199 13408 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 12:17:14.891960 13413 raft_consensus.cc:493] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:14.914135 13413 raft_consensus.cc:515] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:14.917644 13464 raft_consensus.cc:2804] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:14.918326 13464 raft_consensus.cc:493] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:14.886942 13287 raft_consensus.cc:493] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:14.918737 13464 raft_consensus.cc:3060] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:14.921271 13287 raft_consensus.cc:515] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:14.877804 13352 raft_consensus.cc:697] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 5 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
W20260709 12:17:14.939810 13438 log.cc:927] Time spent T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.682s	user 0.000s	sys 0.003s
I20260709 12:17:14.971455 12204 leader_election.cc:304] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:14.972711 13289 raft_consensus.cc:2749] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:17:14.997932 13473 log.cc:927] Time spent T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:17:14.999825 12361 leader_election.cc:290] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
W20260709 12:17:15.005797 11493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 325776us
I20260709 12:17:15.030243 13352 consensus_queue.cc:237] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
W20260709 12:17:15.034047 11568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:15.035786 13461 consensus_queue.cc:1048] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:15.038566 13461 consensus_queue.cc:1048] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:17:15.060940 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 89571.3us
I20260709 12:17:15.062429 13317 raft_consensus.cc:515] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:15.064379 13223 raft_consensus.cc:515] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:15.066907 13223 leader_election.cc:290] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
W20260709 12:17:15.067919 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 213821us
I20260709 12:17:15.084991 11491 leader_election.cc:304] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:15.070333 13368 leader_election.cc:290] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:15.071149 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:15.086475 11491 leader_election.cc:304] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:15.072263 13413 leader_election.cc:290] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
W20260709 12:17:15.061368 13353 consensus_meta.cc:287] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671: Time spent flushing consensus metadata: real 0.532s	user 0.008s	sys 0.013s
I20260709 12:17:15.067992 13287 leader_election.cc:290] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:15.075771 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:15.074505 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:15.098109 11520 raft_consensus.cc:3060] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:15.078465 13475 leader_election.cc:290] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:15.076349 13476 consensus_queue.cc:1048] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.006s
W20260709 12:17:15.082041 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 324928us
I20260709 12:17:15.074100 13220 raft_consensus.cc:515] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
W20260709 12:17:15.077518 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 426400us
I20260709 12:17:15.122548 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:15.070130 12361 raft_consensus.cc:1240] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 4. Current term is 5. Ops: []
W20260709 12:17:15.074580 11566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:15.093842 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 335365us
I20260709 12:17:15.126724 12203 leader_election.cc:304] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:15.096333 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:15.099808 13469 consensus_queue.cc:1059] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:15.104065 11491 leader_election.cc:304] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:15.122061 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ed4eeff0ae44d0bc1ebb8cbe3adea5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:15.125650 11526 raft_consensus.cc:2468] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 4.
I20260709 12:17:15.128067 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:17:15.151258 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 47294.7us
I20260709 12:17:15.152527 11491 leader_election.cc:304] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:15.152885 13084 raft_consensus.cc:2804] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:15.153330 13084 raft_consensus.cc:493] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:15.153777 13084 raft_consensus.cc:3060] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:15.153616 13471 consensus_queue.cc:1059] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:15.158330 11491 leader_election.cc:304] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:15.146229 12348 raft_consensus.cc:2468] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 4.
I20260709 12:17:15.175312 13464 raft_consensus.cc:515] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:15.119257 13368 raft_consensus.cc:2804] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:15.118635 13461 raft_consensus.cc:2749] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:17:15.210038 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 81449.7us
I20260709 12:17:15.210822 11419 leader_election.cc:304] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:15.180521 13380 raft_consensus.cc:3055] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:15.117785 13353 raft_consensus.cc:515] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:15.181907 13084 raft_consensus.cc:515] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:15.186753 11566 leader_election.cc:304] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
W20260709 12:17:15.188704 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 62050.5us
I20260709 12:17:15.189762 13125 raft_consensus.cc:2749] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:15.156266 12204 leader_election.cc:304] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:15.193511 11418 leader_election.cc:304] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:15.202594 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
W20260709 12:17:15.206193 11523 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.049s	sys 0.065s
I20260709 12:17:15.155161 13201 raft_consensus.cc:2804] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:15.182587 13317 leader_election.cc:290] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:15.211922 11493 leader_election.cc:304] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:15.212781 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:15.220863 11520 raft_consensus.cc:2468] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 7.
I20260709 12:17:15.237510 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:15.215699 12203 leader_election.cc:304] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8
W20260709 12:17:15.245935 11523 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.049s	sys 0.065s
W20260709 12:17:15.178243 13483 log.cc:927] Time spent T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.074s	user 0.000s	sys 0.005s
W20260709 12:17:15.248755 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 92580.7us
W20260709 12:17:15.257999 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 71346us
I20260709 12:17:15.249482 11600 raft_consensus.cc:1275] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:17:15.251799 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 58490.3us
I20260709 12:17:15.255012 11519 raft_consensus.cc:1240] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:15.261907 11418 leader_election.cc:304] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:15.198446 13368 raft_consensus.cc:493] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:15.213972 13380 raft_consensus.cc:740] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:15.277246 11566 leader_election.cc:304] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
W20260709 12:17:15.288405 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 77654.5us
I20260709 12:17:15.255872 13286 raft_consensus.cc:2804] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:15.251040 13201 raft_consensus.cc:493] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1c101e338f954ef086338e251deed19d)
W20260709 12:17:15.308600 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 92947.4us
I20260709 12:17:15.255019 13319 raft_consensus.cc:2749] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:15.308459 13471 raft_consensus.cc:2804] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:15.263304 12346 raft_consensus.cc:3060] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:15.258402 13455 raft_consensus.cc:2749] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:15.213726 13355 raft_consensus.cc:515] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:15.315486 11419 leader_election.cc:304] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:15.271302 13368 raft_consensus.cc:3060] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:15.286415 12206 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:15.327075 12203 leader_election.cc:304] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:15.281533 13130 raft_consensus.cc:2804] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:15.272472 13199 raft_consensus.cc:2749] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:15.275998 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ed4eeff0ae44d0bc1ebb8cbe3adea5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
W20260709 12:17:15.316782 13310 consensus_meta.cc:287] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8: Time spent flushing consensus metadata: real 0.631s	user 0.007s	sys 0.014s
I20260709 12:17:15.308336 13286 raft_consensus.cc:493] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:15.347930 13286 raft_consensus.cc:3060] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:15.349128 13468 raft_consensus.cc:2804] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:15.350615 13489 raft_consensus.cc:493] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:15.351182 13489 raft_consensus.cc:515] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:15.351810 13355 leader_election.cc:290] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:15.351604 13205 raft_consensus.cc:515] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:15.352773 12359 raft_consensus.cc:1240] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:15.317651 13201 raft_consensus.cc:3060] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:15.354856 13205 leader_election.cc:290] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 8 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:15.336359 13301 raft_consensus.cc:515] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:15.329170 13471 raft_consensus.cc:493] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:15.357666 13471 raft_consensus.cc:3060] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:15.358897 13301 leader_election.cc:290] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:15.277860 13223 consensus_queue.cc:1059] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 12:17:15.339771 11419 leader_election.cc:304] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:15.363469 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e4724ed93a467ea47763eec9a6de2e" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:15.364550 11449 raft_consensus.cc:2468] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 5.
I20260709 12:17:15.363508 13162 raft_consensus.cc:2749] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:15.366204 11453 raft_consensus.cc:1275] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:15.367520 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:15.368263 11445 raft_consensus.cc:2468] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 5.
I20260709 12:17:15.369763 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:15.371658 13466 raft_consensus.cc:3055] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:15.372116 13466 raft_consensus.cc:740] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
W20260709 12:17:15.337754 13356 consensus_meta.cc:287] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de: Time spent flushing consensus metadata: real 0.651s	user 0.007s	sys 0.015s
I20260709 12:17:15.397578 13147 raft_consensus.cc:493] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.398445 13461 raft_consensus.cc:493] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.398272 13147 raft_consensus.cc:515] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:15.399027 13461 raft_consensus.cc:515] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:15.400624 13147 leader_election.cc:290] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:17:15.403414 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 76412.8us
I20260709 12:17:15.404348 12203 leader_election.cc:304] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:15.406688 12203 leader_election.cc:304] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:15.407744 12204 leader_election.cc:304] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:15.412894 12352 raft_consensus.cc:1240] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:15.346186 13190 raft_consensus.cc:2749] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:17:15.383210 13459 consensus_meta.cc:287] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d: Time spent flushing consensus metadata: real 0.614s	user 0.016s	sys 0.015s
I20260709 12:17:15.337065 13130 raft_consensus.cc:493] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
W20260709 12:17:15.410877 12206 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:15.416999 13252 raft_consensus.cc:2749] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:17:15.423007 11493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 171409us
I20260709 12:17:15.409842 13408 raft_consensus.cc:2804] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:15.401291 13461 leader_election.cc:290] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:15.410290 13489 leader_election.cc:290] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:15.372936 13466 consensus_queue.cc:260] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:15.374120 13310 raft_consensus.cc:515] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:15.422902 13289 raft_consensus.cc:2804] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:15.423655 13205 raft_consensus.cc:493] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.436755 13287 raft_consensus.cc:2749] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:15.428741 13130 raft_consensus.cc:3060] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:15.346506 13380 consensus_queue.cc:260] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:15.454098 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:15.474052 11452 raft_consensus.cc:2393] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 5: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:15.474426 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
W20260709 12:17:15.474889 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 68284.8us
W20260709 12:17:15.475430 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 207053us
I20260709 12:17:15.479293 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:15.480826 11520 raft_consensus.cc:1240] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:15.434144 12357 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 850) took 1009 ms. Trace:
I20260709 12:17:15.483486 11453 raft_consensus.cc:2468] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 5.
I20260709 12:17:15.433420 13472 raft_consensus.cc:493] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:15.485634 11566 leader_election.cc:304] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
W20260709 12:17:15.489899 11493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 58755.5us
I20260709 12:17:15.493935 12203 leader_election.cc:304] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:15.447736 13310 leader_election.cc:290] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:15.497484 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:15.499475 11451 raft_consensus.cc:2393] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 5: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:15.499400 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:15.500396 12347 raft_consensus.cc:2468] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 5.
I20260709 12:17:15.502821 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:15.503593 11522 raft_consensus.cc:2468] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 5.
I20260709 12:17:15.533705 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:15.429633 13459 raft_consensus.cc:515] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:15.538072 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
W20260709 12:17:15.540237 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 46404.2us
I20260709 12:17:15.542572 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:15.489084 13289 raft_consensus.cc:697] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:15.544467 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:17:15.545336 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 59793us
I20260709 12:17:15.495913 13466 raft_consensus.cc:3060] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:15.579259 13380 raft_consensus.cc:3060] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:15.580940 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:15.581750 11527 raft_consensus.cc:2368] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 5. Current term is 6.
I20260709 12:17:15.582508 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390e91331fd04f97a5235133a34875ee" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:15.583314 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:15.583957 11449 raft_consensus.cc:2468] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 5.
I20260709 12:17:15.588034 13220 leader_election.cc:290] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:15.589710 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:15.590137 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:15.590514 11451 raft_consensus.cc:2393] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 4: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:15.590332 13168 consensus_queue.cc:1059] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:15.591132 13478 consensus_queue.cc:1059] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:15.592166 13319 raft_consensus.cc:3055] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:15.592537 13319 raft_consensus.cc:740] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:15.593217 13459 leader_election.cc:290] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:15.593344 13319 consensus_queue.cc:260] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:15.594770 13319 raft_consensus.cc:3060] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:15.533238 13353 leader_election.cc:290] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 7 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:15.599162 13353 raft_consensus.cc:493] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:15.599728 13353 raft_consensus.cc:515] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:15.476336 13205 raft_consensus.cc:515] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:15.591328 13385 raft_consensus.cc:3055] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:15.601415 13385 raft_consensus.cc:740] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:15.532254 13147 raft_consensus.cc:2749] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:15.602351 13385 consensus_queue.cc:260] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:15.535075 13084 leader_election.cc:290] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:15.603648 13385 raft_consensus.cc:3060] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:15.499260 13287 consensus_queue.cc:1048] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.105s
I20260709 12:17:15.605218 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:15.498042 13472 raft_consensus.cc:515] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:15.589164 11493 leader_election.cc:304] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:15.607839 13084 raft_consensus.cc:2804] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:15.608250 13084 raft_consensus.cc:493] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:15.608596 13084 raft_consensus.cc:3060] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:15.496981 13317 raft_consensus.cc:2804] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:15.641145  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:17:15.634514 11568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:15.498451 13464 leader_election.cc:290] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:15.496335 13471 raft_consensus.cc:515] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:15.670146 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:15.642166 13317 raft_consensus.cc:493] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:15.594666 13356 consensus_queue.cc:1059] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.070s
I20260709 12:17:15.645422 13468 raft_consensus.cc:697] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 6 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:15.663949 13489 raft_consensus.cc:493] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.678378 11523 raft_consensus.cc:1240] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:17:15.680212 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e4724ed93a467ea47763eec9a6de2e" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:15.682961 11521 raft_consensus.cc:2410] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:17:15.676270 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 134818us
I20260709 12:17:15.648085 13287 consensus_queue.cc:1059] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:17:15.647882 13310 consensus_queue.cc:1048] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:17:15.689543 11519 raft_consensus.cc:1275] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:15.650187 13201 raft_consensus.cc:515] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:15.649317 13286 raft_consensus.cc:515] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:15.693039 11566 leader_election.cc:304] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:15.687526 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:15.677459 13317 raft_consensus.cc:3060] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:15.696612 11566 leader_election.cc:304] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:15.697834 11452 raft_consensus.cc:2393] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 6: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:15.677208 13205 leader_election.cc:290] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:15.676647 13301 raft_consensus.cc:493] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:15.703008 11418 leader_election.cc:304] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:15.682224 13495 raft_consensus.cc:493] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:15.706071 11566 leader_election.cc:304] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:15.708117 11418 leader_election.cc:400] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 election: Vote denied by peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063) with higher term. Message: Invalid argument: T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 5. Current term is 6.
I20260709 12:17:15.708362 11566 leader_election.cc:304] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:15.709785 11418 leader_election.cc:403] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:17:15.712214 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:15.712463 11566 leader_election.cc:304] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:15.687444 13478 consensus_queue.cc:1048] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:17:15.704864 13459 raft_consensus.cc:493] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.717183 11566 leader_election.cc:304] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:15.706285 13467 raft_consensus.cc:2804] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:15.687940 13489 raft_consensus.cc:515] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
W20260709 12:17:15.720796 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 189262us
W20260709 12:17:15.715062 13492 log.cc:927] Time spent T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 12:17:15.723394 12848 raft_consensus.cc:2749] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:15.724993 11599 raft_consensus.cc:2468] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 4.
I20260709 12:17:15.725553 13475 raft_consensus.cc:3060] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:15.780289 13229 raft_consensus.cc:2804] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:17:15.733961 13494 log.cc:927] Time spent T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:17:15.734656 13286 leader_election.cc:290] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:15.712123 13168 raft_consensus.cc:2749] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:15.488250 12357 rpcz_store.cc:276] 0709 12:17:14.425165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:14.429279 (+  4114us) service_pool.cc:224] Handling call
0709 12:17:14.728457 (+299178us) spinlock_profiling.cc:243] Waited 2.61 ms on lock 0x7b5800003f98. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9eeee 000000000036eb39 00007f84ebb121e0 00007f84ebbdb0c4 00007f84ebbdb131 00007f84ebb9cfc0 00007f84ebb87929 00007f84ebb873d2 00007f84e50febd4
0709 12:17:14.728653 (+   196us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:14.742869 (+ 14216us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:17:14.768702 (+ 25833us) log.cc:844] Serialized 14 byte log entry
0709 12:17:15.198758 (+430056us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:15.334765 (+136007us) log.cc:844] Serialized 26 byte log entry
0709 12:17:15.340536 (+  5771us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:15.346997 (+  6461us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:15.390947 (+ 43950us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:15.410709 (+ 19762us) raft_consensus.cc:1685] finished
0709 12:17:15.423890 (+ 13181us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:15.431289 (+  7399us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59695,"prepare.queue_time_us":197,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":48,"raft.queue_time_us":61534,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":164,"spinlock_wait_cycles":6006528,"thread_start_us":356167,"threads_started":1,"wal-append.queue_time_us":380501}
I20260709 12:17:15.735992 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:15.783860 11449 raft_consensus.cc:2393] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 4: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:15.736413 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:15.704864 13289 consensus_queue.cc:237] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:15.785817 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:15.786629 11523 raft_consensus.cc:2393] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 5: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:17:15.737591 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:15.789791 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:15.790511 11521 raft_consensus.cc:2468] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 5.
I20260709 12:17:15.791216 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:15.791594 11525 raft_consensus.cc:1275] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:15.737752 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:15.738582 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:15.793038 11451 raft_consensus.cc:2393] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 6: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:15.739162 13478 raft_consensus.cc:2749] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:15.739379 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:15.739629 13468 consensus_queue.cc:237] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:15.710405 13301 raft_consensus.cc:515] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:15.721408 13467 raft_consensus.cc:493] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:15.741443 13130 raft_consensus.cc:515] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:15.718144 13399 raft_consensus.cc:2749] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:15.712958 13355 raft_consensus.cc:2804] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:15.745877 13408 raft_consensus.cc:493] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:15.746121 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:15.747033 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:15.750715 13356 raft_consensus.cc:3055] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:15.751629 13413 raft_consensus.cc:3055] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:15.756275 13472 leader_election.cc:290] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:15.764849 13201 leader_election.cc:290] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:15.767359 11445 raft_consensus.cc:2468] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 6.
I20260709 12:17:15.769104 12346 raft_consensus.cc:2468] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 6.
I20260709 12:17:15.769569 13459 raft_consensus.cc:515] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:15.752841 13084 raft_consensus.cc:515] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:15.827139 13413 raft_consensus.cc:740] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:15.827143 13229 raft_consensus.cc:493] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:15.837759 13229 raft_consensus.cc:3060] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:15.769547 12359 raft_consensus.cc:2468] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 6.
I20260709 12:17:15.761193 13319 raft_consensus.cc:493] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:15.838013 13130 leader_election.cc:290] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:15.838508 13319 raft_consensus.cc:515] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:15.840701 13319 leader_election.cc:290] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:15.841410 11526 raft_consensus.cc:1240] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:15.841740 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:15.823913 13356 raft_consensus.cc:740] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:15.843469 11601 raft_consensus.cc:1275] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:15.823552 13408 raft_consensus.cc:3060] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:15.838092 13084 leader_election.cc:290] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:15.823694 13355 raft_consensus.cc:493] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:15.846331 13355 raft_consensus.cc:3060] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:15.837317 13413 consensus_queue.cc:260] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:15.849881 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:15.850710 12348 raft_consensus.cc:2393] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 5: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:17:15.706130 13190 consensus_queue.cc:1059] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 12:17:15.714689 13140 raft_consensus.cc:2749] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:15.851955 13475 raft_consensus.cc:2749] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063) with higher term. Message: Invalid argument: T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 5. Current term is 6.
I20260709 12:17:15.852260 12357 raft_consensus.cc:1275] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:15.853359 13469 raft_consensus.cc:493] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:15.772030 13471 leader_election.cc:290] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:15.855379 11567 leader_election.cc:304] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:15.804623 13353 leader_election.cc:290] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:15.806797 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ed4eeff0ae44d0bc1ebb8cbe3adea5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:15.815241 13467 raft_consensus.cc:3060] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:15.815850 11452 raft_consensus.cc:2468] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 4.
I20260709 12:17:15.829282 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c355b3902a4e7fb72bac6a91ea3316" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:17:15.830044 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 114173us
I20260709 12:17:15.791762 13489 leader_election.cc:290] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:15.835142 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:15.831614 13125 raft_consensus.cc:2749] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:15.841799 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a841f2f09ced40a4bbf33594e11bd7ad" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:15.850188 13356 consensus_queue.cc:260] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:15.802731 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:17:15.800540 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 80591.4us
I20260709 12:17:15.857247 11451 raft_consensus.cc:1240] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 5 LEADER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:15.859797 11567 leader_election.cc:304] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:15.894001 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:15.816392 12204 leader_election.cc:304] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:15.849249 13413 raft_consensus.cc:3060] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:15.879588 11450 raft_consensus.cc:1240] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:15.837941 13459 leader_election.cc:290] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:15.878226 12349 raft_consensus.cc:2468] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 4.
I20260709 12:17:15.853981 13469 raft_consensus.cc:515] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:15.887274 11600 raft_consensus.cc:1240] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 7 LEADER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:15.717733 13495 raft_consensus.cc:515] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:15.901535 12203 leader_election.cc:304] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:15.875972 13478 raft_consensus.cc:2804] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:17:15.898635 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 82309.3us
I20260709 12:17:15.875689 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:15.911669 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:15.912389 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:15.911603 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:15.915850 11452 raft_consensus.cc:2393] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 7: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:15.915685 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a841f2f09ced40a4bbf33594e11bd7ad" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:15.918174 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c355b3902a4e7fb72bac6a91ea3316" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:15.918522 11449 raft_consensus.cc:2468] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 1.
I20260709 12:17:15.920079 11595 raft_consensus.cc:2468] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 4.
I20260709 12:17:15.909482 13399 raft_consensus.cc:2804] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:15.933526 11594 raft_consensus.cc:2468] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 8.
I20260709 12:17:15.909803 13501 raft_consensus.cc:2804] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:17:15.934103 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 216965us
W20260709 12:17:15.936307 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 207987us
I20260709 12:17:15.938478 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:15.917552 13478 raft_consensus.cc:697] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:15.949890 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
W20260709 12:17:15.919648 11565 leader_election.cc:336] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Timed out: RequestConsensusVote RPC to 127.3.212.130:41579 timed out after 1.521s (SENT)
I20260709 12:17:15.919581 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:15.942896 11454 raft_consensus.cc:2468] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 6.
I20260709 12:17:15.907164 13205 consensus_queue.cc:1048] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:17:15.950043 11445 raft_consensus.cc:1240] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:15.955152 11453 raft_consensus.cc:2393] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 6: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:15.929154 13356 raft_consensus.cc:3060] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:15.921132 13147 raft_consensus.cc:2749] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:15.957796 11565 leader_election.cc:304] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:15.951009 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:15.958853 11451 raft_consensus.cc:2468] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 5.
I20260709 12:17:15.909919 13140 consensus_queue.cc:1048] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:17:15.954563 13471 raft_consensus.cc:493] T da8741606df54c3f8b5cc5c1141862ea P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:15.957465 13493 consensus_queue.cc:1048] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 12:17:15.938192 13130 raft_consensus.cc:3055] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:15.963191 11454 raft_consensus.cc:1240] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:17:15.940569 13501 raft_consensus.cc:493] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:15.942929 13399 raft_consensus.cc:697] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 6 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
W20260709 12:17:15.960114 12206 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:15.968258 11491 leader_election.cc:336] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Timed out: RequestConsensusVote RPC to 127.3.212.130:41579 timed out after 1.539s (SENT)
I20260709 12:17:15.976646 11491 leader_election.cc:304] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
W20260709 12:17:15.981490 11568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:15.973356 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:15.963606 12357 raft_consensus.cc:3060] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:15.960598 13252 raft_consensus.cc:493] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:16.002849 12203 leader_election.cc:304] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:15.970265 13130 raft_consensus.cc:740] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
W20260709 12:17:16.010211 11491 leader_election.cc:336] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Timed out: RequestConsensusVote RPC to 127.3.212.130:41579 timed out after 1.639s (SENT)
I20260709 12:17:16.017975 12203 leader_election.cc:304] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:16.017038 11453 raft_consensus.cc:1240] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:17:15.993958 13319 raft_consensus.cc:2749] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:15.996582 13220 raft_consensus.cc:2749] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:15.975203 13501 raft_consensus.cc:3060] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:16.062469 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 142837us
I20260709 12:17:16.022636 12203 leader_election.cc:304] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:16.024338 11454 raft_consensus.cc:1275] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:17:16.009827 13368 consensus_meta.cc:287] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671: Time spent flushing consensus metadata: real 0.667s	user 0.008s	sys 0.007s
W20260709 12:17:16.076263 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 53716.9us
I20260709 12:17:16.028384 11445 raft_consensus.cc:1240] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:16.030486 11491 leader_election.cc:304] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:16.024996 11566 leader_election.cc:304] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:16.032830 11598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "b126028166e8480ba25541bf8f7fc6de"
 from {username='slave'} at 127.0.0.1:37992
I20260709 12:17:16.077884 11598 raft_consensus.cc:606] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 5 LEADER]: Received request to transfer leadership to TS b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:16.079520 11454 raft_consensus.cc:1240] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 2. Current term is 3. Ops: []
W20260709 12:17:16.080000 13496 log.cc:927] Time spent T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.118s	user 0.000s	sys 0.003s
I20260709 12:17:16.079914 13287 raft_consensus.cc:2804] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:16.033339 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:15.992688 13471 raft_consensus.cc:515] T da8741606df54c3f8b5cc5c1141862ea P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:16.036123 13505 raft_consensus.cc:493] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:16.080535 13287 raft_consensus.cc:493] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:16.007983 13459 consensus_queue.cc:1048] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:17:16.081009 13287 raft_consensus.cc:3060] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:16.037878 13130 consensus_queue.cc:260] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:16.081996 13495 leader_election.cc:290] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:16.084548 13471 leader_election.cc:290] T da8741606df54c3f8b5cc5c1141862ea P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:16.009711 13190 consensus_queue.cc:1059] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:17:16.041700 13301 leader_election.cc:290] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:16.028034 13478 consensus_queue.cc:237] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:16.049511 13229 raft_consensus.cc:515] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:16.009658 13199 consensus_queue.cc:1048] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 12:17:16.056222 11451 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a"
dest_uuid: "1c101e338f954ef086338e251deed19d"
 from {username='slave'} at 127.0.0.1:58868
I20260709 12:17:16.123045 11451 raft_consensus.cc:493] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:16.123479 11451 raft_consensus.cc:3060] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:16.058910 11449 raft_consensus.cc:1240] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:16.067688 11448 raft_consensus.cc:2468] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 6.
I20260709 12:17:16.081924 13130 raft_consensus.cc:3060] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:16.093624 13461 raft_consensus.cc:493] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:16.095808 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 65391.7us
I20260709 12:17:16.092763 13353 consensus_queue.cc:1048] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:16.085753 13317 raft_consensus.cc:515] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:16.080950 13505 raft_consensus.cc:515] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
W20260709 12:17:16.097875 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 72994.3us
I20260709 12:17:16.102475 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:16.139506 11594 raft_consensus.cc:2410] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:16.080974 11454 raft_consensus.cc:1275] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:16.086107 11525 raft_consensus.cc:1240] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:16.027276 13504 raft_consensus.cc:2749] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:16.095772 12203 leader_election.cc:304] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:16.113019 11493 leader_election.cc:304] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:16.123215 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:16.094085 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:16.124696 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:16.173967 11453 raft_consensus.cc:2468] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 4.
I20260709 12:17:16.127279 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:16.131525 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:16.020325 13162 consensus_queue.cc:1059] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.100s
I20260709 12:17:16.117165 12848 raft_consensus.cc:2749] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:17:16.184441 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 88746.1us
I20260709 12:17:16.060976 13355 raft_consensus.cc:515] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:16.115507 13495 raft_consensus.cc:2749] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:16.188335 12203 leader_election.cc:304] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
W20260709 12:17:16.178017 11493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 65095.8us
I20260709 12:17:16.179037 11450 raft_consensus.cc:2393] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 8: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:16.009253 13252 raft_consensus.cc:515] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:16.192973 13252 leader_election.cc:290] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:16.196765 11593 raft_consensus.cc:1240] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:16.187197 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:16.094755 13399 consensus_queue.cc:237] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:16.188030 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:16.118136 13467 raft_consensus.cc:515] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:16.201531 13140 raft_consensus.cc:493] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:16.222162 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390e91331fd04f97a5235133a34875ee" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
W20260709 12:17:16.223619 12203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:16.204001 13301 raft_consensus.cc:3055] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:16.205813 13147 consensus_queue.cc:1059] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:16.096040 13368 raft_consensus.cc:515] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:16.209643 11602 raft_consensus.cc:1240] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 5. Current term is 6. Ops: []
W20260709 12:17:16.214871 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 159493us
I20260709 12:17:16.219321 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:16.201967 13229 leader_election.cc:290] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:16.238446 11453 raft_consensus.cc:1240] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:16.225160 12203 leader_election.cc:304] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:16.227030 11445 raft_consensus.cc:1240] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:16.233091 11454 raft_consensus.cc:1240] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:16.187407 13084 raft_consensus.cc:2804] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:16.242440 13084 raft_consensus.cc:493] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:16.242905 13084 raft_consensus.cc:3060] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:16.244442 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:16.245751 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:16.196048 13286 raft_consensus.cc:2804] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:16.246825 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:16.246948 13355 leader_election.cc:290] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:16.247092 13286 raft_consensus.cc:493] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:16.247566 13286 raft_consensus.cc:3060] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:16.248085 11449 raft_consensus.cc:1240] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:16.251057 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:16.252045 11594 raft_consensus.cc:3060] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:16.239372 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:16.256521 11520 raft_consensus.cc:1240] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:16.257459 11599 raft_consensus.cc:2393] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 6: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:17:16.247989 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:16.258905 11450 raft_consensus.cc:2468] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 6.
I20260709 12:17:16.218998 11598 raft_consensus.cc:1275] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:16.173174 13461 raft_consensus.cc:515] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:16.261855 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:16.267089 11601 raft_consensus.cc:3060] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:16.251212 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390e91331fd04f97a5235133a34875ee" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:16.251019 13505 leader_election.cc:290] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:16.252780 13287 raft_consensus.cc:515] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
W20260709 12:17:16.240060 11417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:16.220808 13517 raft_consensus.cc:2749] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:16.271826 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8741606df54c3f8b5cc5c1141862ea" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:16.229943 13301 raft_consensus.cc:740] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:16.283466 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:16.294906 11594 raft_consensus.cc:2468] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 6.
I20260709 12:17:16.296121 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e4724ed93a467ea47763eec9a6de2e" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:16.297809 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:16.299194 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:16.301344 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffe47647c274723808482c166efa21c" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:16.302335 11598 raft_consensus.cc:1275] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:16.304355 13287 leader_election.cc:290] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:16.305727 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:16.305995 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:16.306687 11453 raft_consensus.cc:2393] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 6: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
W20260709 12:17:16.306993 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 81922.3us
I20260709 12:17:16.279119 12357 raft_consensus.cc:2468] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 6.
I20260709 12:17:16.309484 12203 leader_election.cc:304] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d
I20260709 12:17:16.232611 13140 raft_consensus.cc:515] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:16.321744 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:16.322104 12203 leader_election.cc:304] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:16.325546 13287 raft_consensus.cc:2804] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:16.326146 13287 raft_consensus.cc:697] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 8 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:16.318686 13467 leader_election.cc:290] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:16.327108 13287 consensus_queue.cc:237] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:16.327994 13301 consensus_queue.cc:260] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:16.329800 13140 leader_election.cc:290] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:16.332955 13461 leader_election.cc:290] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:16.335580 11417 leader_election.cc:304] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:16.337144 13355 raft_consensus.cc:2749] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:16.339115 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:16.340144 12356 raft_consensus.cc:2410] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:16.265614 13408 raft_consensus.cc:515] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:16.290625 13289 raft_consensus.cc:2804] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:16.350396 11417 leader_election.cc:304] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:16.326033 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9fe9a94294836aec652338f44367d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:16.361469 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a841f2f09ced40a4bbf33594e11bd7ad" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:16.362854 11452 raft_consensus.cc:1240] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:16.363458 13355 raft_consensus.cc:2749] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:16.321344 13472 raft_consensus.cc:2749] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:16.366240 13147 raft_consensus.cc:3060] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:16.374982 12352 raft_consensus.cc:1240] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:16.375042 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:16.402148 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:16.399874 11453 raft_consensus.cc:2468] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 4.
I20260709 12:17:16.359175 13289 raft_consensus.cc:493] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting leader election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:16.407940 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a841f2f09ced40a4bbf33594e11bd7ad" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:16.412510 13289 raft_consensus.cc:3060] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:16.427084 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:16.427932 11449 raft_consensus.cc:3060] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:16.366101 13190 consensus_queue.cc:1048] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 12:17:16.446934 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:16.449365 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:16.456843 13408 leader_election.cc:290] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:16.460237 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:16.461033 11452 raft_consensus.cc:3060] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:16.463140 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:16.463140 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:16.374397 13504 consensus_queue.cc:1059] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:17:16.467401 11597 raft_consensus.cc:2468] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 7.
I20260709 12:17:16.476027 11451 raft_consensus.cc:515] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:16.474045 13468 raft_consensus.cc:493] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:16.483222 13468 raft_consensus.cc:515] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:16.490154 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
W20260709 12:17:16.490448 13413 consensus_meta.cc:287] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de: Time spent flushing consensus metadata: real 0.586s	user 0.010s	sys 0.000s
I20260709 12:17:16.491070 11596 raft_consensus.cc:2393] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 8: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:17:16.494001 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
W20260709 12:17:16.494635 12206 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:16.495087 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:16.498184 13301 raft_consensus.cc:3060] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:16.497407 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d43eecbad746fd9ddce50c5b9fc3e8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:16.495177 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:16.499393 12347 raft_consensus.cc:2468] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 5.
I20260709 12:17:16.501251 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:16.461064 13368 leader_election.cc:290] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:16.502897 13504 raft_consensus.cc:3055] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:16.503741 13504 raft_consensus.cc:740] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:16.505272 13504 consensus_queue.cc:260] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:16.506704 13504 raft_consensus.cc:3060] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:16.512053 13468 leader_election.cc:290] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:16.512219 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:16.513242 11521 raft_consensus.cc:1240] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:16.513321 11520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38272 (request call id 296) took 1013 ms. Trace:
I20260709 12:17:16.514777 13461 raft_consensus.cc:493] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:16.511312 13286 raft_consensus.cc:515] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:16.509255 12203 leader_election.cc:304] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:16.528972 13084 raft_consensus.cc:515] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:16.518873 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a841f2f09ced40a4bbf33594e11bd7ad" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:16.568451 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:16.522500 13317 leader_election.cc:290] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:16.523725 12361 raft_consensus.cc:1240] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:16.527335 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9fe9a94294836aec652338f44367d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:16.529238 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:16.575661 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:16.576233 11524 raft_consensus.cc:3060] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:16.530141 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:16.530779 11417 leader_election.cc:304] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:16.533025 11452 raft_consensus.cc:2468] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 7.
W20260709 12:17:16.533852 11568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:16.534475 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:16.535787 11449 raft_consensus.cc:2468] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 5.
W20260709 12:17:16.551734 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 58232.2us
I20260709 12:17:16.574266 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:16.575600 11522 raft_consensus.cc:2468] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 5.
I20260709 12:17:16.552414 11451 leader_election.cc:290] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:16.554193 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:16.556169 11520 rpcz_store.cc:276] 0709 12:17:15.499878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:15.500538 (+   660us) service_pool.cc:224] Handling call
0709 12:17:15.500882 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:16.256996 (+756114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:16.513096 (+256100us) spinlock_profiling.cc:243] Waited 755 ms on lock 0x7b5400671454. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:17:16.513261 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1737295232}
I20260709 12:17:16.556700 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:16.557648 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:16.553402 11601 raft_consensus.cc:2468] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 5.
I20260709 12:17:16.564278 11596 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "1c101e338f954ef086338e251deed19d"
 from {username='slave'} at 127.0.0.1:37992
I20260709 12:17:16.564128 11525 raft_consensus.cc:2368] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 for earlier term 6. Current term is 7.
I20260709 12:17:16.518252 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:16.583030 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:16.583799 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:16.584640 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:16.585501 11521 raft_consensus.cc:2393] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 6: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:17:16.585917 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390e91331fd04f97a5235133a34875ee" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:16.586615 11448 raft_consensus.cc:2393] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 4: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:16.586712 11521 raft_consensus.cc:1275] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:16.587347 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8741606df54c3f8b5cc5c1141862ea" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:16.588397 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e4724ed93a467ea47763eec9a6de2e" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:16.588764 11448 raft_consensus.cc:1275] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:17:16.589542 12348 raft_consensus.cc:1240] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:16.571144 13461 raft_consensus.cc:515] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:16.591485 12348 raft_consensus.cc:1240] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:17:16.592065 13461 leader_election.cc:290] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:16.583112 11596 raft_consensus.cc:606] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 LEADER]: Received request to transfer leadership to TS 1c101e338f954ef086338e251deed19d
I20260709 12:17:16.595654 11528 raft_consensus.cc:2393] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 6: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
W20260709 12:17:16.573964 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 64801.4us
I20260709 12:17:16.517095 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
W20260709 12:17:16.584137 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 53538.3us
I20260709 12:17:16.569370 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:16.584606 11453 raft_consensus.cc:2393] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 4: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:16.596359 12203 leader_election.cc:304] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:16.595317 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:16.598037 11449 raft_consensus.cc:2376] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 6. Re-sending same reply.
I20260709 12:17:16.598809 12348 raft_consensus.cc:1240] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:16.581924 11447 raft_consensus.cc:2393] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 5: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:16.600922 11600 raft_consensus.cc:1240] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:16.603931 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:16.604954 11520 raft_consensus.cc:3060] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:16.605131 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:16.603075 11524 raft_consensus.cc:2468] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 5.
I20260709 12:17:16.610728 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:16.613941 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:16.614639 11601 raft_consensus.cc:3055] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:16.605365 12203 leader_election.cc:304] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:16.614969 11601 raft_consensus.cc:740] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:16.615697 11520 raft_consensus.cc:2468] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 6.
I20260709 12:17:16.605850 11446 raft_consensus.cc:2468] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 5.
I20260709 12:17:16.619089 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:16.619340 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffe47647c274723808482c166efa21c" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:16.527233 13289 raft_consensus.cc:515] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:16.621120 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:16.621659 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:16.622340 12347 raft_consensus.cc:1240] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:17:16.619728 11522 raft_consensus.cc:2468] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 6.
I20260709 12:17:16.580610 13468 raft_consensus.cc:493] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:16.589450 13286 leader_election.cc:290] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:16.564950 13168 consensus_queue.cc:1059] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 12:17:16.598346 13520 raft_consensus.cc:2804] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:16.640949 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:16.641510 11596 raft_consensus.cc:1240] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:16.453159 13501 raft_consensus.cc:515] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:16.621264 11601 consensus_queue.cc:260] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:16.648885 12356 raft_consensus.cc:1275] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:16.646217 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:16.612962 13408 raft_consensus.cc:2749] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:16.654471 11596 raft_consensus.cc:1240] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 LEADER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:16.620164 13355 raft_consensus.cc:2749] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:17:16.641688 13537 log.cc:927] Time spent T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:17:16.654680 12352 raft_consensus.cc:1240] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:16.656657 11601 raft_consensus.cc:3060] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:16.666272 13289 leader_election.cc:290] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:16.670179 13501 leader_election.cc:290] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:16.671563 11601 raft_consensus.cc:2468] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 4.
I20260709 12:17:16.640051 13469 leader_election.cc:290] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:16.677065 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:16.652144 13520 raft_consensus.cc:493] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:16.623473 13413 raft_consensus.cc:2804] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:16.626811 13368 raft_consensus.cc:493] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:16.618956 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:16.681908 12848 consensus_queue.cc:1059] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:17:16.690191 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:16.652359 13468 raft_consensus.cc:515] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:16.691458 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:16.687208 13168 consensus_queue.cc:1059] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:17:16.682257 13520 raft_consensus.cc:3060] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:16.706573 11452 raft_consensus.cc:2468] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 6.
I20260709 12:17:16.673347 13399 consensus_queue.cc:1059] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:17:16.724841 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d43eecbad746fd9ddce50c5b9fc3e8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:16.734457 11524 raft_consensus.cc:1240] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:17:16.680164 13229 consensus_queue.cc:1048] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 12:17:16.730118 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:16.734858 11526 raft_consensus.cc:1240] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:16.731081 11448 raft_consensus.cc:1275] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:16.684146 13507 consensus_queue.cc:1059] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:17:16.692004 13413 raft_consensus.cc:697] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:16.685695 13478 consensus_queue.cc:1048] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:17:16.681460 13509 consensus_queue.cc:1059] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 12:17:16.739517 11525 raft_consensus.cc:1240] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:16.732420 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:16.755770 11601 raft_consensus.cc:1275] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:17:16.761911 13531 log.cc:927] Time spent T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.366s	user 0.004s	sys 0.000s
I20260709 12:17:16.692130 13368 raft_consensus.cc:515] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:16.763907 12356 raft_consensus.cc:1275] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:16.749107 13147 raft_consensus.cc:2749] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:16.766341 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:16.778115 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:16.780508 12356 raft_consensus.cc:2393] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 7: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:17:16.784022 12345 raft_consensus.cc:1240] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 6. Current term is 7. Ops: []
W20260709 12:17:16.791046 11567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:16.792865 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c355b3902a4e7fb72bac6a91ea3316" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:16.793593 11593 raft_consensus.cc:3060] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:16.765511 13534 raft_consensus.cc:493] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:16.779343 13310 raft_consensus.cc:3055] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:16.848451 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:16.852289 13493 consensus_queue.cc:1059] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:16.853796 13509 raft_consensus.cc:3055] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:16.854197 13509 raft_consensus.cc:740] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:16.855077 13509 consensus_queue.cc:260] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:16.861527 12848 raft_consensus.cc:3055] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:16.862126 12848 raft_consensus.cc:740] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:16.863032 12848 consensus_queue.cc:260] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:16.864394 12848 raft_consensus.cc:3060] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:16.782709 13521 consensus_queue.cc:1059] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
I20260709 12:17:16.867202 13319 raft_consensus.cc:3055] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:16.867741 13319 raft_consensus.cc:740] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:16.868678 13319 consensus_queue.cc:260] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:16.869058 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:16.869800 13084 leader_election.cc:290] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:16.867393 13468 leader_election.cc:290] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
W20260709 12:17:16.900579 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 167017us
W20260709 12:17:16.891155 13554 log.cc:927] Time spent T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.099s	user 0.000s	sys 0.010s
I20260709 12:17:16.879355 13368 leader_election.cc:290] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:16.881521 13168 raft_consensus.cc:3055] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:17:16.882202 11417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:16.846776 13310 raft_consensus.cc:740] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:16.885560 13413 consensus_queue.cc:237] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
W20260709 12:17:16.898845 11418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:16.903079 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a841f2f09ced40a4bbf33594e11bd7ad" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:16.940471 13385 consensus_queue.cc:1059] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 12:17:16.950707 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:16.949601 13548 consensus_queue.cc:1059] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:17:16.951869 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:16.952112 13548 raft_consensus.cc:3055] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:16.952620 13548 raft_consensus.cc:740] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:16.954038 11453 raft_consensus.cc:1275] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:17:16.914093 11493 leader_election.cc:304] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:16.955329 13147 consensus_queue.cc:1059] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:16.956161 11493 leader_election.cc:304] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:16.930891 11566 leader_election.cc:304] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d
I20260709 12:17:16.873047 13521 raft_consensus.cc:3055] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:16.957731 13521 raft_consensus.cc:740] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
W20260709 12:17:16.941177 11417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:16.885954 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:16.959364 13521 consensus_queue.cc:260] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:16.960150 13548 consensus_queue.cc:260] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:16.960708 13521 raft_consensus.cc:3060] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:16.957149 13147 raft_consensus.cc:3055] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:16.961685 13147 raft_consensus.cc:740] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
W20260709 12:17:16.957948 11420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:16.962586 11447 raft_consensus.cc:3060] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:16.962806 13548 raft_consensus.cc:3060] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:16.940338 13168 raft_consensus.cc:740] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:16.964633 13168 consensus_queue.cc:260] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:16.951450 11452 raft_consensus.cc:3060] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:16.966141 13147 consensus_queue.cc:260] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:16.967468 13147 raft_consensus.cc:3060] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:16.945686 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:16.969542 12359 raft_consensus.cc:3060] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:16.978125 11452 raft_consensus.cc:2468] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 7.
I20260709 12:17:16.980398 11593 raft_consensus.cc:2468] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 5.
W20260709 12:17:16.981526 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 46196.1us
I20260709 12:17:16.845573 13534 raft_consensus.cc:515] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
W20260709 12:17:16.987304 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 56477.2us
I20260709 12:17:16.982877 12203 leader_election.cc:304] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
W20260709 12:17:16.987635 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 220752us
I20260709 12:17:16.936749 13532 raft_consensus.cc:493] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:16.991202 11565 leader_election.cc:304] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:16.934177 13461 raft_consensus.cc:493] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:16.937934 13319 raft_consensus.cc:3060] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:16.934738 13289 raft_consensus.cc:493] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
W20260709 12:17:16.996285 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 65897.3us
I20260709 12:17:17.003058 11593 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "1c101e338f954ef086338e251deed19d"
 from {username='slave'} at 127.0.0.1:37992
I20260709 12:17:17.003804 11593 raft_consensus.cc:606] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Received request to transfer leadership to TS 1c101e338f954ef086338e251deed19d
I20260709 12:17:17.004148 11593 raft_consensus.cc:614] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:16.997704 12347 raft_consensus.cc:2468] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 8.
I20260709 12:17:16.980103 13517 raft_consensus.cc:3055] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:16.984537 13471 raft_consensus.cc:2804] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:17.010823 11491 leader_election.cc:304] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:17.023859 12359 raft_consensus.cc:2468] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 4.
I20260709 12:17:16.998513 13084 consensus_queue.cc:1059] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:17:17.000612 13286 raft_consensus.cc:2804] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:17.000777 13469 consensus_queue.cc:1048] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:17:17.027590 13286 raft_consensus.cc:697] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:17.028548 13286 consensus_queue.cc:237] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:16.993475 13287 consensus_queue.cc:1048] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:17:17.017266 13385 consensus_queue.cc:1059] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 12:17:17.005925 13461 raft_consensus.cc:515] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:16.998502 13532 raft_consensus.cc:515] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:17.034693 13534 leader_election.cc:290] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:17.035422 13461 leader_election.cc:290] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:17.016592 13517 raft_consensus.cc:740] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:17.007025 13475 raft_consensus.cc:3055] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:17.007714 13289 raft_consensus.cc:515] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:17.043522 13162 raft_consensus.cc:493] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.043849 13289 leader_election.cc:290] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:17.044214 13162 raft_consensus.cc:515] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:17.045054 13520 raft_consensus.cc:515] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:17.046603 13162 leader_election.cc:290] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:17.047232 13520 leader_election.cc:290] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:17.005954 13551 raft_consensus.cc:2804] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:17.048061 13551 raft_consensus.cc:493] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:17.048473 13551 raft_consensus.cc:3060] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:17.048440 13507 consensus_queue.cc:1048] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:17.049010 13478 raft_consensus.cc:2749] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:17.041069 13475 raft_consensus.cc:740] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:17.035573 13532 leader_election.cc:290] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:17.063544 11447 raft_consensus.cc:2468] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 6.
I20260709 12:17:17.066072 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:17.066854 11453 raft_consensus.cc:3060] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:17.067582 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7937e0cff84ef7a26c84247c8ffc08" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
W20260709 12:17:17.069250 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 58510.9us
I20260709 12:17:17.067456 12203 leader_election.cc:304] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:17.054096 13471 raft_consensus.cc:697] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 6 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:17.081223 11491 leader_election.cc:304] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:17.084106 11491 leader_election.cc:304] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:17.085565 11491 leader_election.cc:304] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
W20260709 12:17:17.086408 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 97593.3us
I20260709 12:17:17.109429 11566 leader_election.cc:400] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 election: Vote denied by peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063) with higher term. Message: Invalid argument: T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 for earlier term 6. Current term is 7.
I20260709 12:17:17.114112 11566 leader_election.cc:304] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:17.069327 13461 raft_consensus.cc:2804] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:17.074132 13468 raft_consensus.cc:2804] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:17.075546 13532 raft_consensus.cc:2804] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:17.117101 11566 leader_election.cc:304] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:17.118829 11593 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a841f2f09ced40a4bbf33594e11bd7ad"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "b126028166e8480ba25541bf8f7fc6de"
 from {username='slave'} at 127.0.0.1:37992
W20260709 12:17:17.115617 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 123892us
I20260709 12:17:17.119603 11593 raft_consensus.cc:606] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Received request to transfer leadership to TS b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:17.120200 11565 leader_election.cc:304] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
W20260709 12:17:17.123065 11493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 126188us
I20260709 12:17:17.124234  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:17:17.127197 11491 leader_election.cc:304] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:17.128831 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:17:17.130900 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 130069us
I20260709 12:17:17.121675 13557 raft_consensus.cc:2804] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:17.115896 13461 raft_consensus.cc:493] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:17.132232 13368 raft_consensus.cc:2804] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:17.132651 13471 consensus_queue.cc:237] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:17.118883 13517 consensus_queue.cc:260] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:17.122982 13385 raft_consensus.cc:2749] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:17.125036 13084 consensus_queue.cc:1243] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer b126028166e8480ba25541bf8f7fc6de log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:17:17.129207 13464 raft_consensus.cc:2749] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:17.123569 13532 raft_consensus.cc:697] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 6 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:17.136299 13461 raft_consensus.cc:3060] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:17.150439 13532 consensus_queue.cc:237] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:17.149164 13499 raft_consensus.cc:3055] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:17.158509 11491 leader_election.cc:304] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:17.136430 13368 raft_consensus.cc:493] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:17.152978 13499 raft_consensus.cc:740] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:17.176328 13499 consensus_queue.cc:260] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:17.177523 13368 raft_consensus.cc:3060] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:17.181787 13562 raft_consensus.cc:2804] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:17.182488 13562 raft_consensus.cc:697] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 6 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:17.183840 13517 raft_consensus.cc:3060] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:17.177685 13499 raft_consensus.cc:3060] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:17.169801 13464 consensus_queue.cc:1059] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 12:17:17.183467 13562 consensus_queue.cc:237] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
W20260709 12:17:17.198549 12203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:17.144678 13564 raft_consensus.cc:2804] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:17:17.212725 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 82275.8us
I20260709 12:17:17.160127 13565 raft_consensus.cc:2749] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:17.186364 13468 raft_consensus.cc:493] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1c101e338f954ef086338e251deed19d)
W20260709 12:17:17.231030 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 99112.2us
I20260709 12:17:17.234613 11565 leader_election.cc:304] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:17.241428 11520 raft_consensus.cc:1240] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:17.243988 11417 leader_election.cc:304] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:17:17.223791 13570 raft_consensus.cc:493] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.260373 11419 leader_election.cc:304] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:17.231521 13468 raft_consensus.cc:3060] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:17.266494 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:17.268622 11523 raft_consensus.cc:2468] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 3.
I20260709 12:17:17.272677 11522 raft_consensus.cc:1240] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:17.272820 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:17.273447 11521 raft_consensus.cc:3060] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:17.230993 13564 raft_consensus.cc:697] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 6 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:17.270027 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:17.276278 11419 leader_election.cc:304] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:17.278152 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:17.251207 13355 raft_consensus.cc:2804] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:17.279891 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:17.279359 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c355b3902a4e7fb72bac6a91ea3316" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:17.278854 11520 raft_consensus.cc:3060] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:17.265573 13162 consensus_queue.cc:1059] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 12:17:17.307663 11527 raft_consensus.cc:1275] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:17.268110 13471 raft_consensus.cc:2749] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:17:17.313251 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 78705.9us
I20260709 12:17:17.315647 12204 leader_election.cc:304] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:17.270282 13557 raft_consensus.cc:697] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:17.320508 11565 leader_election.cc:304] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:17.279479 13190 raft_consensus.cc:2749] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:17.279891 13205 raft_consensus.cc:493] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:17.327275 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 168826us
I20260709 12:17:17.329346 11491 leader_election.cc:304] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:17.370975 13319 raft_consensus.cc:2749] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:17:17.371237 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 95029.7us
I20260709 12:17:17.320083 13289 raft_consensus.cc:2804] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:17.372536 11419 leader_election.cc:304] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:17.270076 13570 raft_consensus.cc:515] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:17.377341 11520 raft_consensus.cc:2468] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 7.
I20260709 12:17:17.378300 11521 raft_consensus.cc:2468] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 6.
I20260709 12:17:17.383038 11419 leader_election.cc:304] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:17.303459 13573 consensus_queue.cc:1059] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.098s
I20260709 12:17:17.390214 13567 raft_consensus.cc:2749] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:17.390597 12848 raft_consensus.cc:493] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:17.391160 12848 raft_consensus.cc:515] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:17.373886 13289 raft_consensus.cc:493] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting leader election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:17.393275 12848 leader_election.cc:290] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:17.403049 11519 raft_consensus.cc:1275] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:17.404814 13229 raft_consensus.cc:3055] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:17.405352 13229 raft_consensus.cc:740] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:17.359902 13205 raft_consensus.cc:515] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:17.406461 13229 consensus_queue.cc:260] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:17.408174 13317 raft_consensus.cc:3055] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:17.408651 13317 raft_consensus.cc:740] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:17.409915 13399 raft_consensus.cc:3055] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:17.410372 13399 raft_consensus.cc:740] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:17.411259 13399 consensus_queue.cc:260] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
W20260709 12:17:17.416214 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 86928.9us
I20260709 12:17:17.420542 11491 leader_election.cc:304] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d
I20260709 12:17:17.421965 11491 leader_election.cc:304] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:17.435192 13570 leader_election.cc:290] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:17.388469 13471 raft_consensus.cc:2764] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 12:17:17.412686 13399 raft_consensus.cc:3060] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:17.436161 13557 consensus_queue.cc:237] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:17.415307 13229 raft_consensus.cc:3060] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:17.437779 13582 raft_consensus.cc:2749] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:17.438537 13582 raft_consensus.cc:2749] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:17.441596 13582 raft_consensus.cc:493] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:17.388638 13190 raft_consensus.cc:2749] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:17.443912 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:17.405481 13289 raft_consensus.cc:3060] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:17.443447 11491 leader_election.cc:304] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:17.444682 13084 raft_consensus.cc:2764] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 12:17:17.452337 13570 raft_consensus.cc:2749] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:17.453248 13190 raft_consensus.cc:493] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.453827 13190 raft_consensus.cc:515] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:17.455927 13190 leader_election.cc:290] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:17.462168 13468 raft_consensus.cc:515] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:17.464486 13468 leader_election.cc:290] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:17.466892 11491 leader_election.cc:304] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:17.468058 11491 leader_election.cc:304] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:17.468644 11453 raft_consensus.cc:2468] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 7.
I20260709 12:17:17.400602 13564 consensus_queue.cc:237] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:17.470193 13570 raft_consensus.cc:2749] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:17.470918 13570 raft_consensus.cc:3060] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:17.474370 13467 raft_consensus.cc:3055] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:17.474867 13467 raft_consensus.cc:740] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:17.475911 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:17.476568 11601 raft_consensus.cc:2468] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 4.
I20260709 12:17:17.475661 13467 consensus_queue.cc:260] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:17.477743 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:17.478403 12348 raft_consensus.cc:3060] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:17.469141 11491 leader_election.cc:304] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:17.485885 11491 leader_election.cc:304] T da8741606df54c3f8b5cc5c1141862ea P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:17.469646 13471 raft_consensus.cc:2749] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:17.487265 11491 leader_election.cc:304] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d
W20260709 12:17:17.487871 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 167420us
W20260709 12:17:17.494897 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 360276us
I20260709 12:17:17.511620 11565 leader_election.cc:304] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
W20260709 12:17:17.526111 11417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:17.525724 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 142760us
I20260709 12:17:17.528213 11419 leader_election.cc:304] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:17.533097 11418 leader_election.cc:304] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:17.534222 11419 leader_election.cc:304] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
W20260709 12:17:17.535203 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 54339.7us
I20260709 12:17:17.536702 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:17.537693 11601 raft_consensus.cc:2468] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 6.
I20260709 12:17:17.515687 13576 raft_consensus.cc:2749] T da8741606df54c3f8b5cc5c1141862ea P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:17.517748 13468 raft_consensus.cc:3060] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:17.536634 11417 leader_election.cc:304] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:17:17.523381 13521 raft_consensus.cc:493] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:17.527025 13162 consensus_queue.cc:1243] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [LEADER]: Peer 9da53be18b0f446aaa406216e20b0ec8 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:17:17.442855 13565 consensus_queue.cc:1048] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.097s
I20260709 12:17:17.469197 13551 raft_consensus.cc:515] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
W20260709 12:17:17.561864 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 50258.3us
W20260709 12:17:17.568578 11568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:17.530745 13084 raft_consensus.cc:2804] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:17.566679 11520 raft_consensus.cc:1240] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 4. Current term is 5. Ops: []
W20260709 12:17:17.587105 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 75595us
I20260709 12:17:17.567108 11521 raft_consensus.cc:1240] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 12:17:17.587831 11567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:17.570293 13571 consensus_queue.cc:1059] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 12:17:17.571684 13592 consensus_queue.cc:1059] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:17:17.588629 11567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:17.574854 13551 leader_election.cc:290] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:17.564908 13521 raft_consensus.cc:515] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:17.442248 13582 raft_consensus.cc:515] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:17.580610 13301 consensus_queue.cc:1059] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:17.582156 13310 consensus_queue.cc:260] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:17.583981 13162 consensus_queue.cc:1048] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:17.585529 12203 leader_election.cc:304] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:17.578299 11526 raft_consensus.cc:1275] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:17.572500 13569 consensus_queue.cc:1048] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:17:17.609575 12347 raft_consensus.cc:1275] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:17.569862 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:17:17.611106 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 78089.5us
W20260709 12:17:17.611346 11567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:17.611907 11491 leader_election.cc:304] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d
I20260709 12:17:17.616997 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:17.568022 13464 raft_consensus.cc:493] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:17.620798 12361 raft_consensus.cc:1275] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:17.549849 13471 consensus_queue.cc:1059] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 12:17:17.566215 13355 raft_consensus.cc:697] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 4 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:17.629456 12359 raft_consensus.cc:2468] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 8.
I20260709 12:17:17.629540 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:17.643059 11601 raft_consensus.cc:2393] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 3: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:17:17.634689 13286 raft_consensus.cc:2804] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:17.625049 13399 consensus_queue.cc:1059] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:17:17.619812 13084 raft_consensus.cc:697] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 6 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:17.638192 13464 raft_consensus.cc:515] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:17.638823 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7937e0cff84ef7a26c84247c8ffc08" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:17.639415 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:17.645217 11595 raft_consensus.cc:1275] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:17:17.568892 13548 consensus_queue.cc:1059] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 12:17:17.619306 13570 raft_consensus.cc:2749] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:17.610842 13368 raft_consensus.cc:515] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:17.667757 11525 raft_consensus.cc:2410] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 12:17:17.668105 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 133965us
I20260709 12:17:17.666458 12348 raft_consensus.cc:2468] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 6.
I20260709 12:17:17.668792 13084 consensus_queue.cc:237] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:17.636669 13592 raft_consensus.cc:2749] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:17.670886 11493 leader_election.cc:304] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:17.663662 13578 raft_consensus.cc:993] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8: : Instructing follower b126028166e8480ba25541bf8f7fc6de to start an election
I20260709 12:17:17.644333 13301 raft_consensus.cc:2804] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:17:17.677235 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 140652us
I20260709 12:17:17.618814 13461 raft_consensus.cc:515] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:17.683770 11419 leader_election.cc:304] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:17.685117 11417 leader_election.cc:304] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:17:17.641862 13517 consensus_queue.cc:1048] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:17:17.667107 13286 raft_consensus.cc:697] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [term 5 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:17.714298 11567 leader_election.cc:304] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:17.680677 13301 raft_consensus.cc:493] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:17.721544 12203 leader_election.cc:304] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:17.711391 13471 raft_consensus.cc:2804] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:17.712323 13578 raft_consensus.cc:1081] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 5 LEADER]: Signalling peer b126028166e8480ba25541bf8f7fc6de to start an election
I20260709 12:17:17.726481 13301 raft_consensus.cc:3060] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:17.730830 13567 raft_consensus.cc:2804] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:17.715950 13597 raft_consensus.cc:2749] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:17.750448 13601 raft_consensus.cc:3055] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:17.739039 13579 raft_consensus.cc:2749] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:17.751938 13368 leader_election.cc:290] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:17.751749 13584 consensus_queue.cc:1059] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.130s
I20260709 12:17:17.752419 13586 consensus_queue.cc:1048] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:17:17.754084 13521 leader_election.cc:290] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:17.754619 13286 consensus_queue.cc:237] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:17.754722 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:17.724728 13162 consensus_queue.cc:1059] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 12:17:17.750991 13590 raft_consensus.cc:2804] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:17.738303 13356 raft_consensus.cc:2749] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:17:17.802634 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 117605us
I20260709 12:17:17.780109 12347 raft_consensus.cc:1275] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:17.757146 13461 leader_election.cc:290] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
W20260709 12:17:17.798188 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 114500us
I20260709 12:17:17.798916 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:17.800140 12345 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f"
dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
 from {username='slave'} at 127.0.0.1:51706
I20260709 12:17:17.733992 13355 consensus_queue.cc:237] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:17.801126 13602 raft_consensus.cc:2804] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:17.768292 13567 raft_consensus.cc:493] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:17.800781 13581 raft_consensus.cc:2749] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:17.776005 13592 consensus_queue.cc:1059] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:17:17.736756 13471 raft_consensus.cc:697] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 6 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:17.793761 13385 consensus_queue.cc:1048] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:17:17.772676 13601 raft_consensus.cc:740] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:17.804486 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:17.803844 13551 raft_consensus.cc:493] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:17.805205 11419 leader_election.cc:304] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:17.795776 13583 raft_consensus.cc:493] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
W20260709 12:17:17.829118 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 124026us
I20260709 12:17:17.829619 11595 raft_consensus.cc:3060] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:17.827056 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:17.830677 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:17.805797 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:17:17.813333 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 91840.6us
I20260709 12:17:17.806384 11600 raft_consensus.cc:2468] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 4.
I20260709 12:17:17.836592 12203 leader_election.cc:304] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:17.836691 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:17:17.811094 13593 log.cc:927] Time spent T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
W20260709 12:17:17.810344 13591 log.cc:927] Time spent T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 12:17:17.838006 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:17:17.810840 13599 log.cc:927] Time spent T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 12:17:17.805219 13606 raft_consensus.cc:493] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.812849 13602 raft_consensus.cc:493] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:17.804906 13571 raft_consensus.cc:493] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.810295 13162 raft_consensus.cc:3055] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:17:17.857340 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 52227us
I20260709 12:17:17.809113 13567 raft_consensus.cc:3060] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:17.857666 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:17.810326 13464 leader_election.cc:290] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:17.815038 13590 raft_consensus.cc:697] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [term 5 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:17.869189 13590 consensus_queue.cc:237] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:17.828572 13582 leader_election.cc:290] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:17.873133 13592 consensus_queue.cc:1048] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:17.873340 11419 leader_election.cc:304] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:17.856030 13602 raft_consensus.cc:3060] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:17.874974 11419 leader_election.cc:304] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:17.876196 11419 leader_election.cc:304] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:17.863240 11597 raft_consensus.cc:1275] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:17.860894 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:17.864995 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:17.867420 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:17.876989 11491 leader_election.cc:304] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:17.878779 11602 raft_consensus.cc:2468] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 7.
I20260709 12:17:17.887336 11419 leader_election.cc:304] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:17.889616 11491 leader_election.cc:304] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d
I20260709 12:17:17.862051 13162 raft_consensus.cc:740] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:17.892225 13521 raft_consensus.cc:493] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:17.892426 11453 raft_consensus.cc:1275] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:17.892884 13521 raft_consensus.cc:515] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:17.894264 13464 raft_consensus.cc:2749] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:17.895067 13521 leader_election.cc:290] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:17.874909 13592 raft_consensus.cc:2749] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:17.897105 12345 raft_consensus.cc:493] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:17.801863 13604 consensus_queue.cc:1048] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 12:17:17.899197 12345 raft_consensus.cc:3060] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:17.899212 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:17.900749 11491 leader_election.cc:304] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:17.876221 13532 raft_consensus.cc:2749] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:17:17.919467 13575 log.cc:927] Time spent T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.545s	user 0.003s	sys 0.000s
I20260709 12:17:17.855902 13520 consensus_queue.cc:1048] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:17:17.873136 13611 raft_consensus.cc:2749] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:17.876416 13571 raft_consensus.cc:515] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:17.926884 11601 raft_consensus.cc:2468] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 3.
I20260709 12:17:17.928068 13571 leader_election.cc:290] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:17.928719 13317 consensus_queue.cc:260] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:17.929978 13317 raft_consensus.cc:3060] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:17.902884 13464 raft_consensus.cc:2804] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:17.932515 13464 raft_consensus.cc:493] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:17.932900 13464 raft_consensus.cc:3060] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:17.934263 11419 leader_election.cc:304] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:17.935293 13548 raft_consensus.cc:2804] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:17.935828 13548 raft_consensus.cc:697] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 8 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:17.936731 13548 consensus_queue.cc:237] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:17.835134 13551 raft_consensus.cc:515] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:17.940016 13551 leader_election.cc:290] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:17.897248 13603 raft_consensus.cc:2749] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:17.856009 13606 raft_consensus.cc:515] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:17.957039 11448 raft_consensus.cc:1240] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:17.958439 13606 leader_election.cc:290] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:17.905478 13608 raft_consensus.cc:2749] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:17.836364 13583 raft_consensus.cc:515] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:17.898058 13289 raft_consensus.cc:515] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:17.908317 13617 raft_consensus.cc:2749] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:17.910001 11452 raft_consensus.cc:2393] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 3: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:17.911057 13468 raft_consensus.cc:2749] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:17.912496 13581 raft_consensus.cc:2749] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:17.960565 12345 raft_consensus.cc:515] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:17.897492 13589 raft_consensus.cc:493] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:17.810312 13471 consensus_queue.cc:237] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:17.941591 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d43eecbad746fd9ddce50c5b9fc3e8" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:17.943320 13592 raft_consensus.cc:493] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
W20260709 12:17:17.944435 11568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:17.972046 11448 raft_consensus.cc:1240] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:17.973934 11450 raft_consensus.cc:1240] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 4. Current term is 5. Ops: []
W20260709 12:17:17.974911 11566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:17.974998 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
W20260709 12:17:17.975942 13605 log.cc:927] Time spent T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 12:17:17.976128 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9fe9a94294836aec652338f44367d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:17.977604 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:17.977803 13162 consensus_queue.cc:260] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:17.979064 13162 raft_consensus.cc:3060] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:17.979700 13571 consensus_queue.cc:1059] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:17:17.981094 13595 log.cc:927] Time spent T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 12:17:17.982913 13612 raft_consensus.cc:493] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:17.982594 13475 consensus_queue.cc:260] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:17.983469 13612 raft_consensus.cc:515] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:17.984079 13475 raft_consensus.cc:3060] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:17.984683 12203 leader_election.cc:304] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:17.986588 13356 raft_consensus.cc:2804] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:17.987139 13356 raft_consensus.cc:697] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:17.987673 13608 raft_consensus.cc:493] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:17.987982 13356 consensus_queue.cc:237] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:17.988230 13608 raft_consensus.cc:515] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:17.990670 13608 leader_election.cc:290] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:17.992153 11521 raft_consensus.cc:1240] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:17.992604 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:17.993726 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:17.994521 11526 raft_consensus.cc:2393] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 8: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:17:17.995510 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9fe9a94294836aec652338f44367d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:17.944900 13582 raft_consensus.cc:493] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:17.944957 13604 raft_consensus.cc:493] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:17.947863 13602 raft_consensus.cc:515] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:17.948323 11447 raft_consensus.cc:1240] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:17:17.998337 13604 raft_consensus.cc:515] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:17.999029 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:17.999732 11447 raft_consensus.cc:2468] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 6.
I20260709 12:17:18.000341 13612 leader_election.cc:290] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:17.950340 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:17.950505 13556 raft_consensus.cc:3055] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:17.951056 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:17:17.952744 13560 log.cc:927] Time spent T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.801s	user 0.004s	sys 0.008s
I20260709 12:17:17.950517 11446 raft_consensus.cc:1240] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:17.903846 11491 leader_election.cc:304] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:17.913784 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d43eecbad746fd9ddce50c5b9fc3e8" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:18.000708 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:18.000995 13582 raft_consensus.cc:515] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:18.001747 11453 raft_consensus.cc:2393] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 5: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:18.002002 12349 raft_consensus.cc:2468] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 6.
I20260709 12:17:18.002170 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:18.002792 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:18.000982 13556 raft_consensus.cc:740] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:18.003283 13582 leader_election.cc:290] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:18.003647 11453 raft_consensus.cc:2393] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 6: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:18.004483 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:18.002888 11447 raft_consensus.cc:3060] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:18.005141 11453 raft_consensus.cc:2368] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for earlier term 5. Current term is 6.
I20260709 12:17:17.948985 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:18.005774 11446 raft_consensus.cc:3055] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:18.006178 11446 raft_consensus.cc:740] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:18.007072 11446 consensus_queue.cc:260] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:18.004070 13556 consensus_queue.cc:260] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:17.973187 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:17.960011 13310 raft_consensus.cc:3060] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:18.022238 12352 raft_consensus.cc:2468] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 3.
W20260709 12:17:18.014205 11567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:18.012079 11566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:18.014909 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 111132us
I20260709 12:17:18.009214 11599 raft_consensus.cc:1240] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:18.002831 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:18.024755 11491 leader_election.cc:304] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:17.993089 13461 raft_consensus.cc:493] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:18.009096 11446 raft_consensus.cc:3060] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:18.032431 11491 leader_election.cc:304] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:17.965425 11595 raft_consensus.cc:2468] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 8.
I20260709 12:17:18.024834 12349 raft_consensus.cc:2468] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 5.
I20260709 12:17:18.018373 11447 raft_consensus.cc:2468] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 6.
I20260709 12:17:17.920620 13601 consensus_queue.cc:260] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:18.027992 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:18.034849 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:18.035578 11526 raft_consensus.cc:2468] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 3.
I20260709 12:17:18.037497 13468 raft_consensus.cc:2804] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:18.039986 13468 raft_consensus.cc:493] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:18.040727 11567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:18.041285 11491 leader_election.cc:304] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:18.043632 11491 leader_election.cc:304] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:18.026592 13570 raft_consensus.cc:2749] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:18.040396 13468 raft_consensus.cc:3060] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:18.056636 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 71037.9us
I20260709 12:17:18.044723 13499 raft_consensus.cc:2749] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:18.040668 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:18.030467 13368 consensus_queue.cc:1048] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:17:18.059326 13520 consensus_queue.cc:1048] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:18.047688 13565 raft_consensus.cc:2804] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:18.031263 13301 raft_consensus.cc:515] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:18.083803 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:18.060562 13590 raft_consensus.cc:2804] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:18.088603 11491 leader_election.cc:304] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:18.038029 13461 raft_consensus.cc:515] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:18.062034 13556 raft_consensus.cc:3060] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:18.096037 11491 leader_election.cc:304] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:18.091579 13301 leader_election.cc:290] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:18.025863 13592 raft_consensus.cc:515] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:18.012208 13589 raft_consensus.cc:515] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:18.102900 11519 raft_consensus.cc:1240] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:18.104585 13590 raft_consensus.cc:697] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 8 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:18.105785 13570 raft_consensus.cc:2749] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:18.106631 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:18.107554 11595 raft_consensus.cc:1240] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:17:18.106670 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:18.108642 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:18.110088 13289 leader_election.cc:290] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
W20260709 12:17:18.121073 11568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:18.118034 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:18.122957 11522 raft_consensus.cc:2393] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 6: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:17:18.128898 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:18.089493 13565 raft_consensus.cc:493] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:18.141132 11567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:18.051954 13567 raft_consensus.cc:515] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:18.147969 13584 raft_consensus.cc:493] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.116287 13461 leader_election.cc:290] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:18.116120 13627 raft_consensus.cc:493] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:18.172282 13509 raft_consensus.cc:3060] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:18.142685 13565 raft_consensus.cc:3060] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:18.182806 11446 raft_consensus.cc:1275] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:17:18.191627 13618 log.cc:927] Time spent T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.094s	user 0.001s	sys 0.001s
I20260709 12:17:18.185511 13532 raft_consensus.cc:493] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:18.191282 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:18.230567 12346 raft_consensus.cc:2468] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 5.
I20260709 12:17:18.232192 13467 raft_consensus.cc:3060] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:17:18.192313 13619 log.cc:927] Time spent T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.156s	user 0.003s	sys 0.000s
I20260709 12:17:18.188959 13590 consensus_queue.cc:237] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:18.205122 13567 leader_election.cc:290] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
W20260709 12:17:18.205834 13623 log.cc:927] Time spent T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 12:17:18.237341 11451 raft_consensus.cc:1240] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:17:18.206638 13589 leader_election.cc:290] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:18.130777 13495 consensus_queue.cc:1059] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 12:17:18.238864 11451 raft_consensus.cc:1240] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 12:17:18.179551 13627 raft_consensus.cc:515] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:18.216496 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
W20260709 12:17:18.187441 13620 log.cc:927] Time spent T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 12:17:18.162881 13584 raft_consensus.cc:515] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:18.218286 13592 leader_election.cc:290] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:18.246129 13627 leader_election.cc:290] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:18.222630 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8741606df54c3f8b5cc5c1141862ea" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:18.197167 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:18.247675 11446 raft_consensus.cc:2393] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 5: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:18.247968 13584 leader_election.cc:290] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:18.229789 13205 leader_election.cc:290] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:18.214852 13464 raft_consensus.cc:515] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:18.250730 13464 leader_election.cc:290] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:18.245193 11451 raft_consensus.cc:1275] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:18.246204 11449 raft_consensus.cc:2393] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 5: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:18.253093 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:18.235908 13532 raft_consensus.cc:515] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:18.255477 13532 leader_election.cc:290] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:18.256071 13205 raft_consensus.cc:493] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:18.256723 13205 raft_consensus.cc:515] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:18.258908 13205 leader_election.cc:290] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:17:18.259915 13199 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 12:17:18.264921 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:18.269337 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:18.266860 11522 raft_consensus.cc:2468] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 8.
I20260709 12:17:18.276108 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:18.272789 13229 raft_consensus.cc:3055] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:18.277814 13229 raft_consensus.cc:740] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:18.278399 11526 raft_consensus.cc:1240] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:18.278635 13229 consensus_queue.cc:260] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:18.281962 11523 raft_consensus.cc:1275] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:18.252271 13468 raft_consensus.cc:515] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:18.287067 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:18.288681 11449 raft_consensus.cc:2468] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 5.
I20260709 12:17:18.287987 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:18.294660 12203 leader_election.cc:304] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:18.294786 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:18.267309 13532 raft_consensus.cc:493] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.303726 11526 raft_consensus.cc:2393] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 5: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:17:18.304114 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:18.305061 11521 raft_consensus.cc:2393] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 5: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:17:18.306026 12204 leader_election.cc:304] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:18.311945 13602 leader_election.cc:290] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:18.306701 13356 consensus_queue.cc:1048] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:17:18.316097 13583 leader_election.cc:290] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:18.316342 13356 raft_consensus.cc:2804] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:18.316875 13356 raft_consensus.cc:493] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:18.317235 13356 raft_consensus.cc:3060] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:18.317948 13638 raft_consensus.cc:493] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.318533 13638 raft_consensus.cc:515] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:18.320504 13602 raft_consensus.cc:493] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.321192 13602 raft_consensus.cc:515] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
W20260709 12:17:18.322454 13635 log.cc:927] Time spent T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 12:17:18.323156 13626 raft_consensus.cc:2804] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:18.323685 13626 raft_consensus.cc:493] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:18.324061 13626 raft_consensus.cc:3060] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:18.305990 13612 consensus_queue.cc:1048] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:17:18.325709 13565 raft_consensus.cc:515] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:18.327201 11523 raft_consensus.cc:2368] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de for earlier term 3. Current term is 4.
I20260709 12:17:18.328418 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:18.294847 13229 raft_consensus.cc:3060] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:18.329265 11593 raft_consensus.cc:2393] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 3: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:17:18.332703 12204 leader_election.cc:304] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:18.336220 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390e91331fd04f97a5235133a34875ee" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:18.330376 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:18.337564 11595 raft_consensus.cc:2468] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 8.
W20260709 12:17:18.319048 13628 log.cc:927] Time spent T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.261s	user 0.002s	sys 0.000s
I20260709 12:17:18.341013 11595 raft_consensus.cc:1240] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:18.341745 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:18.342142 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
W20260709 12:17:18.341663 11568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:18.345007 11445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35814 (request call id 274) took 1034 ms. Trace:
I20260709 12:17:18.345412 11445 rpcz_store.cc:276] 0709 12:17:17.311125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:17.311295 (+   170us) service_pool.cc:224] Handling call
0709 12:17:17.320524 (+  9229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:17.386113 (+ 65589us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:17.386149 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:17.386192 (+    43us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:17.386222 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:18.344779 (+958557us) spinlock_profiling.cc:243] Waited 65.3 ms on lock 0x7b5400107554. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:17:18.344824 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:18.344952 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":150268288}
I20260709 12:17:18.308164 13532 raft_consensus.cc:515] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:18.301457 13289 raft_consensus.cc:493] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:18.347592 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:18.348866 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:18.344885 13592 raft_consensus.cc:493] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:18.313683 13559 log.cc:927] Time spent T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 1.164s	user 0.003s	sys 0.000s
I20260709 12:17:18.321070 13638 leader_election.cc:290] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:18.362896 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:18.354171 11519 raft_consensus.cc:1275] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:18.359494 11566 leader_election.cc:304] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:18.367784 11566 leader_election.cc:304] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:18.369275 13638 consensus_queue.cc:1059] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:18.373713 13520 raft_consensus.cc:3055] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:18.374140 13520 raft_consensus.cc:740] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:18.374953 13520 consensus_queue.cc:260] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:18.380285 11597 raft_consensus.cc:2468] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 5.
I20260709 12:17:18.316149 13468 leader_election.cc:290] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:18.381449 13602 leader_election.cc:290] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:18.348272 13504 raft_consensus.cc:2749] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:18.352277 13612 consensus_queue.cc:1048] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:17:18.386711 11528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33456 (request call id 970) took 1668 ms. Trace:
I20260709 12:17:18.387202 11528 rpcz_store.cc:276] 0709 12:17:16.718147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:16.721128 (+  2981us) service_pool.cc:224] Handling call
0709 12:17:16.734306 (+ 13178us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:16.742094 (+  7788us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:16.742127 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:16.770843 (+ 28716us) log.cc:844] Serialized 26 byte log entry
0709 12:17:17.068609 (+297766us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:17.068655 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:17.068742 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:18.312944 (+1244202us) spinlock_profiling.cc:243] Waited 2.79 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e675e86e 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221 00007f84e67671d9 00007f84e6767169
0709 12:17:18.386398 (+ 73454us) raft_consensus.cc:1685] finished
0709 12:17:18.386418 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:18.386649 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":102,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":129,"spinlock_wait_cycles":6430464,"thread_start_us":188420,"threads_started":1,"wal-append.queue_time_us":307102}
I20260709 12:17:18.389603 13592 raft_consensus.cc:515] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:18.390671 13565 leader_election.cc:290] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:18.391883 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:18.386814 13626 raft_consensus.cc:515] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:18.396306 13551 raft_consensus.cc:2749] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:18.368697 13571 raft_consensus.cc:2804] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:18.404640 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:18.405483 11453 raft_consensus.cc:2368] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for earlier term 4. Current term is 5.
I20260709 12:17:18.407351 12348 raft_consensus.cc:1240] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [term 5 LEADER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:18.408805 11596 raft_consensus.cc:2468] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 4.
I20260709 12:17:18.409184 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:18.409458 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:18.410953 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:18.411592 11601 raft_consensus.cc:3060] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:18.413125 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7937e0cff84ef7a26c84247c8ffc08" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:18.414429 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390e91331fd04f97a5235133a34875ee" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:18.416040 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8741606df54c3f8b5cc5c1141862ea" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:18.402321 13310 raft_consensus.cc:493] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.416743 13310 raft_consensus.cc:515] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:18.412312 11417 leader_election.cc:304] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:18.419914 11596 raft_consensus.cc:2468] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 4.
I20260709 12:17:18.391958 13592 leader_election.cc:290] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:18.422595 11601 raft_consensus.cc:2468] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 5.
I20260709 12:17:18.423244 13475 raft_consensus.cc:2749] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:18.423728 11417 leader_election.cc:304] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:18.405912 13571 raft_consensus.cc:493] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:18.362738 13289 raft_consensus.cc:515] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:18.402357 13199 consensus_queue.cc:1059] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 12:17:18.421895 13509 raft_consensus.cc:493] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:18.435161 11417 leader_election.cc:304] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:18.437824 13509 raft_consensus.cc:515] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:18.442438 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390e91331fd04f97a5235133a34875ee" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:18.443164 11451 raft_consensus.cc:2468] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 4.
I20260709 12:17:18.445367 13594 raft_consensus.cc:3055] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:18.445868 13594 raft_consensus.cc:740] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:18.446645 13594 consensus_queue.cc:260] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:18.447081 13356 raft_consensus.cc:515] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:18.437088 13589 raft_consensus.cc:2749] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:18.451678 13289 leader_election.cc:290] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:18.452235 13532 leader_election.cc:290] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:18.452401 13475 raft_consensus.cc:3055] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:17:18.436079 13622 log.cc:927] Time spent T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.352s	user 0.002s	sys 0.000s
I20260709 12:17:18.452796 13475 raft_consensus.cc:740] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:18.453725 13475 consensus_queue.cc:260] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:18.454231 13310 leader_election.cc:290] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:18.429661 13571 raft_consensus.cc:3060] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:18.455106 13475 raft_consensus.cc:3060] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:18.462433 13626 leader_election.cc:290] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:18.467397 13509 leader_election.cc:290] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:18.468933 13603 raft_consensus.cc:2749] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:18.470381 11417 leader_election.cc:304] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:18.472896 13356 leader_election.cc:290] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:18.474090 13603 raft_consensus.cc:2804] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:18.474601 13603 raft_consensus.cc:697] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 5 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:18.475230 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:18.475534 13603 consensus_queue.cc:237] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:18.477650 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:18.478389 12356 raft_consensus.cc:2368] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 for earlier term 8. Current term is 9.
I20260709 12:17:18.488078 12349 raft_consensus.cc:1275] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:18.489799 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:18.474124 13568 raft_consensus.cc:3055] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:17:18.497910 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 148116us
I20260709 12:17:18.499814 12204 leader_election.cc:304] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:18.495040 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:18.492758 13229 raft_consensus.cc:493] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:18.498135 13568 raft_consensus.cc:740] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:18.510494 12204 leader_election.cc:400] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 election: Vote denied by peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063) with higher term. Message: Invalid argument: T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de for earlier term 3. Current term is 4.
I20260709 12:17:18.510167 13229 raft_consensus.cc:515] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:18.510903 12204 leader_election.cc:403] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:17:18.499648 13190 raft_consensus.cc:2749] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 4 LEADER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:18.502480 13356 raft_consensus.cc:3060] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:18.517365 13229 leader_election.cc:290] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:18.518051 12352 raft_consensus.cc:1240] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:17:18.519013 13568 consensus_queue.cc:260] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:18.519505 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:18.520598 13568 raft_consensus.cc:3060] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:18.510308 12346 raft_consensus.cc:2468] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 6.
I20260709 12:17:18.517478 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:18.526701 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:18.514816 13413 raft_consensus.cc:3060] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:18.529063 13603 consensus_queue.cc:1059] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:18.530237 13603 raft_consensus.cc:3055] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:18.530587 13603 raft_consensus.cc:740] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:18.531414 13603 consensus_queue.cc:260] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:18.532604 13603 raft_consensus.cc:3060] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:18.525725 13205 raft_consensus.cc:493] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.533713 13205 raft_consensus.cc:515] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:18.536005 13205 leader_election.cc:290] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:18.541327 13604 leader_election.cc:290] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:18.542550 13413 raft_consensus.cc:2749] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063) with higher term. Message: Invalid argument: T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de for earlier term 3. Current term is 4.
I20260709 12:17:18.551887 13601 raft_consensus.cc:3060] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:18.552345 13413 raft_consensus.cc:493] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.552918 13413 raft_consensus.cc:515] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:18.555117 13413 leader_election.cc:290] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
W20260709 12:17:18.556768 13600 log.cc:927] Time spent T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.823s	user 0.003s	sys 0.000s
I20260709 12:17:18.542563 13571 raft_consensus.cc:515] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:18.559926 11446 raft_consensus.cc:1240] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:18.560489 13571 leader_election.cc:290] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:18.562290 11452 raft_consensus.cc:1275] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:18.568416 13413 raft_consensus.cc:493] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.569069 13413 raft_consensus.cc:515] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:18.569993 13168 raft_consensus.cc:3060] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:18.571262 13413 leader_election.cc:290] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:18.569141 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:18.580665 11417 leader_election.cc:304] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:18.582261 13557 consensus_queue.cc:1048] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:18.582895 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:18.584386 13557 consensus_queue.cc:1059] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:18.573581 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:18.594837 12357 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51698 (request call id 657) took 2063 ms. Trace:
I20260709 12:17:18.596014 13581 raft_consensus.cc:2804] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:18.596706 13581 raft_consensus.cc:493] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:18.597172 13581 raft_consensus.cc:3060] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:18.598631 11598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 733) took 1123 ms. Trace:
I20260709 12:17:18.599350 11525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38272 (request call id 311) took 1340 ms. Trace:
I20260709 12:17:18.600253 13469 consensus_queue.cc:1059] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:18.596941 11565 leader_election.cc:304] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:17:18.601513 11520 raft_consensus.cc:1275] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:17:18.599545 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 255409us
I20260709 12:17:18.602895 11491 leader_election.cc:304] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:18.599102 11598 rpcz_store.cc:276] 0709 12:17:17.475174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:17.477508 (+  2334us) service_pool.cc:224] Handling call
0709 12:17:17.477931 (+   423us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:17.478347 (+   416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:17.478379 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:17.478995 (+   616us) log.cc:844] Serialized 52 byte log entry
0709 12:17:17.625087 (+146092us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:17.627298 (+  2211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:17.643766 (+ 16468us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:18.556144 (+912378us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e675e86e 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221 00007f84e67671d9 00007f84e6767169
0709 12:17:18.598364 (+ 42220us) raft_consensus.cc:1685] finished
0709 12:17:18.598387 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:18.598575 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1412,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":113,"spinlock_wait_cycles":296939264,"thread_start_us":137149,"threads_started":1,"wal-append.queue_time_us":222849}
I20260709 12:17:18.603977 11523 raft_consensus.cc:1240] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:17:18.604177 13576 raft_consensus.cc:2804] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:18.604753 13576 raft_consensus.cc:697] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 4 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:18.605044 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:18.605839 13399 consensus_queue.cc:1059] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:18.605647 13576 consensus_queue.cc:237] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:18.606623 13399 consensus_queue.cc:1048] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:18.606899 13478 raft_consensus.cc:3055] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:18.607373 13478 raft_consensus.cc:740] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:18.608433 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:18.610081 11522 raft_consensus.cc:1275] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:18.604192 13607 raft_consensus.cc:493] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.611150 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390e91331fd04f97a5235133a34875ee" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:18.611339 13607 raft_consensus.cc:515] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:18.595368 12357 rpcz_store.cc:276] 0709 12:17:16.531465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:16.552989 (+ 21524us) service_pool.cc:224] Handling call
0709 12:17:18.594572 (+2041583us) spinlock_profiling.cc:243] Waited 1.83 s on lock 0x7b54000078d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:18.594734 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4197825280}
I20260709 12:17:18.611809 13570 raft_consensus.cc:493] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.612545 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:18.612845 11491 leader_election.cc:400] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 election: Vote denied by peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579) with higher term. Message: Invalid argument: T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for earlier term 5. Current term is 6.
I20260709 12:17:18.613240 11491 leader_election.cc:403] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:17:18.612938 13570 raft_consensus.cc:515] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:18.615578 13570 leader_election.cc:290] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:18.599896 11525 rpcz_store.cc:276] 0709 12:17:17.258917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:17.267787 (+  8870us) service_pool.cc:224] Handling call
0709 12:17:18.599123 (+1331336us) spinlock_profiling.cc:243] Waited 364 ms on lock 0x7b54006de7d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:18.599295 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":836978560}
I20260709 12:17:18.633746 11522 raft_consensus.cc:2393] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 4: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:17:18.603977 11521 raft_consensus.cc:1240] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 5. Current term is 6. Ops: []
W20260709 12:17:18.617962 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 278394us
I20260709 12:17:18.619733 13556 consensus_queue.cc:1048] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:18.621510  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:18.622285 12345 leader_election.cc:290] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:18.623093 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ed4eeff0ae44d0bc1ebb8cbe3adea5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:18.608180 13478 consensus_queue.cc:260] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:18.596076 11419 leader_election.cc:304] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:18.641789 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:18.639110 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:18.643687 12345 raft_consensus.cc:2410] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:18.640538 12356 raft_consensus.cc:2468] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 4.
I20260709 12:17:18.641577 11594 raft_consensus.cc:1275] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:18.652491 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:18.653746 11527 raft_consensus.cc:2393] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 8: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:17:18.654440 11523 raft_consensus.cc:1240] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:17:18.654964 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7937e0cff84ef7a26c84247c8ffc08" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:18.605439 13385 raft_consensus.cc:2804] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:17:18.657564 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 44872.6us
I20260709 12:17:18.663319 11491 leader_election.cc:304] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:18.602247 13569 raft_consensus.cc:3060] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:18.658191 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:18.668041 11522 raft_consensus.cc:3060] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:17:18.666988 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 71004.4us
I20260709 12:17:18.669060 11419 leader_election.cc:304] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:18.649585 13570 raft_consensus.cc:2749] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579) with higher term. Message: Invalid argument: T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for earlier term 5. Current term is 6.
I20260709 12:17:18.653540 13571 raft_consensus.cc:493] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.674292 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:18.680776 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:18.659858 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:18.685703 11419 leader_election.cc:304] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:18.686242 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:18.687016 11521 raft_consensus.cc:2468] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 6.
I20260709 12:17:18.682204 11491 leader_election.cc:400] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 election: Vote denied by peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579) with higher term. Message: Invalid argument: T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for earlier term 4. Current term is 5.
I20260709 12:17:18.662376 13385 raft_consensus.cc:493] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:18.681020 11527 raft_consensus.cc:2468] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 5.
I20260709 12:17:18.682101 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:18.670852 13471 raft_consensus.cc:2804] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:18.672691 13617 raft_consensus.cc:2749] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:18.667955 13578 raft_consensus.cc:3055] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:18.669178 13589 raft_consensus.cc:493] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.670323 13478 raft_consensus.cc:3060] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:18.688926 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:18.691728 11594 raft_consensus.cc:1275] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:18.701689 12204 leader_election.cc:304] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:18.686525 11524 raft_consensus.cc:2393] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 5: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:17:18.702322 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:18.672581 13356 raft_consensus.cc:2749] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:18.703202 11519 raft_consensus.cc:2410] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:18.693199 11419 leader_election.cc:304] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:18.703953 12204 leader_election.cc:304] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:18.697166 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:18.706333 11527 raft_consensus.cc:3060] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:18.704238 12848 consensus_queue.cc:1048] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 12:17:18.714973 12349 raft_consensus.cc:1240] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:17:18.717497 13199 raft_consensus.cc:2749] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:18.719084 13520 raft_consensus.cc:3060] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:18.717226 11494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:18.717052 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ed4eeff0ae44d0bc1ebb8cbe3adea5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:18.728940 11602 raft_consensus.cc:2468] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 4.
I20260709 12:17:18.716311 11418 leader_election.cc:304] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
W20260709 12:17:18.727682 11494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:18.682922 13469 consensus_queue.cc:1048] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:17:18.692341 13610 raft_consensus.cc:2749] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:18.678390 13608 consensus_queue.cc:1059] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:17:18.692178 13592 raft_consensus.cc:2749] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:18.734045 11447 raft_consensus.cc:1275] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:18.692502 13385 raft_consensus.cc:3060] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:18.731503 13084 consensus_queue.cc:1048] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:17:18.732653 13408 raft_consensus.cc:2804] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:18.741367 12345 raft_consensus.cc:1275] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:17:18.715188 11598 raft_consensus.cc:2393] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 4: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:17:18.741447 11452 raft_consensus.cc:1275] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:18.699108 13578 raft_consensus.cc:740] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:18.744632 13604 raft_consensus.cc:2749] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:18.751660 13578 consensus_queue.cc:260] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:18.755827 13603 consensus_queue.cc:1048] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:18.732870 13627 raft_consensus.cc:2804] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:18.761729 13627 raft_consensus.cc:493] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:18.762218 13627 raft_consensus.cc:3060] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:18.764068 13607 leader_election.cc:290] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:18.765197 13607 raft_consensus.cc:493] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:18.765986 13651 log.cc:927] Time spent T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 12:17:18.765794 13607 raft_consensus.cc:515] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:18.685971 13571 raft_consensus.cc:515] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:18.768371 13607 leader_election.cc:290] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:18.764694 11527 raft_consensus.cc:2468] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 6.
I20260709 12:17:18.769572 13571 leader_election.cc:290] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:18.736315 13399 raft_consensus.cc:493] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.771476 13399 raft_consensus.cc:515] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:18.745064 13408 raft_consensus.cc:493] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:18.774179 13408 raft_consensus.cc:3060] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:18.742360 13140 raft_consensus.cc:493] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.707042 13589 raft_consensus.cc:515] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:18.778016 13140 raft_consensus.cc:515] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:18.706485 13521 consensus_queue.cc:1059] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 12:17:18.780377 13521 raft_consensus.cc:3055] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:18.780742 13521 raft_consensus.cc:740] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:18.781481 13589 leader_election.cc:290] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:18.731175 13471 raft_consensus.cc:697] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 6 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:18.784698 13471 consensus_queue.cc:237] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:18.786648 13521 consensus_queue.cc:260] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:18.788458 13521 raft_consensus.cc:3060] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:18.789345 13610 raft_consensus.cc:493] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.790011 13610 raft_consensus.cc:515] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:18.790498 11450 raft_consensus.cc:2410] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:18.790766 13589 raft_consensus.cc:493] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.791347 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:18.753221 13578 raft_consensus.cc:3060] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:18.793771 13610 leader_election.cc:290] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:18.797283 13399 leader_election.cc:290] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:18.798547 13581 raft_consensus.cc:515] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:18.804378 11522 raft_consensus.cc:2468] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 9.
I20260709 12:17:18.812251 13594 raft_consensus.cc:3060] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:18.814581 12203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:18.815603 13356 raft_consensus.cc:493] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.816254 13356 raft_consensus.cc:515] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:18.818516 13356 leader_election.cc:290] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
W20260709 12:17:18.820325 13652 log.cc:927] Time spent T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 12:17:18.822491 13573 raft_consensus.cc:493] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.823143 13573 raft_consensus.cc:515] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:18.825598 11600 raft_consensus.cc:2468] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 3.
I20260709 12:17:18.828784 13573 leader_election.cc:290] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:18.825489 13581 leader_election.cc:290] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:18.837999 13569 raft_consensus.cc:2749] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:18.638029  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:18.839704 13408 raft_consensus.cc:515] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
W20260709 12:17:18.842020 13654 log.cc:927] Time spent T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.127s	user 0.002s	sys 0.000s
I20260709 12:17:18.842188 11452 raft_consensus.cc:1275] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:17:18.842988 11596 raft_consensus.cc:1275] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:17:18.860855 12206 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:18.843417 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:18.843886 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:18.863454 12203 leader_election.cc:304] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:18.844116 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:18.844916 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:18.845368 13568 consensus_queue.cc:1048] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:18.845427 11451 raft_consensus.cc:1275] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:17:18.846426 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:18.847424 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a841f2f09ced40a4bbf33594e11bd7ad" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:18.871419 12349 raft_consensus.cc:2468] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 2.
I20260709 12:17:18.847584 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390e91331fd04f97a5235133a34875ee" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:18.871021 12357 raft_consensus.cc:2468] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 4.
I20260709 12:17:18.791239 13589 raft_consensus.cc:515] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:18.848704 11493 leader_election.cc:304] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:18.849260 13464 consensus_queue.cc:1048] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:18.849838 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:18.850307 13594 consensus_queue.cc:1048] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:18.850749 11528 raft_consensus.cc:2468] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 3.
I20260709 12:17:18.851137 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:18.875756 12359 raft_consensus.cc:2468] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 7.
I20260709 12:17:18.851816 11449 raft_consensus.cc:1275] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:18.876165 11493 leader_election.cc:304] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d
I20260709 12:17:18.852203 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:18.853112 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
W20260709 12:17:18.847512 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 92215.8us
I20260709 12:17:18.870733 11602 raft_consensus.cc:2468] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 6.
I20260709 12:17:18.870920 11446 raft_consensus.cc:2410] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:18.877208 11445 raft_consensus.cc:2468] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 7.
I20260709 12:17:18.879107 11524 raft_consensus.cc:3060] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:18.880772 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:18.882200 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390e91331fd04f97a5235133a34875ee" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:18.882867 11520 raft_consensus.cc:3060] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:18.885983 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:18.887184 11522 raft_consensus.cc:2410] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:18.871610 12203 leader_election.cc:304] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:18.890197 11493 leader_election.cc:304] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d
I20260709 12:17:18.892168 13084 raft_consensus.cc:2804] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:18.892562 13084 raft_consensus.cc:493] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:18.892882 13084 raft_consensus.cc:3060] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:18.893201 11493 leader_election.cc:304] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
W20260709 12:17:18.899061 11568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:18.903435 11520 raft_consensus.cc:2468] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 5.
I20260709 12:17:18.905908 11491 leader_election.cc:304] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
W20260709 12:17:18.913663 12204 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:18.914569 11417 leader_election.cc:304] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:18.917184 12203 leader_election.cc:304] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d
I20260709 12:17:18.916143 11567 leader_election.cc:304] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:18.922506 13356 raft_consensus.cc:2804] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:18.922992 13356 raft_consensus.cc:493] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:18.923347 13356 raft_consensus.cc:3060] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:18.915424 13570 raft_consensus.cc:2749] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:18.917681 11418 leader_election.cc:304] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:18.925577 13603 raft_consensus.cc:2804] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:18.925962 13603 raft_consensus.cc:493] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:18.926295 13603 raft_consensus.cc:3060] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:18.928743 11567 leader_election.cc:304] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:18.929486 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a841f2f09ced40a4bbf33594e11bd7ad" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:18.930169 11449 raft_consensus.cc:2468] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 1.
I20260709 12:17:18.928784 13140 leader_election.cc:290] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:18.930387 13604 raft_consensus.cc:2804] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:18.932750 13604 raft_consensus.cc:697] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [term 5 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:18.913030 13469 consensus_queue.cc:1048] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 12:17:18.933672 13604 consensus_queue.cc:237] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:18.935242 11274 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39286 (request call id 109) took 5070 ms. Trace:
I20260709 12:17:18.873836 13650 raft_consensus.cc:2749] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:18.929592 13551 raft_consensus.cc:2804] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:18.911130 13637 raft_consensus.cc:2749] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:18.937126 11600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40784 (request call id 273) took 1073 ms. Trace:
I20260709 12:17:18.940418 11491 leader_election.cc:304] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:18.937601 11600 rpcz_store.cc:276] 0709 12:17:17.863755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:17.864761 (+  1006us) service_pool.cc:224] Handling call
0709 12:17:18.936974 (+1072213us) spinlock_profiling.cc:243] Waited 947 ms on lock 0x7b540054c754. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:18.937067 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2178145024}
I20260709 12:17:18.943040 11524 raft_consensus.cc:1275] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:17:18.956202 11524 raft_consensus.cc:1275] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:17:18.956977 12204 leader_election.cc:304] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:18.959939 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:18.960912 13084 raft_consensus.cc:515] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:18.962492 11491 leader_election.cc:304] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:18.961449 13205 consensus_queue.cc:1048] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:17:18.967315 11453 raft_consensus.cc:2468] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 5.
I20260709 12:17:18.904767 13576 raft_consensus.cc:2749] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:18.873623 13581 consensus_queue.cc:1048] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.080s
I20260709 12:17:18.910662 13368 raft_consensus.cc:2804] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:18.910506 13564 raft_consensus.cc:493] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.911065 13608 raft_consensus.cc:2749] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:18.977923 13368 raft_consensus.cc:493] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:18.984766 13368 raft_consensus.cc:3060] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:18.985610 13662 log.cc:927] Time spent T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:17:18.954718 13399 raft_consensus.cc:2749] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:18.987457 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:18.988103 11454 raft_consensus.cc:2468] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 5.
I20260709 12:17:18.988952 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a841f2f09ced40a4bbf33594e11bd7ad" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:18.989537 11454 raft_consensus.cc:2468] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 1.
I20260709 12:17:18.990734 13356 raft_consensus.cc:515] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:18.993034 13356 leader_election.cc:290] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:18.971288 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:18.968298 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:18.935648 11274 rpcz_store.cc:276] 0709 12:17:13.864755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:13.865146 (+   391us) service_pool.cc:224] Handling call
0709 12:17:18.935170 (+5070024us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:15.597555 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:15.598243 (+   688us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:15.598291 (+    48us) write_op.cc:435] Acquired schema lock
0709 12:17:15.598309 (+    18us) tablet.cc:662] Decoding operations
0709 12:17:15.599924 (+  1615us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:15.600049 (+   125us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:15.600076 (+    27us) tablet.cc:685] Acquiring locks for 19 operations
0709 12:17:15.762162 (+162086us) tablet.cc:701] Row locks acquired
0709 12:17:15.762362 (+   200us) write_op.cc:260] PREPARE: finished
0709 12:17:15.762609 (+   247us) write_op.cc:270] Start()
0709 12:17:15.762764 (+   155us) write_op.cc:276] Timestamp: P: 1783599435762528 usec, L: 0
0709 12:17:15.762783 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:17:15.763550 (+   767us) log.cc:844] Serialized 7521 byte log entry
0709 12:17:16.254289 (+490739us) op_driver.cc:464] REPLICATION: finished
0709 12:17:16.421326 (+167037us) write_op.cc:301] APPLY: starting
0709 12:17:16.429708 (+  8382us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:16.443920 (+ 14212us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:16.444055 (+   135us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:16.480411 (+ 36356us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:16.480778 (+   367us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=19
0709 12:17:16.480820 (+    42us) write_op.cc:312] APPLY: finished
0709 12:17:16.481246 (+   426us) log.cc:844] Serialized 131 byte log entry
0709 12:17:16.481489 (+   243us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:16.481665 (+   176us) write_op.cc:454] Released schema lock
0709 12:17:16.481737 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:16.482162 (+   425us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:16.482192 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":39014,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":142186,"apply.run_cpu_time_us":4769,"apply.run_wall_time_us":74875,"num_ops":19,"prepare.queue_time_us":347224,"prepare.run_cpu_time_us":39601,"prepare.run_wall_time_us":413381,"raft.queue_time_us":210842,"raft.run_cpu_time_us":6339,"raft.run_wall_time_us":62951,"replication_time_us":491333,"thread_start_us":558431,"threads_started":4,"wal-append.queue_time_us":253090,"wal-append.run_cpu_time_us":16791,"wal-append.run_wall_time_us":1472458}]]}
I20260709 12:17:19.004217 11449 raft_consensus.cc:2468] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 7.
I20260709 12:17:18.977015 13084 leader_election.cc:290] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:18.974922 12204 leader_election.cc:304] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:18.952924 13551 raft_consensus.cc:493] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:19.005520 13551 raft_consensus.cc:3060] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:19.006211 13650 raft_consensus.cc:2749] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:19.006918 13630 raft_consensus.cc:2804] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:19.007380 13630 raft_consensus.cc:493] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:19.007712 13630 raft_consensus.cc:3060] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:19.010529 13564 raft_consensus.cc:515] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:19.010974 13168 raft_consensus.cc:493] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.011713 13168 raft_consensus.cc:515] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:18.967818 13627 raft_consensus.cc:515] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:19.015416 13627 leader_election.cc:290] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:18.980340 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:19.016418 11451 raft_consensus.cc:2468] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 7.
I20260709 12:17:18.995002 13569 raft_consensus.cc:2749] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:18.997866 11524 raft_consensus.cc:3055] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:19.017545 11524 raft_consensus.cc:740] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
W20260709 12:17:19.018016 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 76554.1us
I20260709 12:17:18.998598 11602 raft_consensus.cc:1275] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:17:19.018769 12203 leader_election.cc:304] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:18.999641 13581 consensus_queue.cc:1048] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:18.969224 11567 leader_election.cc:304] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:19.001724 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:19.002316 13385 raft_consensus.cc:515] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:18.966548 13468 raft_consensus.cc:493] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.019683 12203 leader_election.cc:304] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:19.025718 13521 consensus_queue.cc:1048] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:17:19.044494 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 75353.4us
I20260709 12:17:18.967140 13532 consensus_queue.cc:1048] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:17:19.024684 13626 consensus_queue.cc:1048] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:19.018389 11524 consensus_queue.cc:260] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:19.049682 11524 raft_consensus.cc:3060] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:19.028857 11453 raft_consensus.cc:2468] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 3.
I20260709 12:17:19.045014 12203 leader_election.cc:304] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
W20260709 12:17:19.045498 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 70646.9us
I20260709 12:17:19.047115 13576 consensus_queue.cc:1048] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:19.069087 11567 leader_election.cc:400] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 election: Vote denied by peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935) with higher term. Message: Invalid argument: T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 for earlier term 8. Current term is 9.
I20260709 12:17:19.062301 12204 leader_election.cc:304] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:19.074205 11597 raft_consensus.cc:2393] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 5: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:17:19.071020 11567 leader_election.cc:403] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:17:19.078558 11567 leader_election.cc:304] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:19.042389 13520 raft_consensus.cc:2804] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:19.082273 11567 leader_election.cc:304] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d
I20260709 12:17:19.069214 13650 raft_consensus.cc:2804] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:19.087145 11567 leader_election.cc:304] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:19.087975 13356 raft_consensus.cc:2804] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:19.091598 11417 leader_election.cc:304] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
W20260709 12:17:19.153736 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 53079.6us
I20260709 12:17:19.071162 13626 consensus_queue.cc:1243] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer a03223e9e41247c3a36b7b7c3d476671 log is divergent from this leader: its last log entry 6.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:17:19.082999 13556 consensus_queue.cc:1048] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:17:19.085810 13520 raft_consensus.cc:493] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:19.127442 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d43eecbad746fd9ddce50c5b9fc3e8" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:19.172441 11449 raft_consensus.cc:2393] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 5: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:19.048610 13468 raft_consensus.cc:515] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:19.069761 13615 raft_consensus.cc:2749] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:19.127489 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:19.174502 11445 raft_consensus.cc:3060] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:19.134089 13147 raft_consensus.cc:2804] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:19.127527 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:19.069175 13289 raft_consensus.cc:2804] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:19.095585 11567 leader_election.cc:304] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
W20260709 12:17:19.180439 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 84920us
I20260709 12:17:19.181207 11567 leader_election.cc:304] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:19.182204 11567 leader_election.cc:304] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:19.184826 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:19.163467 11527 pending_rounds.cc:85] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671: Aborting all ops after (but not including) 2
I20260709 12:17:19.185678 11527 pending_rounds.cc:107] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 12:17:19.186000 11527 raft_consensus.cc:2889] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:19.167968 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:19.096997 13571 raft_consensus.cc:2804] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:19.090235 13399 raft_consensus.cc:2749] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:19.172710 11524 raft_consensus.cc:1275] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:17:19.174099 13603 raft_consensus.cc:515] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:19.194895 11524 pending_rounds.cc:85] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671: Aborting all ops after (but not including) 3
I20260709 12:17:19.195322 11524 pending_rounds.cc:107] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:17:19.195706 11524 raft_consensus.cc:2889] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:19.083389 13509 raft_consensus.cc:3060] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:17:19.177336 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 85820.6us
I20260709 12:17:19.177266 11528 raft_consensus.cc:2468] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 5.
I20260709 12:17:19.191401 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:19.192768 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:19.134680 13557 raft_consensus.cc:2804] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:17:19.236588 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 53066.7us
I20260709 12:17:19.259914 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:19.177838 13520 raft_consensus.cc:3060] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:19.133118 13650 raft_consensus.cc:697] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 6 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:19.172266 13564 leader_election.cc:290] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:17:19.286877 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 45574.9us
I20260709 12:17:19.196441 13289 raft_consensus.cc:493] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:19.293576 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:19.203625 11445 raft_consensus.cc:2410] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:19.195633 13581 raft_consensus.cc:2749] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:17:19.262317 13659 log.cc:927] Time spent T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 12:17:19.193994 13147 raft_consensus.cc:697] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 9 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:19.177780 13356 raft_consensus.cc:697] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 5 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:19.194398 13571 raft_consensus.cc:493] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:19.302258 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:19.297320 11524 raft_consensus.cc:2468] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 5.
I20260709 12:17:19.309500 13355 raft_consensus.cc:493] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.254356 13385 leader_election.cc:290] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:19.237900 13589 leader_election.cc:290] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:19.182116 13368 raft_consensus.cc:515] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:19.299546 13289 raft_consensus.cc:3060] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:19.260210 13475 raft_consensus.cc:493] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:19.319756 13661 log.cc:927] Time spent T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
W20260709 12:17:19.320732 13665 log.cc:927] Time spent T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 12:17:19.321568 13650 consensus_queue.cc:237] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:19.336393 13551 raft_consensus.cc:515] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:19.339958 13637 raft_consensus.cc:493] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:19.296185 13557 raft_consensus.cc:697] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:19.302451 11275 catalog_manager.cc:5697] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 3 to 4, leader changed from 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132) to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 4 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } }
I20260709 12:17:19.382495 13571 raft_consensus.cc:3060] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:19.205698 13577 raft_consensus.cc:2804] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:19.180871 13413 consensus_queue.cc:1048] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.120s
I20260709 12:17:19.393519 13475 raft_consensus.cc:515] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:19.415601 13356 consensus_queue.cc:237] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:19.420109 13576 raft_consensus.cc:3055] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:19.386329 11595 raft_consensus.cc:3055] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:19.462400 11595 raft_consensus.cc:740] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:19.463948 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:19.385660 13478 raft_consensus.cc:2804] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:19.206506 13615 raft_consensus.cc:2804] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:19.465983 13581 raft_consensus.cc:493] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:19.467429 11565 leader_election.cc:304] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:17:19.453867 11275 catalog_manager.cc:5697] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 3 to 4, leader changed from 1c101e338f954ef086338e251deed19d (127.3.212.130) to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 4 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } }
I20260709 12:17:19.456189 11594 raft_consensus.cc:1240] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:19.456774 12349 raft_consensus.cc:1240] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:17:19.376578 11593 raft_consensus.cc:1275] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:19.363163 13471 raft_consensus.cc:493] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.471093 12848 raft_consensus.cc:2804] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:19.431519 13577 raft_consensus.cc:493] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:19.475652 12347 raft_consensus.cc:1275] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:19.476456 11565 leader_election.cc:304] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: b126028166e8480ba25541bf8f7fc6de
W20260709 12:17:19.477031 11493 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.057s	sys 0.097s
I20260709 12:17:19.476652 11275 catalog_manager.cc:5697] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 2 to 3, leader changed from 1c101e338f954ef086338e251deed19d (127.3.212.130) to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 3 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } }
W20260709 12:17:19.487648 11493 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.058s	sys 0.097s
I20260709 12:17:19.478574 11595 consensus_queue.cc:260] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:19.477974 11445 raft_consensus.cc:2393] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 5: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:19.488564 11275 catalog_manager.cc:5697] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 2 to 3, leader changed from a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131) to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 3 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } }
I20260709 12:17:19.466457 13615 raft_consensus.cc:493] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:19.490622 11565 leader_election.cc:304] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:19.491282 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d43eecbad746fd9ddce50c5b9fc3e8" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:19.491204 11275 catalog_manager.cc:5697] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 1 to 2, leader changed from 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132) to a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131). New cstate: current_term: 2 leader_uuid: "a03223e9e41247c3a36b7b7c3d476671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:19.500231 11449 raft_consensus.cc:1240] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:17:19.458146 13576 raft_consensus.cc:740] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:19.421026 13637 raft_consensus.cc:515] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:19.502357 12352 raft_consensus.cc:1275] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:17:19.502784 11524 raft_consensus.cc:1275] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:19.503409 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:19.509272 13084 consensus_queue.cc:1048] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:19.516796 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:19.517155 11447 raft_consensus.cc:1240] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:17:19.489552 13577 raft_consensus.cc:3060] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:19.415982 13147 consensus_queue.cc:237] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:19.486424 12848 raft_consensus.cc:493] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:19.499612 13615 raft_consensus.cc:3060] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:19.509812 13630 consensus_meta.cc:287] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671: Time spent flushing consensus metadata: real 0.502s	user 0.012s	sys 0.000s
I20260709 12:17:19.532407 12361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51698 (request call id 678) took 1017 ms. Trace:
I20260709 12:17:19.533450 12348 raft_consensus.cc:1275] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:19.466599 13581 raft_consensus.cc:515] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:19.535717 12361 rpcz_store.cc:276] 0709 12:17:18.515365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:18.515500 (+   135us) service_pool.cc:224] Handling call
0709 12:17:18.524414 (+  8914us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:18.524805 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:18.524835 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:18.526705 (+  1870us) log.cc:844] Serialized 26 byte log entry
0709 12:17:18.695537 (+168832us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:18.695575 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:18.695639 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:18.841425 (+145786us) spinlock_profiling.cc:243] Waited 19.3 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e675e86e 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221 00007f84e67671d9 00007f84e6767169
0709 12:17:18.937811 (+ 96386us) raft_consensus.cc:1685] finished
0709 12:17:18.937832 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:19.532204 (+594372us) spinlock_profiling.cc:243] Waited 8.5 ms on lock 0x7b54000082d0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc28ad 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:19.532349 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":95,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":10696,"spinlock_wait_cycles":64002688,"thread_start_us":166187,"threads_started":1,"wal-append.queue_time_us":185848}
I20260709 12:17:19.460698 13355 raft_consensus.cc:515] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:19.495769 13589 consensus_queue.cc:1048] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:17:19.550294 12347 raft_consensus.cc:2468] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 5.
I20260709 12:17:19.548540 11593 raft_consensus.cc:2468] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 5.
I20260709 12:17:19.489348 13471 raft_consensus.cc:515] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:19.532646 13356 raft_consensus.cc:493] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:19.535919 13385 raft_consensus.cc:2804] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:19.532574 12848 raft_consensus.cc:3060] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:19.553542 13084 consensus_queue.cc:1048] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:17:19.559186 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 44022.1us
I20260709 12:17:19.560770 13578 raft_consensus.cc:2804] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:19.532478 13556 raft_consensus.cc:493] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:19.602747 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:19.624253 11493 leader_election.cc:304] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:19.619082 13578 raft_consensus.cc:493] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:19.601234 13190 raft_consensus.cc:493] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.552459 13630 raft_consensus.cc:515] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:19.604540 13603 leader_election.cc:290] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:19.633934 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a841f2f09ced40a4bbf33594e11bd7ad" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:19.527613 13557 consensus_queue.cc:237] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:19.610055 13385 raft_consensus.cc:493] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:19.656633 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:19.627722 13570 raft_consensus.cc:2804] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:19.646564 13578 raft_consensus.cc:3060] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:19.615203 13607 consensus_queue.cc:1059] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 12:17:19.645874 13687 raft_consensus.cc:493] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:19.657651 13385 raft_consensus.cc:3060] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:19.655625 13603 raft_consensus.cc:493] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.629722 13556 raft_consensus.cc:515] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:19.604851 13576 consensus_queue.cc:260] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:19.695207 13576 raft_consensus.cc:3060] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:19.615854 13356 raft_consensus.cc:515] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:19.654791 13368 leader_election.cc:290] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
W20260709 12:17:19.679307 13669 log.cc:927] Time spent T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 12:17:19.660449 13686 raft_consensus.cc:493] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.698619 13637 leader_election.cc:290] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:19.699040 13603 raft_consensus.cc:515] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:19.699245 13686 raft_consensus.cc:515] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
W20260709 12:17:19.704888 13681 log.cc:927] Time spent T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 12:17:19.706784 13666 log.cc:927] Time spent T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.232s	user 0.000s	sys 0.001s
I20260709 12:17:19.711529 13630 leader_election.cc:290] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
W20260709 12:17:19.682451 13667 log.cc:927] Time spent T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.237s	user 0.001s	sys 0.000s
I20260709 12:17:19.725661 12357 raft_consensus.cc:2468] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 5.
I20260709 12:17:19.744885 11493 leader_election.cc:304] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:19.680869 13570 raft_consensus.cc:697] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 5 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:19.654247 13190 raft_consensus.cc:515] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:19.684326 13475 leader_election.cc:290] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:19.749361 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
W20260709 12:17:19.740355 13671 log.cc:927] Time spent T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.258s	user 0.001s	sys 0.000s
I20260709 12:17:19.776046 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ed4eeff0ae44d0bc1ebb8cbe3adea5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:19.776954 12357 raft_consensus.cc:3060] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Advancing to term 5
W20260709 12:17:19.747430 13670 log.cc:927] Time spent T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
I20260709 12:17:19.748283 13637 raft_consensus.cc:493] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:19.783917 13637 raft_consensus.cc:515] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:19.784492 13190 leader_election.cc:290] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:19.772441 13589 raft_consensus.cc:493] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:19.785413 13356 leader_election.cc:290] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:19.786837 13603 leader_election.cc:290] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:19.787571 13471 leader_election.cc:290] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:19.788838 13581 leader_election.cc:290] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:19.792043 13571 raft_consensus.cc:515] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:19.793872 13570 consensus_queue.cc:237] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:19.794822 13578 raft_consensus.cc:515] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:19.785725 13589 raft_consensus.cc:515] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:19.799840 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:19.800462 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:19.803013 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:19.803649 12359 raft_consensus.cc:2468] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 8.
I20260709 12:17:19.684057 13687 raft_consensus.cc:515] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:19.746516 13551 leader_election.cc:290] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:19.751369 13565 raft_consensus.cc:2804] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:19.806449 11567 leader_election.cc:304] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:19.821360 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:19.824182 12357 raft_consensus.cc:2468] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 5.
I20260709 12:17:19.827044 12352 raft_consensus.cc:2468] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 5.
I20260709 12:17:19.786998 13556 leader_election.cc:290] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:19.786904 13686 leader_election.cc:290] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:19.832652 11567 leader_election.cc:304] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:19.834605 11493 leader_election.cc:304] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:19.793136 13577 raft_consensus.cc:515] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:19.825407 13581 raft_consensus.cc:493] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.834707 13578 leader_election.cc:290] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:19.837721 13557 raft_consensus.cc:2804] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:19.855512 11593 raft_consensus.cc:2393] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 3: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:17:19.843716 13630 raft_consensus.cc:2804] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:19.839074 13607 raft_consensus.cc:493] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:19.837113 13565 raft_consensus.cc:697] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 5 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:19.891570 13565 consensus_queue.cc:237] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:19.841468 13556 raft_consensus.cc:2804] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:19.893743 13556 raft_consensus.cc:493] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:19.894439 13556 raft_consensus.cc:3060] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:19.888242 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:19.901340 13698 raft_consensus.cc:493] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.902207 13698 raft_consensus.cc:515] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:19.905124 13698 leader_election.cc:290] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:19.862142 13557 raft_consensus.cc:493] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:19.917245 13630 raft_consensus.cc:697] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [term 5 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
W20260709 12:17:19.919073 13672 log.cc:927] Time spent T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:17:19.919483 13607 raft_consensus.cc:515] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:19.937575 13557 raft_consensus.cc:3060] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:19.951918 13607 leader_election.cc:290] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:19.942190 13385 raft_consensus.cc:515] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:19.942390 12848 raft_consensus.cc:515] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:19.851154 13581 raft_consensus.cc:515] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:19.955569 13581 leader_election.cc:290] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:19.957513 13385 leader_election.cc:290] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
W20260709 12:17:19.947649 13289 consensus_meta.cc:287] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de: Time spent flushing consensus metadata: real 0.554s	user 0.012s	sys 0.001s
I20260709 12:17:19.957918 13589 leader_election.cc:290] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:19.958410 13289 raft_consensus.cc:515] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:19.960086 13687 leader_election.cc:290] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:19.960908 13289 leader_election.cc:290] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:19.961844 13577 leader_election.cc:290] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:19.971252 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:19.972023 11452 raft_consensus.cc:3060] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:19.972358 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:19.973886 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:19.974978 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:19.975512 11446 raft_consensus.cc:2468] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 6.
I20260709 12:17:19.976248 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffe47647c274723808482c166efa21c" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:19.977208 13576 raft_consensus.cc:493] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.977797 13576 raft_consensus.cc:515] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:19.978174 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390e91331fd04f97a5235133a34875ee" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:19.979071 13355 leader_election.cc:290] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:19.979914 11452 raft_consensus.cc:2468] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 4.
I20260709 12:17:19.977700 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:19.980691 11454 raft_consensus.cc:2468] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 5.
I20260709 12:17:19.981353 11595 raft_consensus.cc:3060] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:19.982929 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:19.984177 13637 leader_election.cc:290] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:19.985263 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a841f2f09ced40a4bbf33594e11bd7ad" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:19.986279 11451 raft_consensus.cc:3060] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:17:19.987733 13630 consensus_queue.cc:237] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:19.982594 13615 raft_consensus.cc:515] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
W20260709 12:17:19.989524 13520 consensus_meta.cc:287] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de: Time spent flushing consensus metadata: real 0.690s	user 0.012s	sys 0.001s
I20260709 12:17:19.990070 13520 raft_consensus.cc:515] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:19.991114 13615 leader_election.cc:290] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:19.992633 11599 raft_consensus.cc:2393] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 8: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:17:19.937003 13471 raft_consensus.cc:493] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.993577 13471 raft_consensus.cc:515] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:19.994292 11597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 752) took 1147 ms. Trace:
I20260709 12:17:19.994712 11597 rpcz_store.cc:276] 0709 12:17:18.847227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:18.847347 (+   120us) service_pool.cc:224] Handling call
0709 12:17:19.994083 (+1146736us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b5400000d54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:19.994221 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":464597376}
W20260709 12:17:19.946368 13509 consensus_meta.cc:287] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8: Time spent flushing consensus metadata: real 0.681s	user 0.008s	sys 0.004s
I20260709 12:17:19.995635 13509 raft_consensus.cc:2749] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935) with higher term. Message: Invalid argument: T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 for earlier term 8. Current term is 9.
I20260709 12:17:19.996681 13627 consensus_queue.cc:1048] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:17:19.923213 13684 log.cc:927] Time spent T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:17:20.000038 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:17:19.958168 11494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:20.001157 12356 raft_consensus.cc:2410] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:17:20.002027 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:20.002928 13084 raft_consensus.cc:493] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:20.003428 13084 raft_consensus.cc:515] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:20.003603 13557 raft_consensus.cc:515] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:20.005976 13168 leader_election.cc:290] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:20.008410 11451 raft_consensus.cc:2468] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 3.
I20260709 12:17:20.010829 13698 consensus_queue.cc:1048] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:20.011521 11594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55250 (request call id 597) took 1042 ms. Trace:
I20260709 12:17:20.012133 11594 rpcz_store.cc:276] 0709 12:17:18.968744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:18.969742 (+   998us) service_pool.cc:224] Handling call
0709 12:17:18.970028 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:19.474051 (+504023us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:20.010960 (+536909us) spinlock_profiling.cc:243] Waited 486 ms on lock 0x7b5400a1f4d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:17:20.011189 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1117542272}
I20260709 12:17:20.016661 13084 leader_election.cc:290] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:20.023346 11525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38272 (request call id 329) took 1373 ms. Trace:
I20260709 12:17:20.033640 11595 raft_consensus.cc:2468] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 6.
I20260709 12:17:20.034053 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffe47647c274723808482c166efa21c" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:20.036181 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:20.037191 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:20.038856 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a841f2f09ced40a4bbf33594e11bd7ad" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:20.040534 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:20.041726 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:20.051540 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a841f2f09ced40a4bbf33594e11bd7ad" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:20.052667 11593 raft_consensus.cc:2393] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 3: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
W20260709 12:17:20.053936 11567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:20.055809 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:20.056728 11594 raft_consensus.cc:2468] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 7.
I20260709 12:17:20.025511 11418 leader_election.cc:304] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:20.061851 12352 raft_consensus.cc:2393] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 3: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:17:20.061779 13084 raft_consensus.cc:493] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:20.061923 12356 raft_consensus.cc:2393] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 8: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:17:20.062973 13084 raft_consensus.cc:515] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
W20260709 12:17:20.069347 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 43981.4us
I20260709 12:17:20.071035 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ed4eeff0ae44d0bc1ebb8cbe3adea5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:20.072896 11598 raft_consensus.cc:1275] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:17:19.945480 13673 log.cc:927] Time spent T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.486s	user 0.003s	sys 0.000s
I20260709 12:17:20.076169 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ed4eeff0ae44d0bc1ebb8cbe3adea5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:20.069775 12359 raft_consensus.cc:2468] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 8.
I20260709 12:17:20.077009 11601 raft_consensus.cc:2468] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 9.
I20260709 12:17:20.028963 11525 rpcz_store.cc:276] 0709 12:17:18.650261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:18.651695 (+  1434us) service_pool.cc:224] Handling call
0709 12:17:18.666925 (+ 15230us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:18.687873 (+ 20948us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:18.687902 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:18.695557 (+  7655us) log.cc:844] Serialized 52 byte log entry
0709 12:17:18.875878 (+180321us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:18.875920 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:20.022842 (+1146922us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b54000bde54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:17:20.022901 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:20.022958 (+    57us) raft_consensus.cc:1685] finished
0709 12:17:20.022974 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:20.023256 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29057,"raft.queue_time_us":2353,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":9738,"spinlock_wait_cycles":47296256,"thread_start_us":169629,"threads_started":1,"wal-append.queue_time_us":309540,"wal-append.run_cpu_time_us":1884,"wal-append.run_wall_time_us":1001909}
I20260709 12:17:20.079648 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:20.078300 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:20.087549 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:20.087612 11593 raft_consensus.cc:2393] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 3: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:17:20.088497 12357 raft_consensus.cc:2468] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 5.
I20260709 12:17:20.071754 11596 raft_consensus.cc:2468] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 4.
I20260709 12:17:20.083942 11567 leader_election.cc:304] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:20.015873 13589 raft_consensus.cc:493] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:20.093045 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:20.114473 11593 raft_consensus.cc:1275] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:17:20.013767 13557 leader_election.cc:290] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:20.140125 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a841f2f09ced40a4bbf33594e11bd7ad" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:20.068534 13573 raft_consensus.cc:493] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:20.015750 13601 raft_consensus.cc:493] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:20.015625 13355 raft_consensus.cc:493] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:20.152288 11453 raft_consensus.cc:2393] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 3: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:17:20.153366 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:20.154039 13084 leader_election.cc:290] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:20.074947 13571 leader_election.cc:290] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:20.156664 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:20.157455 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:20.170742 11593 raft_consensus.cc:2410] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:17:20.065773 13576 leader_election.cc:290] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:20.162840 12347 raft_consensus.cc:1240] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 6 LEADER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:20.155244 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:20.185804 11451 raft_consensus.cc:2468] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 5.
I20260709 12:17:20.186637 11450 raft_consensus.cc:2393] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 5: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:20.170534 11452 raft_consensus.cc:3060] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:20.080622 13190 raft_consensus.cc:2804] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:20.185545 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:20.188712 13557 raft_consensus.cc:493] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:20.160341 13168 raft_consensus.cc:2804] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:20.220153 13557 raft_consensus.cc:515] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:20.220665 13168 raft_consensus.cc:697] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:20.221643 13168 consensus_queue.cc:237] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:20.222612 13557 leader_election.cc:290] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:20.171793 13601 raft_consensus.cc:515] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:20.225792 13471 leader_election.cc:290] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:20.163547 13589 raft_consensus.cc:515] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:20.187191 13355 raft_consensus.cc:515] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:20.228374 13589 leader_election.cc:290] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:20.164016 13509 raft_consensus.cc:493] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:20.230072 11599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40784 (request call id 289) took 1029 ms. Trace:
I20260709 12:17:20.169214 13573 raft_consensus.cc:515] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:20.230515 11599 rpcz_store.cc:276] 0709 12:17:19.200326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:19.200500 (+   174us) service_pool.cc:224] Handling call
0709 12:17:20.229853 (+1029353us) spinlock_profiling.cc:243] Waited 732 ms on lock 0x7b5400568954. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:20.230006 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1682556672}
I20260709 12:17:20.232620 13573 leader_election.cc:290] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:17:20.232769 13702 log.cc:927] Time spent T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 12:17:20.229732 13509 raft_consensus.cc:515] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:20.171509 13556 raft_consensus.cc:515] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:20.237494 13509 leader_election.cc:290] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:20.168082 13520 leader_election.cc:290] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 8 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:20.241901 13520 raft_consensus.cc:493] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
W20260709 12:17:20.242449 13673 log.cc:927] Time spent T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:17:20.243223 11447 raft_consensus.cc:1275] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:20.161065 13698 raft_consensus.cc:493] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:20.229053 13355 leader_election.cc:290] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:20.198097 13190 raft_consensus.cc:493] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:20.303750 13478 raft_consensus.cc:493] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:20.304354 13478 raft_consensus.cc:3060] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:20.306027 11601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40784 (request call id 285) took 1122 ms. Trace:
I20260709 12:17:20.306488 11601 rpcz_store.cc:276] 0709 12:17:19.183851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:19.184527 (+   676us) service_pool.cc:224] Handling call
0709 12:17:20.305834 (+1121307us) spinlock_profiling.cc:243] Waited 808 ms on lock 0x7b5400833954. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:20.305967 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1859240192}
I20260709 12:17:20.279176 13589 raft_consensus.cc:493] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:20.306713 11452 raft_consensus.cc:2468] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 8.
I20260709 12:17:20.294431 13571 raft_consensus.cc:493] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:20.242512 13520 raft_consensus.cc:515] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:20.300999 13190 raft_consensus.cc:3060] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:20.294739 13698 raft_consensus.cc:515] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:20.320130 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:20.323956 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9fe9a94294836aec652338f44367d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:20.327786 11453 raft_consensus.cc:2468] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 6.
I20260709 12:17:20.325660 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:20.328370 11452 raft_consensus.cc:2468] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 6.
I20260709 12:17:20.331169 11450 raft_consensus.cc:2393] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 7: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
W20260709 12:17:20.323400 13570 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.071s	sys 0.081s
I20260709 12:17:20.322407 13509 raft_consensus.cc:493] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:20.367789 13570 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.072s	sys 0.082s
I20260709 12:17:20.322644 13589 raft_consensus.cc:515] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:20.323622 13571 raft_consensus.cc:515] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:20.368196 13557 raft_consensus.cc:493] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
W20260709 12:17:20.412041 13674 log.cc:927] Time spent T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.800s	user 0.001s	sys 0.015s
W20260709 12:17:20.415772 13660 log.cc:927] Time spent T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 1.548s	user 0.000s	sys 0.009s
I20260709 12:17:20.417150 11448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58868 (request call id 1171) took 1707 ms. Trace:
I20260709 12:17:20.417611 11448 rpcz_store.cc:276] 0709 12:17:18.709704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:18.709813 (+   109us) service_pool.cc:224] Handling call
0709 12:17:18.710125 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:18.710436 (+   311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:18.710453 (+    17us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:18.720010 (+  9557us) log.cc:844] Serialized 26 byte log entry
0709 12:17:18.754536 (+ 34526us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:18.754573 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:18.754639 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:20.415247 (+1660608us) spinlock_profiling.cc:243] Waited 2.06 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e675e86e 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221 00007f84e67671d9 00007f84e6767169
0709 12:17:20.416832 (+  1585us) raft_consensus.cc:1685] finished
0709 12:17:20.416853 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:20.417061 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15519,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":113,"spinlock_wait_cycles":4735360,"thread_start_us":34204,"threads_started":1,"wal-append.queue_time_us":147266}
I20260709 12:17:20.433293 12848 leader_election.cc:290] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:20.437623 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:20.439167 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:20.439845 12348 raft_consensus.cc:2468] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 5.
I20260709 12:17:20.440285 13617 raft_consensus.cc:493] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:20.440914 13617 raft_consensus.cc:515] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:20.441268 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d43eecbad746fd9ddce50c5b9fc3e8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:20.372404 13355 raft_consensus.cc:493] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:20.442622 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:20.446237 12345 raft_consensus.cc:2410] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:17:20.443361 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:20.444052 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:20.447697 11600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55250 (request call id 596) took 1479 ms. Trace:
I20260709 12:17:20.447728 12352 raft_consensus.cc:2468] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 6.
I20260709 12:17:20.389760 13556 leader_election.cc:290] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:20.444816 12357 raft_consensus.cc:2468] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 5.
I20260709 12:17:20.440925 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:20.373554 13509 raft_consensus.cc:515] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:20.490365 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:20.491214 12347 raft_consensus.cc:2468] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 5.
I20260709 12:17:20.448155 11600 rpcz_store.cc:276] 0709 12:17:18.968444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:18.969048 (+   604us) service_pool.cc:224] Handling call
0709 12:17:18.969437 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:19.009711 (+ 40274us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:19.009743 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:19.010244 (+   501us) log.cc:844] Serialized 26 byte log entry
0709 12:17:19.287503 (+277259us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:19.287546 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:19.287609 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:20.411236 (+1123627us) spinlock_profiling.cc:243] Waited 9.32 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e675e86e 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221 00007f84e67671d9 00007f84e6767169
0709 12:17:20.444645 (+ 33409us) raft_consensus.cc:1685] finished
0709 12:17:20.444668 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:20.447628 (+  2960us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39868,"raft.queue_time_us":41021,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"spinlock_wait_cycles":21426432,"thread_start_us":276428,"threads_started":1,"wal-append.queue_time_us":520729}
I20260709 12:17:20.480599 11419 leader_election.cc:304] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:20.446044 13604 raft_consensus.cc:493] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:20.527705 13594 raft_consensus.cc:493] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:20.530203 11602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40784 (request call id 284) took 1346 ms. Trace:
I20260709 12:17:20.530673 11602 rpcz_store.cc:276] 0709 12:17:19.183504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:19.183667 (+   163us) service_pool.cc:224] Handling call
0709 12:17:19.252671 (+ 69004us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:19.254834 (+  2163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:19.254878 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:19.254925 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:19.254957 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:20.529944 (+1274987us) spinlock_profiling.cc:243] Waited 1.92 ms on lock 0x7b540014e1d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:17:20.529997 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:20.530140 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4415360}
I20260709 12:17:20.443141 13557 raft_consensus.cc:515] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:20.452390 13355 raft_consensus.cc:515] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
W20260709 12:17:20.537995 13709 log.cc:927] Time spent T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:17:20.539088 13355 leader_election.cc:290] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
W20260709 12:17:20.536952 11494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:20.541580 13509 leader_election.cc:290] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:20.507365 12346 raft_consensus.cc:2468] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 5.
I20260709 12:17:20.547466 13475 raft_consensus.cc:2804] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:20.528321 13594 raft_consensus.cc:515] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:20.528872 13604 raft_consensus.cc:515] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:20.545032 13478 raft_consensus.cc:515] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:20.555119 13698 leader_election.cc:290] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
W20260709 12:17:20.595403 11493 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.033s	sys 0.041s
W20260709 12:17:20.598896 11493 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.034s	sys 0.041s
W20260709 12:17:20.599884 11493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 510548us
I20260709 12:17:20.575155 13475 raft_consensus.cc:493] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:20.577165 13617 leader_election.cc:290] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:20.581722 13520 leader_election.cc:290] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
W20260709 12:17:20.613663 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 465830us
I20260709 12:17:20.592602 13603 raft_consensus.cc:476] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 4 LEADER]: Not starting pre-election -- already a leader
I20260709 12:17:20.611181 13475 raft_consensus.cc:3060] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:20.608279 13610 raft_consensus.cc:493] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:20.609217 13571 leader_election.cc:290] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:20.638031 13557 leader_election.cc:290] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:20.627532 13610 raft_consensus.cc:515] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:20.638752 13630 raft_consensus.cc:493] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:20.639387 13630 raft_consensus.cc:515] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:20.640570 13610 leader_election.cc:290] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
W20260709 12:17:20.642282 13711 log.cc:927] Time spent T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:17:20.622891 13589 leader_election.cc:290] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:20.646034 12203 leader_election.cc:304] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d
I20260709 12:17:20.650738 13594 leader_election.cc:290] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:20.661185 13627 raft_consensus.cc:2804] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:20.659106 13468 leader_election.cc:290] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:20.667776 12203 leader_election.cc:304] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:20.662134 13712 raft_consensus.cc:493] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:20.665467 13627 raft_consensus.cc:493] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:20.669986 13627 raft_consensus.cc:3060] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:20.675092 12203 leader_election.cc:304] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d
I20260709 12:17:20.677441 11493 leader_election.cc:304] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:20.666985 13603 raft_consensus.cc:493] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:20.670017 13712 raft_consensus.cc:515] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:20.689810 13608 raft_consensus.cc:2804] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:20.700693 13608 raft_consensus.cc:493] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:20.701136 13608 raft_consensus.cc:3060] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:20.701506 13630 leader_election.cc:290] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:20.703162 13190 raft_consensus.cc:515] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:20.689594 13603 raft_consensus.cc:515] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:20.706700 13580 raft_consensus.cc:3055] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:20.707134 13580 raft_consensus.cc:740] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:20.699795 13719 consensus_queue.cc:1048] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:20.695504 13650 raft_consensus.cc:2749] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:20.713632 13604 leader_election.cc:290] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
W20260709 12:17:20.714519 11491 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.000s	sys 0.019s
W20260709 12:17:20.714864 11491 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.000s	sys 0.020s
I20260709 12:17:20.715013 13580 consensus_queue.cc:260] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:20.716035 13580 raft_consensus.cc:3060] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:20.718544 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 694597us
I20260709 12:17:20.723452 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:20.724347 11522 raft_consensus.cc:2410] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:20.724871 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:20.700366 13712 leader_election.cc:290] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:20.709394 13478 leader_election.cc:290] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:20.731166 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:20.733551 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:20.734360 11524 raft_consensus.cc:2468] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 5.
I20260709 12:17:20.709043 13603 leader_election.cc:290] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:20.717530 13356 raft_consensus.cc:2804] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:20.719534 13190 leader_election.cc:290] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:20.738158 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:20.741144 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:20.743633  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:20.725313 13630 raft_consensus.cc:493] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:20.788911 11522 raft_consensus.cc:1275] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:20.791033 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:17:20.804286 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 323719us
I20260709 12:17:20.780579 13356 raft_consensus.cc:697] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 5 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:20.805001 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:20.808022 11419 leader_election.cc:304] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:20.807772 11522 raft_consensus.cc:2468] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 5.
I20260709 12:17:20.793074 13478 raft_consensus.cc:493] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:20.815861 11419 leader_election.cc:304] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:20.818717 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:20.819957 11419 leader_election.cc:304] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:20.820815 13604 raft_consensus.cc:2804] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:20.821085 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:20.816761 13603 raft_consensus.cc:2804] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:20.831874 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:20.833930 11520 raft_consensus.cc:2468] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 6.
W20260709 12:17:20.835150 11492 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.013s	sys 0.016s
W20260709 12:17:20.835537 11492 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.013s	sys 0.016s
I20260709 12:17:20.841746 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:20.842512 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:20.843647 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390e91331fd04f97a5235133a34875ee" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:20.795562 13630 raft_consensus.cc:515] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:20.841029 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ed4eeff0ae44d0bc1ebb8cbe3adea5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:20.847601 11520 raft_consensus.cc:2393] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 5: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:20.848398 11528 raft_consensus.cc:2393] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 7: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:17:20.832475 11419 leader_election.cc:304] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:20.846961 11523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33456 (request call id 1000) took 1679 ms. Trace:
I20260709 12:17:20.849643 11523 rpcz_store.cc:276] 0709 12:17:19.167753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:19.173368 (+  5615us) service_pool.cc:224] Handling call
0709 12:17:19.173769 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:19.256478 (+ 82709us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:19.256512 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:19.959684 (+703172us) spinlock_profiling.cc:243] Waited 7.98 ms on lock 0x7b2c0019c098. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e54bca11 00007f84e54cc372 00007f84e6bfea01 00007f84e6bc343a 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2
0709 12:17:19.960160 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 12:17:20.250545 (+290385us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:20.250593 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:20.846672 (+596079us) spinlock_profiling.cc:243] Waited 82.3 ms on lock 0x7b54009632d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:17:20.846726 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:20.846769 (+    43us) raft_consensus.cc:1685] finished
0709 12:17:20.846783 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:20.846908 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":447,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":26450,"spinlock_wait_cycles":207543936,"thread_start_us":290014,"threads_started":1,"wal-append.queue_time_us":590473}
I20260709 12:17:20.851917 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:20.852612 11519 raft_consensus.cc:2468] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 3.
I20260709 12:17:20.852744 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:20.854466 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:20.854984 11566 leader_election.cc:304] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:20.857342 11526 raft_consensus.cc:2393] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 8: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:17:20.857121 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:20.859084 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:20.860474 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:20.854086 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:20.863795 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:20.864486 11526 raft_consensus.cc:3060] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:20.865990 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:20.832926 13604 raft_consensus.cc:493] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:20.866688 11528 raft_consensus.cc:2468] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 6.
I20260709 12:17:20.816421 13478 raft_consensus.cc:515] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:20.867590 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:20.865984 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:20.845917 13190 raft_consensus.cc:2804] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:20.839104 13603 raft_consensus.cc:493] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:20.867316 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:20.877938 11520 raft_consensus.cc:3060] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:20.872099 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:20.871132 11491 leader_election.cc:304] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:20.886435 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:20.887137 11491 leader_election.cc:304] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:20.861660 13509 raft_consensus.cc:493] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:20.853452 13168 raft_consensus.cc:493] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:20.878652 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c355b3902a4e7fb72bac6a91ea3316" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:20.852165 13601 leader_election.cc:290] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:17:20.866168 13676 log.cc:927] Time spent T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 1.258s	user 0.007s	sys 0.004s
I20260709 12:17:20.881788 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffe47647c274723808482c166efa21c" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:20.883776 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:20.867575 11566 leader_election.cc:304] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:20.892748 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9fe9a94294836aec652338f44367d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:20.875213 13604 raft_consensus.cc:3060] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:20.895310 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:20.921573 11519 raft_consensus.cc:2468] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 7.
I20260709 12:17:20.897007 13168 raft_consensus.cc:515] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:20.898063 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:17:20.900043 13720 log.cc:927] Time spent T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:17:20.871151 13726 raft_consensus.cc:493] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:20.931607 13726 raft_consensus.cc:515] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:20.902037 13509 raft_consensus.cc:515] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:20.906579 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7937e0cff84ef7a26c84247c8ffc08" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:20.912385 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:20.874359 13564 raft_consensus.cc:2804] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:20.891510 13565 raft_consensus.cc:2749] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:20.876673 13468 consensus_queue.cc:1059] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:17:20.895689 13368 raft_consensus.cc:2804] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:17:20.915166 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 240131us
I20260709 12:17:20.949708 12203 leader_election.cc:304] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:20.874104 13650 raft_consensus.cc:493] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:20.906827 13471 consensus_queue.cc:1048] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:17:20.918358 11524 raft_consensus.cc:2468] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 5.
I20260709 12:17:20.876593 13190 raft_consensus.cc:493] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:20.874490 13727 raft_consensus.cc:2804] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:20.879412 13603 raft_consensus.cc:3060] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:20.927502 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 59999.6us
I20260709 12:17:20.928920 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:17:20.902215 13718 log.cc:927] Time spent T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
W20260709 12:17:20.958314 13706 log.cc:927] Time spent T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.762s	user 0.000s	sys 0.011s
W20260709 12:17:20.934667 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 46123.4us
I20260709 12:17:20.942257 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:20.947847 12204 leader_election.cc:304] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:20.878122 13608 raft_consensus.cc:515] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:20.915069 13698 raft_consensus.cc:493] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:20.932937 13475 raft_consensus.cc:515] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:20.954980 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:20.957825 12203 leader_election.cc:304] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:20.958146 13728 raft_consensus.cc:2749] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:20.944983 13564 raft_consensus.cc:493] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:20.965409 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:20.972045 12359 raft_consensus.cc:2410] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:17:20.978108 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:20.939643 13573 raft_consensus.cc:2804] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:20.967319 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9fe9a94294836aec652338f44367d" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:20.979483 11448 raft_consensus.cc:2468] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 6.
I20260709 12:17:20.971915 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:20.983340 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:20.966447 11418 leader_election.cc:304] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:20.970820 11450 raft_consensus.cc:1275] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:20.961427 11566 leader_election.cc:304] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:20.970657 11452 raft_consensus.cc:1275] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:20.933925 13726 leader_election.cc:290] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:20.952060 13368 raft_consensus.cc:493] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:20.990375 11566 leader_election.cc:304] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:20.996893 11520 raft_consensus.cc:2468] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 6.
I20260709 12:17:20.951423 13731 raft_consensus.cc:493] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:20.956108 13727 raft_consensus.cc:493] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:21.010488 11521 raft_consensus.cc:2368] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 5. Current term is 6.
I20260709 12:17:20.999404 11527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38272 (request call id 339) took 1836 ms. Trace:
W20260709 12:17:21.012223 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 64451.8us
I20260709 12:17:21.014178 12204 leader_election.cc:304] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d
I20260709 12:17:21.015419 11524 raft_consensus.cc:1275] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:21.007753 13368 raft_consensus.cc:3060] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:21.017925 13509 leader_election.cc:290] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:20.959168 13408 leader_election.cc:290] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:21.022063 11566 leader_election.cc:304] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:20.956249 13190 raft_consensus.cc:3060] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:21.000691 11449 raft_consensus.cc:1275] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:21.035676 11526 raft_consensus.cc:2468] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 6.
I20260709 12:17:21.037213 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:21.038563 12361 raft_consensus.cc:3060] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Advancing to term 7
W20260709 12:17:21.015188 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 57796.6us
I20260709 12:17:21.039733 12203 leader_election.cc:304] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:20.891464 13356 consensus_queue.cc:237] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:21.012665 11527 rpcz_store.cc:276] 0709 12:17:19.162695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:19.162839 (+   144us) service_pool.cc:224] Handling call
0709 12:17:19.163222 (+   383us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:19.186685 (+ 23463us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:19.186718 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:19.187314 (+   596us) log.cc:844] Serialized 52 byte log entry
0709 12:17:19.439125 (+251811us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:19.439169 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:19.439238 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:20.786280 (+1347042us) spinlock_profiling.cc:243] Waited 6.38 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e675e86e 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221 00007f84e67671d9 00007f84e6767169
0709 12:17:20.999074 (+212794us) raft_consensus.cc:1685] finished
0709 12:17:20.999095 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:20.999349 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6994,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":93920,"spinlock_wait_cycles":14684032,"thread_start_us":251465,"threads_started":1,"wal-append.queue_time_us":344947}
I20260709 12:17:21.039355 11447 raft_consensus.cc:2468] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 5.
I20260709 12:17:20.996644 13564 raft_consensus.cc:3060] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:21.057643 11524 raft_consensus.cc:1275] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:20.996641 13573 raft_consensus.cc:493] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:20.957001 13650 raft_consensus.cc:515] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:20.998266 13556 raft_consensus.cc:2749] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:21.082463 12359 raft_consensus.cc:1240] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:17:20.995103 13601 consensus_queue.cc:1048] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.073s
I20260709 12:17:21.049924 13726 raft_consensus.cc:2804] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:21.056195 13730 raft_consensus.cc:2804] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:21.048601 13557 raft_consensus.cc:2804] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:21.035701 13727 raft_consensus.cc:3060] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:21.099165 13468 raft_consensus.cc:493] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:21.099748 13471 raft_consensus.cc:493] T da8741606df54c3f8b5cc5c1141862ea P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:21.065333 13408 raft_consensus.cc:2749] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:21.067447 13573 raft_consensus.cc:3060] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:21.123044 13556 raft_consensus.cc:2804] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:21.125138 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:20.994753 13698 raft_consensus.cc:515] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:21.069206 13626 raft_consensus.cc:2804] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:21.058230 13581 raft_consensus.cc:2749] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:21.051913 13509 raft_consensus.cc:493] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
W20260709 12:17:21.159430 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 193052us
I20260709 12:17:21.040549 13731 raft_consensus.cc:515] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:21.155792 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:17:21.162261 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 97391.4us
I20260709 12:17:21.163153 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:21.160233 12361 raft_consensus.cc:2468] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 7.
I20260709 12:17:21.173400 12345 raft_consensus.cc:3060] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:21.129952 13475 leader_election.cc:290] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:21.147862 13557 raft_consensus.cc:493] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:21.184585 12359 raft_consensus.cc:1275] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:21.185004 12361 raft_consensus.cc:1275] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:17:21.178316 12203 leader_election.cc:304] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:21.172598 11418 leader_election.cc:304] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
W20260709 12:17:21.159756 13705 log.cc:927] Time spent T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 12:17:21.177950 11567 leader_election.cc:304] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:21.148792 13608 leader_election.cc:290] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:21.131951 13726 raft_consensus.cc:493] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:21.132553 13730 raft_consensus.cc:493] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting leader election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:21.207412 11418 leader_election.cc:304] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
W20260709 12:17:21.210796 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 194497us
I20260709 12:17:21.211810 11566 leader_election.cc:304] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:21.163592 13556 raft_consensus.cc:493] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:21.172269 13630 leader_election.cc:290] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:21.223294 11418 leader_election.cc:304] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:21.224488 13741 raft_consensus.cc:2804] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:21.232113 12345 raft_consensus.cc:2468] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 6.
I20260709 12:17:21.175276 13168 leader_election.cc:290] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:21.234524 11418 leader_election.cc:304] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:21.185819 13557 raft_consensus.cc:3060] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:21.180327 13408 raft_consensus.cc:493] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:21.161543 13468 raft_consensus.cc:515] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:21.197045 13726 raft_consensus.cc:3060] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:21.184587 13626 raft_consensus.cc:697] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 6 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:21.238536 11493 leader_election.cc:304] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:21.238828 11418 leader_election.cc:304] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:21.163225 13471 raft_consensus.cc:515] T da8741606df54c3f8b5cc5c1141862ea P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:21.236580 13680 consensus_queue.cc:1048] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:17:21.207718 13730 raft_consensus.cc:3060] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:21.225996 13556 raft_consensus.cc:3060] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:21.225596 13581 raft_consensus.cc:2749] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:21.178966 13509 raft_consensus.cc:515] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:21.233209 13475 raft_consensus.cc:2804] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:21.238046 13601 raft_consensus.cc:2749] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:21.237421 13729 raft_consensus.cc:2764] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 12:17:21.260933 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 49224.2us
I20260709 12:17:21.242437 13168 raft_consensus.cc:2804] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:17:21.263736 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 85501.6us
I20260709 12:17:21.221768 13368 raft_consensus.cc:515] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:21.240751 13741 raft_consensus.cc:697] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 7 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:21.262990 13630 raft_consensus.cc:2804] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:21.271050 12356 raft_consensus.cc:1275] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:21.226128 13190 raft_consensus.cc:515] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:21.259707 13475 raft_consensus.cc:493] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
W20260709 12:17:21.278961 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 90827.3us
I20260709 12:17:21.259140 13576 raft_consensus.cc:493] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:21.242802 13408 raft_consensus.cc:515] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:21.283919 11520 raft_consensus.cc:1240] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:21.243135 13747 consensus_queue.cc:1048] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:17:21.271128 13168 raft_consensus.cc:493] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:21.275552 13601 raft_consensus.cc:2749] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:21.278887 13581 raft_consensus.cc:2749] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:21.281123 13475 raft_consensus.cc:3060] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:21.290614 13739 raft_consensus.cc:493] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
W20260709 12:17:21.325664 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 254001us
W20260709 12:17:21.326256 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 63909.4us
I20260709 12:17:21.327451 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:21.328406 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:21.329193 11449 raft_consensus.cc:2393] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 7: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:21.329193 11602 raft_consensus.cc:1275] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:21.331389 11602 raft_consensus.cc:1240] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:21.332654 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:21.333204 11600 raft_consensus.cc:3060] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:21.335489 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:21.337348 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:21.337623 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:21.289098 13168 raft_consensus.cc:3060] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:21.286124 13630 raft_consensus.cc:697] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 6 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:21.343824 11600 raft_consensus.cc:2468] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 7.
I20260709 12:17:21.341272 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:21.345544 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:21.343179 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:21.357133 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:21.358282 11600 raft_consensus.cc:2468] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 8.
I20260709 12:17:21.359261 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffe47647c274723808482c166efa21c" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:21.359899 13468 leader_election.cc:290] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:21.360198 13675 raft_consensus.cc:3055] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:21.360638 13675 raft_consensus.cc:740] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:21.361114 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:21.361766 11596 raft_consensus.cc:2468] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 6.
I20260709 12:17:21.363245 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:21.362946 13741 consensus_queue.cc:237] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:21.364002 11596 raft_consensus.cc:2393] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 8: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:17:21.365026 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:21.365263 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7937e0cff84ef7a26c84247c8ffc08" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:21.366346 13589 raft_consensus.cc:493] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:21.366671 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:21.366853 13589 raft_consensus.cc:515] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:21.367225 13368 leader_election.cc:290] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:21.367851 13601 raft_consensus.cc:493] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:21.368489 13471 leader_election.cc:290] T da8741606df54c3f8b5cc5c1141862ea P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:21.368333 13601 raft_consensus.cc:515] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:21.368978 13589 leader_election.cc:290] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:21.370359 13601 leader_election.cc:290] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:21.370424 13509 leader_election.cc:290] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:21.372713 11446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35814 (request call id 302) took 1348 ms. Trace:
I20260709 12:17:21.373085 11446 rpcz_store.cc:276] 0709 12:17:20.024775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:20.024914 (+   139us) service_pool.cc:224] Handling call
0709 12:17:20.025224 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:20.244337 (+219113us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:17:20.296574 (+ 52237us) log.cc:844] Serialized 14 byte log entry
0709 12:17:20.623131 (+326557us) log.cc:844] Serialized 14 byte log entry
0709 12:17:20.624031 (+   900us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:20.624080 (+    49us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:20.624129 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:20.664390 (+ 40261us) spinlock_profiling.cc:243] Waited 1.95 ms on lock 0x7b180048f1c0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3ad63f3 00007f84e3ad87c1 00007f84e3ad8779 00007f84e3ad8709 00007f84e3ad86d1 00007f84e3ad79cd 0000000000388634 0000000000388479 00007f84e3ab983a
0709 12:17:21.290020 (+625630us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b180048f1c0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3aa42a6 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419
0709 12:17:21.372496 (+ 82476us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b54001c25d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:17:21.372541 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:21.372658 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":53005,"prepare.run_cpu_time_us":122,"prepare.run_wall_time_us":3016,"raft.queue_time_us":1102,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":4425,"spinlock_wait_cycles":540695808,"thread_start_us":325590,"threads_started":1,"wal-append.queue_time_us":453259}
I20260709 12:17:21.375422 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:17:21.376276 13707 log.cc:927] Time spent T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.784s	user 0.005s	sys 0.012s
I20260709 12:17:21.376814 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c355b3902a4e7fb72bac6a91ea3316" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:17:21.377579 13733 log.cc:927] Time spent T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
I20260709 12:17:21.377729 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:21.346319 13745 consensus_queue.cc:1048] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:21.347607 13650 leader_election.cc:290] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:21.348104 11593 raft_consensus.cc:1275] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:21.285189 13576 raft_consensus.cc:515] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:21.394505 13576 leader_election.cc:290] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:21.348702 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d43eecbad746fd9ddce50c5b9fc3e8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:21.349925 13630 consensus_queue.cc:237] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:21.352015 13408 leader_election.cc:290] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
W20260709 12:17:21.354835 13627 consensus_meta.cc:287] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de: Time spent flushing consensus metadata: real 0.684s	user 0.012s	sys 0.001s
I20260709 12:17:21.342754 13739 raft_consensus.cc:515] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:21.356240 13168 raft_consensus.cc:515] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:21.378417 11526 raft_consensus.cc:2468] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 6.
I20260709 12:17:21.293470 13734 consensus_queue.cc:1048] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.086s
I20260709 12:17:21.381157 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:21.382002 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:21.384050 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:21.384753 13573 raft_consensus.cc:515] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:21.383474 13675 consensus_queue.cc:260] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:21.392068 13731 leader_election.cc:290] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:21.395488 11599 raft_consensus.cc:2468] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 5.
I20260709 12:17:21.458165 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:21.458863 12348 raft_consensus.cc:2468] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 4.
I20260709 12:17:21.392689 13557 raft_consensus.cc:515] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:21.370857 13190 leader_election.cc:290] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:21.451799 11452 raft_consensus.cc:2468] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 6.
I20260709 12:17:21.460016 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c355b3902a4e7fb72bac6a91ea3316" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:21.464550 11596 raft_consensus.cc:2468] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 5.
I20260709 12:17:21.461242 11600 raft_consensus.cc:1240] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:17:21.467403 11566 leader_election.cc:304] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
W20260709 12:17:21.469470 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 397339us
I20260709 12:17:21.472008 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9fe9a94294836aec652338f44367d" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:21.436347 13556 raft_consensus.cc:515] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:21.478664 11493 leader_election.cc:304] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:21.472304 11601 raft_consensus.cc:2393] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 6: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:17:21.480433 11593 raft_consensus.cc:2368] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for earlier term 6. Current term is 7.
I20260709 12:17:21.485031 11597 raft_consensus.cc:2393] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 7: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:17:21.458736 13698 leader_election.cc:290] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:21.315414 13626 consensus_queue.cc:237] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:21.495594 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:21.492202 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:21.502110 11598 raft_consensus.cc:1240] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:21.472213 13509 raft_consensus.cc:2804] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:21.498768 11596 raft_consensus.cc:2468] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 6.
I20260709 12:17:21.455888 13564 raft_consensus.cc:515] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:21.511534 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:21.481912 13675 raft_consensus.cc:3060] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:21.482148 13190 raft_consensus.cc:493] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:21.531832 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:21.534353 11523 raft_consensus.cc:2468] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 5.
I20260709 12:17:21.536953 13573 leader_election.cc:290] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:21.500316 13468 raft_consensus.cc:2804] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:21.482209 13731 consensus_queue.cc:1048] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:17:21.546554 13739 leader_election.cc:290] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:21.547231 13557 leader_election.cc:290] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:21.503885 13698 raft_consensus.cc:493] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:21.548708 13727 raft_consensus.cc:515] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
W20260709 12:17:21.531174 13603 consensus_meta.cc:287] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d: Time spent flushing consensus metadata: real 0.553s	user 0.007s	sys 0.004s
I20260709 12:17:21.513116 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:21.457696 13627 raft_consensus.cc:515] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:21.511500 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:21.500104 11565 leader_election.cc:304] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:21.503427 13737 raft_consensus.cc:493] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:21.549292 13698 raft_consensus.cc:515] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:21.550123 13468 raft_consensus.cc:493] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:21.512495 13509 raft_consensus.cc:493] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
W20260709 12:17:21.574116 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 335322us
I20260709 12:17:21.577919 11600 raft_consensus.cc:2468] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 6.
I20260709 12:17:21.513932 13753 raft_consensus.cc:493] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:21.583782 11418 leader_election.cc:304] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
W20260709 12:17:21.586747 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 86728.3us
I20260709 12:17:21.592537 11565 leader_election.cc:304] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:21.572206 13468 raft_consensus.cc:3060] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:21.595031 11565 leader_election.cc:304] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:21.548755 13556 leader_election.cc:290] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:21.597219 13754 raft_consensus.cc:493] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:21.622756 11565 leader_election.cc:304] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:21.543234 13190 raft_consensus.cc:515] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:21.640610 11565 leader_election.cc:304] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:21.596685 13746 raft_consensus.cc:2749] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:17:21.602398 13761 log.cc:927] Time spent T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:17:21.647197 13758 raft_consensus.cc:493] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:21.647933 13758 raft_consensus.cc:515] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:21.649927 13168 leader_election.cc:290] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:21.595578 13573 raft_consensus.cc:2749] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:21.651227 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:21.650193 13758 leader_election.cc:290] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:21.652593 13758 raft_consensus.cc:493] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:21.652366 13475 raft_consensus.cc:515] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:21.653580 13589 consensus_queue.cc:1059] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:21.655166 13190 leader_election.cc:290] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:21.655755 13190 raft_consensus.cc:2749] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:21.656337 13190 raft_consensus.cc:3055] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:21.656636 13190 raft_consensus.cc:740] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
W20260709 12:17:21.658001 13763 log.cc:927] Time spent T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:17:21.658721 13698 leader_election.cc:290] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:21.581701 13737 raft_consensus.cc:515] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
W20260709 12:17:21.660272 13604 consensus_meta.cc:287] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d: Time spent flushing consensus metadata: real 0.727s	user 0.012s	sys 0.000s
I20260709 12:17:21.660647 13730 raft_consensus.cc:515] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:21.661569 13737 leader_election.cc:290] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:21.662279 13475 leader_election.cc:290] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:21.666204 13190 consensus_queue.cc:260] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:21.585987 13603 raft_consensus.cc:515] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:21.596531 13564 leader_election.cc:290] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:21.669649 13603 leader_election.cc:290] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:21.629462 13759 raft_consensus.cc:2749] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:21.623606 13557 raft_consensus.cc:2749] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:21.660745 13604 raft_consensus.cc:515] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:21.675290 13604 leader_election.cc:290] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:21.678787 13627 leader_election.cc:290] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:21.679534 11565 leader_election.cc:304] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:21.681130 13564 raft_consensus.cc:2804] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:21.681622 13759 raft_consensus.cc:2749] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:21.681942 13564 raft_consensus.cc:697] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:21.681221 11565 leader_election.cc:304] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:21.683652 11565 leader_election.cc:304] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:21.683903 13573 raft_consensus.cc:2749] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:21.684883 13573 raft_consensus.cc:2804] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:21.685247 11565 leader_election.cc:304] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:21.653136 13758 raft_consensus.cc:515] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:21.683616 13564 consensus_queue.cc:237] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:21.686604 11565 leader_election.cc:304] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:21.591001 13509 raft_consensus.cc:3060] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:21.716188 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:21.716989 11600 raft_consensus.cc:1240] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:17:21.718127 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:21.713485 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:21.722482 11602 raft_consensus.cc:2393] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 7: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:17:21.717027 11594 raft_consensus.cc:2468] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 6.
I20260709 12:17:21.728539 11565 leader_election.cc:304] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:21.733554 11565 leader_election.cc:304] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:21.733831 11594 raft_consensus.cc:1275] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:17:21.734305 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:21.686137 13756 raft_consensus.cc:2749] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:21.740587 11565 leader_election.cc:304] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:21.737941 11599 raft_consensus.cc:1275] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:17:21.738027 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 187452us
I20260709 12:17:21.681350 13727 leader_election.cc:290] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:17:21.739931 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 156232us
I20260709 12:17:21.688099 13758 leader_election.cc:290] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:21.685537 13573 raft_consensus.cc:697] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:21.742272 11602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "1c101e338f954ef086338e251deed19d"
 from {username='slave'} at 127.0.0.1:37992
I20260709 12:17:21.743533 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:21.750468 12357 raft_consensus.cc:2468] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 7.
I20260709 12:17:21.751602 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:21.743883 11565 leader_election.cc:304] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:21.711251 12848 raft_consensus.cc:2804] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:21.753842 11602 raft_consensus.cc:606] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Received request to transfer leadership to TS 1c101e338f954ef086338e251deed19d
I20260709 12:17:21.747145 11600 raft_consensus.cc:2393] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 7: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:17:21.603469 13757 consensus_queue.cc:1048] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.136s
I20260709 12:17:21.736366 13741 raft_consensus.cc:2749] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:21.753106 11565 leader_election.cc:304] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:21.753818 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:21.744167 11417 leader_election.cc:304] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:21.754886 11602 raft_consensus.cc:614] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:21.762624 11417 leader_election.cc:304] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:21.764138 11417 leader_election.cc:304] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:21.755436 11419 leader_election.cc:304] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:21.685370 13726 raft_consensus.cc:515] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
W20260709 12:17:21.875633 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 120292us
I20260709 12:17:21.909188 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:21.909158 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:21.604840 13753 raft_consensus.cc:515] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:21.742682 13759 raft_consensus.cc:2749] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:21.889371 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:21.746651 13557 raft_consensus.cc:2749] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:21.910609 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
W20260709 12:17:21.875834 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 111782us
I20260709 12:17:21.914845 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d43eecbad746fd9ddce50c5b9fc3e8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:21.916703 11417 leader_election.cc:304] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:21.911317 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9fe9a94294836aec652338f44367d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:21.917768 11449 raft_consensus.cc:3060] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:21.911662 11446 raft_consensus.cc:3060] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:21.912349 11452 raft_consensus.cc:2393] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 6: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:21.645165 13754 raft_consensus.cc:515] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:21.914247 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:21.928794 11445 raft_consensus.cc:2393] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 8: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:17:21.919412 11417 leader_election.cc:304] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:21.931345 11451 raft_consensus.cc:2393] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 7: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:21.760838 13556 raft_consensus.cc:2749] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:21.986351 11445 raft_consensus.cc:1275] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:21.876998 13727 raft_consensus.cc:493] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:21.914692 13475 raft_consensus.cc:2804] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:21.914846 13758 raft_consensus.cc:2804] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:17:21.993237 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 73903.2us
I20260709 12:17:21.905741 13752 raft_consensus.cc:493] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:21.905368 13571 raft_consensus.cc:2804] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:21.904973 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:21.995961 11449 raft_consensus.cc:2468] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 7.
I20260709 12:17:21.996853 11446 raft_consensus.cc:2468] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 7.
I20260709 12:17:21.916383 13698 raft_consensus.cc:2749] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:21.919946 13737 raft_consensus.cc:2804] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:22.002697 11417 leader_election.cc:304] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:22.017277 11565 leader_election.cc:304] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:17:22.030093 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:22.041517 11599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34d43eecbad746fd9ddce50c5b9fc3e8"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "1c101e338f954ef086338e251deed19d"
 from {username='slave'} at 127.0.0.1:37992
I20260709 12:17:22.042349 11599 raft_consensus.cc:606] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Received request to transfer leadership to TS 1c101e338f954ef086338e251deed19d
I20260709 12:17:22.042739 11599 raft_consensus.cc:614] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:22.043341 13774 raft_consensus.cc:2804] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:22.043815 13774 raft_consensus.cc:493] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:22.044145 13774 raft_consensus.cc:3060] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:22.046661 13754 leader_election.cc:290] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:22.007900 13413 raft_consensus.cc:493] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:22.047605 13413 raft_consensus.cc:515] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
W20260709 12:17:22.048424 13770 log.cc:927] Time spent T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:17:22.050101 13413 leader_election.cc:290] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:22.002758 13727 raft_consensus.cc:515] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:21.997488 13604 raft_consensus.cc:493] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:22.013986 13719 raft_consensus.cc:493] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:22.020035 13573 consensus_queue.cc:237] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:22.058902 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:22.006750 13758 raft_consensus.cc:493] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:22.006711 13571 raft_consensus.cc:493] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:22.062427 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 45322.3us
I20260709 12:17:22.011550 13475 raft_consensus.cc:697] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 7 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
W20260709 12:17:22.054042 13769 log.cc:927] Time spent T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 12:17:22.012256 13737 raft_consensus.cc:493] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:22.071269 11565 leader_election.cc:304] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:17:21.978895 13468 raft_consensus.cc:515] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:22.027839 12848 raft_consensus.cc:697] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
W20260709 12:17:22.066790 13675 consensus_meta.cc:287] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671: Time spent flushing consensus metadata: real 0.525s	user 0.010s	sys 0.000s
I20260709 12:17:22.116021 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:22.089118 13753 leader_election.cc:290] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:22.016343 13752 raft_consensus.cc:515] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:22.092018 13475 consensus_queue.cc:237] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:22.074354 13571 raft_consensus.cc:3060] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:22.096231 11599 raft_consensus.cc:1275] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:22.099735 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7937e0cff84ef7a26c84247c8ffc08" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:22.100983 11521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33456 (request call id 1004) took 1377 ms. Trace:
W20260709 12:17:22.101267 13765 log.cc:927] Time spent T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:17:22.102303 11594 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "b126028166e8480ba25541bf8f7fc6de"
 from {username='slave'} at 127.0.0.1:37992
I20260709 12:17:22.070315 13758 raft_consensus.cc:3060] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:22.068930 13741 raft_consensus.cc:2804] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:22.192476 13556 raft_consensus.cc:493] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:22.102036 13557 raft_consensus.cc:2804] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:22.239778 11521 rpcz_store.cc:276] 0709 12:17:20.723577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:20.724622 (+  1045us) service_pool.cc:224] Handling call
0709 12:17:22.100730 (+1376108us) spinlock_profiling.cc:243] Waited 285 ms on lock 0x7b54006df1d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:22.100910 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":654863744}
I20260709 12:17:22.054239 13719 raft_consensus.cc:515] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:22.060870 13604 raft_consensus.cc:515] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:22.079278 13757 raft_consensus.cc:2749] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:22.241460 13740 raft_consensus.cc:493] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:22.283851 13468 leader_election.cc:290] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:22.274068 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:22.293069 11446 raft_consensus.cc:1240] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:22.352401 11525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33456 (request call id 1009) took 1542 ms. Trace:
I20260709 12:17:22.327888 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7937e0cff84ef7a26c84247c8ffc08" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:22.398039 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:22.398845 11451 raft_consensus.cc:2468] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 5.
I20260709 12:17:22.084362 13737 raft_consensus.cc:3060] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:22.393710 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 391067us
I20260709 12:17:22.395952 11525 rpcz_store.cc:276] 0709 12:17:20.809629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:22.346190 (+1536561us) service_pool.cc:224] Handling call
0709 12:17:22.351827 (+  5637us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:22.352037 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:22.352062 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:22.352106 (+    44us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:22.352143 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:22.352195 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:22.352334 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:17:22.412187 11417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:22.413754 11450 raft_consensus.cc:2368] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de for earlier term 3. Current term is 4.
W20260709 12:17:22.385174 13509 consensus_meta.cc:287] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8: Time spent flushing consensus metadata: real 0.652s	user 0.001s	sys 0.006s
W20260709 12:17:22.412940 11417 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.212.132:34973 timed out after 2.265s (SENT) [suppressed 26 similar messages]
I20260709 12:17:22.284395 13730 leader_election.cc:290] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:22.284627 13741 raft_consensus.cc:697] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 7 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:22.352332 13746 raft_consensus.cc:493] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:22.373837 13147 raft_consensus.cc:493] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:22.296190 13557 raft_consensus.cc:697] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:22.372718 13604 leader_election.cc:290] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:22.240362 13726 leader_election.cc:290] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:22.284934 13556 raft_consensus.cc:515] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:22.311102 13740 raft_consensus.cc:515] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:22.442839 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:17:22.443377 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 204089us
I20260709 12:17:22.445796 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8741606df54c3f8b5cc5c1141862ea" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:22.320178 12848 consensus_queue.cc:237] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:22.449244 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:22.422372 13509 raft_consensus.cc:515] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:22.451712 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d43eecbad746fd9ddce50c5b9fc3e8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:22.453775 11595 raft_consensus.cc:3060] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:22.424285 13768 consensus_queue.cc:1048] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:17:22.454937 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:22.456552 11602 raft_consensus.cc:2410] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:17:22.439383 13147 raft_consensus.cc:515] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:22.502211 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:22.503165 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:22.449944 13698 raft_consensus.cc:3060] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:22.437609 13746 raft_consensus.cc:515] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:22.447595 13726 raft_consensus.cc:493] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:22.505668 11602 raft_consensus.cc:2393] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 6: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:17:22.510134 11596 raft_consensus.cc:1240] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:22.454807 13752 leader_election.cc:290] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:22.512887 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e4724ed93a467ea47763eec9a6de2e" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:22.502585 13556 leader_election.cc:290] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:22.502878 13730 raft_consensus.cc:493] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:22.510039 13719 leader_election.cc:290] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:22.531122 11595 raft_consensus.cc:2468] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 6.
I20260709 12:17:22.532181 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:17:22.535440 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 122531us
I20260709 12:17:22.533202 13147 leader_election.cc:290] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:22.533934 13730 raft_consensus.cc:515] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:22.543648 13730 leader_election.cc:290] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:22.547277 11452 raft_consensus.cc:1275] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:22.546975 13571 raft_consensus.cc:515] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:22.504873 13557 consensus_queue.cc:237] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:22.551754 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:22.553604 13759 consensus_queue.cc:1048] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:22.522104 13741 consensus_queue.cc:237] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:22.554615 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:22.555483 12345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51698 (request call id 714) took 1083 ms. Trace:
I20260709 12:17:22.551813 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:22.556674 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:22.557331 12357 raft_consensus.cc:3060] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:22.559819 13408 raft_consensus.cc:493] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:22.521251 13726 raft_consensus.cc:515] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:22.560408 13408 raft_consensus.cc:515] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:22.562155 11601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 754) took 1235 ms. Trace:
I20260709 12:17:22.562703 11601 rpcz_store.cc:276] 0709 12:17:21.327022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:21.327157 (+   135us) service_pool.cc:224] Handling call
0709 12:17:22.561951 (+1234794us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b54004fa6d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:22.562089 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":331389184}
I20260709 12:17:22.556752 11454 raft_consensus.cc:2468] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 4.
I20260709 12:17:22.564653 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:22.545051 12203 leader_election.cc:304] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:22.584378 12357 raft_consensus.cc:2468] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 6.
I20260709 12:17:22.555792 12345 rpcz_store.cc:276] 0709 12:17:21.472559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:21.472676 (+   117us) service_pool.cc:224] Handling call
0709 12:17:22.554460 (+1081784us) spinlock_profiling.cc:243] Waited 9.64 ms on lock 0x7b5800003f98. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb890a0 00007f84ebb88984 00007f84e51036d4 00007f84e5103662
0709 12:17:22.555398 (+   938us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22180608}
W20260709 12:17:22.622432 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 77461.7us
I20260709 12:17:22.609442 11452 raft_consensus.cc:1240] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:22.620437 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:22.632874 11595 raft_consensus.cc:2468] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 7.
I20260709 12:17:22.573256 13571 leader_election.cc:290] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:22.636025 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:22.637799 11601 raft_consensus.cc:2368] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de for earlier term 3. Current term is 4.
I20260709 12:17:22.626124 13147 raft_consensus.cc:2749] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:22.646042 13726 leader_election.cc:290] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
W20260709 12:17:22.647645 13774 consensus_meta.cc:287] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d: Time spent flushing consensus metadata: real 0.603s	user 0.010s	sys 0.002s
I20260709 12:17:22.648188 13774 raft_consensus.cc:515] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:22.649736 11445 raft_consensus.cc:2393] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 7: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:22.650538 13698 raft_consensus.cc:2749] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:22.650882 13509 leader_election.cc:290] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:22.654803 13408 leader_election.cc:290] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:22.655587 13730 consensus_queue.cc:1048] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:22.637676 12203 leader_election.cc:304] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:22.660107 13478 leader_election.cc:290] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:22.661535 11593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55250 (request call id 605) took 1202 ms. Trace:
I20260709 12:17:22.661945 11593 rpcz_store.cc:276] 0709 12:17:21.458784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:21.458932 (+   148us) service_pool.cc:224] Handling call
0709 12:17:22.661285 (+1202353us) spinlock_profiling.cc:243] Waited 7.39 ms on lock 0x7b54005bb654. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:22.661472 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16999808}
I20260709 12:17:22.662545 13746 leader_election.cc:290] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:22.663695 13740 leader_election.cc:290] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
W20260709 12:17:22.665763 11447 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58856 (request call id 617) took 1700 ms (client timeout 2117 ms). Trace:
I20260709 12:17:22.666447 13737 raft_consensus.cc:515] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:22.667681 11448 raft_consensus.cc:2393] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 8: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
W20260709 12:17:22.666203 11447 rpcz_store.cc:269] 0709 12:17:20.964956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:20.965099 (+   143us) service_pool.cc:224] Handling call
0709 12:17:22.665602 (+1700503us) spinlock_profiling.cc:243] Waited 60.4 ms on lock 0x7b5400107554. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:22.665708 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":138934144}
I20260709 12:17:22.673408 12203 leader_election.cc:400] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 election: Vote denied by peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579) with higher term. Message: Invalid argument: T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de for earlier term 3. Current term is 4.
I20260709 12:17:22.673744 12203 leader_election.cc:403] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:17:22.779376 11448 raft_consensus.cc:1275] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:17:22.781086 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 106636us
I20260709 12:17:22.780601 13601 raft_consensus.cc:493] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:22.778901 13781 raft_consensus.cc:2804] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:22.800498 12203 leader_election.cc:304] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:22.784741 13740 raft_consensus.cc:3060] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:22.732740 13737 leader_election.cc:290] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:22.813155 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:22.819876 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
W20260709 12:17:22.867488 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 50836.3us
W20260709 12:17:22.868497 11417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:22.797262 13726 raft_consensus.cc:493] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:22.819581 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:22.819545 11447 raft_consensus.cc:1240] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:22.870222 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:22.784852 13408 consensus_queue.cc:1059] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:17:22.874348 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:22.882754 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:22.819092 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:22.886826 11598 raft_consensus.cc:2393] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 6: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:17:22.865028 13356 raft_consensus.cc:2804] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:22.887557 11448 raft_consensus.cc:2393] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 6: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:22.867251 11454 raft_consensus.cc:2468] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 6.
I20260709 12:17:22.883180 13726 raft_consensus.cc:515] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:22.808642 13781 raft_consensus.cc:493] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:22.884281 12346 raft_consensus.cc:1275] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:22.790381 13758 raft_consensus.cc:515] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:22.897084 11451 raft_consensus.cc:1240] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:22.897147 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:22.897867 12346 raft_consensus.cc:2468] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 8.
I20260709 12:17:22.898694 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ed4eeff0ae44d0bc1ebb8cbe3adea5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:22.899901 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:22.880967 13571 raft_consensus.cc:493] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:22.901186 13758 leader_election.cc:290] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:22.901664 13571 raft_consensus.cc:515] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:22.903918 13571 leader_election.cc:290] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:22.906773 11567 leader_election.cc:304] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:22.908497 13571 raft_consensus.cc:2804] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:22.909037 13571 raft_consensus.cc:493] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:22.911223 13571 raft_consensus.cc:3060] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:22.909910 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:22.913335 12346 raft_consensus.cc:2468] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 7.
I20260709 12:17:22.914577 11567 leader_election.cc:304] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:22.915361 13557 raft_consensus.cc:2804] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:22.915745 13557 raft_consensus.cc:493] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:22.916059 13557 raft_consensus.cc:3060] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:22.934461 13557 raft_consensus.cc:515] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:22.939182 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:17:22.948029 13721 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.841s	user 0.021s	sys 0.031s
I20260709 12:17:22.871260 13719 consensus_queue.cc:1059] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:17:22.970657 13719 consensus_queue.cc:1243] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer 1c101e338f954ef086338e251deed19d log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:17:22.958072 11594 raft_consensus.cc:606] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 LEADER]: Received request to transfer leadership to TS b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:22.887367 13730 raft_consensus.cc:493] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:22.891355 13356 raft_consensus.cc:493] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting leader election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:22.810624 13601 raft_consensus.cc:515] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:22.893173 13147 raft_consensus.cc:493] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:22.946655 13781 raft_consensus.cc:3060] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:22.970068 13801 raft_consensus.cc:3055] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:22.968322 12346 raft_consensus.cc:2468] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 7.
I20260709 12:17:23.029934 11567 leader_election.cc:304] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:23.005848 13730 raft_consensus.cc:515] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:22.945766 13571 raft_consensus.cc:515] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:23.005153 13740 raft_consensus.cc:2749] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579) with higher term. Message: Invalid argument: T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de for earlier term 3. Current term is 4.
W20260709 12:17:22.970220 13721 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.867s	user 0.022s	sys 0.031s
I20260709 12:17:22.805248 13741 consensus_queue.cc:1048] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.087s
I20260709 12:17:23.021747 13356 raft_consensus.cc:3060] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:23.013260 11454 raft_consensus.cc:1275] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:17:23.014111 13712 raft_consensus.cc:493] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:23.015388 13576 raft_consensus.cc:493] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:23.018075 13793 log.cc:927] Time spent T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:17:23.002846 13796 log.cc:927] Time spent T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:17:23.026472 13408 consensus_queue.cc:1059] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 12:17:22.907886 13786 consensus_queue.cc:1048] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:23.020598 12203 leader_election.cc:304] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:23.032776 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:23.011435 13557 leader_election.cc:290] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:23.030869 13774 leader_election.cc:290] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:23.052951 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:23.054535 12203 leader_election.cc:304] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:23.048233 11454 raft_consensus.cc:1240] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:23.040908 13748 raft_consensus.cc:2804] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:23.028716 13801 raft_consensus.cc:740] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:23.022197 13734 consensus_queue.cc:1059] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
W20260709 12:17:23.050567 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 145780us
I20260709 12:17:23.065683 11524 raft_consensus.cc:1275] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:17:23.029153 13147 raft_consensus.cc:515] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:23.062933 11454 raft_consensus.cc:1275] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:17:23.066952 11526 raft_consensus.cc:1240] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:17:23.072281 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:23.073228 11519 raft_consensus.cc:3060] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:23.073626 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:23.074255 11526 raft_consensus.cc:2468] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 6.
I20260709 12:17:23.068147 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:23.068796 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:23.069871 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9fe9a94294836aec652338f44367d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:23.070572 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ed4eeff0ae44d0bc1ebb8cbe3adea5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:23.075559 11521 raft_consensus.cc:2468] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 5.
I20260709 12:17:23.075832 11528 raft_consensus.cc:3060] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:17:23.077170 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:23.077803 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:23.078217 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:23.044426 13712 raft_consensus.cc:515] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:23.078363 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:23.078780 12348 raft_consensus.cc:3060] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:23.079736 11417 leader_election.cc:304] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:17:23.077170 13777 consensus_queue.cc:1048] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:17:23.060051 13748 raft_consensus.cc:493] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:23.080907 13748 raft_consensus.cc:3060] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:23.082219 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:23.078387 11523 raft_consensus.cc:3060] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:23.080235 13712 leader_election.cc:290] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:23.085273 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:23.085573 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:23.086012 11417 leader_election.cc:304] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:17:23.088014 11598 raft_consensus.cc:2393] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 7: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:17:23.087862 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:23.089648 12346 raft_consensus.cc:3060] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:23.090623 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:23.090972 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:23.091282 11520 raft_consensus.cc:3060] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:23.091598 11526 raft_consensus.cc:2468] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 7.
I20260709 12:17:23.092168 12348 raft_consensus.cc:2468] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 8.
I20260709 12:17:23.062232 13803 raft_consensus.cc:2804] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:23.094187 13803 raft_consensus.cc:493] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting leader election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:23.094558 13803 raft_consensus.cc:3060] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:23.086740 13800 raft_consensus.cc:3060] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:23.097467 13737 consensus_queue.cc:1059] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:23.097975 13408 consensus_queue.cc:1048] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:17:23.083542 13795 log.cc:927] Time spent T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 12:17:23.099599 13589 raft_consensus.cc:2804] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:23.100193 13589 raft_consensus.cc:697] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 6 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:23.082333 13746 consensus_queue.cc:1059] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:17:23.101090 13589 consensus_queue.cc:237] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:23.101944 13746 raft_consensus.cc:3055] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:23.102337 13746 raft_consensus.cc:740] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:23.103153 13746 consensus_queue.cc:260] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:23.104332 13746 raft_consensus.cc:3060] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:23.106750 12348 raft_consensus.cc:1275] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 12:17:23.097855 13794 log.cc:927] Time spent T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 12:17:23.047330 13576 raft_consensus.cc:515] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:23.108783 11567 leader_election.cc:304] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:23.130146 11597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55252 (request call id 761) took 1787 ms. Trace:
I20260709 12:17:23.131167 11600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40784 (request call id 310) took 1415 ms. Trace:
I20260709 12:17:23.131587 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:23.132254 11521 raft_consensus.cc:3060] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:17:23.131552 11600 rpcz_store.cc:276] 0709 12:17:21.716076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:21.717882 (+  1806us) service_pool.cc:224] Handling call
0709 12:17:23.130994 (+1413112us) spinlock_profiling.cc:243] Waited 28.2 ms on lock 0x7b5400a1f9d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:23.131115 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64944896}
I20260709 12:17:23.130616 11597 rpcz_store.cc:276] 0709 12:17:21.342889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:21.343024 (+   135us) service_pool.cc:224] Handling call
0709 12:17:23.129953 (+1786929us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b54005c44d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:23.130087 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":292034432}
I20260709 12:17:23.135392 11519 raft_consensus.cc:2468] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 4.
W20260709 12:17:23.111181 11566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:23.110630 11520 raft_consensus.cc:2468] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 7.
I20260709 12:17:23.134343 13168 raft_consensus.cc:2804] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:23.144364 13601 leader_election.cc:290] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:23.130800 13712 raft_consensus.cc:3055] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:23.077170 13726 leader_election.cc:290] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:23.160144 12349 raft_consensus.cc:1275] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:23.108173 11525 raft_consensus.cc:2393] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 6: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:23.118137 13800 raft_consensus.cc:2749] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:23.121114 12348 raft_consensus.cc:1275] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:23.123031 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:23.167917 12359 raft_consensus.cc:3060] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:23.052640 13573 consensus_queue.cc:1048] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 12:17:23.123963 13801 consensus_queue.cc:260] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:23.107904 13774 raft_consensus.cc:2804] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:23.176491 12346 raft_consensus.cc:2468] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 4.
I20260709 12:17:23.101114 13147 leader_election.cc:290] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:23.138648 11523 raft_consensus.cc:2468] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 7.
I20260709 12:17:23.110569 11527 raft_consensus.cc:2468] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 7.
I20260709 12:17:23.154315 11528 raft_consensus.cc:2468] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 7.
I20260709 12:17:23.111992 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:23.188827 11567 leader_election.cc:304] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:23.189010 11526 raft_consensus.cc:2468] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 9.
I20260709 12:17:23.157030 11419 leader_election.cc:304] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:23.131922 13721 raft_consensus.cc:493] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:23.130527 11417 leader_election.cc:304] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:23.187191 11521 raft_consensus.cc:2468] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 8.
I20260709 12:17:23.197467 12359 raft_consensus.cc:2468] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 5.
W20260709 12:17:23.202250 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 45291.3us
I20260709 12:17:23.203150 11419 leader_election.cc:304] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
W20260709 12:17:23.203946 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 189498us
I20260709 12:17:23.207096 12349 raft_consensus.cc:1240] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:17:23.138962 13786 consensus_queue.cc:1048] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:17:23.158737 13712 raft_consensus.cc:740] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:23.218129 13712 consensus_queue.cc:260] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:23.219175 13712 raft_consensus.cc:3060] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:23.222381 13727 leader_election.cc:290] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
W20260709 12:17:23.225903 13791 log.cc:927] Time spent T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.567s	user 0.000s	sys 0.002s
I20260709 12:17:23.228677 13740 raft_consensus.cc:3055] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:23.177182 13803 raft_consensus.cc:515] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:23.231429 13803 leader_election.cc:290] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:23.232432 13747 raft_consensus.cc:493] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:23.237409 12848 consensus_queue.cc:1059] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:17:23.238381 12848 raft_consensus.cc:3055] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:23.238749 12848 raft_consensus.cc:740] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:23.239589 12848 consensus_queue.cc:260] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:23.240773 12848 raft_consensus.cc:3060] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:23.172448 13774 raft_consensus.cc:493] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting leader election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:23.241611 13774 raft_consensus.cc:3060] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:23.212218 11566 leader_election.cc:304] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:23.178337 13168 raft_consensus.cc:697] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 8 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:23.213598 13797 raft_consensus.cc:2804] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:23.214140 13557 raft_consensus.cc:2804] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:23.210888 13801 raft_consensus.cc:3060] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:23.199492 13721 raft_consensus.cc:515] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:23.229146 13740 raft_consensus.cc:740] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:23.200043 13739 consensus_queue.cc:1048] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 12:17:23.247411 11566 leader_election.cc:304] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:23.233004 13747 raft_consensus.cc:515] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:23.208719 13601 raft_consensus.cc:2749] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:23.270048 13781 raft_consensus.cc:515] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:23.271064 13557 raft_consensus.cc:697] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 4 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:23.214067 13478 consensus_queue.cc:1048] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.054s
W20260709 12:17:23.269038 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 138565us
I20260709 12:17:23.277802 13730 leader_election.cc:290] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
W20260709 12:17:23.277866 13799 log.cc:927] Time spent T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.233s	user 0.000s	sys 0.001s
I20260709 12:17:23.298435 13747 leader_election.cc:290] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:23.298913 13557 consensus_queue.cc:237] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:23.278811 13168 consensus_queue.cc:237] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:23.279783 13610 raft_consensus.cc:3055] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:23.282989 13190 raft_consensus.cc:3060] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:23.305536 13576 leader_election.cc:290] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:23.256338 13777 raft_consensus.cc:2804] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:23.199047 13509 consensus_queue.cc:1048] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 12:17:23.297636 13478 raft_consensus.cc:2749] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:23.302942 13610 raft_consensus.cc:740] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:23.213088 12346 raft_consensus.cc:1240] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:23.287592 13520 raft_consensus.cc:493] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:23.307051 12359 raft_consensus.cc:1240] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:17:23.307152 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c355b3902a4e7fb72bac6a91ea3316" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:23.306586 13777 raft_consensus.cc:493] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:23.306237 13739 raft_consensus.cc:493] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:23.292629 13797 raft_consensus.cc:697] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 6 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:23.310508 13520 raft_consensus.cc:515] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:23.300143 13748 raft_consensus.cc:515] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:23.320214 13520 leader_election.cc:290] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:23.320704 13571 leader_election.cc:290] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 9 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:23.323961 13610 consensus_queue.cc:260] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:23.325150 13610 raft_consensus.cc:3060] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:23.312268 13777 raft_consensus.cc:3060] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:23.329802 11522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33456 (request call id 1010) took 2517 ms. Trace:
I20260709 12:17:23.330279 11522 rpcz_store.cc:276] 0709 12:17:20.813175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:20.813354 (+   179us) service_pool.cc:224] Handling call
0709 12:17:20.813748 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:20.874536 (+ 60788us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:20.874565 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:21.648275 (+773710us) spinlock_profiling.cc:243] Waited 2.65 ms on lock 0x7b2c0019c098. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e54bca11 00007f84e54cc372 00007f84e6bfea01 00007f84e6bc343a 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2
0709 12:17:21.648666 (+   391us) log.cc:844] Serialized 26 byte log entry
0709 12:17:21.966143 (+317477us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:21.966187 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:23.329451 (+1363264us) spinlock_profiling.cc:243] Waited 57.6 ms on lock 0x7b54001379d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:17:23.329503 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:23.329551 (+    48us) raft_consensus.cc:1685] finished
0709 12:17:23.329563 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:23.329708 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2810,"raft.queue_time_us":3207,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":5284,"spinlock_wait_cycles":138530048,"thread_start_us":317112,"threads_started":1,"wal-append.queue_time_us":425054,"wal-append.run_cpu_time_us":1815,"wal-append.run_wall_time_us":1014325}
I20260709 12:17:23.333604 11594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:37992 (request call id 31) took 1234 ms. Trace:
I20260709 12:17:23.333779 11449 raft_consensus.cc:2468] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 7.
I20260709 12:17:23.334087 11594 rpcz_store.cc:276] 0709 12:17:22.099631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:22.102112 (+  2481us) service_pool.cc:224] Handling call
0709 12:17:23.333421 (+1231309us) spinlock_profiling.cc:243] Waited 563 ms on lock 0x7b5400568954. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bbd853 00007f84ebb8b60a 00007f84e51117d4 00007f84e5111762 00007f84e5111691 00007f84e511160c 00007f84e51108c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:23.333518 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1294121728}
I20260709 12:17:23.335006 13781 leader_election.cc:290] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:23.335952 11596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40784 (request call id 308) took 1620 ms. Trace:
I20260709 12:17:23.336383 11449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35814 (request call id 312) took 1278 ms. Trace:
I20260709 12:17:23.336341 11596 rpcz_store.cc:276] 0709 12:17:21.715384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:21.720474 (+  5090us) service_pool.cc:224] Handling call
0709 12:17:21.720768 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:22.518106 (+797338us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:23.335736 (+817630us) spinlock_profiling.cc:243] Waited 784 ms on lock 0x7b5400278654. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:17:23.335898 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1803080064}
I20260709 12:17:23.336885 11449 rpcz_store.cc:276] 0709 12:17:22.058310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:22.058532 (+   222us) service_pool.cc:224] Handling call
0709 12:17:23.336214 (+1277682us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54001aa254. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:23.336324 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2929345920}
I20260709 12:17:23.368475 11493 leader_election.cc:304] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:23.320560 13748 leader_election.cc:290] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
W20260709 12:17:23.361526 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 277513us
I20260709 12:17:23.373661 12203 leader_election.cc:304] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:23.386577 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:23.387462 12347 raft_consensus.cc:2368] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 5. Current term is 6.
I20260709 12:17:23.380692 13747 raft_consensus.cc:2804] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:17:23.389946 12347 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51698 (request call id 713) took 1918 ms (client timeout 1853 ms). Trace:
W20260709 12:17:23.390425 12347 rpcz_store.cc:269] 0709 12:17:21.471943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:21.472729 (+   786us) service_pool.cc:224] Handling call
0709 12:17:23.386401 (+1913672us) spinlock_profiling.cc:243] Waited 9.56 ms on lock 0x7b5800003f98. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb890a0 00007f84ebb88984 00007f84e51036d4 00007f84e5103662
0709 12:17:23.389868 (+  3467us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21981440}
I20260709 12:17:23.390944 13520 consensus_queue.cc:1048] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:23.391583 11596 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67ed4eeff0ae44d0bc1ebb8cbe3adea5"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "a03223e9e41247c3a36b7b7c3d476671"
 from {username='slave'} at 127.0.0.1:37992
I20260709 12:17:23.392242 11596 raft_consensus.cc:606] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Received request to transfer leadership to TS a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:23.392613 11596 raft_consensus.cc:614] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:23.399552  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:17:23.388718 13721 leader_election.cc:290] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:23.336014 13739 raft_consensus.cc:515] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:23.390236 13747 raft_consensus.cc:697] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 5 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:23.329806 13797 consensus_queue.cc:237] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:23.386008 13781 raft_consensus.cc:3060] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:23.420656 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:23.421720 12347 raft_consensus.cc:1240] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:23.427323 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:23.423880 12203 leader_election.cc:304] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:23.427162 13147 raft_consensus.cc:493] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:23.340587 13740 consensus_queue.cc:260] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:23.440884 12203 leader_election.cc:400] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 election: Vote denied by peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973) with higher term. Message: Invalid argument: T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de for earlier term 3. Current term is 4.
I20260709 12:17:23.441401 12203 leader_election.cc:403] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:17:23.436908 13147 raft_consensus.cc:515] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:23.449404 12203 leader_election.cc:304] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:23.447167 13803 raft_consensus.cc:2749] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:23.476615 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:23.469065 11527 raft_consensus.cc:1275] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:17:23.486107 11445 raft_consensus.cc:2468] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 6.
I20260709 12:17:23.489176 11445 raft_consensus.cc:1240] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:23.489279 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:23.487952 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:23.490947 11527 raft_consensus.cc:2393] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 7: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:17:23.482805 11521 raft_consensus.cc:1240] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:23.458948 13740 raft_consensus.cc:3060] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:23.496371 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 307594us
I20260709 12:17:23.468921 11522 raft_consensus.cc:1275] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:17:23.458177 13589 raft_consensus.cc:493] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:23.490031 11452 raft_consensus.cc:2468] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 5.
I20260709 12:17:23.493369 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:23.438007 13576 consensus_queue.cc:1059] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:17:23.458515 13520 raft_consensus.cc:2749] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973) with higher term. Message: Invalid argument: T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de for earlier term 3. Current term is 4.
I20260709 12:17:23.499892 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:23.466149 13726 raft_consensus.cc:2804] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:23.499235 11449 raft_consensus.cc:3060] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:23.501561 12352 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51698 (request call id 717) took 1949 ms. Trace:
I20260709 12:17:23.501652 12203 leader_election.cc:304] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:23.504361 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:23.513048 11526 raft_consensus.cc:2368] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de for earlier term 3. Current term is 4.
I20260709 12:17:23.505659 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:23.506247 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:23.514007 11521 raft_consensus.cc:2468] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 5.
I20260709 12:17:23.507300 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:23.497962 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:23.522847 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:23.523509 11521 raft_consensus.cc:2468] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 8.
I20260709 12:17:23.514926 11522 raft_consensus.cc:2468] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 8.
I20260709 12:17:23.524821 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:17:23.526849 11418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:23.511322 12352 rpcz_store.cc:276] 0709 12:17:21.546429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:21.546560 (+   131us) service_pool.cc:224] Handling call
0709 12:17:21.546917 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:21.547125 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:17:23.149755 (+1602630us) spinlock_profiling.cc:243] Waited 6.18 ms on lock 0x7b180048eaa0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e676b4bc 00007f84e3ab948b 00007f84ec9139a9 00007f84e3ad569b 00007f84e3ad393f 00007f84e3ad3455 00007f84ea5bb3c7 00007f84e6bcd9a7 00007f84e6bdd0bf
0709 12:17:23.149922 (+   167us) log.cc:844] Serialized 14 byte log entry
0709 12:17:23.495204 (+345282us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:23.495256 (+    52us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:23.495299 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:23.495362 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:23.495467 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14631,"prepare.queue_time_us":6007,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":33610,"spinlock_wait_cycles":14207872,"thread_start_us":352449,"threads_started":2}
I20260709 12:17:23.533703 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:23.535255 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:23.540205 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:23.491708 13748 raft_consensus.cc:493] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:23.555023 12204 leader_election.cc:304] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:23.550137 11567 leader_election.cc:304] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:23.551481 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:23.556211 12345 raft_consensus.cc:3060] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:23.556667 11449 raft_consensus.cc:2468] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 6.
I20260709 12:17:23.495895 13627 raft_consensus.cc:493] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
W20260709 12:17:23.494377 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 205788us
I20260709 12:17:23.552228 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:23.495728 13168 raft_consensus.cc:493] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:23.553550 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:23.563907 11596 raft_consensus.cc:3060] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:23.560372 11566 leader_election.cc:304] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:23.525096 13571 raft_consensus.cc:493] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:23.568212 11566 leader_election.cc:304] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:23.573777 11566 leader_election.cc:304] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:23.575547 12345 raft_consensus.cc:2468] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 9.
I20260709 12:17:23.535511 13811 raft_consensus.cc:493] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
W20260709 12:17:23.599246 13637 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.017s	user 0.008s	sys 0.056s
I20260709 12:17:23.559537 13803 raft_consensus.cc:2749] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:23.557704 13478 raft_consensus.cc:2749] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:23.484369 13747 consensus_queue.cc:237] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:23.545943 13356 raft_consensus.cc:515] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
W20260709 12:17:23.609055 13637 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.037s	user 0.008s	sys 0.057s
I20260709 12:17:23.526824 13589 raft_consensus.cc:515] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:23.597813 13571 raft_consensus.cc:515] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
W20260709 12:17:23.633145 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 131594us
I20260709 12:17:23.566200 13748 raft_consensus.cc:515] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:23.619318 13811 raft_consensus.cc:515] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:23.571014 13627 raft_consensus.cc:515] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:23.630227 13823 raft_consensus.cc:2749] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:23.579152 13168 raft_consensus.cc:515] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:23.655193 12349 raft_consensus.cc:1240] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:23.621138 13801 raft_consensus.cc:2804] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:23.616675 13808 raft_consensus.cc:493] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:23.660220 12203 leader_election.cc:304] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
W20260709 12:17:23.711561 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 51414us
W20260709 12:17:23.646744 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 440497us
W20260709 12:17:23.712999 11417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:23.623200 13726 raft_consensus.cc:697] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:23.665558 11596 raft_consensus.cc:2468] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 7.
I20260709 12:17:23.713891 11594 raft_consensus.cc:1240] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 12:17:23.718689 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 145002us
I20260709 12:17:23.713781 11491 leader_election.cc:304] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:23.720533 11566 leader_election.cc:304] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:23.723798 12203 leader_election.cc:304] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:23.713927 13478 raft_consensus.cc:2804] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:23.725735 11491 leader_election.cc:304] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
W20260709 12:17:23.738708 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 176804us
I20260709 12:17:23.636757 13803 consensus_queue.cc:1059] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.082s
I20260709 12:17:23.757421 11491 leader_election.cc:304] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:23.710680 13801 raft_consensus.cc:493] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
W20260709 12:17:23.729103 13814 log.cc:927] Time spent T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 12:17:23.722208 13637 raft_consensus.cc:2804] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:23.762751 11566 leader_election.cc:304] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d
I20260709 12:17:23.722040 13147 leader_election.cc:290] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:23.738021 13739 leader_election.cc:290] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:23.770221 13589 leader_election.cc:290] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:23.714593 13800 consensus_queue.cc:1059] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:17:23.731824 13576 raft_consensus.cc:2749] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:23.754268 13413 raft_consensus.cc:2804] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:23.762660 13801 raft_consensus.cc:3060] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:23.771534 13726 consensus_queue.cc:237] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:23.882472 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:23.732169 13468 consensus_queue.cc:1048] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 12:17:23.735523 13734 consensus_queue.cc:1048] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 12:17:23.719471 13808 raft_consensus.cc:515] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:23.887359 13413 raft_consensus.cc:493] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:23.726619 13835 consensus_queue.cc:1059] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.117s
I20260709 12:17:23.774605 13637 raft_consensus.cc:493] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting leader election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:23.898499 13637 raft_consensus.cc:3060] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:23.839722 13712 consensus_meta.cc:287] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671: Time spent flushing consensus metadata: real 0.620s	user 0.006s	sys 0.006s
W20260709 12:17:23.890870 13812 log.cc:927] Time spent T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
W20260709 12:17:23.892153 13813 log.cc:927] Time spent T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.244s	user 0.001s	sys 0.000s
I20260709 12:17:23.895879 13781 raft_consensus.cc:2749] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:17:23.881147 13746 consensus_meta.cc:287] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8: Time spent flushing consensus metadata: real 0.753s	user 0.006s	sys 0.013s
I20260709 12:17:23.838542 13840 raft_consensus.cc:2749] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:23.927469 13818 raft_consensus.cc:2804] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:23.948215 13818 raft_consensus.cc:493] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:23.948652 13818 raft_consensus.cc:3060] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:23.970471 13833 raft_consensus.cc:3055] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:23.971123 13833 raft_consensus.cc:740] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:23.972072 13833 consensus_queue.cc:260] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:23.974064 13837 raft_consensus.cc:3055] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:23.974444 13833 raft_consensus.cc:3060] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:23.974637 13837 raft_consensus.cc:740] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:23.930344 13839 consensus_queue.cc:1048] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 12:17:23.982993 13811 leader_election.cc:290] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:23.987869 13837 consensus_queue.cc:260] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:23.989485 13837 raft_consensus.cc:3060] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:17:24.031096 11418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:24.033171 11450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58868 (request call id 1218) took 1468 ms. Trace:
I20260709 12:17:24.033931 11450 rpcz_store.cc:276] 0709 12:17:22.564486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:22.564643 (+   157us) service_pool.cc:224] Handling call
0709 12:17:22.565006 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:22.565391 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:22.565421 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:23.309539 (+744118us) spinlock_profiling.cc:243] Waited 6.14 ms on lock 0x7b2c0016f388. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e54bca11 00007f84e54cc372 00007f84e6bfea01 00007f84e6bc343a 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2
0709 12:17:23.312219 (+  2680us) log.cc:844] Serialized 26 byte log entry
0709 12:17:23.478906 (+166687us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:23.478960 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:23.479031 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:24.032472 (+553441us) raft_consensus.cc:1685] finished
0709 12:17:24.032510 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:24.032976 (+   466us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30461,"raft.queue_time_us":815,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":78916,"spinlock_wait_cycles":14125440,"thread_start_us":160205,"threads_started":1,"wal-append.queue_time_us":622560}
W20260709 12:17:23.850518 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 192918us
I20260709 12:17:23.848564 11567 leader_election.cc:304] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
W20260709 12:17:23.768796 12205 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:24.097009 12205 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:23.897946 13413 raft_consensus.cc:3060] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:23.909617 13734 raft_consensus.cc:2749] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:17:24.106082 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 257457us
I20260709 12:17:24.108752 13746 raft_consensus.cc:2804] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:24.109683 13849 raft_consensus.cc:493] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:24.109833 13841 raft_consensus.cc:493] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
W20260709 12:17:24.110169 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 349829us
I20260709 12:17:24.110746 13849 raft_consensus.cc:515] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:24.111754 12203 leader_election.cc:304] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:24.109695 13746 raft_consensus.cc:697] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:24.120065 13746 consensus_queue.cc:237] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
W20260709 12:17:24.068462 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 311003us
W20260709 12:17:24.040851 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 277855us
I20260709 12:17:24.088446 13571 leader_election.cc:290] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:24.089190 13478 raft_consensus.cc:697] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:23.883388 12357 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 940) took 1216 ms. Trace:
W20260709 12:17:24.141669 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 366487us
I20260709 12:17:24.142424 12357 rpcz_store.cc:276] 0709 12:17:22.666858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:22.674859 (+  8001us) service_pool.cc:224] Handling call
0709 12:17:23.882306 (+1207447us) spinlock_profiling.cc:243] Waited 3.89 ms on lock 0x7b5800003f98. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb890a0 00007f84ebb88984 00007f84e51036d4 00007f84e5103662
0709 12:17:23.883308 (+  1002us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8950656}
I20260709 12:17:24.148448 11450 raft_consensus.cc:1275] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:17:24.148795 13781 raft_consensus.cc:2804] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:24.149238 13781 raft_consensus.cc:493] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting leader election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:24.067608 13589 raft_consensus.cc:493] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
W20260709 12:17:24.146970 13610 consensus_meta.cc:287] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d: Time spent flushing consensus metadata: real 0.821s	user 0.018s	sys 0.016s
I20260709 12:17:24.150245 13589 raft_consensus.cc:515] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:24.100553 12348 raft_consensus.cc:1240] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:24.133121 12356 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 943) took 1465 ms. Trace:
I20260709 12:17:24.135156 13601 raft_consensus.cc:493] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:24.137748 13849 leader_election.cc:290] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:24.153589 13601 raft_consensus.cc:515] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:24.154994 13808 leader_election.cc:290] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:24.129139 11491 leader_election.cc:304] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:24.102846 13356 leader_election.cc:290] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:24.155536 13833 consensus_queue.cc:1059] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:17:24.163129 13356 raft_consensus.cc:3055] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:24.163772 13356 raft_consensus.cc:740] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:24.163812 13811 raft_consensus.cc:493] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:24.165314 12204 leader_election.cc:304] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d
I20260709 12:17:24.165863 13356 consensus_queue.cc:260] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:24.166638 13478 consensus_queue.cc:237] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:24.168013 13356 raft_consensus.cc:3060] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:24.168901 13817 raft_consensus.cc:493] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:24.152997 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:24.152498 12356 rpcz_store.cc:276] 0709 12:17:22.667742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:22.671053 (+  3311us) service_pool.cc:224] Handling call
0709 12:17:23.254686 (+583633us) spinlock_profiling.cc:243] Waited 6.46 ms on lock 0x7b5800003f98. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb9cfc0 00007f84ebb87929 00007f84ebb873d2 00007f84e50febd4
0709 12:17:23.254895 (+   209us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:23.255271 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:17:23.255298 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:23.255765 (+   467us) log.cc:844] Serialized 26 byte log entry
0709 12:17:23.653335 (+397570us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:23.653393 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:23.653462 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:24.125738 (+472276us) raft_consensus.cc:1685] finished
0709 12:17:24.132472 (+  6734us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:24.132889 (+   417us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":518,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":89,"spinlock_wait_cycles":14854400,"thread_start_us":397200,"threads_started":1,"wal-append.queue_time_us":481986}
I20260709 12:17:24.169729 13833 raft_consensus.cc:2764] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:17:24.169742 13589 leader_election.cc:290] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:24.169368 12204 leader_election.cc:304] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:24.110975 13841 raft_consensus.cc:515] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
W20260709 12:17:24.137825 13777 consensus_meta.cc:287] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8: Time spent flushing consensus metadata: real 0.807s	user 0.019s	sys 0.000s
I20260709 12:17:24.158600 13781 raft_consensus.cc:3060] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:24.195832 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:24.196749 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:24.198218 12203 leader_election.cc:304] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:24.198973 13576 raft_consensus.cc:493] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:24.199378 12204 leader_election.cc:400] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 3 election: Vote denied by peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063) with higher term. Message: Invalid argument: T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de for earlier term 3. Current term is 4.
I20260709 12:17:24.204130 13576 raft_consensus.cc:515] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:24.205554 12204 leader_election.cc:304] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d
W20260709 12:17:24.165196 13774 consensus_meta.cc:287] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d: Time spent flushing consensus metadata: real 0.923s	user 0.022s	sys 0.010s
I20260709 12:17:24.206652 13774 raft_consensus.cc:515] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:24.195909 12348 raft_consensus.cc:2468] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 7.
I20260709 12:17:24.206981 13576 leader_election.cc:290] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:24.214139 12357 raft_consensus.cc:2393] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 7: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:17:24.213651 13734 consensus_queue.cc:1059] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:17:24.164956 13811 raft_consensus.cc:515] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:24.213922 13739 consensus_queue.cc:1048] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 12:17:24.231526 13849 raft_consensus.cc:493] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:24.232390 13849 raft_consensus.cc:515] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:24.234300 13801 raft_consensus.cc:515] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
W20260709 12:17:24.235699 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 107144us
I20260709 12:17:24.236876 11446 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35814 (request call id 326) took 1417 ms. Trace:
I20260709 12:17:24.238504 13841 leader_election.cc:290] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:24.241601 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:24.234958 13849 leader_election.cc:290] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:24.226662 13833 raft_consensus.cc:2804] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:24.243425 13833 raft_consensus.cc:493] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:24.237316 11446 rpcz_store.cc:276] 0709 12:17:22.819939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:22.820098 (+   159us) service_pool.cc:224] Handling call
0709 12:17:22.820439 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:23.023251 (+202812us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:23.023298 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:23.027033 (+  3735us) log.cc:844] Serialized 26 byte log entry
0709 12:17:23.452224 (+425191us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:23.452268 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:24.236169 (+783901us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b54000d43d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:17:24.236256 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:24.236325 (+    69us) raft_consensus.cc:1685] finished
0709 12:17:24.236337 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:24.236707 (+   370us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":659,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":3657,"spinlock_wait_cycles":465421696,"thread_start_us":409081,"threads_started":1,"wal-append.queue_time_us":596662}
I20260709 12:17:24.244001 13833 raft_consensus.cc:3060] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:24.244578 13817 raft_consensus.cc:515] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:24.245574 13851 raft_consensus.cc:2804] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:24.249888 13854 raft_consensus.cc:2804] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:24.250473 13576 raft_consensus.cc:2804] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:24.250980 13576 raft_consensus.cc:493] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:24.251389 13576 raft_consensus.cc:3060] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:24.224431 13571 raft_consensus.cc:493] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:24.248093 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:24.252226 13571 raft_consensus.cc:515] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:24.220041 13777 raft_consensus.cc:515] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:24.253017 11450 raft_consensus.cc:2468] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 7.
I20260709 12:17:24.257700 13863 raft_consensus.cc:2804] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:24.258334 13863 raft_consensus.cc:493] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:24.258790 13863 raft_consensus.cc:3060] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:24.255831 11446 raft_consensus.cc:1240] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 12:17:24.259169 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:24.261258 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:24.262331 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:24.262836 11450 raft_consensus.cc:3060] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:24.266412 13777 leader_election.cc:290] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:24.270088 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:24.271513 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:24.306759 12349 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51690 (request call id 683) took 1186 ms. Trace:
I20260709 12:17:24.307322 12349 rpcz_store.cc:276] 0709 12:17:23.120588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:23.254544 (+133956us) service_pool.cc:224] Handling call
0709 12:17:23.254937 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:23.714045 (+459108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:24.306261 (+592216us) spinlock_profiling.cc:243] Waited 400 ms on lock 0x7b540000aad4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:17:24.306561 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":920117760}
I20260709 12:17:24.309725 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
W20260709 12:17:24.311111 12361 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51698 (request call id 716) took 2837 ms (client timeout 2569 ms). Trace:
I20260709 12:17:24.311739 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:24.313946 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:24.314851 11521 raft_consensus.cc:3060] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:24.311561 12361 rpcz_store.cc:269] 0709 12:17:21.473786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:21.473906 (+   120us) service_pool.cc:224] Handling call
0709 12:17:22.670488 (+1196582us) spinlock_profiling.cc:243] Waited 7.67 ms on lock 0x7b5800003f98. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb890a0 00007f84ebb88984 00007f84e51036d4 00007f84e5103662
0709 12:17:24.309275 (+1638787us) spinlock_profiling.cc:243] Waited 8.22 ms on lock 0x7b5800003f98. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9ee9c 00007f84e3a9ea5b 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb890a0 00007f84ebb88984 00007f84e51036d4 00007f84e5103662
0709 12:17:24.310966 (+  1691us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36542592}
I20260709 12:17:24.317828 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:24.318742 11522 raft_consensus.cc:2468] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 7.
I20260709 12:17:24.325423 11491 leader_election.cc:400] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973) with higher term. Message: Invalid argument: T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for earlier term 6. Current term is 7.
I20260709 12:17:24.302860 13851 raft_consensus.cc:697] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:24.325923 11491 leader_election.cc:403] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:24.326422 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:17:24.326668 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 49397.2us
I20260709 12:17:24.250525 13854 raft_consensus.cc:493] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:24.332942 11417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:24.333703 13851 consensus_queue.cc:237] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:24.334551 13774 leader_election.cc:290] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:24.336644 13601 leader_election.cc:290] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:24.337604 13865 raft_consensus.cc:2749] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973) with higher term. Message: Invalid argument: T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for earlier term 6. Current term is 7.
I20260709 12:17:24.330384 13854 raft_consensus.cc:3060] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:24.360121 12348 raft_consensus.cc:1240] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:24.361440 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:24.360910 13637 raft_consensus.cc:515] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:24.361954 12203 leader_election.cc:304] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:24.363837 12203 leader_election.cc:304] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:24.364285 13637 leader_election.cc:290] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:24.360890 13719 raft_consensus.cc:3055] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:24.377941 13626 raft_consensus.cc:2804] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:24.384370 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:17:24.386348 12206 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:24.369614 13719 raft_consensus.cc:740] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:24.361040 13801 leader_election.cc:290] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:24.393985 13413 raft_consensus.cc:515] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:24.421283 11521 raft_consensus.cc:2468] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 8.
I20260709 12:17:24.378062 13808 raft_consensus.cc:2749] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:24.378490 13864 raft_consensus.cc:493] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:24.426250 11593 raft_consensus.cc:1240] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:24.428007 13841 raft_consensus.cc:493] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:24.428740 13841 raft_consensus.cc:515] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:24.430646 12348 raft_consensus.cc:1240] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:24.431155 13841 leader_election.cc:290] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:24.431787 13841 raft_consensus.cc:493] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:24.431913 13840 raft_consensus.cc:493] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:24.432359 13841 raft_consensus.cc:515] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:24.432523 13840 raft_consensus.cc:515] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:24.433741 13786 raft_consensus.cc:493] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:24.434273 13786 raft_consensus.cc:515] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
W20260709 12:17:24.436193 13740 consensus_meta.cc:287] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de: Time spent flushing consensus metadata: real 0.925s	user 0.006s	sys 0.014s
I20260709 12:17:24.436535 13786 leader_election.cc:290] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:24.437088 12356 raft_consensus.cc:2410] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:17:24.438200 13745 raft_consensus.cc:493] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:24.438864 13745 raft_consensus.cc:515] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:24.440196 13715 raft_consensus.cc:3055] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:24.440627 13715 raft_consensus.cc:740] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:24.442029 13739 consensus_queue.cc:1048] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:24.421147 13719 consensus_queue.cc:260] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:24.446023 13719 raft_consensus.cc:3060] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:24.447789 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:24.448796 11522 raft_consensus.cc:2410] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:17:24.449162 13355 raft_consensus.cc:2749] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:24.449646 13864 raft_consensus.cc:515] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:24.450316 13811 leader_election.cc:290] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:24.457188 11593 raft_consensus.cc:1240] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:24.419653 13571 leader_election.cc:290] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:24.420269 13817 leader_election.cc:290] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:24.422287 13626 raft_consensus.cc:697] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:24.441239 13745 leader_election.cc:290] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:24.469704 13715 consensus_queue.cc:260] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:24.470907 13864 leader_election.cc:290] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:24.472811 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffe47647c274723808482c166efa21c" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:24.476876 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:24.477116 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:24.478055 11446 raft_consensus.cc:2468] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 5.
I20260709 12:17:24.484015 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:24.487838 13478 raft_consensus.cc:493] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:24.489012 13478 raft_consensus.cc:515] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:24.493155 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffe47647c274723808482c166efa21c" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
W20260709 12:17:24.495301 13819 log.cc:927] Time spent T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.760s	user 0.006s	sys 0.003s
I20260709 12:17:24.497159 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:24.497520 11451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58868 (request call id 1229) took 1293 ms. Trace:
I20260709 12:17:24.498302 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:17:24.498512 11493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 66441.6us
I20260709 12:17:24.499042 13841 leader_election.cc:290] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:24.499367 13758 raft_consensus.cc:493] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:24.500137 13758 raft_consensus.cc:515] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:24.502516 13758 leader_election.cc:290] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:24.503093 13168 leader_election.cc:290] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:24.495326 11447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58868 (request call id 1230) took 1240 ms. Trace:
I20260709 12:17:24.505810 11447 rpcz_store.cc:276] 0709 12:17:23.244031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:23.244156 (+   125us) service_pool.cc:224] Handling call
0709 12:17:23.244526 (+   370us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:17:23.244926 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:23.244953 (+    27us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:17:23.245591 (+   638us) log.cc:844] Serialized 78 byte log entry
0709 12:17:23.550786 (+305195us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:23.579236 (+ 28450us) log.cc:844] Serialized 14 byte log entry
0709 12:17:24.447964 (+868728us) spinlock_profiling.cc:243] Waited 3.28 ms on lock 0x7b18000b96e0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3a50c0a 00007f84ed190219 00007f84e3ad8a40 00007f84e3ad34e4 00007f84e3ad3455 00007f84ea5bb3c7 00007f84e6bcd9a7 00007f84e6bdd0bf 00007f84e6bdd038
0709 12:17:24.448322 (+   358us) log.cc:844] Serialized 14 byte log entry
0709 12:17:24.448721 (+   399us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:24.451723 (+  3002us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:24.463985 (+ 12262us) raft_consensus.cc:1685] finished
0709 12:17:24.464013 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:24.484121 (+ 20108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":845183,"prepare.queue_time_us":937679,"prepare.run_cpu_time_us":134,"prepare.run_wall_time_us":8564,"raft.queue_time_us":4273,"raft.run_cpu_time_us":491,"raft.run_wall_time_us":21218,"spinlock_wait_cycles":7537920,"thread_start_us":294535,"threads_started":1,"wal-append.queue_time_us":406306}
I20260709 12:17:24.497870 11566 leader_election.cc:304] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:24.508378 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:24.509462 13840 leader_election.cc:290] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:24.510303 13840 raft_consensus.cc:2804] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:24.510749 13840 raft_consensus.cc:493] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:24.511150 13840 raft_consensus.cc:3060] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:24.499715 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:24.514082 11596 raft_consensus.cc:3060] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:24.514863 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8741606df54c3f8b5cc5c1141862ea" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:24.516273 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:17:24.516392 13818 consensus_meta.cc:287] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8: Time spent flushing consensus metadata: real 0.539s	user 0.020s	sys 0.011s
I20260709 12:17:24.499400 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:24.519016 11520 raft_consensus.cc:2468] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 5.
I20260709 12:17:24.519824 12346 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51690 (request call id 691) took 1050 ms. Trace:
I20260709 12:17:24.520920 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:24.521934 12348 raft_consensus.cc:2468] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 4.
I20260709 12:17:24.523155 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:24.497944 11451 rpcz_store.cc:276] 0709 12:17:23.204495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:23.204649 (+   154us) service_pool.cc:224] Handling call
0709 12:17:23.205038 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:23.214982 (+  9944us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:23.215012 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:23.215449 (+   437us) log.cc:844] Serialized 26 byte log entry
0709 12:17:23.527637 (+312188us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:23.527681 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:23.527743 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:24.386111 (+858368us) spinlock_profiling.cc:243] Waited 4.16 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e675e86e 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221 00007f84e67671d9 00007f84e6767169
0709 12:17:24.497048 (+110937us) raft_consensus.cc:1685] finished
0709 12:17:24.497068 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:24.497343 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9543,"raft.queue_time_us":16501,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":108,"spinlock_wait_cycles":9570688,"thread_start_us":311065,"threads_started":1,"wal-append.queue_time_us":404807}
I20260709 12:17:24.483115 13413 leader_election.cc:290] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:24.530207 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:24.516953 13818 raft_consensus.cc:515] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:24.468328 13854 raft_consensus.cc:515] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:24.559650 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:24.560446 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:24.566581 13626 consensus_queue.cc:237] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:24.569499 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:24.570819 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:24.571969 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:24.572081 13818 leader_election.cc:290] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:24.574167  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:24.574903 11602 raft_consensus.cc:1240] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:17:24.576108  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:24.577776 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:24.578524 11527 raft_consensus.cc:2468] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 5.
I20260709 12:17:24.578619 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:24.579466 11595 raft_consensus.cc:1275] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:24.520339 12346 rpcz_store.cc:276] 0709 12:17:23.468869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:23.469034 (+   165us) service_pool.cc:224] Handling call
0709 12:17:23.469315 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:23.469560 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:17:23.849400 (+379840us) log.cc:844] Serialized 14 byte log entry
0709 12:17:24.518766 (+669366us) spinlock_profiling.cc:243] Waited 3.59 ms on lock 0x7b1800255d60. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e676b4bc 00007f84e3ab948b 00007f84ec9139a9 00007f84e3ad569b 00007f84e3ad393f 00007f84e3ad5c02 00007f84e675d20b 00007f84e6762d23 00007f84e676323a
0709 12:17:24.519088 (+   322us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:24.519180 (+    92us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:24.519303 (+   123us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:24.519401 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:24.519609 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":142360,"prepare.queue_time_us":461280,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":5269,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":144,"spinlock_wait_cycles":8249600,"thread_start_us":592672,"threads_started":2,"wal-append.queue_time_us":130080}
I20260709 12:17:24.580883 13854 leader_election.cc:290] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:24.581630 12361 raft_consensus.cc:1240] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:24.581815 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:24.582482 11451 raft_consensus.cc:3060] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:24.582624 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:24.583807 11525 raft_consensus.cc:1275] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:24.574208 11566 leader_election.cc:304] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
W20260709 12:17:24.593284 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 57538.7us
I20260709 12:17:24.607079 11450 raft_consensus.cc:2468] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 5.
I20260709 12:17:24.608677 11596 raft_consensus.cc:2468] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 7.
W20260709 12:17:24.631973 12206 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:24.636472 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
W20260709 12:17:24.636314 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 62282.9us
I20260709 12:17:24.637495 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:17:24.639967 12203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:24.555202 13833 raft_consensus.cc:515] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:24.645933 11521 raft_consensus.cc:1275] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:17:24.648779 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:24.647461 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:24.648370 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:24.661923 11451 raft_consensus.cc:2468] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 7.
I20260709 12:17:24.649649 13580 raft_consensus.cc:2804] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:24.650974 11566 leader_election.cc:304] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:24.671264 11450 raft_consensus.cc:3060] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:17:24.674376 13786 raft_consensus.cc:2804] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:24.674932 13786 raft_consensus.cc:493] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:24.675350 13786 raft_consensus.cc:3060] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:24.675839 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:24.677268 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:24.677904 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:24.678371 11417 leader_election.cc:304] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:17:24.679395 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:24.680238 11445 raft_consensus.cc:2468] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 5.
W20260709 12:17:24.680769 13875 log.cc:927] Time spent T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:17:24.682331 13824 raft_consensus.cc:493] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:24.683139 13824 raft_consensus.cc:515] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:24.684350 13601 consensus_queue.cc:1048] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:24.686268 13601 raft_consensus.cc:2804] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:24.686780 13601 raft_consensus.cc:697] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 7 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
W20260709 12:17:24.687111 12848 consensus_meta.cc:287] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8: Time spent flushing consensus metadata: real 1.446s	user 0.008s	sys 0.032s
I20260709 12:17:24.688745 13601 consensus_queue.cc:237] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:24.689630 13833 leader_election.cc:290] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
W20260709 12:17:24.693958 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 47896.7us
I20260709 12:17:24.694445 13571 raft_consensus.cc:493] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:24.702217 13571 raft_consensus.cc:515] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
W20260709 12:17:24.708696 13870 log.cc:927] Time spent T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.226s	user 0.001s	sys 0.000s
I20260709 12:17:24.697240 13786 raft_consensus.cc:515] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:24.710180 12347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 965) took 1141 ms. Trace:
W20260709 12:17:24.710290 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 73302.9us
I20260709 12:17:24.710590 12347 rpcz_store.cc:276] 0709 12:17:23.569119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:24.041887 (+472768us) service_pool.cc:224] Handling call
0709 12:17:24.042767 (+   880us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:24.207654 (+164887us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:24.207686 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:24.209441 (+  1755us) log.cc:844] Serialized 26 byte log entry
0709 12:17:24.225968 (+ 16527us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:24.226016 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:24.226092 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:24.709838 (+483746us) raft_consensus.cc:1685] finished
0709 12:17:24.709857 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:24.710010 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59808,"raft.queue_time_us":4029,"raft.run_cpu_time_us":425,"raft.run_wall_time_us":31559,"thread_start_us":14366,"threads_started":1,"wal-append.queue_time_us":148365}
I20260709 12:17:24.712293 11567 leader_election.cc:304] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:24.712663 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:17:24.715544 11417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:24.678756 11447 raft_consensus.cc:2393] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 9: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:24.678416 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:24.722409 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:24.725952 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:24.732959 13839 raft_consensus.cc:493] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:24.733757 13839 raft_consensus.cc:515] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:24.736532 12348 raft_consensus.cc:1275] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:24.665927 13580 raft_consensus.cc:697] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 8 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:24.737552 11454 raft_consensus.cc:1275] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:24.738296 13580 consensus_queue.cc:237] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
W20260709 12:17:24.740594 13859 log.cc:927] Time spent T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.531s	user 0.003s	sys 0.000s
I20260709 12:17:24.745012 11450 raft_consensus.cc:2468] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 7.
I20260709 12:17:24.746945 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:24.747996 11596 raft_consensus.cc:2410] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:24.750387 11453 raft_consensus.cc:2468] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 7.
W20260709 12:17:24.723901 13356 consensus_meta.cc:287] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de: Time spent flushing consensus metadata: real 0.555s	user 0.011s	sys 0.011s
I20260709 12:17:24.768790 11597 raft_consensus.cc:1275] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:17:24.770426 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d43eecbad746fd9ddce50c5b9fc3e8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:24.708977 13748 leader_election.cc:290] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:24.784171 13698 raft_consensus.cc:493] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:24.787750 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:24.789337 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:24.789705 11599 raft_consensus.cc:1240] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:24.794771 12359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51690 (request call id 681) took 1674 ms. Trace:
I20260709 12:17:24.795804 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:24.798805 13630 raft_consensus.cc:3055] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:24.815531 13839 leader_election.cc:290] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
W20260709 12:17:24.817085 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 104900us
I20260709 12:17:24.817641 13851 raft_consensus.cc:2749] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:24.824074 12359 rpcz_store.cc:276] 0709 12:17:23.120030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:23.208656 (+ 88626us) service_pool.cc:224] Handling call
0709 12:17:23.215289 (+  6633us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:23.309938 (+ 94649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:24.794144 (+1484206us) spinlock_profiling.cc:243] Waited 91.5 ms on lock 0x7b54000064d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:17:24.794574 (+   430us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":210452864}
I20260709 12:17:24.830543 12347 raft_consensus.cc:1275] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:17:24.832304 12347 pending_rounds.cc:85] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de: Aborting all ops after (but not including) 3
W20260709 12:17:24.832532 13863 consensus_meta.cc:287] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de: Time spent flushing consensus metadata: real 0.573s	user 0.013s	sys 0.004s
I20260709 12:17:24.868157 11454 raft_consensus.cc:2410] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:17:24.838068 12347 pending_rounds.cc:107] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:17:24.873865 12347 raft_consensus.cc:2889] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:24.828102 13630 raft_consensus.cc:740] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
W20260709 12:17:24.838981 13576 consensus_meta.cc:287] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671: Time spent flushing consensus metadata: real 0.587s	user 0.010s	sys 0.011s
I20260709 12:17:24.832813 13786 leader_election.cc:290] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:17:24.877839 13781 consensus_meta.cc:287] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de: Time spent flushing consensus metadata: real 0.666s	user 0.010s	sys 0.009s
I20260709 12:17:24.829100 13698 raft_consensus.cc:515] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:24.882547 13774 raft_consensus.cc:493] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:24.877628 13863 raft_consensus.cc:515] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:24.881448 13576 raft_consensus.cc:515] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:24.886994 13781 raft_consensus.cc:515] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:24.917996 11523 raft_consensus.cc:2393] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 7: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
W20260709 12:17:24.938992 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 108916us
I20260709 12:17:24.942610 12349 raft_consensus.cc:1240] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:24.984601 12357 raft_consensus.cc:1240] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:24.905026 13774 raft_consensus.cc:515] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:24.988436 13630 consensus_queue.cc:260] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
W20260709 12:17:24.989696 13885 log.cc:927] Time spent T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:17:24.990327 13630 raft_consensus.cc:3060] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:25.002820 13698 leader_election.cc:290] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:25.005244 13863 leader_election.cc:290] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:25.005868 13781 leader_election.cc:290] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:25.006886 13576 leader_election.cc:290] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 7 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:25.007839 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7937e0cff84ef7a26c84247c8ffc08" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:24.996984 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:25.014027 11448 raft_consensus.cc:2468] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 6.
I20260709 12:17:25.016268 11448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35814 (request call id 330) took 1539 ms. Trace:
I20260709 12:17:25.017903 11448 rpcz_store.cc:276] 0709 12:17:23.474661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:23.474800 (+   139us) service_pool.cc:224] Handling call
0709 12:17:24.996657 (+1521857us) spinlock_profiling.cc:243] Waited 3.77 ms on lock 0x7b5800003998. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9ea22 00007f84ec9b78d9 00007f84ebb11ee0 00007f84ebbdb0ab 00007f84ebbdb131 00007f84ebb890a0 00007f84ebb88984 00007f84e51036d4 00007f84e5103662
0709 12:17:25.014520 (+ 17863us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8674176}
W20260709 12:17:25.017890 13886 log.cc:927] Time spent T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 12:17:25.025069 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:25.022317 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:25.027359 11419 leader_election.cc:304] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:25.027051 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d43eecbad746fd9ddce50c5b9fc3e8" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:17:25.038053 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 50344.8us
W20260709 12:17:25.037036 13883 log.cc:927] Time spent T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 12:17:25.043970 11419 leader_election.cc:304] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:25.054764 13758 raft_consensus.cc:2749] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:25.042069 13895 raft_consensus.cc:2804] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:17:25.064857 13889 log.cc:927] Time spent T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 12:17:25.060402 13895 raft_consensus.cc:493] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:25.073958 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:25.075770 11600 raft_consensus.cc:2410] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:25.076494 11419 leader_election.cc:304] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:25.070694 13895 raft_consensus.cc:3060] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:25.084028 13715 raft_consensus.cc:3060] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:25.087634 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:25.088169 11419 leader_election.cc:304] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
W20260709 12:17:25.089713 12205 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:25.091256 12345 raft_consensus.cc:2468] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 9.
I20260709 12:17:25.093863 13698 raft_consensus.cc:2749] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:25.094871 12347 raft_consensus.cc:1240] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:25.081852 13758 raft_consensus.cc:2749] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:17:25.098996 13840 consensus_meta.cc:287] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8: Time spent flushing consensus metadata: real 0.587s	user 0.008s	sys 0.005s
I20260709 12:17:25.099557 13840 raft_consensus.cc:515] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:25.100256 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390e91331fd04f97a5235133a34875ee" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:25.106031 11565 leader_election.cc:304] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:25.106388 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:25.107070 11602 raft_consensus.cc:2468] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 7.
I20260709 12:17:25.100723 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:25.101857 11601 raft_consensus.cc:1240] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 12:17:25.103377 11594 raft_consensus.cc:1240] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:25.109474 13745 raft_consensus.cc:2804] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:25.110785 13840 leader_election.cc:290] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:25.104707 11595 raft_consensus.cc:1240] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:17:25.117854 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:25.104903 11598 raft_consensus.cc:3060] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:25.111318 13745 raft_consensus.cc:493] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:25.111233 13571 leader_election.cc:290] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:25.118872 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d43eecbad746fd9ddce50c5b9fc3e8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:25.118935 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:25.104249 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:25.120581 11596 raft_consensus.cc:2393] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 7: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:17:25.111763 11565 leader_election.cc:304] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:25.107172 12348 raft_consensus.cc:1275] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:25.117475 12347 raft_consensus.cc:1275] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:25.122694 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:25.123415 12352 raft_consensus.cc:2468] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 7.
I20260709 12:17:25.123433 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:25.125805 13747 raft_consensus.cc:3055] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:25.126338 13747 raft_consensus.cc:740] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:25.127377 13747 consensus_queue.cc:260] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:25.118600 12361 raft_consensus.cc:2468] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 4.
I20260709 12:17:25.128854 13747 raft_consensus.cc:3060] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:17:25.129532 13892 log.cc:927] Time spent T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.117s	user 0.004s	sys 0.000s
I20260709 12:17:25.095391 11419 leader_election.cc:304] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:25.133992 13758 raft_consensus.cc:2749] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:25.119629 12356 raft_consensus.cc:2468] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 6.
I20260709 12:17:25.136560 13571 raft_consensus.cc:2749] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:25.115473 13895 raft_consensus.cc:515] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
W20260709 12:17:25.136965 11493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 637653us
I20260709 12:17:25.139839 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:25.140662 12345 raft_consensus.cc:2393] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 9: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:25.141456 12356 raft_consensus.cc:1240] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:25.136641 13758 consensus_queue.cc:1048] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:17:25.143306 13871 consensus_queue.cc:1059] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:25.144083 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:25.144659 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
W20260709 12:17:25.145215 12206 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:25.147119 11521 raft_consensus.cc:1240] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:25.147465 11598 raft_consensus.cc:1275] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:25.120612 13745 raft_consensus.cc:3060] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:25.155093 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:25.155840 11520 raft_consensus.cc:2468] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 6.
I20260709 12:17:25.144694 13871 raft_consensus.cc:3055] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:25.159103 11565 leader_election.cc:304] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:17:25.160943 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:25.162858 11523 raft_consensus.cc:1275] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 12:17:25.164844 11417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:25.165649 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:25.164322 11419 leader_election.cc:304] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8
W20260709 12:17:25.162612 11418 leader_election.cc:336] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Timed out: RequestConsensusVote RPC to 127.3.212.131:36063 timed out after 2.024s (SENT)
I20260709 12:17:25.169525 12345 raft_consensus.cc:2468] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 8.
I20260709 12:17:25.172030 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:25.172029 11528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38272 (request call id 367) took 1665 ms. Trace:
I20260709 12:17:25.161727 13871 raft_consensus.cc:740] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:25.154039 13698 consensus_queue.cc:1048] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 12:17:25.178928 13786 raft_consensus.cc:2804] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:25.181664 13786 raft_consensus.cc:493] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:25.182155 13786 raft_consensus.cc:3060] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:25.183009 11491 connection.cc:256] RPC call timeout handler was delayed by -1.9792674129998886s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1579s for a response
I20260709 12:17:25.182824 13817 consensus_queue.cc:1059] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:17:25.183444 11491 connection.cc:256] RPC call timeout handler was delayed by -1.9576674129998537s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1603s for a response
W20260709 12:17:25.183768 11491 connection.cc:256] RPC call timeout handler was delayed by -1.4950674130000152s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2117s for a response
I20260709 12:17:25.184253 13806 consensus_queue.cc:1059] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:25.184871 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:25.185525 13811 raft_consensus.cc:493] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:25.186414 13895 leader_election.cc:290] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:25.186228 13811 raft_consensus.cc:515] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:25.186728 12346 raft_consensus.cc:2410] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:17:25.188145 13862 raft_consensus.cc:493] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:25.188709 13811 leader_election.cc:290] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:25.185433 13568 consensus_queue.cc:1059] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:25.190971 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:25.172739 13576 raft_consensus.cc:493] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:25.190187 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:25.191936 13576 raft_consensus.cc:515] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:25.193508 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:25.190758 13817 raft_consensus.cc:3055] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:25.197278 13817 raft_consensus.cc:740] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:25.198451 13817 consensus_queue.cc:260] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:25.199865 13817 raft_consensus.cc:3060] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:25.172169 13721 raft_consensus.cc:2804] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:25.204334 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:25.181427 13601 raft_consensus.cc:2804] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:25.190158 13568 raft_consensus.cc:3055] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:25.207616 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:25.175078 11528 rpcz_store.cc:276] 0709 12:17:23.506946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:23.507778 (+   832us) service_pool.cc:224] Handling call
0709 12:17:23.508089 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:23.508299 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:17:23.525141 (+ 16842us) log.cc:844] Serialized 14 byte log entry
0709 12:17:24.812352 (+1287211us) spinlock_profiling.cc:243] Waited 6.41 ms on lock 0x7b1800232840. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3ab8e07 00007f84ec9139a9 00007f84e3ad569b 00007f84e3ad393f 00007f84e3ad5c02 00007f84e675d20b 00007f84e6762d23 00007f84e676323a 00007f84e6bcda2a
0709 12:17:25.155196 (+342844us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:25.158222 (+  3026us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:25.158271 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:25.168598 (+ 10327us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:25.171848 (+  3250us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":245071,"prepare.queue_time_us":16518,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":59,"raft.queue_time_us":245405,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":118,"spinlock_wait_cycles":14745344,"thread_start_us":78738,"threads_started":1,"wal-append.queue_time_us":1417124}
I20260709 12:17:25.188776 13862 raft_consensus.cc:515] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:25.221050 12359 raft_consensus.cc:1275] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:25.221613 13862 leader_election.cc:290] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:25.185196 13806 raft_consensus.cc:493] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:25.222589 13806 raft_consensus.cc:515] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:25.223670 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:25.224915 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:25.225301 11566 leader_election.cc:304] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d
I20260709 12:17:25.224970 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:25.226722 11522 raft_consensus.cc:1275] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:25.226831 13571 raft_consensus.cc:2804] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:25.227356 13571 raft_consensus.cc:493] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:25.227700 13571 raft_consensus.cc:3060] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:25.189356 13811 raft_consensus.cc:3055] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:25.227865 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:25.194557 13576 leader_election.cc:290] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:25.228036 13715 raft_consensus.cc:493] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:25.230181 11519 raft_consensus.cc:1240] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:25.229918 13715 raft_consensus.cc:515] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:25.229808 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:25.209491 13509 consensus_queue.cc:1048] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:17:25.230224 13680 consensus_queue.cc:1048] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:25.232100 13715 leader_election.cc:290] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:25.232282 13601 raft_consensus.cc:697] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 9 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:25.232122 13680 consensus_queue.cc:1048] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:25.233301 13601 consensus_queue.cc:237] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:25.236160 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:25.236824 11523 raft_consensus.cc:3060] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:25.237249 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:25.237640 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8741606df54c3f8b5cc5c1141862ea" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:25.237872 11528 raft_consensus.cc:2468] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 5.
I20260709 12:17:25.238437 13811 raft_consensus.cc:740] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:25.239526 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:25.230089 12361 raft_consensus.cc:1275] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:17:25.240417 11522 raft_consensus.cc:2410] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:17:25.236701 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:25.241074 11526 raft_consensus.cc:3060] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:25.248553 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 94314.6us
I20260709 12:17:25.254688 11445 raft_consensus.cc:1240] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 7 LEADER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:25.209858 13568 raft_consensus.cc:740] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:25.224807 13806 leader_election.cc:290] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:25.261572 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8741606df54c3f8b5cc5c1141862ea" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:25.261780 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:25.258706 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e4724ed93a467ea47763eec9a6de2e" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:25.262535 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:25.263008 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:25.263569 11524 raft_consensus.cc:3060] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:25.264312 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:25.255204 11566 leader_election.cc:304] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:25.257618 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:25.257432 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:25.269804 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:25.270661 11453 raft_consensus.cc:2368] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for earlier term 6. Current term is 7.
I20260709 12:17:25.271494 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:25.272225 11453 raft_consensus.cc:2393] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 7: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:25.273716 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:25.273062 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390e91331fd04f97a5235133a34875ee" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:25.276046 11450 raft_consensus.cc:3060] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:25.261162 12204 leader_election.cc:304] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
W20260709 12:17:25.277791 11493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:25.280613 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:25.281255 12348 raft_consensus.cc:2468] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 8.
I20260709 12:17:25.282203 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:25.283041 12352 raft_consensus.cc:2468] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 7.
I20260709 12:17:25.283905 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:25.230662 13871 consensus_queue.cc:260] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:25.286190 13871 raft_consensus.cc:3060] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:25.292121 11526 raft_consensus.cc:2468] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 7.
I20260709 12:17:25.293008 11446 raft_consensus.cc:2468] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 7.
I20260709 12:17:25.294463 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:25.294872 11452 raft_consensus.cc:1240] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:25.291150 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:25.301081 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:17:25.300498 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 43840.4us
W20260709 12:17:25.302973 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 48746.9us
I20260709 12:17:25.305562 13721 raft_consensus.cc:493] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:25.306082 13721 raft_consensus.cc:3060] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:25.306382 13817 consensus_queue.cc:1048] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:25.310760 13824 leader_election.cc:290] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:25.314126 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:25.314941 11446 raft_consensus.cc:2468] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 6.
I20260709 12:17:25.304409 11449 raft_consensus.cc:1240] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:25.318452 13627 leader_election.cc:290] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:25.303617 13408 raft_consensus.cc:2804] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:25.319217 13408 raft_consensus.cc:493] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:25.319667 13408 raft_consensus.cc:3060] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:25.248358 13715 consensus_queue.cc:1059] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:17:25.321969 13715 raft_consensus.cc:3055] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:25.322355 13715 raft_consensus.cc:740] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:25.323258 13715 consensus_queue.cc:260] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:25.324494 13715 raft_consensus.cc:3060] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:25.326279 13698 consensus_queue.cc:1048] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:25.326896 13895 consensus_queue.cc:1059] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:25.310884 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:25.329454 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:25.329758 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
W20260709 12:17:25.332705 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 172224us
I20260709 12:17:25.335518 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8741606df54c3f8b5cc5c1141862ea" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:25.338311 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:25.294606 13680 raft_consensus.cc:3060] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:25.239470 13811 consensus_queue.cc:260] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:25.339344 11522 raft_consensus.cc:2376] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1c101e338f954ef086338e251deed19d in term 7. Re-sending same reply.
I20260709 12:17:25.341519 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:25.346550 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:25.347373 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:25.350842 12348 raft_consensus.cc:2468] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 5.
I20260709 12:17:25.353029 11526 raft_consensus.cc:2468] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 5.
I20260709 12:17:25.353760 12349 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51698 (request call id 725) took 1002 ms. Trace:
I20260709 12:17:25.354235 12349 rpcz_store.cc:276] 0709 12:17:24.351883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:24.352066 (+   183us) service_pool.cc:224] Handling call
0709 12:17:24.355008 (+  2942us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:24.984239 (+629231us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:25.353556 (+369317us) spinlock_profiling.cc:243] Waited 566 ms on lock 0x7b540000c3d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:17:25.353710 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1301774080}
I20260709 12:17:25.355039 11567 leader_election.cc:304] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:25.356771 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e4724ed93a467ea47763eec9a6de2e" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:25.356900 12848 raft_consensus.cc:493] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:25.357532 12848 raft_consensus.cc:515] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:25.358073 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:25.359262 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:25.360651 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:25.363302 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:25.363643 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:25.364809 12361 raft_consensus.cc:1275] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:17:25.364965 12352 raft_consensus.cc:3060] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:25.362478 11567 leader_election.cc:304] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:25.367779 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d43eecbad746fd9ddce50c5b9fc3e8" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
W20260709 12:17:25.369160 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 60827us
I20260709 12:17:25.370138 11491 leader_election.cc:304] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:25.370841 13774 leader_election.cc:290] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:25.371467 13774 raft_consensus.cc:493] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:25.372004 13774 raft_consensus.cc:515] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:25.304280 13568 consensus_queue.cc:260] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:25.373399 13568 raft_consensus.cc:3060] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:25.373656 13806 raft_consensus.cc:2749] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:25.374058 13846 raft_consensus.cc:2749] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:25.374281 13774 leader_election.cc:290] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:25.376787 13811 raft_consensus.cc:3060] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:25.379670 11273 catalog_manager.cc:5697] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:25.381623 13478 leader_election.cc:290] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
W20260709 12:17:25.382138 11418 leader_election.cc:336] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Timed out: RequestConsensusVote RPC to 127.3.212.131:36063 timed out after 1.642s (SENT)
I20260709 12:17:25.382612 11418 leader_election.cc:304] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:25.383478 11275 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57430 (request call id 152) took 11093 ms. Trace:
W20260709 12:17:25.383961 11418 leader_election.cc:336] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Timed out: RequestConsensusVote RPC to 127.3.212.131:36063 timed out after 1.647s (SENT)
I20260709 12:17:25.384480 11273 catalog_manager.cc:5697] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 5 to 7, leader changed from 1c101e338f954ef086338e251deed19d (127.3.212.130) to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 7 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:25.386999 11273 catalog_manager.cc:5697] T da8741606df54c3f8b5cc5c1141862ea P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 1 to 2, leader changed from a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131) to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 2 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:25.387603 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:25.390909 13721 raft_consensus.cc:515] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:25.391346 11522 raft_consensus.cc:2468] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 7.
I20260709 12:17:25.392321 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:25.392899 11522 raft_consensus.cc:2468] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 7.
I20260709 12:17:25.388684 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:25.393975 11526 raft_consensus.cc:2393] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 6: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:17:25.389369 13774 raft_consensus.cc:2749] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:17:25.385125 11418 leader_election.cc:336] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Timed out: RequestConsensusVote RPC to 127.3.212.131:36063 timed out after 1.665s (SENT)
I20260709 12:17:25.395248 11418 leader_election.cc:304] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:25.399703 11450 raft_consensus.cc:2410] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:17:25.401723 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:25.401930 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:25.402288 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:25.410951 11519 raft_consensus.cc:2376] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1c101e338f954ef086338e251deed19d in term 6. Re-sending same reply.
I20260709 12:17:25.393183 13721 leader_election.cc:290] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:25.412358 11524 raft_consensus.cc:2468] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 7.
I20260709 12:17:25.342856 13848 consensus_queue.cc:1048] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 12:17:25.420190 13839 raft_consensus.cc:493] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:25.420482 12203 leader_election.cc:304] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:25.414767 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:25.442189 11526 raft_consensus.cc:3060] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:25.416205 11522 raft_consensus.cc:1275] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:17:25.443344 11522 pending_rounds.cc:85] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671: Aborting all ops after (but not including) 3
I20260709 12:17:25.443616 11522 pending_rounds.cc:107] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:17:25.443847 11522 raft_consensus.cc:2889] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:25.417641 11566 leader_election.cc:304] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:25.418370 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:25.401482 13627 raft_consensus.cc:493] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:25.421203 13836 raft_consensus.cc:2749] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:25.373804 13576 consensus_queue.cc:1048] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 12:17:25.422124 13774 raft_consensus.cc:2749] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:25.413690 11273 catalog_manager.cc:5697] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 4 to 5, leader changed from a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131) to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 5 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:25.423446 13839 raft_consensus.cc:515] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:25.425006 13680 raft_consensus.cc:2749] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:25.426469 13408 raft_consensus.cc:515] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:25.430318 11528 raft_consensus.cc:2368] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 5. Current term is 7.
I20260709 12:17:25.476374 11491 leader_election.cc:400] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 election: Vote denied by peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579) with higher term. Message: Invalid argument: T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for earlier term 6. Current term is 7.
I20260709 12:17:25.431093 13848 consensus_queue.cc:1059] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:25.431409 13571 raft_consensus.cc:515] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:25.432340 12204 leader_election.cc:304] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:25.434203 11521 raft_consensus.cc:1275] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:17:25.435781 12848 leader_election.cc:290] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:25.478858 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ed4eeff0ae44d0bc1ebb8cbe3adea5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:17:25.470542 11493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 58337.2us
I20260709 12:17:25.443871 12352 raft_consensus.cc:2468] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 8.
I20260709 12:17:25.383906 11275 rpcz_store.cc:276] 0709 12:17:14.289946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:14.290102 (+   156us) service_pool.cc:224] Handling call
0709 12:17:25.383215 (+11093113us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:19.870776 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:20.229303 (+358527us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:20.229344 (+    41us) write_op.cc:435] Acquired schema lock
0709 12:17:20.229361 (+    17us) tablet.cc:662] Decoding operations
0709 12:17:20.230103 (+   742us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:20.230165 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:20.230190 (+    25us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:17:20.230724 (+   534us) tablet.cc:701] Row locks acquired
0709 12:17:20.230746 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:17:20.230913 (+   167us) write_op.cc:270] Start()
0709 12:17:20.231024 (+   111us) write_op.cc:276] Timestamp: P: 1783599440230848 usec, L: 0
0709 12:17:20.231045 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:17:20.231748 (+   703us) log.cc:844] Serialized 2093 byte log entry
0709 12:17:20.954736 (+722988us) op_driver.cc:464] REPLICATION: finished
0709 12:17:21.329109 (+374373us) write_op.cc:301] APPLY: starting
0709 12:17:21.329208 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:21.329811 (+   603us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:21.329958 (+   147us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:21.330743 (+   785us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:21.330959 (+   216us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:17:21.331009 (+    50us) write_op.cc:312] APPLY: finished
0709 12:17:21.331261 (+   252us) log.cc:844] Serialized 46 byte log entry
0709 12:17:21.331430 (+   169us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:21.331540 (+   110us) write_op.cc:454] Released schema lock
0709 12:17:21.331580 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:21.331986 (+   406us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:21.332017 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":60626,"reported_tablets":34,"child_traces":[["op",{"apply.queue_time_us":372303,"apply.run_cpu_time_us":2324,"apply.run_wall_time_us":2836,"num_ops":5,"prepare.queue_time_us":325272,"prepare.run_cpu_time_us":28667,"prepare.run_wall_time_us":773234,"raft.queue_time_us":143914,"raft.run_cpu_time_us":6829,"raft.run_wall_time_us":440738,"replication_time_us":694870,"thread_start_us":1078179,"threads_started":4,"wal-append.queue_time_us":506881,"wal-append.run_cpu_time_us":7975,"wal-append.run_wall_time_us":1594370}]]}
I20260709 12:17:25.453526 13866 raft_consensus.cc:2749] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:17:25.487252 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 54956.7us
W20260709 12:17:25.491469 12204 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:25.491788 13721 consensus_queue.cc:1048] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:17:25.492151 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 47372.7us
I20260709 12:17:25.491900 12848 consensus_queue.cc:1048] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:25.493003 11491 leader_election.cc:304] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:25.494397 11493 leader_election.cc:304] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:25.495272 13721 raft_consensus.cc:2804] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:25.495645 13721 raft_consensus.cc:493] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:25.495967 13721 raft_consensus.cc:3060] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:25.497601 13781 raft_consensus.cc:2804] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:25.498160 13781 raft_consensus.cc:493] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:25.498514 13781 raft_consensus.cc:3060] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:25.497733 11493 leader_election.cc:304] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:25.476400 13627 raft_consensus.cc:515] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:25.504002 13627 leader_election.cc:290] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:25.505350 13806 raft_consensus.cc:2764] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:17:25.506095 13839 leader_election.cc:290] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:25.476174 13626 raft_consensus.cc:2804] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:25.506984 13626 raft_consensus.cc:697] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 6 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:25.508051 13626 consensus_queue.cc:237] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:25.430418 13786 raft_consensus.cc:515] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
W20260709 12:17:25.517066 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 96689us
I20260709 12:17:25.514412 11523 raft_consensus.cc:2468] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 6.
I20260709 12:17:25.525432 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ed4eeff0ae44d0bc1ebb8cbe3adea5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:25.547322 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:25.547672 12349 raft_consensus.cc:1240] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:17:25.548061 12361 raft_consensus.cc:3060] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:25.444236 13898 consensus_queue.cc:1059] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.073s
I20260709 12:17:25.560273 11522 raft_consensus.cc:1275] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:25.560438 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c355b3902a4e7fb72bac6a91ea3316" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:25.561856 11526 raft_consensus.cc:2468] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 8.
I20260709 12:17:25.562045 11273 catalog_manager.cc:5697] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } }
W20260709 12:17:25.559955 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 67090.5us
I20260709 12:17:25.479967 13568 consensus_queue.cc:1059] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 12:17:25.567999 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7937e0cff84ef7a26c84247c8ffc08" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:17:25.568269 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 240779us
I20260709 12:17:25.566282 11566 leader_election.cc:304] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:25.570838 13817 raft_consensus.cc:2749] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:25.579511 12203 leader_election.cc:304] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
W20260709 12:17:25.590072 12205 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:25.590535 12205 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:25.593992 11524 raft_consensus.cc:1275] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:17:25.595114 11273 catalog_manager.cc:5697] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:25.565366 13774 raft_consensus.cc:493] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:25.583029 13509 raft_consensus.cc:2804] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:25.581597 13721 raft_consensus.cc:515] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:25.604300 11491 leader_election.cc:304] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
W20260709 12:17:25.611279 11494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:25.615244 11525 raft_consensus.cc:1240] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:17:25.616879 13571 leader_election.cc:290] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:25.622550 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:25.623358 11526 raft_consensus.cc:3060] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:25.623159 13356 raft_consensus.cc:3055] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:25.623831 13356 raft_consensus.cc:740] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:25.624890 13356 consensus_queue.cc:260] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:25.632256 13571 consensus_queue.cc:1059] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:25.612991 11273 catalog_manager.cc:5697] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 2 to 3, leader changed from a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131) to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 3 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:25.597113 13898 consensus_queue.cc:1243] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer 1c101e338f954ef086338e251deed19d log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:17:25.641414 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:25.642099 12352 raft_consensus.cc:3060] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:25.632681 13356 raft_consensus.cc:3060] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:25.645576 12203 leader_election.cc:304] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:25.652179 11526 raft_consensus.cc:2468] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 6.
I20260709 12:17:25.633203 13571 raft_consensus.cc:3055] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:17:25.654002 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 61613.1us
I20260709 12:17:25.656005 11273 catalog_manager.cc:5697] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:25.611712 13509 raft_consensus.cc:697] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 8 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:25.637537 13721 leader_election.cc:290] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:25.661504 12352 raft_consensus.cc:2468] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 9.
I20260709 12:17:25.648211 13715 raft_consensus.cc:493] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:25.674338 11493 leader_election.cc:304] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:25.672062 11273 catalog_manager.cc:5697] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 3 to 5, leader changed from a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131) to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 5 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:25.609723 13774 raft_consensus.cc:515] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
W20260709 12:17:25.709236 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 48715.3us
W20260709 12:17:25.694135 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 331707us
I20260709 12:17:25.677907 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:25.715739 11599 raft_consensus.cc:1275] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:17:25.712606 11491 leader_election.cc:304] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:25.678587 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:25.659576 13817 raft_consensus.cc:2804] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:25.657521 13571 raft_consensus.cc:740] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:25.725364 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:25.737689 11450 raft_consensus.cc:2468] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 2.
W20260709 12:17:25.766845 11493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:25.741693 11593 raft_consensus.cc:2468] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 8.
I20260709 12:17:25.675014 13863 raft_consensus.cc:2804] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:25.677688 13698 raft_consensus.cc:493] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:25.798584 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:25.719203 13871 raft_consensus.cc:2804] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:25.811954 11445 raft_consensus.cc:1275] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:17:25.819658 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 394125us
I20260709 12:17:25.723191 13721 raft_consensus.cc:2804] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:25.853339 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:25.736405 13817 raft_consensus.cc:493] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:25.859002 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:25.722301 13715 raft_consensus.cc:515] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:25.853679 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:25.896437 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:25.897856 11450 raft_consensus.cc:2468] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 8.
I20260709 12:17:25.902930 11594 raft_consensus.cc:2393] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 6: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:17:25.735765 13840 raft_consensus.cc:493] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:25.853609 13786 leader_election.cc:290] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:25.853581 13408 leader_election.cc:290] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:25.908895 13408 raft_consensus.cc:493] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:25.910311 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c355b3902a4e7fb72bac6a91ea3316" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:25.846352 13627 raft_consensus.cc:493] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:25.911001 11600 raft_consensus.cc:3060] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:25.912488 13715 leader_election.cc:290] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:25.911469 13627 raft_consensus.cc:515] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:25.913949 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:25.914810 13627 leader_election.cc:290] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
W20260709 12:17:25.915138 13902 log.cc:927] Time spent T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 12:17:25.859335 13745 consensus_meta.cc:287] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8: Time spent flushing consensus metadata: real 0.703s	user 0.008s	sys 0.003s
I20260709 12:17:25.917368 13745 raft_consensus.cc:515] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:25.919708 13745 leader_election.cc:290] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:25.790923 13836 consensus_queue.cc:1048] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.156s
I20260709 12:17:25.922037 13571 consensus_queue.cc:260] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:25.923317 13571 raft_consensus.cc:3060] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:25.909624 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:25.909091 11601 raft_consensus.cc:1275] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:17:25.909917 11273 catalog_manager.cc:5697] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:25.938724 11595 raft_consensus.cc:2468] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 7.
I20260709 12:17:25.932036 11601 pending_rounds.cc:85] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8: Aborting all ops after (but not including) 2
I20260709 12:17:25.898797 13817 raft_consensus.cc:3060] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:25.944790 11567 leader_election.cc:304] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:25.854365 13721 raft_consensus.cc:493] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:25.911024 13901 log.cc:927] Time spent T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 12:17:25.942476 11601 pending_rounds.cc:107] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:17:25.948628 11273 catalog_manager.cc:5697] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } }
I20260709 12:17:25.955452 11601 raft_consensus.cc:2889] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:17:25.953153 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 59818us
I20260709 12:17:25.960559 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:25.961333 11445 raft_consensus.cc:3060] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:25.915032 13774 leader_election.cc:290] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:25.860126 13871 raft_consensus.cc:697] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 9 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
W20260709 12:17:25.969545 12356 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.010s	sys 0.013s
W20260709 12:17:25.976933 12356 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.010s	sys 0.013s
I20260709 12:17:25.978286 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:25.844501 13781 raft_consensus.cc:515] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
W20260709 12:17:25.984763 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 84903.2us
I20260709 12:17:25.910457 13408 raft_consensus.cc:515] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:25.909529 13698 raft_consensus.cc:515] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:25.955202 13721 raft_consensus.cc:3060] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:26.000547 11491 leader_election.cc:304] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:26.010346 11273 catalog_manager.cc:5697] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 3 to 5, leader changed from 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132) to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 5 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } }
I20260709 12:17:26.021890 11566 leader_election.cc:304] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
W20260709 12:17:26.005932 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 329149us
I20260709 12:17:26.024210 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:25.983106 13680 raft_consensus.cc:2749] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:26.027817 11418 leader_election.cc:304] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:26.014416 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a841f2f09ced40a4bbf33594e11bd7ad" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:26.032483 11567 leader_election.cc:304] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d
I20260709 12:17:26.038219 11567 leader_election.cc:304] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:26.034291 13756 consensus_queue.cc:1048] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:25.997175 13806 raft_consensus.cc:3055] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:26.036388 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:26.033401 13786 consensus_queue.cc:1059] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:26.047863 13627 raft_consensus.cc:493] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:26.046805 12203 leader_election.cc:304] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:26.009048 13848 raft_consensus.cc:2804] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:26.075522 11567 leader_election.cc:304] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:26.086179 11565 leader_election.cc:304] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:17:25.976670 13840 raft_consensus.cc:515] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
W20260709 12:17:26.090003 12361 consensus_meta.cc:287] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de: Time spent flushing consensus metadata: real 0.541s	user 0.011s	sys 0.001s
W20260709 12:17:26.092832 11519 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.019s	sys 0.019s
W20260709 12:17:26.096153 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 95756.4us
I20260709 12:17:26.098562 12361 raft_consensus.cc:2468] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 5.
I20260709 12:17:26.099587 11491 leader_election.cc:304] T da8741606df54c3f8b5cc5c1141862ea P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
W20260709 12:17:26.100818 11519 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.020s	sys 0.019s
I20260709 12:17:26.087584 11417 leader_election.cc:304] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
W20260709 12:17:26.105799 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 82163.7us
I20260709 12:17:26.106927 12203 leader_election.cc:304] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:26.108166 12203 leader_election.cc:304] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:26.035324 13580 raft_consensus.cc:2804] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:26.109716 11448 raft_consensus.cc:1240] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 4. Current term is 5. Ops: []
W20260709 12:17:26.115816 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 44181.4us
I20260709 12:17:25.942152 13509 consensus_queue.cc:237] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:26.069629 13745 raft_consensus.cc:2804] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:26.125197 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:26.125954 11521 raft_consensus.cc:3060] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:26.049278 13568 raft_consensus.cc:2749] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:26.064460 13806 raft_consensus.cc:740] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:26.097666 13715 raft_consensus.cc:493] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:26.092659 13851 raft_consensus.cc:2749] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:17:26.153647 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 45133.8us
W20260709 12:17:26.124542 13876 log.cc:927] Time spent T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:17:26.082444 13774 consensus_queue.cc:1048] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 12:17:26.180500 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:17:26.168111 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 76863.6us
I20260709 12:17:26.125628 13745 raft_consensus.cc:493] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:26.126068 13910 raft_consensus.cc:2804] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:26.162237 13680 raft_consensus.cc:2804] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:26.100927 13627 raft_consensus.cc:515] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:26.161530 13836 raft_consensus.cc:2749] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:26.161135 13580 raft_consensus.cc:697] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 6 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:26.223930 11520 raft_consensus.cc:1240] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 5. Current term is 6. Ops: []
W20260709 12:17:26.239754 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 249765us
I20260709 12:17:26.255174 13911 raft_consensus.cc:2749] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:26.209165 13745 raft_consensus.cc:3060] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:26.218662 13910 raft_consensus.cc:493] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:26.257743 13910 raft_consensus.cc:3060] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:17:26.264354 13906 log.cc:927] Time spent T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 12:17:26.219182 13680 raft_consensus.cc:493] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:26.269817 13680 raft_consensus.cc:3060] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:26.275363 13627 leader_election.cc:290] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:26.277326 13580 consensus_queue.cc:237] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:26.285444 13840 leader_election.cc:290] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:17:26.287361 13919 log.cc:927] Time spent T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 12:17:26.289675 13876 log.cc:927] Time spent T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:17:26.291195 13698 leader_election.cc:290] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:26.217681 13862 raft_consensus.cc:3055] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:26.296525 13862 raft_consensus.cc:740] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:26.299742 13898 raft_consensus.cc:493] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:26.300496 13898 raft_consensus.cc:515] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:26.301319 13848 raft_consensus.cc:493] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:26.318014 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:26.179641 13715 raft_consensus.cc:515] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:26.217343 13931 raft_consensus.cc:2804] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:17:26.336692 11446 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.022s	sys 0.039s
I20260709 12:17:26.241598 13932 raft_consensus.cc:2804] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:26.288928 13806 consensus_queue.cc:260] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:26.310237 13848 raft_consensus.cc:3060] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:26.362118 11445 raft_consensus.cc:2468] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 6.
W20260709 12:17:26.372079 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 272698us
W20260709 12:17:26.372558 11446 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.022s	sys 0.044s
W20260709 12:17:26.373634 12205 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:26.370059 11600 raft_consensus.cc:2468] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 6.
W20260709 12:17:26.386801 11568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:26.431016 12205 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:26.378613 11493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:26.389284 11521 raft_consensus.cc:2468] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 7.
I20260709 12:17:26.134442 11599 raft_consensus.cc:2468] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 6.
I20260709 12:17:26.465941 11491 leader_election.cc:304] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
W20260709 12:17:26.402177 13916 log.cc:927] Time spent T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.208s	user 0.000s	sys 0.000s
W20260709 12:17:26.391521 13356 consensus_meta.cc:287] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de: Time spent flushing consensus metadata: real 0.734s	user 0.004s	sys 0.004s
I20260709 12:17:26.249595 13851 consensus_queue.cc:1048] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.212s
I20260709 12:17:26.407737 13806 raft_consensus.cc:3060] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:26.389925 13840 raft_consensus.cc:493] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:26.492184 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:26.407266 13715 leader_election.cc:290] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:26.393517 11418 leader_election.cc:304] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:26.415186 13627 raft_consensus.cc:493] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:26.405615 13811 raft_consensus.cc:2749] T da8741606df54c3f8b5cc5c1141862ea P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:26.508324 12356 raft_consensus.cc:2410] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:17:26.397210 13898 leader_election.cc:290] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:26.496083 12359 raft_consensus.cc:1240] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 6. Current term is 7. Ops: []
W20260709 12:17:26.498409 12204 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:26.424326 13774 raft_consensus.cc:493] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:26.415326 13932 raft_consensus.cc:697] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:26.414088 13931 raft_consensus.cc:697] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:26.373582 13934 raft_consensus.cc:2804] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:26.480065 13568 raft_consensus.cc:2749] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:17:26.685431 11493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 193732us
W20260709 12:17:26.686532 11493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:26.511356 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 391556us
W20260709 12:17:26.487087 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 348830us
W20260709 12:17:26.501866 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 426355us
I20260709 12:17:26.688983 11567 leader_election.cc:304] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d
W20260709 12:17:26.506652 13571 consensus_meta.cc:287] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8: Time spent flushing consensus metadata: real 0.576s	user 0.011s	sys 0.002s
I20260709 12:17:26.403177 13817 raft_consensus.cc:515] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:26.526392 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a841f2f09ced40a4bbf33594e11bd7ad" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:26.403164 13680 raft_consensus.cc:515] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:26.691049 12348 raft_consensus.cc:2468] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 3.
I20260709 12:17:26.695247 12203 leader_election.cc:304] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:26.695537 11525 raft_consensus.cc:1275] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:17:26.695945 11525 pending_rounds.cc:85] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671: Aborting all ops after (but not including) 3
I20260709 12:17:26.696213 11525 pending_rounds.cc:107] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:17:26.391137 13745 raft_consensus.cc:515] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
W20260709 12:17:26.532470 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 104667us
I20260709 12:17:26.635812 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:26.666814 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:26.696452 11525 raft_consensus.cc:2889] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:26.694973 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:26.694176 12204 leader_election.cc:304] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:26.122010 13871 consensus_queue.cc:237] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:26.638091 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:26.673648 11598 raft_consensus.cc:1240] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 6 LEADER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:26.671582 13895 raft_consensus.cc:2749] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:26.705734 12346 raft_consensus.cc:2468] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 8.
I20260709 12:17:26.712710 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:26.671049 12352 raft_consensus.cc:1240] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 6. Current term is 7. Ops: []
W20260709 12:17:26.636647 13916 log.cc:927] Time spent T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
W20260709 12:17:26.666679 13863 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.781s	user 0.123s	sys 0.160s
I20260709 12:17:26.690605 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:26.590226 13774 raft_consensus.cc:515] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:26.700446 11567 leader_election.cc:304] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:26.701205 11593 raft_consensus.cc:2410] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:17:26.701421 11449 raft_consensus.cc:1240] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:17:26.509208 13840 raft_consensus.cc:515] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:26.695003 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:26.704192 11565 leader_election.cc:304] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:17:26.393682 13862 consensus_queue.cc:260] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:26.521556 13627 raft_consensus.cc:515] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:26.700646 13355 raft_consensus.cc:3055] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:26.728010 11445 raft_consensus.cc:2393] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 7: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:26.724614 11527 raft_consensus.cc:2468] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 7.
I20260709 12:17:26.729809 13823 raft_consensus.cc:2804] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:17:26.734030 13929 log.cc:927] Time spent T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.202s	user 0.000s	sys 0.000s
W20260709 12:17:26.734515 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 341103us
I20260709 12:17:26.737890 13862 raft_consensus.cc:3060] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:26.774606 13355 raft_consensus.cc:740] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:26.758953 13680 leader_election.cc:290] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:26.737526 13931 consensus_queue.cc:237] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:26.741286 13910 raft_consensus.cc:515] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:26.757718 13944 raft_consensus.cc:2804] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:26.795966 13944 raft_consensus.cc:697] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:26.738890 11491 leader_election.cc:304] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:26.740697 13848 raft_consensus.cc:515] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
W20260709 12:17:26.719971 13863 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.124s	sys 0.161s
I20260709 12:17:26.753721 12349 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51690 (request call id 710) took 1226 ms. Trace:
I20260709 12:17:26.760615 11451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58856 (request call id 627) took 1510 ms. Trace:
W20260709 12:17:26.773602 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 69480.4us
W20260709 12:17:26.775511 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 75153.6us
I20260709 12:17:26.742664 13745 leader_election.cc:290] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:26.747185 13627 leader_election.cc:290] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:26.750312 13840 leader_election.cc:290] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:26.748818 13817 leader_election.cc:290] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:26.787065 11418 leader_election.cc:304] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:26.785068 13823 raft_consensus.cc:493] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:26.798925 11519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33446 (request call id 1225) took 1352 ms. Trace:
I20260709 12:17:26.796151 13910 leader_election.cc:290] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
W20260709 12:17:26.785069 13938 log.cc:927] Time spent T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:17:26.723953 13408 leader_election.cc:290] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:26.758637 13945 raft_consensus.cc:2804] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:26.800829 13571 raft_consensus.cc:3060] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:26.856400 11451 rpcz_store.cc:276] 0709 12:17:25.250139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:25.250319 (+   180us) service_pool.cc:224] Handling call
0709 12:17:25.268116 (+ 17797us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:25.290219 (+ 22103us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:17:25.449840 (+159621us) log.cc:844] Serialized 14 byte log entry
0709 12:17:25.850384 (+400544us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:25.900018 (+ 49634us) log.cc:844] Serialized 26 byte log entry
0709 12:17:25.900187 (+   169us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:25.942737 (+ 42550us) log.cc:844] Serialized 14 byte log entry
0709 12:17:25.969889 (+ 27152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:25.969976 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:26.760379 (+790403us) raft_consensus.cc:1685] finished
0709 12:17:26.760398 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:26.760549 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":154193,"prepare.queue_time_us":352020,"prepare.run_cpu_time_us":110,"prepare.run_wall_time_us":5111,"raft.queue_time_us":44990,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":24982,"thread_start_us":518486,"threads_started":2,"wal-append.queue_time_us":628197}
W20260709 12:17:26.892278 12205 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:26.745689 13774 leader_election.cc:290] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:17:26.965876 11493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:26.833199 13863 raft_consensus.cc:697] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 5 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:26.836673 11519 rpcz_store.cc:276] 0709 12:17:25.446964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:25.552988 (+106024us) service_pool.cc:224] Handling call
0709 12:17:25.553301 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:25.553531 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:17:26.109668 (+556137us) log.cc:844] Serialized 14 byte log entry
0709 12:17:26.798542 (+688874us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:26.798605 (+    63us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:26.798662 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:26.798736 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:26.798864 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3801,"prepare.queue_time_us":50800,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":32119,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":30742,"thread_start_us":1217881,"threads_started":3,"wal-append.queue_time_us":644212}
I20260709 12:17:26.858503 13568 raft_consensus.cc:2749] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:17:26.973065 11568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:26.742861 13839 consensus_queue.cc:1059] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.230s
W20260709 12:17:26.976642 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 237801us
I20260709 12:17:26.983652 11491 leader_election.cc:304] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:26.986418 13817 raft_consensus.cc:2804] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:26.987124 13817 raft_consensus.cc:493] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:26.987527 13817 raft_consensus.cc:3060] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:26.746443 13932 consensus_queue.cc:237] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
W20260709 12:17:26.978353 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 283166us
I20260709 12:17:26.850405 13823 raft_consensus.cc:3060] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:26.986726 11593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55250 (request call id 627) took 1134 ms. Trace:
I20260709 12:17:26.992296 11593 rpcz_store.cc:276] 0709 12:17:25.852554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:25.852765 (+   211us) service_pool.cc:224] Handling call
0709 12:17:26.986484 (+1133719us) spinlock_profiling.cc:243] Waited 765 ms on lock 0x7b540016cbd4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:26.986644 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1759702272}
I20260709 12:17:26.995180 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:26.995850 11600 raft_consensus.cc:3060] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:26.856750 12349 rpcz_store.cc:276] 0709 12:17:25.527535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:25.548711 (+ 21176us) service_pool.cc:224] Handling call
0709 12:17:25.549020 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:25.567237 (+ 18217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:25.567272 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:25.571283 (+  4011us) log.cc:844] Serialized 26 byte log entry
0709 12:17:25.944445 (+373162us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:25.944484 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:25.944555 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:26.753475 (+808920us) raft_consensus.cc:1685] finished
0709 12:17:26.753495 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:26.753644 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7495,"raft.queue_time_us":12597,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":5261,"spinlock_wait_cycles":883840,"thread_start_us":368050,"threads_started":1,"wal-append.queue_time_us":1174579}
I20260709 12:17:26.998281 13408 consensus_queue.cc:1059] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:27.000043 13626 raft_consensus.cc:3055] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:27.000412 13626 raft_consensus.cc:740] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:27.001204 13626 consensus_queue.cc:260] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:26.835644 13944 consensus_queue.cc:237] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:27.002549 13626 raft_consensus.cc:3060] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:27.005544 13627 raft_consensus.cc:493] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
W20260709 12:17:27.005800 13922 log.cc:927] Time spent T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 12:17:27.006188 13627 raft_consensus.cc:515] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:27.008324 13627 leader_election.cc:290] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:27.009251 11600 raft_consensus.cc:2468] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 9.
I20260709 12:17:27.011155 11599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55250 (request call id 624) took 1267 ms. Trace:
I20260709 12:17:27.010643 12203 leader_election.cc:304] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:27.017179 11599 rpcz_store.cc:276] 0709 12:17:25.744213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:25.797215 (+ 53002us) service_pool.cc:224] Handling call
0709 12:17:27.010973 (+1213758us) spinlock_profiling.cc:243] Waited 278 ms on lock 0x7b54004fa6d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:27.011096 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":640441728}
I20260709 12:17:27.018020 12203 leader_election.cc:304] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:27.022739 13848 leader_election.cc:290] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 8 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:27.023491 13848 raft_consensus.cc:2749] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:27.024219 13848 raft_consensus.cc:2749] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:17:27.026887 13823 raft_consensus.cc:515] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:27.029616 13823 leader_election.cc:290] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
W20260709 12:17:27.032434 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 245456us
I20260709 12:17:26.879190 13945 raft_consensus.cc:493] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting leader election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:26.991291 13947 raft_consensus.cc:2804] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:27.024751 13817 raft_consensus.cc:515] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:26.971019 13840 consensus_queue.cc:1059] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.068s
W20260709 12:17:26.972754 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 115802us
I20260709 12:17:27.044412 11491 leader_election.cc:304] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:27.063730 11491 leader_election.cc:304] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:27.045900 13948 raft_consensus.cc:2749] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:27.046293 11418 leader_election.cc:304] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
W20260709 12:17:27.040738 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 176403us
I20260709 12:17:27.046505 13947 raft_consensus.cc:493] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:27.043370 13945 raft_consensus.cc:3060] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:27.047459 13806 consensus_queue.cc:1048] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:17:27.042439 13848 consensus_queue.cc:1059] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:17:27.051594 13817 leader_election.cc:290] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:27.047273 13568 consensus_queue.cc:1059] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 12:17:27.058034 11597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 806) took 1395 ms. Trace:
I20260709 12:17:27.058243 13863 consensus_queue.cc:237] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:27.039126 13910 raft_consensus.cc:493] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:27.066351 11567 leader_election.cc:304] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:27.038264 13601 raft_consensus.cc:493] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:27.043751 13956 raft_consensus.cc:493] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:27.073700 11597 rpcz_store.cc:276] 0709 12:17:25.662089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:25.662204 (+   115us) service_pool.cc:224] Handling call
0709 12:17:25.678999 (+ 16795us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:25.679399 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:25.679429 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:25.744871 (+ 65442us) log.cc:844] Serialized 26 byte log entry
0709 12:17:26.197113 (+452242us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:26.197165 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:26.197230 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:27.057748 (+860518us) raft_consensus.cc:1685] finished
0709 12:17:27.057773 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:27.057941 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":31165,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":4690,"thread_start_us":326850,"threads_started":1,"wal-append.queue_time_us":890169}
I20260709 12:17:27.078094 11565 leader_election.cc:304] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:27.036712 13895 consensus_queue.cc:1059] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:17:27.043581 13811 consensus_queue.cc:1059] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:17:27.083523 13680 raft_consensus.cc:2804] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:27.071825 13866 consensus_queue.cc:1048] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:17:27.088569 11418 leader_election.cc:304] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:27.091444 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:27.094538 11527 raft_consensus.cc:1275] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:27.096954 11524 raft_consensus.cc:1275] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:27.072120 13947 raft_consensus.cc:3060] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:27.086946 13956 raft_consensus.cc:515] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:27.086064 13910 raft_consensus.cc:515] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
W20260709 12:17:27.099542 13721 consensus_meta.cc:287] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671: Time spent flushing consensus metadata: real 1.081s	user 0.008s	sys 0.004s
I20260709 12:17:27.087982 13748 consensus_queue.cc:1048] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:27.100330 13817 raft_consensus.cc:3060] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:27.204694 11519 raft_consensus.cc:2410] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:17:27.083173 13774 raft_consensus.cc:2804] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:27.207358 11526 raft_consensus.cc:1240] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 9 LEADER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 12:17:27.214435 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 110477us
W20260709 12:17:27.214637 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 136624us
I20260709 12:17:27.115943 13680 raft_consensus.cc:493] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:27.107249 13840 raft_consensus.cc:493] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:27.084904 13601 raft_consensus.cc:515] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:27.128139 13571 raft_consensus.cc:2749] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:27.292869 13840 raft_consensus.cc:515] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:27.301208 11598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 811) took 1280 ms. Trace:
I20260709 12:17:27.206532 13957 raft_consensus.cc:2804] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:27.230365 13914 raft_consensus.cc:2749] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:27.310823 11598 rpcz_store.cc:276] 0709 12:17:26.021185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:26.021415 (+   230us) service_pool.cc:224] Handling call
0709 12:17:26.048871 (+ 27456us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:26.705785 (+656914us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:27.300925 (+595140us) spinlock_profiling.cc:243] Waited 624 ms on lock 0x7b5400336b54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:17:27.301139 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1436308736}
I20260709 12:17:27.273339 13806 raft_consensus.cc:493] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:27.273792 13909 raft_consensus.cc:2804] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:17:27.322139 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 233684us
I20260709 12:17:27.227519 13871 consensus_queue.cc:1048] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.090s
I20260709 12:17:27.309618 13774 raft_consensus.cc:697] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 7 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:27.228719 13721 raft_consensus.cc:515] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:27.291687 13680 raft_consensus.cc:3060] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:27.345502 13774 consensus_queue.cc:237] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:27.350575  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:27.318652 13848 raft_consensus.cc:493] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:27.351776 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 625597us
W20260709 12:17:27.352254 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 281933us
W20260709 12:17:27.322932 13862 consensus_meta.cc:287] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671: Time spent flushing consensus metadata: real 0.535s	user 0.010s	sys 0.000s
I20260709 12:17:27.364223 11418 leader_election.cc:304] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:27.318776 13909 raft_consensus.cc:493] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
W20260709 12:17:27.374033 11491 connection.cc:256] RPC call timeout handler was delayed by -1.6027285289999327s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1567s for a response
W20260709 12:17:27.379554 11491 connection.cc:256] RPC call timeout handler was delayed by -1.4380285289998938s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17500000000000002s for a response
W20260709 12:17:27.380946 11491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:27.382057 11491 connection.cc:256] RPC call timeout handler was delayed by -1.0555285289999574s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2175s for a response
I20260709 12:17:27.323045 13957 raft_consensus.cc:697] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 7 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:27.321626 13806 raft_consensus.cc:515] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:27.387117 11522 raft_consensus.cc:2393] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 7: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:17:27.387370 11419 leader_election.cc:304] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:27.388195 13966 raft_consensus.cc:493] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:27.390167 13966 raft_consensus.cc:515] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:27.393008 13966 leader_election.cc:290] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:27.388489 11417 leader_election.cc:304] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:17:27.385367 13909 raft_consensus.cc:3060] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:27.370582 13931 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.008s	sys 0.007s
I20260709 12:17:27.371685 13848 raft_consensus.cc:515] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
W20260709 12:17:27.424592 13934 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.003s	sys 0.012s
I20260709 12:17:27.446426 13910 leader_election.cc:290] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:27.447161 13910 raft_consensus.cc:2749] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:27.447924 13910 raft_consensus.cc:2804] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:27.448369 13910 raft_consensus.cc:697] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [term 9 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:27.446935 13945 raft_consensus.cc:515] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
W20260709 12:17:27.449975 13960 log.cc:927] Time spent T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 12:17:27.451176 13958 log.cc:927] Time spent T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:17:27.451854 13945 leader_election.cc:290] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:27.452672 12349 raft_consensus.cc:1240] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:27.455991 11595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 813) took 1096 ms. Trace:
I20260709 12:17:27.456466 11595 rpcz_store.cc:276] 0709 12:17:26.359867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:26.360008 (+   141us) service_pool.cc:224] Handling call
0709 12:17:26.360370 (+   362us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:26.378556 (+ 18186us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:17:26.673975 (+295419us) log.cc:844] Serialized 14 byte log entry
0709 12:17:27.060909 (+386934us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:27.072902 (+ 11993us) log.cc:844] Serialized 52 byte log entry
0709 12:17:27.073060 (+   158us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:27.073104 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:27.073166 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:27.455744 (+382578us) raft_consensus.cc:1685] finished
0709 12:17:27.455764 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:27.455925 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8440,"prepare.queue_time_us":40416,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":24270,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":205,"thread_start_us":636084,"threads_started":2,"wal-append.queue_time_us":578955}
I20260709 12:17:27.459319 13806 leader_election.cc:290] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:27.459913 13715 raft_consensus.cc:3055] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:27.461954 13840 leader_election.cc:290] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:27.440817 13698 raft_consensus.cc:2749] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:17:27.471890 11448 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.718s	user 0.043s	sys 0.121s
W20260709 12:17:27.473541 11448 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.043s	sys 0.121s
W20260709 12:17:27.442168 13934 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.003s	sys 0.012s
I20260709 12:17:27.460341 13715 raft_consensus.cc:740] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
W20260709 12:17:27.438696 13931 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.008s	sys 0.007s
W20260709 12:17:27.477259 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 381267us
I20260709 12:17:27.518054 13811 raft_consensus.cc:493] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:27.519132 13811 raft_consensus.cc:515] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:27.522759 13811 leader_election.cc:290] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:27.462006 13898 raft_consensus.cc:493] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:27.471346 13626 raft_consensus.cc:3055] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:27.562044 13601 leader_election.cc:290] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:27.516480 13698 raft_consensus.cc:493] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:27.482091 13934 raft_consensus.cc:697] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:27.461177 13680 raft_consensus.cc:515] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:27.512329 13965 raft_consensus.cc:493] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:27.562702 13580 consensus_queue.cc:1048] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:27.562754 13990 raft_consensus.cc:493] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:27.574654 12204 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.870s	user 0.009s	sys 0.008s
I20260709 12:17:27.449256 13910 consensus_queue.cc:237] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:27.559406 13976 raft_consensus.cc:493] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:27.568961 13840 raft_consensus.cc:493] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:27.590358 12204 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.885s	user 0.009s	sys 0.008s
I20260709 12:17:27.570353 13626 raft_consensus.cc:740] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:27.594394 11595 raft_consensus.cc:1275] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:17:27.594242 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 900042us
I20260709 12:17:27.573402 13956 leader_election.cc:290] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:27.563901 13914 consensus_queue.cc:1048] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
W20260709 12:17:27.598224 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 375161us
W20260709 12:17:27.599411 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 330370us
I20260709 12:17:27.608521 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:27.572037 13898 raft_consensus.cc:515] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:27.609262 11519 raft_consensus.cc:2468] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 6.
W20260709 12:17:27.607220 12203 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.212.130:41579 timed out after 2.027s (SENT) [suppressed 22 similar messages]
I20260709 12:17:27.604451 13568 raft_consensus.cc:493] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:27.581715 13698 raft_consensus.cc:515] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:27.600827 13840 raft_consensus.cc:515] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:27.594636 13947 raft_consensus.cc:515] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:27.593829 13990 raft_consensus.cc:515] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:27.566919 13957 consensus_queue.cc:237] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:27.591966 13965 raft_consensus.cc:515] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:27.599661 13715 consensus_queue.cc:260] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:27.597846 13976 raft_consensus.cc:515] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:27.626870 11491 leader_election.cc:304] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:27.654666 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:27.659240 11526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33446 (request call id 1231) took 1647 ms. Trace:
I20260709 12:17:27.668246 11526 rpcz_store.cc:276] 0709 12:17:26.012089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:26.025519 (+ 13430us) service_pool.cc:224] Handling call
0709 12:17:26.063749 (+ 38230us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:27.274507 (+1210758us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:27.658927 (+384420us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b5400672354. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:17:27.659169 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2629274368}
W20260709 12:17:27.643599 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 256307us
I20260709 12:17:27.675616 11419 leader_election.cc:304] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8
W20260709 12:17:27.673197 11568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:27.638054 13781 leader_election.cc:290] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 8 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:27.640532 13568 raft_consensus.cc:515] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
W20260709 12:17:27.683234 13928 log.cc:927] Time spent T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 1.373s	user 0.001s	sys 0.016s
I20260709 12:17:27.626544 13811 raft_consensus.cc:493] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:27.685320 13715 raft_consensus.cc:3060] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:27.692580 11419 leader_election.cc:304] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8
W20260709 12:17:27.613878 11493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:27.698582 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 356038us
I20260709 12:17:27.615837 13956 raft_consensus.cc:493] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:27.714692 13956 raft_consensus.cc:515] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:27.628190 13848 leader_election.cc:290] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:27.673756 13973 raft_consensus.cc:493] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:27.657652 13979 raft_consensus.cc:493] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:27.715238 11418 leader_election.cc:304] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:27.715940 13979 raft_consensus.cc:515] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:27.716990 13956 leader_election.cc:290] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:27.718282 13979 leader_election.cc:290] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:27.720274 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:27.721696 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:27.719086 13973 raft_consensus.cc:515] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:27.699434 13988 raft_consensus.cc:2749] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:27.656986 13626 consensus_queue.cc:260] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
W20260709 12:17:27.757236 12204 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:27.762495 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 139841us
I20260709 12:17:27.763213 12204 leader_election.cc:304] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:27.763461 11491 leader_election.cc:304] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:27.764183 12204 leader_election.cc:304] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:27.733625 13863 raft_consensus.cc:493] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:27.754033 13972 log.cc:927] Time spent T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 12:17:27.729565 13781 raft_consensus.cc:493] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:27.737838 13995 raft_consensus.cc:493] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:27.782655 13978 log.cc:927] Time spent T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 12:17:27.782483 13995 raft_consensus.cc:515] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
W20260709 12:17:27.784662 13961 log.cc:927] Time spent T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 12:17:27.785305 13989 log.cc:927] Time spent T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 12:17:27.658057 13934 consensus_queue.cc:237] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:27.786756 13933 raft_consensus.cc:493] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:27.787520 13990 leader_election.cc:290] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:27.787350 13933 raft_consensus.cc:515] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:27.777910 13626 raft_consensus.cc:3060] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:27.779245 13947 leader_election.cc:290] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 9 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:27.780124 13965 leader_election.cc:290] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:27.780318 13863 raft_consensus.cc:515] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:27.762975 13601 raft_consensus.cc:2804] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:27.781152 13992 consensus_queue.cc:1059] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:27.767912 13939 raft_consensus.cc:493] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:27.739553 13956 raft_consensus.cc:493] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:27.778061 13898 leader_election.cc:290] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
W20260709 12:17:27.793983 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 78756.4us
I20260709 12:17:27.812552 11418 leader_election.cc:304] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:27.720444 13811 raft_consensus.cc:515] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:27.780763 13976 leader_election.cc:290] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:27.769613 13944 raft_consensus.cc:2804] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:17:27.799145 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 93171.4us
I20260709 12:17:27.775285 13979 raft_consensus.cc:2749] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:27.767572 13680 leader_election.cc:290] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
W20260709 12:17:27.784734 13970 log.cc:927] Time spent T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 12:17:27.802659 11491 leader_election.cc:304] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:27.804785 13971 raft_consensus.cc:493] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:27.782132 13781 raft_consensus.cc:515] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:27.819200 13601 raft_consensus.cc:697] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 5 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:27.775476 13931 raft_consensus.cc:2804] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:27.781927 11523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33446 (request call id 1222) took 2514 ms. Trace:
I20260709 12:17:27.831000 13944 raft_consensus.cc:493] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:27.786809 13997 raft_consensus.cc:2804] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:27.830965 11601 raft_consensus.cc:1275] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:17:27.848479 13967 log.cc:927] Time spent T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.203s	user 0.001s	sys 0.001s
I20260709 12:17:27.775395 13848 consensus_queue.cc:1048] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:17:27.844966 11418 leader_election.cc:304] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:27.845330 11600 raft_consensus.cc:1240] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 8 LEADER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:27.848531 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ed4eeff0ae44d0bc1ebb8cbe3adea5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:27.863687 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:27.846982 11448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58856 (request call id 645) took 1152 ms. Trace:
I20260709 12:17:27.851629 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:27.785185 13995 leader_election.cc:290] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:27.840821 13992 consensus_queue.cc:1243] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [LEADER]: Peer 9da53be18b0f446aaa406216e20b0ec8 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:17:27.852360 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:27.852824 11523 rpcz_store.cc:276] 0709 12:17:25.267142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:25.526717 (+259575us) service_pool.cc:224] Handling call
0709 12:17:25.527072 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:25.576665 (+ 49593us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:25.576703 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:25.593628 (+ 16925us) log.cc:844] Serialized 26 byte log entry
0709 12:17:26.031664 (+438036us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:26.104961 (+ 73297us) log.cc:844] Serialized 14 byte log entry
0709 12:17:26.502293 (+397332us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:26.502479 (+   186us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:27.682583 (+1180104us) spinlock_profiling.cc:243] Waited 52.7 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e675e86e 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221 00007f84e67671d9 00007f84e6767169
0709 12:17:27.781575 (+ 98992us) raft_consensus.cc:1685] finished
0709 12:17:27.781695 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:27.781848 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":371699,"prepare.queue_time_us":76984,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":384238,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":20582,"spinlock_wait_cycles":121289088,"thread_start_us":406590,"threads_started":1,"wal-append.queue_time_us":567744}
W20260709 12:17:27.852491 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 159970us
I20260709 12:17:27.811991 13939 raft_consensus.cc:515] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:27.865324 11596 raft_consensus.cc:2368] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de for earlier term 5. Current term is 6.
I20260709 12:17:27.821475 13956 raft_consensus.cc:515] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:27.867429 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:27.854880 13698 leader_election.cc:290] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:27.872927 11419 leader_election.cc:304] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:27.921702 11594 raft_consensus.cc:2393] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 9: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:27.857501 13944 raft_consensus.cc:3060] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:27.857432 13979 raft_consensus.cc:2749] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:17:27.924304 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 79422.5us
I20260709 12:17:27.870487 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:27.852663 13931 raft_consensus.cc:493] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:27.925165 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 77823.2us
W20260709 12:17:27.938762 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 65933.5us
W20260709 12:17:27.940389 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 137790us
W20260709 12:17:27.925141 13817 consensus_meta.cc:287] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671: Time spent flushing consensus metadata: real 0.651s	user 0.012s	sys 0.000s
I20260709 12:17:27.858986 13997 raft_consensus.cc:493] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:27.869253 13866 raft_consensus.cc:493] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:27.946269 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:27.865073 11448 rpcz_store.cc:276] 0709 12:17:26.694260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:26.694455 (+   195us) service_pool.cc:224] Handling call
0709 12:17:26.711628 (+ 17173us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:26.712012 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:26.712038 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:26.727542 (+ 15504us) log.cc:844] Serialized 52 byte log entry
0709 12:17:27.475287 (+747745us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:27.674653 (+199366us) log.cc:844] Serialized 14 byte log entry
0709 12:17:27.702602 (+ 27949us) log.cc:844] Serialized 14 byte log entry
0709 12:17:27.769515 (+ 66913us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:27.769633 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:27.846322 (+ 76689us) raft_consensus.cc:1685] finished
0709 12:17:27.846343 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:27.846841 (+   498us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10975,"prepare.queue_time_us":356861,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":2807,"raft.queue_time_us":398133,"raft.run_cpu_time_us":470,"raft.run_wall_time_us":28851,"thread_start_us":934555,"threads_started":3,"wal-append.queue_time_us":901576}
I20260709 12:17:27.946544 14013 raft_consensus.cc:493] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
W20260709 12:17:27.943224 13969 log.cc:927] Time spent T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
I20260709 12:17:27.953307 13994 raft_consensus.cc:2749] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:27.853335 13971 raft_consensus.cc:515] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:27.954483 13817 raft_consensus.cc:2749] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:27.954767 11418 leader_election.cc:304] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:27.961019 11491 leader_election.cc:304] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:27.938746 13931 raft_consensus.cc:3060] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:27.980417 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:27.981467 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:27.946188 13973 leader_election.cc:290] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
W20260709 12:17:27.973806 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 130216us
I20260709 12:17:27.926585 14007 raft_consensus.cc:2749] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:27.980129 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:27.941955 13910 consensus_queue.cc:1048] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:17:27.979974 14013 raft_consensus.cc:515] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:27.861119 13933 leader_election.cc:290] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:27.858270 13909 raft_consensus.cc:515] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:27.964121 13997 raft_consensus.cc:3060] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:27.993448 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:28.000034 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:27.984768 13995 raft_consensus.cc:2804] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:27.982946 13758 raft_consensus.cc:2749] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:28.008817 12356 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51690 (request call id 716) took 1531 ms. Trace:
I20260709 12:17:28.009430 11602 raft_consensus.cc:1275] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:17:28.009963 11595 raft_consensus.cc:1240] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:17:28.010847 11602 pending_rounds.cc:85] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8: Aborting all ops after (but not including) 4
I20260709 12:17:28.011118 11602 pending_rounds.cc:107] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:17:28.011338 11602 raft_consensus.cc:2889] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:27.966509 13947 consensus_queue.cc:1059] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:17:28.010557 12356 rpcz_store.cc:276] 0709 12:17:26.474082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:26.483720 (+  9638us) service_pool.cc:224] Handling call
0709 12:17:28.004968 (+1521248us) spinlock_profiling.cc:243] Waited 5.71 ms on lock 0x7b54000e24d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:28.005127 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13128960}
I20260709 12:17:28.013439 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8741606df54c3f8b5cc5c1141862ea" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:28.015812 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:28.015877 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:28.016186 11600 raft_consensus.cc:1240] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:28.017355 12346 raft_consensus.cc:3060] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:28.018080 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:28.016582 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:28.019665 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:28.019335 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:28.020217 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:28.020594 12345 raft_consensus.cc:2393] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 7: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:17:28.020311 12359 raft_consensus.cc:2468] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 6.
W20260709 12:17:28.021136 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 66460.7us
I20260709 12:17:28.016868 13995 raft_consensus.cc:697] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [term 6 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:28.022868 12361 raft_consensus.cc:1275] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:17:28.021127 11602 raft_consensus.cc:2468] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 7.
I20260709 12:17:28.004168 13568 leader_election.cc:290] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:27.974110 13866 raft_consensus.cc:515] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:28.026700 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:28.027256 11418 leader_election.cc:304] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:28.029929 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:28.030663 12356 raft_consensus.cc:2468] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 8.
I20260709 12:17:28.014149 13774 raft_consensus.cc:493] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:28.031765 14007 raft_consensus.cc:493] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:28.034147 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:28.034334 14007 raft_consensus.cc:515] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
W20260709 12:17:28.036936 14005 log.cc:927] Time spent T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:17:28.019802 13910 raft_consensus.cc:2804] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:28.032099 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:28.037402 13774 raft_consensus.cc:515] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:28.038264 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:28.040535 11451 raft_consensus.cc:3060] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:28.009243 13627 raft_consensus.cc:493] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:28.040853 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:28.033753 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d43eecbad746fd9ddce50c5b9fc3e8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:28.046481 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:28.047585 11445 raft_consensus.cc:3060] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:28.049412 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:28.052364 12357 raft_consensus.cc:2393] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 8: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:17:28.052896 11602 raft_consensus.cc:2410] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:17:27.984735 13601 consensus_queue.cc:237] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:28.063469 13781 leader_election.cc:290] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:28.052138 13627 raft_consensus.cc:515] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:28.067968 13627 leader_election.cc:290] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:28.068588 13956 leader_election.cc:290] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:28.047214 14011 raft_consensus.cc:2764] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:17:28.039983 13774 leader_election.cc:290] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:28.032907 13947 raft_consensus.cc:493] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:28.068444 11451 raft_consensus.cc:2468] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 8.
I20260709 12:17:28.074558 11602 raft_consensus.cc:1240] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:17:28.057960 13811 leader_election.cc:290] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:28.095415 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:28.098379 11445 raft_consensus.cc:2468] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 3.
I20260709 12:17:28.059257 13863 leader_election.cc:290] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:28.105662 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffe47647c274723808482c166efa21c" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:28.109311 11446 raft_consensus.cc:2468] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 5.
W20260709 12:17:28.123517 11568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:28.076910 14014 raft_consensus.cc:3060] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:28.084421 13910 raft_consensus.cc:697] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 6 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:28.054769 13944 raft_consensus.cc:515] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:28.130448 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffe47647c274723808482c166efa21c" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:28.012053 13973 consensus_queue.cc:1059] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
W20260709 12:17:28.134024 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 64398.7us
I20260709 12:17:28.122957 14000 raft_consensus.cc:493] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:28.089304 13947 raft_consensus.cc:515] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:28.152527 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:28.152853 12352 raft_consensus.cc:2368] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 6. Current term is 7.
I20260709 12:17:28.153520 11602 raft_consensus.cc:2410] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de for term 10 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:17:28.154332 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:28.143175 14013 leader_election.cc:290] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:17:28.144917 14021 log.cc:927] Time spent T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 12:17:28.158653 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:28.159291 11453 raft_consensus.cc:3060] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:28.156162 11602 raft_consensus.cc:2393] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 8: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
W20260709 12:17:28.163470 14012 log.cc:927] Time spent T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 12:17:28.164074 13971 leader_election.cc:290] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:28.075934 13995 consensus_queue.cc:237] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:28.146076 14000 raft_consensus.cc:515] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:28.173237 13910 consensus_queue.cc:237] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:28.172996 13997 raft_consensus.cc:515] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:28.174068 13866 leader_election.cc:290] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:28.145208 13811 raft_consensus.cc:493] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:28.175031 13811 raft_consensus.cc:515] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:28.176010 13997 leader_election.cc:290] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:28.178061 13944 leader_election.cc:290] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:28.182070 11595 raft_consensus.cc:1240] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:28.192214 13909 leader_election.cc:290] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:28.177198 13811 leader_election.cc:290] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:28.197811 11418 leader_election.cc:400] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 election: Vote denied by peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063) with higher term. Message: Invalid argument: T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 5. Current term is 7.
I20260709 12:17:28.200764 11418 leader_election.cc:403] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:17:28.137725 13993 consensus_queue.cc:1048] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 12:17:28.199383 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a841f2f09ced40a4bbf33594e11bd7ad" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:28.195804 14007 leader_election.cc:290] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:28.211319 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:28.215165 11602 raft_consensus.cc:2468] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 7.
I20260709 12:17:28.219379 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:28.226737 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:28.231572 12346 raft_consensus.cc:2468] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 9.
I20260709 12:17:28.212754 13965 raft_consensus.cc:2749] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063) with higher term. Message: Invalid argument: T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 5. Current term is 7.
I20260709 12:17:28.240013 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:28.249797 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:28.250677 11454 raft_consensus.cc:3060] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:28.249873 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:28.255136 11453 raft_consensus.cc:2468] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 9.
I20260709 12:17:28.257682 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:28.264075 11447 raft_consensus.cc:1240] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 5 LEADER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:28.265991 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:28.232924 14007 consensus_queue.cc:1048] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:17:28.248277 13715 raft_consensus.cc:493] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:28.265991 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:28.267277 11600 raft_consensus.cc:1240] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 6 LEADER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:28.273106 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:28.278162 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:28.280083 11453 raft_consensus.cc:2368] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de for earlier term 5. Current term is 6.
I20260709 12:17:28.281865 13823 raft_consensus.cc:3055] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:28.282338 13823 raft_consensus.cc:740] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:28.283143 13823 consensus_queue.cc:260] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:28.284127 13823 raft_consensus.cc:3060] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:28.293736 13939 leader_election.cc:290] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:28.295063 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
W20260709 12:17:28.295365 12205 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:28.295811 11450 raft_consensus.cc:2468] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 7.
I20260709 12:17:28.296725 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:28.299228 13995 consensus_queue.cc:1059] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:28.300199 13995 raft_consensus.cc:3055] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:28.300580 13995 raft_consensus.cc:740] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:28.301517 13995 consensus_queue.cc:260] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:28.302768 13995 raft_consensus.cc:3060] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:28.289840 13715 raft_consensus.cc:515] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
W20260709 12:17:28.304625 12203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:28.300592 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:28.309343 14008 raft_consensus.cc:3055] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:28.309975 14008 raft_consensus.cc:740] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
W20260709 12:17:28.310216 12206 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:28.309494 12352 raft_consensus.cc:2468] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 4.
I20260709 12:17:28.300201 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:28.311427 12359 raft_consensus.cc:2468] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 8.
I20260709 12:17:28.312198 12848 raft_consensus.cc:3055] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:28.312610 12848 raft_consensus.cc:740] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:28.299453 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:28.319393 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:28.315493 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:28.335170 11449 raft_consensus.cc:2468] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 7.
W20260709 12:17:28.373432 11493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:28.375687 12346 raft_consensus.cc:1275] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 12:17:28.376268 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 68324.6us
I20260709 12:17:28.377740 12203 leader_election.cc:304] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
W20260709 12:17:28.379197 11522 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33446 (request call id 1235) took 1999 ms (client timeout 2632 ms). Trace:
I20260709 12:17:28.380426 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:28.380952 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:28.381134 11595 raft_consensus.cc:2468] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 4.
I20260709 12:17:28.380396 11454 raft_consensus.cc:2468] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 7.
I20260709 12:17:28.383575 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:28.385911 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:28.385536 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
W20260709 12:17:28.379643 11522 rpcz_store.cc:269] 0709 12:17:26.317607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:26.317741 (+   134us) service_pool.cc:224] Handling call
0709 12:17:28.316509 (+1998768us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54000a5fd4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:28.316681 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2453733760}
I20260709 12:17:28.387153 11452 raft_consensus.cc:2468] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 7.
I20260709 12:17:28.392506 12203 leader_election.cc:304] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:28.394794 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffe47647c274723808482c166efa21c" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:28.396580 11597 raft_consensus.cc:2393] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 9: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:17:28.397549 12203 leader_election.cc:304] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:28.398553 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a841f2f09ced40a4bbf33594e11bd7ad" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:28.399230 12356 raft_consensus.cc:3060] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:28.399911 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:28.402294 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:28.402871 11454 raft_consensus.cc:2468] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 6.
I20260709 12:17:28.403556 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:28.373878 13991 raft_consensus.cc:493] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:28.404910 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:28.406637 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:28.378556 13863 raft_consensus.cc:493] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:28.413537 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:28.418862 11449 raft_consensus.cc:2468] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 5.
I20260709 12:17:28.420782 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:28.421473 12352 raft_consensus.cc:2393] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 9: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:17:28.423444 13863 raft_consensus.cc:515] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:28.425722 13863 leader_election.cc:290] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:28.422616 11419 leader_election.cc:304] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:28.427788 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:28.428205 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:28.398586 13626 raft_consensus.cc:2749] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:28.435425 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:28.405067 13971 raft_consensus.cc:2749] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:28.402436 13944 raft_consensus.cc:2749] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:28.404003 14014 raft_consensus.cc:2749] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:28.436199 11449 raft_consensus.cc:2376] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 6. Re-sending same reply.
I20260709 12:17:28.387858 13939 consensus_queue.cc:1048] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:17:28.386005 12848 consensus_queue.cc:260] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:28.446543 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:28.450196 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:28.450380 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:28.445297 12203 leader_election.cc:304] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:28.452497 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:28.454406 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7937e0cff84ef7a26c84247c8ffc08" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:28.455574 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:28.455930 12352 raft_consensus.cc:2393] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 8: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:17:28.457363 11446 raft_consensus.cc:2468] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 7.
I20260709 12:17:28.444170 13997 raft_consensus.cc:2804] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:28.402947 13931 raft_consensus.cc:515] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:28.461910 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a841f2f09ced40a4bbf33594e11bd7ad" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:28.445278 13715 leader_election.cc:290] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:28.463966 12361 raft_consensus.cc:2468] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 9.
I20260709 12:17:28.420967 13991 raft_consensus.cc:515] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:28.456835 13627 raft_consensus.cc:2804] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:28.458467 12848 raft_consensus.cc:3060] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:28.473582 11597 raft_consensus.cc:1240] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:28.474189 13991 leader_election.cc:290] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:28.445873 13910 consensus_queue.cc:1048] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:17:28.453567 13863 consensus_queue.cc:1059] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:17:28.404211 14008 consensus_queue.cc:260] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:28.476346 11454 raft_consensus.cc:3055] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:28.479175 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:28.479535 11454 raft_consensus.cc:740] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:28.464761 13997 raft_consensus.cc:493] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:28.476679 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:28.479873 11449 raft_consensus.cc:3060] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:28.483819 11454 consensus_queue.cc:260] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:28.485248 11454 raft_consensus.cc:3060] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:28.471725 13627 raft_consensus.cc:493] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:28.482054 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:28.491645 12352 raft_consensus.cc:2468] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 7.
I20260709 12:17:28.493484 11449 raft_consensus.cc:2468] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 7.
I20260709 12:17:28.499096 13948 raft_consensus.cc:3055] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:28.499635 13948 raft_consensus.cc:740] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:28.500193 13355 consensus_queue.cc:260] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:28.500424 13948 consensus_queue.cc:260] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:28.482692 13997 raft_consensus.cc:3060] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:28.512660 11449 raft_consensus.cc:1275] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:28.492333 13627 raft_consensus.cc:3060] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:28.512082 14032 log.cc:927] Time spent T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:17:28.521900 12356 raft_consensus.cc:2468] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 4.
I20260709 12:17:28.507284 14008 raft_consensus.cc:3060] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:28.536710 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ed4eeff0ae44d0bc1ebb8cbe3adea5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:28.537086 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:28.548027 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:28.536484 13948 raft_consensus.cc:3060] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:28.552207 13931 leader_election.cc:290] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 8 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:28.555146 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:28.555717 11449 raft_consensus.cc:3060] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:28.561421 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:28.562125 12346 raft_consensus.cc:3060] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:17:28.562338 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:28.563433 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d43eecbad746fd9ddce50c5b9fc3e8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:28.564538 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:28.566515 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:28.566637 12356 raft_consensus.cc:1275] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:17:28.567060 12356 pending_rounds.cc:85] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de: Aborting all ops after (but not including) 4
I20260709 12:17:28.567281 12356 pending_rounds.cc:107] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:17:28.567492 12356 raft_consensus.cc:2889] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:28.572312 11449 raft_consensus.cc:2468] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 7.
I20260709 12:17:28.572810 12357 raft_consensus.cc:1240] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:17:28.573462 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:28.573909 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:28.574527 12357 raft_consensus.cc:3060] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:28.575405 11594 raft_consensus.cc:1275] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:28.574517 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffe47647c274723808482c166efa21c" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:17:28.577862 11568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:28.581758 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a841f2f09ced40a4bbf33594e11bd7ad" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:28.582640 11448 raft_consensus.cc:2393] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 4: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:28.584012 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:28.572393 12346 raft_consensus.cc:2468] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 6.
I20260709 12:17:28.587414 12346 raft_consensus.cc:1240] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:28.590613 12346 raft_consensus.cc:1275] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:28.591554 13840 leader_election.cc:290] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:28.591903 12346 raft_consensus.cc:1240] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:28.592120 13997 raft_consensus.cc:515] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:28.592624 13995 raft_consensus.cc:493] T da8741606df54c3f8b5cc5c1141862ea P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:28.593230 12348 raft_consensus.cc:1240] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:28.593140 13995 raft_consensus.cc:515] T da8741606df54c3f8b5cc5c1141862ea P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:28.595237 13997 leader_election.cc:290] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:28.596940 13862 raft_consensus.cc:3055] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:28.597412 13862 raft_consensus.cc:740] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:28.597762 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:28.598145 11599 raft_consensus.cc:1275] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:28.598862 11452 raft_consensus.cc:2393] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 9: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:17:28.598291 13862 consensus_queue.cc:260] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:28.599433 13862 raft_consensus.cc:3060] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:28.599766 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:28.600867 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7937e0cff84ef7a26c84247c8ffc08" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:28.588466 13806 raft_consensus.cc:3055] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:28.601573 13806 raft_consensus.cc:740] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:28.602420 11452 raft_consensus.cc:1275] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:28.604080 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:28.604734 11448 raft_consensus.cc:2468] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 5.
I20260709 12:17:28.589103 12357 raft_consensus.cc:2468] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 9.
I20260709 12:17:28.585304 12356 raft_consensus.cc:3060] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:28.610199 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:28.611805 11491 leader_election.cc:304] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:28.613097 11491 leader_election.cc:304] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:28.613868 13979 raft_consensus.cc:2749] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:28.614602 13979 raft_consensus.cc:2749] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:28.614840 14000 leader_election.cc:290] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:28.616645 14019 consensus_queue.cc:1059] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:28.617683 14014 raft_consensus.cc:3055] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:28.618033 14014 raft_consensus.cc:740] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:28.620977 12348 raft_consensus.cc:1240] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:28.595214 13995 leader_election.cc:290] T da8741606df54c3f8b5cc5c1141862ea P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:28.627140 11567 leader_election.cc:304] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:28.629738 11567 leader_election.cc:304] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:28.623874 14007 consensus_queue.cc:1048] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 12:17:28.630785 14014 consensus_queue.cc:260] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:28.630992 13745 consensus_queue.cc:1048] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:28.631840 14014 raft_consensus.cc:3060] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:28.602605 13806 consensus_queue.cc:260] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:28.632727 13745 consensus_queue.cc:1059] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:28.633908 13806 raft_consensus.cc:3060] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:28.635638 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:28.638566 11567 leader_election.cc:304] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:28.644157 12356 raft_consensus.cc:2410] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:28.645282 12357 raft_consensus.cc:1240] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 5. Current term is 6. Ops: []
W20260709 12:17:28.646785 14036 log.cc:927] Time spent T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:17:28.650090 13580 consensus_queue.cc:1048] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:28.625466 11493 leader_election.cc:304] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:28.659278 11493 leader_election.cc:304] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:28.658208 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c355b3902a4e7fb72bac6a91ea3316" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:28.653551 11567 leader_election.cc:304] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:28.654872 11491 leader_election.cc:304] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:28.660960 12346 raft_consensus.cc:1275] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:28.663113 11491 leader_election.cc:304] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:28.624136 14009 consensus_queue.cc:1048] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:17:28.666463 13979 raft_consensus.cc:2749] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:28.667349 13979 consensus_queue.cc:1048] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:28.669576 13957 raft_consensus.cc:2804] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:28.670076 13957 raft_consensus.cc:493] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:28.670439 13957 raft_consensus.cc:3060] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:28.655385 14000 raft_consensus.cc:2749] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:28.683045 13957 raft_consensus.cc:515] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:28.683765 13627 raft_consensus.cc:515] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:28.684983 12352 raft_consensus.cc:1240] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:28.688980 13957 leader_election.cc:290] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
W20260709 12:17:28.690455 11568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:28.653945 13745 raft_consensus.cc:2804] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:28.689795 13957 raft_consensus.cc:2749] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:28.689961 13811 raft_consensus.cc:2804] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:28.694846 13823 raft_consensus.cc:2804] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:28.653777 13509 consensus_queue.cc:1059] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
W20260709 12:17:28.711524 11493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 48878.4us
I20260709 12:17:28.712580 13823 raft_consensus.cc:697] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 9 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
W20260709 12:17:28.715662 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 52629.9us
I20260709 12:17:28.699702 14000 consensus_queue.cc:1059] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:17:28.708514 13811 raft_consensus.cc:493] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:28.720009 11449 raft_consensus.cc:2468] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 9.
I20260709 12:17:28.708876 13745 raft_consensus.cc:697] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 6 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:28.716640 11491 leader_election.cc:304] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:28.723609 13823 consensus_queue.cc:237] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:28.725464 11493 leader_election.cc:304] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:28.726367 13957 raft_consensus.cc:2804] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:28.726771 13957 raft_consensus.cc:493] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:28.727118 13957 raft_consensus.cc:3060] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:28.720928 13811 raft_consensus.cc:3060] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:28.731243 11491 leader_election.cc:304] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:28.732937 11491 leader_election.cc:304] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:28.734063 14026 raft_consensus.cc:493] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:28.735038 12848 raft_consensus.cc:493] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:28.735620 12848 raft_consensus.cc:515] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:28.737303 14026 raft_consensus.cc:515] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:28.742336 14026 leader_election.cc:290] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
W20260709 12:17:28.743891 14017 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 12:17:28.746649 12848 leader_election.cc:290] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:28.737680 13580 raft_consensus.cc:493] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:28.750512 13721 leader_election.cc:290] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 7 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:28.738102 13995 raft_consensus.cc:3060] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:28.721223 13627 leader_election.cc:290] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 8 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:28.757893 13745 consensus_queue.cc:237] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:28.723464 14043 raft_consensus.cc:2804] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:28.768532 14043 raft_consensus.cc:493] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:28.768929 14043 raft_consensus.cc:3060] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:28.769767 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:28.770437 12352 raft_consensus.cc:3060] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:28.770629 13786 raft_consensus.cc:3055] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:28.771076 13786 raft_consensus.cc:740] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:28.771919 13786 consensus_queue.cc:260] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
W20260709 12:17:28.774664 11566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:28.776782 13580 raft_consensus.cc:515] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:28.777417 12359 raft_consensus.cc:1275] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:28.777485 12349 raft_consensus.cc:1240] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 7. Current term is 8. Ops: []
W20260709 12:17:28.780282 14039 log.cc:927] Time spent T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:17:28.784490 13947 leader_election.cc:290] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:28.773144 13786 raft_consensus.cc:3060] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:28.788830 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:28.789723 13580 leader_election.cc:290] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:28.790819 13995 raft_consensus.cc:2749] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:28.791713 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:28.792387 12349 raft_consensus.cc:2468] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 9.
I20260709 12:17:28.793265 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:28.793893 12349 raft_consensus.cc:2468] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 6.
I20260709 12:17:28.795043 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:28.795620 11599 raft_consensus.cc:3055] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:28.796003 11599 raft_consensus.cc:740] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:28.796044 12349 raft_consensus.cc:2410] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:17:28.800391 13811 raft_consensus.cc:515] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:28.803629 11567 leader_election.cc:304] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
W20260709 12:17:28.804479 11566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:28.809048 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 76169.2us
I20260709 12:17:28.814599 12352 raft_consensus.cc:2468] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 9.
I20260709 12:17:28.816165 12352 raft_consensus.cc:1240] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 12:17:28.816620 11419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:28.797008 11599 consensus_queue.cc:260] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:28.827015 12349 raft_consensus.cc:1240] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:17:28.827447 11599 raft_consensus.cc:3060] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:28.827018 11596 raft_consensus.cc:1240] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:28.825852 11567 leader_election.cc:304] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:28.840073 11493 leader_election.cc:304] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:28.840214 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8741606df54c3f8b5cc5c1141862ea" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:28.840550 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:28.841751 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:28.842517 11446 raft_consensus.cc:2468] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 6.
I20260709 12:17:28.844287 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:28.844854 11493 leader_election.cc:304] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:28.847265 12356 raft_consensus.cc:1275] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:28.847555 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:28.848150 11448 raft_consensus.cc:2468] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 7.
I20260709 12:17:28.860117 11450 raft_consensus.cc:1240] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:28.832167 13806 raft_consensus.cc:2804] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:28.831805 13994 raft_consensus.cc:493] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:28.837090 14026 raft_consensus.cc:2804] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:28.844192 13580 raft_consensus.cc:2804] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:28.849598 13862 raft_consensus.cc:2804] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:28.849933 13817 raft_consensus.cc:2804] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:28.866420 13806 raft_consensus.cc:493] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:28.865707 13939 raft_consensus.cc:493] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:28.843911 13995 consensus_queue.cc:1048] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:17:28.847107 13721 consensus_queue.cc:1059] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:17:28.867882 14026 raft_consensus.cc:493] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:28.872938 13580 raft_consensus.cc:493] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:28.846870 14042 consensus_queue.cc:1059] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:17:28.877013 13862 raft_consensus.cc:493] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:28.890893 13806 raft_consensus.cc:3060] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:28.897687 13580 raft_consensus.cc:3060] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:28.895457 14026 raft_consensus.cc:3060] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:17:28.929639 11418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:28.868669 13994 raft_consensus.cc:515] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:28.920545 13862 raft_consensus.cc:3060] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:28.892767 13939 raft_consensus.cc:515] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:28.943558 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:28.958890 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:28.959685 11446 raft_consensus.cc:3060] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:28.966593 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:17:28.971630 11565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:28.972357 11565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:28.973527 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:28.973768 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:28.974275 11600 raft_consensus.cc:3060] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:28.974792 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d43eecbad746fd9ddce50c5b9fc3e8" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:28.975629 11447 raft_consensus.cc:2410] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:17:28.976313 11601 raft_consensus.cc:1240] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:17:28.978432 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8741606df54c3f8b5cc5c1141862ea" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:17:28.981637 11417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:28.982422 11417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:28.984297 12203 leader_election.cc:304] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:28.944224 13991 raft_consensus.cc:3055] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:28.988493 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:28.991231 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:28.992846 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:28.988466 12203 leader_election.cc:304] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:28.996937 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:28.992100 11565 leader_election.cc:304] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
W20260709 12:17:28.997777 11493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:29.000522 12203 leader_election.cc:304] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
W20260709 12:17:29.001217 12205 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:29.001565 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:29.001802 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:29.007238 11597 raft_consensus.cc:2393] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 6: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:17:29.013960 11565 leader_election.cc:304] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:29.019492 11602 raft_consensus.cc:1275] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:28.991197 13994 leader_election.cc:290] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:29.024037 11519 raft_consensus.cc:1275] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:29.021095 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:28.996070 13627 raft_consensus.cc:2804] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:28.996070 14050 raft_consensus.cc:493] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:29.002537 13931 raft_consensus.cc:2749] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:28.991645 13991 raft_consensus.cc:740] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:29.027984 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:29.042109 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:29.030161 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:29.017335 13786 raft_consensus.cc:2749] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:29.033540 11524 raft_consensus.cc:1240] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:29.036584 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c355b3902a4e7fb72bac6a91ea3316" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:29.029515 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:29.042804 11453 raft_consensus.cc:2376] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 7. Re-sending same reply.
I20260709 12:17:29.046344 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:29.047637 11519 raft_consensus.cc:2410] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:17:29.052248 11600 raft_consensus.cc:2468] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 8.
I20260709 12:17:29.021035 13811 leader_election.cc:290] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:29.056603 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:29.054306 11447 raft_consensus.cc:2368] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de for earlier term 5. Current term is 6.
I20260709 12:17:29.057273 11523 raft_consensus.cc:2468] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 7.
I20260709 12:17:29.059412 11453 raft_consensus.cc:1240] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:29.062750 11447 raft_consensus.cc:1240] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:29.054104 14058 raft_consensus.cc:3055] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:29.033190 13911 raft_consensus.cc:493] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:29.063640 13939 leader_election.cc:290] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:29.063966 11447 raft_consensus.cc:1240] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 3. Current term is 4. Ops: []
W20260709 12:17:29.064670 11420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:29.065460 11447 raft_consensus.cc:1275] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:29.069797 13863 raft_consensus.cc:2749] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:17:29.070422 14046 log.cc:927] Time spent T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:17:29.077527 13991 consensus_queue.cc:260] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:29.078838 13991 raft_consensus.cc:3060] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:29.079685 11446 raft_consensus.cc:2468] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 8.
I20260709 12:17:29.090927 12346 raft_consensus.cc:1240] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:29.032303 13627 raft_consensus.cc:493] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1c101e338f954ef086338e251deed19d)
W20260709 12:17:29.105610 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 50159.7us
I20260709 12:17:29.032568 13817 raft_consensus.cc:697] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [term 9 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
W20260709 12:17:29.122074 14047 log.cc:927] Time spent T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 12:17:29.039928 13745 raft_consensus.cc:2804] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:29.107995 11419 leader_election.cc:304] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8
W20260709 12:17:29.123068 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 122592us
I20260709 12:17:29.124837 11419 leader_election.cc:304] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:29.121824 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:29.127391 12345 raft_consensus.cc:2468] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 6.
I20260709 12:17:29.130669 11419 leader_election.cc:400] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Vote denied by peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935) with higher term. Message: Invalid argument: T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 6. Current term is 7.
I20260709 12:17:29.134133 11419 leader_election.cc:403] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:17:29.102948 14044 log.cc:927] Time spent T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
I20260709 12:17:29.142799 11565 leader_election.cc:304] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:17:29.100215 14058 raft_consensus.cc:740] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:29.154301 11525 raft_consensus.cc:1240] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:29.149897 12203 leader_election.cc:304] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:29.114215 13627 raft_consensus.cc:3060] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:29.157235 11419 leader_election.cc:304] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:29.160251 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:29.160908 11528 raft_consensus.cc:2468] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 5.
I20260709 12:17:29.161339 11419 leader_election.cc:304] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:29.161556 11565 leader_election.cc:304] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:29.156332 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:29.163020 11524 raft_consensus.cc:2410] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:17:29.105129 14043 raft_consensus.cc:515] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:29.165436 14008 raft_consensus.cc:2749] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:29.144179 13966 raft_consensus.cc:2804] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:29.168242 13966 raft_consensus.cc:493] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:29.168630 13966 raft_consensus.cc:3060] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:29.169056 13947 raft_consensus.cc:2804] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:17:29.169646 14051 log.cc:927] Time spent T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 12:17:29.170961 13509 raft_consensus.cc:3055] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:29.171379 13509 raft_consensus.cc:740] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:29.172111 13509 consensus_queue.cc:260] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:29.173112 13509 raft_consensus.cc:3060] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:29.169534 13947 raft_consensus.cc:493] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:29.146943 13895 raft_consensus.cc:3060] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:29.064085 13911 raft_consensus.cc:515] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:29.176775 11419 leader_election.cc:304] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:29.182392 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:29.139245 13745 raft_consensus.cc:493] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:29.145288 14056 raft_consensus.cc:493] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:29.049738 14050 raft_consensus.cc:515] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:29.185612 11565 leader_election.cc:304] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:29.196151 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:29.202323 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:29.165745 14055 raft_consensus.cc:493] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:29.152071 11602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "1c101e338f954ef086338e251deed19d"
 from {username='slave'} at 127.0.0.1:37992
I20260709 12:17:29.169241 14043 leader_election.cc:290] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:29.213306 11419 leader_election.cc:304] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:29.195955 13947 raft_consensus.cc:3060] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:29.222239 11599 raft_consensus.cc:1275] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:29.220992 11565 leader_election.cc:304] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:29.223166 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:29.168939 13939 raft_consensus.cc:2804] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:29.196976 13745 raft_consensus.cc:3060] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:29.222669 11528 raft_consensus.cc:2468] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 6.
I20260709 12:17:29.224154 13983 raft_consensus.cc:2804] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:29.221915 14017 consensus_queue.cc:1048] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:17:29.184527 13840 raft_consensus.cc:2749] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:29.195770 13851 raft_consensus.cc:3060] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:29.221943 14008 raft_consensus.cc:2804] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:29.227342 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9fe9a94294836aec652338f44367d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:29.225268 13911 leader_election.cc:290] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:29.225440 13910 consensus_queue.cc:1059] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:17:29.273064 11450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35814 (request call id 350) took 1024 ms. Trace:
I20260709 12:17:29.274219 11450 rpcz_store.cc:276] 0709 12:17:28.248379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:28.311844 (+ 63465us) service_pool.cc:224] Handling call
0709 12:17:28.859910 (+548066us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:28.860669 (+   759us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:29.272829 (+412160us) spinlock_profiling.cc:243] Waited 548 ms on lock 0x7b54001c20d0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc28ad 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:29.272994 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1259619712}
I20260709 12:17:29.216810 14056 raft_consensus.cc:515] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:29.234493 14058 consensus_queue.cc:260] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:29.235174 14050 leader_election.cc:290] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
W20260709 12:17:29.235492 13957 consensus_meta.cc:287] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671: Time spent flushing consensus metadata: real 0.508s	user 0.011s	sys 0.001s
I20260709 12:17:29.236101 14054 raft_consensus.cc:493] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:29.184788 13698 raft_consensus.cc:2749] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:29.165529 14019 raft_consensus.cc:2749] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935) with higher term. Message: Invalid argument: T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 6. Current term is 7.
W20260709 12:17:29.239962 11568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:29.259052 14043 raft_consensus.cc:493] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
W20260709 12:17:29.251222 14006 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 12:17:29.246280 13758 raft_consensus.cc:2749] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:29.282977 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:29.247956 12848 raft_consensus.cc:2804] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:29.254628 13965 consensus_queue.cc:1048] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:17:29.269578 13983 raft_consensus.cc:697] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 8 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:29.260650 13939 raft_consensus.cc:697] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:29.258509 13984 consensus_queue.cc:1048] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:17:29.254004 13680 consensus_queue.cc:1059] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:17:29.241757 14055 raft_consensus.cc:515] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:29.297165 12848 raft_consensus.cc:697] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:29.324029 12848 consensus_queue.cc:237] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:29.325023 14055 leader_election.cc:290] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:29.325929 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:29.326785 11526 raft_consensus.cc:2393] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 6: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:17:29.328302 11528 raft_consensus.cc:2468] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 6.
I20260709 12:17:29.310101 13355 raft_consensus.cc:3060] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:29.309872 13983 consensus_queue.cc:237] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:29.336573 13931 raft_consensus.cc:493] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:29.314837 12352 raft_consensus.cc:1275] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:29.245836 13817 consensus_queue.cc:237] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:29.281672 14008 raft_consensus.cc:697] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [term 4 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:29.316833 11525 raft_consensus.cc:1240] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [term 6 LEADER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:29.285605 14054 raft_consensus.cc:515] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:29.299490 13698 consensus_queue.cc:1048] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:17:29.284389 13957 raft_consensus.cc:515] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:29.311741 13939 consensus_queue.cc:237] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:29.337934 14026 raft_consensus.cc:515] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:29.366391 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:29.307617 14043 raft_consensus.cc:515] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:29.365658 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:29.351817 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:29.379381 11520 raft_consensus.cc:3060] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:29.354689 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:29.262027 13806 raft_consensus.cc:515] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:29.366844 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:29.378756 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:29.347018 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:29.382413 11519 raft_consensus.cc:2468] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 8.
I20260709 12:17:29.382611 11521 raft_consensus.cc:2410] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:17:29.383342 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:17:29.396517 11418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:29.409327 11519 raft_consensus.cc:2368] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 7. Current term is 8.
I20260709 12:17:29.409157 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9fe9a94294836aec652338f44367d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:29.409165 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:29.414646 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:29.416157 11521 raft_consensus.cc:3060] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:29.414141 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 255468us
I20260709 12:17:29.428593 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:29.423703 12203 leader_election.cc:304] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:29.427057 11419 leader_election.cc:304] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:29.397115 13895 raft_consensus.cc:2749] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:29.361642 13931 raft_consensus.cc:515] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:29.438445 11526 raft_consensus.cc:2468] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 7.
I20260709 12:17:29.384565 13627 raft_consensus.cc:515] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:29.439435 13680 consensus_queue.cc:1059] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:17:29.439101 13991 consensus_queue.cc:1048] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 12:17:29.446110 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
W20260709 12:17:29.446784 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 201277us
I20260709 12:17:29.476315 11454 raft_consensus.cc:2468] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 6.
I20260709 12:17:29.447510 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:29.468779 11448 raft_consensus.cc:1240] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:29.449453 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:29.493855 11528 raft_consensus.cc:3060] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:29.483511 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 94855.8us
I20260709 12:17:29.499182 11491 leader_election.cc:304] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:29.500815 13947 raft_consensus.cc:515] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:29.445334 11521 raft_consensus.cc:2468] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 7.
W20260709 12:17:29.466068 13580 consensus_meta.cc:287] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8: Time spent flushing consensus metadata: real 0.527s	user 0.005s	sys 0.005s
I20260709 12:17:29.507170 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8741606df54c3f8b5cc5c1141862ea" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:29.445545 13911 raft_consensus.cc:2804] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:29.454399 14056 leader_election.cc:290] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:29.448158 13862 raft_consensus.cc:515] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:29.458554 13966 raft_consensus.cc:515] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:29.522957 13862 leader_election.cc:290] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:29.460769 13745 raft_consensus.cc:515] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:29.458961 13931 leader_election.cc:290] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:29.455760 13957 leader_election.cc:290] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:29.523373 13966 leader_election.cc:290] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:29.492990 13973 raft_consensus.cc:493] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:29.449833 14008 consensus_queue.cc:237] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:29.524093 13973 raft_consensus.cc:515] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:29.526401 13745 leader_election.cc:290] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:29.527292 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:29.479734 14049 raft_consensus.cc:3055] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:29.450932 14043 leader_election.cc:290] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:29.478751 13991 raft_consensus.cc:2749] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:29.507647 11491 leader_election.cc:304] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:29.460093 14026 leader_election.cc:290] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:29.516953 13911 raft_consensus.cc:493] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:29.520525 13627 leader_election.cc:290] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
W20260709 12:17:29.529170 11417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:29.529553 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 94820.6us
W20260709 12:17:29.512143 11566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:29.532359 11528 raft_consensus.cc:2468] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 8.
I20260709 12:17:29.538878 11523 raft_consensus.cc:1240] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:29.453787 14054 leader_election.cc:290] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:29.541992 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:29.575088 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
W20260709 12:17:29.529577 12205 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:29.546891 11525 raft_consensus.cc:2393] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 6: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:17:29.548933 13947 leader_election.cc:290] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:29.486986 13811 consensus_queue.cc:1048] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:17:29.540722 14049 raft_consensus.cc:740] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
W20260709 12:17:29.564229 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 56676.5us
I20260709 12:17:29.596375 11491 leader_election.cc:304] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:29.568094 13823 consensus_queue.cc:1059] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:17:29.598135 13823 raft_consensus.cc:3055] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:29.598549 13823 raft_consensus.cc:740] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:29.599386 13823 consensus_queue.cc:260] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:29.571113 12203 leader_election.cc:304] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:29.601326 12203 leader_election.cc:304] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:29.602564 12203 leader_election.cc:304] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:29.579344 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:29.585994 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:29.602909 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:29.603466 12349 raft_consensus.cc:3060] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:29.587141 11493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:29.568666 13911 raft_consensus.cc:3060] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:29.590096 11566 leader_election.cc:304] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:29.593663 11519 raft_consensus.cc:1240] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:29.613534 11528 raft_consensus.cc:1275] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:17:29.613936 11528 pending_rounds.cc:85] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671: Aborting all ops after (but not including) 3
I20260709 12:17:29.614159 11528 pending_rounds.cc:107] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:17:29.614377 11528 raft_consensus.cc:2889] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:29.508627 14066 consensus_queue.cc:1059] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 12:17:29.568380 14043 raft_consensus.cc:2749] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:29.604805 11491 leader_election.cc:304] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:29.587548 13991 raft_consensus.cc:493] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:29.586548 14001 raft_consensus.cc:3055] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:29.558795 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:29.605888 12361 raft_consensus.cc:2393] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 9: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:17:29.607556 12203 leader_election.cc:304] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:29.604699 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:29.527401 13580 raft_consensus.cc:515] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:29.645730 11491 leader_election.cc:304] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:29.615072 11566 leader_election.cc:304] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:29.637297 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:29.612620 14062 raft_consensus.cc:2749] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:29.650230 12203 leader_election.cc:304] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:29.653553 11491 leader_election.cc:304] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:29.612401 13627 raft_consensus.cc:2749] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:17:29.661550 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 46555.8us
I20260709 12:17:29.612959 13931 raft_consensus.cc:2804] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:29.627494 14006 raft_consensus.cc:2749] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:29.662364 11566 leader_election.cc:304] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d
I20260709 12:17:29.633603 13966 raft_consensus.cc:493] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:29.663524 11528 raft_consensus.cc:1240] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:29.663187 13966 raft_consensus.cc:515] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:29.664903 11528 raft_consensus.cc:1275] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:17:29.658955 11520 raft_consensus.cc:2468] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 8.
I20260709 12:17:29.658586 13995 raft_consensus.cc:2804] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:29.662624 14006 raft_consensus.cc:2749] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:29.659641 11491 leader_election.cc:304] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:29.627890 13806 leader_election.cc:290] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:29.628415 14065 raft_consensus.cc:2749] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:17:29.660072 12204 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:29.644227 13862 raft_consensus.cc:2749] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:17:29.662022 11419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:29.670348 11528 raft_consensus.cc:1240] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:29.688956 11491 leader_election.cc:304] T da8741606df54c3f8b5cc5c1141862ea P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:29.690361 11528 raft_consensus.cc:1240] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:17:29.675876 12349 raft_consensus.cc:2468] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 8.
I20260709 12:17:29.667410 11566 leader_election.cc:304] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d
I20260709 12:17:29.600955 14026 consensus_queue.cc:1048] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 12:17:29.710590 11418 leader_election.cc:304] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:29.711997 11418 leader_election.cc:304] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:29.642436 14001 raft_consensus.cc:740] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:29.691856 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffe47647c274723808482c166efa21c" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:29.693544 11493 leader_election.cc:304] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:29.716456 11491 leader_election.cc:304] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:29.720713 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:29.724422 11418 leader_election.cc:304] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:29.727540 11418 leader_election.cc:304] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:29.732285 11418 leader_election.cc:304] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:29.639520 13947 consensus_queue.cc:1059] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 12:17:29.744894 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:29.746011 11418 leader_election.cc:400] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Vote denied by peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063) with higher term. Message: Invalid argument: T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 7. Current term is 8.
I20260709 12:17:29.746620 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:29.747349 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
W20260709 12:17:29.748488 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 81134us
I20260709 12:17:29.665427 13756 raft_consensus.cc:2804] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:29.745707 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390e91331fd04f97a5235133a34875ee" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:29.777766 11418 leader_election.cc:403] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:29.778049 11448 raft_consensus.cc:1275] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:29.780836 11445 raft_consensus.cc:3060] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:29.774667 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9fe9a94294836aec652338f44367d" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:29.781529 11453 raft_consensus.cc:3060] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:29.665807 13995 raft_consensus.cc:493] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:29.665369 13966 leader_election.cc:290] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:29.648277 13991 raft_consensus.cc:515] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:29.652554 14056 consensus_queue.cc:1048] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.086s
I20260709 12:17:29.687124 13931 raft_consensus.cc:697] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:29.751636 11491 leader_election.cc:304] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:29.738148 13948 raft_consensus.cc:2749] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:29.805347 11566 leader_election.cc:304] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:29.727039 13979 raft_consensus.cc:2804] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:29.726934 13698 raft_consensus.cc:2749] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:29.723991 14050 raft_consensus.cc:2749] T da8741606df54c3f8b5cc5c1141862ea P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:29.776069 13910 raft_consensus.cc:2749] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:29.833668 11566 leader_election.cc:304] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:29.841997 11522 raft_consensus.cc:1240] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [term 9 LEADER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 12:17:29.818624 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 67092.5us
I20260709 12:17:29.844116 12848 raft_consensus.cc:2749] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:17:29.825266 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 79378.7us
I20260709 12:17:29.723871 14061 raft_consensus.cc:2749] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:29.783659 13756 raft_consensus.cc:493] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:29.744849 14068 raft_consensus.cc:2749] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:29.831876 13947 raft_consensus.cc:2749] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:29.727396 13721 raft_consensus.cc:2804] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:29.834532 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
W20260709 12:17:29.815177 14059 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.012s	sys 0.017s
I20260709 12:17:29.854825 11418 leader_election.cc:304] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:29.841701 12352 raft_consensus.cc:2468] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 10.
I20260709 12:17:29.782683 13509 raft_consensus.cc:2804] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:29.730433 14070 raft_consensus.cc:2749] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:29.816484 13995 raft_consensus.cc:3060] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:29.866155 12848 raft_consensus.cc:493] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:29.874601 12848 raft_consensus.cc:515] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
W20260709 12:17:29.875160 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 453251us
W20260709 12:17:29.862809 13983 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.024s	sys 0.016s
I20260709 12:17:29.871376 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7937e0cff84ef7a26c84247c8ffc08" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:29.814988 14075 raft_consensus.cc:2749] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:29.870939 11447 raft_consensus.cc:3060] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:29.834398 13862 raft_consensus.cc:2749] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:29.884236 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:30.004194 11521 raft_consensus.cc:3060] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:29.935056 11445 raft_consensus.cc:2468] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 8.
W20260709 12:17:30.006270 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 151527us
I20260709 12:17:29.869218 13939 raft_consensus.cc:2804] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:17:30.007881 11418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:30.008267 13939 raft_consensus.cc:493] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting leader election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:30.008710 13939 raft_consensus.cc:3060] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:30.009217 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 129172us
I20260709 12:17:30.009636 13991 leader_election.cc:290] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:30.010838 13966 consensus_queue.cc:1059] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:30.011804 13966 consensus_queue.cc:1059] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:30.012537 13966 raft_consensus.cc:493] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:30.015255 14075 raft_consensus.cc:3055] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:30.015434 13910 raft_consensus.cc:493] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:30.015750 14075 raft_consensus.cc:740] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:30.016047 13698 raft_consensus.cc:493] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:30.016712 14019 raft_consensus.cc:493] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:30.016562 13698 raft_consensus.cc:515] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:30.013101 13966 raft_consensus.cc:515] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:30.017269 14019 raft_consensus.cc:515] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:30.018814 13698 leader_election.cc:290] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:29.862798 13979 raft_consensus.cc:697] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 8 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:30.019476 14019 leader_election.cc:290] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:30.016077 13910 raft_consensus.cc:515] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:30.020046 13979 consensus_queue.cc:237] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:30.020066 14019 raft_consensus.cc:493] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:30.020943 13966 leader_election.cc:290] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:30.021270 14019 raft_consensus.cc:515] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:30.022161 13910 leader_election.cc:290] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:29.867488 13756 raft_consensus.cc:3060] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:29.873534 14059 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.014s	sys 0.017s
I20260709 12:17:29.862939 14042 raft_consensus.cc:493] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
W20260709 12:17:30.024364 11524 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.022s	sys 0.026s
W20260709 12:17:30.024747 11524 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.022s	sys 0.026s
I20260709 12:17:29.870537 13866 raft_consensus.cc:3055] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:17:30.029400 11449 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.028s	sys 0.024s
W20260709 12:17:30.031899 11449 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.029s	sys 0.024s
I20260709 12:17:29.875383 13721 raft_consensus.cc:493] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1c101e338f954ef086338e251deed19d)
W20260709 12:17:29.885674 13983 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.024s	sys 0.016s
I20260709 12:17:29.879464 13509 raft_consensus.cc:493] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:30.064577 11453 raft_consensus.cc:2468] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 8.
I20260709 12:17:30.064652 11521 raft_consensus.cc:2410] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:17:29.979616 14026 raft_consensus.cc:493] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:30.030956 14060 log.cc:927] Time spent T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.718s	user 0.001s	sys 0.003s
W20260709 12:17:30.068893 11419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:30.035701 13786 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.024s	sys 0.032s
I20260709 12:17:30.073365 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:30.076143 11521 raft_consensus.cc:3060] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:30.084152 11417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:30.023002 13939 raft_consensus.cc:515] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:30.075891 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:30.088553 11453 raft_consensus.cc:1240] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:30.006925 14071 raft_consensus.cc:2749] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063) with higher term. Message: Invalid argument: T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 7. Current term is 8.
I20260709 12:17:30.050004 14019 leader_election.cc:290] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:30.050479 13866 raft_consensus.cc:740] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:30.056958 13721 raft_consensus.cc:3060] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:30.095572 11445 raft_consensus.cc:1240] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 5. Current term is 6. Ops: []
W20260709 12:17:30.075724 13786 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.750s	user 0.025s	sys 0.032s
I20260709 12:17:30.034835 14064 raft_consensus.cc:2804] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:17:30.085085 13851 consensus_meta.cc:287] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8: Time spent flushing consensus metadata: real 0.810s	user 0.010s	sys 0.001s
I20260709 12:17:30.155652 11447 raft_consensus.cc:2468] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 6.
W20260709 12:17:30.108794 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 427799us
I20260709 12:17:30.156955 12203 leader_election.cc:304] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
W20260709 12:17:30.115890 12205 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:30.100469 14008 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.017s	sys 0.065s
I20260709 12:17:30.116657 11521 raft_consensus.cc:2468] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 7.
I20260709 12:17:30.117261 13580 leader_election.cc:290] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:30.165887 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:30.138682 11453 raft_consensus.cc:1275] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:30.139667 12348 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51698 (request call id 767) took 1364 ms. Trace:
I20260709 12:17:30.036125 14042 raft_consensus.cc:515] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:30.140169 13939 leader_election.cc:290] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:30.146795 11593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55250 (request call id 635) took 2448 ms. Trace:
I20260709 12:17:30.081599 14026 raft_consensus.cc:515] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:30.153944 12357 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51690 (request call id 739) took 1157 ms. Trace:
I20260709 12:17:30.196498 12357 rpcz_store.cc:276] 0709 12:17:28.996692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:28.996864 (+   172us) service_pool.cc:224] Handling call
0709 12:17:29.013839 (+ 16975us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:29.487171 (+473332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:29.487203 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:29.487667 (+   464us) log.cc:844] Serialized 26 byte log entry
0709 12:17:29.837198 (+349531us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:29.837271 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:29.837417 (+   146us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:30.153563 (+316146us) raft_consensus.cc:1685] finished
0709 12:17:30.153583 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:30.153868 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":56478,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":91,"thread_start_us":800002,"threads_started":2,"wal-append.queue_time_us":619023}
I20260709 12:17:30.070358 13509 raft_consensus.cc:3060] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:30.051265 13931 consensus_queue.cc:237] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:30.116604 13957 raft_consensus.cc:2804] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:29.671988 14006 consensus_queue.cc:1059] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.491s
I20260709 12:17:29.807237 14065 consensus_queue.cc:1048] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.367s
W20260709 12:17:30.174496 14008 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.019s	sys 0.065s
I20260709 12:17:29.864321 14001 consensus_queue.cc:260] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:30.016624 14075 consensus_queue.cc:260] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:29.678886 14049 consensus_queue.cc:260] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:30.191448 11593 rpcz_store.cc:276] 0709 12:17:27.698670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:27.698789 (+   119us) service_pool.cc:224] Handling call
0709 12:17:27.722346 (+ 23557us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:28.940303 (+1217957us) spinlock_profiling.cc:243] Waited 5.08 ms on lock 0x7b18004d1580. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e676b4bc 00007f84e3ab948b 00007f84ec9139a9 00007f84e3ad569b 00007f84e3ad393f 00007f84e3ad3455 00007f84e6bbb060 00007f84e6bbbbfb 00007f84e6bc664b
0709 12:17:28.940462 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:28.940487 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:28.961876 (+ 21389us) log.cc:844] Serialized 26 byte log entry
0709 12:17:29.149490 (+187614us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:29.175256 (+ 25766us) log.cc:844] Serialized 14 byte log entry
0709 12:17:29.175521 (+   265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:29.175642 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:29.678348 (+502706us) spinlock_profiling.cc:243] Waited 3.27 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e675e86e 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221 00007f84e67671d9 00007f84e6767169
0709 12:17:30.146502 (+468154us) raft_consensus.cc:1685] finished
0709 12:17:30.146528 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:30.146695 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12544,"prepare.queue_time_us":16343,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":117710,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":16804,"spinlock_wait_cycles":19205888,"thread_start_us":266182,"threads_started":2,"wal-append.queue_time_us":280694}
I20260709 12:17:30.173736 12348 rpcz_store.cc:276] 0709 12:17:28.775708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:28.797546 (+ 21838us) service_pool.cc:224] Handling call
0709 12:17:29.100684 (+303138us) spinlock_profiling.cc:243] Waited 4.69 ms on lock 0x7b5800003f98. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9eb71 00007f84e3a9eeee 000000000036eb39 00007f84ebb121e0 00007f84ebbdb0c4 00007f84ebbdb131 00007f84ebb9cfc0 00007f84ebb87929 00007f84ebb873d2 00007f84e50febd4
0709 12:17:29.100868 (+   184us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:29.101291 (+   423us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:29.101320 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:29.109684 (+  8364us) log.cc:844] Serialized 26 byte log entry
0709 12:17:29.360853 (+251169us) spinlock_profiling.cc:243] Waited 20 ms on lock 0x7b18001fbee0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3ab8e07 00007f84ec9139a9 00007f84e3ad569b 00007f84e3ad393f 00007f84e3ad5c02 00007f84e675d20b 00007f84e6762d23 00007f84e67630d1 00007f84e6b7ea0f
0709 12:17:29.687501 (+326648us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:29.687545 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:29.687615 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:30.139404 (+451789us) raft_consensus.cc:1685] finished
0709 12:17:30.139428 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:30.139598 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":114,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":10845,"spinlock_wait_cycles":56784896,"thread_start_us":326450,"threads_started":1,"wal-append.queue_time_us":954542}
I20260709 12:17:30.162322 13851 raft_consensus.cc:2749] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:30.216068 12361 raft_consensus.cc:1240] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 5. Current term is 6. Ops: []
W20260709 12:17:30.221004 11566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:30.215409 12346 raft_consensus.cc:1275] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:17:30.160327 13966 raft_consensus.cc:493] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
W20260709 12:17:30.234628 13911 consensus_meta.cc:287] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d: Time spent flushing consensus metadata: real 0.596s	user 0.010s	sys 0.000s
I20260709 12:17:30.267985 12203 leader_election.cc:304] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:30.183252 13863 raft_consensus.cc:2749] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:30.183221 14072 raft_consensus.cc:2749] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:30.272984 11602 raft_consensus.cc:606] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Received request to transfer leadership to TS 1c101e338f954ef086338e251deed19d
I20260709 12:17:30.273489 11602 raft_consensus.cc:614] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:30.245205 14017 raft_consensus.cc:493] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:30.234004 14071 raft_consensus.cc:493] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:30.216661 14061 raft_consensus.cc:493] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:30.275274 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 183123us
I20260709 12:17:30.275045 12203 leader_election.cc:304] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:30.207885 13758 raft_consensus.cc:3055] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:30.210219 13862 raft_consensus.cc:493] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:30.213135 13823 raft_consensus.cc:3060] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:30.277225 11594 raft_consensus.cc:1240] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:30.215088 13957 raft_consensus.cc:493] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:30.299798 13957 raft_consensus.cc:3060] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:30.283870 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:30.301222 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9fe9a94294836aec652338f44367d" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:30.286088 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390e91331fd04f97a5235133a34875ee" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:30.267721 13966 raft_consensus.cc:515] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:30.303112 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:30.306738 11600 raft_consensus.cc:2468] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 9.
I20260709 12:17:30.276690 14075 raft_consensus.cc:3060] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:30.276355 13627 raft_consensus.cc:3060] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:30.305408 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:30.305867 11596 raft_consensus.cc:2393] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 10: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:17:30.279593 14001 raft_consensus.cc:3060] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:30.322995 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
W20260709 12:17:30.333734 11494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:30.439320 11420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:30.471061 11418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:30.483887 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 208887us
I20260709 12:17:30.291275 13851 raft_consensus.cc:493] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:30.495251 11519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38272 (request call id 416) took 1147 ms. Trace:
I20260709 12:17:30.293584 13758 raft_consensus.cc:740] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:30.564395 12203 leader_election.cc:400] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Vote denied by peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579) with higher term. Message: Invalid argument: T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de for earlier term 5. Current term is 6.
I20260709 12:17:30.596698 12203 leader_election.cc:403] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:30.564908 11519 rpcz_store.cc:276] 0709 12:17:29.347328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:29.588065 (+240737us) service_pool.cc:224] Handling call
0709 12:17:29.592341 (+  4276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:29.613477 (+ 21136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:30.494997 (+881520us) spinlock_profiling.cc:243] Waited 3.93 ms on lock 0x7b540032e450. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc28ad 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:30.495167 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9044224}
I20260709 12:17:30.274797 13911 raft_consensus.cc:515] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
W20260709 12:17:30.620980 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 136253us
W20260709 12:17:30.623039 11528 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.010s	sys 0.042s
W20260709 12:17:30.268396 13910 consensus_queue.cc:1175] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9da53be18b0f446aaa406216e20b0ec8" responder_term: 7 status { last_received { term: 7 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 7 index: 4 } }
W20260709 12:17:30.627767 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 63500.5us
I20260709 12:17:30.628728 12203 leader_election.cc:304] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:30.290197 14017 raft_consensus.cc:515] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
W20260709 12:17:30.623648 11528 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.010s	sys 0.042s
I20260709 12:17:30.599534 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:30.634868 12203 leader_election.cc:304] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:30.563297 13863 raft_consensus.cc:493] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:30.629699 13786 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.015s	sys 0.016s
I20260709 12:17:30.650095 11453 raft_consensus.cc:1275] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:30.651105 11598 raft_consensus.cc:1240] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:30.494139 14099 raft_consensus.cc:2764] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 12:17:30.300761 13862 raft_consensus.cc:515] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:30.658139 11454 raft_consensus.cc:1240] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:30.663882 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:30.664785 11519 raft_consensus.cc:2468] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 8.
W20260709 12:17:30.665112 11567 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.785s	user 0.020s	sys 0.053s
W20260709 12:17:30.665791 11568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:30.293644 14071 raft_consensus.cc:515] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:30.295989 14061 raft_consensus.cc:515] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:30.296875 13756 raft_consensus.cc:515] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:30.674580 11520 raft_consensus.cc:1240] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:30.674479 11527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33446 (request call id 1242) took 1670 ms. Trace:
W20260709 12:17:30.680073 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 45335.8us
I20260709 12:17:30.675290 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:30.644170 14065 raft_consensus.cc:2749] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579) with higher term. Message: Invalid argument: T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de for earlier term 5. Current term is 6.
I20260709 12:17:30.688417 12204 leader_election.cc:304] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:30.680483 11527 rpcz_store.cc:276] 0709 12:17:29.004411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:29.004585 (+   174us) service_pool.cc:224] Handling call
0709 12:17:29.021444 (+ 16859us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:29.237213 (+215769us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:17:29.589502 (+352289us) log.cc:844] Serialized 14 byte log entry
0709 12:17:29.833470 (+243968us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:29.836279 (+  2809us) log.cc:844] Serialized 26 byte log entry
0709 12:17:29.844107 (+  7828us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:29.844143 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:29.844210 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:30.674167 (+829957us) raft_consensus.cc:1685] finished
0709 12:17:30.674193 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:30.674414 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35738,"prepare.queue_time_us":577913,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":214156,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":29357,"spinlock_wait_cycles":6800768,"thread_start_us":750932,"threads_started":3,"wal-append.queue_time_us":627206}
I20260709 12:17:30.652806 14100 raft_consensus.cc:2804] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:30.617457 13851 raft_consensus.cc:515] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:30.692606 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:30.700454 11453 raft_consensus.cc:2393] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 9: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:30.703389 14061 leader_election.cc:290] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:30.704315 14061 raft_consensus.cc:493] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:30.697129 13758 consensus_queue.cc:260] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:30.706959 13758 raft_consensus.cc:3060] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:30.710052 13721 consensus_meta.cc:287] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671: Time spent flushing consensus metadata: real 0.586s	user 0.007s	sys 0.002s
I20260709 12:17:30.710554 13721 raft_consensus.cc:515] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:30.711365 14071 leader_election.cc:290] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:30.712613 13721 leader_election.cc:290] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
W20260709 12:17:30.714004 13995 consensus_meta.cc:287] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671: Time spent flushing consensus metadata: real 0.710s	user 0.007s	sys 0.003s
I20260709 12:17:30.714147 13756 leader_election.cc:290] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:30.714818 11595 raft_consensus.cc:1240] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 7. Current term is 8. Ops: []
W20260709 12:17:30.657986 13786 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.016s	sys 0.017s
I20260709 12:17:30.714474 13995 raft_consensus.cc:515] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
W20260709 12:17:30.715675 14090 log.cc:927] Time spent T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 12:17:30.716964 14017 leader_election.cc:290] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:30.717244 13995 leader_election.cc:290] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:30.684942 13939 raft_consensus.cc:2804] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:30.717940 13995 raft_consensus.cc:493] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:30.661806 13863 raft_consensus.cc:515] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:30.720575 13863 leader_election.cc:290] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:30.721623 14100 raft_consensus.cc:697] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 8 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:30.720918 12848 leader_election.cc:290] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:30.724817 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:30.625846 14098 consensus_queue.cc:1059] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 12:17:30.721004 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:30.704809 14061 raft_consensus.cc:515] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:30.718448 13995 raft_consensus.cc:515] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:30.730894 13851 leader_election.cc:290] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:30.731594 13995 leader_election.cc:290] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:30.732589 13786 raft_consensus.cc:3055] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:30.732990 13786 raft_consensus.cc:740] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:30.689991 13991 raft_consensus.cc:493] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:30.733906 13786 consensus_queue.cc:260] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:30.735061 13786 raft_consensus.cc:3060] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:30.735993 13911 leader_election.cc:290] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:30.684471 14056 raft_consensus.cc:493] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:30.735065 13966 leader_election.cc:290] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:30.722548 14100 consensus_queue.cc:237] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
W20260709 12:17:30.741392 14092 log.cc:927] Time spent T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.464s	user 0.001s	sys 0.000s
I20260709 12:17:30.682512 14059 raft_consensus.cc:493] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:30.758247 14059 raft_consensus.cc:515] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:30.758886 11602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:37992 (request call id 33) took 1618 ms. Trace:
I20260709 12:17:30.759418 11602 rpcz_store.cc:276] 0709 12:17:29.149316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:29.149473 (+   157us) service_pool.cc:224] Handling call
0709 12:17:30.758631 (+1609158us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54004fa6d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bbd853 00007f84ebb8b60a 00007f84e51117d4 00007f84e5111762 00007f84e5111691 00007f84e511160c 00007f84e51108c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:30.758783 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2376212224}
I20260709 12:17:30.681972 14087 raft_consensus.cc:493] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:30.760612 13580 raft_consensus.cc:3055] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:30.761188 14087 raft_consensus.cc:515] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:30.763616 14087 leader_election.cc:290] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:30.765600 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:30.765345 13866 consensus_queue.cc:260] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:30.766268 11527 raft_consensus.cc:2468] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 9.
I20260709 12:17:30.766350 11602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "1c101e338f954ef086338e251deed19d"
 from {username='slave'} at 127.0.0.1:37992
I20260709 12:17:30.767028 11602 raft_consensus.cc:606] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Received request to transfer leadership to TS 1c101e338f954ef086338e251deed19d
I20260709 12:17:30.767215 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:30.767452 11602 raft_consensus.cc:614] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:30.725639 14099 raft_consensus.cc:2749] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:30.768381 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:30.770609 11602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "390e91331fd04f97a5235133a34875ee"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "a03223e9e41247c3a36b7b7c3d476671"
 from {username='slave'} at 127.0.0.1:37992
I20260709 12:17:30.771353 11602 raft_consensus.cc:606] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Received request to transfer leadership to TS a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:30.771785 11602 raft_consensus.cc:614] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:30.733858 13991 raft_consensus.cc:515] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:30.774317 11454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58868 (request call id 1298) took 1084 ms. Trace:
I20260709 12:17:30.774492 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:30.774744 11454 rpcz_store.cc:276] 0709 12:17:29.689540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:29.689705 (+   165us) service_pool.cc:224] Handling call
0709 12:17:29.732516 (+ 42811us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:30.659383 (+926867us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:30.774002 (+114619us) spinlock_profiling.cc:243] Waited 925 ms on lock 0x7b5400612454. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:17:30.774256 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2128181632}
I20260709 12:17:30.775849 13991 leader_election.cc:290] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:30.777060 11602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "1c101e338f954ef086338e251deed19d"
 from {username='slave'} at 127.0.0.1:37992
I20260709 12:17:30.777801 11602 raft_consensus.cc:606] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Received request to transfer leadership to TS 1c101e338f954ef086338e251deed19d
I20260709 12:17:30.778235 11602 raft_consensus.cc:614] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:30.779294 14026 leader_election.cc:290] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:30.781760 11528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33456 (request call id 1063) took 1417 ms. Trace:
W20260709 12:17:30.668411 11567 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.789s	user 0.021s	sys 0.053s
I20260709 12:17:30.713227 13721 raft_consensus.cc:493] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:30.748140 11519 raft_consensus.cc:2468] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 5.
I20260709 12:17:30.690270 14074 raft_consensus.cc:493] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:30.754153 14056 raft_consensus.cc:515] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:30.794569 14074 raft_consensus.cc:515] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:30.796617 14074 leader_election.cc:290] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
W20260709 12:17:30.773186 13509 consensus_meta.cc:287] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8: Time spent flushing consensus metadata: real 0.509s	user 0.006s	sys 0.000s
I20260709 12:17:30.797336 13509 raft_consensus.cc:515] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:30.799518 13509 leader_election.cc:290] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:17:30.800073 14096 log.cc:927] Time spent T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 12:17:30.800999 11520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33456 (request call id 1055) took 1438 ms. Trace:
I20260709 12:17:30.801436 11520 rpcz_store.cc:276] 0709 12:17:29.362457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:29.666052 (+303595us) service_pool.cc:224] Handling call
0709 12:17:30.674402 (+1008350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:30.681431 (+  7029us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:30.800802 (+119371us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54001379d0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc28ad 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:30.800938 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2318108416}
I20260709 12:17:30.761106 13862 leader_election.cc:290] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:30.805295 13973 leader_election.cc:290] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:30.806263 11521 raft_consensus.cc:1275] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:17:30.755093 13627 raft_consensus.cc:2749] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:30.796623 14056 leader_election.cc:290] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:30.784591 11527 raft_consensus.cc:2468] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 6.
I20260709 12:17:30.756937 12203 leader_election.cc:304] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
W20260709 12:17:30.820937 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 64098.5us
I20260709 12:17:30.782192 11528 rpcz_store.cc:276] 0709 12:17:29.364255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:29.691564 (+327309us) service_pool.cc:224] Handling call
0709 12:17:29.691830 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:29.692044 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:17:30.116287 (+424243us) log.cc:844] Serialized 14 byte log entry
0709 12:17:30.780724 (+664437us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:30.781401 (+   677us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:30.781464 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:30.781542 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:30.781692 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":316122,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":59359,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":95,"thread_start_us":1036668,"threads_started":3,"wal-append.queue_time_us":641198}
I20260709 12:17:30.822458 11528 raft_consensus.cc:1240] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:30.808051 11521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33456 (request call id 1064) took 1426 ms. Trace:
I20260709 12:17:30.766497 13866 raft_consensus.cc:3060] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:30.794660 11519 raft_consensus.cc:1240] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:30.840134 11519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33456 (request call id 1065) took 1452 ms. Trace:
I20260709 12:17:30.823047 11521 rpcz_store.cc:276] 0709 12:17:29.381222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:30.188558 (+807336us) service_pool.cc:224] Handling call
0709 12:17:30.189578 (+  1020us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:30.806687 (+617109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:30.807806 (+  1119us) spinlock_profiling.cc:243] Waited 616 ms on lock 0x7b5400672854. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:17:30.807992 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1417342336}
W20260709 12:17:30.783792 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 903939us
W20260709 12:17:30.841531 13957 consensus_meta.cc:287] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671: Time spent flushing consensus metadata: real 0.541s	user 0.010s	sys 0.000s
I20260709 12:17:30.813550 13721 raft_consensus.cc:515] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:30.842027 11521 raft_consensus.cc:1240] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:30.841964 13957 raft_consensus.cc:515] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:30.842535 14058 raft_consensus.cc:3060] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:30.842988 11521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33456 (request call id 1068) took 1454 ms. Trace:
I20260709 12:17:30.843655 13721 leader_election.cc:290] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:30.825163 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:30.847474 11453 raft_consensus.cc:2468] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 3.
I20260709 12:17:30.760632 14059 leader_election.cc:290] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:30.836230 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:30.848874 11493 leader_election.cc:304] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:30.849186 11527 raft_consensus.cc:3060] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:30.849809 11418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:30.844667 11454 raft_consensus.cc:1240] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:17:30.840564 11519 rpcz_store.cc:276] 0709 12:17:29.387390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:30.794113 (+1406723us) service_pool.cc:224] Handling call
0709 12:17:30.794489 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:30.839848 (+ 45359us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:30.840072 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:30.844201 11525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38272 (request call id 418) took 1496 ms. Trace:
I20260709 12:17:30.761111 13580 raft_consensus.cc:740] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:30.856057 11522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33446 (request call id 1243) took 1851 ms. Trace:
I20260709 12:17:30.856544 11522 rpcz_store.cc:276] 0709 12:17:29.004733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:29.004860 (+   127us) service_pool.cc:224] Handling call
0709 12:17:29.005223 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:29.842438 (+837215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:30.855759 (+1013321us) spinlock_profiling.cc:243] Waited 831 ms on lock 0x7b540066e9d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:17:30.855986 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1912292608}
I20260709 12:17:30.823848 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:30.824381 12203 leader_election.cc:304] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:30.843366 11521 rpcz_store.cc:276] 0709 12:17:29.388163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:30.841528 (+1453365us) service_pool.cc:224] Handling call
0709 12:17:30.841856 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:30.842679 (+   823us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:30.842905 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:30.845851 11596 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "b126028166e8480ba25541bf8f7fc6de"
 from {username='slave'} at 127.0.0.1:37992
I20260709 12:17:30.859272 11596 raft_consensus.cc:606] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 6 LEADER]: Received request to transfer leadership to TS b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:30.844259 11528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33456 (request call id 1067) took 1456 ms. Trace:
I20260709 12:17:30.860149 11528 rpcz_store.cc:276] 0709 12:17:29.387926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:30.821935 (+1434009us) service_pool.cc:224] Handling call
0709 12:17:30.822264 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:30.844047 (+ 21783us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:30.844195 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:17:30.861454 12205 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:30.863200 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:30.864662 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:30.862874 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:17:30.861564 11566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:30.851034 13939 raft_consensus.cc:697] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 9 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:30.875911 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:30.876930 11521 raft_consensus.cc:1240] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:17:30.883728 11451 raft_consensus.cc:2468] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 8.
W20260709 12:17:30.880885 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 56574.6us
I20260709 12:17:30.851387 11525 rpcz_store.cc:276] 0709 12:17:29.347855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:29.589337 (+241482us) service_pool.cc:224] Handling call
0709 12:17:29.589671 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:29.590321 (+   650us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:29.590354 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:29.590830 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 12:17:30.110441 (+519611us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:30.110490 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:30.110571 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:30.799438 (+688867us) spinlock_profiling.cc:243] Waited 41.4 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e675e86e 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221 00007f84e67671d9 00007f84e6767169
0709 12:17:30.810410 (+ 10972us) raft_consensus.cc:1685] finished
0709 12:17:30.810432 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:30.844143 (+ 33711us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":223,"raft.queue_time_us":341,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":9106,"spinlock_wait_cycles":95223168,"thread_start_us":466059,"threads_started":1,"wal-append.queue_time_us":950969}
I20260709 12:17:30.840623 14074 raft_consensus.cc:2804] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:30.885510 12203 leader_election.cc:304] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
W20260709 12:17:30.886351 11567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:30.887465 11528 raft_consensus.cc:1240] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:30.893297 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:30.894230 11595 raft_consensus.cc:2468] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 6.
W20260709 12:17:30.894155 11493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 45406.6us
I20260709 12:17:30.852170 13995 raft_consensus.cc:493] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:30.897442 11595 raft_consensus.cc:1240] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 8 LEADER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:30.891731 14098 raft_consensus.cc:3060] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:30.900472 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:30.902275 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:30.902940 11593 raft_consensus.cc:2468] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 9.
I20260709 12:17:30.903887 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:30.904538 11598 raft_consensus.cc:2468] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 10.
I20260709 12:17:30.900467 13580 consensus_queue.cc:260] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:30.899930 14043 raft_consensus.cc:2804] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:30.907246 14043 raft_consensus.cc:493] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:30.907613 14043 raft_consensus.cc:3060] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:30.910144 14098 raft_consensus.cc:2749] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:30.911762 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:30.863015 13957 leader_election.cc:290] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 7 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:30.914670 11602 raft_consensus.cc:2468] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 6.
I20260709 12:17:30.919309 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:30.919761 14064 raft_consensus.cc:493] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:30.920360 14064 raft_consensus.cc:3060] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:30.917649 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:17:30.931978 11417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:30.932794 13910 raft_consensus.cc:493] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:30.933264 14075 raft_consensus.cc:493] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:30.936053 12203 leader_election.cc:304] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:30.877475 14062 consensus_queue.cc:1059] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:17:30.937019 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:30.938035 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:30.896178 13627 raft_consensus.cc:2804] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:30.950824 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:30.940526 12203 leader_election.cc:304] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:30.945550 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:30.952266 11453 raft_consensus.cc:3060] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:30.882110 14054 consensus_queue.cc:1048] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:17:30.958179 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:30.875975 14001 consensus_queue.cc:1048] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:17:30.896672 14026 raft_consensus.cc:493] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:30.942803 11565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:30.895990 13983 raft_consensus.cc:493] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:30.953751 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:30.959738 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:30.953204 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:30.956576 12203 leader_election.cc:304] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:30.933616 14074 raft_consensus.cc:697] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 8 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:30.962942 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:30.968350 12203 leader_election.cc:304] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:30.946975 14122 raft_consensus.cc:2804] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:30.918186 13995 raft_consensus.cc:515] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:30.954661 13627 raft_consensus.cc:493] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:30.982189 11595 raft_consensus.cc:2393] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 7: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:17:30.985464 12203 leader_election.cc:304] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:30.967486 14059 raft_consensus.cc:2804] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:30.992993 11453 raft_consensus.cc:2468] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 7.
I20260709 12:17:31.002055 14099 raft_consensus.cc:493] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:31.002707 14099 raft_consensus.cc:515] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:31.003605 11565 leader_election.cc:304] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
W20260709 12:17:31.004515 11627 heartbeater.cc:646] Failed to heartbeat to 127.3.212.190:40671 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.3.212.190:40671 timed out after 15.000s (SENT)
I20260709 12:17:31.005002 14099 leader_election.cc:290] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:31.005563 13851 consensus_queue.cc:1048] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:31.007872 13851 raft_consensus.cc:2804] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:31.008646 13851 raft_consensus.cc:697] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:31.008795 13786 consensus_queue.cc:1059] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:31.011195 13786 raft_consensus.cc:3055] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:31.011646 13786 raft_consensus.cc:740] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:31.012586 13786 consensus_queue.cc:260] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:30.948578 13911 consensus_queue.cc:1059] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:17:30.964033 14098 raft_consensus.cc:2749] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:30.969734 14026 raft_consensus.cc:515] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:31.020459 14026 leader_election.cc:290] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:30.991592 14122 raft_consensus.cc:493] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:31.021467 13939 consensus_queue.cc:237] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:31.022943 14061 leader_election.cc:290] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:31.028852 14074 consensus_queue.cc:237] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:31.029597 13991 raft_consensus.cc:2804] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:31.030148 13991 raft_consensus.cc:493] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:31.030514 13991 raft_consensus.cc:3060] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:30.991744 13931 raft_consensus.cc:2804] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:31.031467 13931 raft_consensus.cc:493] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:31.031857 13931 raft_consensus.cc:3060] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:30.974938 13983 raft_consensus.cc:515] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:31.035725 13983 leader_election.cc:290] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:31.036149 13995 leader_election.cc:290] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:30.977679 13509 raft_consensus.cc:493] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:31.037674 13509 raft_consensus.cc:515] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:31.040019 13509 leader_election.cc:290] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:31.044230 14042 leader_election.cc:290] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:30.945765 13910 raft_consensus.cc:515] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:31.046096 13911 raft_consensus.cc:3055] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:31.046608 13911 raft_consensus.cc:740] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:31.046761 13910 leader_election.cc:290] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:30.947438 14075 raft_consensus.cc:515] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:31.048957 14075 leader_election.cc:290] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:31.049882 14059 raft_consensus.cc:493] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:31.050359 14059 raft_consensus.cc:3060] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:31.050544 14111 raft_consensus.cc:493] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:31.051182 14111 raft_consensus.cc:515] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:30.998282 14120 consensus_queue.cc:1059] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 12:17:31.054160 14120 consensus_queue.cc:1243] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer 9da53be18b0f446aaa406216e20b0ec8 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:17:30.999867 13966 raft_consensus.cc:493] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:31.054591 13911 consensus_queue.cc:260] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:31.021525 14122 raft_consensus.cc:3060] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:31.056205 11448 raft_consensus.cc:2468] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 6.
I20260709 12:17:31.056710 13580 raft_consensus.cc:3060] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:31.062492 12203 leader_election.cc:304] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:31.063879 14065 consensus_queue.cc:1059] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:31.064762 14065 raft_consensus.cc:2749] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:31.065006 14098 raft_consensus.cc:3055] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:31.065536 14098 raft_consensus.cc:740] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:31.066450 14098 consensus_queue.cc:260] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:31.067759 14098 raft_consensus.cc:3060] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:31.069020 13957 raft_consensus.cc:3055] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:31.071157 14071 raft_consensus.cc:493] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:31.055490 13966 raft_consensus.cc:515] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:31.072333 13948 raft_consensus.cc:493] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:31.074491  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:17:31.075596 11526 raft_consensus.cc:2468] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 6.
W20260709 12:17:31.076933 11418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:31.055752 11597 raft_consensus.cc:2468] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 8.
I20260709 12:17:31.081806 11527 raft_consensus.cc:2468] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 7.
I20260709 12:17:31.066047 12203 leader_election.cc:304] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
W20260709 12:17:31.153327 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 87351.4us
W20260709 12:17:31.155573 12203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:31.084940 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:31.156410 12356 raft_consensus.cc:3060] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:31.077584 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 72195.9us
I20260709 12:17:31.094720 11491 leader_election.cc:304] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:31.097251 11594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 857) took 1095 ms. Trace:
W20260709 12:17:31.104151 11568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:31.124306 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:31.122555 13786 raft_consensus.cc:3060] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:31.123569 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:31.122877 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:31.076548 13911 raft_consensus.cc:3060] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:31.123637 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffe47647c274723808482c166efa21c" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:31.124794 13984 consensus_queue.cc:1059] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 12:17:31.124171 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:31.123152 12349 raft_consensus.cc:1275] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:31.000931 13627 raft_consensus.cc:3060] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:31.189452 11452 raft_consensus.cc:1240] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:17:31.191771 13966 leader_election.cc:290] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:31.197355 12356 raft_consensus.cc:2468] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 7.
W20260709 12:17:31.203375 12204 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.007s	sys 0.064s
W20260709 12:17:31.204057 12204 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.007s	sys 0.064s
I20260709 12:17:31.092991 11566 leader_election.cc:304] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:31.139808 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:30.973281 14043 raft_consensus.cc:515] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:31.144083 14111 leader_election.cc:290] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:31.106117 13957 raft_consensus.cc:740] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:31.145340 13851 consensus_queue.cc:237] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:31.126322 13910 raft_consensus.cc:493] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:31.150028 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:17:31.178876 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 84204.3us
I20260709 12:17:31.256024 11491 leader_election.cc:304] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:31.165560 11594 rpcz_store.cc:276] 0709 12:17:30.001846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:30.002056 (+   210us) service_pool.cc:224] Handling call
0709 12:17:30.002515 (+   459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:30.298479 (+295964us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:31.096650 (+798171us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b54004fa6d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:17:31.097157 (+   507us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":623838464}
W20260709 12:17:31.180727 11568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:31.140489 14075 raft_consensus.cc:493] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:31.204420 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 504218us
I20260709 12:17:31.264178 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:31.118425 14071 raft_consensus.cc:515] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:31.240746 12348 raft_consensus.cc:3055] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:31.268518 12348 raft_consensus.cc:740] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:31.266933 12204 leader_election.cc:304] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:31.247004 14070 consensus_queue.cc:1059] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:31.251073 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:17:31.252398 11526 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38272 (request call id 426) took 1829 ms (client timeout 1872 ms). Trace:
W20260709 12:17:31.273222 11526 rpcz_store.cc:269] 0709 12:17:29.423509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:29.440517 (+ 17008us) service_pool.cc:224] Handling call
0709 12:17:31.252188 (+1811671us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b54006fead4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:31.252322 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3632586496}
I20260709 12:17:31.281517 13910 raft_consensus.cc:515] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:31.180250 14099 raft_consensus.cc:2804] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:31.282131 13939 raft_consensus.cc:2749] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:17:31.282655 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 61529.8us
I20260709 12:17:31.294727  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:31.298702  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:31.307440 12348 consensus_queue.cc:260] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
W20260709 12:17:31.313674 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 220734us
I20260709 12:17:31.181437 13948 raft_consensus.cc:515] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:31.285830 14111 raft_consensus.cc:2804] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:31.255244 13509 consensus_queue.cc:1048] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 12:17:31.292167 14099 raft_consensus.cc:493] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:31.288923 14066 raft_consensus.cc:493] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:31.334137 14066 raft_consensus.cc:515] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:31.305560 13862 raft_consensus.cc:493] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:31.330397 14074 consensus_queue.cc:1048] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 12:17:31.326310 13939 consensus_queue.cc:1059] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:17:31.343372 11566 leader_election.cc:304] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:31.288527 14075 raft_consensus.cc:515] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:31.349309 11565 leader_election.cc:304] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:31.332069 14077 raft_consensus.cc:2804] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:31.352993 11567 leader_election.cc:304] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:31.332403 14099 raft_consensus.cc:3060] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:31.359741 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:31.362449 11566 leader_election.cc:304] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:31.321152 14120 consensus_queue.cc:1048] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:17:31.337410 14111 raft_consensus.cc:697] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 6 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:31.314934 11491 leader_election.cc:304] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
W20260709 12:17:31.338801 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 138112us
I20260709 12:17:31.397586 14077 raft_consensus.cc:697] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:31.400923 13948 leader_election.cc:290] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:31.401316 13756 raft_consensus.cc:2804] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:31.401789 13756 raft_consensus.cc:493] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:31.402118 13756 raft_consensus.cc:3060] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:31.403158 14043 leader_election.cc:290] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
W20260709 12:17:31.363546 13979 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.260s	user 0.007s	sys 0.097s
I20260709 12:17:31.342340 13983 consensus_queue.cc:1048] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
W20260709 12:17:31.404150 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 54942.2us
I20260709 12:17:31.437527 11565 leader_election.cc:304] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:17:31.439075 12848 raft_consensus.cc:2804] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:17:31.399451 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 84783.7us
I20260709 12:17:31.440728 11491 leader_election.cc:304] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
W20260709 12:17:31.405390 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 52472.1us
I20260709 12:17:31.356228 13823 raft_consensus.cc:493] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:31.400847 14077 consensus_queue.cc:237] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:31.421980 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:31.353260 13862 raft_consensus.cc:515] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:31.331110 13957 consensus_queue.cc:260] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
W20260709 12:17:31.423040 11492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:31.424137 13680 raft_consensus.cc:2749] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:17:31.426249 13863 raft_consensus.cc:493] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:31.427372 14001 raft_consensus.cc:3055] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:31.402041 13806 raft_consensus.cc:2749] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:31.429487 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:31.430356 13910 leader_election.cc:290] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:31.431392 14075 leader_election.cc:290] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:17:31.455263 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 238584us
I20260709 12:17:31.356415 14107 consensus_queue.cc:1059] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 12:17:31.398856 13939 raft_consensus.cc:3055] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:31.481989 11491 leader_election.cc:304] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:31.486964 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:31.365453 13866 consensus_queue.cc:1048] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 12:17:31.535879 13866 raft_consensus.cc:493] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:31.420698 14097 raft_consensus.cc:2804] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:31.361759 14064 raft_consensus.cc:515] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
W20260709 12:17:31.502605 14129 log.cc:927] Time spent T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.161s	user 0.001s	sys 0.001s
I20260709 12:17:31.489797 14111 consensus_queue.cc:237] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
W20260709 12:17:31.456302 13979 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.365s	user 0.007s	sys 0.101s
I20260709 12:17:31.495546 13756 raft_consensus.cc:515] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:31.420051 14026 raft_consensus.cc:2749] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:31.527271 13957 raft_consensus.cc:3060] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:31.531419 14133 log.cc:927] Time spent T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 12:17:31.532656 14068 raft_consensus.cc:493] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:31.483079 13745 raft_consensus.cc:493] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:31.496649 14043 raft_consensus.cc:2749] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:31.483557 13823 raft_consensus.cc:515] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:31.533888 14107 raft_consensus.cc:493] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:31.527833 13939 raft_consensus.cc:740] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
W20260709 12:17:31.423102 14114 log.cc:927] Time spent T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
W20260709 12:17:31.540843 11417 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:31.552624 13984 raft_consensus.cc:3055] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:31.560997 11524 raft_consensus.cc:2393] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 8: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:17:31.536407 13866 raft_consensus.cc:515] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:31.496663 14001 raft_consensus.cc:740] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
W20260709 12:17:31.546192 11419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:31.499442 13863 raft_consensus.cc:515] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:31.499425 14072 raft_consensus.cc:493] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:31.592254 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:31.592113 14072 raft_consensus.cc:515] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:31.592993 11447 raft_consensus.cc:2468] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 7.
I20260709 12:17:31.532928 13862 leader_election.cc:290] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:31.597339 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:31.597553 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:31.454517 14122 raft_consensus.cc:515] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:31.544773 14097 raft_consensus.cc:493] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:31.572116 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 295532us
W20260709 12:17:31.576363 11494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:31.607692 11494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:31.561412 14068 raft_consensus.cc:515] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:31.570065 13984 raft_consensus.cc:740] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:31.596773 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:31.598227 11452 raft_consensus.cc:2410] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:17:31.599910 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:31.600732 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
W20260709 12:17:31.603817 11568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:31.617264 11568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:31.596079 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:31.612907 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:31.564778 14107 raft_consensus.cc:515] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:31.608548 12204 leader_election.cc:304] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:31.618929 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:31.624330 11447 raft_consensus.cc:2468] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 7.
I20260709 12:17:31.617209 11451 raft_consensus.cc:2468] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 8.
I20260709 12:17:31.620422 11446 raft_consensus.cc:2368] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for earlier term 6. Current term is 7.
I20260709 12:17:31.623900 12204 leader_election.cc:304] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:31.626010 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:31.626605 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:31.627558 11453 raft_consensus.cc:2393] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 6: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:31.627923 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:31.626591 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:31.629276 11565 leader_election.cc:304] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
W20260709 12:17:31.630371 11567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:31.631134 11567 leader_election.cc:304] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:31.560302 13745 raft_consensus.cc:515] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:31.609709 14097 raft_consensus.cc:3060] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:31.638671 11454 raft_consensus.cc:2410] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:17:31.640303 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:17:31.644706 11565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:31.642477 11597 raft_consensus.cc:1240] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:17:31.642285 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:31.645495 11593 raft_consensus.cc:2410] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:17:31.640425 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:31.646008 11599 raft_consensus.cc:2410] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:17:31.611891 14071 leader_election.cc:290] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:31.648283 11596 raft_consensus.cc:2468] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 6.
I20260709 12:17:31.618420 13966 raft_consensus.cc:493] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:31.570278 13939 consensus_queue.cc:260] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:31.662652 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
W20260709 12:17:31.663703 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 272594us
I20260709 12:17:31.633208 14136 raft_consensus.cc:2749] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:31.647497 13947 raft_consensus.cc:2804] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:17:31.677219 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 44608.7us
I20260709 12:17:31.643503 14066 leader_election.cc:290] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:31.660164 13983 raft_consensus.cc:2749] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:31.693787 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:17:31.694133 14130 log.cc:927] Time spent T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
W20260709 12:17:31.699620 13931 consensus_meta.cc:287] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de: Time spent flushing consensus metadata: real 0.667s	user 0.011s	sys 0.000s
I20260709 12:17:31.700129 13931 raft_consensus.cc:515] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:31.701406 12352 raft_consensus.cc:2368] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for earlier term 10. Current term is 11.
W20260709 12:17:31.701924 14143 log.cc:927] Time spent T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:17:31.702281 13745 leader_election.cc:290] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:31.703047 14072 leader_election.cc:290] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
W20260709 12:17:31.706241 14098 consensus_meta.cc:287] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de: Time spent flushing consensus metadata: real 0.638s	user 0.012s	sys 0.001s
I20260709 12:17:31.708109 12346 raft_consensus.cc:1240] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:17:31.707023 14098 raft_consensus.cc:493] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:31.681843 13947 raft_consensus.cc:493] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:31.663720 13966 raft_consensus.cc:515] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:31.735323 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:31.688041 13939 raft_consensus.cc:3060] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:31.776510 12357 raft_consensus.cc:1240] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:31.761281 12848 raft_consensus.cc:697] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:31.771457 11446 raft_consensus.cc:2468] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 6.
W20260709 12:17:31.774669 12359 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.009s	sys 0.037s
W20260709 12:17:31.782214 12359 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.009s	sys 0.038s
I20260709 12:17:31.644872 14001 consensus_queue.cc:260] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:31.808667 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:31.809453 11446 raft_consensus.cc:2468] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 6.
I20260709 12:17:31.711951 13866 leader_election.cc:290] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:31.819785 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:31.751420 13947 raft_consensus.cc:3060] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:31.780949 13983 raft_consensus.cc:493] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:31.815325 12848 consensus_queue.cc:237] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:31.685324 13984 consensus_queue.cc:260] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:31.844332 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
W20260709 12:17:31.836093 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 204264us
I20260709 12:17:31.759496 14098 raft_consensus.cc:515] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:31.825649 14001 raft_consensus.cc:3060] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:17:31.855432 12205 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:31.832233 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 162970us
I20260709 12:17:31.858314 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:31.865307 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:31.837751 13756 leader_election.cc:290] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:31.845710 11446 raft_consensus.cc:2468] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 9.
I20260709 12:17:31.870548 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:31.840600 14150 raft_consensus.cc:493] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:31.840037 14026 raft_consensus.cc:493] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:31.854082 13509 raft_consensus.cc:493] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:31.856405 14072 raft_consensus.cc:493] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:31.884673 11568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:31.873617 13984 raft_consensus.cc:3060] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:31.846550 13983 raft_consensus.cc:515] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:31.868721 14122 leader_election.cc:290] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:31.876688 14068 leader_election.cc:290] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:31.905314 14161 raft_consensus.cc:493] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:31.903568 14071 raft_consensus.cc:493] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:31.925325 13910 consensus_queue.cc:1059] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:17:31.929940 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:31.926940 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c355b3902a4e7fb72bac6a91ea3316" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:31.932722 14161 raft_consensus.cc:515] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:31.933251 11528 raft_consensus.cc:3060] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:17:31.934523 14068 raft_consensus.cc:3055] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:31.934954 14068 raft_consensus.cc:740] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:31.935580 13966 leader_election.cc:290] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:31.935753 14068 consensus_queue.cc:260] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:31.931373 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:31.883953 13931 leader_election.cc:290] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 11 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:31.934527 14071 raft_consensus.cc:515] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:31.900082 14026 raft_consensus.cc:515] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:31.941893 14026 leader_election.cc:290] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:31.942531 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:31.943181 11593 raft_consensus.cc:2468] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 8.
I20260709 12:17:31.943349 14161 leader_election.cc:290] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:31.944155 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d43eecbad746fd9ddce50c5b9fc3e8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:17:31.944614 14099 consensus_meta.cc:287] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de: Time spent flushing consensus metadata: real 0.567s	user 0.008s	sys 0.002s
W20260709 12:17:31.930282 13911 consensus_meta.cc:287] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d: Time spent flushing consensus metadata: real 0.743s	user 0.011s	sys 0.001s
I20260709 12:17:31.948688 14105 raft_consensus.cc:493] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:31.949448 14105 raft_consensus.cc:515] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:31.950937 11528 raft_consensus.cc:2468] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 7.
I20260709 12:17:31.951897 14105 leader_election.cc:290] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
W20260709 12:17:31.952798 13627 consensus_meta.cc:287] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de: Time spent flushing consensus metadata: real 0.764s	user 0.004s	sys 0.004s
I20260709 12:17:31.953629 14153 raft_consensus.cc:493] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:31.954186 14153 raft_consensus.cc:515] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:31.955597 14098 leader_election.cc:290] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:31.956658 14064 leader_election.cc:290] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:31.956907 14153 leader_election.cc:290] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:31.957885 11417 leader_election.cc:304] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:17:31.958863 13911 raft_consensus.cc:2804] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:31.959167 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7937e0cff84ef7a26c84247c8ffc08" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:31.960448 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:31.910478 14150 raft_consensus.cc:515] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:31.961135 12346 raft_consensus.cc:2393] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 5: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:17:31.906215 14072 raft_consensus.cc:515] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:31.945094 14099 raft_consensus.cc:515] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:31.963244 12345 raft_consensus.cc:2393] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 9: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:17:31.963548 14072 leader_election.cc:290] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:31.928150 11526 raft_consensus.cc:1240] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:31.969341 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:31.970329 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:31.945127 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:17:31.954025 13786 consensus_meta.cc:287] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8: Time spent flushing consensus metadata: real 0.769s	user 0.007s	sys 0.004s
W20260709 12:17:31.976734 11492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:31.936934 11522 raft_consensus.cc:2468] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 5.
I20260709 12:17:31.944753 11593 raft_consensus.cc:2468] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 7.
I20260709 12:17:31.959300 13911 raft_consensus.cc:493] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:31.989576 11566 leader_election.cc:304] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:31.972416 11594 raft_consensus.cc:2468] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 7.
I20260709 12:17:31.995422 11566 leader_election.cc:304] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
W20260709 12:17:31.942883 13991 consensus_meta.cc:287] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de: Time spent flushing consensus metadata: real 0.912s	user 0.011s	sys 0.000s
I20260709 12:17:31.996464 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:17:31.978752 13580 consensus_meta.cc:287] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8: Time spent flushing consensus metadata: real 0.922s	user 0.012s	sys 0.000s
I20260709 12:17:32.001931 11526 raft_consensus.cc:2393] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 8: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:17:32.001943 11566 leader_election.cc:304] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:31.996547 13911 raft_consensus.cc:3060] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:32.004364 13786 raft_consensus.cc:2804] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:32.008766 13786 raft_consensus.cc:697] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 7 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:32.009001 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:32.000980 13851 raft_consensus.cc:3060] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:32.010303 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7937e0cff84ef7a26c84247c8ffc08" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:32.011384 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:17:32.012336 11418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:32.007236 14146 log.cc:927] Time spent T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 12:17:32.007589 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:17:32.012504 11568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:32.012409 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:32.014197 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
W20260709 12:17:32.014894 14126 log.cc:927] Time spent T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.597s	user 0.006s	sys 0.000s
I20260709 12:17:32.015631 13786 consensus_queue.cc:237] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:32.016381 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:32.017135 11525 raft_consensus.cc:2393] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 10: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:17:32.017478 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:32.017946 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:32.018504 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:32.014843 11524 raft_consensus.cc:2376] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 8. Re-sending same reply.
I20260709 12:17:32.018664 11523 raft_consensus.cc:2376] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 7. Re-sending same reply.
I20260709 12:17:32.020355 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:32.020453 12357 raft_consensus.cc:2468] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 9.
I20260709 12:17:32.018673 11519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33446 (request call id 1267) took 2015 ms. Trace:
I20260709 12:17:32.018000 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:32.021584 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d43eecbad746fd9ddce50c5b9fc3e8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:32.020895 11524 raft_consensus.cc:3060] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:32.022058 11525 raft_consensus.cc:3060] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:32.021415 11519 rpcz_store.cc:276] 0709 12:17:30.002938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:30.875245 (+872307us) service_pool.cc:224] Handling call
0709 12:17:30.875626 (+   381us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:30.889651 (+ 14025us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:30.889685 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:30.894084 (+  4399us) log.cc:844] Serialized 52 byte log entry
0709 12:17:31.255281 (+361197us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:31.488262 (+232981us) log.cc:844] Serialized 14 byte log entry
0709 12:17:31.496905 (+  8643us) log.cc:844] Serialized 14 byte log entry
0709 12:17:31.497271 (+   366us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:31.497409 (+   138us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:31.745757 (+248348us) spinlock_profiling.cc:243] Waited 4.63 ms on lock 0x7b18001efdc0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3ad63f3 00007f84e3ad87c1 00007f84e3ad8779 00007f84e3ad8709 00007f84e3ad86d1 00007f84e3ad79cd 0000000000388634 0000000000388479 00007f84e3ab983a
0709 12:17:32.014201 (+268444us) spinlock_profiling.cc:243] Waited 5.57 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e675e86e 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221 00007f84e67671d9 00007f84e6767169
0709 12:17:32.018469 (+  4268us) raft_consensus.cc:1685] finished
0709 12:17:32.018491 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:32.018619 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23846,"prepare.queue_time_us":280789,"prepare.run_cpu_time_us":107,"prepare.run_wall_time_us":9986,"raft.queue_time_us":26466,"raft.run_cpu_time_us":381,"raft.run_wall_time_us":24771,"spinlock_wait_cycles":32133632,"thread_start_us":559805,"threads_started":2,"wal-append.queue_time_us":447780}
I20260709 12:17:31.953239 13627 raft_consensus.cc:515] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:31.967370 14107 leader_election.cc:290] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:31.908176 13509 raft_consensus.cc:515] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:31.978135 14049 raft_consensus.cc:3060] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:32.000419 13991 raft_consensus.cc:515] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:32.082999 14150 leader_election.cc:290] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:32.084859 13991 leader_election.cc:290] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:32.021947 11523 raft_consensus.cc:1275] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:17:32.085691 12361 raft_consensus.cc:2393] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 7: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:17:32.085517 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:32.022214 12357 raft_consensus.cc:2468] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 7.
I20260709 12:17:32.087064 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:32.087169 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:32.065826 11526 raft_consensus.cc:1275] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 12:17:32.066335 11418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:32.068284 11524 raft_consensus.cc:2468] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 11.
W20260709 12:17:32.068616 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 66744.6us
I20260709 12:17:32.093865 11417 leader_election.cc:304] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:17:32.068765 11595 raft_consensus.cc:2468] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 5.
I20260709 12:17:32.095980 12345 raft_consensus.cc:2410] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:17:32.018092 11522 raft_consensus.cc:2468] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 8.
I20260709 12:17:32.070679 14153 raft_consensus.cc:2804] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:32.072441 11519 raft_consensus.cc:1240] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:17:32.069798 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:32.103755 11521 raft_consensus.cc:2393] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 5: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:17:32.076665 11528 raft_consensus.cc:1275] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:32.000654 14068 raft_consensus.cc:3060] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:32.105283 11452 raft_consensus.cc:1275] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 12:17:32.078779 14059 consensus_meta.cc:287] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de: Time spent flushing consensus metadata: real 1.028s	user 0.013s	sys 0.000s
I20260709 12:17:32.106340 13911 raft_consensus.cc:515] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:32.106739 14059 raft_consensus.cc:515] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:32.106410 12349 raft_consensus.cc:1240] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:32.107548 13947 raft_consensus.cc:515] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:32.108897 11598 raft_consensus.cc:2393] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 8: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:17:32.109730 13911 leader_election.cc:290] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:32.080104 14099 leader_election.cc:290] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
W20260709 12:17:32.072111 13957 consensus_meta.cc:287] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671: Time spent flushing consensus metadata: real 0.515s	user 0.013s	sys 0.001s
I20260709 12:17:32.080858 13509 leader_election.cc:290] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:32.102829 14153 raft_consensus.cc:493] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:32.114022 14153 raft_consensus.cc:3060] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:32.115711 13627 leader_election.cc:290] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:32.098376 11522 raft_consensus.cc:1240] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:32.098694 11448 raft_consensus.cc:1275] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:17:32.099404 14072 raft_consensus.cc:2804] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:32.156430 14072 raft_consensus.cc:493] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:32.156519 11494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:32.156912 14072 raft_consensus.cc:3060] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:32.099525 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:32.100606 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:32.159165 14153 raft_consensus.cc:515] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
W20260709 12:17:32.159952 11493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 299361us
I20260709 12:17:32.101078 13910 raft_consensus.cc:493] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:32.102005 11417 leader_election.cc:304] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:17:32.102784 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:32.104967 14071 leader_election.cc:290] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:32.110417 13580 raft_consensus.cc:493] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:32.081652 13983 leader_election.cc:290] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:32.119575 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ed4eeff0ae44d0bc1ebb8cbe3adea5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:32.078838 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:32.117451 13851 raft_consensus.cc:2749] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:32.077461 14097 raft_consensus.cc:515] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:32.117985 13991 raft_consensus.cc:493] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:32.146801 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 664830us
I20260709 12:17:32.183591 11491 leader_election.cc:304] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:32.161506 13995 raft_consensus.cc:2804] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:17:32.147825 12206 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:32.148382 12356 raft_consensus.cc:2393] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 10: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:17:32.148833 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:32.186682 11521 raft_consensus.cc:2393] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 7: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:17:32.162421 11520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33456 (request call id 1066) took 2774 ms. Trace:
I20260709 12:17:32.162565 11593 raft_consensus.cc:2393] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 7: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:17:32.163151 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:17:32.165108 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 63164.5us
W20260709 12:17:32.169822 11420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:32.172842 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:32.191247 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:32.192643 14075 raft_consensus.cc:493] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:32.199849 11491 leader_election.cc:304] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:32.174890 13911 raft_consensus.cc:2804] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:32.146987 12204 leader_election.cc:304] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:32.162227 14058 raft_consensus.cc:2749] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:32.208990 11600 raft_consensus.cc:2368] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for earlier term 7. Current term is 8.
I20260709 12:17:32.182039 13947 leader_election.cc:290] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:32.210628 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:32.185529 13995 raft_consensus.cc:493] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:32.173291 13910 raft_consensus.cc:515] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:32.197988 13991 raft_consensus.cc:515] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:32.220402 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:32.205771 13911 raft_consensus.cc:493] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:32.232939 11418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:32.178069 13580 raft_consensus.cc:515] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
W20260709 12:17:32.224050 11565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:32.251560 11521 raft_consensus.cc:3060] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Advancing to term 7
W20260709 12:17:32.213869 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 66963.4us
I20260709 12:17:32.254679 12204 leader_election.cc:304] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d
I20260709 12:17:32.203418 14062 raft_consensus.cc:2749] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:17:32.211937 14055 raft_consensus.cc:2749] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:32.297084 12204 leader_election.cc:304] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:32.309828 11525 raft_consensus.cc:2468] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 7.
I20260709 12:17:32.217094 14153 leader_election.cc:290] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:32.314459 12361 raft_consensus.cc:2468] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 9.
I20260709 12:17:32.223227 13957 consensus_queue.cc:1059] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.095s
I20260709 12:17:32.312326 14141 raft_consensus.cc:2804] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:32.258006 13911 raft_consensus.cc:3060] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:32.316227 14141 raft_consensus.cc:697] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 8 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:32.317148 14141 consensus_queue.cc:237] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:32.251988 13995 raft_consensus.cc:3060] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:32.204851 14075 raft_consensus.cc:515] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
W20260709 12:17:32.323836 14171 log.cc:927] Time spent T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:17:32.325664 14075 leader_election.cc:290] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:32.326949 14099 raft_consensus.cc:2749] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:32.327710 13939 raft_consensus.cc:493] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:32.328234 13939 raft_consensus.cc:515] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:32.221724 13862 raft_consensus.cc:493] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:32.329195 13862 raft_consensus.cc:515] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:32.330314 13939 leader_election.cc:290] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
W20260709 12:17:32.333109 14164 log.cc:927] Time spent T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 12:17:32.219575 13627 raft_consensus.cc:3060] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:32.250564 14042 raft_consensus.cc:493] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:32.250775 14064 raft_consensus.cc:493] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:32.345408 12204 leader_election.cc:304] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
W20260709 12:17:32.257870 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 48218.7us
I20260709 12:17:32.356034 11521 raft_consensus.cc:2468] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 7.
I20260709 12:17:32.357758 11566 leader_election.cc:304] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:32.343667 14075 raft_consensus.cc:493] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:32.359333 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 169518us
I20260709 12:17:32.355547 11491 leader_election.cc:304] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:32.343636 13786 raft_consensus.cc:493] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:32.367808 12204 leader_election.cc:304] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:32.351068 14059 leader_election.cc:290] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 10 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:32.373184 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:32.378974 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:32.387830 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c355b3902a4e7fb72bac6a91ea3316" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:32.388034 14158 raft_consensus.cc:2804] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:32.388734 14158 raft_consensus.cc:697] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:32.389879 14049 raft_consensus.cc:2764] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:17:32.389602 14158 consensus_queue.cc:237] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:32.374145 13786 raft_consensus.cc:515] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:32.391105 13580 leader_election.cc:290] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:32.392940 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:32.393702 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:32.346094 14161 consensus_queue.cc:1048] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:17:32.395967 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:32.401207 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:32.402071 11522 raft_consensus.cc:2393] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 8: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:17:32.397914 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:32.402804 11526 raft_consensus.cc:2468] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 7.
I20260709 12:17:32.362061 14065 raft_consensus.cc:2804] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:32.397471 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:32.399459 11519 raft_consensus.cc:1275] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 12:17:32.407074 11519 pending_rounds.cc:85] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671: Aborting all ops after (but not including) 5
I20260709 12:17:32.407377 11519 pending_rounds.cc:107] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:17:32.349270 14100 consensus_queue.cc:1048] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:17:32.407614 11519 raft_consensus.cc:2889] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:32.409235 12348 raft_consensus.cc:3060] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:32.392618 13786 leader_election.cc:290] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:17:32.474649 14175 log.cc:927] Time spent T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:17:32.475039 11565 leader_election.cc:304] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:17:32.476331 13580 raft_consensus.cc:2804] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:32.476778 13580 raft_consensus.cc:493] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:32.477128 13580 raft_consensus.cc:3060] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:32.449623 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:32.463665 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:32.358534 14042 raft_consensus.cc:515] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:32.364519 13939 consensus_queue.cc:1048] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:17:32.367434 14098 consensus_queue.cc:1059] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 12:17:32.413918 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:32.414047 12356 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51706 (request call id 1039) took 1327 ms. Trace:
I20260709 12:17:32.369136 13947 raft_consensus.cc:2804] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:32.414810 12347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 1047) took 1076 ms. Trace:
W20260709 12:17:32.439397 14135 log.cc:927] Time spent T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 1.038s	user 0.000s	sys 0.006s
I20260709 12:17:32.371202 14075 raft_consensus.cc:515] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:32.371170 14070 consensus_queue.cc:1059] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 12:17:32.417711 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:32.187494 11520 rpcz_store.cc:276] 0709 12:17:29.387681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:30.802304 (+1414623us) service_pool.cc:224] Handling call
0709 12:17:30.802679 (+   375us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:30.808756 (+  6077us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:30.808788 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:30.809503 (+   715us) log.cc:844] Serialized 52 byte log entry
0709 12:17:31.315329 (+505826us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:31.548389 (+233060us) log.cc:844] Serialized 14 byte log entry
0709 12:17:32.161750 (+613361us) log.cc:844] Serialized 14 byte log entry
0709 12:17:32.162016 (+   266us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:32.162095 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:32.162142 (+    47us) raft_consensus.cc:1685] finished
0709 12:17:32.162152 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:32.162330 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":600312,"prepare.queue_time_us":227309,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":90,"raft.queue_time_us":617383,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":7734,"spinlock_wait_cycles":15421824,"thread_start_us":684009,"threads_started":2,"wal-append.queue_time_us":559113}
W20260709 12:17:32.422237 14167 log.cc:927] Time spent T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:17:32.422730 14065 raft_consensus.cc:697] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 11 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:32.404558 14072 raft_consensus.cc:515] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:32.358783 14064 raft_consensus.cc:515] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:32.437247 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a841f2f09ced40a4bbf33594e11bd7ad" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:32.647238 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:17:32.647540 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 163948us
I20260709 12:17:32.437458 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:32.438474 11448 raft_consensus.cc:1275] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:17:32.439112 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:32.445959 14097 leader_election.cc:290] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:32.452497 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:32.449726 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:32.454974 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:32.445667 11595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40784 (request call id 377) took 1303 ms. Trace:
I20260709 12:17:32.441239 12345 raft_consensus.cc:1240] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:32.468026 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:32.665681 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:32.471926 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:32.479521 11519 raft_consensus.cc:2468] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 8.
I20260709 12:17:32.504731 11527 raft_consensus.cc:2393] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 7: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:17:32.489964 11602 raft_consensus.cc:2468] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 8.
I20260709 12:17:32.503865 12356 rpcz_store.cc:276] 0709 12:17:31.086874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:31.250740 (+163866us) service_pool.cc:224] Handling call
0709 12:17:32.413840 (+1163100us) spinlock_profiling.cc:243] Waited 862 ms on lock 0x7b54000073d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:32.413988 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1982314368}
I20260709 12:17:32.668430 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:32.669049 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:32.669487 14070 consensus_queue.cc:1048] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:32.504112 12347 rpcz_store.cc:276] 0709 12:17:31.338474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:31.705936 (+367462us) service_pool.cc:224] Handling call
0709 12:17:31.706309 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:31.706696 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:31.706722 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:31.707321 (+   599us) log.cc:844] Serialized 26 byte log entry
0709 12:17:32.150998 (+443677us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:32.151037 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:32.151100 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:32.414594 (+263494us) raft_consensus.cc:1685] finished
0709 12:17:32.414617 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:32.414752 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":108885,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":114,"thread_start_us":443235,"threads_started":1,"wal-append.queue_time_us":670330}
I20260709 12:17:32.510322 11491 leader_election.cc:304] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:32.670301 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:32.671010 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:32.507050 11418 leader_election.cc:304] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
W20260709 12:17:32.671255 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 161013us
I20260709 12:17:32.671597 12347 raft_consensus.cc:2376] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1c101e338f954ef086338e251deed19d in term 9. Re-sending same reply.
I20260709 12:17:32.672202 11491 leader_election.cc:304] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:32.512284 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:32.672544 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:17:32.541760 11568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:32.673463 11491 leader_election.cc:304] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:32.417186 13911 raft_consensus.cc:515] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:32.674829 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:32.665863 11528 raft_consensus.cc:2468] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 7.
I20260709 12:17:32.675453 11491 leader_election.cc:304] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:32.667511 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:32.676599 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:32.453418 13910 leader_election.cc:290] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:32.439287 11446 raft_consensus.cc:1275] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:32.649442 11452 raft_consensus.cc:3060] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:32.678172 12345 raft_consensus.cc:1240] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 8 LEADER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:17:32.679174 11519 raft_consensus.cc:2393] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 8: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:17:32.679174 11524 raft_consensus.cc:2393] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 8: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:17:32.679378 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a841f2f09ced40a4bbf33594e11bd7ad" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:32.666054 11595 rpcz_store.cc:276] 0709 12:17:31.142165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:31.149730 (+  7565us) service_pool.cc:224] Handling call
0709 12:17:32.445510 (+1295780us) spinlock_profiling.cc:243] Waited 813 ms on lock 0x7b54002e9354. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:32.445609 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1870848256}
I20260709 12:17:32.681432 11522 raft_consensus.cc:2468] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 6.
I20260709 12:17:32.683300 11520 raft_consensus.cc:2393] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 7: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:17:32.514102 14062 raft_consensus.cc:493] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:32.454311 13991 leader_election.cc:290] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:32.447654 13863 leader_election.cc:290] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:32.443647 14074 raft_consensus.cc:493] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:32.666567 11525 raft_consensus.cc:2393] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 8: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:17:32.669572 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:32.673523 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:32.648743 14066 raft_consensus.cc:493] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:32.683348 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:32.684563 11491 leader_election.cc:400] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 election: Vote denied by peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579) with higher term. Message: Invalid argument: T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for earlier term 6. Current term is 7.
I20260709 12:17:32.729513 11491 leader_election.cc:403] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 12:17:32.730094 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 45695us
I20260709 12:17:32.729115 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:32.731151 11447 raft_consensus.cc:3060] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:32.732551 11452 raft_consensus.cc:2468] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 9.
I20260709 12:17:32.730929 11491 leader_election.cc:304] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:32.685726 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:32.651688 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:32.737221 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:32.738569 11452 raft_consensus.cc:3060] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:32.671383 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:32.673812 13979 raft_consensus.cc:2749] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:17:32.693794 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 45014.1us
I20260709 12:17:32.693843 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:32.745045 11519 raft_consensus.cc:2393] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 7: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:17:32.692624 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:32.696012 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:32.745939 11527 raft_consensus.cc:2393] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 8: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:17:32.673591 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:17:32.442301 14123 log.cc:927] Time spent T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 1.042s	user 0.005s	sys 0.000s
I20260709 12:17:32.699635 11523 raft_consensus.cc:2468] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 9.
I20260709 12:17:32.699038 11450 raft_consensus.cc:2468] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 7.
I20260709 12:17:32.677783 13910 raft_consensus.cc:493] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:32.674365 14163 raft_consensus.cc:3055] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:32.691913 14177 raft_consensus.cc:493] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:32.776580 11446 raft_consensus.cc:1275] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:17:32.718087 14065 consensus_queue.cc:237] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:32.695363 14141 consensus_queue.cc:1048] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 12:17:32.740603 12356 raft_consensus.cc:2393] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 6: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:17:32.743062 11491 leader_election.cc:304] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:32.746284 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:32.787408 11528 raft_consensus.cc:2468] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 6.
I20260709 12:17:32.745841 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:32.684090 13806 raft_consensus.cc:2749] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:32.723912 14111 raft_consensus.cc:2749] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:32.683444 14049 raft_consensus.cc:2804] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:32.754895 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:32.805040 11445 raft_consensus.cc:3060] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:17:32.805050 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:32.807566 11527 raft_consensus.cc:3060] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:17:32.755182 11523 raft_consensus.cc:1275] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:17:32.756078 11519 raft_consensus.cc:1240] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:32.697935 14062 raft_consensus.cc:515] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:32.782424 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:32.815809 11525 raft_consensus.cc:2468] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 8.
I20260709 12:17:32.771812 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:32.701328 13947 raft_consensus.cc:697] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:32.647091 14122 consensus_queue.cc:1048] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:17:32.754518 14055 raft_consensus.cc:2749] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579) with higher term. Message: Invalid argument: T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for earlier term 6. Current term is 7.
I20260709 12:17:32.803478 11452 raft_consensus.cc:2468] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 8.
I20260709 12:17:32.773183 14163 raft_consensus.cc:740] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:32.754231 14066 raft_consensus.cc:515] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:32.831151 11445 raft_consensus.cc:2468] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 8.
I20260709 12:17:32.818729 11447 raft_consensus.cc:2468] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 7.
W20260709 12:17:32.884737 14183 log.cc:927] Time spent T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 12:17:32.890988 11520 raft_consensus.cc:1275] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:32.637127 13580 raft_consensus.cc:515] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:32.791499 14141 consensus_queue.cc:1243] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer 1c101e338f954ef086338e251deed19d log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:17:32.794926 14059 raft_consensus.cc:493] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:32.922662 11527 raft_consensus.cc:2468] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 8.
I20260709 12:17:32.924075 11520 raft_consensus.cc:1240] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 7. Current term is 8. Ops: [7.4-7.4]
W20260709 12:17:32.910495 11493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 131349us
I20260709 12:17:32.821877 14068 raft_consensus.cc:2804] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:32.790616 14185 raft_consensus.cc:2749] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:32.815167 14049 raft_consensus.cc:493] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:32.932226 11526 raft_consensus.cc:2468] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 7.
I20260709 12:17:32.723830 14074 raft_consensus.cc:515] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
W20260709 12:17:32.900893 11567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:32.836812 13984 raft_consensus.cc:493] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:32.921213 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 178210us
I20260709 12:17:32.933563 11417 leader_election.cc:304] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:17:32.789003 13910 raft_consensus.cc:515] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:32.951839 11491 leader_election.cc:304] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:32.934410 11449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35814 (request call id 393) took 2178 ms. Trace:
I20260709 12:17:32.794780 14177 raft_consensus.cc:515] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:32.963343 11449 rpcz_store.cc:276] 0709 12:17:30.750843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:30.751169 (+   326us) service_pool.cc:224] Handling call
0709 12:17:30.751551 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:30.751806 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:30.751832 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:30.756120 (+  4288us) log.cc:844] Serialized 26 byte log entry
0709 12:17:31.170555 (+414435us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:31.170596 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:31.170659 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:32.441680 (+1271021us) spinlock_profiling.cc:243] Waited 5.75 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e675e86e 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221 00007f84e67671d9 00007f84e6767169
0709 12:17:32.916986 (+475306us) raft_consensus.cc:1685] finished
0709 12:17:32.917012 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:32.929103 (+ 12091us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13217536,"thread_start_us":397171,"threads_started":1,"wal-append.queue_time_us":627167}
I20260709 12:17:32.969509 11491 leader_election.cc:304] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:32.971002 11491 leader_election.cc:304] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
W20260709 12:17:32.952229 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 445244us
W20260709 12:17:32.977213 11418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:32.923952 14116 raft_consensus.cc:2764] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:17:32.932475 14068 raft_consensus.cc:493] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:32.932436 13823 leader_election.cc:290] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
W20260709 12:17:32.999296 11565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:32.993149 12347 raft_consensus.cc:2410] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 12:17:32.991180 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 324549us
I20260709 12:17:32.934767 14049 raft_consensus.cc:3060] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:32.928727 13863 consensus_queue.cc:1048] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 12:17:33.002213 11595 raft_consensus.cc:1275] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:17:32.950875 14193 raft_consensus.cc:493] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:32.930310 14059 raft_consensus.cc:515] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:33.004283 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:33.006647 11595 pending_rounds.cc:85] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8: Aborting all ops after (but not including) 4
I20260709 12:17:32.934500 14100 consensus_queue.cc:1059] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 12:17:33.024425 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:32.988798 13911 leader_election.cc:290] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:33.043475 12203 leader_election.cc:304] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:32.998636 14068 raft_consensus.cc:3060] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:33.046769 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:33.047902 11602 raft_consensus.cc:2393] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 10: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:17:32.991551 14072 leader_election.cc:290] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
W20260709 12:17:33.049821 11493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 122947us
I20260709 12:17:32.968338 13984 raft_consensus.cc:515] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:33.047403 11595 pending_rounds.cc:107] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:17:33.068885 11595 raft_consensus.cc:2889] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:33.061703 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:33.062490 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:33.064106 11445 pending_rounds.cc:85] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d: Aborting all ops after (but not including) 2
I20260709 12:17:33.070554 11445 pending_rounds.cc:107] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:17:33.070904 11445 raft_consensus.cc:2889] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:33.000020 14042 leader_election.cc:290] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:33.002054 13948 raft_consensus.cc:2804] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:33.078189 11599 raft_consensus.cc:2468] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 8.
W20260709 12:17:33.089546 11568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:33.043874 14064 leader_election.cc:290] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:33.047446 14075 leader_election.cc:290] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:33.057411 14185 raft_consensus.cc:2749] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:33.046653 14120 consensus_queue.cc:1048] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
W20260709 12:17:33.137560 12348 consensus_meta.cc:287] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de: Time spent flushing consensus metadata: real 0.673s	user 0.007s	sys 0.002s
I20260709 12:17:32.979348 14163 consensus_queue.cc:260] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:33.054697 14196 raft_consensus.cc:2804] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:17:33.111117 14181 log.cc:927] Time spent T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.376s	user 0.000s	sys 0.001s
I20260709 12:17:32.991183 13947 consensus_queue.cc:237] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:33.143321 12348 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 1034) took 2058 ms. Trace:
I20260709 12:17:33.071873 14158 raft_consensus.cc:2804] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:33.146360 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:17:33.162680 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 191755us
I20260709 12:17:33.047848 14098 consensus_queue.cc:1048] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.081s
I20260709 12:17:33.148183 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
W20260709 12:17:33.142618 13995 consensus_meta.cc:287] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671: Time spent flushing consensus metadata: real 0.821s	user 0.011s	sys 0.000s
I20260709 12:17:33.154706 14196 raft_consensus.cc:493] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:33.160533 12348 rpcz_store.cc:276] 0709 12:17:31.084901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:31.240117 (+155216us) service_pool.cc:224] Handling call
0709 12:17:31.240582 (+   465us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:32.408583 (+1168001us) spinlock_profiling.cc:243] Waited 39.5 ms on lock 0x7b58006ec3d0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6b1f0aa 00007f84e6ba1447 00007f84e6bb9fe7 00007f84e6bbb7de 00007f84e6bc5b49 00007f84e6bc6416 00007f84e6bc2d8f 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4
0709 12:17:33.142923 (+734340us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:17:33.142956 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:33.142999 (+    43us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:33.143034 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:33.143101 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:33.143259 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":90789248}
I20260709 12:17:33.164122 11602 raft_consensus.cc:3060] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:33.152659 11599 raft_consensus.cc:1275] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:17:33.167279 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:33.170601 11595 raft_consensus.cc:3060] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:33.136294 14042 raft_consensus.cc:2804] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:17:33.159406 14195 log.cc:927] Time spent T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 12:17:33.141685 14072 raft_consensus.cc:493] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:33.182492 11602 raft_consensus.cc:2468] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 7.
I20260709 12:17:33.183467 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:33.184769 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a841f2f09ced40a4bbf33594e11bd7ad" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:33.185267 11594 raft_consensus.cc:1240] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:33.188472 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c355b3902a4e7fb72bac6a91ea3316" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:33.190052 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:33.146481 14188 raft_consensus.cc:493] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:33.191217 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:33.191464 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:33.145048 14161 raft_consensus.cc:493] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
W20260709 12:17:33.186179 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 113870us
I20260709 12:17:33.160079 13948 raft_consensus.cc:697] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 8 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:33.194164 11594 raft_consensus.cc:2393] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 9: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:17:33.196590 11491 leader_election.cc:400] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973) with higher term. Message: Invalid argument: T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for earlier term 7. Current term is 8.
I20260709 12:17:33.201370 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:33.200348 11491 leader_election.cc:304] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:33.205617 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:33.206352 11600 raft_consensus.cc:3060] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:17:33.192082 14186 log.cc:927] Time spent T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.215s	user 0.001s	sys 0.001s
I20260709 12:17:33.208673 11602 raft_consensus.cc:1240] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:33.058766 14193 raft_consensus.cc:515] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:33.179673 14042 raft_consensus.cc:493] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:33.177026 14196 raft_consensus.cc:3060] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:33.179180 14158 raft_consensus.cc:697] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 9 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
W20260709 12:17:33.195273 14180 log.cc:927] Time spent T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.375s	user 0.001s	sys 0.001s
I20260709 12:17:33.214907 11418 leader_election.cc:304] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:33.220841 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:33.178171 13995 raft_consensus.cc:515] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:33.213228 11595 raft_consensus.cc:2468] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 11.
I20260709 12:17:33.223394 11567 leader_election.cc:304] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:33.225194 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:33.226500 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:33.164909 14189 consensus_queue.cc:1059] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 12:17:33.212013 14185 raft_consensus.cc:2804] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:33.233307 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a841f2f09ced40a4bbf33594e11bd7ad" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:33.227396 11567 leader_election.cc:304] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:33.193574 14072 raft_consensus.cc:515] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
W20260709 12:17:33.216935 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 226076us
I20260709 12:17:33.215705 14042 raft_consensus.cc:3060] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:33.236958 11600 raft_consensus.cc:2468] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 10.
I20260709 12:17:33.222433 11418 leader_election.cc:304] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:33.246616 11418 leader_election.cc:304] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:33.239007 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:33.246969 11419 leader_election.cc:304] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:33.218830 13580 leader_election.cc:290] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 9 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:33.212059 13979 consensus_queue.cc:1048] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:17:33.202082 14161 raft_consensus.cc:515] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:33.221081 14066 leader_election.cc:290] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:33.251751 11418 leader_election.cc:304] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:33.253046 11521 raft_consensus.cc:3060] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:33.222414 14074 leader_election.cc:290] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:33.224035 14075 raft_consensus.cc:2749] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:33.250180 12348 raft_consensus.cc:2393] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 7: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:17:33.278317 11521 raft_consensus.cc:2468] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 10.
W20260709 12:17:33.280220 12352 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51690 (request call id 767) took 1870 ms (client timeout 1741 ms). Trace:
I20260709 12:17:33.273916 12361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 1048) took 1415 ms. Trace:
I20260709 12:17:33.282701 12361 rpcz_store.cc:276] 0709 12:17:31.858692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:32.453819 (+595127us) service_pool.cc:224] Handling call
0709 12:17:32.454140 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:32.454460 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:32.454485 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:32.454960 (+   475us) log.cc:844] Serialized 26 byte log entry
0709 12:17:32.694275 (+239315us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:32.694320 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:32.694394 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:33.262870 (+568476us) raft_consensus.cc:1685] finished
0709 12:17:33.262893 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:33.273809 (+ 10916us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18871,"raft.run_cpu_time_us":66,"raft.run_wall_time_us":66,"thread_start_us":238893,"threads_started":1,"wal-append.queue_time_us":358929}
I20260709 12:17:33.286022 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:33.286610 12361 raft_consensus.cc:3060] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:17:33.293741 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
W20260709 12:17:33.282455 12352 rpcz_store.cc:269] 0709 12:17:31.410106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:31.486637 (+ 76531us) service_pool.cc:224] Handling call
0709 12:17:33.265235 (+1778598us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b5400005ad4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:33.280057 (+ 14822us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":396697344}
I20260709 12:17:33.289636 11519 raft_consensus.cc:1275] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:33.303262 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:33.303489 11596 raft_consensus.cc:3060] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:17:33.290620 11523 raft_consensus.cc:1275] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 12:17:33.201161 14188 raft_consensus.cc:515] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:33.305619 11454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58856 (request call id 671) took 1709 ms. Trace:
I20260709 12:17:33.290701 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d43eecbad746fd9ddce50c5b9fc3e8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:33.253129 13786 raft_consensus.cc:493] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:33.262447 14185 raft_consensus.cc:697] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 8 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:33.250027 14198 raft_consensus.cc:3060] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:33.262156 14201 raft_consensus.cc:2749] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:33.253212 14098 raft_consensus.cc:3055] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:33.297739 11566 leader_election.cc:304] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:33.302496 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ed4eeff0ae44d0bc1ebb8cbe3adea5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:33.304337 11523 pending_rounds.cc:85] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671: Aborting all ops after (but not including) 3
I20260709 12:17:33.312577 11523 pending_rounds.cc:107] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:17:33.306303 11454 rpcz_store.cc:276] 0709 12:17:31.596700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:31.597275 (+   575us) service_pool.cc:224] Handling call
0709 12:17:33.305252 (+1707977us) spinlock_profiling.cc:243] Waited 40 ms on lock 0x7b5400153bd4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:33.305545 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":92021632}
I20260709 12:17:33.306384 11594 raft_consensus.cc:3060] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:33.251073 14105 raft_consensus.cc:2749] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:33.279415 14178 raft_consensus.cc:2804] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:33.305853 14177 leader_election.cc:290] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:33.284480 14100 raft_consensus.cc:493] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:33.319871 14178 raft_consensus.cc:493] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:33.320415 14178 raft_consensus.cc:3060] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:33.320878 14185 consensus_queue.cc:237] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:33.324075 14097 raft_consensus.cc:2804] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:33.326737 14192 raft_consensus.cc:2804] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:33.327358 14192 raft_consensus.cc:493] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:33.327716 14192 raft_consensus.cc:3060] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:33.313254 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:33.282047 13948 consensus_queue.cc:237] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
W20260709 12:17:33.307680 14087 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 12:17:33.319180 14208 raft_consensus.cc:493] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
W20260709 12:17:33.312058 12206 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:33.312868 11523 raft_consensus.cc:2889] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:17:33.300545 13627 consensus_meta.cc:287] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de: Time spent flushing consensus metadata: real 0.947s	user 0.012s	sys 0.000s
I20260709 12:17:33.301167 14074 raft_consensus.cc:493] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:33.370621 14153 consensus_queue.cc:1048] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:33.373617 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:33.375109 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c355b3902a4e7fb72bac6a91ea3316" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:33.380785 11596 raft_consensus.cc:2468] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 9.
I20260709 12:17:33.384101 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:33.309834 14059 leader_election.cc:290] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:33.330430 14072 leader_election.cc:290] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:33.393177 12348 raft_consensus.cc:1275] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:33.387218 12203 leader_election.cc:304] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
W20260709 12:17:33.388232 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 61950.4us
I20260709 12:17:33.311053 14098 raft_consensus.cc:740] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:33.305876 13580 consensus_queue.cc:1048] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.081s
I20260709 12:17:33.362689 14097 raft_consensus.cc:697] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:33.380358 13627 raft_consensus.cc:2749] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:33.320257 14100 raft_consensus.cc:515] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:33.380095 14153 raft_consensus.cc:493] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:33.311980 13786 raft_consensus.cc:515] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
W20260709 12:17:33.379278 14184 log.cc:927] Time spent T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
I20260709 12:17:33.419840 12203 leader_election.cc:304] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:33.307672 14158 consensus_queue.cc:237] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
W20260709 12:17:33.422960 14191 log.cc:927] Time spent T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
I20260709 12:17:33.400203 13995 leader_election.cc:290] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:33.433631 12361 raft_consensus.cc:2468] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 8.
W20260709 12:17:33.434514 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 63490.6us
I20260709 12:17:33.438458 12361 raft_consensus.cc:1275] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:33.433369 12203 leader_election.cc:304] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:33.436683 12352 raft_consensus.cc:2410] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:17:33.410995 14177 raft_consensus.cc:493] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:33.450016 14177 raft_consensus.cc:515] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
W20260709 12:17:33.451411 14204 log.cc:927] Time spent T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 12:17:33.452373 14177 leader_election.cc:290] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:33.389861 14074 raft_consensus.cc:515] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:33.453148 11524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33456 (request call id 1073) took 1056 ms. Trace:
I20260709 12:17:33.453622 11524 rpcz_store.cc:276] 0709 12:17:32.396961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:32.397178 (+   217us) service_pool.cc:224] Handling call
0709 12:17:33.452929 (+1055751us) spinlock_profiling.cc:243] Waited 272 ms on lock 0x7b5400370354. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:33.453084 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":625653504}
I20260709 12:17:33.454854 11601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55250 (request call id 659) took 1829 ms. Trace:
I20260709 12:17:33.455260 11601 rpcz_store.cc:276] 0709 12:17:31.625667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:31.625778 (+   111us) service_pool.cc:224] Handling call
0709 12:17:33.454675 (+1828897us) spinlock_profiling.cc:243] Waited 579 ms on lock 0x7b540054b854. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:33.454797 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1330580352}
I20260709 12:17:33.449079 14049 raft_consensus.cc:515] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:33.457919 11525 raft_consensus.cc:1240] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:17:33.414927 14221 raft_consensus.cc:2804] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:33.467518 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:33.468191 11522 raft_consensus.cc:2468] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 8.
I20260709 12:17:33.377575 14208 raft_consensus.cc:515] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:33.441881 14062 leader_election.cc:290] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:33.437075 13862 leader_election.cc:290] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:33.443589 14207 raft_consensus.cc:2749] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:33.445569 11417 leader_election.cc:304] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:17:33.447892 14163 raft_consensus.cc:3060] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:33.449234 14154 log.cc:927] Time spent T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 1.577s	user 0.010s	sys 0.010s
I20260709 12:17:33.485069 14100 leader_election.cc:290] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:33.473477 13863 raft_consensus.cc:2749] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:33.461470 11418 leader_election.cc:304] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:33.487900 11418 leader_election.cc:304] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:33.488929 11418 leader_election.cc:304] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:33.487912 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:33.463845 11594 raft_consensus.cc:2468] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 8.
I20260709 12:17:33.469622 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8741606df54c3f8b5cc5c1141862ea" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:33.472232 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:33.460934 12203 leader_election.cc:304] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:33.470176 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:33.472534 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:33.492022 11519 raft_consensus.cc:2468] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 8.
I20260709 12:17:33.492309 11601 raft_consensus.cc:2410] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:17:33.474740 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:33.493572 11602 raft_consensus.cc:2393] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 8: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:17:33.476414 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:33.455184 14074 leader_election.cc:290] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:33.490658 11418 leader_election.cc:304] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:33.491554 11528 raft_consensus.cc:3060] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:33.493670 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:33.504742 11418 leader_election.cc:304] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:33.494567 11524 raft_consensus.cc:2393] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 7: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:17:33.426891 14153 raft_consensus.cc:515] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:33.414165 14097 consensus_queue.cc:237] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:33.495434 11417 leader_election.cc:304] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:17:33.496206 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:33.466117 14221 raft_consensus.cc:493] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:33.485577 14177 raft_consensus.cc:2804] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:17:33.442078 14173 log.cc:927] Time spent T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:17:33.491649 11596 raft_consensus.cc:2368] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for earlier term 9. Current term is 10.
I20260709 12:17:33.507869 11522 raft_consensus.cc:2468] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 10.
I20260709 12:17:33.485497 13786 leader_election.cc:290] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:33.484892 14215 raft_consensus.cc:493] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:33.508772 14075 raft_consensus.cc:2804] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:33.512565 14153 leader_election.cc:290] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:33.505911 11418 leader_election.cc:304] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:33.518435 11491 leader_election.cc:400] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 election: Vote denied by peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973) with higher term. Message: Invalid argument: T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for earlier term 9. Current term is 10.
I20260709 12:17:33.518702 12203 leader_election.cc:304] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:33.516227 11566 leader_election.cc:304] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:33.493673 13966 raft_consensus.cc:2764] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:17:33.501778 14219 raft_consensus.cc:2749] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:33.507342 14201 raft_consensus.cc:3060] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:33.506862 13911 raft_consensus.cc:2749] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:33.524906 14059 consensus_queue.cc:1059] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:17:33.549880 14075 raft_consensus.cc:493] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:33.561676 11528 raft_consensus.cc:2468] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 9.
I20260709 12:17:33.553224 11491 leader_election.cc:403] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:17:33.558955 13786 raft_consensus.cc:2804] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:33.562683 13786 raft_consensus.cc:493] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:33.563071 13786 raft_consensus.cc:3060] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:33.468703 14098 consensus_queue.cc:260] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:33.514387 14221 raft_consensus.cc:3060] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:33.519737 14120 raft_consensus.cc:2749] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:33.490024 14068 raft_consensus.cc:515] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:33.558050 11521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38272 (request call id 449) took 1185 ms. Trace:
I20260709 12:17:33.582151 11521 rpcz_store.cc:276] 0709 12:17:32.372436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:32.372664 (+   228us) service_pool.cc:224] Handling call
0709 12:17:33.557887 (+1185223us) spinlock_profiling.cc:243] Waited 873 ms on lock 0x7b5400593654. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:33.557995 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2007073024}
I20260709 12:17:33.560161 14207 raft_consensus.cc:2804] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:33.561512 14136 raft_consensus.cc:2749] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:33.516602 14072 raft_consensus.cc:2804] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:17:33.554412 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 48589.9us
W20260709 12:17:33.553752 11565 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.212.130:41579 timed out after 1.584s (SENT) [suppressed 18 similar messages]
I20260709 12:17:33.524569 14177 raft_consensus.cc:697] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 9 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
W20260709 12:17:33.564435 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 46253.2us
I20260709 12:17:33.441148 14152 consensus_queue.cc:1048] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:33.423576 14217 consensus_queue.cc:1048] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:17:33.549960 14215 raft_consensus.cc:515] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:33.577207 14049 leader_election.cc:290] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:33.577942 14059 raft_consensus.cc:3055] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:33.566197 14194 raft_consensus.cc:2749] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973) with higher term. Message: Invalid argument: T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for earlier term 9. Current term is 10.
I20260709 12:17:33.611331 14059 raft_consensus.cc:740] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:33.559746 12203 leader_election.cc:304] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
W20260709 12:17:33.614346 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 54692.9us
I20260709 12:17:33.583799 12204 leader_election.cc:304] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:33.579758 13984 leader_election.cc:290] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:33.555910 14193 leader_election.cc:290] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:33.616539 14141 raft_consensus.cc:2804] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:33.611626 14072 raft_consensus.cc:697] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 8 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:33.617183 14141 raft_consensus.cc:697] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 10 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:33.617738 14072 consensus_queue.cc:237] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:33.618296 14141 consensus_queue.cc:237] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
W20260709 12:17:33.619627 14182 log.cc:927] Time spent T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.685s	user 0.002s	sys 0.000s
I20260709 12:17:33.565011 14075 raft_consensus.cc:3060] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:33.573758 14192 raft_consensus.cc:515] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:33.623193 14192 leader_election.cc:290] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:33.595372 11418 leader_election.cc:304] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:33.626169 11418 leader_election.cc:304] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:33.626988 14196 raft_consensus.cc:515] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:33.628057 11527 raft_consensus.cc:1240] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:33.603163 14177 consensus_queue.cc:237] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:33.633735 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:33.634469 11523 raft_consensus.cc:2468] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 7.
I20260709 12:17:33.615665 14217 raft_consensus.cc:2749] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:33.613987 14059 consensus_queue.cc:260] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:33.630070 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:33.596179 14098 raft_consensus.cc:3060] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:33.587204 14207 raft_consensus.cc:493] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting leader election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:33.655714 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:17:33.629317 11418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:33.657981 11418 leader_election.cc:304] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:33.626410 14071 raft_consensus.cc:2804] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:33.661300 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:33.672297 11445 raft_consensus.cc:2368] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de for earlier term 7. Current term is 8.
I20260709 12:17:33.661341 11454 raft_consensus.cc:1240] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:17:33.607167 14188 leader_election.cc:290] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:33.656597 12361 raft_consensus.cc:2468] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 9.
I20260709 12:17:33.683537 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:33.683954 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:33.684273 12361 raft_consensus.cc:2468] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 10.
I20260709 12:17:33.684454 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:33.684913 11447 raft_consensus.cc:2468] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 6.
I20260709 12:17:33.685348 11600 raft_consensus.cc:2368] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de for earlier term 7. Current term is 8.
I20260709 12:17:33.638044 14193 raft_consensus.cc:2804] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:33.686944 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffe47647c274723808482c166efa21c" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:33.688795 11567 leader_election.cc:304] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:33.687073 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:33.690097 11600 raft_consensus.cc:2468] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 7.
I20260709 12:17:33.689498 11454 raft_consensus.cc:1240] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:17:33.641932 14224 raft_consensus.cc:493] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:33.641999 14120 raft_consensus.cc:493] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:33.697712 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:33.701866 11454 raft_consensus.cc:2393] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 7: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:33.671125 14071 raft_consensus.cc:493] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:33.671633 14192 raft_consensus.cc:2804] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:33.670434 14207 raft_consensus.cc:3060] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:33.676074 14217 raft_consensus.cc:493] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:33.674785 13680 raft_consensus.cc:493] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:33.640538 14042 raft_consensus.cc:515] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:33.699990 14059 raft_consensus.cc:3060] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:33.692732 14193 raft_consensus.cc:493] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:33.735638 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:33.736248 11447 raft_consensus.cc:2468] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 7.
I20260709 12:17:33.712801 14071 raft_consensus.cc:3060] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:17:33.743809 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 55095.6us
I20260709 12:17:33.712441 14192 raft_consensus.cc:493] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:33.756855 12206 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:33.755785 11567 leader_election.cc:304] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:33.735101 14193 raft_consensus.cc:3060] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:33.778031 11567 leader_election.cc:304] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:33.709333 14120 raft_consensus.cc:515] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:33.782998 12349 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 1035) took 2691 ms. Trace:
I20260709 12:17:33.786077 12349 rpcz_store.cc:276] 0709 12:17:31.085326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:31.242413 (+157087us) service_pool.cc:224] Handling call
0709 12:17:31.242820 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:32.107702 (+864882us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:33.776482 (+1668780us) spinlock_profiling.cc:243] Waited 860 ms on lock 0x7b5400146754. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:17:33.776684 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1977801472}
I20260709 12:17:33.754402 14152 raft_consensus.cc:2749] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:33.769313 14192 raft_consensus.cc:3060] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:33.747422 14208 leader_election.cc:290] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:33.732031 13680 raft_consensus.cc:515] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
W20260709 12:17:33.784554 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 76229.8us
I20260709 12:17:33.707124 14224 raft_consensus.cc:515] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:33.721055 14217 raft_consensus.cc:515] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:33.803587 12349 pending_rounds.cc:85] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de: Aborting all ops after (but not including) 4
I20260709 12:17:33.806403 12349 pending_rounds.cc:107] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:17:33.810688 12349 raft_consensus.cc:2889] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:33.786499 14222 raft_consensus.cc:2749] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:33.814834 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:33.832099 14224 leader_election.cc:290] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:33.836565 13680 leader_election.cc:290] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:17:33.849242 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 295489us
I20260709 12:17:33.850426 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390e91331fd04f97a5235133a34875ee" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:17:33.851596 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 73652.8us
I20260709 12:17:33.852913 11567 leader_election.cc:304] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:33.844750 13786 raft_consensus.cc:515] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:33.809617 14068 leader_election.cc:290] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:33.854664 11567 leader_election.cc:304] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:33.812613 13580 raft_consensus.cc:2749] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:33.856025 13680 raft_consensus.cc:2749] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:33.856057 14196 leader_election.cc:290] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 7 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:33.867552 11567 leader_election.cc:304] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
W20260709 12:17:33.910826 14178 consensus_meta.cc:287] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d: Time spent flushing consensus metadata: real 0.590s	user 0.012s	sys 0.000s
I20260709 12:17:33.905706 14207 raft_consensus.cc:515] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:33.910735 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:33.951433 11528 raft_consensus.cc:3060] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:33.878150 14120 leader_election.cc:290] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:33.958608 14221 raft_consensus.cc:515] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:33.965909 14196 raft_consensus.cc:493] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:33.966275 14207 leader_election.cc:290] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:33.966563 13995 raft_consensus.cc:493] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:33.967109 13995 raft_consensus.cc:515] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:33.961077 14221 leader_election.cc:290] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:33.867071 14151 raft_consensus.cc:2804] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:33.867905 14152 consensus_queue.cc:1048] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:17:33.871812 14206 consensus_queue.cc:1048] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:17:33.975317 13995 leader_election.cc:290] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:33.976037 14196 raft_consensus.cc:515] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:33.978421 14192 raft_consensus.cc:515] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:33.980909 14192 leader_election.cc:290] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:33.981225 12203 leader_election.cc:304] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:33.983248 14196 leader_election.cc:290] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
W20260709 12:17:33.912376 14198 consensus_meta.cc:287] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8: Time spent flushing consensus metadata: real 0.580s	user 0.006s	sys 0.004s
I20260709 12:17:34.022953 14198 raft_consensus.cc:2749] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:34.024627 11595 raft_consensus.cc:1240] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:34.022843 12203 leader_election.cc:304] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:34.025934 14136 raft_consensus.cc:2749] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:33.914512 14075 raft_consensus.cc:515] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:33.942814 12359 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51706 (request call id 1031) took 2859 ms. Trace:
I20260709 12:17:33.944476 14217 leader_election.cc:290] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:33.945546 14117 raft_consensus.cc:2804] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:17:33.872015 14235 log.cc:927] Time spent T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:17:33.912818 13786 leader_election.cc:290] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 11 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
W20260709 12:17:34.021642 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 154120us
I20260709 12:17:34.026901 12359 rpcz_store.cc:276] 0709 12:17:31.083618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:31.083738 (+   120us) service_pool.cc:224] Handling call
0709 12:17:31.125317 (+ 41579us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:31.125692 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:17:31.815578 (+689886us) log.cc:844] Serialized 14 byte log entry
0709 12:17:33.877759 (+2062181us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b18004a3ec0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3a50c0a 00007f84ed190219 00007f84e3ad8a40 00007f84e3ad34e4 00007f84e3ad3455 00007f84ea5bb3c7 00007f84e6bcd9a7 00007f84e6bdd0bf 00007f84e6bdd038
0709 12:17:33.877988 (+   229us) log.cc:844] Serialized 14 byte log entry
0709 12:17:33.942443 (+ 64455us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:33.942504 (+    61us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:33.942548 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:33.942627 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:33.942756 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":164835,"prepare.queue_time_us":2090273,"prepare.run_cpu_time_us":1595,"prepare.run_wall_time_us":8511,"raft.queue_time_us":151336,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":56880,"spinlock_wait_cycles":2623744,"thread_start_us":754250,"threads_started":3,"wal-append.queue_time_us":441845,"wal-append.run_cpu_time_us":1736,"wal-append.run_wall_time_us":1150191}
I20260709 12:17:33.974597 11528 raft_consensus.cc:2468] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 11.
I20260709 12:17:34.030735 11566 leader_election.cc:304] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:34.034991 12203 leader_election.cc:400] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Vote denied by peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579) with higher term. Message: Invalid argument: T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de for earlier term 7. Current term is 8.
I20260709 12:17:34.036439 13786 consensus_queue.cc:1059] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:34.037732 14198 raft_consensus.cc:2804] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:34.044220 12203 leader_election.cc:403] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:34.045991 11450 raft_consensus.cc:1240] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:17:34.046061 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:34.056280 12359 raft_consensus.cc:3060] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:33.984983 14105 raft_consensus.cc:2804] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:34.059036 12203 leader_election.cc:304] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:34.074709 12203 leader_election.cc:304] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:33.951907 14178 raft_consensus.cc:515] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:34.081581 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:34.055188 14151 raft_consensus.cc:697] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
W20260709 12:17:34.066948 14201 consensus_meta.cc:287] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d: Time spent flushing consensus metadata: real 0.501s	user 0.010s	sys 0.000s
I20260709 12:17:34.084863 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:34.087442 11452 raft_consensus.cc:1275] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:17:34.066288 14105 raft_consensus.cc:493] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:34.095614 12203 leader_election.cc:400] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Vote denied by peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973) with higher term. Message: Invalid argument: T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de for earlier term 7. Current term is 8.
I20260709 12:17:34.094465 11454 raft_consensus.cc:2468] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 6.
I20260709 12:17:34.066552 14120 raft_consensus.cc:2749] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579) with higher term. Message: Invalid argument: T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de for earlier term 7. Current term is 8.
I20260709 12:17:34.075958 14189 raft_consensus.cc:2804] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:34.098299 12203 leader_election.cc:304] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d
I20260709 12:17:34.101222 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7937e0cff84ef7a26c84247c8ffc08" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:34.107427 11451 raft_consensus.cc:2468] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 1.
I20260709 12:17:34.069788 14136 consensus_queue.cc:1059] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:17:34.093459 14074 raft_consensus.cc:2804] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:34.110322 12345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51698 (request call id 787) took 2117 ms. Trace:
I20260709 12:17:34.098764 14201 raft_consensus.cc:2749] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:34.109789 13627 raft_consensus.cc:2749] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:34.118397 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:34.119203 14042 leader_election.cc:290] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:34.124240 12345 rpcz_store.cc:276] 0709 12:17:31.993029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:32.741779 (+748750us) service_pool.cc:224] Handling call
0709 12:17:32.742524 (+   745us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:32.742734 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:17:34.056381 (+1313647us) log.cc:844] Serialized 14 byte log entry
0709 12:17:34.109104 (+ 52723us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:34.109176 (+    72us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:34.109229 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:34.109313 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:34.110253 (+   940us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1207201,"prepare.queue_time_us":1221231,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"raft.queue_time_us":1413,"thread_start_us":153824,"threads_started":2}
I20260709 12:17:34.099303 14105 raft_consensus.cc:3060] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:34.079010 14098 consensus_queue.cc:1059] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:17:34.139710 12359 raft_consensus.cc:2468] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 11.
I20260709 12:17:34.106838 14189 raft_consensus.cc:493] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:34.144906 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:34.145666 11528 raft_consensus.cc:3060] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:17:34.131774 14074 raft_consensus.cc:493] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:34.122720 14221 raft_consensus.cc:2804] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:34.138968 14064 raft_consensus.cc:493] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:34.144645 14189 raft_consensus.cc:3060] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:34.187433 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 120606us
I20260709 12:17:34.132088 14193 raft_consensus.cc:515] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:34.171005 14074 raft_consensus.cc:3060] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:34.169715 14221 raft_consensus.cc:493] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:34.220952 12361 raft_consensus.cc:2468] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 6.
I20260709 12:17:34.225224 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7937e0cff84ef7a26c84247c8ffc08" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:34.226172 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:34.228809 11528 raft_consensus.cc:2468] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 9.
I20260709 12:17:34.216034 14178 leader_election.cc:290] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:34.167194 14151 consensus_queue.cc:237] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:34.230052 11520 raft_consensus.cc:2468] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 6.
W20260709 12:17:34.272106 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 88567.2us
I20260709 12:17:34.230810 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:34.220319 14221 raft_consensus.cc:3060] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:34.188764 14064 raft_consensus.cc:515] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:34.273942 12203 leader_election.cc:304] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:34.234978 14245 raft_consensus.cc:493] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:34.236853 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:34.243469 11597 raft_consensus.cc:1240] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:17:34.223259 14198 raft_consensus.cc:697] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 11 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:34.244215 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:34.265654 13947 raft_consensus.cc:493] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:34.267401 12352 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51690 (request call id 778) took 1193 ms. Trace:
I20260709 12:17:34.267910 14258 raft_consensus.cc:493] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:34.294562 12346 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51698 (request call id 776) took 2444 ms. Trace:
I20260709 12:17:34.264410 14189 raft_consensus.cc:515] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:34.293538 12352 rpcz_store.cc:276] 0709 12:17:33.073689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:33.294941 (+221252us) service_pool.cc:224] Handling call
0709 12:17:34.267142 (+972201us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b5400007dd4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:34.267329 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":304484608}
I20260709 12:17:34.297785 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:34.299887 12357 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51690 (request call id 774) took 1856 ms. Trace:
I20260709 12:17:34.294936 12346 rpcz_store.cc:276] 0709 12:17:31.850361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:32.334924 (+484563us) service_pool.cc:224] Handling call
0709 12:17:32.335270 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:32.335611 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:32.335638 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:32.347028 (+ 11390us) log.cc:844] Serialized 26 byte log entry
0709 12:17:32.383934 (+ 36906us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:34.070995 (+1687061us) log.cc:844] Serialized 14 byte log entry
0709 12:17:34.294278 (+223283us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:34.294354 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:34.294397 (+    43us) raft_consensus.cc:1685] finished
0709 12:17:34.294407 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:34.294513 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1622991,"prepare.queue_time_us":1579778,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":9435,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":5455,"thread_start_us":273093,"threads_started":3,"wal-append.queue_time_us":308368,"wal-append.run_cpu_time_us":3115,"wal-append.run_wall_time_us":1348976}
I20260709 12:17:34.292544 14257 raft_consensus.cc:493] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:34.304822 14257 raft_consensus.cc:515] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:34.306357 14105 raft_consensus.cc:515] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:34.307422 14198 consensus_queue.cc:237] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:34.293542 14245 raft_consensus.cc:515] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:34.308662 14189 leader_election.cc:290] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:34.310575 14245 leader_election.cc:290] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:34.311097 13931 raft_consensus.cc:493] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:34.311739 13931 raft_consensus.cc:515] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:34.290652 14136 consensus_queue.cc:1048] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:17:34.300835 13947 raft_consensus.cc:515] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:34.304102 13991 raft_consensus.cc:2804] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:34.318282 13991 raft_consensus.cc:493] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:34.318670 13991 raft_consensus.cc:3060] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:34.318986 14117 raft_consensus.cc:493] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:34.319489 14117 raft_consensus.cc:3060] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:17:34.293718 14071 consensus_meta.cc:287] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d: Time spent flushing consensus metadata: real 0.520s	user 0.008s	sys 0.012s
I20260709 12:17:34.321736 14071 raft_consensus.cc:515] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:34.322124 14064 leader_election.cc:290] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:34.323796 14071 leader_election.cc:290] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:34.297194 14122 raft_consensus.cc:2749] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:17:34.326705 14065 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.149s	user 0.008s	sys 0.012s
I20260709 12:17:34.317111 13947 leader_election.cc:290] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:17:34.330657 14065 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.176s	user 0.008s	sys 0.012s
I20260709 12:17:34.297302 14258 raft_consensus.cc:515] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:34.337558 14193 leader_election.cc:290] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:34.345609 14134 raft_consensus.cc:3055] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:34.346290 14134 raft_consensus.cc:740] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:34.346328 14221 raft_consensus.cc:515] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:34.347506 14134 consensus_queue.cc:260] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:34.348812 14221 leader_election.cc:290] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:34.348986 14134 raft_consensus.cc:3060] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:34.262717 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 1.00859e+06us
I20260709 12:17:34.379968 11419 leader_election.cc:304] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:34.381949 11449 raft_consensus.cc:1240] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:34.391055 11419 leader_election.cc:304] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:34.401749 12356 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51690 (request call id 775) took 1957 ms. Trace:
I20260709 12:17:34.402542 11600 raft_consensus.cc:2468] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 5.
I20260709 12:17:34.401852 14064 raft_consensus.cc:493] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:34.402559 12356 rpcz_store.cc:276] 0709 12:17:32.444288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:32.787011 (+342723us) service_pool.cc:224] Handling call
0709 12:17:32.787345 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:32.787557 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:32.787581 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:34.218872 (+1431291us) spinlock_profiling.cc:243] Waited 4.52 ms on lock 0x7b2c0001afe8. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e54bca11 00007f84e54cc372 00007f84e6bfea01 00007f84e6bc343a 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2
0709 12:17:34.219253 (+   381us) log.cc:844] Serialized 26 byte log entry
0709 12:17:34.330060 (+110807us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:34.330109 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:34.330207 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:34.400751 (+ 70544us) raft_consensus.cc:1685] finished
0709 12:17:34.400816 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:34.401345 (+   529us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10396032,"thread_start_us":76247,"threads_started":1,"wal-append.queue_time_us":106172}
I20260709 12:17:34.406939 14196 consensus_queue.cc:1059] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:34.407176 14064 raft_consensus.cc:515] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:34.412016 13931 leader_election.cc:290] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:17:34.417145 11526 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33446 (request call id 1297) took 2017 ms (client timeout 1552 ms). Trace:
W20260709 12:17:34.420370 11526 rpcz_store.cc:269] 0709 12:17:32.399598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:32.467711 (+ 68113us) service_pool.cc:224] Handling call
0709 12:17:34.416538 (+1948827us) spinlock_profiling.cc:243] Waited 267 ms on lock 0x7b54000a5fd4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:34.416819 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":613337472}
I20260709 12:17:34.430400 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:34.431767 11525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38272 (request call id 456) took 1523 ms. Trace:
I20260709 12:17:34.431465 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:34.432336 11525 rpcz_store.cc:276] 0709 12:17:32.907848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:32.908180 (+   332us) service_pool.cc:224] Handling call
0709 12:17:32.931446 (+ 23266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:33.458341 (+526895us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:34.430900 (+972559us) spinlock_profiling.cc:243] Waited 526 ms on lock 0x7b54004b00d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:17:34.431470 (+   570us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1209995520}
I20260709 12:17:34.434886 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:34.435171 11527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33446 (request call id 1303) took 1149 ms. Trace:
I20260709 12:17:34.435688 11527 rpcz_store.cc:276] 0709 12:17:33.285796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:33.287812 (+  2016us) service_pool.cc:224] Handling call
0709 12:17:33.288057 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:33.628414 (+340357us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:34.434609 (+806195us) spinlock_profiling.cc:243] Waited 340 ms on lock 0x7b54001379d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:17:34.434977 (+   368us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":781505280}
I20260709 12:17:34.334070 14074 raft_consensus.cc:515] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:34.439940 14068 raft_consensus.cc:2749] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:34.445890 14201 raft_consensus.cc:2749] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:34.446882 13991 raft_consensus.cc:515] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:34.447649 11595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 885) took 1156 ms. Trace:
I20260709 12:17:34.469878 11595 rpcz_store.cc:276] 0709 12:17:33.291465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:33.291583 (+   118us) service_pool.cc:224] Handling call
0709 12:17:33.291825 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:34.026306 (+734481us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:34.447048 (+420742us) spinlock_profiling.cc:243] Waited 733 ms on lock 0x7b5400050354. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:17:34.447420 (+   372us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1684779904}
I20260709 12:17:34.448735 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:34.448999 12347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51698 (request call id 799) took 1969 ms. Trace:
I20260709 12:17:34.449889 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:34.450201 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:34.452605 12348 raft_consensus.cc:1240] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:34.453730 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:34.455376 13811 raft_consensus.cc:3055] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:34.461097 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:34.456908 11521 raft_consensus.cc:1275] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:17:34.463718 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:34.476459 11526 raft_consensus.cc:2393] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 10: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:17:34.477815 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:34.478291 11528 raft_consensus.cc:3060] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:34.479218 11526 raft_consensus.cc:2393] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 9: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:34.480283 14074 leader_election.cc:290] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:34.476368 12203 leader_election.cc:304] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:34.471542 12347 rpcz_store.cc:276] 0709 12:17:32.479614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:32.673404 (+193790us) service_pool.cc:224] Handling call
0709 12:17:34.448604 (+1775200us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b540000aad4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:34.448828 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":552566016}
I20260709 12:17:34.489682 13939 raft_consensus.cc:493] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:34.472625 13811 raft_consensus.cc:740] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:34.490746 13939 raft_consensus.cc:515] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:34.492354 13811 consensus_queue.cc:260] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:34.497555 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:34.497941 11519 raft_consensus.cc:2468] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 7.
I20260709 12:17:34.498726 11527 raft_consensus.cc:2468] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 8.
I20260709 12:17:34.498991 13811 raft_consensus.cc:3060] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:34.495177 11419 leader_election.cc:304] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
W20260709 12:17:34.502948 11418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:34.503334 11520 raft_consensus.cc:3060] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:17:34.504617 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 91440.1us
I20260709 12:17:34.507284 13931 raft_consensus.cc:2749] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:34.511154 14064 leader_election.cc:290] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:34.515512 14075 leader_election.cc:290] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:34.518282 14099 raft_consensus.cc:3055] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:34.518821 14099 raft_consensus.cc:740] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:34.518370 11519 raft_consensus.cc:1240] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:17:34.520649 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:17:34.518353 11493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:34.525311 11519 raft_consensus.cc:2468] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 8.
I20260709 12:17:34.530402 11525 raft_consensus.cc:1240] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:34.530575 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:34.534286 11566 leader_election.cc:304] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:34.534332 13851 consensus_queue.cc:1059] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:34.536216 13580 raft_consensus.cc:2804] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:34.536788 13580 raft_consensus.cc:493] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:34.537214 13580 raft_consensus.cc:3060] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:34.527070 13939 leader_election.cc:290] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:34.542522 11491 leader_election.cc:304] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:34.531519 11526 raft_consensus.cc:2468] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 5.
I20260709 12:17:34.542975 14153 raft_consensus.cc:3055] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:34.544343 14153 raft_consensus.cc:740] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:34.544051 14099 consensus_queue.cc:260] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:34.546305 14099 raft_consensus.cc:3060] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:34.546236 14153 consensus_queue.cc:260] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:34.548305 14153 raft_consensus.cc:3060] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:34.518883 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:34.528483 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:34.535881 11566 leader_election.cc:304] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
W20260709 12:17:34.557160 14228 log.cc:927] Time spent T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.981s	user 0.000s	sys 0.002s
W20260709 12:17:34.558591 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 152858us
I20260709 12:17:34.562810 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:34.566866 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:34.568943 11527 raft_consensus.cc:2393] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 5: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:17:34.577139 13991 leader_election.cc:290] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:34.577168 14064 raft_consensus.cc:2804] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:34.578558 14064 raft_consensus.cc:493] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:34.578930 14064 raft_consensus.cc:3060] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:34.579645 14042 raft_consensus.cc:493] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:34.578090 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:34.570216 14075 raft_consensus.cc:2749] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:34.587857 14257 leader_election.cc:290] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:34.590179 11419 leader_election.cc:304] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:34.592046 14075 raft_consensus.cc:2749] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:34.575570 11418 leader_election.cc:304] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:34.593118 11419 leader_election.cc:304] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:34.581141 14042 raft_consensus.cc:515] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:34.594811 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
W20260709 12:17:34.615090 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 91519.9us
I20260709 12:17:34.615628 14258 leader_election.cc:290] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:34.616469 14187 raft_consensus.cc:2804] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:34.617493 14187 raft_consensus.cc:697] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 9 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:34.617823 14258 raft_consensus.cc:2804] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:34.618323 14258 raft_consensus.cc:493] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:34.618731 14258 raft_consensus.cc:3060] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:34.616000 11418 leader_election.cc:304] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:34.620633 14193 raft_consensus.cc:2804] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:34.613001 14075 raft_consensus.cc:2749] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:17:34.620836 11493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 46135.4us
I20260709 12:17:34.621822 14193 raft_consensus.cc:697] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 6 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:34.623255 14193 consensus_queue.cc:237] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:34.599699 11453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58868 (request call id 1329) took 2151 ms. Trace:
I20260709 12:17:34.624402 11453 rpcz_store.cc:276] 0709 12:17:32.448579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:32.739356 (+290777us) service_pool.cc:224] Handling call
0709 12:17:32.739630 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:32.992054 (+252424us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:32.992087 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:32.992132 (+    45us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:32.992161 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:34.599127 (+1606966us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b5400108e54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:17:34.599201 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:34.599474 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":579986304}
W20260709 12:17:34.625514 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 89954.9us
I20260709 12:17:34.628605 14042 leader_election.cc:290] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:34.629490 13680 raft_consensus.cc:3055] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:34.619112 14117 raft_consensus.cc:515] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:34.597586 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:34.636390 11520 raft_consensus.cc:2468] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 9.
I20260709 12:17:34.629997 13680 raft_consensus.cc:740] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:34.639307 11526 raft_consensus.cc:1240] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:34.640576 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:34.641314 11524 raft_consensus.cc:2468] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 6.
I20260709 12:17:34.643752 12203 leader_election.cc:304] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:34.644693 13991 raft_consensus.cc:493] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:34.645038 14216 raft_consensus.cc:493] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:34.645816 14216 raft_consensus.cc:515] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:34.648192 11528 raft_consensus.cc:2468] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 9.
I20260709 12:17:34.647650 11526 raft_consensus.cc:2468] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 6.
I20260709 12:17:34.654444 14211 raft_consensus.cc:2804] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:34.655047 14211 raft_consensus.cc:493] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:34.655478 14211 raft_consensus.cc:3060] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:34.657495 11522 raft_consensus.cc:2468] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 10.
W20260709 12:17:34.658634 14269 log.cc:927] Time spent T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:17:34.659291 14216 leader_election.cc:290] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:34.657658 11519 raft_consensus.cc:1240] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:34.660455 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:34.661201 11525 raft_consensus.cc:3060] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:34.662254 12348 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51690 (request call id 776) took 1725 ms. Trace:
I20260709 12:17:34.660358 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:34.662727 12348 rpcz_store.cc:276] 0709 12:17:32.937112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:33.397181 (+460069us) service_pool.cc:224] Handling call
0709 12:17:34.452067 (+1054886us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:34.482968 (+ 30901us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:34.661973 (+179005us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540000aad0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc28ad 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:34.662182 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2424864000}
I20260709 12:17:34.662254 13680 consensus_queue.cc:260] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:34.666213 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:34.667228 11526 raft_consensus.cc:2468] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 8.
I20260709 12:17:34.646811 14099 raft_consensus.cc:493] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
W20260709 12:17:34.669523 11567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:34.669216 14099 raft_consensus.cc:515] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:34.670961 13680 raft_consensus.cc:3060] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:34.673796 14210 consensus_queue.cc:1059] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:34.674937 14210 raft_consensus.cc:3055] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:34.675344 14210 raft_consensus.cc:740] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:34.675514 14216 consensus_queue.cc:1059] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:34.676378 14216 consensus_queue.cc:1243] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer 1c101e338f954ef086338e251deed19d log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:17:34.677361 14215 leader_election.cc:290] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:34.300340 12357 rpcz_store.cc:276] 0709 12:17:32.443961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:32.779434 (+335473us) service_pool.cc:224] Handling call
0709 12:17:32.779723 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:32.779930 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:17:34.076158 (+1296228us) log.cc:844] Serialized 14 byte log entry
0709 12:17:34.299509 (+223351us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:34.299571 (+    62us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:34.299620 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:34.299698 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:34.299824 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1253942,"prepare.queue_time_us":1184251,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":81892,"thread_start_us":252527,"threads_started":2}
I20260709 12:17:34.662381 13991 raft_consensus.cc:515] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:34.687813 13991 leader_election.cc:290] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:34.688409 14215 raft_consensus.cc:3055] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:34.690841 14117 leader_election.cc:290] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:34.691637 14117 raft_consensus.cc:493] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:34.692253 14117 raft_consensus.cc:515] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:34.694458 13580 raft_consensus.cc:515] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:34.659368 13910 leader_election.cc:290] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:34.676615 14210 consensus_queue.cc:260] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:34.707100 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:34.708168 11453 raft_consensus.cc:3060] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:34.709820 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:34.711498 14161 leader_election.cc:290] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:34.689091 14215 raft_consensus.cc:740] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:34.619292 14187 consensus_queue.cc:237] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:34.725953 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ed4eeff0ae44d0bc1ebb8cbe3adea5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:34.673048 14099 leader_election.cc:290] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:34.715193 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:34.723923 12204 leader_election.cc:304] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:34.725766 11527 raft_consensus.cc:1275] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:17:34.713312 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
W20260709 12:17:34.738574 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 85342.8us
I20260709 12:17:34.685222 14105 leader_election.cc:290] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:34.718763 14117 leader_election.cc:290] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:34.744305 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:34.752576 11522 raft_consensus.cc:3060] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:34.743733 11419 leader_election.cc:304] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:34.743988 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:34.759887 13627 raft_consensus.cc:493] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:34.760744 13627 raft_consensus.cc:515] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:34.763651 11526 raft_consensus.cc:1275] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:17:34.765519 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:34.766384 11448 raft_consensus.cc:3060] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Advancing to term 9
W20260709 12:17:34.769840 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 46207.8us
I20260709 12:17:34.770716 12204 leader_election.cc:304] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:34.772131 14099 raft_consensus.cc:2749] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:34.773518 13995 raft_consensus.cc:493] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:34.774101 13995 raft_consensus.cc:515] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:34.775833 13939 raft_consensus.cc:2749] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:34.769706 11449 raft_consensus.cc:2393] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 7: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:34.776702 13995 leader_election.cc:290] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:34.778463 14210 raft_consensus.cc:3060] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:34.780689 12204 leader_election.cc:304] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:34.781912 11453 raft_consensus.cc:2468] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 7.
I20260709 12:17:34.784951 11450 raft_consensus.cc:1240] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:34.785554 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:34.786322 11454 raft_consensus.cc:2468] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 8.
I20260709 12:17:34.787321 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:34.787588 11418 leader_election.cc:304] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:34.788256 11449 raft_consensus.cc:2410] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:17:34.788661 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:34.789716 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d43eecbad746fd9ddce50c5b9fc3e8" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:34.790246 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:34.791672 14177 raft_consensus.cc:493] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:34.792295 14177 raft_consensus.cc:515] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:34.794696 14177 leader_election.cc:290] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:34.795765 11448 raft_consensus.cc:2468] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 9.
W20260709 12:17:34.792155 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 96129.9us
I20260709 12:17:34.796540 14178 raft_consensus.cc:2749] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:34.797070 11419 leader_election.cc:304] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:34.802021 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ed4eeff0ae44d0bc1ebb8cbe3adea5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:34.802321 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:34.803220 11598 raft_consensus.cc:2393] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 10: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:17:34.803653 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:17:34.804037 11568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:34.805011 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:34.718608 14215 consensus_queue.cc:260] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:34.809463 11600 raft_consensus.cc:1275] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:17:34.714447 14064 raft_consensus.cc:515] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
W20260709 12:17:34.802742 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 57462.9us
W20260709 12:17:34.825945 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 45347.8us
I20260709 12:17:34.829133 11525 raft_consensus.cc:2468] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 9.
W20260709 12:17:34.842505 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 55046.2us
I20260709 12:17:34.801041 14258 raft_consensus.cc:515] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:34.763712 13627 leader_election.cc:290] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:34.858960 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:34.850672 14161 raft_consensus.cc:2804] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:34.849979 13580 leader_election.cc:290] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:34.866515 11522 raft_consensus.cc:2468] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 7.
I20260709 12:17:34.858476 14177 raft_consensus.cc:2804] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:34.865316 11418 leader_election.cc:304] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
W20260709 12:17:34.871168 14260 log.cc:927] Time spent T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:17:34.871698 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:34.872663 11595 raft_consensus.cc:2468] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 5.
W20260709 12:17:34.873939 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 55817.6us
W20260709 12:17:34.877357 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 80427.9us
W20260709 12:17:34.877743 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 50991.3us
W20260709 12:17:34.829499 14117 consensus_queue.cc:1175] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a03223e9e41247c3a36b7b7c3d476671" responder_term: 9 status { last_received { term: 6 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 8. Current term is 9. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:17:34.878614 12204 leader_election.cc:304] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:34.877008 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:34.879560 12204 leader_election.cc:304] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:34.869140 14192 raft_consensus.cc:2804] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:34.876566 14064 leader_election.cc:290] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:34.880965 14192 raft_consensus.cc:697] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 9 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:34.881460 14134 raft_consensus.cc:2804] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:34.887606 14134 raft_consensus.cc:493] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Starting leader election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:34.842922 14211 raft_consensus.cc:515] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:34.871086 14177 raft_consensus.cc:493] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:34.864584 14161 raft_consensus.cc:493] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:34.883169 11566 leader_election.cc:304] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:34.898756 11593 raft_consensus.cc:2468] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 7.
I20260709 12:17:34.867664 13806 raft_consensus.cc:493] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:34.888149 14134 raft_consensus.cc:3060] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:34.916115 12204 leader_election.cc:304] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:34.881045 14065 raft_consensus.cc:2804] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:34.911705 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d43eecbad746fd9ddce50c5b9fc3e8" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:34.910538 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e4724ed93a467ea47763eec9a6de2e" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:34.900775 14177 raft_consensus.cc:3060] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:34.921806 11593 raft_consensus.cc:2393] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 8: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:34.901602 14161 raft_consensus.cc:3060] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:34.921886 12204 leader_election.cc:304] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
W20260709 12:17:34.922745 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 46359.3us
I20260709 12:17:34.901932 14187 raft_consensus.cc:2804] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:34.928431 14190 raft_consensus.cc:2804] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:34.929081 14163 raft_consensus.cc:2804] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:34.921370 14117 consensus_queue.cc:1048] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 12:17:34.930284 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:34.932576 12203 leader_election.cc:304] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:34.938102 11419 leader_election.cc:304] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:34.944362 11524 raft_consensus.cc:1275] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:34.902382 14075 consensus_queue.cc:1048] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 12:17:34.945148 13806 raft_consensus.cc:515] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:34.918465 14065 raft_consensus.cc:493] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:34.946313 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:34.945873 11520 raft_consensus.cc:1275] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:34.918630 14153 raft_consensus.cc:2804] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:34.974613 11527 raft_consensus.cc:2410] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:17:34.976289 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8741606df54c3f8b5cc5c1141862ea" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:34.976776 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:34.956650 11593 raft_consensus.cc:1275] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:17:34.977497 11522 raft_consensus.cc:3060] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:34.980229 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:34.985685 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:34.952648 14190 raft_consensus.cc:697] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 9 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:34.952960 14187 raft_consensus.cc:697] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 9 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:34.977430 14153 raft_consensus.cc:493] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:35.020861 14211 leader_election.cc:290] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:35.021085 14153 raft_consensus.cc:3060] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:35.021564 14187 consensus_queue.cc:237] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:34.952895 14178 consensus_queue.cc:1059] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:17:34.976505 14192 consensus_queue.cc:237] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:35.025147 14178 raft_consensus.cc:3055] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:34.975970 13910 raft_consensus.cc:2749] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:17:35.025364 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 92866.5us
I20260709 12:17:34.989462 13627 raft_consensus.cc:2804] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:35.026577 13627 raft_consensus.cc:697] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:35.026897 12203 leader_election.cc:304] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:35.027328 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:35.027559 13627 consensus_queue.cc:237] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:35.028122 11453 raft_consensus.cc:2468] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 8.
I20260709 12:17:34.973930 14163 raft_consensus.cc:697] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:34.993530 14190 consensus_queue.cc:237] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:34.974565 14065 raft_consensus.cc:3060] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:35.029531 14163 consensus_queue.cc:237] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:34.997787 14258 leader_election.cc:290] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 9 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:17:34.998606 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 60642.1us
W20260709 12:17:34.999279 11493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:35.002972 14064 consensus_queue.cc:1048] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:35.003434 14177 raft_consensus.cc:515] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:35.005225 14161 raft_consensus.cc:515] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:35.005599 13991 consensus_queue.cc:1059] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:35.007604 11521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33446 (request call id 1313) took 1276 ms. Trace:
I20260709 12:17:35.007866 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffe47647c274723808482c166efa21c" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:35.009115 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:35.009878 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:35.011231 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:35.011230 11593 raft_consensus.cc:1275] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:35.012840 11596 raft_consensus.cc:1275] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:17:35.013156 11601 raft_consensus.cc:1240] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 8. Current term is 9. Ops: []
W20260709 12:17:35.019939 14273 log.cc:927] Time spent T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.201s	user 0.002s	sys 0.000s
I20260709 12:17:35.034017 14178 raft_consensus.cc:740] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:35.047539 11521 rpcz_store.cc:276] 0709 12:17:33.731016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:33.731160 (+   144us) service_pool.cc:224] Handling call
0709 12:17:33.758344 (+ 27184us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:34.481006 (+722662us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:35.007308 (+526302us) spinlock_profiling.cc:243] Waited 698 ms on lock 0x7b5400178754. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:17:35.007539 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1604380032}
I20260709 12:17:35.069680 14134 raft_consensus.cc:515] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:35.072770 14134 leader_election.cc:290] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 10 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:35.074277 14178 consensus_queue.cc:260] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:35.074791 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:35.075673 14178 raft_consensus.cc:3060] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:35.077991 14215 raft_consensus.cc:3060] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:35.084941 11522 raft_consensus.cc:2468] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 8.
W20260709 12:17:35.090807 11418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:35.094937 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7937e0cff84ef7a26c84247c8ffc08" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:35.053191 14211 raft_consensus.cc:2804] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:35.095621 11600 raft_consensus.cc:2393] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 6: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:17:35.095682 11448 raft_consensus.cc:3060] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:35.093197 11602 raft_consensus.cc:2468] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 8.
I20260709 12:17:35.098182 11453 raft_consensus.cc:1240] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:17:35.102597 11525 raft_consensus.cc:2468] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 10.
I20260709 12:17:35.108462 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7937e0cff84ef7a26c84247c8ffc08" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:35.110052 12203 leader_election.cc:304] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:35.111334 11593 raft_consensus.cc:1275] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:17:32.785753  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:35.116530 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:35.118518 11527 raft_consensus.cc:3060] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:35.122855 11525 raft_consensus.cc:1275] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:17:35.097508 14211 raft_consensus.cc:493] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting leader election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:35.122246 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e4724ed93a467ea47763eec9a6de2e" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:35.097236 14065 raft_consensus.cc:515] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:35.114548 14134 raft_consensus.cc:2749] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:35.133810 12203 leader_election.cc:304] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:35.140689 11596 raft_consensus.cc:1275] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 11 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 12:17:35.142887 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 88987.7us
I20260709 12:17:35.129840 14211 raft_consensus.cc:3060] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:35.146420 12203 leader_election.cc:304] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:35.145805 13991 raft_consensus.cc:2749] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:35.147724 14177 leader_election.cc:290] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:35.147778 14216 consensus_queue.cc:1048] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:35.153841 12347 raft_consensus.cc:1275] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:17:35.131755 13910 raft_consensus.cc:493] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:35.158520 12204 leader_election.cc:304] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:35.159718 11566 leader_election.cc:304] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:35.160493 14198 consensus_queue.cc:1048] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:35.184298 13991 raft_consensus.cc:2749] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:35.165796 13984 consensus_queue.cc:1048] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:17:35.166553 14206 consensus_queue.cc:1048] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:17:35.176633 12203 leader_election.cc:304] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d
I20260709 12:17:35.165079 13806 leader_election.cc:290] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:35.161456 13863 consensus_queue.cc:1059] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.074s
I20260709 12:17:35.206785 11419 leader_election.cc:304] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8
W20260709 12:17:35.213805 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 98179.9us
I20260709 12:17:35.214778 11417 leader_election.cc:304] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:35.219641 14161 leader_election.cc:290] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:17:35.220709 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 44263us
I20260709 12:17:35.221742 12203 leader_election.cc:304] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:35.223004 12203 leader_election.cc:304] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d
I20260709 12:17:35.220825 14117 raft_consensus.cc:2804] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:35.222867 14134 raft_consensus.cc:2749] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:17:35.188341 14105 raft_consensus.cc:2804] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:35.237797 11527 raft_consensus.cc:2468] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 9.
I20260709 12:17:35.231186 14117 raft_consensus.cc:493] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:35.228348 12203 leader_election.cc:304] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:35.229370 11448 raft_consensus.cc:2468] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 2.
I20260709 12:17:35.224377 13863 raft_consensus.cc:2804] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:35.205760 11567 leader_election.cc:304] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:35.235064 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:35.188282 13939 raft_consensus.cc:2804] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:35.249049 12347 raft_consensus.cc:2468] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 5.
I20260709 12:17:35.241029 14087 raft_consensus.cc:3055] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:35.257148 14087 raft_consensus.cc:740] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:35.259979 11417 leader_election.cc:304] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:35.261410 13939 raft_consensus.cc:697] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 10 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:35.240944 11276 catalog_manager.cc:5697] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 2 to 4, leader changed from a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131) to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 4 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:35.264827 11568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:35.264812 13939 consensus_queue.cc:237] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:35.268623 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:35.269464 12357 raft_consensus.cc:3060] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:35.270949 14099 consensus_queue.cc:1048] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:17:35.273151 13863 raft_consensus.cc:697] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:35.265825 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:35.235949 14068 raft_consensus.cc:2749] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:35.244884 14117 raft_consensus.cc:3060] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:35.282294 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 96352.4us
I20260709 12:17:35.286477 14065 leader_election.cc:290] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:35.287159 14198 raft_consensus.cc:2804] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:35.287591 14198 raft_consensus.cc:493] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:35.287959 14198 raft_consensus.cc:3060] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:35.282354 13991 consensus_queue.cc:1048] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:17:35.289768 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:35.290303 11566 leader_election.cc:304] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:35.291127 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:35.292136 14206 raft_consensus.cc:2804] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:35.292708 14206 raft_consensus.cc:697] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:35.293252 12352 raft_consensus.cc:1275] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:17:35.255118 14105 raft_consensus.cc:697] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:35.292361 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:35.237972 14153 raft_consensus.cc:515] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:35.265787 14192 raft_consensus.cc:2804] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:35.300259 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:35.304440 12359 raft_consensus.cc:2410] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:17:35.304715 12349 raft_consensus.cc:1240] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:35.305316 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:35.188669 14258 consensus_queue.cc:1048] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 12:17:35.305938 12361 raft_consensus.cc:3060] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:35.316434 11595 raft_consensus.cc:2393] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 6: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:17:35.317458 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:35.316718 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:35.318886 11523 raft_consensus.cc:3060] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:35.274551 13863 consensus_queue.cc:237] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:35.318383 12352 raft_consensus.cc:2468] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 7.
I20260709 12:17:35.189229 13910 raft_consensus.cc:515] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:35.300340 14192 raft_consensus.cc:697] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 9 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:35.353458 12345 raft_consensus.cc:1240] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:35.355468 14105 consensus_queue.cc:237] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:35.305751 14193 raft_consensus.cc:2749] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:17:35.357486 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:17:35.359454 11567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:35.361122 12349 raft_consensus.cc:2393] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 7: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:17:35.362376 12346 raft_consensus.cc:1275] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 11 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:17:35.367955 12357 raft_consensus.cc:2468] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 10.
I20260709 12:17:35.370730 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:35.263857 14087 consensus_queue.cc:260] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:35.372982 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:35.371747 14137 raft_consensus.cc:3060] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:35.313601 14206 consensus_queue.cc:237] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:35.392222 14100 raft_consensus.cc:3055] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:35.397768 14087 raft_consensus.cc:3060] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:35.409121 14279 log.cc:927] Time spent T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
W20260709 12:17:35.415907 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 229186us
I20260709 12:17:35.407050 14100 raft_consensus.cc:740] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:35.417811 14257 raft_consensus.cc:493] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:35.435583 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 175672us
I20260709 12:17:35.447646 11419 leader_election.cc:304] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
W20260709 12:17:35.449292 11493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 192224us
I20260709 12:17:35.450964 11493 leader_election.cc:304] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:35.440511 14153 leader_election.cc:290] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:35.453795 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:35.446835 14193 consensus_queue.cc:1048] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:17:35.451215 14298 consensus_queue.cc:1059] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:17:35.445104 14257 raft_consensus.cc:515] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:35.454679 11521 raft_consensus.cc:2393] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 6: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:17:35.467463 11493 leader_election.cc:304] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:35.470582 11417 leader_election.cc:304] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:35.471511 14193 raft_consensus.cc:2749] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:35.471895 14298 raft_consensus.cc:3055] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:35.472321 14298 raft_consensus.cc:740] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:35.473284 14298 consensus_queue.cc:260] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
W20260709 12:17:35.474248 14291 log.cc:927] Time spent T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:17:35.475011 14298 raft_consensus.cc:3060] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:35.465292 14257 leader_election.cc:290] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:35.481760 11493 leader_election.cc:304] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
W20260709 12:17:35.483706 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 385208us
W20260709 12:17:35.506655 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 130963us
I20260709 12:17:35.506384 11600 raft_consensus.cc:3060] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:35.448518 14187 consensus_queue.cc:1048] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 12:17:35.444242 13811 consensus_queue.cc:1059] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 12:17:35.512236 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:35.429186 14192 consensus_queue.cc:237] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:35.517264 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:35.510823 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:17:35.520926 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 46812.8us
I20260709 12:17:35.454527 14042 consensus_queue.cc:1048] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:17:35.521672 11601 raft_consensus.cc:2468] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 7.
I20260709 12:17:35.504312 13806 raft_consensus.cc:2749] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:17:35.513017 14193 raft_consensus.cc:493] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:35.534296 11567 leader_election.cc:304] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:35.553813 14153 raft_consensus.cc:2749] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:35.560642 14055 raft_consensus.cc:2749] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:35.548283 14193 raft_consensus.cc:515] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:35.531227 14100 consensus_queue.cc:260] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:35.581314 11567 leader_election.cc:304] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:35.558346 14257 consensus_queue.cc:1048] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:17:35.569868 13811 consensus_queue.cc:1243] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer b126028166e8480ba25541bf8f7fc6de log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:17:35.603422 11523 raft_consensus.cc:2468] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 9.
I20260709 12:17:35.622469 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:17:35.627102 14295 log.cc:927] Time spent T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:17:35.577081 14105 consensus_queue.cc:1059] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 12:17:35.632232 12204 leader_election.cc:304] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:35.628330 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:35.586956 14300 raft_consensus.cc:2749] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:35.586488 14117 raft_consensus.cc:515] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:35.646673 12203 leader_election.cc:304] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8
W20260709 12:17:35.647917 14303 log.cc:927] Time spent T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:17:35.649047 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:35.649822 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:35.658782 11453 raft_consensus.cc:3060] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:35.621975 13811 raft_consensus.cc:3055] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:35.624440 14301 raft_consensus.cc:2804] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:35.686668 14301 raft_consensus.cc:697] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:35.687667 14301 consensus_queue.cc:237] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
W20260709 12:17:35.689880 14297 log.cc:927] Time spent T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 12:17:35.663268 13811 raft_consensus.cc:740] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:35.696552 13811 consensus_queue.cc:260] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:35.697948 13811 raft_consensus.cc:3060] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:35.701591 11494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:35.702056 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:17:35.715272 11565 leader_election.cc:336] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Timed out: RequestConsensusVote RPC to 127.3.212.130:41579 timed out after 1.584s (SENT)
I20260709 12:17:35.715746 11565 leader_election.cc:304] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:35.689903 14137 raft_consensus.cc:2749] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:17:35.720489 14211 consensus_meta.cc:287] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de: Time spent flushing consensus metadata: real 0.545s	user 0.008s	sys 0.000s
I20260709 12:17:35.667349 14193 leader_election.cc:290] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:35.668359 13910 leader_election.cc:290] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
W20260709 12:17:35.673087 12205 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:35.661828 14306 raft_consensus.cc:2804] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:35.673816 14302 consensus_queue.cc:1048] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.087s
I20260709 12:17:35.675683 11453 raft_consensus.cc:2468] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 9.
I20260709 12:17:35.677772 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:35.681625 13939 raft_consensus.cc:2804] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:35.643191 14215 raft_consensus.cc:2804] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:35.685776 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:35.765019 11601 raft_consensus.cc:2468] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 7.
W20260709 12:17:35.722172 11568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:35.661109 12361 raft_consensus.cc:2468] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 6.
W20260709 12:17:35.732239 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 67649.8us
I20260709 12:17:35.763865 11596 raft_consensus.cc:2393] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 10: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
W20260709 12:17:35.779328 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 187982us
I20260709 12:17:35.779328 11521 raft_consensus.cc:1240] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:35.782410 11595 raft_consensus.cc:1275] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:17:35.780375 14198 raft_consensus.cc:515] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:35.675733 14117 leader_election.cc:290] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
W20260709 12:17:35.790148 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 209509us
I20260709 12:17:35.785106 11491 leader_election.cc:304] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:35.791698 11600 raft_consensus.cc:1275] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:17:35.764217 14306 raft_consensus.cc:493] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:35.803434 11493 leader_election.cc:304] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:35.785656 14258 raft_consensus.cc:2749] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:35.787410 13939 raft_consensus.cc:697] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [term 2 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:35.812014 11567 leader_election.cc:304] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:35.809273 13995 raft_consensus.cc:2804] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:35.799292 14306 raft_consensus.cc:3060] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:35.766647 14211 raft_consensus.cc:515] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:35.815388 11567 leader_election.cc:304] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:35.815773 11525 raft_consensus.cc:1240] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:35.820067 11419 leader_election.cc:304] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:35.820287 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:35.821110 11525 raft_consensus.cc:2393] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 8: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:17:35.798071 14190 raft_consensus.cc:493] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:35.805325 14064 raft_consensus.cc:2804] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:35.835908 12347 raft_consensus.cc:1240] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:35.821396 13580 raft_consensus.cc:2749] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:35.866729 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:17:35.868433 11565 leader_election.cc:336] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Timed out: RequestConsensusVote RPC to 127.3.212.130:41579 timed out after 1.520s (SENT)
I20260709 12:17:35.869107 11565 leader_election.cc:304] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:35.826596 13995 raft_consensus.cc:697] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 6 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:35.828686 14064 raft_consensus.cc:493] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:35.834725 14192 raft_consensus.cc:2749] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:17:35.870023 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 71848.9us
I20260709 12:17:35.821031 14105 consensus_queue.cc:1059] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:17:35.884459 12203 leader_election.cc:304] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:35.887019 11418 leader_election.cc:304] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:35.859373 14317 raft_consensus.cc:2749] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:35.842485 14190 raft_consensus.cc:515] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:35.867699 11525 raft_consensus.cc:2393] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 7: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:17:35.877045 14064 raft_consensus.cc:3060] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:35.901371 11527 raft_consensus.cc:1275] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:17:35.904249 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 96617.3us
W20260709 12:17:35.894196 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 88989.7us
I20260709 12:17:35.883176 13580 raft_consensus.cc:2749] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:35.960094 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:35.961887 11600 raft_consensus.cc:3060] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:35.965790 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 97404.6us
I20260709 12:17:35.970508 11521 raft_consensus.cc:1275] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:35.947232 14298 raft_consensus.cc:3060] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:35.982403 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:35.896047 13910 consensus_queue.cc:1059] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 12:17:35.976577 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffe47647c274723808482c166efa21c" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:35.991802 12348 raft_consensus.cc:3060] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:35.990199 11596 raft_consensus.cc:1275] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:17:36.002081 11527 raft_consensus.cc:1275] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:17:36.006349 11567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:36.006597 11600 raft_consensus.cc:2468] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 6.
I20260709 12:17:35.967736 14326 raft_consensus.cc:2749] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:35.896221 13939 consensus_queue.cc:237] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:36.010684 13580 raft_consensus.cc:493] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:36.029594 11565 leader_election.cc:336] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Timed out: RequestConsensusVote RPC to 127.3.212.130:41579 timed out after 1.673s (SENT)
I20260709 12:17:36.031932 11565 leader_election.cc:304] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
W20260709 12:17:36.036008 14322 log.cc:927] Time spent T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 12:17:36.037551 14319 log.cc:927] Time spent T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 12:17:36.024369 14198 leader_election.cc:290] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
W20260709 12:17:36.046052 14332 log.cc:927] Time spent T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 12:17:36.047637 14312 log.cc:927] Time spent T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 12:17:36.049868 14117 raft_consensus.cc:493] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:36.050499 14117 raft_consensus.cc:515] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:36.052531 14117 leader_election.cc:290] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:36.054668 14070 raft_consensus.cc:493] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:36.055239 14070 raft_consensus.cc:515] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:36.056354 13863 consensus_queue.cc:1048] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:36.056579 12348 raft_consensus.cc:2468] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 7.
I20260709 12:17:36.057153 14070 leader_election.cc:290] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
W20260709 12:17:36.058030 14323 log.cc:927] Time spent T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 12:17:36.060729 14198 raft_consensus.cc:2749] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:36.068444 11528 raft_consensus.cc:1275] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:36.021468 13995 consensus_queue.cc:237] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:36.082772 11567 leader_election.cc:304] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:36.085968 14329 raft_consensus.cc:493] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.086211 14337 raft_consensus.cc:2804] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:36.086848 14337 raft_consensus.cc:697] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 7 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:36.084057 13580 raft_consensus.cc:515] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
W20260709 12:17:36.088296 14304 log.cc:927] Time spent T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.471s	user 0.000s	sys 0.003s
I20260709 12:17:36.088096 14337 consensus_queue.cc:237] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:36.089697 14328 raft_consensus.cc:493] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.101300 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:36.102294 12348 raft_consensus.cc:2468] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 7.
I20260709 12:17:36.103502 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:36.106752 12345 raft_consensus.cc:2410] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:17:36.107812 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:36.114710 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:36.117940 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d43eecbad746fd9ddce50c5b9fc3e8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:36.115777 12352 raft_consensus.cc:2468] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 5.
I20260709 12:17:36.084816 14211 leader_election.cc:290] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:36.090265 14328 raft_consensus.cc:515] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:36.129153 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffe47647c274723808482c166efa21c" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:36.143392 12357 raft_consensus.cc:2368] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 6. Current term is 7.
I20260709 12:17:36.103525 13580 leader_election.cc:290] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
W20260709 12:17:36.142093 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 92091.1us
I20260709 12:17:36.130837 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:36.156991 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:36.160337 12345 raft_consensus.cc:2410] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:17:36.160652 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:36.163462 12348 raft_consensus.cc:2410] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:17:36.164064 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:36.165021 12352 raft_consensus.cc:2410] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:17:36.164181 11450 raft_consensus.cc:1240] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:36.167591 11451 raft_consensus.cc:1275] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:17:36.114647 14065 consensus_queue.cc:1048] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:17:36.086568 14329 raft_consensus.cc:515] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:36.169059 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:36.121570 13991 consensus_queue.cc:1048] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:17:36.193426 11450 raft_consensus.cc:1240] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:36.202646 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:36.205081 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:36.121304 11600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "a03223e9e41247c3a36b7b7c3d476671"
 from {username='slave'} at 127.0.0.1:37992
I20260709 12:17:36.206037 12349 raft_consensus.cc:2410] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:17:36.206521 11600 raft_consensus.cc:606] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 LEADER]: Received request to transfer leadership to TS a03223e9e41247c3a36b7b7c3d476671
W20260709 12:17:36.207541 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 114808us
I20260709 12:17:36.191414 14134 raft_consensus.cc:493] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:36.208626 12203 leader_election.cc:304] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:36.228236 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffe47647c274723808482c166efa21c" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
W20260709 12:17:36.232193 11568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:36.234380 11450 raft_consensus.cc:2468] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 5.
I20260709 12:17:36.220700 14134 raft_consensus.cc:515] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:36.239357 14298 raft_consensus.cc:2749] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:36.241271 14329 leader_election.cc:290] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:36.243997 13984 raft_consensus.cc:3055] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:36.244524 13984 raft_consensus.cc:740] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:36.248399 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:36.251534 14306 raft_consensus.cc:515] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
W20260709 12:17:36.252817 14338 log.cc:927] Time spent T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 12:17:36.253943 13910 raft_consensus.cc:493] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.254530 13910 raft_consensus.cc:515] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:36.256676 13910 leader_election.cc:290] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:36.222033 14065 raft_consensus.cc:2804] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:36.257725 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a841f2f09ced40a4bbf33594e11bd7ad" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:36.261276 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:36.262571 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:36.264190 12345 raft_consensus.cc:1240] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:36.264386 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:36.265846 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:36.266028 14328 leader_election.cc:290] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:17:36.267841 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 45255.6us
I20260709 12:17:36.269553 11601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "1c101e338f954ef086338e251deed19d"
 from {username='slave'} at 127.0.0.1:37992
I20260709 12:17:36.270553 13984 consensus_queue.cc:260] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:36.272045 13984 raft_consensus.cc:3060] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:36.272476 14306 leader_election.cc:290] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:36.273362 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a841f2f09ced40a4bbf33594e11bd7ad" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:36.273626 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:36.274816 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:36.275372 12356 raft_consensus.cc:1275] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:36.276304 11450 raft_consensus.cc:1275] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:36.244053 14064 raft_consensus.cc:515] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:36.283282 14190 leader_election.cc:290] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:36.285573 14064 leader_election.cc:290] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:36.286638 14100 raft_consensus.cc:3060] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:36.287021 11445 raft_consensus.cc:2410] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:17:36.287752 11450 raft_consensus.cc:1275] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:36.288419 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:36.289139 11445 raft_consensus.cc:2468] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 8.
I20260709 12:17:36.290449 12359 raft_consensus.cc:2468] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 8.
I20260709 12:17:36.290302 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a841f2f09ced40a4bbf33594e11bd7ad" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:36.291271 12352 raft_consensus.cc:1275] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:36.292043 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:36.295077 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:36.300042 11600 raft_consensus.cc:2468] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 9.
I20260709 12:17:36.288797 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:36.307510 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:36.308106 11453 raft_consensus.cc:3060] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:17:36.311003 11494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:36.301184 11450 raft_consensus.cc:2376] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 7. Re-sending same reply.
I20260709 12:17:36.314486 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:36.316267 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:36.317344 11450 raft_consensus.cc:2410] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:17:36.319209 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:36.324249 11597 raft_consensus.cc:1275] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:36.324319 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:36.326351 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:36.298166 14065 raft_consensus.cc:697] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 6 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:36.328501 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:36.328299 14065 consensus_queue.cc:237] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:36.329110 11519 raft_consensus.cc:2468] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 8.
I20260709 12:17:36.326606 11521 raft_consensus.cc:1240] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:36.327224 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:36.327281 11599 raft_consensus.cc:2410] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:36.336014 11449 raft_consensus.cc:1275] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:36.337886 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:36.338589 11450 raft_consensus.cc:2376] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 7. Re-sending same reply.
I20260709 12:17:36.339545 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:36.341104 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffe47647c274723808482c166efa21c" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:36.337209 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:36.340113 11450 raft_consensus.cc:2376] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 8. Re-sending same reply.
I20260709 12:17:36.338270 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390e91331fd04f97a5235133a34875ee" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:36.342036 11445 raft_consensus.cc:3060] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:17:36.348037 11452 raft_consensus.cc:3055] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:36.349880 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:36.333130 14134 leader_election.cc:290] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:36.348559 11452 raft_consensus.cc:740] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:36.317472 14064 raft_consensus.cc:493] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.356858 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:36.325083 14190 raft_consensus.cc:493] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.362675 14120 consensus_queue.cc:1048] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:36.367825 11448 raft_consensus.cc:2468] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 8.
I20260709 12:17:36.361629 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:36.369659 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:36.354593 11452 consensus_queue.cc:260] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:36.373628 11450 raft_consensus.cc:2468] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 8.
I20260709 12:17:36.371026 12359 raft_consensus.cc:1240] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:36.373768 11452 raft_consensus.cc:3060] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:36.369660 11454 raft_consensus.cc:2393] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 9: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:36.377023 11419 leader_election.cc:304] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:36.378788 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:36.376045 14190 raft_consensus.cc:515] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:36.382244 14190 leader_election.cc:290] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:17:36.383702 12206 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:36.389132 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:36.389935 11528 raft_consensus.cc:2468] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 10.
I20260709 12:17:36.391345 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:36.395989 14068 raft_consensus.cc:2804] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:36.396510 14068 raft_consensus.cc:493] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:36.396917 14068 raft_consensus.cc:3060] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:36.404712 11419 leader_election.cc:304] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:36.404243 11276 catalog_manager.cc:5697] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:36.396066 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:36.405599 11452 raft_consensus.cc:1275] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:17:36.406176 11452 pending_rounds.cc:85] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d: Aborting all ops after (but not including) 4
I20260709 12:17:36.406399 11452 pending_rounds.cc:107] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:17:36.406656 11452 raft_consensus.cc:2889] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:36.406831 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
W20260709 12:17:36.407236 14193 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
W20260709 12:17:36.401037 11273 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57440 (request call id 181) took 20677 ms (client timeout 15000 ms). Trace:
I20260709 12:17:36.406899 11276 catalog_manager.cc:5697] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:36.407713 11454 raft_consensus.cc:2393] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 9: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:36.411171 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:36.411854 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:36.409929 11453 raft_consensus.cc:2468] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 9.
I20260709 12:17:36.413314 11276 catalog_manager.cc:5697] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 4 to 6, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 6 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:36.414964 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
W20260709 12:17:36.416517 14321 log.cc:927] Time spent T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.455s	user 0.001s	sys 0.002s
I20260709 12:17:36.443123 11454 raft_consensus.cc:2393] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 8: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:36.422585 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
W20260709 12:17:36.409541 11273 rpcz_store.cc:269] 0709 12:17:15.723299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:15.723736 (+   437us) service_pool.cc:224] Handling call
0709 12:17:36.400809 (+20677073us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:27.374915 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:27.391475 (+ 16560us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:27.391524 (+    49us) write_op.cc:435] Acquired schema lock
0709 12:17:27.391545 (+    21us) tablet.cc:662] Decoding operations
0709 12:17:27.392621 (+  1076us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:27.392783 (+   162us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:27.392810 (+    27us) tablet.cc:685] Acquiring locks for 12 operations
0709 12:17:27.447660 (+ 54850us) tablet.cc:701] Row locks acquired
0709 12:17:27.447712 (+    52us) write_op.cc:260] PREPARE: finished
0709 12:17:27.447897 (+   185us) write_op.cc:270] Start()
0709 12:17:27.448053 (+   156us) write_op.cc:276] Timestamp: P: 1783599447447830 usec, L: 0
0709 12:17:27.448075 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:17:27.448826 (+   751us) log.cc:844] Serialized 4801 byte log entry
0709 12:17:28.237093 (+788267us) op_driver.cc:464] REPLICATION: finished
0709 12:17:28.466595 (+229502us) write_op.cc:301] APPLY: starting
0709 12:17:28.474890 (+  8295us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:28.481993 (+  7103us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:28.490396 (+  8403us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:28.516670 (+ 26274us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:28.516982 (+   312us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 12:17:28.517034 (+    52us) write_op.cc:312] APPLY: finished
0709 12:17:28.517401 (+   367us) log.cc:844] Serialized 88 byte log entry
0709 12:17:28.517602 (+   201us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:28.517794 (+   192us) write_op.cc:454] Released schema lock
0709 12:17:28.517869 (+    75us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:28.518320 (+   451us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:28.518346 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":124702,"reported_tablets":32,"child_traces":[["op",{"apply.queue_time_us":209136,"apply.run_cpu_time_us":4525,"apply.run_wall_time_us":62525,"num_ops":12,"prepare.queue_time_us":560087,"prepare.run_cpu_time_us":47014,"prepare.run_wall_time_us":319677,"raft.queue_time_us":215927,"raft.run_cpu_time_us":10217,"raft.run_wall_time_us":174000,"replication_time_us":788080,"thread_start_us":754521,"threads_started":4,"wal-append.queue_time_us":356561,"wal-append.run_cpu_time_us":39698,"wal-append.run_wall_time_us":1755994}]]}
I20260709 12:17:36.424512 12346 raft_consensus.cc:1240] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 6 LEADER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:36.428671 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
W20260709 12:17:36.430531 14320 log.cc:927] Time spent T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.460s	user 0.000s	sys 0.001s
W20260709 12:17:36.432331 14351 log.cc:927] Time spent T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 12:17:36.440851 11445 raft_consensus.cc:2468] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 7.
I20260709 12:17:36.443307 12357 raft_consensus.cc:2468] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 9.
I20260709 12:17:36.445271 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:36.446190 11448 raft_consensus.cc:2468] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 7.
I20260709 12:17:36.452036 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:36.370801 14064 raft_consensus.cc:515] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:36.452935 11276 catalog_manager.cc:5697] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 2 to 4, leader changed from a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131) to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 4 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } }
W20260709 12:17:36.453776 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 86809.8us
I20260709 12:17:36.454475 11452 raft_consensus.cc:2393] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 8: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
W20260709 12:17:36.441061 14324 log.cc:927] Time spent T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.476s	user 0.000s	sys 0.002s
I20260709 12:17:36.534206 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:36.535202 11445 raft_consensus.cc:2393] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 10: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:36.540488 11524 raft_consensus.cc:1275] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:36.548043 12347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51690 (request call id 790) took 1259 ms. Trace:
I20260709 12:17:36.548514 12347 rpcz_store.cc:276] 0709 12:17:35.288419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:35.354501 (+ 66082us) service_pool.cc:224] Handling call
0709 12:17:35.354784 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:35.842071 (+487287us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:36.547802 (+705731us) spinlock_profiling.cc:243] Waited 481 ms on lock 0x7b540000a5d4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:17:36.547985 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1105889664}
I20260709 12:17:36.551019 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:36.551721 11451 raft_consensus.cc:3060] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:36.550364 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:36.556466 11454 raft_consensus.cc:2468] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 7.
I20260709 12:17:36.444873 13910 raft_consensus.cc:2749] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:36.557528 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:36.556910 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:36.565225 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:36.539992 14100 raft_consensus.cc:493] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:36.568094 11491 leader_election.cc:336] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Timed out: RequestConsensusVote RPC to 127.3.212.130:41579 timed out after 1.527s (SENT)
I20260709 12:17:36.568917 11491 leader_election.cc:304] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
W20260709 12:17:36.569988 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 165413us
I20260709 12:17:36.570150 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:36.569988 11276 catalog_manager.cc:5697] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:36.572293 11598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 903) took 1069 ms. Trace:
I20260709 12:17:36.571990 11276 catalog_manager.cc:5697] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 2 to 4, leader changed from a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131) to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 4 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:36.572707 11598 rpcz_store.cc:276] 0709 12:17:35.503300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:35.503437 (+   137us) service_pool.cc:224] Handling call
0709 12:17:35.514122 (+ 10685us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:35.532808 (+ 18686us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:35.532837 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:35.546381 (+ 13544us) log.cc:844] Serialized 26 byte log entry
0709 12:17:35.809748 (+263367us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:35.809792 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:35.809868 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:36.440490 (+630622us) spinlock_profiling.cc:243] Waited 6.89 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e675e86e 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221 00007f84e67671d9 00007f84e6767169
0709 12:17:36.571983 (+131493us) raft_consensus.cc:1685] finished
0709 12:17:36.572007 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:36.572230 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4683,"raft.queue_time_us":10396,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":5235,"spinlock_wait_cycles":15836416,"thread_start_us":234347,"threads_started":1,"wal-append.queue_time_us":328706}
I20260709 12:17:36.573850 11276 catalog_manager.cc:5697] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 3 to 5, leader changed from 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132) to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 5 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:36.574874 14064 leader_election.cc:290] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:36.550225 14193 raft_consensus.cc:493] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.577471 14100 raft_consensus.cc:515] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:36.578529 11593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55252 (request call id 904) took 1068 ms. Trace:
I20260709 12:17:36.578972 11593 rpcz_store.cc:276] 0709 12:17:35.510282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:35.510436 (+   154us) service_pool.cc:224] Handling call
0709 12:17:35.510774 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:35.530624 (+ 19850us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:35.530662 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:35.548145 (+ 17483us) log.cc:844] Serialized 26 byte log entry
0709 12:17:35.812520 (+264375us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:35.812567 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:35.812698 (+   131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:36.415916 (+603218us) spinlock_profiling.cc:243] Waited 3.48 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e675e86e 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221 00007f84e67671d9 00007f84e6767169
0709 12:17:36.578220 (+162304us) raft_consensus.cc:1685] finished
0709 12:17:36.578244 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:36.578467 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7615,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":4632,"spinlock_wait_cycles":8008576,"thread_start_us":234325,"threads_started":1,"wal-append.queue_time_us":317376}
I20260709 12:17:36.580003 14100 leader_election.cc:290] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:36.581408 11526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33446 (request call id 1342) took 1341 ms. Trace:
I20260709 12:17:36.582237 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:36.583849 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:36.540584 13991 raft_consensus.cc:493] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.586045 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:36.581795 11526 rpcz_store.cc:276] 0709 12:17:35.239664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:35.240153 (+   489us) service_pool.cc:224] Handling call
0709 12:17:35.254429 (+ 14276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:35.546711 (+292282us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:35.546751 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:35.564656 (+ 17905us) log.cc:844] Serialized 26 byte log entry
0709 12:17:35.685696 (+121040us) spinlock_profiling.cc:243] Waited 25.5 ms on lock 0x7b4800060558. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ebaecaa1 00007f84ebae3b37 00007f84ebae39ca 00007f84ebbdb26f 00007f84ebbdaf37 00007f84ebbef55c 00007f84ebbef508 00007f84ebbef488 00007f84ebbef443 00007f84ebbee6ec 00007f84eab18a96
0709 12:17:35.807178 (+121482us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:35.807223 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:35.807296 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:36.429783 (+622487us) spinlock_profiling.cc:243] Waited 2.82 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e675e86e 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221 00007f84e67671d9 00007f84e6767169
0709 12:17:36.581176 (+151393us) raft_consensus.cc:1685] finished
0709 12:17:36.581207 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:36.581328 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":194357,"raft.queue_time_us":199536,"raft.run_cpu_time_us":1767,"raft.run_wall_time_us":229103,"spinlock_wait_cycles":65248896,"thread_start_us":298682,"threads_started":2,"wal-append.queue_time_us":288955}
I20260709 12:17:36.588986 11451 raft_consensus.cc:2468] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 7.
I20260709 12:17:36.590334 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:36.590685 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:36.587538 11446 raft_consensus.cc:2393] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 8: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:36.566138 11445 raft_consensus.cc:2468] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 5.
I20260709 12:17:36.597296 12203 leader_election.cc:304] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:36.601636 11445 raft_consensus.cc:1275] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:17:36.602243 11445 pending_rounds.cc:85] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d: Aborting all ops after (but not including) 5
I20260709 12:17:36.602474 11445 pending_rounds.cc:107] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:17:36.602743 11445 raft_consensus.cc:2889] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:36.602576 12203 leader_election.cc:304] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:36.608070 14141 raft_consensus.cc:2804] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:36.608601 14141 raft_consensus.cc:493] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:36.608922 14141 raft_consensus.cc:3060] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:36.615697 12203 leader_election.cc:304] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:36.568447 14206 raft_consensus.cc:3055] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:36.617610 11448 raft_consensus.cc:1275] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:36.621569 14216 consensus_queue.cc:1048] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:36.623251 14137 raft_consensus.cc:2804] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:36.623883 14137 raft_consensus.cc:697] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 9 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:36.624998 14326 consensus_queue.cc:1048] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:36.625865 14065 raft_consensus.cc:2804] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:36.626292 14065 raft_consensus.cc:493] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:36.626673 14065 raft_consensus.cc:3060] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:36.627110 14141 raft_consensus.cc:515] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
W20260709 12:17:36.631578 11491 leader_election.cc:336] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Timed out: RequestConsensusVote RPC to 127.3.212.130:41579 timed out after 1.614s (SENT)
I20260709 12:17:36.632155 11491 leader_election.cc:304] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:36.633090 11452 raft_consensus.cc:1275] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:17:36.633975 13995 raft_consensus.cc:2749] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:36.635823 14141 leader_election.cc:290] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:17:36.636512 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 65606.8us
I20260709 12:17:36.637051 11446 raft_consensus.cc:1240] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:17:36.637503 11419 leader_election.cc:400] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Vote denied by peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935) with higher term. Message: Invalid argument: T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 6. Current term is 7.
I20260709 12:17:36.600454 14064 raft_consensus.cc:2749] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:36.637850 11419 leader_election.cc:403] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:36.587167 14068 raft_consensus.cc:515] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:36.639505 11453 raft_consensus.cc:2468] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 7.
I20260709 12:17:36.639670 14068 leader_election.cc:290] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:36.640283 14068 raft_consensus.cc:2749] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935) with higher term. Message: Invalid argument: T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 6. Current term is 7.
I20260709 12:17:36.640575 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:36.588212 14193 raft_consensus.cc:515] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:36.614464 14316 consensus_queue.cc:1048] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:17:36.590201 13991 raft_consensus.cc:515] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:36.630405 14206 raft_consensus.cc:740] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:36.652560 11417 leader_election.cc:304] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:36.653139 14206 consensus_queue.cc:260] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:36.653956 11454 raft_consensus.cc:2468] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 8.
I20260709 12:17:36.654146 13991 leader_election.cc:290] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:36.654507 14206 raft_consensus.cc:3060] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:36.654940 11451 raft_consensus.cc:1275] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:36.656695 14300 raft_consensus.cc:2764] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:17:36.642107 11526 raft_consensus.cc:1240] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:17:36.643734 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:17:36.645633 11420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:36.651229 11446 raft_consensus.cc:2468] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 10.
I20260709 12:17:36.639077 11419 leader_election.cc:304] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:36.657444 14300 consensus_queue.cc:1048] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:36.660005 12345 raft_consensus.cc:1275] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:17:36.662257 11449 raft_consensus.cc:2393] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 9: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:17:36.662047 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:36.662845 11452 raft_consensus.cc:2468] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 8.
I20260709 12:17:36.624764 14137 consensus_queue.cc:237] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:36.668614 11521 raft_consensus.cc:1275] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:36.669394 11452 raft_consensus.cc:1275] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:17:36.673128 11418 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:36.674968 14300 raft_consensus.cc:2749] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:36.673072 12203 leader_election.cc:304] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:36.676777 12203 leader_election.cc:304] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:36.681690 14141 raft_consensus.cc:2804] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:36.692551 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:36.693153 11452 raft_consensus.cc:3060] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:36.694284 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:36.697342 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:36.699985 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:36.700810 11520 raft_consensus.cc:2468] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 9.
I20260709 12:17:36.701597 11519 raft_consensus.cc:2368] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 7. Current term is 8.
I20260709 12:17:36.692183 14141 raft_consensus.cc:493] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:36.698129 11524 raft_consensus.cc:2468] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 7.
W20260709 12:17:36.710949 11491 leader_election.cc:336] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Timed out: RequestConsensusVote RPC to 127.3.212.130:41579 timed out after 1.686s (SENT)
I20260709 12:17:36.717542 11491 leader_election.cc:304] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
W20260709 12:17:36.704085 14215 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.882s	user 0.000s	sys 0.036s
I20260709 12:17:36.692339 14216 raft_consensus.cc:2804] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:36.717499 14141 raft_consensus.cc:3060] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:36.687958 14193 leader_election.cc:290] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:36.740615 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:36.744434 13811 raft_consensus.cc:2749] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:36.744828 11418 leader_election.cc:304] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:36.746093 11418 leader_election.cc:400] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 election: Vote denied by peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063) with higher term. Message: Invalid argument: T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 7. Current term is 8.
I20260709 12:17:36.746415 11418 leader_election.cc:403] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:17:36.747072 13627 raft_consensus.cc:493] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:36.747692 13627 raft_consensus.cc:515] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:36.749176 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:36.749895 11524 raft_consensus.cc:3060] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:36.750036 13910 raft_consensus.cc:3060] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:36.751391 13627 leader_election.cc:290] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:36.749781 14178 raft_consensus.cc:2804] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:36.752126 14178 raft_consensus.cc:493] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:36.752496 14178 raft_consensus.cc:3060] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:36.754866 14216 raft_consensus.cc:493] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:36.755388 14216 raft_consensus.cc:3060] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:36.756865 11567 leader_election.cc:304] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
W20260709 12:17:36.726511 11494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:36.726876 14215 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.911s	user 0.001s	sys 0.036s
I20260709 12:17:36.757959 14215 raft_consensus.cc:697] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 9 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:36.759059 14215 consensus_queue.cc:237] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:36.695996 13939 consensus_queue.cc:1048] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:17:36.763557 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:36.770329 11602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40784 (request call id 415) took 1046 ms. Trace:
W20260709 12:17:36.773639 11568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:36.786891 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:36.787858 11447 raft_consensus.cc:2393] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 10: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:36.770937 11602 rpcz_store.cc:276] 0709 12:17:35.723619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:35.723797 (+   178us) service_pool.cc:224] Handling call
0709 12:17:35.770577 (+ 46780us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:35.808414 (+ 37837us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:17:35.965627 (+157213us) log.cc:844] Serialized 14 byte log entry
0709 12:17:36.174578 (+208951us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:36.199253 (+ 24675us) log.cc:844] Serialized 52 byte log entry
0709 12:17:36.199439 (+   186us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:36.206602 (+  7163us) log.cc:844] Serialized 14 byte log entry
0709 12:17:36.213814 (+  7212us) log.cc:844] Serialized 14 byte log entry
0709 12:17:36.769689 (+555875us) spinlock_profiling.cc:243] Waited 3.19 ms on lock 0x7b180019d620. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3a50c0a 00007f84ed190219 00007f84e3ad8a40 00007f84e3ad34e4 00007f84e3ad3455 00007f84e6bbb060 00007f84e6bcd716 00007f84e6bde287 00007f84e6bde208
0709 12:17:36.769906 (+   217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:36.770065 (+   159us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:36.770105 (+    40us) raft_consensus.cc:1685] finished
0709 12:17:36.770119 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:36.770247 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52321,"prepare.queue_time_us":240181,"prepare.run_cpu_time_us":123,"prepare.run_wall_time_us":127,"raft.queue_time_us":579861,"raft.run_cpu_time_us":515,"raft.run_wall_time_us":14298,"spinlock_wait_cycles":7820544,"thread_start_us":276833,"threads_started":2,"wal-append.queue_time_us":225838}
I20260709 12:17:36.788486 11452 raft_consensus.cc:2468] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 9.
I20260709 12:17:36.803380 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:36.804059 12357 raft_consensus.cc:3060] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:36.805670 12348 raft_consensus.cc:1275] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:36.806988 11598 raft_consensus.cc:1275] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:36.813170 12203 leader_election.cc:304] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:36.818095 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:17:36.819401 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 180496us
I20260709 12:17:36.819617 12203 leader_election.cc:304] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d
I20260709 12:17:36.787580 14257 raft_consensus.cc:493] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:36.829438 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:36.830411 12361 raft_consensus.cc:2468] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 9.
I20260709 12:17:36.820570 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:36.812507 12204 leader_election.cc:304] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:36.840785 12359 raft_consensus.cc:1275] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:17:36.788826 14327 consensus_queue.cc:1048] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:17:36.791932 13991 consensus_queue.cc:1059] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:17:36.795679 14211 consensus_queue.cc:1048] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 12:17:36.818593 13984 raft_consensus.cc:2804] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:36.851289 11597 raft_consensus.cc:1240] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 LEADER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:36.813866 14087 raft_consensus.cc:493] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:36.850397 11419 leader_election.cc:304] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:36.861438 12203 leader_election.cc:304] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:36.794420 13811 consensus_queue.cc:1059] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:17:36.815447 13939 raft_consensus.cc:493] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:36.855027 12357 raft_consensus.cc:2468] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 8.
I20260709 12:17:36.822815 14070 raft_consensus.cc:2749] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:17:36.852157 11491 leader_election.cc:336] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Timed out: RequestConsensusVote RPC to 127.3.212.130:41579 timed out after 2.365s (SENT)
I20260709 12:17:36.873284 11491 leader_election.cc:304] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:36.835206 14198 raft_consensus.cc:493] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.818253 14190 consensus_queue.cc:1048] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:17:36.853101 14328 raft_consensus.cc:2749] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:36.839774 14318 consensus_queue.cc:1048] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:17:36.858846 14211 consensus_queue.cc:1243] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer a03223e9e41247c3a36b7b7c3d476671 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 12:17:36.896947 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 46625.1us
I20260709 12:17:36.858363 13984 raft_consensus.cc:493] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:36.911098 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 49777.7us
I20260709 12:17:36.912559 14100 consensus_queue.cc:1048] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:36.864223 13863 raft_consensus.cc:2804] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:36.912679 12203 leader_election.cc:304] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
W20260709 12:17:36.913403 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 66452.8us
I20260709 12:17:36.876781 14300 raft_consensus.cc:2749] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:17:36.843468 14257 raft_consensus.cc:515] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:36.927439 12203 leader_election.cc:304] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:36.894112 13811 raft_consensus.cc:2749] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:36.931265 11419 leader_election.cc:304] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:36.932920 11593 raft_consensus.cc:1275] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:36.898981 14134 raft_consensus.cc:3055] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:36.940886 11601 raft_consensus.cc:606] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Received request to transfer leadership to TS 1c101e338f954ef086338e251deed19d
I20260709 12:17:36.941368 11601 raft_consensus.cc:614] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:36.869897 14087 raft_consensus.cc:515] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:36.917703 13984 raft_consensus.cc:3060] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:36.915592 14163 raft_consensus.cc:2749] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:36.951507 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:36.922219 13863 raft_consensus.cc:493] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:36.875881 13939 raft_consensus.cc:515] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:36.893874 14198 raft_consensus.cc:515] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:36.944756 14134 raft_consensus.cc:740] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:36.915086 14345 consensus_queue.cc:1048] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:17:36.948246 14325 raft_consensus.cc:493] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
W20260709 12:17:36.996378 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 96760.2us
I20260709 12:17:36.954276 14070 raft_consensus.cc:493] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:36.998513 11567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:36.962281 13863 raft_consensus.cc:3060] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:17:37.001657 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 74289.9us
W20260709 12:17:36.999259 11567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:36.999321 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 68168.7us
I20260709 12:17:36.986626 14362 raft_consensus.cc:2749] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:17:37.002775 14328 raft_consensus.cc:2749] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:37.013319 12203 leader_election.cc:304] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
W20260709 12:17:37.027676 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 98134.8us
W20260709 12:17:37.049801 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 210047us
I20260709 12:17:36.957885 14327 raft_consensus.cc:2804] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:17:37.123592 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 97887.6us
I20260709 12:17:37.002077 14070 raft_consensus.cc:515] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:37.049371 13627 raft_consensus.cc:3060] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:36.999812 14325 raft_consensus.cc:515] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:37.015941 14300 consensus_queue.cc:1048] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.118s
I20260709 12:17:37.148756 11524 raft_consensus.cc:2468] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 9.
I20260709 12:17:37.017562 14137 consensus_queue.cc:1048] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.125s
I20260709 12:17:37.151515 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:17:37.157889 14365 log.cc:927] Time spent T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
I20260709 12:17:37.132194 14337 raft_consensus.cc:493] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
W20260709 12:17:37.146266 14065 consensus_meta.cc:287] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de: Time spent flushing consensus metadata: real 0.519s	user 0.011s	sys 0.000s
W20260709 12:17:37.164916 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 261087us
W20260709 12:17:37.165544 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 153767us
W20260709 12:17:37.175578 14368 log.cc:927] Time spent T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260709 12:17:37.181906 13995 raft_consensus.cc:493] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:37.155408 14300 consensus_queue.cc:1243] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [LEADER]: Peer b126028166e8480ba25541bf8f7fc6de log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:17:37.149186 14087 leader_election.cc:290] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
W20260709 12:17:37.176445 14364 log.cc:927] Time spent T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 12:17:37.162981 14064 raft_consensus.cc:493] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:37.207296 14064 raft_consensus.cc:515] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:37.147917 14327 raft_consensus.cc:697] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 9 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
W20260709 12:17:37.213034 11494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:37.049633 14134 consensus_queue.cc:260] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:37.177119 11594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40784 (request call id 414) took 1453 ms. Trace:
I20260709 12:17:37.198799 13811 raft_consensus.cc:493] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:37.209409 14378 raft_consensus.cc:493] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:37.247344 14378 raft_consensus.cc:515] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:37.203074 14141 raft_consensus.cc:515] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:37.203506 14337 raft_consensus.cc:515] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:37.238981 11448 raft_consensus.cc:1240] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:37.246212 14362 raft_consensus.cc:493] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:37.240183 14325 leader_election.cc:290] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:37.211077 13995 raft_consensus.cc:515] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:37.251691 14362 raft_consensus.cc:515] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:37.253732 14362 leader_election.cc:290] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:37.254245 14362 raft_consensus.cc:493] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:37.254702 13995 leader_election.cc:290] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:37.245592 14257 leader_election.cc:290] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:37.255548 14141 leader_election.cc:290] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 11 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:37.256400 14378 leader_election.cc:290] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:37.258092 14198 leader_election.cc:290] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:37.259022 13939 leader_election.cc:290] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:37.261399 14064 leader_election.cc:290] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:37.262109 14337 leader_election.cc:290] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:37.254702 14362 raft_consensus.cc:515] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:37.262728 14327 consensus_queue.cc:237] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
W20260709 12:17:37.264098 14361 log.cc:927] Time spent T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.338s	user 0.000s	sys 0.001s
I20260709 12:17:37.264688 14362 leader_election.cc:290] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:37.265923 13984 raft_consensus.cc:515] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:37.268090 13984 leader_election.cc:290] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:37.215369 11594 rpcz_store.cc:276] 0709 12:17:35.723218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:35.723338 (+   120us) service_pool.cc:224] Handling call
0709 12:17:36.238558 (+515220us) spinlock_profiling.cc:243] Waited 1.25 ms on lock 0x7b5800220b98. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e3a9ef8c 00007f84e3a9eef6 000000000036eb39 00007f84ebb121e0 00007f84ebbdb0c4 00007f84ebbdb131 00007f84ebb9cfc0 00007f84ebb87929 00007f84ebb873d2 00007f84e50febd4
0709 12:17:36.238688 (+   130us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:36.771253 (+532565us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:36.771284 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:36.771739 (+   455us) log.cc:844] Serialized 26 byte log entry
0709 12:17:36.940740 (+169001us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:36.940777 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:36.942538 (+  1761us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:37.176815 (+234277us) raft_consensus.cc:1685] finished
0709 12:17:37.176837 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:37.177056 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":532139,"raft.queue_time_us":533196,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":11115,"spinlock_wait_cycles":2877312,"thread_start_us":168615,"threads_started":1,"wal-append.queue_time_us":365727}
W20260709 12:17:37.274453 11568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:37.246104 14367 log.cc:927] Time spent T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.247s	user 0.001s	sys 0.000s
W20260709 12:17:37.284953 11491 leader_election.cc:336] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Timed out: RequestConsensusVote RPC to 127.3.212.130:41579 timed out after 1.612s (SENT)
I20260709 12:17:37.295588 11491 leader_election.cc:304] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
W20260709 12:17:37.257217 14178 consensus_meta.cc:287] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d: Time spent flushing consensus metadata: real 0.504s	user 0.003s	sys 0.012s
I20260709 12:17:37.297284 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:37.303102 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:37.195634 14065 raft_consensus.cc:515] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:37.311236 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:37.313509 12345 raft_consensus.cc:3060] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:37.295745 14064 raft_consensus.cc:493] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:37.318369 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:17:37.300613 14372 log.cc:927] Time spent T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 12:17:37.319106 12349 raft_consensus.cc:2468] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 4.
W20260709 12:17:37.308048 13910 consensus_meta.cc:287] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d: Time spent flushing consensus metadata: real 0.557s	user 0.002s	sys 0.008s
I20260709 12:17:37.299678 13995 raft_consensus.cc:2749] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:37.226305 13811 raft_consensus.cc:515] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:37.327689 12359 raft_consensus.cc:1240] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:37.312848 14318 raft_consensus.cc:493] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:37.318493 14141 raft_consensus.cc:493] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:37.338838 13627 raft_consensus.cc:2749] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:37.339308 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:37.341166 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:37.341934 11598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34d43eecbad746fd9ddce50c5b9fc3e8"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "1c101e338f954ef086338e251deed19d"
 from {username='slave'} at 127.0.0.1:37992
I20260709 12:17:37.355443 11598 raft_consensus.cc:606] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Received request to transfer leadership to TS 1c101e338f954ef086338e251deed19d
I20260709 12:17:37.342514 14345 consensus_queue.cc:1048] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:37.342995 14381 raft_consensus.cc:493] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:37.327050 13910 raft_consensus.cc:2749] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063) with higher term. Message: Invalid argument: T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 7. Current term is 8.
I20260709 12:17:37.308267 14178 raft_consensus.cc:515] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:37.345268 13811 leader_election.cc:290] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:37.346431 14318 raft_consensus.cc:515] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:37.356107 11598 raft_consensus.cc:614] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:37.330191 14374 raft_consensus.cc:493] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:37.323042 14257 consensus_queue.cc:1048] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
W20260709 12:17:37.369721 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 155623us
W20260709 12:17:37.366637 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 167349us
W20260709 12:17:37.387494 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 174798us
I20260709 12:17:37.400591 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:37.401496 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:37.407311 11524 raft_consensus.cc:2468] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 9.
I20260709 12:17:37.406635 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
W20260709 12:17:37.402774 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 48905.9us
I20260709 12:17:37.408186 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:37.407404 11453 raft_consensus.cc:1240] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:37.405190 11454 raft_consensus.cc:3055] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:37.408908 11450 raft_consensus.cc:3060] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:37.409006 11454 raft_consensus.cc:740] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:37.361773 12345 raft_consensus.cc:2468] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 6.
W20260709 12:17:37.368883 14216 consensus_meta.cc:287] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de: Time spent flushing consensus metadata: real 0.613s	user 0.003s	sys 0.010s
I20260709 12:17:37.415030 14386 consensus_queue.cc:1048] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:17:37.415485 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8741606df54c3f8b5cc5c1141862ea" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:37.415259 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:37.418294 11596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40784 (request call id 422) took 1116 ms. Trace:
I20260709 12:17:37.418730 11596 rpcz_store.cc:276] 0709 12:17:36.302105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:36.302259 (+   154us) service_pool.cc:224] Handling call
0709 12:17:36.318375 (+ 16116us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:36.786549 (+468174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:36.786582 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:36.794886 (+  8304us) log.cc:844] Serialized 26 byte log entry
0709 12:17:36.951210 (+156324us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:36.978878 (+ 27668us) log.cc:844] Serialized 14 byte log entry
0709 12:17:37.014620 (+ 35742us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:37.014703 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:37.418075 (+403372us) raft_consensus.cc:1685] finished
0709 12:17:37.418095 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:37.418229 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":563875,"prepare.queue_time_us":301328,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":504566,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":17178,"thread_start_us":96986,"threads_started":1,"wal-append.queue_time_us":207635}
I20260709 12:17:37.409704 14374 raft_consensus.cc:515] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:37.422260 14065 leader_election.cc:290] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:37.422994 11454 consensus_queue.cc:260] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:37.427026 11419 leader_election.cc:304] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:37.364080 14141 raft_consensus.cc:515] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:37.326902 14064 raft_consensus.cc:515] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:37.366264 14381 raft_consensus.cc:515] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:37.438989 11565 leader_election.cc:304] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:37.439541 14381 leader_election.cc:290] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:37.440382 14381 consensus_queue.cc:1059] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:37.441569 13910 raft_consensus.cc:2749] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:37.442569 14337 raft_consensus.cc:2749] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:37.442859 14178 leader_election.cc:290] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:37.444227 14388 consensus_queue.cc:1048] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:37.446619 14388 consensus_queue.cc:1048] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:37.449235 11565 leader_election.cc:304] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:37.451707 14105 raft_consensus.cc:2749] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:37.452442 13984 consensus_queue.cc:1048] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:37.455796 13863 raft_consensus.cc:515] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:37.456408 11565 leader_election.cc:304] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:37.456929 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:37.458019 11602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "1c101e338f954ef086338e251deed19d"
 from {username='slave'} at 127.0.0.1:37992
I20260709 12:17:37.459619 11602 raft_consensus.cc:606] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 LEADER]: Received request to transfer leadership to TS 1c101e338f954ef086338e251deed19d
I20260709 12:17:37.467052 11454 raft_consensus.cc:3060] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:37.467752 11445 raft_consensus.cc:1275] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:37.466536 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:17:37.470518 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 43595.6us
I20260709 12:17:37.471428 12203 leader_election.cc:304] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:37.476014 11418 leader_election.cc:304] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:37.478650 11519 pending_rounds.cc:85] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671: Aborting all ops after (but not including) 3
I20260709 12:17:37.479142 11519 pending_rounds.cc:107] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:17:37.479403 11519 raft_consensus.cc:2889] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:37.480290 11522 raft_consensus.cc:2468] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 7.
I20260709 12:17:37.482371 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:37.483175 11449 raft_consensus.cc:3060] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:37.422844 14216 raft_consensus.cc:515] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:37.499686 11454 raft_consensus.cc:1275] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:37.458196 14141 leader_election.cc:290] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:37.470912 13984 raft_consensus.cc:2749] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:17:37.423252 14391 consensus_queue.cc:1059] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
W20260709 12:17:37.512212 11491 leader_election.cc:336] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Timed out: RequestConsensusVote RPC to 127.3.212.130:41579 timed out after 1.630s (SENT)
I20260709 12:17:37.514496 12203 leader_election.cc:304] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:37.514868 11491 leader_election.cc:304] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:37.522009 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:37.523036 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8741606df54c3f8b5cc5c1141862ea" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:37.528847 11417 leader_election.cc:304] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
W20260709 12:17:37.531700 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 75366.1us
I20260709 12:17:37.569247 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:17:37.570263 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 55845.5us
W20260709 12:17:37.570420 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 58252.6us
I20260709 12:17:37.486369 14392 raft_consensus.cc:2804] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:17:37.584681 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 52169.3us
I20260709 12:17:37.543972 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:37.586041 11523 raft_consensus.cc:2393] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 8: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
W20260709 12:17:37.541801 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 131832us
I20260709 12:17:37.541492 13995 raft_consensus.cc:2749] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:37.542292 14065 raft_consensus.cc:2749] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:37.574223 14391 raft_consensus.cc:2749] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:37.576152 14329 raft_consensus.cc:2749] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:37.580860 14392 raft_consensus.cc:493] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:37.582757 13811 raft_consensus.cc:493] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:37.606021 13863 leader_election.cc:290] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 10 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:37.575286 14362 consensus_queue.cc:1059] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
W20260709 12:17:37.600546 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 71796.8us
I20260709 12:17:37.530287 14325 consensus_queue.cc:1048] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 12:17:37.602624 14308 raft_consensus.cc:3055] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:37.616647 11449 raft_consensus.cc:2468] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 9.
I20260709 12:17:37.618779 14064 leader_election.cc:290] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:37.621253 11491 leader_election.cc:304] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:37.583801 14326 consensus_queue.cc:1048] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:17:37.587491 14190 consensus_queue.cc:1048] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:17:37.622596 14300 consensus_queue.cc:1048] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:37.623128 11596 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "a03223e9e41247c3a36b7b7c3d476671"
 from {username='slave'} at 127.0.0.1:37992
I20260709 12:17:37.622519 14308 raft_consensus.cc:740] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:37.623768 11596 raft_consensus.cc:606] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 LEADER]: Received request to transfer leadership to TS a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:37.606155 13811 raft_consensus.cc:515] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:37.624575 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:37.625437  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:17:37.625677 13995 raft_consensus.cc:3060] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:37.627374  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:37.628229 14318 leader_election.cc:290] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:37.617110 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:37.629540 12359 raft_consensus.cc:2368] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 7. Current term is 8.
I20260709 12:17:37.629817 11565 leader_election.cc:304] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:37.624044 14362 consensus_queue.cc:1243] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [LEADER]: Peer 9da53be18b0f446aaa406216e20b0ec8 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:17:37.632912 13984 raft_consensus.cc:2749] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:37.633349 11450 raft_consensus.cc:2468] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 11.
I20260709 12:17:37.634698 11453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35814 (request call id 466) took 1013 ms. Trace:
I20260709 12:17:37.635111 11453 rpcz_store.cc:276] 0709 12:17:36.621216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:36.644271 (+ 23055us) service_pool.cc:224] Handling call
0709 12:17:36.828281 (+184010us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:37.408938 (+580657us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:37.633817 (+224879us) spinlock_profiling.cc:243] Waited 579 ms on lock 0x7b5400818154. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:17:37.634510 (+   693us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b5400818150. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc28ad 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:37.634639 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1753653504}
I20260709 12:17:37.636715 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:37.638324 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:37.639906 12203 leader_election.cc:304] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:37.645857 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:37.649978 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:37.650854 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:37.651098 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:37.652340 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:37.653700 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:37.658141 11417 leader_election.cc:304] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:37.622964 14216 leader_election.cc:290] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:37.660567 12203 leader_election.cc:304] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:37.667845 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:37.661855 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:37.676419 11453 raft_consensus.cc:3060] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:37.677567 11566 leader_election.cc:304] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:37.625191 14374 leader_election.cc:290] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:37.601096 14392 raft_consensus.cc:3060] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:37.684142 11566 leader_election.cc:304] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:37.686100 12349 pending_rounds.cc:85] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de: Aborting all ops after (but not including) 4
I20260709 12:17:37.687786 12349 pending_rounds.cc:107] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:17:37.688177 12349 raft_consensus.cc:2889] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:37.709816 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:37.669251 14178 raft_consensus.cc:493] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:37.680722 14065 raft_consensus.cc:2804] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:37.685961 14198 raft_consensus.cc:2749] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:37.725966 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:37.739459 11596 raft_consensus.cc:3060] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:37.715410 14141 raft_consensus.cc:2804] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:37.749181 11453 raft_consensus.cc:2468] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 9.
W20260709 12:17:37.750268 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 92180.6us
I20260709 12:17:37.752044 11417 leader_election.cc:304] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:37.754031 13811 leader_election.cc:290] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:37.669299 14398 consensus_queue.cc:1048] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 12:17:37.686219 14302 consensus_queue.cc:1048] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 12:17:37.756034 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:17:37.756692 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 76721.9us
I20260709 12:17:37.737067 14178 raft_consensus.cc:515] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:37.734351 14105 raft_consensus.cc:2749] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:37.758857 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:37.624495 14308 consensus_queue.cc:260] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:37.725605 14402 raft_consensus.cc:2749] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:37.764405 11602 raft_consensus.cc:1275] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:37.680223 14397 consensus_queue.cc:1048] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.087s
I20260709 12:17:37.744987 14065 raft_consensus.cc:697] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 9 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:37.802634 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:17:37.797297 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 45318.7us
W20260709 12:17:37.798633 14064 consensus_queue.cc:1175] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1c101e338f954ef086338e251deed19d" responder_term: 9 status { last_received { term: 6 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 8. Current term is 9. Ops: [8.5-8.5]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:17:37.805790 14065 consensus_queue.cc:237] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:37.768239 14141 raft_consensus.cc:697] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 11 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
W20260709 12:17:37.812436 11494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:37.812821 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:37.816668 14380 consensus_queue.cc:1059] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.101s
I20260709 12:17:37.817775 14380 raft_consensus.cc:3055] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:37.842942 14412 raft_consensus.cc:2749] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:37.845444 14360 raft_consensus.cc:493] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:37.846150 14360 raft_consensus.cc:515] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:37.848163 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:37.853909 11596 raft_consensus.cc:2468] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 8.
I20260709 12:17:37.838043 14380 raft_consensus.cc:740] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:37.870496 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9fe9a94294836aec652338f44367d" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:17:37.867362 14359 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.778s	user 0.016s	sys 0.037s
I20260709 12:17:37.880679 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:37.886384 14416 raft_consensus.cc:493] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:37.887247 11491 leader_election.cc:304] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:37.887148 14416 raft_consensus.cc:515] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:37.888577 14070 leader_election.cc:290] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
W20260709 12:17:37.889427 14413 log.cc:927] Time spent T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:17:37.889943 14419 raft_consensus.cc:493] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:37.890519 14419 raft_consensus.cc:515] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:37.890882 13811 consensus_queue.cc:1048] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:17:37.892184 14408 log.cc:927] Time spent T 00000000000000000000000000000000 P eb02cb678b0c4f28932bfb6c2377165e: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:17:37.892525 13811 raft_consensus.cc:2804] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:37.892895 14419 leader_election.cc:290] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:37.888602 14414 raft_consensus.cc:493] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:37.894309 14411 raft_consensus.cc:493] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:37.894834 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:37.894812 14411 raft_consensus.cc:515] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:37.896067 14414 raft_consensus.cc:515] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:37.897048 14411 leader_election.cc:290] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:37.902134 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:37.871232 14141 consensus_queue.cc:237] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:37.901574 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
W20260709 12:17:37.877203 14359 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.944s	user 0.016s	sys 0.038s
I20260709 12:17:37.929095 11451 raft_consensus.cc:2368] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for earlier term 10. Current term is 11.
I20260709 12:17:37.904873 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
W20260709 12:17:37.899010 14404 log.cc:927] Time spent T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
I20260709 12:17:37.902633 14178 leader_election.cc:290] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:37.898627 14414 leader_election.cc:290] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:37.900384 14300 raft_consensus.cc:493] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:37.900993 14366 log.cc:927] Time spent T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.850s	user 0.003s	sys 0.000s
I20260709 12:17:37.908748 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:37.897768 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:37.939049 11445 raft_consensus.cc:2368] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for earlier term 9. Current term is 10.
W20260709 12:17:37.934671 11493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 295288us
I20260709 12:17:37.900527 14360 leader_election.cc:290] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:37.903350 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:37.940372 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:37.923108 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:37.898510 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:37.941708 11453 raft_consensus.cc:2468] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 7.
I20260709 12:17:37.939710 11493 leader_election.cc:304] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d
I20260709 12:17:37.930876 13811 raft_consensus.cc:697] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 8 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:37.940855 11452 raft_consensus.cc:2393] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 8: Already voted for candidate 9da53be18b0f446aaa406216e20b0ec8 in this term.
I20260709 12:17:37.945233 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:37.952585 11525 raft_consensus.cc:1275] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:37.953130 11449 raft_consensus.cc:2468] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 3.
I20260709 12:17:37.955765 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:37.955791 11493 leader_election.cc:304] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:37.934151 14416 leader_election.cc:290] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:37.958693 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:37.960738 11445 raft_consensus.cc:3060] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:37.959211 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9fe9a94294836aec652338f44367d" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:37.962078 11453 raft_consensus.cc:2468] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 7.
I20260709 12:17:37.963111 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390e91331fd04f97a5235133a34875ee" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:37.964627 11451 raft_consensus.cc:1275] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:37.965461 14374 raft_consensus.cc:2804] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:37.967327 11521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33456 (request call id 1127) took 1293 ms. Trace:
I20260709 12:17:37.967754 11521 rpcz_store.cc:276] 0709 12:17:36.673811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:36.674030 (+   219us) service_pool.cc:224] Handling call
0709 12:17:36.695474 (+ 21444us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:36.716382 (+ 20908us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:36.716413 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:36.742570 (+ 26157us) log.cc:844] Serialized 52 byte log entry
0709 12:17:36.856745 (+114175us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:36.856784 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:36.856861 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:37.765052 (+908191us) spinlock_profiling.cc:243] Waited 21 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e675e86e 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221 00007f84e67671d9 00007f84e6767169
0709 12:17:37.966999 (+201947us) raft_consensus.cc:1685] finished
0709 12:17:37.967024 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:37.967264 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15231,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":23743,"spinlock_wait_cycles":48353536,"thread_start_us":113756,"threads_started":1,"wal-append.queue_time_us":251421}
I20260709 12:17:37.974299 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffe47647c274723808482c166efa21c" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:37.975032 11449 raft_consensus.cc:2376] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 7. Re-sending same reply.
I20260709 12:17:37.980814 11450 raft_consensus.cc:2468] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 8.
I20260709 12:17:37.986460 11452 raft_consensus.cc:1240] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 12:17:38.000941 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:38.001770 11454 raft_consensus.cc:2376] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 7. Re-sending same reply.
I20260709 12:17:38.003558 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:38.004314 11446 raft_consensus.cc:2376] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 8. Re-sending same reply.
I20260709 12:17:38.010030 13811 consensus_queue.cc:237] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:38.012024 11419 leader_election.cc:400] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 election: Vote denied by peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935) with higher term. Message: Invalid argument: T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 7. Current term is 8.
I20260709 12:17:38.013303 11419 leader_election.cc:304] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:37.983120 14317 raft_consensus.cc:493] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:38.018021 11445 raft_consensus.cc:2468] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 6.
I20260709 12:17:38.015410 11493 leader_election.cc:304] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:37.942293 14300 raft_consensus.cc:515] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:38.020604 11491 leader_election.cc:304] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:38.021358 11565 leader_election.cc:304] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:17:38.023028 11454 raft_consensus.cc:3055] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:38.023447 11454 raft_consensus.cc:740] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:38.024186 11454 consensus_queue.cc:260] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:38.025239 11454 raft_consensus.cc:3060] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:38.026233 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:38.027143 11445 raft_consensus.cc:2410] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for term 10 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:17:38.028225 11449 raft_consensus.cc:1240] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:17:38.034448 11454 raft_consensus.cc:1275] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:17:38.035126 11454 pending_rounds.cc:85] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d: Aborting all ops after (but not including) 5
I20260709 12:17:38.035444 11454 pending_rounds.cc:107] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:17:38.035748 11454 raft_consensus.cc:2889] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:37.938202 14380 consensus_queue.cc:260] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:38.040009 11493 leader_election.cc:304] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:38.041744 11447 raft_consensus.cc:2468] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 7.
I20260709 12:17:38.018139 14316 raft_consensus.cc:2749] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:17:38.043476 11493 leader_election.cc:304] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:38.026513 14381 raft_consensus.cc:2804] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:38.047145 11491 leader_election.cc:400] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 election: Vote denied by peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579) with higher term. Message: Invalid argument: T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for earlier term 10. Current term is 11.
I20260709 12:17:38.047629 11491 leader_election.cc:403] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:17:38.036795 14374 raft_consensus.cc:697] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 8 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:38.049926 14425 raft_consensus.cc:2804] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:38.050300 13995 raft_consensus.cc:2749] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:38.051057 14427 raft_consensus.cc:3060] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:38.055135 12203 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:38.086004 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 63285.5us
I20260709 12:17:38.041458 14411 raft_consensus.cc:2749] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:38.049306 14381 raft_consensus.cc:493] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:38.094545 14425 raft_consensus.cc:493] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:38.099138 14064 raft_consensus.cc:2749] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:17:38.110827 14375 log.cc:927] Time spent T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.887s	user 0.007s	sys 0.002s
I20260709 12:17:38.114320 11565 leader_election.cc:304] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:38.085996 14380 raft_consensus.cc:3060] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:38.126446 11523 raft_consensus.cc:3060] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:38.027380 14317 raft_consensus.cc:515] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:38.123217 14381 raft_consensus.cc:3060] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:38.138474 14425 raft_consensus.cc:3060] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:38.140419 13995 raft_consensus.cc:2749] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:38.144109 14398 raft_consensus.cc:2749] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:38.161618 11523 raft_consensus.cc:2468] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 9.
W20260709 12:17:38.167975 14428 log.cc:927] Time spent T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:17:38.156072 14430 raft_consensus.cc:3060] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:38.172870 14435 raft_consensus.cc:493] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
W20260709 12:17:38.180649 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 66426.2us
W20260709 12:17:38.182916 11493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 139519us
I20260709 12:17:38.183959 11493 leader_election.cc:304] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:38.190126 13811 raft_consensus.cc:2749] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:38.191560 14134 raft_consensus.cc:3060] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:38.192801 11520 raft_consensus.cc:1275] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:17:38.200050 14427 raft_consensus.cc:2749] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:38.184063 13995 raft_consensus.cc:493] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:38.206032 13995 raft_consensus.cc:515] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:38.206420 14423 consensus_queue.cc:1059] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:38.208110 13995 leader_election.cc:290] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:38.209101 14423 raft_consensus.cc:3055] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:17:38.214823 11494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:38.195950 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 148964us
I20260709 12:17:38.209575 14423 raft_consensus.cc:740] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:38.239019 14423 consensus_queue.cc:260] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:38.237879 11448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58856 (request call id 697) took 1877 ms. Trace:
I20260709 12:17:38.238018 11491 leader_election.cc:304] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:38.276216 11448 rpcz_store.cc:276] 0709 12:17:36.360603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:36.618526 (+257923us) service_pool.cc:224] Handling call
0709 12:17:37.238811 (+620285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:37.251526 (+ 12715us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:38.210108 (+958582us) spinlock_profiling.cc:243] Waited 580 ms on lock 0x7b54002b4dd0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc28ad 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:38.237768 (+ 27660us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1334062464}
I20260709 12:17:38.155452 14374 consensus_queue.cc:237] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:38.240537 14423 raft_consensus.cc:3060] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:38.303654 14316 raft_consensus.cc:493] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:38.304236 14316 raft_consensus.cc:515] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:38.284543 11599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40784 (request call id 427) took 1863 ms. Trace:
I20260709 12:17:38.305842 11599 rpcz_store.cc:276] 0709 12:17:36.420953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:36.421126 (+   173us) service_pool.cc:224] Handling call
0709 12:17:36.421542 (+   416us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:36.781578 (+360036us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:17:36.815257 (+ 33679us) log.cc:844] Serialized 14 byte log entry
0709 12:17:36.982335 (+167078us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:36.993170 (+ 10835us) log.cc:844] Serialized 52 byte log entry
0709 12:17:36.993705 (+   535us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:37.267025 (+273320us) log.cc:844] Serialized 14 byte log entry
0709 12:17:37.316358 (+ 49333us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:37.316452 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:38.011718 (+695266us) spinlock_profiling.cc:243] Waited 2.19 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e675e86e 00007f84e675dbb6 00007f84e675d7d8 00007f84e6767221 00007f84e67671d9 00007f84e6767169
0709 12:17:38.284305 (+272587us) raft_consensus.cc:1685] finished
0709 12:17:38.284332 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:38.284481 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":723270,"prepare.queue_time_us":297025,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":80,"raft.queue_time_us":420218,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":24405,"spinlock_wait_cycles":5043584,"thread_start_us":113729,"threads_started":1,"wal-append.queue_time_us":261990}
I20260709 12:17:38.310750 14389 raft_consensus.cc:493] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:38.311415 14389 raft_consensus.cc:515] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:38.317394 12203 leader_election.cc:304] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:38.243523 14317 leader_election.cc:290] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:17:38.282716 14392 consensus_meta.cc:287] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d: Time spent flushing consensus metadata: real 0.576s	user 0.011s	sys 0.000s
I20260709 12:17:38.318432 14392 raft_consensus.cc:515] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:38.319613 14192 raft_consensus.cc:493] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:38.320299 14192 raft_consensus.cc:515] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:38.320647 14392 leader_election.cc:290] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:38.323732 11449 raft_consensus.cc:1275] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:38.323945 11451 raft_consensus.cc:1275] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:17:38.324862 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:38.325337  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:17:38.285876 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 47940.2us
I20260709 12:17:38.192716 14206 consensus_queue.cc:1048] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.090s
I20260709 12:17:38.242656 14300 leader_election.cc:290] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:38.195593 14435 raft_consensus.cc:515] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:38.302575 13995 raft_consensus.cc:2749] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:38.317620 14389 leader_election.cc:290] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:38.237936 11565 leader_election.cc:304] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:17:38.319563 14134 raft_consensus.cc:2804] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:38.330958 11491 leader_election.cc:400] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579) with higher term. Message: Invalid argument: T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for earlier term 9. Current term is 10.
I20260709 12:17:38.327131 11452 raft_consensus.cc:1240] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:17:38.357892 11491 leader_election.cc:403] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:17:38.358575 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 120716us
I20260709 12:17:38.295997 14430 raft_consensus.cc:2749] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579) with higher term. Message: Invalid argument: T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for earlier term 10. Current term is 11.
I20260709 12:17:38.341997 14087 consensus_queue.cc:1048] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:17:38.360008 11493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 173902us
I20260709 12:17:38.342495 13863 consensus_queue.cc:1048] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:38.325490 11449 raft_consensus.cc:2468] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 10.
I20260709 12:17:38.300967 14425 raft_consensus.cc:515] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:38.380394 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
W20260709 12:17:38.383445 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 52627.2us
I20260709 12:17:38.385324 11491 leader_election.cc:304] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:38.386466 11491 leader_election.cc:304] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:38.383760 11448 raft_consensus.cc:2468] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 7.
I20260709 12:17:38.364894 14416 raft_consensus.cc:493] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:38.377856 14134 raft_consensus.cc:697] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 9 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:38.365695 14389 raft_consensus.cc:2804] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:38.364212 14163 raft_consensus.cc:493] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:38.408618 11491 leader_election.cc:304] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:38.377879 14206 consensus_queue.cc:1048] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:17:38.380615 14436 raft_consensus.cc:3060] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:38.377921 14388 consensus_queue.cc:1059] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:17:38.388258 14406 raft_consensus.cc:2749] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:38.435454 14374 raft_consensus.cc:2749] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:38.436153 14425 leader_election.cc:290] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
W20260709 12:17:38.437244 14433 log.cc:927] Time spent T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 12:17:38.442782 14328 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.836s	user 0.004s	sys 0.022s
W20260709 12:17:38.451510 14328 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.844s	user 0.005s	sys 0.023s
I20260709 12:17:38.454200 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:38.457401 11527 raft_consensus.cc:2468] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 8.
W20260709 12:17:38.461251 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 52699.8us
I20260709 12:17:38.462234 11491 leader_election.cc:304] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:38.462404 11524 raft_consensus.cc:1275] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:38.429502 14389 raft_consensus.cc:697] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:38.419900 14163 raft_consensus.cc:515] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:38.416860 14416 raft_consensus.cc:515] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:38.473112 11491 leader_election.cc:304] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:38.468088 14141 raft_consensus.cc:493] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:38.470310 14326 raft_consensus.cc:493] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:38.484416 11491 leader_election.cc:304] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:38.485119 14406 raft_consensus.cc:2804] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:38.491760 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:38.481258 14440 raft_consensus.cc:2804] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:38.519178 11519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33446 (request call id 1368) took 1007 ms. Trace:
I20260709 12:17:38.498484 14430 raft_consensus.cc:2804] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:38.527320 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:38.501840 14435 leader_election.cc:290] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:38.468281 14134 consensus_queue.cc:237] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:38.504679 14425 raft_consensus.cc:493] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:38.519887 11519 rpcz_store.cc:276] 0709 12:17:37.511877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.972251 (+460374us) service_pool.cc:224] Handling call
0709 12:17:37.972536 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:37.972740 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:17:38.284449 (+311709us) log.cc:844] Serialized 14 byte log entry
0709 12:17:38.518733 (+234284us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:38.518848 (+   115us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:38.518901 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:38.518977 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:38.519106 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1150,"prepare.queue_time_us":22241,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":23884,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":2066,"thread_start_us":542815,"threads_started":3,"wal-append.queue_time_us":203804}
I20260709 12:17:38.522136 14064 raft_consensus.cc:2804] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:38.516245 14406 raft_consensus.cc:697] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 7 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:38.492029 14141 raft_consensus.cc:515] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:38.520385 14440 raft_consensus.cc:493] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:38.492583 14326 raft_consensus.cc:515] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
W20260709 12:17:38.541932 14439 log.cc:927] Time spent T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:17:38.549475 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:38.528498 14430 raft_consensus.cc:493] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:38.556718 12204 leader_election.cc:304] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:38.559056 11448 raft_consensus.cc:2393] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 9: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:38.524358 14381 raft_consensus.cc:515] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:38.573722 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:38.575096 12359 raft_consensus.cc:2393] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 4: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:17:38.571686 14380 raft_consensus.cc:2804] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:38.577490 14380 raft_consensus.cc:493] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:38.580591 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:38.581995 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:38.550632 14440 raft_consensus.cc:3060] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:38.561965 14430 raft_consensus.cc:3060] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:38.584589 14380 raft_consensus.cc:3060] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:38.585513 12347 raft_consensus.cc:1240] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 6. Current term is 7. Ops: []
W20260709 12:17:38.586010 14445 log.cc:927] Time spent T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:17:38.587289 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:38.587949 12357 raft_consensus.cc:2468] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 8.
I20260709 12:17:38.588176 12346 raft_consensus.cc:1240] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:38.589318 14245 raft_consensus.cc:493] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:38.590013 14245 raft_consensus.cc:515] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:38.592509 14245 leader_election.cc:290] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:38.594580 14141 leader_election.cc:290] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:38.599364 14316 leader_election.cc:290] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:38.600034 14316 consensus_queue.cc:1059] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:38.601069 14316 raft_consensus.cc:3055] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:38.602716 11419 leader_election.cc:304] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:38.561820 14206 raft_consensus.cc:493] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:38.560060 14388 raft_consensus.cc:493] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:38.608826 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:38.540802 14425 raft_consensus.cc:515] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:38.612433 14381 leader_election.cc:290] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:38.613468 14163 leader_election.cc:290] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:38.614683 14416 leader_election.cc:290] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:38.610217 14380 raft_consensus.cc:515] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:38.615836 14345 raft_consensus.cc:493] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:38.617127 14178 raft_consensus.cc:2804] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:38.607161 14316 raft_consensus.cc:740] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:38.606925 14300 raft_consensus.cc:493] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:38.569846 13984 consensus_queue.cc:1048] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 12:17:38.537437 14389 consensus_queue.cc:237] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:38.564165 13863 consensus_queue.cc:1048] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 12:17:38.646083 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:38.665469 14326 leader_election.cc:290] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:38.644299 14300 raft_consensus.cc:515] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:38.668716 14300 leader_election.cc:290] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:38.674212 11523 raft_consensus.cc:1240] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:38.675009 14330 raft_consensus.cc:493] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:38.675655 14330 raft_consensus.cc:515] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:38.680083 14064 raft_consensus.cc:493] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:38.680783 14064 raft_consensus.cc:3060] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:38.685549 14215 raft_consensus.cc:493] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:38.686221 14215 raft_consensus.cc:515] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:38.688501 14215 leader_election.cc:290] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:38.623622 14206 raft_consensus.cc:515] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:38.690178 14316 consensus_queue.cc:260] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:38.691890 14316 raft_consensus.cc:3060] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:38.692260 14206 leader_election.cc:290] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:38.643167 14406 consensus_queue.cc:237] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:38.675671 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e4724ed93a467ea47763eec9a6de2e" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:38.715794 11565 leader_election.cc:304] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
W20260709 12:17:38.717691 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 154982us
I20260709 12:17:38.642045 14178 raft_consensus.cc:493] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:38.721307 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:38.645025 14329 raft_consensus.cc:493] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
W20260709 12:17:38.736958 11493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:38.735060 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9fe9a94294836aec652338f44367d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:38.731841 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9fe9a94294836aec652338f44367d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:38.735481 11523 raft_consensus.cc:1240] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:38.734602 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e4724ed93a467ea47763eec9a6de2e" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:38.622924 14388 raft_consensus.cc:515] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:38.750468 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:38.752991 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:38.733088 14178 raft_consensus.cc:3060] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:38.758021 14330 leader_election.cc:290] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:38.762650 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:38.763648 11594 raft_consensus.cc:2368] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 4. Current term is 5.
I20260709 12:17:38.731777 13984 raft_consensus.cc:2804] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:38.767843 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:38.772672 11493 leader_election.cc:304] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:38.639889 14345 raft_consensus.cc:515] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:38.741506 14329 raft_consensus.cc:515] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:38.777858 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:38.782485 11519 raft_consensus.cc:3060] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:38.744632 14153 raft_consensus.cc:3055] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:38.783454 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:38.780902 11593 raft_consensus.cc:2468] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 9.
I20260709 12:17:38.789232 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:38.784214 11594 raft_consensus.cc:2468] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 9.
I20260709 12:17:38.793545 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:38.766474 11526 raft_consensus.cc:2468] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 11.
I20260709 12:17:38.795939 11526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38272 (request call id 530) took 1335 ms. Trace:
I20260709 12:17:38.796473 11526 rpcz_store.cc:276] 0709 12:17:37.460248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:38.645757 (+1185509us) service_pool.cc:224] Handling call
0709 12:17:38.795857 (+150100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:38.767824 13984 raft_consensus.cc:493] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:38.815318 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 212685us
I20260709 12:17:38.818460 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:38.818485 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:38.821450 11493 leader_election.cc:304] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:38.822361 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:38.823107 12352 raft_consensus.cc:2468] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 10.
I20260709 12:17:38.790436 13995 raft_consensus.cc:2749] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:38.788190 14153 raft_consensus.cc:740] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:38.827602 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:38.794297 14436 raft_consensus.cc:2749] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579) with higher term. Message: Invalid argument: T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for earlier term 9. Current term is 10.
W20260709 12:17:38.833931 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 89282.7us
I20260709 12:17:38.836393 11417 leader_election.cc:304] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:38.783149 14416 consensus_queue.cc:1059] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 12:17:38.816939 13984 raft_consensus.cc:3060] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:38.761281 14430 raft_consensus.cc:515] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
W20260709 12:17:38.820924 14327 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.510s	user 0.013s	sys 0.023s
I20260709 12:17:38.982012 12356 raft_consensus.cc:1275] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:38.992211 12348 raft_consensus.cc:1240] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:38.819411 14425 leader_election.cc:290] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
W20260709 12:17:38.989116 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 152795us
I20260709 12:17:39.065191 11417 leader_election.cc:400] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Vote denied by peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973) with higher term. Message: Invalid argument: T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 4. Current term is 5.
I20260709 12:17:39.065541 11417 leader_election.cc:403] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:39.066589 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:39.067296 11450 raft_consensus.cc:3060] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:17:39.066589 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:17:39.062716 11493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 241351us
I20260709 12:17:39.068562 12346 raft_consensus.cc:2468] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 8.
I20260709 12:17:39.071543 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:39.076931 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:39.077427 13627 raft_consensus.cc:493] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:39.077924 13627 raft_consensus.cc:515] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:39.080561 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:39.081259 11523 raft_consensus.cc:2393] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 8: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
W20260709 12:17:38.989668 14327 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.679s	user 0.013s	sys 0.023s
I20260709 12:17:39.082234 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:17:39.080017 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 299411us
I20260709 12:17:39.085129 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:38.978772 14134 raft_consensus.cc:493] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:39.083104 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:17:39.080295 14298 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 12:17:39.060009 14326 raft_consensus.cc:493] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:39.096130 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:39.066512 14386 raft_consensus.cc:2749] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:39.104635 13627 leader_election.cc:290] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:39.099953 12346 raft_consensus.cc:3060] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:39.070366 14374 raft_consensus.cc:493] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:39.077570 14427 raft_consensus.cc:2749] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:17:39.117214 11450 raft_consensus.cc:2468] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 5.
I20260709 12:17:39.096726 14068 consensus_queue.cc:1059] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:17:39.125960 14326 raft_consensus.cc:515] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
W20260709 12:17:39.127049 14441 log.cc:927] Time spent T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.672s	user 0.005s	sys 0.013s
W20260709 12:17:39.129108 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 64040.5us
I20260709 12:17:39.138845 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:39.130329 11417 leader_election.cc:304] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:17:39.139618 11528 raft_consensus.cc:2468] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 9.
I20260709 12:17:39.141824 11491 leader_election.cc:304] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:39.099606 14378 raft_consensus.cc:3055] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:39.145470 11418 leader_election.cc:304] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:39.097930 14257 raft_consensus.cc:493] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:39.144110 14450 raft_consensus.cc:2749] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:17:39.196614 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 51261.1us
I20260709 12:17:39.155543 11452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58868 (request call id 1383) took 1144 ms. Trace:
W20260709 12:17:39.156880 14444 log.cc:927] Time spent T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.622s	user 0.000s	sys 0.008s
W20260709 12:17:39.159602 14465 log.cc:927] Time spent T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.182s	user 0.000s	sys 0.000s
W20260709 12:17:39.160521 14459 log.cc:927] Time spent T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:17:39.160676 14068 raft_consensus.cc:3055] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:17:39.165658 12204 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.3.212.131:36063 timed out after 1.527s (SENT) [suppressed 28 similar messages]
I20260709 12:17:39.156731 14064 raft_consensus.cc:515] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:39.140959 14406 raft_consensus.cc:493] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:39.169979 14388 leader_election.cc:290] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:39.170145 12356 raft_consensus.cc:1275] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:39.193692 14345 leader_election.cc:290] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:39.140678 14392 raft_consensus.cc:2749] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973) with higher term. Message: Invalid argument: T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 4. Current term is 5.
W20260709 12:17:39.144305 14409 log.cc:927] Time spent T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.240s	user 0.000s	sys 0.000s
I20260709 12:17:39.172079 14378 raft_consensus.cc:740] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:39.174930 14192 leader_election.cc:290] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:17:39.144982 14453 log.cc:927] Time spent T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.442s	user 0.001s	sys 0.000s
I20260709 12:17:39.183172 12203 leader_election.cc:304] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:39.183909 11520 raft_consensus.cc:1275] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:17:39.185588 14245 raft_consensus.cc:493] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:39.189455 14391 raft_consensus.cc:493] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:39.266266 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:39.266759 14391 raft_consensus.cc:515] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:39.267233 14328 raft_consensus.cc:493] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:39.267835 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 84751.2us
W20260709 12:17:39.191146 11493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:39.270547 11454 raft_consensus.cc:1275] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 11 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:17:39.193490 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:39.271283 11446 raft_consensus.cc:3060] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:39.271914 11454 raft_consensus.cc:1275] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:17:39.192761 14430 leader_election.cc:290] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:39.109442 14380 leader_election.cc:290] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 8 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
W20260709 12:17:39.204617 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 74347.9us
I20260709 12:17:39.206110 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:39.277014 11417 leader_election.cc:304] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:39.198139 11452 rpcz_store.cc:276] 0709 12:17:38.010826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:38.011638 (+   812us) service_pool.cc:224] Handling call
0709 12:17:38.011984 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:38.358116 (+346132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:39.155213 (+797097us) spinlock_profiling.cc:243] Waited 315 ms on lock 0x7b54000a5354. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:17:39.155470 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":724132096}
I20260709 12:17:39.096700 14134 raft_consensus.cc:515] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:39.215827 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:39.209205 14386 raft_consensus.cc:2804] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:39.216948 14300 raft_consensus.cc:2804] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:17:39.231101 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 115996us
I20260709 12:17:39.204900 14257 raft_consensus.cc:515] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
W20260709 12:17:39.171437 14461 log.cc:927] Time spent T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:17:39.133534 14374 raft_consensus.cc:515] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:39.098021 14153 consensus_queue.cc:260] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:39.218667 14068 raft_consensus.cc:740] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:39.304098 14068 consensus_queue.cc:260] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:39.305500 14068 raft_consensus.cc:3060] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:39.306478 14308 raft_consensus.cc:3060] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:39.261178 14329 leader_election.cc:290] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
W20260709 12:17:39.262382 14178 consensus_meta.cc:287] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d: Time spent flushing consensus metadata: real 0.507s	user 0.007s	sys 0.002s
I20260709 12:17:39.310112 14178 raft_consensus.cc:515] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:39.311014 14374 leader_election.cc:290] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:39.290280 14300 raft_consensus.cc:493] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:39.281759 14318 consensus_queue.cc:1048] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:17:39.267820 14328 raft_consensus.cc:515] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:39.315068 14328 leader_election.cc:290] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:39.317426 13984 raft_consensus.cc:515] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:39.318336 14064 leader_election.cc:290] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:39.319551 13984 leader_election.cc:290] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:39.283566 14386 raft_consensus.cc:493] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:39.320289 14386 raft_consensus.cc:3060] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:39.321360 14326 leader_election.cc:290] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:39.312438 14300 raft_consensus.cc:3060] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:17:39.327973 11519 consensus_meta.cc:287] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671: Time spent flushing consensus metadata: real 0.545s	user 0.004s	sys 0.004s
I20260709 12:17:39.328531 11519 raft_consensus.cc:2468] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 10.
W20260709 12:17:39.235965 14440 consensus_meta.cc:287] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671: Time spent flushing consensus metadata: real 0.615s	user 0.009s	sys 0.001s
I20260709 12:17:39.202275 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffe47647c274723808482c166efa21c" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:39.272820 11451 raft_consensus.cc:2468] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 8.
I20260709 12:17:39.285634 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:17:39.296129 11493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:39.269196 14391 leader_election.cc:290] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:39.298496 11567 leader_election.cc:304] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:39.334686 11418 leader_election.cc:304] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:39.312407 14178 leader_election.cc:290] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:39.265627 14245 raft_consensus.cc:515] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:39.333714 11520 raft_consensus.cc:2468] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 7.
I20260709 12:17:39.340713 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:39.346041 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:39.346290 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:39.236936 14406 raft_consensus.cc:515] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:39.287400 14134 leader_election.cc:290] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:39.350971 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:39.351951 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffe47647c274723808482c166efa21c" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:39.355902 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:39.357697 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:39.358165 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:39.358584 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:39.361325 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:39.362968 11418 leader_election.cc:304] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:39.370623 14257 leader_election.cc:290] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
W20260709 12:17:39.373864 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 208230us
I20260709 12:17:39.376662 11419 leader_election.cc:304] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:39.379815 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:39.381686 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:39.382619 11523 raft_consensus.cc:1240] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 9. Current term is 10. Ops: [7.5-9.6]
I20260709 12:17:39.384714 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:39.385213 11419 leader_election.cc:304] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:39.387190 11596 raft_consensus.cc:2468] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 9.
I20260709 12:17:39.284226 14192 consensus_queue.cc:1048] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 12:17:39.390054 11446 raft_consensus.cc:2468] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 8.
I20260709 12:17:39.396003 11491 leader_election.cc:304] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:39.394991 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c355b3902a4e7fb72bac6a91ea3316" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:39.345956 14392 raft_consensus.cc:2804] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:39.396977 11519 raft_consensus.cc:1240] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:39.397536 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:39.404357 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:39.398448 12204 leader_election.cc:304] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:39.426396 11491 leader_election.cc:304] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:39.431131 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:39.286031 14378 consensus_queue.cc:260] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:39.433725 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:39.435051 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:39.436803 11452 raft_consensus.cc:1275] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:17:39.429872 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7937e0cff84ef7a26c84247c8ffc08" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:39.399080 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c355b3902a4e7fb72bac6a91ea3316" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:17:39.428562 11567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:39.384775 14374 raft_consensus.cc:493] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:39.442584 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:39.345329 14440 raft_consensus.cc:515] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:39.399148 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ed4eeff0ae44d0bc1ebb8cbe3adea5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:39.395121 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:39.394337 14298 raft_consensus.cc:2749] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:39.384904 14471 raft_consensus.cc:493] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:39.457737 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:39.459092 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:39.397615 14193 raft_consensus.cc:2804] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:39.463865 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:39.422037 14328 raft_consensus.cc:493] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:39.422631 14362 raft_consensus.cc:2749] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:39.474102 13627 raft_consensus.cc:493] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:39.389096 14391 raft_consensus.cc:2804] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:39.478390 11522 raft_consensus.cc:2393] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 8: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:17:39.478271 13627 raft_consensus.cc:515] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:39.431210 14448 raft_consensus.cc:2749] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:17:39.475005 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 77747.8us
I20260709 12:17:39.441094 14211 raft_consensus.cc:2804] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:39.444615 14436 raft_consensus.cc:2804] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:39.394341 14386 raft_consensus.cc:515] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:39.481645 14391 raft_consensus.cc:493] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:39.442730 14392 raft_consensus.cc:697] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 10 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
W20260709 12:17:39.496627 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 224527us
I20260709 12:17:39.504750 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:39.505116 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:39.507262 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:39.516882 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:39.517175 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:39.471323 14193 raft_consensus.cc:493] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:39.516959 11447 raft_consensus.cc:2468] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 7.
I20260709 12:17:39.520341 12357 raft_consensus.cc:1275] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:39.458328 14087 consensus_queue.cc:1048] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:17:39.530325 11527 raft_consensus.cc:2393] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 10: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:17:39.487991 14211 raft_consensus.cc:493] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:39.307845 14377 consensus_queue.cc:1059] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:39.306118 14464 consensus_queue.cc:1059] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:39.530076 13627 leader_election.cc:290] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:39.305545 14467 consensus_queue.cc:1048] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
W20260709 12:17:39.497226 14423 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.004s	sys 0.020s
I20260709 12:17:39.493016 14391 raft_consensus.cc:3060] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:39.515552 14440 leader_election.cc:290] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:39.532846 14211 raft_consensus.cc:3060] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:39.552155 11525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33446 (request call id 1369) took 2019 ms. Trace:
I20260709 12:17:39.552632 14392 consensus_queue.cc:237] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:39.533973 14436 raft_consensus.cc:697] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 8 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:39.556614 14436 consensus_queue.cc:237] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:39.530870 14330 raft_consensus.cc:2804] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:39.558624 14464 consensus_queue.cc:1059] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:39.560627 14300 raft_consensus.cc:515] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:39.472651 14374 raft_consensus.cc:515] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:39.563117 14374 leader_election.cc:290] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:39.470316 14471 raft_consensus.cc:515] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:39.487231 14328 raft_consensus.cc:515] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:39.565732 14471 leader_election.cc:290] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:39.565860 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ed4eeff0ae44d0bc1ebb8cbe3adea5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:39.546571 14065 consensus_queue.cc:1048] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:17:39.567180 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:39.567373 14328 leader_election.cc:290] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:39.568297 14406 leader_election.cc:290] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:39.569574 14377 raft_consensus.cc:3055] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:39.569981 14377 raft_consensus.cc:740] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:39.570748 14377 consensus_queue.cc:260] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:39.549292 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:39.572376 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:39.572943 11528 raft_consensus.cc:2468] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 7.
I20260709 12:17:39.573798 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:39.574604 14153 raft_consensus.cc:3060] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:39.574813 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:39.575922 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:39.577791 11445 raft_consensus.cc:1240] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:39.580194 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:39.580227 14318 consensus_queue.cc:1048] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:17:39.583320 14443 log.cc:927] Time spent T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 1.064s	user 0.008s	sys 0.004s
I20260709 12:17:39.583833 11599 raft_consensus.cc:3055] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:39.584200 11599 raft_consensus.cc:740] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:39.584923 11599 consensus_queue.cc:260] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:39.593943 14134 consensus_queue.cc:1048] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:39.596725 14245 leader_election.cc:290] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:39.598273  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:17:39.546990 14423 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.005s	sys 0.020s
I20260709 12:17:39.546552 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:39.584918 14455 raft_consensus.cc:2764] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:17:39.586345 14300 leader_election.cc:290] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:39.586542 13995 raft_consensus.cc:493] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:39.552582 11525 rpcz_store.cc:276] 0709 12:17:37.532994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.993776 (+460782us) service_pool.cc:224] Handling call
0709 12:17:38.306651 (+312875us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:39.159377 (+852726us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:39.159412 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:39.159455 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:39.159485 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:39.551139 (+391654us) spinlock_profiling.cc:243] Waited 852 ms on lock 0x7b54006decd4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:17:39.551186 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:39.551968 (+   782us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b54006decd0. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc28ad 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:39.552092 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2628264576}
I20260709 12:17:39.638604 11602 raft_consensus.cc:1275] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:17:39.633843 14463 log.cc:927] Time spent T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:17:39.671212 14391 raft_consensus.cc:515] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:39.672873 14378 raft_consensus.cc:3060] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:39.674528 14391 leader_election.cc:290] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:39.683816 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:39.568377 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:39.594242 11599 raft_consensus.cc:3060] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:39.545691 14474 raft_consensus.cc:493] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:39.548341 14386 leader_election.cc:290] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:39.605706 12346 raft_consensus.cc:2468] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 5.
I20260709 12:17:39.528381 14193 raft_consensus.cc:3060] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:39.617210 11528 raft_consensus.cc:1275] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:17:39.569790 14211 raft_consensus.cc:515] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:39.698433 11521 raft_consensus.cc:1275] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:39.698973 14450 raft_consensus.cc:493] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:39.635294 13995 raft_consensus.cc:515] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:39.699502 14450 raft_consensus.cc:515] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:39.699935 14211 leader_election.cc:290] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 10 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:39.701067 13995 leader_election.cc:290] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:39.687517 11567 leader_election.cc:304] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
W20260709 12:17:39.706161 11567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:39.706892 14388 raft_consensus.cc:2804] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:39.707522 14388 raft_consensus.cc:697] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:39.708417 14388 consensus_queue.cc:237] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:39.710783 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:39.690232 14474 raft_consensus.cc:515] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:39.714030 14474 leader_election.cc:290] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:39.723613 14330 raft_consensus.cc:493] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:39.724176 14330 raft_consensus.cc:3060] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:39.728976 11522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33456 (request call id 1139) took 1016 ms. Trace:
W20260709 12:17:39.738581 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 241693us
I20260709 12:17:39.697671 14193 raft_consensus.cc:515] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:39.733453 11599 raft_consensus.cc:1275] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:17:39.737663 11522 rpcz_store.cc:276] 0709 12:17:38.712470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:38.712670 (+   200us) service_pool.cc:224] Handling call
0709 12:17:39.728757 (+1016087us) spinlock_profiling.cc:243] Waited 739 ms on lock 0x7b54000d2854. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc72fa 00007f84ebb88b17 00007f84e51036d4 00007f84e5103662 00007f84e5103591 00007f84e510350c 00007f84e51027c2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:39.728901 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1699828096}
I20260709 12:17:39.775381 11565 leader_election.cc:304] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:39.789528 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:17:39.794984 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 258976us
I20260709 12:17:39.741278 14406 raft_consensus.cc:493] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:39.784714 14317 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:17:39.796555 12352 raft_consensus.cc:2393] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 10: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:17:39.799547 11565 leader_election.cc:304] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
W20260709 12:17:39.796130 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 301747us
I20260709 12:17:39.811821 12204 leader_election.cc:304] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:39.799784 12203 leader_election.cc:304] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:39.814314 12204 leader_election.cc:304] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:39.799928 13984 raft_consensus.cc:2749] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:39.829819 12203 leader_election.cc:304] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:39.819846 14211 raft_consensus.cc:3060] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:17:39.832888 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 314368us
I20260709 12:17:39.850111 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:39.886529 11566 leader_election.cc:304] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:39.887476 14245 raft_consensus.cc:2749] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:39.851085 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:39.889156 14245 consensus_queue.cc:1059] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:39.890592 14245 raft_consensus.cc:3055] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:39.855332 11595 raft_consensus.cc:1240] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:39.855942 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:17:39.866201 11567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:39.852535 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:39.891776 11602 raft_consensus.cc:2468] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 10.
I20260709 12:17:39.832304 14454 raft_consensus.cc:2749] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:39.891636 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9fe9a94294836aec652338f44367d" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:39.828583 14482 raft_consensus.cc:2804] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:39.828624 14386 raft_consensus.cc:493] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:39.838121 14134 raft_consensus.cc:2804] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:39.892987 14245 raft_consensus.cc:740] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:39.896868 14482 raft_consensus.cc:493] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting leader election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:39.917968 14482 raft_consensus.cc:3060] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:17:39.922084 14485 log.cc:927] Time spent T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:17:39.926050 14245 consensus_queue.cc:260] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
W20260709 12:17:39.928194 14481 log.cc:927] Time spent T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:17:39.928791 14245 raft_consensus.cc:3060] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:39.833609 14380 consensus_queue.cc:1059] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 12:17:39.937944 14380 consensus_queue.cc:1048] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:39.823238 14406 raft_consensus.cc:515] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:39.950878 11566 leader_election.cc:304] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:39.864454 14398 consensus_queue.cc:1059] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 12:17:39.899025 14134 raft_consensus.cc:493] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:39.953846 14327 raft_consensus.cc:2749] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:39.960882 13580 raft_consensus.cc:2749] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:39.962061 13991 raft_consensus.cc:3055] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:39.960553 14374 raft_consensus.cc:493] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:39.982767 11523 raft_consensus.cc:1240] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:39.963812 14134 raft_consensus.cc:3060] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:39.963196 14064 raft_consensus.cc:493] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:39.985319 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:40.015149 11520 raft_consensus.cc:2468] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 8.
I20260709 12:17:39.966089 14329 raft_consensus.cc:493] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:39.988269 14436 raft_consensus.cc:493] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:39.990272 11491 leader_election.cc:304] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d
I20260709 12:17:39.992348 14377 raft_consensus.cc:3060] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:39.961928 14386 raft_consensus.cc:515] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:40.009464 11525 raft_consensus.cc:1240] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:40.011632 14211 raft_consensus.cc:2749] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:40.013204 14257 raft_consensus.cc:493] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:40.017761 11491 leader_election.cc:304] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:40.019847 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:39.992871 11418 leader_election.cc:304] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
W20260709 12:17:40.052412 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 59640us
W20260709 12:17:40.056489 11565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:40.023970 11521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38272 (request call id 535) took 2413 ms. Trace:
I20260709 12:17:40.057899 11521 rpcz_store.cc:276] 0709 12:17:37.610999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:38.039764 (+428765us) service_pool.cc:224] Handling call
0709 12:17:38.048767 (+  9003us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:39.698815 (+1650048us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:40.023643 (+324828us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b5400101b54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:17:40.023890 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3792935680}
W20260709 12:17:40.122906 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 105233us
I20260709 12:17:39.984843 13991 raft_consensus.cc:740] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
W20260709 12:17:40.140420 11567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:40.038480 13995 raft_consensus.cc:2804] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:40.154294 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
W20260709 12:17:40.156853 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 327115us
I20260709 12:17:40.159246 11602 raft_consensus.cc:3060] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:40.159615 12203 leader_election.cc:304] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:40.125651 13910 raft_consensus.cc:3060] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:40.121538 14193 leader_election.cc:290] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 11 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:40.016705 14374 raft_consensus.cc:515] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:40.126760 14448 raft_consensus.cc:2749] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:40.178061 12203 leader_election.cc:304] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:40.017904 14064 raft_consensus.cc:515] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:40.143085 14385 raft_consensus.cc:493] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:40.182695 12203 leader_election.cc:304] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:40.018162 14329 raft_consensus.cc:515] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:40.189608 12203 leader_election.cc:304] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:40.192421 14360 raft_consensus.cc:2749] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:40.193980 12203 leader_election.cc:304] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:40.195130 12203 leader_election.cc:304] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:40.196004 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:40.196234 12203 leader_election.cc:304] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:40.197137 14065 raft_consensus.cc:2749] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:40.197610 14087 raft_consensus.cc:2749] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:40.198205 14163 raft_consensus.cc:2749] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:40.197839 14065 raft_consensus.cc:2749] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:40.186156 14327 raft_consensus.cc:2749] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:40.201486 14065 consensus_queue.cc:1048] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:40.206362 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a841f2f09ced40a4bbf33594e11bd7ad" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:40.207501 14386 leader_election.cc:290] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:40.037688 14436 raft_consensus.cc:515] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:40.181818 14177 raft_consensus.cc:493] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:40.210311 14177 raft_consensus.cc:515] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:40.212481 14177 leader_election.cc:290] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:40.163091 13995 raft_consensus.cc:493] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:40.217667 13995 raft_consensus.cc:3060] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:40.156086 14300 raft_consensus.cc:493] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:40.222272 14300 raft_consensus.cc:515] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:40.189252 14215 raft_consensus.cc:2749] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:40.224601 14300 leader_election.cc:290] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:40.141796 14257 raft_consensus.cc:515] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:40.233566 14257 leader_election.cc:290] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:40.189796 14345 consensus_queue.cc:1059] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:17:40.190351 14392 raft_consensus.cc:493] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:40.235785 12349 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51698 (request call id 825) took 2586 ms. Trace:
I20260709 12:17:40.236022 14392 raft_consensus.cc:515] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
W20260709 12:17:40.238673 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 353450us
I20260709 12:17:40.239459 12204 leader_election.cc:304] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:40.237484 12349 rpcz_store.cc:276] 0709 12:17:37.649768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.649924 (+   156us) service_pool.cc:224] Handling call
0709 12:17:37.685836 (+ 35912us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:37.728212 (+ 42376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:37.728246 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:39.251221 (+1522975us) spinlock_profiling.cc:243] Waited 2.18 ms on lock 0x7b180012ad20. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3aa42a6 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e54bca11 00007f84e54cc372 00007f84e6bfea01 00007f84e6bc343a
0709 12:17:39.558877 (+307656us) spinlock_profiling.cc:243] Waited 9.39 ms on lock 0x7b2c0001afe8. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e54bca11 00007f84e54cc372 00007f84e6bfea01 00007f84e6bc343a 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2
0709 12:17:39.559441 (+   564us) log.cc:844] Serialized 52 byte log entry
0709 12:17:39.963496 (+404055us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:39.963546 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:39.963612 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:40.235472 (+271860us) raft_consensus.cc:1685] finished
0709 12:17:40.235496 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:40.235695 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6274,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":3555,"spinlock_wait_cycles":26616832,"thread_start_us":390413,"threads_started":1,"wal-append.queue_time_us":674238}
I20260709 12:17:40.178284 14450 leader_election.cc:290] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:40.252018 11453 raft_consensus.cc:1240] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:40.226879 14193 raft_consensus.cc:493] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:40.245095 14065 raft_consensus.cc:493] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:40.241992 14211 raft_consensus.cc:2749] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:40.271904 14211 consensus_queue.cc:1059] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:40.273046 14211 raft_consensus.cc:3055] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:40.273450 14211 raft_consensus.cc:740] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:40.274271 14211 consensus_queue.cc:260] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:40.275738 14211 raft_consensus.cc:3060] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:40.237620 13991 consensus_queue.cc:260] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:40.274139 11451 raft_consensus.cc:1275] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:17:40.270574 14177 raft_consensus.cc:493] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:40.279448 14177 raft_consensus.cc:515] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
W20260709 12:17:40.278898 14360 consensus_queue.cc:1175] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9da53be18b0f446aaa406216e20b0ec8" responder_term: 9 status { last_received { term: 9 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 9 index: 7 } }
I20260709 12:17:40.281446 14406 leader_election.cc:290] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:40.243616 14482 raft_consensus.cc:515] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:40.285557 14482 leader_election.cc:290] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:40.227249 14385 raft_consensus.cc:515] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
W20260709 12:17:40.294390 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 166345us
I20260709 12:17:40.244381 14134 raft_consensus.cc:515] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:40.297367 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:40.265664 14193 raft_consensus.cc:515] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:40.289219 14065 raft_consensus.cc:515] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:40.320562 11451 raft_consensus.cc:3060] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:40.288276 13991 raft_consensus.cc:3060] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:40.289739 14455 raft_consensus.cc:493] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:40.289574 14391 raft_consensus.cc:493] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:40.293013 14387 raft_consensus.cc:493] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
W20260709 12:17:40.332216 14330 consensus_meta.cc:287] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de: Time spent flushing consensus metadata: real 0.608s	user 0.005s	sys 0.006s
I20260709 12:17:40.297787 13910 raft_consensus.cc:2749] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:40.353968 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:40.299618 14374 leader_election.cc:290] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:40.306249 14087 consensus_queue.cc:1048] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 12:17:40.341953 14327 raft_consensus.cc:493] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:40.395967 11451 raft_consensus.cc:2468] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 9.
W20260709 12:17:40.405175 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 220467us
I20260709 12:17:40.409546 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffe47647c274723808482c166efa21c" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:40.377650 14391 raft_consensus.cc:515] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:40.410916 11595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:40.386797 14330 raft_consensus.cc:515] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:40.429528 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:40.430869 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7937e0cff84ef7a26c84247c8ffc08" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:40.404147 14329 leader_election.cc:290] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:40.406348 14177 leader_election.cc:290] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:40.463461 11602 raft_consensus.cc:2468] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 11.
I20260709 12:17:40.415561 14392 leader_election.cc:290] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:40.465626 12346 raft_consensus.cc:1240] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 11 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:40.468487 11451 raft_consensus.cc:1240] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 11 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 9. Current term is 11. Ops: []
I20260709 12:17:40.471431 11451 raft_consensus.cc:1240] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:17:40.400754 14327 raft_consensus.cc:515] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:40.473287 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:40.461486 14300 raft_consensus.cc:493] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:40.477135 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:40.479483 11446 raft_consensus.cc:3060] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:40.477183 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7937e0cff84ef7a26c84247c8ffc08" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:40.481510 11451 raft_consensus.cc:1240] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:40.482038 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:40.438292 14385 leader_election.cc:290] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
W20260709 12:17:40.483929 11565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:40.361614 14455 raft_consensus.cc:515] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:40.492671 11419 leader_election.cc:304] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:40.472262 14177 raft_consensus.cc:493] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:40.382905 14387 raft_consensus.cc:515] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:40.496253 11446 raft_consensus.cc:2468] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 8.
I20260709 12:17:40.498631 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9fe9a94294836aec652338f44367d" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
W20260709 12:17:40.499595 14513 log.cc:927] Time spent T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
W20260709 12:17:40.501112 14511 log.cc:927] Time spent T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:17:40.505978 11447 raft_consensus.cc:2468] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 6.
I20260709 12:17:40.507252 14387 leader_election.cc:290] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:40.507656 12361 raft_consensus.cc:1275] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:40.507762 12347 raft_consensus.cc:1240] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:40.513461 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:17:40.505162 11567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:40.515986 11446 raft_consensus.cc:2468] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 8.
I20260709 12:17:40.516987 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:40.517256 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:40.520105 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a841f2f09ced40a4bbf33594e11bd7ad" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:40.521768 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:40.527438 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
W20260709 12:17:40.507930 14506 log.cc:927] Time spent T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 12:17:40.531044 11565 leader_election.cc:304] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:40.535135 11565 leader_election.cc:304] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:40.536458 14193 leader_election.cc:290] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:40.536659 14345 raft_consensus.cc:2749] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:40.523707 14387 raft_consensus.cc:493] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:40.488885 14300 raft_consensus.cc:515] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:40.511750 14177 raft_consensus.cc:515] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:40.554441 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:40.527010 14385 raft_consensus.cc:493] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:40.560612 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:40.563469 11565 leader_election.cc:304] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:40.573017 11417 leader_election.cc:304] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:17:40.564384 11596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:40.511523 14516 raft_consensus.cc:2749] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:17:40.549013 13995 raft_consensus.cc:515] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:40.574283 11596 raft_consensus.cc:3060] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:40.570469 11451 raft_consensus.cc:1240] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:40.572952 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:40.556670 14257 raft_consensus.cc:2749] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:40.580425 11446 raft_consensus.cc:1275] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:40.564622 14065 leader_election.cc:290] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:17:40.600852 12204 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:40.603694 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:40.581113 14517 raft_consensus.cc:2804] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:40.604964 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:40.606453 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "167448b175c040d180318f81f6d10c8d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:40.607072 12361 raft_consensus.cc:3060] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:40.594094 14245 consensus_queue.cc:1059] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:17:40.583778 14492 consensus_queue.cc:1048] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 12:17:40.579254 14467 raft_consensus.cc:2804] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:40.622222 14517 raft_consensus.cc:697] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 11 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:40.630036 11597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40784 (request call id 455) took 1127 ms. Trace:
I20260709 12:17:40.630532 14517 consensus_queue.cc:237] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:40.632128 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:40.634441 11419 leader_election.cc:304] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
W20260709 12:17:40.622844 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 46760.1us
I20260709 12:17:40.606773 11448 raft_consensus.cc:1217] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Deduplicated request from leader. Original: 6.5->[8.6-8.6]   Dedup: 8.6->[]
I20260709 12:17:40.614233 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:40.633281 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:40.615067 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7937e0cff84ef7a26c84247c8ffc08" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:40.635897 11448 raft_consensus.cc:1240] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:17:40.615291 11596 raft_consensus.cc:2468] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 10.
I20260709 12:17:40.622014 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:40.563905 14387 raft_consensus.cc:515] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:40.624552 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffe47647c274723808482c166efa21c" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:40.626530 11446 raft_consensus.cc:1240] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:40.638007 12203 leader_election.cc:304] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:40.640542 14300 leader_election.cc:290] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:40.603618 14474 raft_consensus.cc:3055] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:40.641294 14474 raft_consensus.cc:740] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
W20260709 12:17:40.628911 14508 log.cc:927] Time spent T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.163s	user 0.000s	sys 0.002s
I20260709 12:17:40.571615 14345 consensus_queue.cc:1059] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:17:40.566639 14385 raft_consensus.cc:515] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:40.658324 14327 leader_election.cc:290] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:40.635368 12361 raft_consensus.cc:2468] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 11.
I20260709 12:17:40.610235 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:40.644971 11446 raft_consensus.cc:1240] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:40.648515 12203 leader_election.cc:304] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:40.651968 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:40.654485 14391 leader_election.cc:290] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:40.656198 14300 raft_consensus.cc:493] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:40.657974 14387 leader_election.cc:290] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
W20260709 12:17:40.681828 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 107828us
I20260709 12:17:40.698088 12203 leader_election.cc:304] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:40.630434 11597 rpcz_store.cc:276] 0709 12:17:39.502719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:39.533062 (+ 30343us) service_pool.cc:224] Handling call
0709 12:17:39.533441 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:39.712780 (+179339us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:17:39.713163 (+   383us) log.cc:844] Serialized 14 byte log entry
0709 12:17:40.134580 (+421417us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:40.134645 (+    65us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:40.134693 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:40.629805 (+495112us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b540054c754. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:17:40.629852 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:40.629979 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":94237,"prepare.queue_time_us":702,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":104431,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":11715,"spinlock_wait_cycles":411811200,"thread_start_us":326734,"threads_started":1,"wal-append.queue_time_us":522475}
W20260709 12:17:40.700104 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 49852.2us
I20260709 12:17:40.702389 11419 leader_election.cc:304] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:40.702706 12347 raft_consensus.cc:2468] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 8.
I20260709 12:17:40.704550 12203 leader_election.cc:304] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:40.660336 13863 raft_consensus.cc:2749] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:17:40.653597 14467 raft_consensus.cc:697] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 8 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:40.740374 11566 leader_election.cc:304] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:40.659708 14330 leader_election.cc:290] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 11 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:40.721082 14087 raft_consensus.cc:2749] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:40.727555 14327 raft_consensus.cc:2804] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:40.774241 14329 consensus_queue.cc:1048] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:40.776062 14134 leader_election.cc:290] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 8 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:40.730245 14423 consensus_queue.cc:1048] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:40.732275 14064 leader_election.cc:290] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:40.734130 14177 leader_election.cc:290] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:40.734488 14436 leader_election.cc:290] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:40.738620 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:40.689746 14418 raft_consensus.cc:2749] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:17:40.697475 14211 raft_consensus.cc:2804] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:40.751219 12345 raft_consensus.cc:2468] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 10.
I20260709 12:17:40.759729 14385 leader_election.cc:290] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:40.760941 13995 leader_election.cc:290] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:40.762192 14467 consensus_queue.cc:237] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:40.763805 14345 consensus_queue.cc:1059] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:40.766968 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d43eecbad746fd9ddce50c5b9fc3e8" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:40.768369 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:40.769148 14455 leader_election.cc:290] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:40.769671 14526 raft_consensus.cc:2764] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:17:40.723064 14474 consensus_queue.cc:260] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:40.771530 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d43eecbad746fd9ddce50c5b9fc3e8" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:40.783334 11446 raft_consensus.cc:2468] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 10.
I20260709 12:17:40.799005 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
W20260709 12:17:40.784436 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 136904us
I20260709 12:17:40.704075 14065 consensus_queue.cc:1059] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.078s
I20260709 12:17:40.796903 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:40.842060 11451 raft_consensus.cc:3060] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:40.806228 12203 leader_election.cc:304] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:40.786769 14327 raft_consensus.cc:697] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 10 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:40.702879 14300 raft_consensus.cc:515] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:40.870944 14317 raft_consensus.cc:493] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:40.797928 14211 raft_consensus.cc:697] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 9 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:40.871613 14317 raft_consensus.cc:515] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:40.872571 14211 consensus_queue.cc:237] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:40.859462 14245 consensus_queue.cc:1059] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:17:40.873612 14215 raft_consensus.cc:3055] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:40.874076 14215 raft_consensus.cc:740] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:40.874924 14215 consensus_queue.cc:260] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:40.876175 14215 raft_consensus.cc:3060] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:17:40.877696 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 71600.7us
I20260709 12:17:40.877899 14496 raft_consensus.cc:2804] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:40.878403 14496 raft_consensus.cc:493] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:40.878723 14496 raft_consensus.cc:3060] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:40.879448 12203 leader_election.cc:304] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:40.880667 14509 raft_consensus.cc:2749] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:17:40.787968 14423 consensus_queue.cc:1059] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 12:17:40.886173 14423 raft_consensus.cc:3055] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:17:40.886580 14423 raft_consensus.cc:740] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:40.887607 14423 consensus_queue.cc:260] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:40.888973 14423 raft_consensus.cc:3060] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:40.886512 11451 raft_consensus.cc:2468] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 8.
I20260709 12:17:40.896303 14327 consensus_queue.cc:237] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:40.846896 14455 raft_consensus.cc:493] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:40.902964 14455 raft_consensus.cc:515] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:40.944150 14300 leader_election.cc:290] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:40.947525 14496 raft_consensus.cc:515] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:40.951156 14455 leader_election.cc:290] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:40.970043 14317 leader_election.cc:290] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:40.975672 14496 leader_election.cc:290] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 11 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:17:41.023109 14519 log.cc:927] Time spent T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.447s	user 0.004s	sys 0.005s
I20260709 12:17:41.044440 12203 leader_election.cc:304] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
W20260709 12:17:41.044963 11565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:41.048123 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:41.048847 12361 raft_consensus.cc:2393] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 10: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
W20260709 12:17:41.049868 11567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:41.051011 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:41.046856 14215 raft_consensus.cc:2749] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:41.055961 14474 raft_consensus.cc:3060] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:41.061528 11524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38272 (request call id 547) took 1570 ms. Trace:
I20260709 12:17:41.061992 11524 rpcz_store.cc:276] 0709 12:17:39.490716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:39.495650 (+  4934us) service_pool.cc:224] Handling call
0709 12:17:39.495991 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:39.496228 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:17:39.899083 (+402855us) log.cc:844] Serialized 14 byte log entry
0709 12:17:40.249256 (+350173us) log.cc:844] Serialized 14 byte log entry
0709 12:17:41.061007 (+811751us) spinlock_profiling.cc:243] Waited 4.72 ms on lock 0x7b1800129640. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3a50c0a 00007f84ed190219 00007f84e3ad8a40 00007f84e3ad34e4 00007f84e3ad3455 00007f84e6bbb060 00007f84e6bcd716 00007f84e6bde287 00007f84e6bde208
0709 12:17:41.061158 (+   151us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:41.061212 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:41.061257 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:41.061321 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:41.061466 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4046,"prepare.queue_time_us":99833,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":2438,"raft.queue_time_us":13080,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":6569,"spinlock_wait_cycles":53155840,"thread_start_us":709516,"threads_started":2,"wal-append.queue_time_us":454424}
W20260709 12:17:41.064340 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 767580us
I20260709 12:17:41.065788 11491 leader_election.cc:304] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:41.070370 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:41.071092 11521 raft_consensus.cc:2468] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 9.
I20260709 12:17:41.069039 14425 consensus_queue.cc:1048] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
W20260709 12:17:41.073535 11493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 750607us
I20260709 12:17:41.073706 14425 consensus_queue.cc:1059] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:41.074636 14308 raft_consensus.cc:2804] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:41.075084 14308 raft_consensus.cc:493] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:41.075425 14308 raft_consensus.cc:3060] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:41.078039 14374 raft_consensus.cc:3055] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:41.078467 14374 raft_consensus.cc:740] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:41.079244 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:41.079912 11519 raft_consensus.cc:2468] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 7.
I20260709 12:17:41.082904 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:41.084340 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:41.084962 11519 raft_consensus.cc:2376] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 9. Re-sending same reply.
I20260709 12:17:41.087625 11525 raft_consensus.cc:1275] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:17:41.088371 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:41.085143 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:41.090408 11522 raft_consensus.cc:3060] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:17:41.091501 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:41.092020 11523 raft_consensus.cc:2468] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 9.
I20260709 12:17:41.093170 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:41.099236 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:41.099815 11527 raft_consensus.cc:3060] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:41.106555 12204 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:41.107371 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 405042us
I20260709 12:17:41.108170 11419 leader_election.cc:304] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:41.097846 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:41.109081 11525 raft_consensus.cc:2468] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 10.
I20260709 12:17:41.050632 14467 raft_consensus.cc:493] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:41.110627 14467 raft_consensus.cc:515] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:41.111886 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:41.112720 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:41.117827 11525 raft_consensus.cc:1275] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:17:41.119335 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:41.127254 11522 raft_consensus.cc:2468] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 10.
I20260709 12:17:41.130332 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:41.131229 11522 raft_consensus.cc:2393] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 8: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:17:41.130872 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:41.131865 11528 raft_consensus.cc:3060] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:41.163868 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:41.149127 12203 leader_election.cc:304] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:41.110165 14529 raft_consensus.cc:2749] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:41.177716 11527 raft_consensus.cc:2468] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 8.
I20260709 12:17:41.175855 13627 raft_consensus.cc:2804] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:41.181600 13627 raft_consensus.cc:697] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 8 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:41.184196 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:41.184976 11520 raft_consensus.cc:2468] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 7.
I20260709 12:17:41.186064 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:41.178818 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8741606df54c3f8b5cc5c1141862ea" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:17:41.187927 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 79831.1us
I20260709 12:17:41.189283 11419 leader_election.cc:304] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:41.190760 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:41.193363 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:41.194089 11520 raft_consensus.cc:2468] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 10.
I20260709 12:17:41.193941 13627 consensus_queue.cc:237] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:41.201210 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:41.201949 11449 raft_consensus.cc:3060] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:41.202353 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:41.202920 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:41.145318 14448 raft_consensus.cc:493] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:41.177795 14300 raft_consensus.cc:493] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:41.079211 14374 consensus_queue.cc:260] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:41.174602 14530 raft_consensus.cc:493] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:41.208573 14450 raft_consensus.cc:493] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:41.209088 14540 raft_consensus.cc:493] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:41.183532 14536 raft_consensus.cc:493] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:41.226334 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:41.201231 14391 raft_consensus.cc:2749] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:41.204625 14377 raft_consensus.cc:493] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:41.204532 14517 raft_consensus.cc:493] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:41.222761 14416 raft_consensus.cc:2749] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:41.251868 11528 raft_consensus.cc:2468] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 11.
I20260709 12:17:41.265640 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:41.244701 14515 raft_consensus.cc:493] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:41.279863 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 63698.1us
I20260709 12:17:41.297886 11418 leader_election.cc:304] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:41.296406 11449 raft_consensus.cc:2468] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 11.
I20260709 12:17:41.249559 14536 raft_consensus.cc:515] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:41.299975 14515 raft_consensus.cc:515] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:41.302047 14536 leader_election.cc:290] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:41.302054 14515 leader_election.cc:290] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:41.303483 14308 raft_consensus.cc:515] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:41.224645 14448 raft_consensus.cc:515] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:41.269284 14377 raft_consensus.cc:515] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:41.305958 14448 leader_election.cc:290] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:41.240672 14530 raft_consensus.cc:515] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:41.311034 11519 raft_consensus.cc:1240] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:41.311859 14530 leader_election.cc:290] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:41.316411 11594 raft_consensus.cc:2468] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 9.
I20260709 12:17:41.269868 14517 raft_consensus.cc:515] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:41.320756 14517 leader_election.cc:290] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:41.318385 14308 leader_election.cc:290] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 11 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:41.322858 14467 leader_election.cc:290] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:41.325227 11418 leader_election.cc:304] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:41.326483 14530 raft_consensus.cc:2804] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:41.326898 14530 raft_consensus.cc:493] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:41.327251 14530 raft_consensus.cc:3060] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:41.247964 14540 raft_consensus.cc:515] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:41.332369 14540 leader_election.cc:290] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:41.243975 14450 raft_consensus.cc:515] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:41.335115 14450 leader_election.cc:290] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:41.337844 14392 consensus_queue.cc:1048] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:41.321764 14539 raft_consensus.cc:493] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:41.322373 14064 consensus_queue.cc:1048] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:41.228821 14300 raft_consensus.cc:515] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:41.348299 11418 leader_election.cc:304] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:41.371628 11418 leader_election.cc:304] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:41.379149 11418 leader_election.cc:304] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:41.361261 14388 raft_consensus.cc:3055] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:17:41.406303 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 200499us
I20260709 12:17:41.407274 11491 leader_election.cc:304] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:41.377908 14392 raft_consensus.cc:3060] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:41.406984 11418 leader_election.cc:304] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:41.408618 11491 leader_election.cc:304] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:41.417950 11445 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35814 (request call id 519) took 1178 ms. Trace:
I20260709 12:17:41.400218 14386 raft_consensus.cc:2749] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:41.418201 11491 leader_election.cc:304] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
W20260709 12:17:41.419365 11568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:41.420920 11491 leader_election.cc:304] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:41.403304 14388 raft_consensus.cc:740] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:41.423456 11491 leader_election.cc:304] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
W20260709 12:17:41.430048 14546 log.cc:927] Time spent T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:17:41.421345 14177 raft_consensus.cc:2804] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:41.424274 14540 raft_consensus.cc:2749] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:41.434573 14388 consensus_queue.cc:260] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:41.424753 14450 raft_consensus.cc:2804] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:41.410909 13995 raft_consensus.cc:2749] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:41.453439 12361 raft_consensus.cc:1275] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:41.455459 12346 raft_consensus.cc:1240] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 9 LEADER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 8. Current term is 9. Ops: []
W20260709 12:17:41.456069 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 266824us
I20260709 12:17:41.409617 14385 raft_consensus.cc:2804] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:41.371033 14539 raft_consensus.cc:515] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:41.424578 14517 raft_consensus.cc:2804] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:41.456025 14177 raft_consensus.cc:493] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:41.455610 14448 raft_consensus.cc:493] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:41.460037 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:41.473722 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:41.460691 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:41.465039 11419 leader_election.cc:304] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
W20260709 12:17:41.475909 14544 log.cc:927] Time spent T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:17:41.477415 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:41.478286 11491 leader_election.cc:304] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:41.473297 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:17:41.465430 14528 log.cc:927] Time spent T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.760s	user 0.005s	sys 0.011s
I20260709 12:17:41.480962 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:41.466123 14385 raft_consensus.cc:493] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:41.483464 11419 leader_election.cc:304] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:41.488119 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:41.471144 14450 raft_consensus.cc:697] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [term 8 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:41.488812 12346 raft_consensus.cc:2468] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 10.
I20260709 12:17:41.477782 14177 raft_consensus.cc:3060] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:41.493283 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:41.495740 11565 leader_election.cc:304] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:41.497522 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ed4eeff0ae44d0bc1ebb8cbe3adea5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:41.479167 14553 raft_consensus.cc:2749] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:41.502246 12346 raft_consensus.cc:2393] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 8: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:41.504786 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:41.482200 14555 raft_consensus.cc:2749] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:41.505491 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:41.505967 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:41.506734 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:41.507687 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:41.488627 14385 raft_consensus.cc:3060] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:41.511323 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:41.511706 11449 raft_consensus.cc:1275] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:41.512591 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:41.512745 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:41.513161 11453 raft_consensus.cc:2468] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 10.
I20260709 12:17:41.514014 11447 raft_consensus.cc:2393] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 9: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:41.516683 14517 raft_consensus.cc:493] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:41.517138 14517 raft_consensus.cc:3060] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:17:41.493831 14549 log.cc:927] Time spent T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:17:41.509549 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:41.492929 14416 raft_consensus.cc:2804] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:41.540014 14416 raft_consensus.cc:697] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 8 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:41.540966 14416 consensus_queue.cc:237] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:41.542160 14153 raft_consensus.cc:3055] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:41.479831 14448 raft_consensus.cc:515] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:41.521739 14300 leader_election.cc:290] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:41.522219 11452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58868 (request call id 1403) took 1047 ms. Trace:
I20260709 12:17:41.508896 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:41.503764 14257 consensus_queue.cc:1048] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:17:41.503937 14534 raft_consensus.cc:2804] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:41.530467 14492 raft_consensus.cc:3055] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:41.564675 14492 raft_consensus.cc:740] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:41.566078 11449 raft_consensus.cc:1275] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:41.557816 14534 raft_consensus.cc:493] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:41.567243 14534 raft_consensus.cc:3060] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:41.509979 11450 raft_consensus.cc:2393] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 10: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:41.547526 11565 leader_election.cc:304] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:41.549676 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:41.554396 11452 rpcz_store.cc:276] 0709 12:17:40.475271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.475644 (+   373us) service_pool.cc:224] Handling call
0709 12:17:40.488164 (+ 12520us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:40.575547 (+ 87383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:40.575582 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:40.575630 (+    48us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:40.575668 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:41.522007 (+946339us) spinlock_profiling.cc:243] Waited 87.1 ms on lock 0x7b54007f6554. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:17:41.522052 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:41.522160 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":200443648}
W20260709 12:17:41.546643 12204 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:41.565697 14492 consensus_queue.cc:260] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:41.558959 14450 consensus_queue.cc:237] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:41.578475 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:41.580363 12345 raft_consensus.cc:2468] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 10.
I20260709 12:17:41.581709 11524 raft_consensus.cc:1240] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:41.581699 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:41.585355 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:41.585799 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ed4eeff0ae44d0bc1ebb8cbe3adea5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:41.418519 11445 rpcz_store.cc:276] 0709 12:17:40.239522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.239670 (+   148us) service_pool.cc:224] Handling call
0709 12:17:40.247912 (+  8242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:40.248124 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:17:40.572317 (+324193us) log.cc:844] Serialized 14 byte log entry
0709 12:17:41.410044 (+837727us) log.cc:844] Serialized 14 byte log entry
0709 12:17:41.417581 (+  7537us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:41.417634 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:41.417684 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:41.417757 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:41.417879 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":444617,"prepare.queue_time_us":237527,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":86,"raft.queue_time_us":456750,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":7441,"thread_start_us":710214,"threads_started":3,"wal-append.queue_time_us":274539}
I20260709 12:17:41.591301 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:41.598860 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:41.599678 12352 raft_consensus.cc:2468] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 5.
I20260709 12:17:41.619910 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:41.625173 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:41.550035 14153 raft_consensus.cc:740] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:41.661159 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:41.661629 12361 raft_consensus.cc:1275] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 11 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:17:41.663126 12346 raft_consensus.cc:2393] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 11: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:17:41.667579 12204 leader_election.cc:304] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:41.506062 14530 raft_consensus.cc:515] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:41.679603 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:41.680322 12357 raft_consensus.cc:2468] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 10.
I20260709 12:17:41.685629 12204 leader_election.cc:304] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d
I20260709 12:17:41.576398 14377 leader_election.cc:290] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:41.628737 13580 raft_consensus.cc:2804] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:41.649715 14474 raft_consensus.cc:493] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:41.649936 13984 raft_consensus.cc:493] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:41.677524 14492 raft_consensus.cc:3060] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:41.712805 12204 leader_election.cc:304] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:41.709627 14360 consensus_queue.cc:1048] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:17:41.670729 14345 raft_consensus.cc:493] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:41.732986 11520 raft_consensus.cc:3055] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:41.733584 11520 raft_consensus.cc:740] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:41.734400 11520 consensus_queue.cc:260] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:41.706310 14215 raft_consensus.cc:2749] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:41.673532 14448 leader_election.cc:290] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:41.713874 13580 raft_consensus.cc:493] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:41.714645 14087 raft_consensus.cc:493] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
W20260709 12:17:41.744524 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 266311us
I20260709 12:17:41.745692 11491 leader_election.cc:304] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:41.732419 13863 raft_consensus.cc:2804] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:41.753269 11523 raft_consensus.cc:1275] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:17:41.757509 11493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 263828us
I20260709 12:17:41.737133 14539 leader_election.cc:290] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:41.743068 13580 raft_consensus.cc:3060] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:41.722754 13984 raft_consensus.cc:515] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:41.721203 14474 raft_consensus.cc:515] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:41.767491 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:41.759727 14552 raft_consensus.cc:2749] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:41.738793 14345 raft_consensus.cc:515] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:41.773167 14553 raft_consensus.cc:2749] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:41.785557 14245 raft_consensus.cc:493] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:41.788448 14245 raft_consensus.cc:515] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:41.788928 13984 leader_election.cc:290] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:41.791219 14245 leader_election.cc:290] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:41.792079 11602 raft_consensus.cc:1275] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:17:41.792537 11602 pending_rounds.cc:85] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8: Aborting all ops after (but not including) 5
I20260709 12:17:41.792764 11602 pending_rounds.cc:107] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:17:41.793025 11602 raft_consensus.cc:2889] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:41.800017 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:41.781529 14534 raft_consensus.cc:515] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:41.802327 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8741606df54c3f8b5cc5c1141862ea" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:41.803654 14534 leader_election.cc:290] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
W20260709 12:17:41.804889 11567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:41.805991 14436 raft_consensus.cc:2749] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:41.732215 14153 consensus_queue.cc:260] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:41.810279 14153 raft_consensus.cc:3060] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:41.791328 14474 leader_election.cc:290] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:41.811790 11419 leader_election.cc:304] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:41.812748 14516 raft_consensus.cc:2804] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:41.813954 14516 raft_consensus.cc:697] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 10 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:41.814827 14516 consensus_queue.cc:237] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:41.817338 11451 raft_consensus.cc:1240] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:41.823405 11448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58868 (request call id 1402) took 1348 ms. Trace:
I20260709 12:17:41.823873 11448 rpcz_store.cc:276] 0709 12:17:40.474828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.474973 (+   145us) service_pool.cc:224] Handling call
0709 12:17:40.606611 (+131638us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:40.647714 (+ 41103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:41.823209 (+1175495us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b540058f050. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc28ad 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6 00007f84e4efd26f
0709 12:17:41.823342 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":299387776}
I20260709 12:17:41.824776 11419 leader_election.cc:304] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:41.762125 13863 raft_consensus.cc:697] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 11 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:41.827570 11419 leader_election.cc:304] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:41.752652 14087 raft_consensus.cc:515] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
W20260709 12:17:41.829911 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 251869us
W20260709 12:17:41.831471 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 85889.8us
I20260709 12:17:41.831631 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:41.837800 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:41.837270 11419 leader_election.cc:304] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:41.840291 11491 leader_election.cc:304] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:41.796865 14517 raft_consensus.cc:515] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
W20260709 12:17:41.836155 14543 log.cc:927] Time spent T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:17:41.853057 11602 raft_consensus.cc:1275] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:41.777451 14360 consensus_queue.cc:1048] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 12:17:41.783383 14471 consensus_queue.cc:1059] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 12:17:41.873358 14471 consensus_queue.cc:1243] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Peer b126028166e8480ba25541bf8f7fc6de log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:17:41.838733 14555 raft_consensus.cc:3060] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:17:41.858572 11491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:41.836673 14300 raft_consensus.cc:2804] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:41.859818 14558 raft_consensus.cc:2804] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:41.848450 14418 raft_consensus.cc:2804] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:41.883292 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:41.866420 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:41.884384 12348 raft_consensus.cc:2393] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 10: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:41.884976 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:41.867465 14087 leader_election.cc:290] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:41.870812 14345 leader_election.cc:290] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:41.872596 14530 leader_election.cc:290] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:41.857628 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "721df15d88f64a09bcaa4fe04a559f48" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:41.857610 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:41.877197 11491 leader_election.cc:304] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
W20260709 12:17:41.891011 11493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 131818us
I20260709 12:17:41.848204 14464 consensus_queue.cc:1048] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:17:41.886205 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:41.886936 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d43eecbad746fd9ddce50c5b9fc3e8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:41.867147 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:41.838894 14529 consensus_queue.cc:1048] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:17:41.898203 11491 leader_election.cc:304] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:41.915427 11593 raft_consensus.cc:2410] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for term 11 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:17:41.916560 13995 raft_consensus.cc:2749] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:41.875840 14385 raft_consensus.cc:515] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:41.919169 14385 leader_election.cc:290] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:41.879444 14300 raft_consensus.cc:493] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:41.920178 14300 raft_consensus.cc:3060] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:41.920557 14548 raft_consensus.cc:493] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:41.921172 14548 raft_consensus.cc:515] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:41.903002 12346 raft_consensus.cc:1240] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:41.896246 14558 raft_consensus.cc:697] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 9 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:41.926818 14558 consensus_queue.cc:237] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:41.866075 13863 consensus_queue.cc:237] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:41.876520 14177 raft_consensus.cc:515] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:41.889016 14418 raft_consensus.cc:493] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:41.931995 14418 raft_consensus.cc:3060] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:41.917109 11491 leader_election.cc:304] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:41.937090 14568 raft_consensus.cc:2749] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:41.938967 13580 raft_consensus.cc:515] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:41.900661 14064 raft_consensus.cc:2749] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:17:41.954316 11568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:41.944835 14392 raft_consensus.cc:2749] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:41.959192 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:41.917341 13995 consensus_queue.cc:1048] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:17:41.969566 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:41.970415 11598 raft_consensus.cc:2468] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 10.
I20260709 12:17:41.974033 11493 leader_election.cc:304] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:41.981598 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:41.980232 11566 leader_election.cc:304] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:41.986828 11493 leader_election.cc:304] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:41.987432 11566 leader_election.cc:304] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:41.989573 11493 leader_election.cc:304] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:41.992995 11566 leader_election.cc:304] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:41.995257 11566 leader_election.cc:304] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:41.994356 14536 raft_consensus.cc:2749] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:41.998726 13984 raft_consensus.cc:2749] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:41.983989 14535 raft_consensus.cc:2749] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:42.006471 11566 leader_election.cc:304] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:41.990353 14064 raft_consensus.cc:2749] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:17:42.010753 11493 leader_election.cc:304] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d
I20260709 12:17:41.990650 14569 raft_consensus.cc:2749] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:42.017879 11493 leader_election.cc:304] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
W20260709 12:17:42.020303 11568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:42.003377 14517 leader_election.cc:290] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:42.022572 11566 leader_election.cc:304] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:42.024098 13995 raft_consensus.cc:3060] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:42.032982 13580 leader_election.cc:290] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:42.011256 14536 raft_consensus.cc:2749] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:42.002918 14570 raft_consensus.cc:2749] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:42.017948 13984 raft_consensus.cc:2749] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:42.021396 14568 raft_consensus.cc:2804] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:42.038374 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:42.036604 13580 raft_consensus.cc:2749] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:42.048432 11417 leader_election.cc:304] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:42.049353 14392 consensus_queue.cc:1048] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:42.049851 11417 leader_election.cc:304] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:42.050642 14517 raft_consensus.cc:2749] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:42.050786 11593 raft_consensus.cc:1275] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 11 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:17:42.051318 14517 raft_consensus.cc:2749] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:42.039036 14568 raft_consensus.cc:493] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:42.055209 14568 raft_consensus.cc:3060] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:42.056574 14300 raft_consensus.cc:515] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:42.067046 14300 leader_election.cc:290] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:42.071419 14568 raft_consensus.cc:515] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:42.070269 13995 raft_consensus.cc:2749] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:42.053354 11417 leader_election.cc:304] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:42.074775 14418 raft_consensus.cc:515] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:42.076977 14418 leader_election.cc:290] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 11 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:42.078402 14555 raft_consensus.cc:2749] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:42.079151 14555 raft_consensus.cc:2749] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:42.080948 11418 leader_election.cc:304] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:42.084160 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:42.085647 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:42.091472 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:42.098598 11417 leader_election.cc:304] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:42.110795 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:42.118675 14388 raft_consensus.cc:3060] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:42.119078 11492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:42.121780 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:42.122494 11593 raft_consensus.cc:3060] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:42.129942 14548 leader_election.cc:290] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:42.131336 11520 raft_consensus.cc:3060] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:42.135878 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:42.138944 14177 leader_election.cc:290] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 11 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:42.142567 11593 raft_consensus.cc:2468] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 11.
I20260709 12:17:42.147778 11520 raft_consensus.cc:1275] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:42.115772 14387 raft_consensus.cc:2749] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:42.111845 14530 raft_consensus.cc:2749] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:42.168627 14568 leader_election.cc:290] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:42.164614 11417 leader_election.cc:304] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:17:42.186897 11446 raft_consensus.cc:1275] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:17:42.190769 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:42.203838 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d43eecbad746fd9ddce50c5b9fc3e8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:42.206012 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:42.207510 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a215788da7ae4b548e5c307a6b294109" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:42.230309 11454 raft_consensus.cc:1240] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:17:42.231231 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:42.238603 11565 leader_election.cc:304] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:42.241119 11445 raft_consensus.cc:1240] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:42.241981 11565 leader_election.cc:304] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:42.242260 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:42.245594 11565 leader_election.cc:304] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:42.247730 11565 leader_election.cc:304] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:42.237789 14381 consensus_queue.cc:1048] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 12:17:42.235854 14550 raft_consensus.cc:2804] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:42.249471 14534 consensus_queue.cc:1059] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:17:42.249462 14153 raft_consensus.cc:2749] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:42.244941 14257 raft_consensus.cc:2749] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:42.252334 14493 raft_consensus.cc:2749] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:42.255131 11565 leader_election.cc:304] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:42.255555 14534 raft_consensus.cc:3055] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:42.256706 14534 raft_consensus.cc:740] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:42.164475 14300 consensus_queue.cc:1048] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 12:17:42.257519 14534 consensus_queue.cc:260] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:42.258879 14534 raft_consensus.cc:3060] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:42.261740 14153 raft_consensus.cc:3060] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:42.268191 14550 raft_consensus.cc:697] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 11 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:42.269219 14550 consensus_queue.cc:237] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:42.247465 14557 raft_consensus.cc:2749] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:42.244184 14392 raft_consensus.cc:493] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:42.272272 14392 raft_consensus.cc:515] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:42.274592 14392 leader_election.cc:290] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:42.243052 14530 raft_consensus.cc:493] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:42.275408 14530 raft_consensus.cc:515] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:42.278159 14530 leader_election.cc:290] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:42.283295 14153 raft_consensus.cc:2749] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:17:42.295018 14564 log.cc:927] Time spent T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.338s	user 0.004s	sys 0.008s
I20260709 12:17:42.295957 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:42.301357 11598 raft_consensus.cc:2410] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:17:42.306751 11598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "b126028166e8480ba25541bf8f7fc6de"
 from {username='slave'} at 127.0.0.1:37992
I20260709 12:17:42.307337 11598 raft_consensus.cc:606] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 11 FOLLOWER]: Received request to transfer leadership to TS b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:42.307682 11598 raft_consensus.cc:614] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:42.291039 14153 raft_consensus.cc:493] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:42.324054 11598 raft_consensus.cc:1275] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:17:42.328025 14300 consensus_queue.cc:1048] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:17:42.337741 11598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b179748933846ae9a419549cdfb997a"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "a03223e9e41247c3a36b7b7c3d476671"
 from {username='slave'} at 127.0.0.1:37992
I20260709 12:17:42.338727 11598 raft_consensus.cc:606] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Received request to transfer leadership to TS a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:42.339145 11598 raft_consensus.cc:614] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:42.340740 11448 raft_consensus.cc:1240] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:42.342440 14534 consensus_queue.cc:1059] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:42.343376 14388 raft_consensus.cc:3055] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:42.343901 14388 raft_consensus.cc:740] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:42.343664 11598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb7937e0cff84ef7a26c84247c8ffc08"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "b126028166e8480ba25541bf8f7fc6de"
 from {username='slave'} at 127.0.0.1:37992
I20260709 12:17:42.344954 14388 consensus_queue.cc:260] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:42.318876 14153 raft_consensus.cc:515] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:42.365598 11522 raft_consensus.cc:1275] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:17:42.351902 13991 raft_consensus.cc:2804] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:42.360060 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:42.361744 11419 leader_election.cc:304] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
W20260709 12:17:42.362214 11276 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57426 (request call id 165) took 26072 ms (client timeout 15000 ms). Trace:
I20260709 12:17:42.365326 14374 raft_consensus.cc:3060] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:42.365899 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:42.372928 11598 raft_consensus.cc:606] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Received request to transfer leadership to TS b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:42.387545 11598 raft_consensus.cc:614] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:42.375196 14550 raft_consensus.cc:2749] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:42.378466 14087 raft_consensus.cc:493] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:42.383150 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:42.391834 11599 raft_consensus.cc:2468] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 9.
I20260709 12:17:42.392692 12359 raft_consensus.cc:2393] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 10: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:17:42.392666 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:42.391527 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:42.388259 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:42.394294 12345 raft_consensus.cc:3060] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:42.388433 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:42.391160 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:42.397327 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:42.371230 14388 raft_consensus.cc:3060] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:42.391446 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:42.398201 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "193e9917816a4990998188f9a4e9d08c" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:42.398778 11445 raft_consensus.cc:1275] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:42.402127 12357 raft_consensus.cc:3060] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:42.399163 11446 raft_consensus.cc:1275] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:42.398192 14087 raft_consensus.cc:515] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:42.403847 11448 raft_consensus.cc:2393] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 9: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:42.404654 11567 leader_election.cc:304] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:42.405596 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:42.407491 11594 raft_consensus.cc:1275] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:17:42.370909 11276 rpcz_store.cc:269] 0709 12:17:16.294228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:16.331014 (+ 36786us) service_pool.cc:224] Handling call
0709 12:17:42.362137 (+26031123us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:36.730041 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:36.730706 (+   665us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:36.730761 (+    55us) write_op.cc:435] Acquired schema lock
0709 12:17:36.730781 (+    20us) tablet.cc:662] Decoding operations
0709 12:17:36.731736 (+   955us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:36.731829 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:36.731865 (+    36us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:17:36.732602 (+   737us) tablet.cc:701] Row locks acquired
0709 12:17:36.732650 (+    48us) write_op.cc:260] PREPARE: finished
0709 12:17:36.732836 (+   186us) write_op.cc:270] Start()
0709 12:17:36.732994 (+   158us) write_op.cc:276] Timestamp: P: 1783599456732767 usec, L: 0
0709 12:17:36.733015 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:17:36.858124 (+125109us) log.cc:844] Serialized 3257 byte log entry
0709 12:17:37.626122 (+767998us) spinlock_profiling.cc:243] Waited 3.01 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e3ab90ac 00007f84ec9139a9 00007f84e3ad569b 00007f84e3ad393f 00007f84e3ad5c02 00007f84e675d20b
0709 12:17:39.193518 (+1567396us) spinlock_profiling.cc:243] Waited 2.92 ms on lock 0x7b1800022120. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3ab8e07 00007f84ec9139a9 00007f84e3ad569b 00007f84e3ad393f 00007f84e3ad3455 00007f84e6b40190 00007f84e6b39ae7 00007f84e6b38dd9 00007f84e6b43930
0709 12:17:39.673783 (+480265us) op_driver.cc:464] REPLICATION: finished
0709 12:17:40.282276 (+608493us) write_op.cc:301] APPLY: starting
0709 12:17:40.282389 (+   113us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:40.282595 (+   206us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:40.282633 (+    38us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:40.283742 (+  1109us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:40.284046 (+   304us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:17:40.284087 (+    41us) write_op.cc:312] APPLY: finished
0709 12:17:40.284435 (+   348us) log.cc:844] Serialized 64 byte log entry
0709 12:17:40.284633 (+   198us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:40.284754 (+   121us) write_op.cc:454] Released schema lock
0709 12:17:40.284811 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:40.285209 (+   398us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:40.285234 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6865829,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":608169,"apply.run_cpu_time_us":2924,"apply.run_wall_time_us":2924,"num_ops":8,"prepare.queue_time_us":139997,"prepare.run_cpu_time_us":64050,"prepare.run_wall_time_us":1210837,"raft.queue_time_us":1704944,"raft.run_cpu_time_us":27986,"raft.run_wall_time_us":484270,"replication_time_us":2940603,"spinlock_wait_cycles":13625984,"thread_start_us":1824933,"threads_started":4,"wal-append.queue_time_us":923998,"wal-append.run_cpu_time_us":59034,"wal-append.run_wall_time_us":3496711}]]}
I20260709 12:17:42.382068 14153 leader_election.cc:290] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:42.411568 12348 raft_consensus.cc:1275] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:17:42.421623 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:42.427543 12345 raft_consensus.cc:2468] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 11.
I20260709 12:17:42.428241 11454 raft_consensus.cc:1275] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:17:42.429029 11452 raft_consensus.cc:2393] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 10: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:42.429286 12357 raft_consensus.cc:2468] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 11.
I20260709 12:17:42.433917 11491 leader_election.cc:304] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:42.430642 11445 raft_consensus.cc:1275] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:42.433696 12346 raft_consensus.cc:1275] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:17:42.441298 11491 leader_election.cc:304] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:42.409328 13991 raft_consensus.cc:493] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:42.415769 14534 raft_consensus.cc:2749] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:42.477078 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:42.477790 11526 raft_consensus.cc:3060] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:42.476011 11594 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "a03223e9e41247c3a36b7b7c3d476671"
 from {username='slave'} at 127.0.0.1:37992
W20260709 12:17:42.485764 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 51527.2us
I20260709 12:17:42.432993 13863 consensus_queue.cc:1048] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:17:42.487221 14448 consensus_queue.cc:1048] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:17:42.461860 14539 raft_consensus.cc:2749] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:42.494379 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:42.495095 14087 leader_election.cc:290] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:42.501070 11519 raft_consensus.cc:1275] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:17:42.501720 11599 raft_consensus.cc:1275] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:17:42.508286 11567 leader_election.cc:304] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:42.427547 14360 consensus_queue.cc:1059] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 12:17:42.456645 14568 raft_consensus.cc:2749] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:42.514040 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:17:42.487244 14592 log.cc:927] Time spent T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
W20260709 12:17:42.519279 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 57083.8us
I20260709 12:17:42.523689 11526 raft_consensus.cc:2468] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 11.
I20260709 12:17:42.460744 13991 raft_consensus.cc:3060] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:42.532547 11524 raft_consensus.cc:1275] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 12:17:42.536362 11524 pending_rounds.cc:85] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671: Aborting all ops after (but not including) 5
I20260709 12:17:42.536664 11524 pending_rounds.cc:107] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:17:42.536929 11524 raft_consensus.cc:2889] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:42.455776 14211 consensus_queue.cc:1048] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 12:17:42.506654 14567 raft_consensus.cc:493] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:42.517758 14566 raft_consensus.cc:493] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:42.565856 12349 raft_consensus.cc:2468] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 10.
I20260709 12:17:42.525838 14526 raft_consensus.cc:2749] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:17:42.560639 11275 catalog_manager.cc:5697] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } }
I20260709 12:17:42.569566 11493 leader_election.cc:304] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:42.518215 14540 consensus_queue.cc:1048] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:17:42.518105 14416 consensus_queue.cc:1048] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:17:42.589902 12203 leader_election.cc:304] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:42.592520 11275 catalog_manager.cc:5697] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 3 to 7, leader changed from a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131) to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 7 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:42.596884 13995 consensus_queue.cc:1048] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:17:42.601154 14600 raft_consensus.cc:2804] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:42.601676 14600 raft_consensus.cc:493] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:42.602178 14600 raft_consensus.cc:3060] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:42.605219 14496 consensus_queue.cc:1048] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:42.595954 14515 consensus_queue.cc:1048] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:17:42.606707 14406 raft_consensus.cc:493] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:42.607064 14374 raft_consensus.cc:493] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:42.607630 14374 raft_consensus.cc:515] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:42.587414 14448 raft_consensus.cc:2804] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:42.544109 14567 raft_consensus.cc:515] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:42.573813 14534 consensus_queue.cc:1048] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:17:42.616060 11418 leader_election.cc:304] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:42.627090 11418 leader_election.cc:304] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:42.622226 11275 catalog_manager.cc:5697] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:42.630182 11598 raft_consensus.cc:1275] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:42.572736 14566 raft_consensus.cc:515] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:42.616739 14416 raft_consensus.cc:493] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:42.645910 14416 raft_consensus.cc:515] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:42.629691 14300 raft_consensus.cc:2804] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:42.649035 14300 raft_consensus.cc:697] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 11 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:42.616355 13995 raft_consensus.cc:493] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:42.652925 14374 leader_election.cc:290] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:42.655081 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:42.628647 14448 raft_consensus.cc:697] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 10 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:42.630221 14386 raft_consensus.cc:2749] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:42.612047 14406 raft_consensus.cc:515] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:42.635564 14450 raft_consensus.cc:493] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
W20260709 12:17:42.676698 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 190025us
I20260709 12:17:42.677763 11275 catalog_manager.cc:5697] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:42.680930 11594 raft_consensus.cc:606] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 8 LEADER]: Received request to transfer leadership to TS a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:42.686512 11419 leader_election.cc:304] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:42.689225 11275 catalog_manager.cc:5697] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 2 to 5, leader changed from a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131) to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 5 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:42.690608 11419 leader_election.cc:304] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:42.657552 13995 raft_consensus.cc:515] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:42.692503 11419 leader_election.cc:304] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:42.701153 11419 leader_election.cc:304] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:42.703776 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:42.707468 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:42.696717 14418 raft_consensus.cc:2749] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:17:42.709940 11275 catalog_manager.cc:5697] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 5 to 6, leader changed from 1c101e338f954ef086338e251deed19d (127.3.212.130) to a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131). New cstate: current_term: 6 leader_uuid: "a03223e9e41247c3a36b7b7c3d476671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } }
I20260709 12:17:42.711512 11275 catalog_manager.cc:5697] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } }
I20260709 12:17:42.677430 14326 consensus_queue.cc:1048] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:17:42.687717 14496 consensus_queue.cc:1048] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:17:42.716171 13991 raft_consensus.cc:515] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:42.713090 11275 catalog_manager.cc:5697] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 5 to 6, leader changed from 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132) to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 6 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:42.722271 11275 catalog_manager.cc:5697] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 3 to 4, leader changed from 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132) to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 4 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } }
I20260709 12:17:42.723858 11275 catalog_manager.cc:5697] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 4 to 5, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131). New cstate: current_term: 5 leader_uuid: "a03223e9e41247c3a36b7b7c3d476671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } }
I20260709 12:17:42.726603 14566 leader_election.cc:290] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:42.726907 14529 raft_consensus.cc:2749] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:42.727262 14448 consensus_queue.cc:237] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:42.725260 11275 catalog_manager.cc:5697] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:42.735471 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:17:42.741240 14587 log.cc:927] Time spent T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.134s	user 0.003s	sys 0.000s
I20260709 12:17:42.680725 14300 consensus_queue.cc:237] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:42.744378 14553 raft_consensus.cc:493] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:42.744973 14553 raft_consensus.cc:515] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:42.747341 14553 leader_election.cc:290] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:42.747028 11275 catalog_manager.cc:5697] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 4 to 6, leader changed from 1c101e338f954ef086338e251deed19d (127.3.212.130) to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 6 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:42.749028 11275 catalog_manager.cc:5697] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 5 to 6, leader changed from 1c101e338f954ef086338e251deed19d (127.3.212.130) to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 6 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } }
I20260709 12:17:42.755152 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e4724ed93a467ea47763eec9a6de2e" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:42.678098 14450 raft_consensus.cc:515] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
W20260709 12:17:42.726663 14594 log.cc:927] Time spent T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.233s	user 0.003s	sys 0.001s
I20260709 12:17:42.697685 14555 raft_consensus.cc:2749] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:17:42.758350 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 50968.7us
I20260709 12:17:42.760818 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
W20260709 12:17:42.760818 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 163152us
I20260709 12:17:42.723037 13995 leader_election.cc:290] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:42.762073 12361 raft_consensus.cc:2468] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 11.
I20260709 12:17:42.752597 14386 raft_consensus.cc:2749] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:42.762235 11275 catalog_manager.cc:5697] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 3 to 5, leader changed from 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132) to a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131). New cstate: current_term: 5 leader_uuid: "a03223e9e41247c3a36b7b7c3d476671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } }
I20260709 12:17:42.753036 14553 raft_consensus.cc:493] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:42.769773 11275 catalog_manager.cc:5697] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:42.782470 11567 leader_election.cc:304] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
W20260709 12:17:42.766726 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 104219us
W20260709 12:17:42.789764 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 198529us
I20260709 12:17:42.780397 11525 raft_consensus.cc:1240] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:42.757735 14529 consensus_queue.cc:1048] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:17:42.755486 14418 consensus_queue.cc:1048] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:17:42.793100 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:42.808418 11445 raft_consensus.cc:2468] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 11.
I20260709 12:17:42.813577 14087 consensus_queue.cc:1059] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:42.815500 14450 leader_election.cc:290] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:42.818817 14257 raft_consensus.cc:493] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:42.819501 14257 raft_consensus.cc:515] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:42.821959 14257 leader_election.cc:290] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:42.823167 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:42.825106 11523 raft_consensus.cc:2468] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 8.
I20260709 12:17:42.823410 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
W20260709 12:17:42.824080 14611 log.cc:927] Time spent T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:17:42.826457 11566 leader_election.cc:304] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:42.827299 14534 raft_consensus.cc:2804] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:42.827775 14534 raft_consensus.cc:493] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:42.812042 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9fe9a94294836aec652338f44367d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:42.830461 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:42.789342 14553 raft_consensus.cc:515] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:42.810909 14436 raft_consensus.cc:493] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:42.791405 14493 raft_consensus.cc:2804] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:42.845358 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:42.836344 14534 raft_consensus.cc:3060] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:42.840703 14493 raft_consensus.cc:493] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:42.894706 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:17:42.913030 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 120871us
I20260709 12:17:42.914526 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:42.915254 11602 raft_consensus.cc:2468] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 8.
I20260709 12:17:42.913410 14606 raft_consensus.cc:493] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:42.855226 14567 leader_election.cc:290] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:42.842234 14436 raft_consensus.cc:515] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:42.927654 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e4724ed93a467ea47763eec9a6de2e" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:42.927073 11418 leader_election.cc:304] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:42.930495 14608 raft_consensus.cc:493] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:42.894256 14493 raft_consensus.cc:3060] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:42.935945 14617 raft_consensus.cc:493] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:42.936156 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:42.893704 14380 raft_consensus.cc:493] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:42.934748 14606 raft_consensus.cc:515] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:42.967490 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:42.968374 11447 raft_consensus.cc:2468] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 8.
I20260709 12:17:42.952293 14386 raft_consensus.cc:493] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:42.957005 14388 raft_consensus.cc:493] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:42.961229 14406 leader_election.cc:290] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
W20260709 12:17:42.995070 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 80375.6us
I20260709 12:17:43.006161 14606 leader_election.cc:290] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
W20260709 12:17:43.006515 14607 log.cc:927] Time spent T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 12:17:42.957736 14617 raft_consensus.cc:515] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:43.008723 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:17:43.006161 14610 log.cc:927] Time spent T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:17:43.009807 14617 leader_election.cc:290] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:43.009476 11599 raft_consensus.cc:2468] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 8.
I20260709 12:17:43.020298 12203 leader_election.cc:304] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:42.993109 14530 raft_consensus.cc:2749] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:42.956918 14380 raft_consensus.cc:515] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
W20260709 12:17:43.025533 14620 log.cc:927] Time spent T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:17:42.945564 14608 raft_consensus.cc:515] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:43.042233 14606 raft_consensus.cc:2804] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:42.997943 14386 raft_consensus.cc:515] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:43.012662 14388 raft_consensus.cc:515] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:43.066385 11593 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "b126028166e8480ba25541bf8f7fc6de"
 from {username='slave'} at 127.0.0.1:37992
I20260709 12:17:43.067267 11593 raft_consensus.cc:606] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Received request to transfer leadership to TS b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:43.067672 11593 raft_consensus.cc:614] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:17:43.069537 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 142534us
I20260709 12:17:43.071326 11446 raft_consensus.cc:1240] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:43.073534 11450 raft_consensus.cc:1240] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:43.074373 11451 raft_consensus.cc:1275] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 11 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:17:43.075644 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:43.060334 14300 raft_consensus.cc:493] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:43.058856 14606 raft_consensus.cc:493] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:43.081254  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:17:43.083036  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:43.083627  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:43.089944 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34e69406a86484482230bfec0edfcfa" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:43.068182 14482 raft_consensus.cc:3055] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:17:43.076298 14553 leader_election.cc:290] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:43.092016 14606 raft_consensus.cc:3060] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:43.100097 14482 raft_consensus.cc:740] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:43.091769 14300 raft_consensus.cc:515] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:43.140533 14624 consensus_queue.cc:1059] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 12:17:43.178854 14436 leader_election.cc:290] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
W20260709 12:17:43.220721 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 123818us
I20260709 12:17:43.141664 14326 consensus_queue.cc:1059] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 12:17:43.204274 14416 leader_election.cc:290] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:17:43.251648 14616 log.cc:927] Time spent T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
I20260709 12:17:43.256920 14398 raft_consensus.cc:493] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
W20260709 12:17:43.268002 14614 log.cc:927] Time spent T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
I20260709 12:17:43.272759 14380 leader_election.cc:290] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
W20260709 12:17:43.309955 14629 log.cc:927] Time spent T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
W20260709 12:17:43.324843 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 77069.9us
W20260709 12:17:43.310688 14634 log.cc:927] Time spent T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 12:17:43.249933 14482 consensus_queue.cc:260] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:43.313724 14608 leader_election.cc:290] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:43.314416 14638 raft_consensus.cc:3055] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:17:43.326479 14600 consensus_meta.cc:287] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de: Time spent flushing consensus metadata: real 0.724s	user 0.013s	sys 0.000s
I20260709 12:17:43.313740 14386 leader_election.cc:290] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:43.287177 14398 raft_consensus.cc:515] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:43.336651 14638 raft_consensus.cc:740] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:43.339784 14600 raft_consensus.cc:515] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:43.349216 12203 leader_election.cc:304] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:43.346829 14326 consensus_queue.cc:1048] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:17:43.346695 14300 leader_election.cc:290] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:43.346644 14534 raft_consensus.cc:515] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:43.361624 13991 leader_election.cc:290] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 10 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:43.372820 14600 leader_election.cc:290] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
W20260709 12:17:43.388726 14601 log.cc:927] Time spent T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.848s	user 0.003s	sys 0.005s
I20260709 12:17:43.391433 14380 raft_consensus.cc:3055] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:43.391942 14380 raft_consensus.cc:740] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:43.393440 14398 leader_election.cc:290] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:43.394255 14645 raft_consensus.cc:2749] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:17:43.395431 14636 log.cc:927] Time spent T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:17:43.392843 14380 consensus_queue.cc:260] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:43.403525 14380 raft_consensus.cc:3060] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:43.404263 14534 leader_election.cc:290] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 9 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:43.402935 14638 consensus_queue.cc:260] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:43.418644 14638 raft_consensus.cc:3060] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:43.401352 14493 raft_consensus.cc:515] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:43.423043 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:43.423652 14493 leader_election.cc:290] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 12 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:43.424367 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:43.424975 11520 raft_consensus.cc:3060] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:43.426939 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:43.427095 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:43.427635 11599 raft_consensus.cc:2468] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 8.
I20260709 12:17:43.428610 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:43.429332 11594 raft_consensus.cc:2468] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 8.
I20260709 12:17:43.437697 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:43.438891 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:43.439591 11602 raft_consensus.cc:2468] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 9.
I20260709 12:17:43.459040 11599 raft_consensus.cc:1275] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 11 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:17:43.461122 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:43.474509 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:43.475359 11524 raft_consensus.cc:2468] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 7.
I20260709 12:17:43.476950 11528 raft_consensus.cc:1275] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:43.487694 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:43.490129 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d78aaa911094df3ac90f175cd5c58fb" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:17:43.491789 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 55841us
I20260709 12:17:43.493341 11491 leader_election.cc:304] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:43.494215 14374 raft_consensus.cc:2749] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:43.494589 11491 leader_election.cc:304] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:43.495378 14406 raft_consensus.cc:2804] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:43.495748 14406 raft_consensus.cc:493] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:43.496133 14406 raft_consensus.cc:3060] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:43.474452 14153 raft_consensus.cc:493] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:43.501950 14153 raft_consensus.cc:515] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:43.477927 14567 raft_consensus.cc:493] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:43.505076 14567 raft_consensus.cc:515] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:43.507215 14567 leader_election.cc:290] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:43.510376 11527 raft_consensus.cc:1240] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:43.512418 11520 raft_consensus.cc:2468] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 9.
I20260709 12:17:43.513594 11491 leader_election.cc:304] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:43.522608 11417 leader_election.cc:304] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:17:43.524475 14633 raft_consensus.cc:2804] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:43.524976 14633 raft_consensus.cc:493] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:43.525447 14633 raft_consensus.cc:3060] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:43.524546 14386 consensus_queue.cc:1048] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:17:43.529973 12204 leader_election.cc:304] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:43.530778 14380 raft_consensus.cc:2749] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:17:43.533407 14380 consensus_queue.cc:1048] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:43.534508 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:43.541159 11491 leader_election.cc:304] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:43.544668 11594 raft_consensus.cc:2468] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 9.
I20260709 12:17:43.578388 11594 raft_consensus.cc:1240] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:43.580106 11491 leader_election.cc:304] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:43.581564 11491 leader_election.cc:304] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:43.582141 14318 raft_consensus.cc:2749] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:43.540122 14435 raft_consensus.cc:2749] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:43.589298 12203 leader_election.cc:304] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:43.592484 12203 leader_election.cc:304] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:43.595788 13627 raft_consensus.cc:2804] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:43.596379 13627 raft_consensus.cc:697] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 9 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:43.593308 14643 raft_consensus.cc:2749] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:43.584148 14450 raft_consensus.cc:2804] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:43.598094 14450 raft_consensus.cc:493] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:43.598562 14450 raft_consensus.cc:3060] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:43.545981 14448 consensus_queue.cc:1048] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:17:43.613575 14450 raft_consensus.cc:515] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:43.615940 14450 leader_election.cc:290] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:43.617645 12361 raft_consensus.cc:1275] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 11 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:17:43.620021 14644 consensus_queue.cc:1059] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:43.621407 14644 raft_consensus.cc:3055] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:43.621516 14388 leader_election.cc:290] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:43.585245 14540 raft_consensus.cc:2804] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:43.620632 14450 raft_consensus.cc:493] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:43.622272 14540 raft_consensus.cc:493] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:43.622526 14450 raft_consensus.cc:515] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:43.624423 14633 raft_consensus.cc:515] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
W20260709 12:17:43.635682 12205 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:43.680143 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:17:43.805858 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 97320.4us
I20260709 12:17:43.710896 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:43.668416 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:43.647658 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:43.664157 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:43.723138 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:43.632367 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:43.691967 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:43.687146 11449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:43.652441 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff9fe9a94294836aec652338f44367d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:43.648451 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:43.682319 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:43.704777 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:43.682485 11445 raft_consensus.cc:1275] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:17:43.661962 11526 raft_consensus.cc:1275] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:17:43.854629 12357 raft_consensus.cc:2468] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 10.
I20260709 12:17:43.665182 11566 leader_election.cc:304] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:43.632927 12349 raft_consensus.cc:1240] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:43.866678 11452 raft_consensus.cc:2368] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de for earlier term 9. Current term is 10.
W20260709 12:17:43.875077 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 209936us
W20260709 12:17:43.643471 14649 log.cc:927] Time spent T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.091s	user 0.000s	sys 0.002s
W20260709 12:17:43.820086 14640 log.cc:927] Time spent T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:17:43.621846 14644 raft_consensus.cc:740] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:43.877946 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:43.878530 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:43.881793 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:43.876453 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7937e0cff84ef7a26c84247c8ffc08" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:43.875425 11447 raft_consensus.cc:2393] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 8: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:43.665902 14388 raft_consensus.cc:993] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8: : Instructing follower a03223e9e41247c3a36b7b7c3d476671 to start an election
I20260709 12:17:43.638383 13627 consensus_queue.cc:237] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:43.929421 12345 raft_consensus.cc:3060] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:43.655948 14153 leader_election.cc:290] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
W20260709 12:17:43.651547 14648 log.cc:927] Time spent T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 12:17:43.666388 14300 raft_consensus.cc:493] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:43.640413 14482 raft_consensus.cc:3060] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:43.892563 11598 raft_consensus.cc:2468] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 8.
W20260709 12:17:43.884473 14654 log.cc:927] Time spent T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:17:43.834695 14540 raft_consensus.cc:3060] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:43.930737 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:43.882721 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:43.634661 14633 leader_election.cc:290] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:43.937935 12345 raft_consensus.cc:2468] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 12.
W20260709 12:17:43.895015 14641 log.cc:927] Time spent T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 12:17:43.939707 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 45411.8us
I20260709 12:17:43.763902 14627 raft_consensus.cc:493] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:43.984323 12349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:43.629267 14450 leader_election.cc:290] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:43.805234 14534 raft_consensus.cc:493] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:43.631733 14606 raft_consensus.cc:515] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:43.946390 11491 leader_election.cc:304] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
W20260709 12:17:43.949707 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 49582us
I20260709 12:17:43.637785 14406 raft_consensus.cc:515] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:43.945027 14567 raft_consensus.cc:1081] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 8 LEADER]: Signalling peer a03223e9e41247c3a36b7b7c3d476671 to start an election
I20260709 12:17:43.897969 14257 raft_consensus.cc:2804] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:43.935290 14635 raft_consensus.cc:493] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
W20260709 12:17:44.012632 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 149319us
I20260709 12:17:43.954685 14628 raft_consensus.cc:493] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:43.875171 14550 consensus_queue.cc:1048] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.106s
W20260709 12:17:44.007588 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 61341.5us
I20260709 12:17:44.024049 12349 raft_consensus.cc:2368] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for earlier term 8. Current term is 9.
I20260709 12:17:43.985229 14643 raft_consensus.cc:493] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:44.028704 14643 raft_consensus.cc:515] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:44.031297 14643 leader_election.cc:290] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:44.013305 14448 raft_consensus.cc:493] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.037748 12347 raft_consensus.cc:1275] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:17:44.024353 14450 raft_consensus.cc:2804] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:43.952889 14300 raft_consensus.cc:515] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:44.003301 14534 raft_consensus.cc:515] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:44.002012 14627 raft_consensus.cc:515] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:44.025913 14635 raft_consensus.cc:515] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
W20260709 12:17:44.105065 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 305264us
I20260709 12:17:44.034760 14628 raft_consensus.cc:515] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:44.051343 14448 raft_consensus.cc:515] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:44.105867 14515 consensus_queue.cc:1048] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:17:44.159509 14600 raft_consensus.cc:493] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:44.175549 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 139587us
W20260709 12:17:44.170688 14653 log.cc:927] Time spent T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.295s	user 0.001s	sys 0.000s
W20260709 12:17:44.173101 14657 log.cc:927] Time spent T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
W20260709 12:17:44.190227 11493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 137972us
I20260709 12:17:44.193835 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:44.200397 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:44.205107 11528 raft_consensus.cc:1240] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 8. Current term is 9. Ops: []
W20260709 12:17:44.206677 14660 log.cc:927] Time spent T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 12:17:44.208118 11528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
W20260709 12:17:44.207994 14656 log.cc:927] Time spent T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 12:17:44.183478 14450 raft_consensus.cc:697] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 8 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:44.178970 14600 raft_consensus.cc:515] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:44.219049 14606 leader_election.cc:290] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:44.226835 14671 consensus_queue.cc:1059] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:17:44.234551 14450 consensus_queue.cc:237] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:44.226516 14326 raft_consensus.cc:493] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:44.242460 12203 leader_election.cc:400] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 election: Vote denied by peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579) with higher term. Message: Invalid argument: T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de for earlier term 9. Current term is 10.
I20260709 12:17:44.247553 14635 leader_election.cc:290] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:44.248620 14416 raft_consensus.cc:493] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.249223 14416 raft_consensus.cc:515] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:44.251596 14639 raft_consensus.cc:493] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:44.252238 14639 raft_consensus.cc:515] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
W20260709 12:17:44.253553 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 240207us
I20260709 12:17:44.254264 14600 leader_election.cc:290] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:44.255362 11419 leader_election.cc:304] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
W20260709 12:17:44.256870 14659 log.cc:927] Time spent T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.099s	user 0.000s	sys 0.002s
I20260709 12:17:44.257490 14530 raft_consensus.cc:493] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:44.258069 14530 raft_consensus.cc:515] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:44.259684 14633 raft_consensus.cc:2804] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:44.260196 14633 raft_consensus.cc:493] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:44.260555 14617 consensus_queue.cc:1059] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:44.262331 14448 leader_election.cc:290] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:44.252511 14300 leader_election.cc:290] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:44.264773 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:44.260242 14530 leader_election.cc:290] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:44.265789 12361 raft_consensus.cc:2468] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 11.
I20260709 12:17:44.260622 14633 raft_consensus.cc:3060] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:44.275555 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:44.273952 11493 leader_election.cc:304] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:44.276238 11526 raft_consensus.cc:2468] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 11.
I20260709 12:17:44.282756 12204 leader_election.cc:304] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:44.266337 14540 raft_consensus.cc:515] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:44.246403 14326 raft_consensus.cc:515] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:44.286505 11419 leader_election.cc:304] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:44.278450 14448 raft_consensus.cc:2804] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:44.288703 14448 raft_consensus.cc:493] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:44.289129 14448 raft_consensus.cc:3060] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:44.290522 14628 leader_election.cc:290] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:44.278798 14627 leader_election.cc:290] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:44.287336 11528 raft_consensus.cc:3060] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:17:44.294174 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 312261us
I20260709 12:17:44.308009 14540 leader_election.cc:290] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:44.308341 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e4724ed93a467ea47763eec9a6de2e" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:44.309863 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:44.310019 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:44.311443 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:44.286784 13991 raft_consensus.cc:2804] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:44.314544 14625 consensus_queue.cc:1048] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:44.316035 14625 raft_consensus.cc:493] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:44.305076 14257 raft_consensus.cc:697] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:44.302059 11519 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d"
dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
 from {username='slave'} at 127.0.0.1:33446
I20260709 12:17:44.316831 11519 raft_consensus.cc:493] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:44.316643 14625 raft_consensus.cc:515] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:44.317209 11519 raft_consensus.cc:3060] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:44.318230 14665 raft_consensus.cc:493] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.318739 14665 raft_consensus.cc:515] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:44.320851 14665 leader_election.cc:290] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:17:44.317572 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 328262us
W20260709 12:17:44.315912 14613 log.cc:927] Time spent T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.418s	user 0.004s	sys 0.000s
I20260709 12:17:44.328226 14392 raft_consensus.cc:2749] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:44.328707 14639 leader_election.cc:290] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:44.329234 14326 leader_election.cc:290] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:44.329157 14493 raft_consensus.cc:493] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.330247 14493 raft_consensus.cc:515] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:44.312467 13991 raft_consensus.cc:493] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:44.327054 11519 raft_consensus.cc:515] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:44.317159 14257 consensus_queue.cc:237] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:44.345073 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:44.347908 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:44.348556 11602 raft_consensus.cc:3060] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:44.353363 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183ead47e21645c289d90fbfe75fd319" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:44.354631 11528 raft_consensus.cc:2468] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 9.
I20260709 12:17:44.361796 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:44.363300 11445 raft_consensus.cc:2393] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 6: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:44.368677 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:44.369223 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7e4724ed93a467ea47763eec9a6de2e" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:44.356868 13991 raft_consensus.cc:3060] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:17:44.373651 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 46661.5us
I20260709 12:17:44.377902 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "281f1a743bd44c27af6ace022a8a3ad1" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:44.330322 14416 leader_election.cc:290] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:44.380255 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:44.385905 14680 raft_consensus.cc:493] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:44.386500 14680 raft_consensus.cc:515] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:44.387113 14536 raft_consensus.cc:493] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:44.387629 14536 raft_consensus.cc:515] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:44.388700 14680 leader_election.cc:290] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:44.389670 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:44.390407 11526 raft_consensus.cc:2393] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d in current term 9: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:17:44.391813 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:44.392591 11599 raft_consensus.cc:3060] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:44.379753 11519 leader_election.cc:290] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:44.363889 14153 raft_consensus.cc:493] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:44.366506 14388 raft_consensus.cc:493] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:44.411518 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:44.397418 11594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:44.424327 11594 raft_consensus.cc:2468] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 6.
I20260709 12:17:44.425673 14536 leader_election.cc:290] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:44.423112 14464 raft_consensus.cc:493] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.426364 14464 raft_consensus.cc:515] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:44.428694 14464 leader_election.cc:290] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:44.429407 14493 leader_election.cc:290] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
W20260709 12:17:44.432833 14663 log.cc:927] Time spent T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.275s	user 0.000s	sys 0.002s
I20260709 12:17:44.434587 14625 leader_election.cc:290] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:44.420444 11602 raft_consensus.cc:2468] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 10.
I20260709 12:17:44.421747 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:44.436910 11567 leader_election.cc:304] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:44.439244 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7937e0cff84ef7a26c84247c8ffc08" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:44.444182 11599 raft_consensus.cc:2468] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 9.
I20260709 12:17:44.448206 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:44.448700 11452 raft_consensus.cc:3060] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:44.450387 14406 leader_election.cc:290] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:44.446707 14493 raft_consensus.cc:2749] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:44.458189 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cf7a9497dc4b2ebf7a4c7d4f4dbed4" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:44.458951 11451 raft_consensus.cc:3060] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:44.446342 11567 leader_election.cc:304] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:44.459386 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:44.461295 11602 raft_consensus.cc:2468] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 6.
I20260709 12:17:44.463024 12203 leader_election.cc:304] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:44.465418 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:44.466204 11601 raft_consensus.cc:2468] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 8.
I20260709 12:17:44.465140 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:44.468379 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:44.470227 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:44.468982 12361 raft_consensus.cc:2468] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 5.
I20260709 12:17:44.474789 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:44.476990 11452 raft_consensus.cc:2468] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 9.
I20260709 12:17:44.481070 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:44.482694 11451 raft_consensus.cc:2468] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 12.
I20260709 12:17:44.479290 12203 leader_election.cc:304] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d
I20260709 12:17:44.484207 11566 leader_election.cc:304] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:44.479393 11567 leader_election.cc:304] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:44.486101 12347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:44.490145 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:44.486716 12347 raft_consensus.cc:2468] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 6.
I20260709 12:17:44.495020 11491 leader_election.cc:304] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:44.462049 14555 raft_consensus.cc:493] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
I20260709 12:17:44.510605 12356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e896afa1887146dfade142338e2fc407" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:44.495602 12203 leader_election.cc:304] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:44.445096 14388 raft_consensus.cc:515] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:44.513990 14619 raft_consensus.cc:3055] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:44.514379 14619 raft_consensus.cc:740] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:44.514690 14388 leader_election.cc:290] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:44.515353 14671 raft_consensus.cc:2804] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:44.438757 14153 raft_consensus.cc:515] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:44.460209 14493 raft_consensus.cc:493] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:44.502770 11566 leader_election.cc:304] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:44.503269 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:44.505795 11491 leader_election.cc:304] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:44.507433 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:44.515890 14671 raft_consensus.cc:697] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 9 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:44.516438 12203 leader_election.cc:304] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:44.466279 14681 raft_consensus.cc:2804] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:17:44.449216 14448 raft_consensus.cc:515] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:44.528344 11451 raft_consensus.cc:3060] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:44.517097 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:44.530627 11566 leader_election.cc:304] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:44.528157 12352 raft_consensus.cc:2468] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 8.
I20260709 12:17:44.472276 14638 raft_consensus.cc:2749] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:44.543768 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:44.517836 14515 raft_consensus.cc:2749] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:44.510268 14625 raft_consensus.cc:493] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.553364 11522 raft_consensus.cc:1240] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:44.516662 13580 raft_consensus.cc:2804] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:44.516454 14557 raft_consensus.cc:2749] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:44.558892 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:44.560490 11525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:44.538101 14318 raft_consensus.cc:2749] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:44.543146 14635 raft_consensus.cc:2804] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:44.509013 14605 raft_consensus.cc:2804] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:44.542049 14464 raft_consensus.cc:2749] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:44.573248 12348 raft_consensus.cc:1240] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:44.545964 14566 raft_consensus.cc:2749] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:44.509888 14406 consensus_queue.cc:1048] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 12:17:44.579515 11565 leader_election.cc:304] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:44.565573 13580 raft_consensus.cc:493] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:44.538249 14493 raft_consensus.cc:515] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:44.542490 14633 raft_consensus.cc:515] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:44.525477 14555 raft_consensus.cc:515] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:44.568224 14681 raft_consensus.cc:697] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 12 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:44.576354 14605 raft_consensus.cc:493] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9da53be18b0f446aaa406216e20b0ec8)
W20260709 12:17:44.594065 14683 log.cc:927] Time spent T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:17:44.570695 14635 raft_consensus.cc:493] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting leader election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:44.565282 14625 raft_consensus.cc:515] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:44.585944 13580 raft_consensus.cc:3060] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:44.607236 14681 consensus_queue.cc:237] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:44.584914 14381 raft_consensus.cc:2749] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:44.593945 14153 leader_election.cc:290] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:44.528724 14619 consensus_queue.cc:260] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
W20260709 12:17:44.601171 14682 log.cc:927] Time spent T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:17:44.616241 14619 raft_consensus.cc:3060] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:44.601653 14671 consensus_queue.cc:237] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:44.617894 14625 leader_election.cc:290] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:44.622267 13991 raft_consensus.cc:515] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:44.623432 12361 raft_consensus.cc:1240] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 12 FOLLOWER]: Rejecting Update request from peer 1c101e338f954ef086338e251deed19d for earlier term 11. Current term is 12. Ops: []
I20260709 12:17:44.602751 14555 leader_election.cc:290] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:44.600212 14635 raft_consensus.cc:3060] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:44.623461 14644 consensus_queue.cc:260] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:44.630885 14644 raft_consensus.cc:3060] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:44.612627 14633 leader_election.cc:290] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 11 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:44.598565 14605 raft_consensus.cc:3060] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:44.614975 14493 leader_election.cc:290] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:44.633602 14606 raft_consensus.cc:3055] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:44.634087 14606 raft_consensus.cc:740] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:44.634907 14606 consensus_queue.cc:260] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:44.636147 14606 raft_consensus.cc:3060] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:44.611351 14448 leader_election.cc:290] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 12 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:44.644462 14635 raft_consensus.cc:515] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:44.647425 14534 leader_election.cc:290] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:44.650624 13991 leader_election.cc:290] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 12 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:44.651886 14605 raft_consensus.cc:515] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:44.655126 14635 leader_election.cc:290] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:44.611377 13580 raft_consensus.cc:515] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:44.664885 13580 leader_election.cc:290] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:44.674669 14605 leader_election.cc:290] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
W20260709 12:17:44.707085 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 159356us
I20260709 12:17:44.712803 11417 leader_election.cc:304] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:44.717281 11417 leader_election.cc:304] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:44.285840  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:17:44.724762 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 178426us
I20260709 12:17:44.818297 11419 leader_election.cc:304] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:44.749553 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:44.824671 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:44.751246 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:44.825027 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:44.826026 12352 raft_consensus.cc:3060] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:44.756717 11450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58856 (request call id 749) took 1072 ms. Trace:
I20260709 12:17:44.826828 11450 rpcz_store.cc:276] 0709 12:17:43.683751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:43.683899 (+   148us) service_pool.cc:224] Handling call
0709 12:17:43.684202 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:44.094609 (+410407us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:17:44.117093 (+ 22484us) log.cc:844] Serialized 14 byte log entry
0709 12:17:44.538743 (+421650us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b1800497020. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84ec99eab1 00007f84ec9ab281 00007f84e3ab8e07 00007f84ec9139a9 00007f84e3ad569b 00007f84e3ad393f 00007f84e3ad5c02 00007f84e675d20b 00007f84e6762d23 00007f84e676323a 00007f84e6bcda2a
0709 12:17:44.746271 (+207528us) log.cc:844] Serialized 14 byte log entry
0709 12:17:44.746733 (+   462us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:44.746822 (+    89us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:44.746963 (+   141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:44.756107 (+  9144us) spinlock_profiling.cc:243] Waited 410 ms on lock 0x7b5400107a54. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2c571 00007f84e6bc3e01 00007f84e6bc283e 00007f84ebb87419 00007f84e50febd4 00007f84e50feb62 00007f84e50fea91 00007f84e50fea0c 00007f84e50fdcc2 00007f84e4efe48c 00007f84e4efd8c6
0709 12:17:44.756159 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:44.756393 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":40234,"prepare.run_cpu_time_us":144,"prepare.run_wall_time_us":2158,"spinlock_wait_cycles":974448384,"thread_start_us":206052,"threads_started":2,"wal-append.queue_time_us":559330}
I20260709 12:17:44.758400 11524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8741606df54c3f8b5cc5c1141862ea" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:44.759895 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e58472d98540b986b1ed39edf597d4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:44.828406 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:44.830405 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c607d0d1e744b6babe5fc93505013b" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:44.831336 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:44.786716 11565 leader_election.cc:304] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:44.801702 11597 raft_consensus.cc:1240] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:44.806371 12345 raft_consensus.cc:2468] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 7.
I20260709 12:17:44.834758 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
W20260709 12:17:44.836489 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 55394.8us
I20260709 12:17:44.835150 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:44.843604 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:44.848327 14388 consensus_queue.cc:1059] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:44.849462 14300 raft_consensus.cc:2749] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:44.849830 14153 raft_consensus.cc:2749] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:44.850627 14381 raft_consensus.cc:3055] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:44.850986 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:44.812750 11567 leader_election.cc:304] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:44.843453 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:44.853682 11453 raft_consensus.cc:2393] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de in current term 6: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:44.813930 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:44.855672 11593 raft_consensus.cc:3060] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:44.859282 14386 raft_consensus.cc:493] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:44.860037 14386 raft_consensus.cc:515] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:44.814966 13580 raft_consensus.cc:493] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:44.861909 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:44.862334 13580 raft_consensus.cc:515] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:44.862932 11597 raft_consensus.cc:2368] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de for earlier term 6. Current term is 7.
I20260709 12:17:44.866312 14392 raft_consensus.cc:2804] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:44.866951 14392 raft_consensus.cc:493] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:44.867476 14392 raft_consensus.cc:3060] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:44.869272 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:44.865103 13580 leader_election.cc:290] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:44.833804 11419 leader_election.cc:304] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:44.806661 11601 raft_consensus.cc:1240] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:44.851111 14381 raft_consensus.cc:740] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:44.798292 11451 raft_consensus.cc:2468] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 9.
I20260709 12:17:44.886477 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:44.888944 14381 consensus_queue.cc:260] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:44.891408 14381 raft_consensus.cc:3060] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:44.893463 12203 leader_election.cc:400] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 election: Vote denied by peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973) with higher term. Message: Invalid argument: T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de for earlier term 6. Current term is 7.
I20260709 12:17:44.893903 12203 leader_election.cc:403] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:17:44.887162 11597 raft_consensus.cc:2468] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 10.
I20260709 12:17:44.898487 12352 raft_consensus.cc:2468] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 7.
I20260709 12:17:44.898696 11593 raft_consensus.cc:2468] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 7.
I20260709 12:17:44.904207 14300 raft_consensus.cc:2749] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:44.905774 12357 raft_consensus.cc:1240] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:44.906451 11452 raft_consensus.cc:1240] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:44.907143 14386 leader_election.cc:290] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:44.909013 14671 raft_consensus.cc:2749] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973) with higher term. Message: Invalid argument: T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de for earlier term 6. Current term is 7.
I20260709 12:17:44.913443 14416 raft_consensus.cc:2749] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:44.899367 14153 raft_consensus.cc:2764] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 12:17:44.919847 11420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:44.920104 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:44.920318 12203 leader_election.cc:304] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:44.920987 11519 raft_consensus.cc:2368] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 for earlier term 11. Current term is 12.
I20260709 12:17:44.921299 14606 raft_consensus.cc:2804] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:17:44.925472 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 104087us
I20260709 12:17:44.925287 14671 consensus_queue.cc:1059] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:17:44.927820 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da8741606df54c3f8b5cc5c1141862ea" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:17:44.928144 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 211177us
I20260709 12:17:44.929208 14599 consensus_queue.cc:1059] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:17:44.926793 14606 raft_consensus.cc:697] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:44.932628 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:44.933660 11601 raft_consensus.cc:2368] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for earlier term 8. Current term is 9.
I20260709 12:17:44.933368 14606 consensus_queue.cc:237] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:44.934450 11566 leader_election.cc:400] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 11 pre-election: Vote denied by peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063) with higher term. Message: Invalid argument: T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 for earlier term 11. Current term is 12.
I20260709 12:17:44.934819 11566 leader_election.cc:403] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:44.936290 14680 consensus_queue.cc:1059] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:44.929207 11417 leader_election.cc:304] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:44.939044 11493 leader_election.cc:400] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Vote denied by peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935) with higher term. Message: Invalid argument: T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for earlier term 8. Current term is 9.
I20260709 12:17:44.941394 14374 raft_consensus.cc:493] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:44.941244 14647 raft_consensus.cc:3055] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:44.942392 14647 raft_consensus.cc:740] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:44.942088 14374 raft_consensus.cc:515] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:44.943043 11491 leader_election.cc:304] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:44.944219 13995 raft_consensus.cc:2804] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:44.944728 14388 raft_consensus.cc:3060] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:17:44.945013 13995 raft_consensus.cc:697] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 9 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
W20260709 12:17:44.945837 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 121516us
I20260709 12:17:44.946552 13995 consensus_queue.cc:237] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:44.945007 14374 leader_election.cc:290] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:44.951047 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:44.951815 12357 raft_consensus.cc:3060] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:44.953895 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:44.956602 11567 leader_election.cc:304] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:44.957608 14153 raft_consensus.cc:2749] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:44.953766 14392 raft_consensus.cc:515] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:44.958396 11567 leader_election.cc:304] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:44.959769 14153 raft_consensus.cc:2804] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:44.960687 14153 raft_consensus.cc:493] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:44.961421 14153 raft_consensus.cc:3060] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:44.961548 14679 consensus_queue.cc:1059] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:44.963081 14676 raft_consensus.cc:3055] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:44.963483 14676 raft_consensus.cc:740] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:44.964583 14676 consensus_queue.cc:260] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:44.943710 14647 consensus_queue.cc:260] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:44.965224 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:44.966322 14676 raft_consensus.cc:3060] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:44.966490 14647 raft_consensus.cc:3060] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:44.967453 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:44.968308 12361 raft_consensus.cc:2468] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 10.
I20260709 12:17:44.929802 11274 catalog_manager.cc:5697] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 7 to 9, leader changed from 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132) to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 9 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } }
I20260709 12:17:44.979549 11454 raft_consensus.cc:1240] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 11 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:17:44.982405 14388 raft_consensus.cc:2749] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063) with higher term. Message: Invalid argument: T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 for earlier term 11. Current term is 12.
I20260709 12:17:44.981058 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:44.985574 14680 raft_consensus.cc:3055] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:17:44.990283 14680 raft_consensus.cc:740] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:44.991441 14680 consensus_queue.cc:260] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:44.993120 14680 raft_consensus.cc:3060] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:44.995035 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
W20260709 12:17:44.988027 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 59063.6us
I20260709 12:17:44.986920 11450 raft_consensus.cc:1275] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:44.996049 11599 raft_consensus.cc:1240] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:44.997591 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a6ef0117045b19d2915baab58e53f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:44.998162 11597 raft_consensus.cc:1275] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:45.002710 11417 leader_election.cc:304] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:44.998714 12204 leader_election.cc:304] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b126028166e8480ba25541bf8f7fc6de; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:45.004360 14669 raft_consensus.cc:2804] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:45.005056 14669 raft_consensus.cc:697] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 10 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:45.005843 11491 leader_election.cc:304] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:45.006119 14669 consensus_queue.cc:237] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:45.007519 14374 raft_consensus.cc:2749] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:17:45.008632 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:45.009416 12348 raft_consensus.cc:2468] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 8.
I20260709 12:17:45.009711 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7937e0cff84ef7a26c84247c8ffc08" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:45.004504 11417 leader_election.cc:304] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:45.015009 14668 raft_consensus.cc:2749] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:45.016074 11417 leader_election.cc:304] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:45.017648 14496 raft_consensus.cc:2749] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:17:45.019315 14668 raft_consensus.cc:2804] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:45.019699 14668 raft_consensus.cc:493] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:45.020011 14668 raft_consensus.cc:3060] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:44.988760 14416 raft_consensus.cc:2749] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:44.974579 11567 leader_election.cc:304] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:45.028898 11493 leader_election.cc:304] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
W20260709 12:17:45.034471 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 60950.8us
I20260709 12:17:45.043054 12357 raft_consensus.cc:2468] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 12.
I20260709 12:17:45.043546 11453 raft_consensus.cc:2368] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for earlier term 8. Current term is 9.
I20260709 12:17:45.036826 11274 catalog_manager.cc:5697] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 2 to 9, leader changed from a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131) to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 9 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:45.049261 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:45.053771 11491 leader_election.cc:400] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 election: Vote denied by peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973) with higher term. Message: Invalid argument: T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for earlier term 8. Current term is 9.
I20260709 12:17:45.054255 11491 leader_election.cc:403] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:17:45.054970 14679 raft_consensus.cc:2749] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973) with higher term. Message: Invalid argument: T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for earlier term 8. Current term is 9.
I20260709 12:17:45.057628 11417 leader_election.cc:304] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:45.058638 14669 raft_consensus.cc:2749] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:45.059345 11417 leader_election.cc:304] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:45.060283 14669 raft_consensus.cc:2749] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:45.037611 14388 raft_consensus.cc:2804] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:45.068737 11602 raft_consensus.cc:2468] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 12.
I20260709 12:17:45.040006 14374 raft_consensus.cc:2804] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:45.075037 14388 raft_consensus.cc:697] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:45.078627 14388 consensus_queue.cc:237] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:45.085538 11493 leader_election.cc:304] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:45.074241 14374 raft_consensus.cc:493] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:45.089291 14675 raft_consensus.cc:2804] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:17:45.089968 14374 raft_consensus.cc:3060] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:45.090198 14675 raft_consensus.cc:697] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 12 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:45.091297 14675 consensus_queue.cc:237] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:45.099622 11593 raft_consensus.cc:2468] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 9.
I20260709 12:17:45.071373 11417 leader_election.cc:304] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:45.097019 14668 raft_consensus.cc:515] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:45.114089 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:45.122766 11526 raft_consensus.cc:1275] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:17:45.128396 11275 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39286 (request call id 110) took 18077 ms (client timeout 15000 ms). Trace:
I20260709 12:17:45.125772 11274 catalog_manager.cc:5697] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 1 to 4, leader changed from 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132) to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 4 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:45.116708 11450 raft_consensus.cc:2468] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 6.
I20260709 12:17:45.138199 14680 raft_consensus.cc:2749] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:45.153862 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:45.160295 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba25a071498548cdba1aaf992fa805e8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
W20260709 12:17:45.161257 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 89996.8us
I20260709 12:17:45.152810 11274 catalog_manager.cc:5697] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 5 to 8, leader changed from 1c101e338f954ef086338e251deed19d (127.3.212.130) to a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131). New cstate: current_term: 8 leader_uuid: "a03223e9e41247c3a36b7b7c3d476671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } }
I20260709 12:17:45.137758 14493 consensus_queue.cc:1048] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:17:45.167814 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:45.170020 14672 consensus_queue.cc:1048] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
W20260709 12:17:45.128942 11275 rpcz_store.cc:269] 0709 12:17:27.050408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:27.050751 (+   343us) service_pool.cc:224] Handling call
0709 12:17:45.128104 (+18077353us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:43.178327 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:43.318277 (+139950us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:43.318317 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:17:43.318337 (+    20us) tablet.cc:662] Decoding operations
0709 12:17:43.396777 (+ 78440us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:43.396864 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:43.396917 (+    53us) tablet.cc:685] Acquiring locks for 15 operations
0709 12:17:43.431814 (+ 34897us) tablet.cc:701] Row locks acquired
0709 12:17:43.431832 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:17:43.432000 (+   168us) write_op.cc:270] Start()
0709 12:17:43.432154 (+   154us) write_op.cc:276] Timestamp: P: 1783599463431937 usec, L: 0
0709 12:17:43.432176 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:17:43.432919 (+   743us) log.cc:844] Serialized 5969 byte log entry
0709 12:17:44.089060 (+656141us) op_driver.cc:464] REPLICATION: finished
0709 12:17:44.258270 (+169210us) write_op.cc:301] APPLY: starting
0709 12:17:44.258362 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:44.258686 (+   324us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:44.258798 (+   112us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:44.260376 (+  1578us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:44.260657 (+   281us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 12:17:44.260704 (+    47us) write_op.cc:312] APPLY: finished
0709 12:17:44.261044 (+   340us) log.cc:844] Serialized 106 byte log entry
0709 12:17:44.261222 (+   178us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:44.261421 (+   199us) write_op.cc:454] Released schema lock
0709 12:17:44.261483 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:44.280488 (+ 19005us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:44.281590 (+  1102us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1180,"reported_tablets":36,"child_traces":[["op",{"apply.queue_time_us":162214,"apply.run_cpu_time_us":3657,"apply.run_wall_time_us":13677,"num_ops":15,"prepare.queue_time_us":184171,"prepare.run_cpu_time_us":22170,"prepare.run_wall_time_us":348147,"raft.queue_time_us":404456,"raft.run_cpu_time_us":19412,"raft.run_wall_time_us":203688,"replication_time_us":620030,"thread_start_us":524638,"threads_started":4,"wal-append.queue_time_us":134974}]]}
I20260709 12:17:45.173830 12357 raft_consensus.cc:1275] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 12 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:17:45.165233 11274 catalog_manager.cc:5697] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 3 to 5, leader changed from 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132) to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 5 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:45.176224 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7937e0cff84ef7a26c84247c8ffc08" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:45.197340 11451 raft_consensus.cc:1275] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:45.192389 14493 consensus_queue.cc:1048] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:17:45.204418 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aaa267a7b85487a991ce0600309cac0" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:45.204972 11446 raft_consensus.cc:3060] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:45.192922 11274 catalog_manager.cc:5697] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 6 to 9, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 9 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:45.190598 14392 leader_election.cc:290] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:45.209595 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:45.210094 12357 raft_consensus.cc:3060] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:45.210992 14680 raft_consensus.cc:493] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:45.211350 11565 leader_election.cc:304] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:45.216698 14257 raft_consensus.cc:2749] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:45.216280 11274 catalog_manager.cc:5697] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 6 to 7, leader changed from 1c101e338f954ef086338e251deed19d (127.3.212.130) to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 7 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } }
I20260709 12:17:45.219106 11526 raft_consensus.cc:1275] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:45.226676 11274 catalog_manager.cc:5697] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 4 to 9, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 9 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:45.208513 14698 log.cc:927] Time spent T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 12:17:45.234071 11565 leader_election.cc:304] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:45.235059 14493 raft_consensus.cc:2749] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:45.235713 11565 leader_election.cc:304] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:45.236645 14493 raft_consensus.cc:2749] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:45.238514 14671 consensus_queue.cc:1048] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:45.242197 11602 raft_consensus.cc:1275] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:45.228598 11274 catalog_manager.cc:5697] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 5 to 6, leader changed from a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131) to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 6 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:45.211611 14680 raft_consensus.cc:515] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:45.247772 11446 raft_consensus.cc:2468] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 7.
I20260709 12:17:45.252768 11274 catalog_manager.cc:5697] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 5 to 7, leader changed from 1c101e338f954ef086338e251deed19d (127.3.212.130) to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 7 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } }
I20260709 12:17:45.255378 12357 raft_consensus.cc:2468] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 9.
I20260709 12:17:45.259490 14496 consensus_queue.cc:1048] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:45.258383 11274 catalog_manager.cc:5697] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 6 to 9, leader changed from 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132) to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 9 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:45.261430 11419 leader_election.cc:304] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:45.257433 14668 leader_election.cc:290] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
W20260709 12:17:45.271644 14700 log.cc:927] Time spent T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.062s	user 0.003s	sys 0.000s
W20260709 12:17:45.271077 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 63749.8us
I20260709 12:17:45.272945 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:45.271773 14680 leader_election.cc:290] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:45.279132 14675 raft_consensus.cc:493] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:45.279733 14675 raft_consensus.cc:515] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:45.291271 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:45.297636 13995 consensus_queue.cc:1059] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:45.298457 14675 leader_election.cc:290] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:45.302026 14680 raft_consensus.cc:2749] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:17:45.306495 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:45.307237 12357 raft_consensus.cc:2468] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 10.
I20260709 12:17:45.308424 11493 leader_election.cc:304] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:45.308969 14675 raft_consensus.cc:3055] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:17:45.309273 13995 raft_consensus.cc:2804] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:45.309734 13995 raft_consensus.cc:493] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:45.310058 13995 raft_consensus.cc:3060] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:45.309482 14675 raft_consensus.cc:740] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:45.312292 14675 consensus_queue.cc:260] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:45.318918 13995 raft_consensus.cc:515] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:45.323818 13995 leader_election.cc:290] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:45.325438 11491 leader_election.cc:400] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579) with higher term. Message: Invalid argument: T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for earlier term 8. Current term is 9.
I20260709 12:17:45.327287 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:45.289176 11274 catalog_manager.cc:5697] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } }
I20260709 12:17:45.329711 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:45.283051 14153 raft_consensus.cc:515] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:45.337121 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:45.344903 11597 raft_consensus.cc:2368] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 7. Current term is 8.
W20260709 12:17:45.345556 14703 log.cc:927] Time spent T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 12:17:45.348659 14710 log.cc:927] Time spent T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
W20260709 12:17:45.350605 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 94940.6us
I20260709 12:17:45.324865 14679 consensus_queue.cc:1048] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:17:45.364656 11274 catalog_manager.cc:5697] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 2 to 5, leader changed from 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132) to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 5 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:45.436800 11419 leader_election.cc:304] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
W20260709 12:17:45.438503 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 94317.6us
I20260709 12:17:45.440057 12357 raft_consensus.cc:2468] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 10.
I20260709 12:17:45.459553 11274 catalog_manager.cc:5697] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:45.463593 11274 catalog_manager.cc:5697] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 7 to 9, leader changed from 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132) to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 9 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:45.468801 11602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "a03223e9e41247c3a36b7b7c3d476671"
 from {username='slave'} at 127.0.0.1:37992
I20260709 12:17:45.469617 14153 leader_election.cc:290] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:45.469782 11602 raft_consensus.cc:606] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 LEADER]: Received request to transfer leadership to TS a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:45.465329 11274 catalog_manager.cc:5697] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 6 to 8, leader changed from 1c101e338f954ef086338e251deed19d (127.3.212.130) to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 8 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } }
I20260709 12:17:45.490828 11274 catalog_manager.cc:5697] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } }
I20260709 12:17:45.488538 13580 raft_consensus.cc:993] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8: : Instructing follower a03223e9e41247c3a36b7b7c3d476671 to start an election
I20260709 12:17:45.492462 13580 raft_consensus.cc:1081] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 LEADER]: Signalling peer a03223e9e41247c3a36b7b7c3d476671 to start an election
I20260709 12:17:45.495635 14675 raft_consensus.cc:3060] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:45.496973 11598 raft_consensus.cc:1275] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:17:45.501103 14300 consensus_queue.cc:1048] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:45.501962 14669 raft_consensus.cc:2804] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:45.502394 14669 raft_consensus.cc:493] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:45.502732 14669 raft_consensus.cc:3060] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:45.503306 11418 leader_election.cc:304] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:45.505393 14386 raft_consensus.cc:2749] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:17:45.507222 11417 leader_election.cc:400] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Vote denied by peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973) with higher term. Message: Invalid argument: T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 7. Current term is 8.
I20260709 12:17:45.508284 11417 leader_election.cc:403] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:45.492529 11274 catalog_manager.cc:5697] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 2 to 3, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 3 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } }
W20260709 12:17:45.519457 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 82740.5us
I20260709 12:17:45.523329 11493 leader_election.cc:304] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:45.522056 14668 raft_consensus.cc:3060] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:17:45.524940 11274 catalog_manager.cc:5697] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:45.526346 13995 raft_consensus.cc:2804] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:45.526859 11274 catalog_manager.cc:5697] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } }
I20260709 12:17:45.522394 11527 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5"
dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
 from {username='slave'} at 127.0.0.1:33446
I20260709 12:17:45.530015 11527 raft_consensus.cc:493] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:45.530418 11527 raft_consensus.cc:3060] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:45.526856 13995 raft_consensus.cc:697] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 10 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:45.535748 11601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "a03223e9e41247c3a36b7b7c3d476671"
 from {username='slave'} at 127.0.0.1:37992
I20260709 12:17:45.539932 12357 raft_consensus.cc:1275] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 12 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:17:45.539780 13995 consensus_queue.cc:237] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:45.540793 11274 catalog_manager.cc:5697] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 4 to 8, leader changed from 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132) to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 8 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:45.546499 11419 leader_election.cc:304] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:45.546191 11274 catalog_manager.cc:5697] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:45.554462 11419 leader_election.cc:304] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:45.559134 11274 catalog_manager.cc:5697] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 3 to 6, leader changed from 1c101e338f954ef086338e251deed19d (127.3.212.130) to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 6 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } }
I20260709 12:17:45.562284 14386 raft_consensus.cc:2804] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:45.562947 14386 raft_consensus.cc:697] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 9 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:45.563944 14386 consensus_queue.cc:237] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
W20260709 12:17:45.580484 14709 log.cc:927] Time spent T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
W20260709 12:17:45.582366 14711 log.cc:927] Time spent T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.089s	user 0.002s	sys 0.000s
I20260709 12:17:45.591110 14668 raft_consensus.cc:2749] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973) with higher term. Message: Invalid argument: T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 7. Current term is 8.
I20260709 12:17:45.559358 14416 raft_consensus.cc:2749] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:45.598263 11527 raft_consensus.cc:515] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:45.596848 11599 raft_consensus.cc:1275] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:45.611894 11527 leader_election.cc:290] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:45.627660 11602 raft_consensus.cc:1275] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:17:45.618857 14374 consensus_meta.cc:287] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671: Time spent flushing consensus metadata: real 0.507s	user 0.009s	sys 0.006s
I20260709 12:17:45.636874 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:45.637610 11593 raft_consensus.cc:3055] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:45.637945 11593 raft_consensus.cc:740] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:45.637692 14374 raft_consensus.cc:515] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:45.658530 11593 consensus_queue.cc:260] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
W20260709 12:17:45.673843 14706 log.cc:927] Time spent T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
I20260709 12:17:45.680133 11526 raft_consensus.cc:3060] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:45.685117 11593 raft_consensus.cc:3060] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:45.754240 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 199875us
I20260709 12:17:45.755874 12352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abcb35dfa874d3f9cb851efa0baaea5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:45.756867 12352 raft_consensus.cc:3060] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:45.761052 12357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:45.762274 12357 raft_consensus.cc:3060] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:45.766323 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
W20260709 12:17:45.769102 11492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:45.786983 11451 raft_consensus.cc:1240] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 11 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:17:45.775518 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:45.788625 13995 consensus_queue.cc:1048] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:45.793998 11454 raft_consensus.cc:1275] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:17:45.794226 11453 raft_consensus.cc:1240] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:17:45.754321 14669 raft_consensus.cc:515] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:45.808525 11446 raft_consensus.cc:2368] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for earlier term 10. Current term is 11.
W20260709 12:17:45.825512 14704 log.cc:927] Time spent T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.189s	user 0.003s	sys 0.000s
I20260709 12:17:45.834385 14374 leader_election.cc:290] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:45.835330 14691 raft_consensus.cc:493] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:45.835958 14691 raft_consensus.cc:515] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:45.838289 14691 leader_election.cc:290] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:45.838675 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:45.839455 12361 raft_consensus.cc:2368] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for earlier term 8. Current term is 9.
I20260709 12:17:45.840750 11493 leader_election.cc:400] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 election: Vote denied by peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935) with higher term. Message: Invalid argument: T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for earlier term 8. Current term is 9.
I20260709 12:17:45.841045 11493 leader_election.cc:403] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:17:45.854111 12357 raft_consensus.cc:2468] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 8.
I20260709 12:17:45.855888 11593 raft_consensus.cc:2468] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 8.
I20260709 12:17:45.862372 11447 raft_consensus.cc:1275] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 12 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:17:45.866770 14716 consensus_queue.cc:1048] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:45.890260 11567 leader_election.cc:304] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
W20260709 12:17:45.896932 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 122853us
I20260709 12:17:45.862389 14681 consensus_queue.cc:1048] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.097s
I20260709 12:17:45.915432 11601 raft_consensus.cc:606] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 LEADER]: Received request to transfer leadership to TS a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:45.916108 12352 raft_consensus.cc:2468] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 8.
I20260709 12:17:45.917264 14381 raft_consensus.cc:2804] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:45.917832 14381 raft_consensus.cc:697] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:45.918785 14381 consensus_queue.cc:237] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:45.922101 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:45.922886 11445 raft_consensus.cc:2468] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 10.
I20260709 12:17:45.931263 12345 raft_consensus.cc:1240] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Rejecting Update request from peer 9da53be18b0f446aaa406216e20b0ec8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:45.939181 11526 raft_consensus.cc:2468] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 9.
I20260709 12:17:45.947094 14722 raft_consensus.cc:2749] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935) with higher term. Message: Invalid argument: T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for earlier term 8. Current term is 9.
I20260709 12:17:45.948021 14724 raft_consensus.cc:493] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:45.948664 14724 raft_consensus.cc:515] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:45.949612 14669 leader_election.cc:290] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 11 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:45.950853 14724 leader_election.cc:290] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
W20260709 12:17:45.951766 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 49763.7us
W20260709 12:17:45.952191 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 46463.4us
I20260709 12:17:45.956038 12203 leader_election.cc:304] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:45.957181 14606 raft_consensus.cc:2804] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:45.959862 14606 raft_consensus.cc:493] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:45.960219 14606 raft_consensus.cc:3060] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:45.965102 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:45.966006 12359 raft_consensus.cc:2368] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 7. Current term is 8.
W20260709 12:17:45.979060 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 88882.7us
I20260709 12:17:45.983165 12361 raft_consensus.cc:1275] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:17:45.983608 12361 pending_rounds.cc:85] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de: Aborting all ops after (but not including) 5
I20260709 12:17:45.983843 12361 pending_rounds.cc:107] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:17:45.984093 12361 raft_consensus.cc:2889] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:17:45.984371 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 350897us
I20260709 12:17:45.987808 11491 leader_election.cc:304] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:45.990345 14679 consensus_queue.cc:1048] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:17:45.998777 11567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:46.002472 14679 raft_consensus.cc:2804] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:46.003082 14679 raft_consensus.cc:697] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 8 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:46.004029 14679 consensus_queue.cc:237] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:46.025269 12359 raft_consensus.cc:1275] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:46.032564 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
W20260709 12:17:46.034708 14731 log.cc:927] Time spent T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 12:17:46.035143 11597 raft_consensus.cc:1275] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 12 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:17:46.042133 11520 raft_consensus.cc:1275] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:46.049336 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:46.050136 11523 raft_consensus.cc:2468] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 9.
I20260709 12:17:46.068775 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:46.091550 14673 consensus_queue.cc:1048] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:46.096505 14712 consensus_queue.cc:1048] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:46.131250 13580 consensus_queue.cc:1048] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:46.182314 11446 raft_consensus.cc:1275] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:46.190660 11419 leader_election.cc:400] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 7 pre-election: Vote denied by peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935) with higher term. Message: Invalid argument: T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for earlier term 7. Current term is 8.
I20260709 12:17:46.163362 14606 raft_consensus.cc:515] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:46.193935 11447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2554b9de634e0daa5c0257a1821025" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:46.209100 12359 raft_consensus.cc:2368] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for earlier term 10. Current term is 11.
I20260709 12:17:46.210439 11491 leader_election.cc:400] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579) with higher term. Message: Invalid argument: T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for earlier term 10. Current term is 11.
I20260709 12:17:46.208982 11446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6480ef79a4dc499b94fdb7081ff36fdd" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:46.242715 11449 raft_consensus.cc:1240] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 11 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:46.205269 14392 consensus_queue.cc:1048] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:17:46.219202 14681 consensus_queue.cc:1048] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:17:46.249667 11452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:46.250293 11452 raft_consensus.cc:3060] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:46.251924 11526 raft_consensus.cc:1275] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:46.252966 14448 consensus_queue.cc:1059] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:17:46.253667 14680 consensus_queue.cc:1048] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:46.254032 14724 raft_consensus.cc:493] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:46.254565 14724 raft_consensus.cc:515] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:46.203856 14722 consensus_queue.cc:1048] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 12:17:46.262694 14729 consensus_queue.cc:1048] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 12:17:46.220433 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e9a700accc4fff8304eec59a498721" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:46.270179 12348 raft_consensus.cc:3060] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:46.253888 14448 raft_consensus.cc:3055] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:46.274684 11447 raft_consensus.cc:2468] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 8.
I20260709 12:17:46.282498 12346 raft_consensus.cc:1275] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:46.290342 11452 raft_consensus.cc:2468] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 11.
I20260709 12:17:46.293126 11493 leader_election.cc:400] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 pre-election: Vote denied by peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935) with higher term. Message: Invalid argument: T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for earlier term 10. Current term is 11.
I20260709 12:17:46.294565 11493 leader_election.cc:403] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:46.299981 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:46.265182 14606 leader_election.cc:290] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 11 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:46.307144 11448 raft_consensus.cc:2368] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for earlier term 10. Current term is 11.
I20260709 12:17:46.285452 14448 raft_consensus.cc:740] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:46.325024 12203 leader_election.cc:304] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:46.330775 14450 raft_consensus.cc:3060] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:17:46.333649 14691 raft_consensus.cc:2804] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:46.334249 14691 raft_consensus.cc:697] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 11 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:46.335142 14691 consensus_queue.cc:237] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:46.284579 14679 consensus_queue.cc:1059] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:17:46.345077 14724 leader_election.cc:290] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:46.347362 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:46.359905 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:46.365577 11491 leader_election.cc:400] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579) with higher term. Message: Invalid argument: T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for earlier term 10. Current term is 11.
I20260709 12:17:46.371430 12345 raft_consensus.cc:2393] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 12: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:17:46.378494 14416 consensus_queue.cc:1048] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:46.387965 14722 raft_consensus.cc:3055] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:17:46.388458 14722 raft_consensus.cc:740] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:46.410353 12348 raft_consensus.cc:2468] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 11.
I20260709 12:17:46.411397 12346 raft_consensus.cc:1240] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 11 FOLLOWER]: Rejecting Update request from peer a03223e9e41247c3a36b7b7c3d476671 for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:46.429003 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:46.430089 11453 raft_consensus.cc:2468] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 12.
I20260709 12:17:46.436218 14450 raft_consensus.cc:2749] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935) with higher term. Message: Invalid argument: T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 for earlier term 10. Current term is 11.
I20260709 12:17:46.389309 14722 consensus_queue.cc:260] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:46.363891 14448 consensus_queue.cc:260] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:46.439106 11447 raft_consensus.cc:1275] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:17:46.532063 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 79528.8us
I20260709 12:17:46.534235 13580 consensus_queue.cc:1048] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:17:46.531809 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 62358.2us
I20260709 12:17:46.535539 11491 leader_election.cc:304] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:46.533991 14724 raft_consensus.cc:493] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:46.553618 14724 raft_consensus.cc:515] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:46.554949 14450 raft_consensus.cc:2804] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:46.563894 11523 raft_consensus.cc:2468] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 11.
I20260709 12:17:46.482677 14675 consensus_queue.cc:1059] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.088s
I20260709 12:17:46.572084 12361 raft_consensus.cc:1275] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:17:46.578212 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 136106us
I20260709 12:17:46.581662 14388 consensus_queue.cc:1048] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:46.573796 14153 raft_consensus.cc:493] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:46.583621 14153 raft_consensus.cc:515] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:46.559607 14450 raft_consensus.cc:493] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:17:46.589932 11419 leader_election.cc:304] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:46.566254 14714 raft_consensus.cc:493] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:46.587366 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:46.572253 14448 raft_consensus.cc:3060] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:46.593027 14450 raft_consensus.cc:3060] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:17:46.673408 11494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:46.612843 14714 raft_consensus.cc:515] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:46.677933 14714 leader_election.cc:290] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:46.678757 12346 raft_consensus.cc:2468] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 9.
I20260709 12:17:46.679136 11597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:46.679980 11597 raft_consensus.cc:2468] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 8.
I20260709 12:17:46.681664 12203 leader_election.cc:304] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:46.683743 14714 raft_consensus.cc:2804] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:46.684221 14714 raft_consensus.cc:493] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:46.684654 14714 raft_consensus.cc:3060] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:17:46.659929 14748 log.cc:927] Time spent T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.290s	user 0.001s	sys 0.000s
I20260709 12:17:46.698457 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:46.692814 14669 raft_consensus.cc:2804] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:17:46.703500 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 93113.4us
I20260709 12:17:46.706863 11526 raft_consensus.cc:2468] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 9.
W20260709 12:17:46.708473 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 172974us
I20260709 12:17:46.711580 11598 raft_consensus.cc:1275] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 12:17:46.715559 14751 log.cc:927] Time spent T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:17:46.713218 14669 raft_consensus.cc:697] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 11 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:46.751467 14318 consensus_queue.cc:1048] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:17:46.755049 14752 log.cc:927] Time spent T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.214s	user 0.002s	sys 0.003s
I20260709 12:17:46.764777 14724 leader_election.cc:290] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:46.765017 14669 consensus_queue.cc:237] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:46.782694 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:46.784111 11526 raft_consensus.cc:2393] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 9: Already voted for candidate a03223e9e41247c3a36b7b7c3d476671 in this term.
I20260709 12:17:46.782585 14714 raft_consensus.cc:515] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:46.795840 14714 leader_election.cc:290] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 10 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:46.796048 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:46.796859 11450 raft_consensus.cc:2468] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 11.
I20260709 12:17:46.806222 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:46.807016 11527 raft_consensus.cc:3060] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:46.814405 12346 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "985a868591ad444faeace7fc051862cd"
dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
mode: GRACEFUL
new_leader_uuid: "a03223e9e41247c3a36b7b7c3d476671"
 from {username='slave'} at 127.0.0.1:37972
I20260709 12:17:46.815114 12346 raft_consensus.cc:606] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Received request to transfer leadership to TS a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:46.823200 14714 raft_consensus.cc:993] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de: : Instructing follower a03223e9e41247c3a36b7b7c3d476671 to start an election
I20260709 12:17:46.823371 11597 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a841f2f09ced40a4bbf33594e11bd7ad"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "1c101e338f954ef086338e251deed19d"
 from {username='slave'} at 127.0.0.1:37992
I20260709 12:17:46.824994 11597 raft_consensus.cc:606] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Received request to transfer leadership to TS 1c101e338f954ef086338e251deed19d
I20260709 12:17:46.825451 11597 raft_consensus.cc:614] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:46.827553 11491 leader_election.cc:304] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:46.823748 14714 raft_consensus.cc:1081] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Signalling peer a03223e9e41247c3a36b7b7c3d476671 to start an election
I20260709 12:17:46.841248 14675 raft_consensus.cc:2804] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:46.841761 14675 raft_consensus.cc:493] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:46.842137 14675 raft_consensus.cc:3060] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:46.843474 14722 raft_consensus.cc:3060] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:46.848218 11598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb7937e0cff84ef7a26c84247c8ffc08"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "1c101e338f954ef086338e251deed19d"
 from {username='slave'} at 127.0.0.1:37992
I20260709 12:17:46.848924 11598 raft_consensus.cc:606] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Received request to transfer leadership to TS 1c101e338f954ef086338e251deed19d
I20260709 12:17:46.849220 11598 raft_consensus.cc:614] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:46.857244 11597 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "a03223e9e41247c3a36b7b7c3d476671"
 from {username='slave'} at 127.0.0.1:37992
I20260709 12:17:46.859696 11597 raft_consensus.cc:606] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Received request to transfer leadership to TS a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:46.861691 11597 raft_consensus.cc:614] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:46.873060 11528 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "985a868591ad444faeace7fc051862cd"
dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
 from {username='slave'} at 127.0.0.1:38272
I20260709 12:17:46.876286 11528 raft_consensus.cc:493] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:46.876688 11528 raft_consensus.cc:3060] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:46.877519 14153 leader_election.cc:290] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:46.879544 14388 raft_consensus.cc:993] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8: : Instructing follower a03223e9e41247c3a36b7b7c3d476671 to start an election
I20260709 12:17:46.880090 14388 raft_consensus.cc:1081] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 LEADER]: Signalling peer a03223e9e41247c3a36b7b7c3d476671 to start an election
I20260709 12:17:46.883323 11523 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5"
dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
 from {username='slave'} at 127.0.0.1:33446
I20260709 12:17:46.883908 11523 raft_consensus.cc:493] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:46.884289 11523 raft_consensus.cc:3060] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:46.890231 11567 leader_election.cc:304] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:46.895457 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:46.895977 11602 raft_consensus.cc:3060] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Advancing to term 10
W20260709 12:17:46.919636 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 58332.1us
I20260709 12:17:46.927048  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:17:46.929039  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:46.934055 12345 raft_consensus.cc:1275] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:17:46.937655 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de" is_pre_election: true
I20260709 12:17:46.946110 14761 consensus_queue.cc:1048] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:46.974892 11602 raft_consensus.cc:2468] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 10.
I20260709 12:17:46.960786 11523 raft_consensus.cc:515] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:46.986047 11520 raft_consensus.cc:1275] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:17:46.987799 11527 raft_consensus.cc:2468] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b126028166e8480ba25541bf8f7fc6de in term 10.
I20260709 12:17:46.897744 14496 raft_consensus.cc:493] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:46.977762 14681 raft_consensus.cc:2764] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:17:47.010921 11523 leader_election.cc:290] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:47.013616 11450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:47.015304 11453 raft_consensus.cc:1275] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 11 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:17:47.022801 11450 raft_consensus.cc:3060] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:47.024087 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773ed4105356479c90eb937ef6da81a5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:47.024732 11602 raft_consensus.cc:3055] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:47.025000 11602 raft_consensus.cc:740] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:47.025622 11528 raft_consensus.cc:515] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:47.005853 14744 consensus_queue.cc:1048] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:17:47.034758 11526 raft_consensus.cc:1240] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:47.035794 11602 consensus_queue.cc:260] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:47.046211 11602 raft_consensus.cc:3060] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:47.003966 14496 raft_consensus.cc:515] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
W20260709 12:17:47.061264 11565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:47.063324 11528 leader_election.cc:290] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:47.066196 12348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:47.064785 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985a868591ad444faeace7fc051862cd" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:47.066871 12348 raft_consensus.cc:3055] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:47.067221 12348 raft_consensus.cc:740] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:47.066692 12359 raft_consensus.cc:2468] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 10.
I20260709 12:17:47.073256 11453 raft_consensus.cc:3060] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:47.067945 12348 consensus_queue.cc:260] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:47.075430 14745 consensus_queue.cc:1048] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:17:47.081765 11602 raft_consensus.cc:2468] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 10.
I20260709 12:17:47.098783 14675 raft_consensus.cc:515] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:47.106472 12348 raft_consensus.cc:3060] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:47.109714 11450 raft_consensus.cc:2468] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 10.
I20260709 12:17:47.112754 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
W20260709 12:17:47.115520 14775 log.cc:927] Time spent T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8: Append to log took a long time: real 0.136s	user 0.002s	sys 0.000s
I20260709 12:17:47.116039 11491 leader_election.cc:304] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:47.117022 14761 raft_consensus.cc:2804] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:47.117573 14761 raft_consensus.cc:697] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 10 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:47.122207 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:17:47.111472 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 55865us
I20260709 12:17:47.118577 14761 consensus_queue.cc:237] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:47.125576 11520 raft_consensus.cc:2368] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de for earlier term 11. Current term is 12.
I20260709 12:17:47.087087 14450 raft_consensus.cc:515] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:47.117492 14496 leader_election.cc:290] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:47.101287 14675 leader_election.cc:290] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 12 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:47.140362 14450 leader_election.cc:290] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 12 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:47.142724 12348 raft_consensus.cc:2468] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 8.
I20260709 12:17:47.142917 12346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:47.143788 12346 raft_consensus.cc:2393] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a03223e9e41247c3a36b7b7c3d476671 in current term 12: Already voted for candidate b126028166e8480ba25541bf8f7fc6de in this term.
I20260709 12:17:47.144882 11493 leader_election.cc:304] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:47.146277 14450 raft_consensus.cc:2804] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:47.146835 14450 raft_consensus.cc:697] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 8 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:47.147795 14450 consensus_queue.cc:237] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:47.162207 11453 raft_consensus.cc:2468] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 8.
I20260709 12:17:47.203877 12203 leader_election.cc:304] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:47.205068 14745 raft_consensus.cc:2804] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:47.205638 14745 raft_consensus.cc:697] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 10 LEADER]: Becoming Leader. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:47.206597 14745 consensus_queue.cc:237] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:47.207718 11453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:47.208177 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50204b9643974af9a0505210d261ee78" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:47.208357 11453 raft_consensus.cc:3060] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:47.218856 11453 raft_consensus.cc:2468] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 12.
I20260709 12:17:47.247304 11448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b107ce07924505acbedf93698833e7" candidate_uuid: "b126028166e8480ba25541bf8f7fc6de" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:47.248085 11448 raft_consensus.cc:2368] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de for earlier term 11. Current term is 12.
I20260709 12:17:47.264681 12204 leader_election.cc:400] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 11 pre-election: Vote denied by peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063) with higher term. Message: Invalid argument: T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de for earlier term 11. Current term is 12.
I20260709 12:17:47.127767  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:47.283691 11491 leader_election.cc:304] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:47.287104 14722 raft_consensus.cc:2804] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:17:47.287690 14722 raft_consensus.cc:697] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 12 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:47.288594 14722 consensus_queue.cc:237] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:47.290402 11520 raft_consensus.cc:1275] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:17:47.290885 11520 pending_rounds.cc:85] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671: Aborting all ops after (but not including) 6
I20260709 12:17:47.291119 11520 pending_rounds.cc:107] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:17:47.291502 11520 raft_consensus.cc:2889] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:47.293882 11451 raft_consensus.cc:2468] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 12.
I20260709 12:17:47.265311 12204 leader_election.cc:403] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:47.317207 12203 leader_election.cc:400] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [CANDIDATE]: Term 11 pre-election: Vote denied by peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579) with higher term. Message: Invalid argument: T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de for earlier term 11. Current term is 12.
I20260709 12:17:47.323395 11491 leader_election.cc:304] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:47.329563 14671 raft_consensus.cc:3060] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:17:47.341621 14767 raft_consensus.cc:2804] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:17:47.342357 14767 raft_consensus.cc:697] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 12 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:47.343381 14767 consensus_queue.cc:237] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
W20260709 12:17:47.369139 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 74627.6us
W20260709 12:17:47.390329 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 63750.9us
W20260709 12:17:47.381860 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 63550.2us
I20260709 12:17:47.393159 14772 consensus_queue.cc:1048] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:17:47.435611 14671 raft_consensus.cc:2749] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063) with higher term. Message: Invalid argument: T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b126028166e8480ba25541bf8f7fc6de for earlier term 11. Current term is 12.
I20260709 12:17:47.442747 11273 catalog_manager.cc:5697] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 6 to 7, leader changed from 1c101e338f954ef086338e251deed19d (127.3.212.130) to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 7 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } }
I20260709 12:17:47.472324 11273 catalog_manager.cc:5697] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 4 to 8, leader changed from 1c101e338f954ef086338e251deed19d (127.3.212.130) to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 8 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } }
I20260709 12:17:47.474257 11273 catalog_manager.cc:5697] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 7 to 8, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131). New cstate: current_term: 8 leader_uuid: "a03223e9e41247c3a36b7b7c3d476671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:47.497735 11273 catalog_manager.cc:5697] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 5 to 6, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131). New cstate: current_term: 6 leader_uuid: "a03223e9e41247c3a36b7b7c3d476671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:47.531786 11273 catalog_manager.cc:5697] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 6 to 10, leader changed from 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132) to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 10 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } }
I20260709 12:17:47.539690 12361 raft_consensus.cc:1275] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 11 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:17:47.538432 11273 catalog_manager.cc:5697] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } }
W20260709 12:17:47.548386 11274 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57426 (request call id 166) took 11673 ms (client timeout 15000 ms). Trace:
I20260709 12:17:47.546211 14386 consensus_queue.cc:1048] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:17:47.559190 14773 raft_consensus.cc:493] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:47.555305 11273 catalog_manager.cc:5697] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } }
I20260709 12:17:47.566231 11445 raft_consensus.cc:1275] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:17:47.613058 11273 catalog_manager.cc:5697] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 7 to 8, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 8 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } }
W20260709 12:17:47.621757 11566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 49508.9us
I20260709 12:17:47.622668 13580 raft_consensus.cc:493] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:47.624504 13580 raft_consensus.cc:515] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
W20260709 12:17:47.620954 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 51089.8us
I20260709 12:17:47.630548 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
W20260709 12:17:47.550423 11274 rpcz_store.cc:269] 0709 12:17:35.959974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:36.010980 (+ 51006us) service_pool.cc:224] Handling call
0709 12:17:47.545226 (+11534246us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:45.894056 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:45.922120 (+ 28064us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:45.922183 (+    63us) write_op.cc:435] Acquired schema lock
0709 12:17:45.922207 (+    24us) tablet.cc:662] Decoding operations
0709 12:17:45.924060 (+  1853us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:45.924148 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:45.924180 (+    32us) tablet.cc:685] Acquiring locks for 23 operations
0709 12:17:46.025639 (+101459us) tablet.cc:701] Row locks acquired
0709 12:17:46.025788 (+   149us) write_op.cc:260] PREPARE: finished
0709 12:17:46.026037 (+   249us) write_op.cc:270] Start()
0709 12:17:46.026188 (+   151us) write_op.cc:276] Timestamp: P: 1783599466025964 usec, L: 0
0709 12:17:46.026208 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:17:46.026977 (+   769us) log.cc:844] Serialized 9077 byte log entry
0709 12:17:46.532982 (+506005us) op_driver.cc:464] REPLICATION: finished
0709 12:17:46.877006 (+344024us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b4400022b4c. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e395edb1 00007f84e39fcc85 00007f84e39fd6a2 00007f84e676f1db 00007f84e676aaaf 00007f84e3ab90ac 00007f84ec9139a9 00007f84e3ad569b 00007f84e3ad393f 00007f84e3ad5c02 00007f84ea5f9ef0
0709 12:17:47.081983 (+204977us) write_op.cc:301] APPLY: starting
0709 12:17:47.082137 (+   154us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:47.101734 (+ 19597us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:47.101774 (+    40us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:47.104432 (+  2658us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:47.105023 (+   591us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=23
0709 12:17:47.105073 (+    50us) write_op.cc:312] APPLY: finished
0709 12:17:47.110309 (+  5236us) log.cc:844] Serialized 157 byte log entry
0709 12:17:47.117612 (+  7303us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:47.117815 (+   203us) write_op.cc:454] Released schema lock
0709 12:17:47.117947 (+   132us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:47.118423 (+   476us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:47.118466 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":453463,"reported_tablets":43,"child_traces":[["op",{"apply.queue_time_us":526476,"apply.run_cpu_time_us":5818,"apply.run_wall_time_us":46360,"num_ops":23,"prepare.queue_time_us":277571,"prepare.run_cpu_time_us":53297,"prepare.run_wall_time_us":328809,"raft.queue_time_us":131210,"raft.run_cpu_time_us":74127,"raft.run_wall_time_us":580245,"replication_time_us":405328,"spinlock_wait_cycles":36148608,"thread_start_us":932994,"threads_started":4,"wal-append.queue_time_us":173244}]]}
I20260709 12:17:47.565742 14773 raft_consensus.cc:515] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:47.636866 13580 leader_election.cc:290] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:17:47.633615 14789 log.cc:927] Time spent T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
W20260709 12:17:47.632791 14786 log.cc:927] Time spent T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:17:47.646060 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:47.646800 11527 raft_consensus.cc:2468] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 9.
I20260709 12:17:47.623978 14722 consensus_queue.cc:1048] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 12:17:47.652209 11445 raft_consensus.cc:2393] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 9: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:47.660511 11273 catalog_manager.cc:5697] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } }
I20260709 12:17:47.662017 11273 catalog_manager.cc:5697] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 5 to 7, leader changed from 1c101e338f954ef086338e251deed19d (127.3.212.130) to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 7 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } }
I20260709 12:17:47.677317 11273 catalog_manager.cc:5697] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "a03223e9e41247c3a36b7b7c3d476671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:47.686936 11273 catalog_manager.cc:5697] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 4 to 7, leader changed from 1c101e338f954ef086338e251deed19d (127.3.212.130) to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 7 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } }
W20260709 12:17:47.699323 14785 log.cc:927] Time spent T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de: Append to log took a long time: real 0.076s	user 0.002s	sys 0.000s
I20260709 12:17:47.712670 11566 leader_election.cc:304] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d
I20260709 12:17:47.724787 13580 raft_consensus.cc:2804] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:47.725244 13580 raft_consensus.cc:493] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a03223e9e41247c3a36b7b7c3d476671)
I20260709 12:17:47.725651 13580 raft_consensus.cc:3060] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:47.736810 12346 raft_consensus.cc:1275] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 12 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 12:17:47.742964 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 64465.8us
I20260709 12:17:47.745544 11273 catalog_manager.cc:5697] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } }
I20260709 12:17:47.755818 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:47.756938 11520 raft_consensus.cc:2410] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:17:47.765265 11273 catalog_manager.cc:5697] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } }
I20260709 12:17:47.766481 11273 catalog_manager.cc:5697] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 2 to 7, leader changed from a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131) to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 7 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } }
I20260709 12:17:47.777899 14773 leader_election.cc:290] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:47.783490 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:47.788800 11593 raft_consensus.cc:1275] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:17:47.803690 11273 catalog_manager.cc:5697] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 5 to 7, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 7 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } }
W20260709 12:17:47.811833 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 60261.1us
I20260709 12:17:47.820873 12361 raft_consensus.cc:1275] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:47.833710 11598 raft_consensus.cc:1275] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:17:47.835829 13580 raft_consensus.cc:515] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:47.837255 11602 raft_consensus.cc:2410] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1c101e338f954ef086338e251deed19d for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:17:47.846637 13580 leader_election.cc:290] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 9 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:47.842366 14761 consensus_queue.cc:1048] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:17:47.872685 11523 raft_consensus.cc:1275] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Refusing update from remote peer b126028166e8480ba25541bf8f7fc6de: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:17:47.882969 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:47.887573 11451 raft_consensus.cc:1275] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 12 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:17:47.889247 11417 leader_election.cc:304] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:47.887573 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:47.892314 14644 consensus_queue.cc:1048] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:17:47.875497 14798 consensus_queue.cc:1048] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:17:47.900089 11527 raft_consensus.cc:2468] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 9.
I20260709 12:17:47.878697 14374 consensus_queue.cc:1048] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:17:47.907078 11445 raft_consensus.cc:2393] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9da53be18b0f446aaa406216e20b0ec8 in current term 9: Already voted for candidate 1c101e338f954ef086338e251deed19d in this term.
I20260709 12:17:47.903981 11566 leader_election.cc:304] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:47.908314 13580 raft_consensus.cc:2804] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:47.908802 13580 raft_consensus.cc:697] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:47.909343 14726 consensus_queue.cc:1048] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:47.911571 13580 consensus_queue.cc:237] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:47.947037 12359 raft_consensus.cc:1275] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 12 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:17:47.948833 14450 consensus_queue.cc:1048] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:47.949833 14767 consensus_queue.cc:1048] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:47.958813 11453 raft_consensus.cc:1275] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:47.925040 14416 raft_consensus.cc:2749] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:47.981112 14450 consensus_queue.cc:1048] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
W20260709 12:17:48.056151 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 44500.5us
I20260709 12:17:48.163777 11451 raft_consensus.cc:1275] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 12 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:17:48.185045 14374 consensus_queue.cc:1048] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:17:48.360383 11449 raft_consensus.cc:1275] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:48.381953 11520 raft_consensus.cc:1275] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:48.385022 14381 consensus_queue.cc:1048] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:48.403329 14780 consensus_queue.cc:1048] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:17:48.547235  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:17:48.568670 14814 log.cc:927] Time spent T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.104s	user 0.001s	sys 0.001s
W20260709 12:17:48.587034 14818 log.cc:927] Time spent T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:17:48.627303 11275 catalog_manager.cc:5697] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 9 to 10, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 10 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } }
I20260709 12:17:48.630443 11275 catalog_manager.cc:5697] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 1 to 2, leader changed from 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132) to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 2 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:48.628993 11273 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57430 (request call id 153) took 10830 ms. Trace:
I20260709 12:17:48.631678 11273 rpcz_store.cc:276] 0709 12:17:37.803105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.805472 (+  2367us) service_pool.cc:224] Handling call
0709 12:17:38.296839 (+491367us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b5400a1dbd4. stack: 00007f84e3aa4343 00007f84e3aa4240 00007f84e34331d4 00007f84ed171304 00007f84ed171299 00007f84e6b2d090 00007f84e6bcbf3a 00007f84ec981e9c 00007f84eca8004e 00007f84eaf412a4 00007f84eaf41232 00007f84eaf41161 00007f84eaf410dc 00007f84eaf40392 00007f84e4efe48c 00007f84e4efd8c6
0709 12:17:48.628922 (+10332083us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:48.028978 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:48.029630 (+   652us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:48.029666 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:17:48.029688 (+    22us) tablet.cc:662] Decoding operations
0709 12:17:48.031037 (+  1349us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:48.031101 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:48.031140 (+    39us) tablet.cc:685] Acquiring locks for 16 operations
0709 12:17:48.032376 (+  1236us) tablet.cc:701] Row locks acquired
0709 12:17:48.032403 (+    27us) write_op.cc:260] PREPARE: finished
0709 12:17:48.109319 (+ 76916us) write_op.cc:270] Start()
0709 12:17:48.109481 (+   162us) write_op.cc:276] Timestamp: P: 1783599468109251 usec, L: 0
0709 12:17:48.109503 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:17:48.110289 (+   786us) log.cc:844] Serialized 6353 byte log entry
0709 12:17:48.254238 (+143949us) op_driver.cc:464] REPLICATION: finished
0709 12:17:48.475283 (+221045us) write_op.cc:301] APPLY: starting
0709 12:17:48.475478 (+   195us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:48.481477 (+  5999us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:48.504900 (+ 23423us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:48.527787 (+ 22887us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:48.528060 (+   273us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 12:17:48.528114 (+    54us) write_op.cc:312] APPLY: finished
0709 12:17:48.545544 (+ 17430us) log.cc:844] Serialized 112 byte log entry
0709 12:17:48.545736 (+   192us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:48.545895 (+   159us) write_op.cc:454] Released schema lock
0709 12:17:48.545958 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:48.546395 (+   437us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:48.546425 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":110966,"reported_tablets":44,"spinlock_wait_cycles":292849024,"child_traces":[["op",{"apply.queue_time_us":220595,"apply.run_cpu_time_us":4500,"apply.run_wall_time_us":71146,"num_ops":16,"prepare.queue_time_us":125282,"prepare.run_cpu_time_us":5003,"prepare.run_wall_time_us":114515,"replication_time_us":144493,"thread_start_us":266207,"threads_started":2}]]}
I20260709 12:17:48.645557 11275 catalog_manager.cc:5697] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 8 to 10, leader changed from 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132) to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 10 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:48.647822 11275 catalog_manager.cc:5697] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 7 to 11, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 11 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } }
I20260709 12:17:48.649573 11275 catalog_manager.cc:5697] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 5 to 7, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 7 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } }
I20260709 12:17:48.651567 11275 catalog_manager.cc:5697] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:48.654422 11275 catalog_manager.cc:5697] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:48.655866 11275 catalog_manager.cc:5697] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 4 to 10, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131). New cstate: current_term: 10 leader_uuid: "a03223e9e41247c3a36b7b7c3d476671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } }
I20260709 12:17:48.657517 11275 catalog_manager.cc:5697] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 6 to 9, leader changed from a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131) to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 9 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:48.660800 11275 catalog_manager.cc:5697] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } }
I20260709 12:17:48.662499 11275 catalog_manager.cc:5697] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 4 to 7, leader changed from 1c101e338f954ef086338e251deed19d (127.3.212.130) to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 7 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:48.664045 11275 catalog_manager.cc:5697] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 7 to 8, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 8 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } }
I20260709 12:17:48.665895 11275 catalog_manager.cc:5697] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 7 to 8, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131). New cstate: current_term: 8 leader_uuid: "a03223e9e41247c3a36b7b7c3d476671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } }
I20260709 12:17:48.671655 11275 catalog_manager.cc:5697] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 7 to 9, leader changed from 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132) to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 9 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:48.673411 11275 catalog_manager.cc:5697] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:48.674935 11275 catalog_manager.cc:5697] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 2 to 7, leader changed from a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131) to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 7 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:48.676466 11275 catalog_manager.cc:5697] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 4 to 6, leader changed from 1c101e338f954ef086338e251deed19d (127.3.212.130) to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 6 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } }
I20260709 12:17:48.677897 11275 catalog_manager.cc:5697] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 6 to 11, leader changed from a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131) to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 11 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:48.681934 11593 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "a03223e9e41247c3a36b7b7c3d476671"
 from {username='slave'} at 127.0.0.1:37992
I20260709 12:17:48.682605 11593 raft_consensus.cc:606] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 LEADER]: Received request to transfer leadership to TS a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:48.686064 11597 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35be292dd086433e8b50b99e6f150395"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "a03223e9e41247c3a36b7b7c3d476671"
 from {username='slave'} at 127.0.0.1:37992
I20260709 12:17:48.686643 11597 raft_consensus.cc:606] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 LEADER]: Received request to transfer leadership to TS a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:48.690676 11597 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b179748933846ae9a419549cdfb997a"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "a03223e9e41247c3a36b7b7c3d476671"
 from {username='slave'} at 127.0.0.1:37992
I20260709 12:17:48.691272 11597 raft_consensus.cc:606] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Received request to transfer leadership to TS a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:48.691581 11597 raft_consensus.cc:614] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:48.696348 12346 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7458151705b45928221728d170b4024"
dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
mode: GRACEFUL
new_leader_uuid: "a03223e9e41247c3a36b7b7c3d476671"
 from {username='slave'} at 127.0.0.1:37972
I20260709 12:17:48.679317 11275 catalog_manager.cc:5697] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 6 to 8, leader changed from 1c101e338f954ef086338e251deed19d (127.3.212.130) to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 8 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:48.696936 12346 raft_consensus.cc:606] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Received request to transfer leadership to TS a03223e9e41247c3a36b7b7c3d476671
I20260709 12:17:48.698235 11275 catalog_manager.cc:5697] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 6 to 9, leader changed from 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132) to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 9 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:48.699721 14779 raft_consensus.cc:993] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8: : Instructing follower a03223e9e41247c3a36b7b7c3d476671 to start an election
I20260709 12:17:48.700264 14779 raft_consensus.cc:1081] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 LEADER]: Signalling peer a03223e9e41247c3a36b7b7c3d476671 to start an election
I20260709 12:17:48.700140 11275 catalog_manager.cc:5697] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 9 to 11, leader changed from 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132) to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 11 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } }
I20260709 12:17:48.702893 11520 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35be292dd086433e8b50b99e6f150395"
dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
 from {username='slave'} at 127.0.0.1:33446
I20260709 12:17:48.703151 11597 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e916ed5651f842f99af4ebb1748cd1bb"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "b126028166e8480ba25541bf8f7fc6de"
 from {username='slave'} at 127.0.0.1:37992
I20260709 12:17:48.708017 11597 raft_consensus.cc:606] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Received request to transfer leadership to TS b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:48.708432 11597 raft_consensus.cc:614] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:48.711216 11597 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
mode: GRACEFUL
new_leader_uuid: "1c101e338f954ef086338e251deed19d"
 from {username='slave'} at 127.0.0.1:37992
I20260709 12:17:48.711792 11597 raft_consensus.cc:606] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Received request to transfer leadership to TS 1c101e338f954ef086338e251deed19d
I20260709 12:17:48.712134 11597 raft_consensus.cc:614] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:48.714733  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:17:48.716464  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:48.717347  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:48.707964 11520 raft_consensus.cc:493] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:48.721777 11520 raft_consensus.cc:3060] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:48.729969 11520 raft_consensus.cc:515] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:48.731882 11520 leader_election.cc:290] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:48.734750 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:48.735458 12361 raft_consensus.cc:3060] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:48.738818 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35be292dd086433e8b50b99e6f150395" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:48.739509 11598 raft_consensus.cc:3055] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:48.739782 11598 raft_consensus.cc:740] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:48.740587 11598 consensus_queue.cc:260] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:48.745020 14759 raft_consensus.cc:993] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de: : Instructing follower a03223e9e41247c3a36b7b7c3d476671 to start an election
I20260709 12:17:48.745641 14759 raft_consensus.cc:1081] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Signalling peer a03223e9e41247c3a36b7b7c3d476671 to start an election
I20260709 12:17:48.748493 11523 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7458151705b45928221728d170b4024"
dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
 from {username='slave'} at 127.0.0.1:38272
I20260709 12:17:48.748622 11598 raft_consensus.cc:3060] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:48.749086 11523 raft_consensus.cc:493] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:48.749469 11523 raft_consensus.cc:3060] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:48.756258 11598 raft_consensus.cc:2468] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 8.
I20260709 12:17:48.758324 11491 leader_election.cc:304] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:48.759207 14798 raft_consensus.cc:2804] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:48.764791 12361 raft_consensus.cc:2468] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 8.
I20260709 12:17:48.759680 14798 raft_consensus.cc:697] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 8 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:48.770771 14798 consensus_queue.cc:237] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:48.778096 11523 raft_consensus.cc:515] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:48.806852 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:48.807605 12361 raft_consensus.cc:3055] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:48.806994 11523 leader_election.cc:290] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:48.807917 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7458151705b45928221728d170b4024" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:48.808609 11451 raft_consensus.cc:3060] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:48.816866 11277 catalog_manager.cc:5697] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:48.819903 11277 catalog_manager.cc:5697] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 5 to 6, leader changed from 1c101e338f954ef086338e251deed19d (127.3.212.130) to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 6 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } }
I20260709 12:17:48.807969 12361 raft_consensus.cc:740] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:48.829095 12361 consensus_queue.cc:260] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:48.830287 12361 raft_consensus.cc:3060] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:48.831928 11275 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39286 (request call id 111) took 3338 ms. Trace:
I20260709 12:17:48.834374 11277 catalog_manager.cc:5697] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:48.836459 11277 catalog_manager.cc:5697] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:48.838960 11451 raft_consensus.cc:2468] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 8.
I20260709 12:17:48.840045 11277 catalog_manager.cc:5697] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 5 to 10. New cstate: current_term: 10 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } }
I20260709 12:17:48.842224 11491 leader_election.cc:304] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:48.843228 14798 raft_consensus.cc:2804] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:48.832382 11275 rpcz_store.cc:276] 0709 12:17:45.494028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:45.494540 (+   512us) service_pool.cc:224] Handling call
0709 12:17:48.831833 (+3337293us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:48.735537 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:48.736097 (+   560us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:48.736126 (+    29us) write_op.cc:435] Acquired schema lock
0709 12:17:48.736142 (+    16us) tablet.cc:662] Decoding operations
0709 12:17:48.737846 (+  1704us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:48.737934 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:48.737963 (+    29us) tablet.cc:685] Acquiring locks for 21 operations
0709 12:17:48.739429 (+  1466us) tablet.cc:701] Row locks acquired
0709 12:17:48.739443 (+    14us) write_op.cc:260] PREPARE: finished
0709 12:17:48.739595 (+   152us) write_op.cc:270] Start()
0709 12:17:48.739722 (+   127us) write_op.cc:276] Timestamp: P: 1783599468739545 usec, L: 0
0709 12:17:48.739743 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:17:48.748144 (+  8401us) log.cc:844] Serialized 8301 byte log entry
0709 12:17:48.751059 (+  2915us) op_driver.cc:464] REPLICATION: finished
0709 12:17:48.751528 (+   469us) write_op.cc:301] APPLY: starting
0709 12:17:48.751611 (+    83us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:48.751947 (+   336us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:48.752045 (+    98us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:48.753800 (+  1755us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:48.754070 (+   270us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=21
0709 12:17:48.754113 (+    43us) write_op.cc:312] APPLY: finished
0709 12:17:48.754490 (+   377us) log.cc:844] Serialized 144 byte log entry
0709 12:17:48.754662 (+   172us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:48.754844 (+   182us) write_op.cc:454] Released schema lock
0709 12:17:48.754902 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:48.758590 (+  3688us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:48.758621 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1005,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":243,"apply.run_cpu_time_us":3751,"apply.run_wall_time_us":7018,"num_ops":21,"prepare.queue_time_us":8083,"prepare.run_cpu_time_us":9489,"prepare.run_wall_time_us":12890,"replication_time_us":11178,"thread_start_us":12524,"threads_started":1}]]}
I20260709 12:17:48.842469 11277 catalog_manager.cc:5697] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 8 to 9, leader changed from 1c101e338f954ef086338e251deed19d (127.3.212.130) to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 9 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:48.843741 14798 raft_consensus.cc:697] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 8 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:48.847992 14798 consensus_queue.cc:237] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:48.852795 12361 raft_consensus.cc:2468] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 8.
I20260709 12:17:48.914846 11273 catalog_manager.cc:5697] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 8 to 9, leader changed from 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132) to a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131). New cstate: current_term: 9 leader_uuid: "a03223e9e41247c3a36b7b7c3d476671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:48.916697 11273 catalog_manager.cc:5697] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 9 to 12, leader changed from 1c101e338f954ef086338e251deed19d (127.3.212.130) to a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131). New cstate: current_term: 12 leader_uuid: "a03223e9e41247c3a36b7b7c3d476671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:48.918318 11273 catalog_manager.cc:5697] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 8 to 11, leader changed from a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131) to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 11 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } }
I20260709 12:17:48.924407 11277 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57440 (request call id 182) took 10808 ms. Trace:
I20260709 12:17:48.926059 11273 catalog_manager.cc:5697] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } }
I20260709 12:17:48.928117 11273 catalog_manager.cc:5697] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 7 to 8, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131). New cstate: current_term: 8 leader_uuid: "a03223e9e41247c3a36b7b7c3d476671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:48.935464 11273 catalog_manager.cc:5697] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 2 to 9. New cstate: current_term: 9 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } }
I20260709 12:17:48.936801 11273 catalog_manager.cc:5697] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 10 to 12, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131). New cstate: current_term: 12 leader_uuid: "a03223e9e41247c3a36b7b7c3d476671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:48.938570 11273 catalog_manager.cc:5697] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 9 to 11, leader changed from 1c101e338f954ef086338e251deed19d (127.3.212.130) to b126028166e8480ba25541bf8f7fc6de (127.3.212.129). New cstate: current_term: 11 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } }
I20260709 12:17:48.939885 11273 catalog_manager.cc:5697] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 7 to 8, leader changed from 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132) to a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131). New cstate: current_term: 8 leader_uuid: "a03223e9e41247c3a36b7b7c3d476671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:48.924909 11277 rpcz_store.cc:276] 0709 12:17:38.115800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:38.121273 (+  5473us) service_pool.cc:224] Handling call
0709 12:17:48.924328 (+10803055us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:48.864751 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:48.865262 (+   511us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:48.865294 (+    32us) write_op.cc:435] Acquired schema lock
0709 12:17:48.865313 (+    19us) tablet.cc:662] Decoding operations
0709 12:17:48.866036 (+   723us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:48.866098 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:48.866125 (+    27us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:17:48.866594 (+   469us) tablet.cc:701] Row locks acquired
0709 12:17:48.866611 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:17:48.866749 (+   138us) write_op.cc:270] Start()
0709 12:17:48.866853 (+   104us) write_op.cc:276] Timestamp: P: 1783599468866704 usec, L: 0
0709 12:17:48.866877 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:17:48.867501 (+   624us) log.cc:844] Serialized 2481 byte log entry
0709 12:17:48.870359 (+  2858us) op_driver.cc:464] REPLICATION: finished
0709 12:17:48.870821 (+   462us) write_op.cc:301] APPLY: starting
0709 12:17:48.870897 (+    76us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:48.871071 (+   174us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:48.871165 (+    94us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:48.876194 (+  5029us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:48.876391 (+   197us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:17:48.876439 (+    48us) write_op.cc:312] APPLY: finished
0709 12:17:48.876706 (+   267us) log.cc:844] Serialized 52 byte log entry
0709 12:17:48.876898 (+   192us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:48.877005 (+   107us) write_op.cc:454] Released schema lock
0709 12:17:48.877061 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:48.880953 (+  3892us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:48.880983 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":18046,"reported_tablets":43,"child_traces":[["op",{"apply.queue_time_us":265,"apply.run_cpu_time_us":5267,"apply.run_wall_time_us":6554,"num_ops":6,"prepare.queue_time_us":120,"prepare.run_cpu_time_us":3019,"prepare.run_wall_time_us":5356,"replication_time_us":3355}]]}
I20260709 12:17:48.953545 11273 catalog_manager.cc:5697] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "b126028166e8480ba25541bf8f7fc6de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } }
I20260709 12:17:48.955216 11273 catalog_manager.cc:5697] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "a03223e9e41247c3a36b7b7c3d476671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:48.956856 11273 catalog_manager.cc:5697] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 7 to 8, leader changed from 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132) to a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131). New cstate: current_term: 8 leader_uuid: "a03223e9e41247c3a36b7b7c3d476671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:48.958704 11273 catalog_manager.cc:5697] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 7 to 8, leader changed from 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132) to a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131). New cstate: current_term: 8 leader_uuid: "a03223e9e41247c3a36b7b7c3d476671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:48.960875 11273 catalog_manager.cc:5697] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 6 to 9, leader changed from 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132) to a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131). New cstate: current_term: 9 leader_uuid: "a03223e9e41247c3a36b7b7c3d476671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:48.973754 11273 catalog_manager.cc:5697] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 7 to 10, leader changed from 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132) to a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131). New cstate: current_term: 10 leader_uuid: "a03223e9e41247c3a36b7b7c3d476671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:48.975337 11273 catalog_manager.cc:5697] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 9 to 10, leader changed from 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132) to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 10 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } }
I20260709 12:17:49.012655 11275 catalog_manager.cc:5697] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 6 to 8, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 8 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } }
I20260709 12:17:49.014205 11275 catalog_manager.cc:5697] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 8 to 10, leader changed from 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132) to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 10 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } }
I20260709 12:17:49.015825 11275 catalog_manager.cc:5697] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } }
I20260709 12:17:49.017823 11275 catalog_manager.cc:5697] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } }
W20260709 12:17:49.174959 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 51029.3us
W20260709 12:17:49.176669 11565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 58233.4us
I20260709 12:17:49.182664 11274 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57426 (request call id 167) took 1035 ms. Trace:
I20260709 12:17:49.183194 11274 rpcz_store.cc:276] 0709 12:17:48.147532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:48.147740 (+   208us) service_pool.cc:224] Handling call
0709 12:17:49.182566 (+1034826us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":37}
I20260709 12:17:49.186174 11273 catalog_manager.cc:5697] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 7 to 8, leader changed from 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132) to a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131). New cstate: current_term: 8 leader_uuid: "a03223e9e41247c3a36b7b7c3d476671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:49.188058 11273 catalog_manager.cc:5697] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 7 to 8, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131). New cstate: current_term: 8 leader_uuid: "a03223e9e41247c3a36b7b7c3d476671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:49.207417 14780 raft_consensus.cc:993] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8: : Instructing follower a03223e9e41247c3a36b7b7c3d476671 to start an election
I20260709 12:17:49.207957 14827 raft_consensus.cc:1081] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 LEADER]: Signalling peer a03223e9e41247c3a36b7b7c3d476671 to start an election
I20260709 12:17:49.209892 11523 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79"
dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
 from {username='slave'} at 127.0.0.1:33446
I20260709 12:17:49.210515 11523 raft_consensus.cc:493] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:49.210871 11523 raft_consensus.cc:3060] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:49.231021 11523 raft_consensus.cc:515] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:49.233796 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:49.234417 11451 raft_consensus.cc:3060] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:49.239193 11450 raft_consensus.cc:1275] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:49.241163 14761 consensus_queue.cc:1048] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:49.256644 11451 raft_consensus.cc:2468] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 10.
I20260709 12:17:49.263089 11523 leader_election.cc:290] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:17:49.263674 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b15621d7be54f2489041bbe8258bb79" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:49.272126 11598 raft_consensus.cc:3055] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:49.272521 11598 raft_consensus.cc:740] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:49.274734 11598 consensus_queue.cc:260] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:49.276106 11598 raft_consensus.cc:3060] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:49.277079 11491 leader_election.cc:304] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:49.280418 14798 raft_consensus.cc:2804] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:49.280997 14798 raft_consensus.cc:697] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 10 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:49.282111 14798 consensus_queue.cc:237] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:49.321743 11277 catalog_manager.cc:5697] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 9 to 10, leader changed from 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132) to a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131). New cstate: current_term: 10 leader_uuid: "a03223e9e41247c3a36b7b7c3d476671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:49.325063 11597 raft_consensus.cc:1275] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:17:49.328610 14798 consensus_queue.cc:1048] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:17:49.347925 11598 raft_consensus.cc:2468] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 10.
I20260709 12:17:49.363391 12361 raft_consensus.cc:1275] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:49.365682 14832 consensus_queue.cc:1048] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:49.389822 12346 raft_consensus.cc:1275] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:17:49.392720 14832 consensus_queue.cc:1048] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:49.683651 11450 raft_consensus.cc:1275] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:17:49.708962 14832 consensus_queue.cc:1048] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:17:49.771152 11598 raft_consensus.cc:1275] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:17:49.816116  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:49.846175 14798 consensus_queue.cc:1048] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
W20260709 12:17:49.981102 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 98637.4us
I20260709 12:17:50.019649 12346 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f"
dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
mode: GRACEFUL
new_leader_uuid: "9da53be18b0f446aaa406216e20b0ec8"
 from {username='slave'} at 127.0.0.1:37972
I20260709 12:17:50.020279 12346 raft_consensus.cc:606] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 10 LEADER]: Received request to transfer leadership to TS 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:50.030757 11520 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8"
dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
mode: GRACEFUL
new_leader_uuid: "9da53be18b0f446aaa406216e20b0ec8"
 from {username='slave'} at 127.0.0.1:42478
I20260709 12:17:50.031399 11520 raft_consensus.cc:606] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 8 LEADER]: Received request to transfer leadership to TS 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:50.034835 12361 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694"
dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
mode: GRACEFUL
new_leader_uuid: "1c101e338f954ef086338e251deed19d"
 from {username='slave'} at 127.0.0.1:37972
I20260709 12:17:50.035408 12361 raft_consensus.cc:606] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Received request to transfer leadership to TS 1c101e338f954ef086338e251deed19d
I20260709 12:17:50.040194 11520 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d"
dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
mode: GRACEFUL
new_leader_uuid: "9da53be18b0f446aaa406216e20b0ec8"
 from {username='slave'} at 127.0.0.1:42478
I20260709 12:17:50.040825 11520 raft_consensus.cc:606] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 9 LEADER]: Received request to transfer leadership to TS 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:50.044377 11520 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559"
dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
mode: GRACEFUL
new_leader_uuid: "9da53be18b0f446aaa406216e20b0ec8"
 from {username='slave'} at 127.0.0.1:42478
I20260709 12:17:50.044950 11520 raft_consensus.cc:606] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 8 LEADER]: Received request to transfer leadership to TS 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:17:50.046348  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:17:50.047544  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:50.048185  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:50.162891 14842 raft_consensus.cc:993] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671: : Instructing follower 9da53be18b0f446aaa406216e20b0ec8 to start an election
I20260709 12:17:50.163511 14842 raft_consensus.cc:1081] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 8 LEADER]: Signalling peer 9da53be18b0f446aaa406216e20b0ec8 to start an election
I20260709 12:17:50.165354 11597 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
 from {username='slave'} at 127.0.0.1:55250
I20260709 12:17:50.166005 11597 raft_consensus.cc:493] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:50.166364 11597 raft_consensus.cc:3060] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:50.236289 11597 raft_consensus.cc:515] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:50.253284 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:50.253930 12361 raft_consensus.cc:3060] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:50.258544 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da6f4e0d7b894d0581c87d020e67b559" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:50.259334 11520 raft_consensus.cc:3055] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:50.259699 11520 raft_consensus.cc:740] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:50.260468 11520 consensus_queue.cc:260] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:50.261924 11520 raft_consensus.cc:3060] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:50.270357 12361 raft_consensus.cc:2468] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 9.
I20260709 12:17:50.272228 11567 leader_election.cc:304] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:50.273288 14153 raft_consensus.cc:2804] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:50.273821 14153 raft_consensus.cc:697] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:50.274622 14153 consensus_queue.cc:237] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:50.292520 11597 leader_election.cc:290] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 9 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:50.301411 11274 catalog_manager.cc:5697] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 8 to 9, leader changed from a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131) to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 9 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:50.320566 14852 raft_consensus.cc:993] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671: : Instructing follower 9da53be18b0f446aaa406216e20b0ec8 to start an election
I20260709 12:17:50.321328 14852 raft_consensus.cc:1081] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 8 LEADER]: Signalling peer 9da53be18b0f446aaa406216e20b0ec8 to start an election
I20260709 12:17:50.325155 11597 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
 from {username='slave'} at 127.0.0.1:55250
I20260709 12:17:50.325834 11597 raft_consensus.cc:493] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:50.326248 11597 raft_consensus.cc:3060] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:50.337468 11520 raft_consensus.cc:2468] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 9.
I20260709 12:17:50.348665 11597 raft_consensus.cc:515] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:50.360791 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:50.362373 11520 raft_consensus.cc:3055] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:50.363040 11520 raft_consensus.cc:740] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:50.363852 11520 consensus_queue.cc:260] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:50.369011 11520 raft_consensus.cc:3060] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:50.369783 11597 leader_election.cc:290] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 9 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:50.390522 12361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b19a20c753d463babb75ec55ddd0ba8" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:50.391688 12361 raft_consensus.cc:3060] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:17:50.674239 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 336808us
I20260709 12:17:51.005179 14852 raft_consensus.cc:993] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671: : Instructing follower 9da53be18b0f446aaa406216e20b0ec8 to start an election
I20260709 12:17:51.005688 14852 raft_consensus.cc:1081] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 9 LEADER]: Signalling peer 9da53be18b0f446aaa406216e20b0ec8 to start an election
W20260709 12:17:51.041141 11417 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 630897us
I20260709 12:17:51.069931 14864 raft_consensus.cc:993] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de: : Instructing follower 1c101e338f954ef086338e251deed19d to start an election
I20260709 12:17:51.070770 14864 raft_consensus.cc:1081] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Signalling peer 1c101e338f954ef086338e251deed19d to start an election
I20260709 12:17:51.085991 11450 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694"
dest_uuid: "1c101e338f954ef086338e251deed19d"
 from {username='slave'} at 127.0.0.1:35814
I20260709 12:17:51.087308 11450 raft_consensus.cc:493] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:51.087706 11450 raft_consensus.cc:3060] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:51.095197 11450 raft_consensus.cc:515] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:51.098973 11450 leader_election.cc:290] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:17:51.113034 11520 consensus_meta.cc:287] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671: Time spent flushing consensus metadata: real 0.743s	user 0.005s	sys 0.007s
I20260709 12:17:51.113492 11520 raft_consensus.cc:2468] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 9.
I20260709 12:17:51.154064 14868 raft_consensus.cc:993] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de: : Instructing follower 9da53be18b0f446aaa406216e20b0ec8 to start an election
I20260709 12:17:51.154556 14868 raft_consensus.cc:1081] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 10 LEADER]: Signalling peer 9da53be18b0f446aaa406216e20b0ec8 to start an election
I20260709 12:17:51.158175 11593 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
 from {username='slave'} at 127.0.0.1:40784
I20260709 12:17:51.158973 11593 raft_consensus.cc:493] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:51.159366 11593 raft_consensus.cc:3060] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:51.178617 11593 raft_consensus.cc:515] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:51.192929 11593 leader_election.cc:290] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 11 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:17:51.194097 14859 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.838s	user 0.004s	sys 0.005s
W20260709 12:17:51.194628 14859 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.838s	user 0.004s	sys 0.005s
I20260709 12:17:51.203440 11566 leader_election.cc:304] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:51.206037 14780 raft_consensus.cc:2804] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:51.206673 14780 raft_consensus.cc:697] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:51.213925 12359 raft_consensus.cc:1275] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:51.215553 11523 raft_consensus.cc:1275] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:51.218675 12345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:51.218839 14780 consensus_queue.cc:237] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:51.219452 12345 raft_consensus.cc:3055] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:17:51.219751 12345 raft_consensus.cc:740] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:51.220424 12345 consensus_queue.cc:260] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:51.221311 12345 raft_consensus.cc:3060] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:51.224380 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cd3dfdeed3494ea7d5a7c45337ad3f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:51.225067 11523 raft_consensus.cc:3060] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:17:51.225894 12203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 61787.1us
W20260709 12:17:51.218968 12361 consensus_meta.cc:287] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de: Time spent flushing consensus metadata: real 0.827s	user 0.012s	sys 0.000s
I20260709 12:17:51.229729 12361 raft_consensus.cc:2468] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 9.
I20260709 12:17:51.233038 11523 raft_consensus.cc:2468] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 11.
I20260709 12:17:51.236722 12345 raft_consensus.cc:2468] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 11.
W20260709 12:17:51.257790 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:41579, user_credentials={real_user=slave}} blocked reactor thread for 71131.7us
I20260709 12:17:51.263496 11454 raft_consensus.cc:1240] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Rejecting Update request from peer b126028166e8480ba25541bf8f7fc6de for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:51.267189 14876 consensus_queue.cc:1048] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:51.267725 14759 consensus_queue.cc:1059] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:51.269155 14759 raft_consensus.cc:3055] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:51.269541 14759 raft_consensus.cc:740] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b126028166e8480ba25541bf8f7fc6de, State: Running, Role: LEADER
I20260709 12:17:51.270335 14759 consensus_queue.cc:260] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:51.273475 14759 raft_consensus.cc:3060] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:51.274876 11567 leader_election.cc:304] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:51.275826 14876 raft_consensus.cc:2804] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:51.276362 14876 raft_consensus.cc:697] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 11 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:51.277204 14876 consensus_queue.cc:237] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:51.303543 14153 consensus_queue.cc:1048] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:17:51.305878 12204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 53049.2us
I20260709 12:17:51.307763 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:51.308473 11527 raft_consensus.cc:3060] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:51.315534 11527 raft_consensus.cc:2468] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 8.
I20260709 12:17:51.319749 11598 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d"
dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
 from {username='slave'} at 127.0.0.1:55250
I20260709 12:17:51.325764 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a690fb2f9e0548988bfefbe6ed3ab694" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "b126028166e8480ba25541bf8f7fc6de"
I20260709 12:17:51.358053 11598 raft_consensus.cc:493] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:51.358559 11598 raft_consensus.cc:3060] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:51.364547 12359 raft_consensus.cc:2468] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 8.
I20260709 12:17:51.366395 11419 leader_election.cc:304] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de; no voters: 
I20260709 12:17:51.367316 14300 raft_consensus.cc:2804] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:51.367832 14300 raft_consensus.cc:697] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 8 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:51.368687 14300 consensus_queue.cc:237] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:51.404085 11598 raft_consensus.cc:515] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:51.423096 11598 leader_election.cc:290] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:51.427783 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:51.428469 11527 raft_consensus.cc:3055] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:51.430662 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdf8217c2b5b47f68e62de34bb95e95d" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:51.431285 11445 raft_consensus.cc:3060] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:51.432920 11275 catalog_manager.cc:5697] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 7 to 8, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 8 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:51.438660 11445 raft_consensus.cc:2468] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 10.
I20260709 12:17:51.428776 11527 raft_consensus.cc:740] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:51.458914 11565 leader_election.cc:304] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:17:51.442812 11527 consensus_queue.cc:260] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:51.460541 11527 raft_consensus.cc:3060] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:51.462669 14876 raft_consensus.cc:2804] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:51.473042 14876 raft_consensus.cc:697] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 10 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:51.474325 14876 consensus_queue.cc:237] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:17:51.475569 11527 raft_consensus.cc:2468] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 10.
I20260709 12:17:51.475168 11274 catalog_manager.cc:5697] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 8 to 9, leader changed from a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131) to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 9 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:51.476879 11274 catalog_manager.cc:5697] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 10 to 11, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 11 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:51.532460 11274 catalog_manager.cc:5697] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 9 to 10, leader changed from a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131) to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 10 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:51.648125 12345 raft_consensus.cc:1275] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:17:51.653257 14153 consensus_queue.cc:1048] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:51.691377 11527 raft_consensus.cc:1275] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:17:51.696089 14876 consensus_queue.cc:1048] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:51.854228 12345 raft_consensus.cc:1275] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 11 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:17:51.856395 14876 consensus_queue.cc:1048] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:17:51.872525 11527 raft_consensus.cc:1275] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:17:51.885870 11454 raft_consensus.cc:1275] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:17:51.888749 12346 raft_consensus.cc:1275] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:51.892778 14863 consensus_queue.cc:1048] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:17:51.893355 14865 consensus_queue.cc:1048] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:51.898855 14863 consensus_queue.cc:1048] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:17:51.925205 11526 raft_consensus.cc:1275] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:17:51.926892 14153 consensus_queue.cc:1048] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:17:51.959827 11475 debug-util.cc:398] Leaking SignalData structure 0x7b08002cb7a0 after lost signal to thread 3925
W20260709 12:17:51.963179 11475 debug-util.cc:398] Leaking SignalData structure 0x7b080032b660 after lost signal to thread 11311
W20260709 12:17:51.964434 11475 debug-util.cc:398] Leaking SignalData structure 0x7b080029d900 after lost signal to thread 11478
W20260709 12:17:51.965586 11475 debug-util.cc:398] Leaking SignalData structure 0x7b08003b52c0 after lost signal to thread 11552
W20260709 12:17:51.968152 11475 debug-util.cc:398] Leaking SignalData structure 0x7b08003ca980 after lost signal to thread 11626
W20260709 12:17:51.969964 11475 debug-util.cc:398] Leaking SignalData structure 0x7b08001cf560 after lost signal to thread 12405
I20260709 12:17:51.971185 11523 raft_consensus.cc:1275] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:51.972661 14865 consensus_queue.cc:1048] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:17:52.115828 14892 log.cc:927] Time spent T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671: Append to log took a long time: real 0.075s	user 0.000s	sys 0.006s
W20260709 12:17:52.134065 14890 log.cc:927] Time spent T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d: Append to log took a long time: real 0.080s	user 0.000s	sys 0.006s
I20260709 12:17:52.301591  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:52.390969  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:17:52.392493  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:52.393174  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:52.455611  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:52.536971  3922 tablet_server.cc:179] TabletServer@127.3.212.129:37935 shutting down...
W20260709 12:17:52.557986 11493 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
W20260709 12:17:52.589270 11493 consensus_peers.cc:597] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:52.613725 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 43663us
W20260709 12:17:52.621321 11419 consensus_peers.cc:597] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:52.624064 11419 consensus_peers.cc:597] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:52.633149 11493 consensus_peers.cc:597] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:52.633924 11493 consensus_peers.cc:597] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:52.671657 11567 consensus_peers.cc:597] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:52.703018  3922 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:17:52.708113  3922 tablet_replica.cc:333] stopping tablet replica
W20260709 12:17:52.708913 11493 consensus_peers.cc:597] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:52.709110  3922 raft_consensus.cc:2243] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:17:52.710568  3922 raft_consensus.cc:2272] T ef13d597f7a84434a1bbdc95857e6215 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:52.713798  3922 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:52.714756  3922 raft_consensus.cc:2243] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:52.715359  3922 raft_consensus.cc:2272] T f8e9a700accc4fff8304eec59a498721 P b126028166e8480ba25541bf8f7fc6de [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:52.740379  3922 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:52.741443  3922 raft_consensus.cc:2243] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:52.742209  3922 raft_consensus.cc:2272] T a34e69406a86484482230bfec0edfcfa P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:52.749534 11493 consensus_peers.cc:597] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:52.759541 11419 consensus_peers.cc:597] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:52.760370  3922 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:52.762137  3922 raft_consensus.cc:2243] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 11 LEADER]: Raft consensus shutting down.
W20260709 12:17:52.764356 11419 consensus_peers.cc:597] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:52.770429  3922 raft_consensus.cc:2272] T 85a1c543b632476b909b2a5fb50e9f78 P b126028166e8480ba25541bf8f7fc6de [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:52.776908  3922 tablet_replica.cc:333] stopping tablet replica
W20260709 12:17:52.777062 11567 consensus_peers.cc:597] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:52.781924 11419 consensus_peers.cc:597] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:52.785002 11419 consensus_peers.cc:597] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:52.786150  3922 raft_consensus.cc:2243] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:52.789295  3922 raft_consensus.cc:2272] T a215788da7ae4b548e5c307a6b294109 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:52.791211 11493 consensus_peers.cc:597] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:52.799439  3922 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:52.809883  3922 raft_consensus.cc:2243] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:52.810532  3922 raft_consensus.cc:2272] T 9b19a20c753d463babb75ec55ddd0ba8 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:52.812758 11493 consensus_peers.cc:597] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:52.813889  3922 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:52.817452  3922 raft_consensus.cc:2243] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:52.818122  3922 raft_consensus.cc:2272] T 5ffe47647c274723808482c166efa21c P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:52.814023 11567 consensus_peers.cc:597] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:52.822818 11567 consensus_peers.cc:597] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:52.829458 11419 consensus_peers.cc:597] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:52.832568  3922 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:52.833743  3922 raft_consensus.cc:2243] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:52.834470  3922 raft_consensus.cc:2272] T 45c355b3902a4e7fb72bac6a91ea3316 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:52.839676 11419 consensus_peers.cc:597] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:52.845602  3922 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:52.846607  3922 raft_consensus.cc:2243] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:52.847239  3922 raft_consensus.cc:2272] T 1d2554b9de634e0daa5c0257a1821025 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:52.851341  3922 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:52.852301  3922 raft_consensus.cc:2243] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 10 LEADER]: Raft consensus shutting down.
W20260709 12:17:52.852550 11493 consensus_peers.cc:597] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:52.853592  3922 raft_consensus.cc:2272] T f112ae9059f34e52b722c66748dbffe5 P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:52.866665  3922 tablet_replica.cc:333] stopping tablet replica
W20260709 12:17:52.866752 11493 consensus_peers.cc:597] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:52.867818 11493 consensus_peers.cc:597] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:52.867890  3922 raft_consensus.cc:2243] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 9 LEADER]: Raft consensus shutting down.
W20260709 12:17:52.868953 11567 consensus_peers.cc:597] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:52.873046 11567 consensus_peers.cc:597] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:52.874524  3922 raft_consensus.cc:2272] T 4d8592bdb30445228c429e3c55360c25 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:52.880146  3922 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:52.881209  3922 raft_consensus.cc:2243] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:52.881803  3922 raft_consensus.cc:2272] T e916ed5651f842f99af4ebb1748cd1bb P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:52.885205 11419 consensus_peers.cc:597] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:52.892207  3922 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:52.893308  3922 raft_consensus.cc:2243] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:52.893963  3922 raft_consensus.cc:2272] T b9c607d0d1e744b6babe5fc93505013b P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:52.894357 11567 consensus_peers.cc:597] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:52.897096  3922 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:52.898090  3922 raft_consensus.cc:2243] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:17:52.899302  3922 raft_consensus.cc:2272] T cc18a67cc3d24753b2677d72cfee35b4 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:52.920715  3922 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:52.921664  3922 raft_consensus.cc:2243] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:17:52.922808  3922 raft_consensus.cc:2272] T c67c223a5ec948b4bf18874bf0d591b5 P b126028166e8480ba25541bf8f7fc6de [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:52.927726  3922 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:52.928545  3922 raft_consensus.cc:2243] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:52.929210  3922 raft_consensus.cc:2272] T 74b107ce07924505acbedf93698833e7 P b126028166e8480ba25541bf8f7fc6de [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:52.932538  3922 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:52.933467  3922 raft_consensus.cc:2243] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:52.934132  3922 raft_consensus.cc:2272] T 721df15d88f64a09bcaa4fe04a559f48 P b126028166e8480ba25541bf8f7fc6de [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:52.937240  3922 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:52.938251  3922 raft_consensus.cc:2243] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:52.938800  3922 raft_consensus.cc:2272] T 9a3a6ef0117045b19d2915baab58e53f P b126028166e8480ba25541bf8f7fc6de [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:52.940320 11419 consensus_peers.cc:597] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:52.941743  3922 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:52.942610  3922 raft_consensus.cc:2243] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:17:52.943616  3922 raft_consensus.cc:2272] T e3b977efa036417c9a75e3b30b19c72a P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:52.946477  3922 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:52.947264  3922 raft_consensus.cc:2243] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:52.947817  3922 raft_consensus.cc:2272] T a841f2f09ced40a4bbf33594e11bd7ad P b126028166e8480ba25541bf8f7fc6de [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:52.950665  3922 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:52.951494  3922 raft_consensus.cc:2243] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:52.952380  3922 raft_consensus.cc:2272] T 6480ef79a4dc499b94fdb7081ff36fdd P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:52.958209  3922 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:52.959203  3922 raft_consensus.cc:2243] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:17:52.960386  3922 raft_consensus.cc:2272] T cb7937e0cff84ef7a26c84247c8ffc08 P b126028166e8480ba25541bf8f7fc6de [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:52.963636  3922 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:52.964483  3922 raft_consensus.cc:2243] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:52.965046  3922 raft_consensus.cc:2272] T 985a868591ad444faeace7fc051862cd P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:52.968250  3922 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:52.983620  3922 raft_consensus.cc:2243] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:52.984476  3922 raft_consensus.cc:2272] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P b126028166e8480ba25541bf8f7fc6de [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:52.997947  3922 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:53.042989  3922 raft_consensus.cc:2243] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:53.043727  3922 raft_consensus.cc:2272] T 50204b9643974af9a0505210d261ee78 P b126028166e8480ba25541bf8f7fc6de [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:53.046850  3922 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:53.047756  3922 raft_consensus.cc:2243] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:53.053427  3922 raft_consensus.cc:2272] T a690fb2f9e0548988bfefbe6ed3ab694 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:53.056383 11419 consensus_peers.cc:597] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:53.057219  3922 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:53.058234  3922 raft_consensus.cc:2243] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:53.058899  3922 raft_consensus.cc:2272] T 2aaa267a7b85487a991ce0600309cac0 P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:53.062917  3922 tablet_replica.cc:333] stopping tablet replica
W20260709 12:17:53.082814 11567 consensus_peers.cc:597] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:53.091807  3922 raft_consensus.cc:2243] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:53.092912  3922 raft_consensus.cc:2272] T da6f4e0d7b894d0581c87d020e67b559 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:53.096715  3922 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:53.097618  3922 raft_consensus.cc:2243] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:53.098307  3922 raft_consensus.cc:2272] T 34d43eecbad746fd9ddce50c5b9fc3e8 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:53.106412  3922 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:53.109301  3922 raft_consensus.cc:2243] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:53.110018  3922 raft_consensus.cc:2272] T 2d78aaa911094df3ac90f175cd5c58fb P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:53.132798 11567 consensus_peers.cc:597] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:53.134037  3922 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:53.135502  3922 raft_consensus.cc:2243] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:53.136126  3922 raft_consensus.cc:2272] T 193e9917816a4990998188f9a4e9d08c P b126028166e8480ba25541bf8f7fc6de [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:53.140098  3922 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:53.140950  3922 raft_consensus.cc:2243] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:53.188966  3922 raft_consensus.cc:2272] T 4abcb35dfa874d3f9cb851efa0baaea5 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:53.196441  3922 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:53.197359  3922 raft_consensus.cc:2243] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:17:53.198559  3922 raft_consensus.cc:2272] T 88412eb571b84fdc8d521a981be63bfa P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:53.224840  3922 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:53.229763  3922 raft_consensus.cc:2243] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:53.230434  3922 raft_consensus.cc:2272] T 35be292dd086433e8b50b99e6f150395 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:53.233832  3922 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:53.234807  3922 raft_consensus.cc:2243] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:17:53.235857  3922 raft_consensus.cc:2272] T f1589b98714c45ef8ed01287d13b8252 P b126028166e8480ba25541bf8f7fc6de [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:53.258639  3922 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:53.273298  3922 raft_consensus.cc:2243] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:17:53.276513  3922 raft_consensus.cc:2272] T 876bdec904324677a10f21ffbc21f5e3 P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:53.279724  3922 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:53.280525  3922 raft_consensus.cc:2243] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:17:53.290354  3922 raft_consensus.cc:2272] T 987e6a4207394b2f80be7c7d03b696bf P b126028166e8480ba25541bf8f7fc6de [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:53.294776  3922 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:53.295608  3922 raft_consensus.cc:2243] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:53.296304  3922 raft_consensus.cc:2272] T e896afa1887146dfade142338e2fc407 P b126028166e8480ba25541bf8f7fc6de [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:53.299235  3922 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:53.300004  3922 raft_consensus.cc:2243] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:17:53.301151  3922 raft_consensus.cc:2272] T 381fa277bb844a948c90100e03a4059a P b126028166e8480ba25541bf8f7fc6de [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:53.304159  3922 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:53.304913  3922 raft_consensus.cc:2243] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:53.310897  3922 raft_consensus.cc:2272] T 167448b175c040d180318f81f6d10c8d P b126028166e8480ba25541bf8f7fc6de [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:53.350323  3922 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:53.351109  3922 raft_consensus.cc:2243] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:53.351805  3922 raft_consensus.cc:2272] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P b126028166e8480ba25541bf8f7fc6de [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:53.382634  3922 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:53.383518  3922 raft_consensus.cc:2243] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:17:53.386345  3922 raft_consensus.cc:2272] T 2b52025153e440eebdadbe35d49837ff P b126028166e8480ba25541bf8f7fc6de [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:53.389951  3922 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:53.390802  3922 raft_consensus.cc:2243] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:53.393010  3922 raft_consensus.cc:2272] T 98cd3dfdeed3494ea7d5a7c45337ad3f P b126028166e8480ba25541bf8f7fc6de [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:17:53.409353 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 83912.5us
I20260709 12:17:53.412705  3922 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:53.413622  3922 raft_consensus.cc:2243] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:53.414216  3922 raft_consensus.cc:2272] T e7458151705b45928221728d170b4024 P b126028166e8480ba25541bf8f7fc6de [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:53.417163  3922 tablet_replica.cc:333] stopping tablet replica
I20260709 12:17:53.418046  3922 raft_consensus.cc:2243] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:17:53.458488  3922 raft_consensus.cc:2272] T 7b179748933846ae9a419549cdfb997a P b126028166e8480ba25541bf8f7fc6de [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:53.718076 14915 raft_consensus.cc:493] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:53.718636 14915 raft_consensus.cc:515] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:53.721843 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:53.724387 14915 leader_election.cc:290] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
W20260709 12:17:53.726384 11419 leader_election.cc:336] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:17:53.726931 11419 leader_election.cc:304] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:53.727624 14915 raft_consensus.cc:2749] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:53.789175 14914 raft_consensus.cc:493] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:53.789762 14914 raft_consensus.cc:515] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:53.794159 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:53.802515 14914 leader_election.cc:290] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
W20260709 12:17:53.878430 11493 leader_election.cc:336] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:17:53.878903 11493 leader_election.cc:304] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:53.879659 14908 raft_consensus.cc:2749] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:54.014285 14908 raft_consensus.cc:493] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:54.014871 14908 raft_consensus.cc:515] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
W20260709 12:17:54.023298 11493 leader_election.cc:336] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:17:54.025575 14907 raft_consensus.cc:493] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:54.024434 14908 leader_election.cc:290] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:54.026162 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:54.026237 14907 raft_consensus.cc:515] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:54.027801 11491 leader_election.cc:304] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:54.029059 14153 raft_consensus.cc:493] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:54.029505 14907 leader_election.cc:290] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:54.036988 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:54.029580 14153 raft_consensus.cc:515] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
W20260709 12:17:54.038275 11493 leader_election.cc:336] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:17:54.039912 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:54.040768 11523 raft_consensus.cc:2468] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 10.
I20260709 12:17:54.042474 11566 leader_election.cc:304] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:54.043419 14916 raft_consensus.cc:2804] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:54.043862 14916 raft_consensus.cc:493] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:54.044248 14916 raft_consensus.cc:3060] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:54.052295 14153 leader_election.cc:290] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:54.052253 11491 leader_election.cc:304] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:54.054360 14907 raft_consensus.cc:2749] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:54.051079 14908 raft_consensus.cc:2749] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:17:54.058272 11567 leader_election.cc:336] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:17:54.068356 14766 raft_consensus.cc:493] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:54.075341 14916 raft_consensus.cc:515] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:54.078352 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f112ae9059f34e52b722c66748dbffe5" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:54.069043 14766 raft_consensus.cc:515] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:54.079044 11523 raft_consensus.cc:3060] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:17:54.086277 11567 leader_election.cc:336] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:17:54.087316 14916 leader_election.cc:290] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 11 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:54.087811 14766 leader_election.cc:290] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:17:54.099141 11419 leader_election.cc:336] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:17:54.103039 11523 raft_consensus.cc:2468] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 11.
I20260709 12:17:54.104660 11566 leader_election.cc:304] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:54.105659 14916 raft_consensus.cc:2804] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:54.106201 14916 raft_consensus.cc:697] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 11 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:54.106912 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:54.106329 14766 raft_consensus.cc:493] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:54.108839 14766 raft_consensus.cc:515] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:54.111994 11418 leader_election.cc:304] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:54.112965 14912 raft_consensus.cc:2749] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:54.107080 14916 consensus_queue.cc:237] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:54.149768 11274 catalog_manager.cc:5697] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 10 to 11, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 11 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:54.155535 14916 raft_consensus.cc:493] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:54.156193 14916 raft_consensus.cc:515] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:54.162199 14912 raft_consensus.cc:493] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:54.162977 14912 raft_consensus.cc:515] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
W20260709 12:17:54.164332 11567 leader_election.cc:336] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:17:54.165580 14912 leader_election.cc:290] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:54.168069 14916 leader_election.cc:290] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
W20260709 12:17:54.168733 11419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 43753.9us
I20260709 12:17:54.169988 14766 leader_election.cc:290] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:54.176040 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:54.178679 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:54.183537 11526 raft_consensus.cc:2468] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 9.
I20260709 12:17:54.185456 11418 leader_election.cc:304] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:54.186414 14912 raft_consensus.cc:2804] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:54.186914 14912 raft_consensus.cc:493] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:54.187358 14912 raft_consensus.cc:3060] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:17:54.189591 11419 leader_election.cc:336] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:17:54.192903 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:54.193575 11451 raft_consensus.cc:2468] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 9.
I20260709 12:17:54.198195 14908 raft_consensus.cc:493] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:54.198886 11565 leader_election.cc:304] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:54.198827 14908 raft_consensus.cc:515] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:54.199951 14916 raft_consensus.cc:2804] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:17:54.200881 11419 leader_election.cc:336] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:17:54.201417 11419 leader_election.cc:304] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:54.202212 14766 raft_consensus.cc:2749] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:54.204305 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:54.204952 11451 raft_consensus.cc:2468] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 11.
I20260709 12:17:54.206058 11491 leader_election.cc:304] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:54.206827 14907 raft_consensus.cc:2804] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:54.200413 14916 raft_consensus.cc:493] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:54.207247 14907 raft_consensus.cc:493] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:54.202236 14912 raft_consensus.cc:515] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:54.208051 14907 raft_consensus.cc:3060] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:54.208051 14916 raft_consensus.cc:3060] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:17:54.207188 11493 leader_election.cc:336] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:17:54.201139 14908 leader_election.cc:290] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:54.213970 14915 raft_consensus.cc:493] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:54.214591 14915 raft_consensus.cc:515] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:54.216883 14915 leader_election.cc:290] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:17:54.218461 11419 leader_election.cc:336] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:17:54.220582 14912 leader_election.cc:290] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:54.221765 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:17:54.222431 11419 leader_election.cc:336] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:17:54.223560 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d8592bdb30445228c429e3c55360c25" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:54.223176 11526 raft_consensus.cc:2468] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 11.
I20260709 12:17:54.224175 11523 raft_consensus.cc:3060] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:54.228825 14907 raft_consensus.cc:515] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:54.231426 11523 raft_consensus.cc:2468] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 10.
W20260709 12:17:54.235795 11493 leader_election.cc:336] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:17:54.237216 11418 leader_election.cc:304] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:54.238709 14912 raft_consensus.cc:2804] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:54.239099 14912 raft_consensus.cc:493] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 11 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:54.239468 14912 raft_consensus.cc:3060] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:54.241398 14915 raft_consensus.cc:493] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:54.242057 14915 raft_consensus.cc:515] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:54.246475 11418 leader_election.cc:304] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:54.247498 14766 raft_consensus.cc:2804] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:54.247926 14766 raft_consensus.cc:697] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 10 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:54.248708 14766 consensus_queue.cc:237] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:54.251596 14915 leader_election.cc:290] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:54.253032 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:54.256934 14907 leader_election.cc:290] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 12 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:54.259420 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85a1c543b632476b909b2a5fb50e9f78" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:54.263465 11451 raft_consensus.cc:3060] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:54.272478 11451 raft_consensus.cc:2468] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 12.
I20260709 12:17:54.264472 14916 raft_consensus.cc:515] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:54.278218 11491 leader_election.cc:304] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
W20260709 12:17:54.278887 11419 leader_election.cc:336] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:17:54.281265 14780 raft_consensus.cc:493] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:54.282037 14780 raft_consensus.cc:515] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:54.282963 14908 raft_consensus.cc:2804] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:17:54.283557 14908 raft_consensus.cc:697] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 12 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:54.284441 14908 consensus_queue.cc:237] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:54.284860 14780 leader_election.cc:290] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:54.287576 11417 leader_election.cc:304] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:54.294032 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
W20260709 12:17:54.294309 11567 leader_election.cc:336] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:17:54.295372 11451 raft_consensus.cc:2468] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 7.
I20260709 12:17:54.297083 11565 leader_election.cc:304] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:54.298484 14780 raft_consensus.cc:2804] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:54.299180 14916 leader_election.cc:290] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:54.300611 14912 raft_consensus.cc:515] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:54.312250 14912 leader_election.cc:290] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 12 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:54.307338 14780 raft_consensus.cc:493] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:54.313082 14780 raft_consensus.cc:3060] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:54.315521 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef13d597f7a84434a1bbdc95857e6215" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:54.316150 11454 raft_consensus.cc:3060] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:17:54.308621 11567 leader_election.cc:336] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
W20260709 12:17:54.325141 11419 leader_election.cc:336] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
W20260709 12:17:54.306041 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 59653us
I20260709 12:17:54.328612 11454 raft_consensus.cc:2468] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 10.
I20260709 12:17:54.303587 14926 raft_consensus.cc:2749] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:54.330446 14916 raft_consensus.cc:493] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:54.331179 14916 raft_consensus.cc:515] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:54.334052 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67c223a5ec948b4bf18874bf0d591b5" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:54.334275 14924 raft_consensus.cc:493] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:54.339556 14915 raft_consensus.cc:493] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:54.341650 11523 raft_consensus.cc:3060] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:54.342303 11565 leader_election.cc:304] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:54.345407 14153 raft_consensus.cc:2804] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:54.351752 11523 raft_consensus.cc:2468] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 12.
I20260709 12:17:54.352859 11418 leader_election.cc:304] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:54.356281 14766 raft_consensus.cc:2804] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:17:54.354390 14780 raft_consensus.cc:515] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:54.357431 14766 raft_consensus.cc:697] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 12 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:54.358454 14766 consensus_queue.cc:237] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:54.359261 14907 raft_consensus.cc:493] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:54.359810 14907 raft_consensus.cc:515] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:54.364270 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:54.357700 14916 leader_election.cc:290] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:54.366166 14842 raft_consensus.cc:493] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:54.373032 11277 catalog_manager.cc:5697] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 11 to 12, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131). New cstate: current_term: 12 leader_uuid: "a03223e9e41247c3a36b7b7c3d476671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:54.378322 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b977efa036417c9a75e3b30b19c72a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:54.378932 11454 raft_consensus.cc:3060] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:54.381150 11275 catalog_manager.cc:5697] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 9 to 10, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 10 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:54.366472 14780 leader_election.cc:290] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:54.346875 14924 raft_consensus.cc:515] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:54.376914 14907 leader_election.cc:290] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:54.386281 14924 leader_election.cc:290] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:54.347561 14915 raft_consensus.cc:515] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:54.391180 11454 raft_consensus.cc:2468] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 8.
I20260709 12:17:54.382772 14842 raft_consensus.cc:515] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:54.403683 14915 leader_election.cc:290] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:54.398164 11445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:54.399150 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7937e0cff84ef7a26c84247c8ffc08" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:54.408221 11445 raft_consensus.cc:2468] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 9.
I20260709 12:17:54.405586 14842 leader_election.cc:290] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:54.396059 14914 raft_consensus.cc:493] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:54.409463 14914 raft_consensus.cc:515] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:54.411808 14914 leader_election.cc:290] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:54.418097 11565 leader_election.cc:304] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: 
I20260709 12:17:54.425736 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
W20260709 12:17:54.426313 11493 leader_election.cc:336] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
W20260709 12:17:54.428020 11567 leader_election.cc:336] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:17:54.429039 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:54.428534 11567 leader_election.cc:304] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:54.433427 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
W20260709 12:17:54.438414 11493 leader_election.cc:336] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
W20260709 12:17:54.439155 11493 leader_election.cc:336] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:17:54.429039 14916 raft_consensus.cc:2804] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:54.439745 14916 raft_consensus.cc:697] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 8 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:54.440646 14916 consensus_queue.cc:237] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:54.449486 11491 leader_election.cc:304] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:54.452510 11491 leader_election.cc:304] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:54.454175 14914 raft_consensus.cc:2804] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:54.459205 14914 raft_consensus.cc:493] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:54.459578 14914 raft_consensus.cc:3060] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:54.460223 14780 raft_consensus.cc:2749] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:54.450560 14931 raft_consensus.cc:493] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:54.462080 14153 raft_consensus.cc:697] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:54.462891 14907 raft_consensus.cc:2749] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:54.480276 14153 consensus_queue.cc:237] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
W20260709 12:17:54.487077 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 59081us
I20260709 12:17:54.496822 11275 catalog_manager.cc:5697] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 11 to 12, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 12 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:54.481040 14931 raft_consensus.cc:515] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:54.500310 14931 leader_election.cc:290] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
W20260709 12:17:54.498360 11567 leader_election.cc:336] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:17:54.488441 11491 leader_election.cc:304] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:54.503782 14907 raft_consensus.cc:2749] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:54.537549 11526 raft_consensus.cc:1275] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:17:54.539513 14934 consensus_queue.cc:1048] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:17:54.540663 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7937e0cff84ef7a26c84247c8ffc08" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:54.541328 11451 raft_consensus.cc:2468] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 2.
W20260709 12:17:54.542235 11419 leader_election.cc:336] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:17:54.542676 11419 leader_election.cc:304] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
W20260709 12:17:54.543882 11419 leader_election.cc:336] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:17:54.544373 11419 leader_election.cc:304] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1c101e338f954ef086338e251deed19d; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:54.543665 14766 raft_consensus.cc:2749] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:54.545187 14925 raft_consensus.cc:2749] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:17:54.549531 11567 leader_election.cc:336] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:17:54.560698 11565 leader_election.cc:304] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: b126028166e8480ba25541bf8f7fc6de
W20260709 12:17:54.561553 11567 consensus_peers.cc:597] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:54.561908 14934 raft_consensus.cc:2804] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:54.562671 14934 raft_consensus.cc:493] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:54.563078 14934 raft_consensus.cc:3060] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:54.539994 14914 raft_consensus.cc:515] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:54.576768 11275 catalog_manager.cc:5697] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 9 to 10, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 10 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:54.588644 14907 raft_consensus.cc:493] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:54.589221 14907 raft_consensus.cc:515] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:54.591444 14914 leader_election.cc:290] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:54.594110 14925 raft_consensus.cc:493] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:54.594755 14925 raft_consensus.cc:515] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:54.597172 14925 leader_election.cc:290] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:54.598656 11275 catalog_manager.cc:5697] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 7 to 8, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 8 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:54.601119 11493 leader_election.cc:336] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:17:54.591354 14907 leader_election.cc:290] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
W20260709 12:17:54.606392 11419 leader_election.cc:336] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
W20260709 12:17:54.606771 11493 leader_election.cc:336] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:17:54.606541 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:54.607484 11523 raft_consensus.cc:2468] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 9.
I20260709 12:17:54.608630 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc18a67cc3d24753b2677d72cfee35b4" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:54.603077 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:54.609282 11454 raft_consensus.cc:3060] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:54.613595 11418 leader_election.cc:304] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:54.614593 14925 raft_consensus.cc:2804] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:54.614993 14925 raft_consensus.cc:493] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:54.615361 14925 raft_consensus.cc:3060] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:54.587884 14934 raft_consensus.cc:515] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:54.623410 14925 raft_consensus.cc:515] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:54.617111 11491 leader_election.cc:304] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:54.625844 14907 raft_consensus.cc:2749] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:17:54.627012 11567 leader_election.cc:336] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:17:54.632462 14907 raft_consensus.cc:493] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:54.633112 14907 raft_consensus.cc:515] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:54.634229 14925 leader_election.cc:290] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:54.635300 14907 leader_election.cc:290] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:54.635430 14908 raft_consensus.cc:493] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:54.636029 14908 raft_consensus.cc:515] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:54.638341 14908 leader_election.cc:290] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:54.639474 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:17:54.641139 11419 leader_election.cc:336] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:17:54.642660 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:54.643991 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876bdec904324677a10f21ffbc21f5e3" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:54.644272 11598 raft_consensus.cc:2468] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 7.
I20260709 12:17:54.644709 11523 raft_consensus.cc:3060] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:54.617223 11454 raft_consensus.cc:2468] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 10.
I20260709 12:17:54.648104 11491 leader_election.cc:304] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:54.651023 11491 leader_election.cc:304] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:54.651746 14842 raft_consensus.cc:2804] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:54.652237 14842 raft_consensus.cc:493] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:54.652643 14842 raft_consensus.cc:3060] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:54.652251 14934 leader_election.cc:290] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:54.658058 14933 raft_consensus.cc:2804] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:54.658694 14933 raft_consensus.cc:697] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 10 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:54.659647 14933 consensus_queue.cc:237] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:54.664053 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7937e0cff84ef7a26c84247c8ffc08" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:54.663038 14938 raft_consensus.cc:493] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
W20260709 12:17:54.666632 11493 leader_election.cc:336] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:17:54.668008 14938 raft_consensus.cc:515] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:54.667886 11454 raft_consensus.cc:3060] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:54.669111 14842 raft_consensus.cc:515] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:54.668437 11493 leader_election.cc:304] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 9da53be18b0f446aaa406216e20b0ec8, b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:54.671312 14842 leader_election.cc:290] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:54.671871 14914 raft_consensus.cc:2749] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:17:54.671468 11493 leader_election.cc:336] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:17:54.673532 11451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d" is_pre_election: true
I20260709 12:17:54.674175 11451 raft_consensus.cc:2468] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 8.
I20260709 12:17:54.674192 11593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "381fa277bb844a948c90100e03a4059a" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:54.675470 11593 raft_consensus.cc:3060] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:54.680079 14766 raft_consensus.cc:493] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:54.681074 14766 raft_consensus.cc:515] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:54.679795 11491 leader_election.cc:304] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:54.684211 14766 leader_election.cc:290] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:54.686667 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:54.687388 11526 raft_consensus.cc:2468] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 11.
I20260709 12:17:54.689051 11418 leader_election.cc:304] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:54.689580 14914 raft_consensus.cc:2804] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:54.690083 14914 raft_consensus.cc:493] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:54.670320 14938 leader_election.cc:290] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:54.690999 14915 raft_consensus.cc:2804] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:54.697203 14153 raft_consensus.cc:493] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:54.697950 14915 raft_consensus.cc:493] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 11 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
W20260709 12:17:54.692476 11419 leader_election.cc:336] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:17:54.698402 14915 raft_consensus.cc:3060] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:54.698442 14153 raft_consensus.cc:515] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:54.697749 14914 raft_consensus.cc:3060] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:54.702005 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:54.664862 11523 raft_consensus.cc:2468] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 10.
I20260709 12:17:54.702632 11526 raft_consensus.cc:2468] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 11.
I20260709 12:17:54.703308 14153 leader_election.cc:290] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
W20260709 12:17:54.705397  3922 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 12401)
W20260709 12:17:54.707430 11567 leader_election.cc:336] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:17:54.717227 11566 leader_election.cc:304] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:54.717900 11418 leader_election.cc:304] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:54.718287 14934 raft_consensus.cc:2804] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:54.718748 14925 raft_consensus.cc:2804] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:54.718804 14934 raft_consensus.cc:493] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:54.719609 14925 raft_consensus.cc:697] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 10 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:54.719527 14934 raft_consensus.cc:3060] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:54.720958 14925 consensus_queue.cc:237] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:54.726933 11593 raft_consensus.cc:2468] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 8.
I20260709 12:17:54.728349 11275 catalog_manager.cc:5697] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 9 to 10, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131). New cstate: current_term: 10 leader_uuid: "a03223e9e41247c3a36b7b7c3d476671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:54.736135 14915 raft_consensus.cc:515] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:54.748126 11491 leader_election.cc:304] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:54.751941 11277 catalog_manager.cc:5697] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 9 to 10, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 10 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:54.753815 14842 raft_consensus.cc:2804] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:54.754451 14842 raft_consensus.cc:697] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 8 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:54.755309 14842 consensus_queue.cc:237] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:54.758119 14932 raft_consensus.cc:493] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:54.758745 14932 raft_consensus.cc:515] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:54.760979 14932 leader_election.cc:290] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:54.762578 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
W20260709 12:17:54.769153 11493 leader_election.cc:336] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
W20260709 12:17:54.770150 11493 leader_election.cc:336] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:17:54.783263 11454 raft_consensus.cc:2468] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 3.
I20260709 12:17:54.786892 11526 raft_consensus.cc:1275] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:17:54.787941 14934 raft_consensus.cc:515] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:54.805801 14934 leader_election.cc:290] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 12 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:54.799242 14914 raft_consensus.cc:515] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:17:54.808066 14925 consensus_queue.cc:1048] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:17:54.803565 11493 consensus_peers.cc:597] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:54.795326 11419 consensus_peers.cc:597] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:54.806510 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "987e6a4207394b2f80be7c7d03b696bf" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:54.810084 11565 leader_election.cc:304] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:54.811771 14934 raft_consensus.cc:2804] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:54.812315 14934 raft_consensus.cc:697] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:54.813764 14934 consensus_queue.cc:237] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:17:54.810086 11526 raft_consensus.cc:3060] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:54.808564 14914 leader_election.cc:290] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:17:54.820629 11454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88412eb571b84fdc8d521a981be63bfa" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1c101e338f954ef086338e251deed19d"
I20260709 12:17:54.826370 11454 raft_consensus.cc:3060] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:54.823089 11275 catalog_manager.cc:5697] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 7 to 8, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131). New cstate: current_term: 8 leader_uuid: "a03223e9e41247c3a36b7b7c3d476671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:54.837930 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1589b98714c45ef8ed01287d13b8252" candidate_uuid: "1c101e338f954ef086338e251deed19d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:54.838827 11527 raft_consensus.cc:3060] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:17:54.838910 11419 leader_election.cc:336] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
W20260709 12:17:54.847584 11493 leader_election.cc:336] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:17:54.863750 11520 raft_consensus.cc:1275] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 12 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:17:54.865732 14912 consensus_queue.cc:1048] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:17:54.837169 14915 leader_election.cc:290] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 12 election: Requested vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:17:54.873207 11527 raft_consensus.cc:2468] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c101e338f954ef086338e251deed19d in term 12.
W20260709 12:17:54.877164 11419 consensus_peers.cc:597] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:54.877197 14933 raft_consensus.cc:493] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:54.877929 14933 raft_consensus.cc:515] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:54.880056 14933 leader_election.cc:290] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:54.881848 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:17:54.882575 11598 raft_consensus.cc:2468] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 10.
I20260709 12:17:54.883870 11491 leader_election.cc:304] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:54.876533 11526 raft_consensus.cc:2468] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 12.
I20260709 12:17:54.884720 14914 raft_consensus.cc:2804] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:54.885169 14914 raft_consensus.cc:493] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:54.885632 14914 raft_consensus.cc:3060] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:54.891451 11450 raft_consensus.cc:1275] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 12 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:17:54.896803 11566 leader_election.cc:304] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:54.899144 14937 raft_consensus.cc:2804] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:17:54.899739 14937 raft_consensus.cc:697] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 12 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:54.900635 14937 consensus_queue.cc:237] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:54.905586 14933 consensus_queue.cc:1048] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:17:54.911079 11418 leader_election.cc:304] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:54.913215 14912 raft_consensus.cc:2804] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:17:54.917014 14912 raft_consensus.cc:697] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 12 LEADER]: Becoming Leader. State: Replica: 1c101e338f954ef086338e251deed19d, State: Running, Role: LEADER
I20260709 12:17:54.917956 14912 consensus_queue.cc:237] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
W20260709 12:17:54.920197 11493 leader_election.cc:336] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:17:54.921104 11454 raft_consensus.cc:2468] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 9.
I20260709 12:17:54.926508 11277 catalog_manager.cc:5697] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 2 to 3, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 3 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:54.931018 11491 leader_election.cc:304] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:54.932096 14937 raft_consensus.cc:493] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:54.948721 14908 raft_consensus.cc:2804] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:54.962946 14937 raft_consensus.cc:515] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:55.011579 14937 leader_election.cc:290] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:55.009938 14914 raft_consensus.cc:515] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:55.015116 14914 leader_election.cc:290] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 11 election: Requested vote from peers 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
W20260709 12:17:55.056774 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 77665.2us
W20260709 12:17:55.067261 11567 leader_election.cc:336] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:17:55.084266 11567 leader_election.cc:304] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: a03223e9e41247c3a36b7b7c3d476671, b126028166e8480ba25541bf8f7fc6de
W20260709 12:17:55.087577 11567 leader_election.cc:336] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:17:55.073589 14908 raft_consensus.cc:697] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 9 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:55.091327 14908 consensus_queue.cc:237] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
W20260709 12:17:55.108706 11493 leader_election.cc:336] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:17:55.111383 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:17:55.112776 11527 raft_consensus.cc:2468] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 9.
I20260709 12:17:55.114705 14780 raft_consensus.cc:2749] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:55.118549 11519 raft_consensus.cc:1275] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 12:17:55.132444 11493 consensus_peers.cc:597] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:55.133193 11493 consensus_peers.cc:597] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:17:55.133992 11598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b52025153e440eebdadbe35d49837ff" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:17:55.135231 11598 raft_consensus.cc:3060] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:55.149691 11566 leader_election.cc:304] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
W20260709 12:17:55.167943 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 80517.1us
I20260709 12:17:55.173080 11593 raft_consensus.cc:1275] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:17:55.174392 14953 raft_consensus.cc:2804] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:55.175148 14953 raft_consensus.cc:493] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b126028166e8480ba25541bf8f7fc6de)
I20260709 12:17:55.175678 14953 raft_consensus.cc:3060] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:17:55.174398 11493 consensus_peers.cc:597] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:55.178572 11493 consensus_peers.cc:597] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:55.194725 11451 raft_consensus.cc:1275] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:17:55.213115 11274 catalog_manager.cc:5697] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d reported cstate change: term changed from 11 to 12, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to 1c101e338f954ef086338e251deed19d (127.3.212.130). New cstate: current_term: 12 leader_uuid: "1c101e338f954ef086338e251deed19d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:55.218326 11493 consensus_peers.cc:597] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:55.217831 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 44045.5us
I20260709 12:17:55.220016 11277 catalog_manager.cc:5697] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 11 to 12, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 12 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:55.245124 14938 consensus_queue.cc:1048] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:55.253737 14953 raft_consensus.cc:515] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
I20260709 12:17:55.256822 14953 leader_election.cc:290] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 election: Requested vote from peers a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:17:55.232641 11598 raft_consensus.cc:2468] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 11.
I20260709 12:17:55.285987 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b179748933846ae9a419549cdfb997a" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:17:55.286708 11527 raft_consensus.cc:3060] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:17:55.292050 11493 consensus_peers.cc:597] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:55.298167 11567 consensus_peers.cc:597] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:55.298844 11527 raft_consensus.cc:2468] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 10.
I20260709 12:17:55.300697 11566 leader_election.cc:304] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:17:55.299073 11491 leader_election.cc:304] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: b126028166e8480ba25541bf8f7fc6de
I20260709 12:17:55.312835 11450 raft_consensus.cc:1275] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:17:55.313057 14937 raft_consensus.cc:2804] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:55.313057 11454 raft_consensus.cc:1275] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:17:55.313856 14937 raft_consensus.cc:697] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 10 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:17:55.315019 14937 consensus_queue.cc:237] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
W20260709 12:17:55.328009 11418 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:36063, user_credentials={real_user=slave}} blocked reactor thread for 148955us
I20260709 12:17:55.338757 14926 consensus_queue.cc:1048] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:55.356457 14908 raft_consensus.cc:2804] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:55.357515 14908 raft_consensus.cc:697] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 11 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:17:55.358654 14908 consensus_queue.cc:237] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } }
W20260709 12:17:55.355049 11567 consensus_peers.cc:597] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:55.365944 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 67284.1us
W20260709 12:17:55.377067 11491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.132:34973, user_credentials={real_user=slave}} blocked reactor thread for 80353.2us
W20260709 12:17:55.408381 11493 consensus_peers.cc:597] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:17:55.408543 14914 consensus_queue.cc:1048] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:55.410609 14916 consensus_queue.cc:1048] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:17:55.412626 14932 consensus_queue.cc:1048] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:55.418134 11277 catalog_manager.cc:5697] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 8 to 9, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131). New cstate: current_term: 9 leader_uuid: "a03223e9e41247c3a36b7b7c3d476671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } }
W20260709 12:17:55.403261 11567 leader_election.cc:336] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:17:55.431480 11274 catalog_manager.cc:5697] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 9 to 10, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 10 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:55.448192 11493 consensus_peers.cc:597] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:55.450068 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 46833.1us
W20260709 12:17:55.453701 11493 consensus_peers.cc:597] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:55.463014 11493 consensus_peers.cc:597] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:55.463469 11567 consensus_peers.cc:597] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:55.485519 11419 consensus_peers.cc:597] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:55.486364 11419 consensus_peers.cc:597] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:55.477602 11567 leader_election.cc:336] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:17:55.491000 11277 catalog_manager.cc:5697] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 reported cstate change: term changed from 10 to 11, leader changed from b126028166e8480ba25541bf8f7fc6de (127.3.212.129) to a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131). New cstate: current_term: 11 leader_uuid: "a03223e9e41247c3a36b7b7c3d476671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:55.503545 11493 consensus_peers.cc:597] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:17:55.521780 11520 raft_consensus.cc:1275] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 12 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 12:17:55.523662 11493 consensus_peers.cc:597] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:55.524132 14916 consensus_queue.cc:1048] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:55.534489 11451 raft_consensus.cc:1275] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:17:55.541330 11419 consensus_peers.cc:597] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:55.541893 11419 consensus_peers.cc:597] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:55.542243 11419 consensus_peers.cc:597] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:55.543849 11567 consensus_peers.cc:597] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:55.547552 11419 consensus_peers.cc:597] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:55.548457 11419 consensus_peers.cc:597] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:55.544428 11567 consensus_peers.cc:597] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:55.553926 11567 consensus_peers.cc:597] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:55.554512 11567 consensus_peers.cc:597] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:55.554951 11567 consensus_peers.cc:597] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:17:55.558581 14934 consensus_queue.cc:1048] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:17:55.600581 11419 consensus_peers.cc:597] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:55.609359 11567 consensus_peers.cc:597] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:55.611229 11419 consensus_peers.cc:597] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:55.615878 11419 consensus_peers.cc:597] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:55.619328 11419 consensus_peers.cc:597] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:17:55.615248 11526 raft_consensus.cc:1275] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 12 FOLLOWER]: Refusing update from remote peer 1c101e338f954ef086338e251deed19d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:17:55.630682 14925 consensus_queue.cc:1048] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:17:55.642510 11567 consensus_peers.cc:597] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:55.654836 11567 consensus_peers.cc:597] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:55.680562 11419 consensus_peers.cc:597] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:55.702011 11493 consensus_peers.cc:597] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:55.708554 11567 consensus_peers.cc:597] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:55.719596  3922 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 12401)
W20260709 12:17:55.743594 11419 consensus_peers.cc:597] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:55.760522 11450 raft_consensus.cc:1275] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:55.769961 14914 consensus_queue.cc:1048] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:17:55.775214 11493 consensus_peers.cc:597] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:55.798666 11567 consensus_peers.cc:597] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:55.875779 11567 consensus_peers.cc:597] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:55.919548 11526 raft_consensus.cc:1275] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Refusing update from remote peer 9da53be18b0f446aaa406216e20b0ec8: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:17:55.922015 14931 consensus_queue.cc:1048] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:55.939714 11600 raft_consensus.cc:1275] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 11 FOLLOWER]: Refusing update from remote peer a03223e9e41247c3a36b7b7c3d476671: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:17:55.942435 14842 consensus_queue.cc:1048] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:17:56.720165  3922 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 12401)
W20260709 12:17:57.057686 11567 consensus_peers.cc:597] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:57.247534 11493 consensus_peers.cc:597] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:57.453403 11493 consensus_peers.cc:597] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:57.559895 11567 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111) [suppressed 409 similar messages]
W20260709 12:17:57.563127 11493 consensus_peers.cc:597] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:57.582569 11567 consensus_peers.cc:597] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:57.605068 11419 consensus_peers.cc:597] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:57.607661 11419 consensus_peers.cc:597] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:57.615898 11419 consensus_peers.cc:597] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:57.631821 11419 consensus_peers.cc:597] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:57.649855 11493 consensus_peers.cc:597] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:57.691030 11567 consensus_peers.cc:597] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:57.720722  3922 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 12401)
W20260709 12:17:57.725075 11567 consensus_peers.cc:597] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:57.734529 11567 consensus_peers.cc:597] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:57.752496 11419 consensus_peers.cc:597] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:57.764519 11493 consensus_peers.cc:597] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:57.788075 11567 consensus_peers.cc:597] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:57.800104 11419 consensus_peers.cc:597] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:57.825280 11419 consensus_peers.cc:597] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:57.848389 11493 consensus_peers.cc:597] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:57.887930 11493 consensus_peers.cc:597] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:57.892542 11419 consensus_peers.cc:597] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:57.907706 11567 consensus_peers.cc:597] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:57.918226 11419 consensus_peers.cc:597] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:57.934696 11493 consensus_peers.cc:597] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:57.953595 11567 consensus_peers.cc:597] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:57.969944 11567 consensus_peers.cc:597] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:57.978506 11419 consensus_peers.cc:597] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:57.997608 11493 consensus_peers.cc:597] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:58.042151 11493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 44590.7us
W20260709 12:17:58.039283 11419 consensus_peers.cc:597] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:58.020470 11567 consensus_peers.cc:597] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:58.064462 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 44049.1us
W20260709 12:17:58.120723 11567 consensus_peers.cc:597] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:58.122484 11493 consensus_peers.cc:597] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:58.137835 11493 consensus_peers.cc:597] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:58.145998 11567 consensus_peers.cc:597] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:58.219635 11493 consensus_peers.cc:597] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:58.225841 11493 consensus_peers.cc:597] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:58.225014 11419 consensus_peers.cc:597] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:58.250991 11567 consensus_peers.cc:597] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:58.259752 11493 consensus_peers.cc:597] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:58.265925 11419 consensus_peers.cc:597] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:58.294641 11493 consensus_peers.cc:597] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:58.315047 11419 consensus_peers.cc:597] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:17:58.373685 11567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37935, user_credentials={real_user=slave}} blocked reactor thread for 51419.9us
W20260709 12:17:58.397265 11419 consensus_peers.cc:597] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:58.456944 11567 consensus_peers.cc:597] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:58.494900 11567 consensus_peers.cc:597] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:58.723492  3922 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 12401)
W20260709 12:17:59.208925 11567 consensus_peers.cc:597] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:59.724045  3922 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 12401)
W20260709 12:17:59.741825 11567 consensus_peers.cc:597] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:59.830612 11493 consensus_peers.cc:597] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:17:59.961781 11567 consensus_peers.cc:597] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:18:00.008383 11419 consensus_peers.cc:597] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:18:00.105538 11419 consensus_peers.cc:597] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:18:00.125221 11567 consensus_peers.cc:597] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:18:00.128634 11419 consensus_peers.cc:597] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:18:00.129320 11419 consensus_peers.cc:597] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:18:00.204136 11419 consensus_peers.cc:597] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:18:00.223186 11419 consensus_peers.cc:597] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:18:00.255380 11567 consensus_peers.cc:597] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:18:00.275796 11567 consensus_peers.cc:597] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:18:00.469050 11419 consensus_peers.cc:597] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:18:00.478520 11567 consensus_peers.cc:597] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:18:00.507026 11567 consensus_peers.cc:597] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:18:00.517690 11419 consensus_peers.cc:597] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:18:00.529579 11419 consensus_peers.cc:597] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:18:00.565625 11567 consensus_peers.cc:597] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:18:00.569003 11567 consensus_peers.cc:597] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:18:00.595935 11419 consensus_peers.cc:597] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:18:00.725193  3922 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 12401)
W20260709 12:18:00.730151 11419 consensus_peers.cc:597] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:18:00.772081 11419 consensus_peers.cc:597] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:18:00.772493 11419 consensus_peers.cc:597] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:18:00.778903 11567 consensus_peers.cc:597] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:18:00.794457 11567 consensus_peers.cc:597] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:18:00.844183 11419 consensus_peers.cc:597] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:18:00.905993 11567 consensus_peers.cc:597] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:18:00.919189 11493 consensus_peers.cc:597] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:18:00.928424 11493 consensus_peers.cc:597] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:18:00.930109 11493 consensus_peers.cc:597] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:18:00.930907 11493 consensus_peers.cc:597] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:18:00.927960 11419 consensus_peers.cc:597] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:18:00.961136 11567 consensus_peers.cc:597] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:18:01.025964 11493 consensus_peers.cc:597] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:18:01.035113 11493 consensus_peers.cc:597] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:18:01.041587 11493 consensus_peers.cc:597] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:18:01.075064 11493 consensus_peers.cc:597] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:18:01.181650 11567 consensus_peers.cc:597] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:18:01.188866 11493 consensus_peers.cc:597] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:18:01.224666 11493 consensus_peers.cc:597] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:18:01.234395  3922 tablet_server.cc:196] TabletServer@127.3.212.129:37935 shutdown complete.
W20260709 12:18:01.316583 11493 consensus_peers.cc:597] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:18:01.375118  3922 tablet_server.cc:179] TabletServer@127.3.212.130:0 shutting down...
W20260709 12:18:01.379783 11491 consensus_peers.cc:597] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 -> Peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Couldn't send request to peer 1c101e338f954ef086338e251deed19d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:01.387192 11565 consensus_peers.cc:597] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Couldn't send request to peer 1c101e338f954ef086338e251deed19d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:01.390450 11493 consensus_peers.cc:597] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:18:01.414564 11493 consensus_peers.cc:597] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:18:01.415244 11565 consensus_peers.cc:597] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Couldn't send request to peer 1c101e338f954ef086338e251deed19d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:01.422391 11565 consensus_peers.cc:597] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 -> Peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Couldn't send request to peer 1c101e338f954ef086338e251deed19d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:01.423514 11491 consensus_peers.cc:597] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 -> Peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Couldn't send request to peer 1c101e338f954ef086338e251deed19d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:01.426074 11493 consensus_peers.cc:597] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:18:01.442063 11491 consensus_peers.cc:597] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 -> Peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Couldn't send request to peer 1c101e338f954ef086338e251deed19d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:01.457078 11565 consensus_peers.cc:597] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Couldn't send request to peer 1c101e338f954ef086338e251deed19d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:01.460868  3922 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:18:01.463667  3922 tablet_replica.cc:333] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d: stopping tablet replica
I20260709 12:18:01.464824  3922 raft_consensus.cc:2243] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:01.465583  3922 raft_consensus.cc:2272] T 2aaa267a7b85487a991ce0600309cac0 P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:01.468609  3922 tablet_replica.cc:333] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d: stopping tablet replica
W20260709 12:18:01.468834 11491 consensus_peers.cc:597] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 -> Peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Couldn't send request to peer 1c101e338f954ef086338e251deed19d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:01.469302  3922 raft_consensus.cc:2243] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:18:01.470235  3922 raft_consensus.cc:2272] T 2ec97657dc1d40eeb0b7a225b412300f P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:01.472543  3922 tablet_replica.cc:333] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d: stopping tablet replica
I20260709 12:18:01.473220  3922 raft_consensus.cc:2243] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:01.473814  3922 raft_consensus.cc:2272] T cc18a67cc3d24753b2677d72cfee35b4 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:01.476269  3922 tablet_replica.cc:333] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d: stopping tablet replica
I20260709 12:18:01.477016  3922 raft_consensus.cc:2243] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:01.477675  3922 raft_consensus.cc:2272] T e7e4724ed93a467ea47763eec9a6de2e P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:01.480284  3922 tablet_replica.cc:333] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d: stopping tablet replica
I20260709 12:18:01.481230  3922 raft_consensus.cc:2243] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:18:01.482473  3922 raft_consensus.cc:2272] T 167448b175c040d180318f81f6d10c8d P 1c101e338f954ef086338e251deed19d [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:01.486196  3922 tablet_replica.cc:333] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d: stopping tablet replica
I20260709 12:18:01.487149  3922 raft_consensus.cc:2243] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:01.487946  3922 raft_consensus.cc:2272] T cdf8217c2b5b47f68e62de34bb95e95d P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:01.491240  3922 tablet_replica.cc:333] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d: stopping tablet replica
I20260709 12:18:01.492147  3922 raft_consensus.cc:2243] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:18:01.493271  3922 raft_consensus.cc:2272] T 193e9917816a4990998188f9a4e9d08c P 1c101e338f954ef086338e251deed19d [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:01.495949 11565 consensus_peers.cc:597] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 -> Peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Couldn't send request to peer 1c101e338f954ef086338e251deed19d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:01.496362  3922 tablet_replica.cc:333] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d: stopping tablet replica
I20260709 12:18:01.497233  3922 raft_consensus.cc:2243] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:18:01.498402  3922 raft_consensus.cc:2272] T a34e69406a86484482230bfec0edfcfa P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:01.501336  3922 tablet_replica.cc:333] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d: stopping tablet replica
I20260709 12:18:01.502192  3922 raft_consensus.cc:2243] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:01.502774  3922 raft_consensus.cc:2272] T da8741606df54c3f8b5cc5c1141862ea P 1c101e338f954ef086338e251deed19d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:01.505615  3922 tablet_replica.cc:333] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d: stopping tablet replica
I20260709 12:18:01.506443  3922 raft_consensus.cc:2243] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:18:01.507562  3922 raft_consensus.cc:2272] T 2d78aaa911094df3ac90f175cd5c58fb P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:01.510422  3922 tablet_replica.cc:333] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d: stopping tablet replica
I20260709 12:18:01.511309  3922 raft_consensus.cc:2243] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:18:01.512373  3922 raft_consensus.cc:2272] T f1589b98714c45ef8ed01287d13b8252 P 1c101e338f954ef086338e251deed19d [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:01.515235  3922 tablet_replica.cc:333] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d: stopping tablet replica
I20260709 12:18:01.516177  3922 raft_consensus.cc:2243] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:18:01.517246  3922 raft_consensus.cc:2272] T 876bdec904324677a10f21ffbc21f5e3 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:01.519973  3922 tablet_replica.cc:333] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d: stopping tablet replica
I20260709 12:18:01.520732  3922 raft_consensus.cc:2243] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:01.521442  3922 raft_consensus.cc:2272] T 281f1a743bd44c27af6ace022a8a3ad1 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:01.524408  3922 tablet_replica.cc:333] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d: stopping tablet replica
I20260709 12:18:01.526825  3922 raft_consensus.cc:2243] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:18:01.528103  3922 raft_consensus.cc:2272] T 4d8592bdb30445228c429e3c55360c25 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:01.531459  3922 tablet_replica.cc:333] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d: stopping tablet replica
I20260709 12:18:01.532330  3922 raft_consensus.cc:2243] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:18:01.533603  3922 raft_consensus.cc:2272] T e916ed5651f842f99af4ebb1748cd1bb P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:01.536754  3922 tablet_replica.cc:333] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d: stopping tablet replica
I20260709 12:18:01.537617  3922 raft_consensus.cc:2243] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:01.538367  3922 raft_consensus.cc:2272] T 50204b9643974af9a0505210d261ee78 P 1c101e338f954ef086338e251deed19d [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:01.541675  3922 tablet_replica.cc:333] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d: stopping tablet replica
I20260709 12:18:01.542469  3922 raft_consensus.cc:2243] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:18:01.543674  3922 raft_consensus.cc:2272] T 390e91331fd04f97a5235133a34875ee P 1c101e338f954ef086338e251deed19d [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:01.546710  3922 tablet_replica.cc:333] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d: stopping tablet replica
I20260709 12:18:01.547598  3922 raft_consensus.cc:2243] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:18:01.548764  3922 raft_consensus.cc:2272] T a690fb2f9e0548988bfefbe6ed3ab694 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:01.551712  3922 tablet_replica.cc:333] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d: stopping tablet replica
I20260709 12:18:01.552556  3922 raft_consensus.cc:2243] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:01.553197  3922 raft_consensus.cc:2272] T ba25a071498548cdba1aaf992fa805e8 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:01.556185  3922 tablet_replica.cc:333] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d: stopping tablet replica
I20260709 12:18:01.557005  3922 raft_consensus.cc:2243] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 10 LEADER]: Raft consensus shutting down.
W20260709 12:18:01.557420 11567 consensus_peers.cc:597] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:18:01.558100  3922 raft_consensus.cc:2272] T 49b270aad1134eb894de5aa7cc60f3a8 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:01.561089  3922 tablet_replica.cc:333] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d: stopping tablet replica
I20260709 12:18:01.562021  3922 raft_consensus.cc:2243] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:01.562759  3922 raft_consensus.cc:2272] T a5e58472d98540b986b1ed39edf597d4 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:01.565738  3922 tablet_replica.cc:333] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d: stopping tablet replica
I20260709 12:18:01.566636  3922 raft_consensus.cc:2243] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:01.568245  3922 raft_consensus.cc:2272] T e3b977efa036417c9a75e3b30b19c72a P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:01.571259  3922 tablet_replica.cc:333] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d: stopping tablet replica
I20260709 12:18:01.572166  3922 raft_consensus.cc:2243] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:01.572945  3922 raft_consensus.cc:2272] T 74b107ce07924505acbedf93698833e7 P 1c101e338f954ef086338e251deed19d [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:01.576010  3922 tablet_replica.cc:333] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d: stopping tablet replica
I20260709 12:18:01.577121  3922 raft_consensus.cc:2243] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:18:01.578648  3922 raft_consensus.cc:2272] T c67c223a5ec948b4bf18874bf0d591b5 P 1c101e338f954ef086338e251deed19d [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:01.582224  3922 tablet_replica.cc:333] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d: stopping tablet replica
W20260709 12:18:01.582789 11491 consensus_peers.cc:597] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 -> Peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Couldn't send request to peer 1c101e338f954ef086338e251deed19d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:01.583122  3922 raft_consensus.cc:2243] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:18:01.584509  3922 raft_consensus.cc:2272] T a215788da7ae4b548e5c307a6b294109 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:01.586431 11491 consensus_peers.cc:597] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 -> Peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Couldn't send request to peer 1c101e338f954ef086338e251deed19d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:01.587601  3922 tablet_replica.cc:333] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d: stopping tablet replica
I20260709 12:18:01.588555  3922 raft_consensus.cc:2243] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Raft consensus shutting down.
W20260709 12:18:01.588943 11565 consensus_peers.cc:597] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 -> Peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Couldn't send request to peer 1c101e338f954ef086338e251deed19d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:01.589229  3922 raft_consensus.cc:2272] T 2ff9fe9a94294836aec652338f44367d P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:01.589689 11491 consensus_peers.cc:597] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 -> Peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Couldn't send request to peer 1c101e338f954ef086338e251deed19d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:01.592263  3922 tablet_replica.cc:333] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d: stopping tablet replica
I20260709 12:18:01.593210  3922 raft_consensus.cc:2243] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:18:01.594318  3922 raft_consensus.cc:2272] T f8e9a700accc4fff8304eec59a498721 P 1c101e338f954ef086338e251deed19d [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:01.597234  3922 tablet_replica.cc:333] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d: stopping tablet replica
I20260709 12:18:01.598119  3922 raft_consensus.cc:2243] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:01.598794  3922 raft_consensus.cc:2272] T e7458151705b45928221728d170b4024 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:01.599598 11491 consensus_peers.cc:597] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 -> Peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Couldn't send request to peer 1c101e338f954ef086338e251deed19d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:01.601481  3922 tablet_replica.cc:333] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d: stopping tablet replica
I20260709 12:18:01.602360  3922 raft_consensus.cc:2243] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:01.602957  3922 raft_consensus.cc:2272] T 0b15621d7be54f2489041bbe8258bb79 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:01.605949  3922 tablet_replica.cc:333] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d: stopping tablet replica
I20260709 12:18:01.606724  3922 raft_consensus.cc:2243] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:18:01.607774  3922 raft_consensus.cc:2272] T a841f2f09ced40a4bbf33594e11bd7ad P 1c101e338f954ef086338e251deed19d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:01.610607  3922 tablet_replica.cc:333] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d: stopping tablet replica
I20260709 12:18:01.611394  3922 raft_consensus.cc:2243] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:01.612007  3922 raft_consensus.cc:2272] T cb7937e0cff84ef7a26c84247c8ffc08 P 1c101e338f954ef086338e251deed19d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:01.614753  3922 tablet_replica.cc:333] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d: stopping tablet replica
I20260709 12:18:01.615589  3922 raft_consensus.cc:2243] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:18:01.616767  3922 raft_consensus.cc:2272] T 6480ef79a4dc499b94fdb7081ff36fdd P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:01.620311  3922 tablet_replica.cc:333] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d: stopping tablet replica
I20260709 12:18:01.621173  3922 raft_consensus.cc:2243] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:01.621902  3922 raft_consensus.cc:2272] T 985a868591ad444faeace7fc051862cd P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:01.624738 11565 consensus_peers.cc:597] T da8741606df54c3f8b5cc5c1141862ea P 9da53be18b0f446aaa406216e20b0ec8 -> Peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Couldn't send request to peer 1c101e338f954ef086338e251deed19d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:01.624970  3922 tablet_replica.cc:333] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d: stopping tablet replica
I20260709 12:18:01.625891  3922 raft_consensus.cc:2243] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:18:01.626991  3922 raft_consensus.cc:2272] T 3205ea0248f74fa5ba9de670d91b9568 P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:01.629798  3922 tablet_replica.cc:333] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d: stopping tablet replica
I20260709 12:18:01.630638  3922 raft_consensus.cc:2243] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:01.631338  3922 raft_consensus.cc:2272] T 1d2554b9de634e0daa5c0257a1821025 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:01.634127  3922 tablet_replica.cc:333] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d: stopping tablet replica
I20260709 12:18:01.634895  3922 raft_consensus.cc:2243] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:01.635524  3922 raft_consensus.cc:2272] T 5ffe47647c274723808482c166efa21c P 1c101e338f954ef086338e251deed19d [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:01.638334  3922 tablet_replica.cc:333] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d: stopping tablet replica
I20260709 12:18:01.639061  3922 raft_consensus.cc:2243] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:01.639638  3922 raft_consensus.cc:2272] T 183ead47e21645c289d90fbfe75fd319 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:01.642431  3922 tablet_replica.cc:333] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d: stopping tablet replica
I20260709 12:18:01.643203  3922 raft_consensus.cc:2243] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:01.643791  3922 raft_consensus.cc:2272] T 773ed4105356479c90eb937ef6da81a5 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:01.646566  3922 tablet_replica.cc:333] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d: stopping tablet replica
I20260709 12:18:01.647324  3922 raft_consensus.cc:2243] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:01.647930  3922 raft_consensus.cc:2272] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 1c101e338f954ef086338e251deed19d [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:01.651037  3922 tablet_replica.cc:333] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d: stopping tablet replica
I20260709 12:18:01.651844  3922 raft_consensus.cc:2243] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:01.652560  3922 raft_consensus.cc:2272] T ef13d597f7a84434a1bbdc95857e6215 P 1c101e338f954ef086338e251deed19d [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:01.655282  3922 tablet_replica.cc:333] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d: stopping tablet replica
I20260709 12:18:01.656013  3922 raft_consensus.cc:2243] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:01.656594  3922 raft_consensus.cc:2272] T 88412eb571b84fdc8d521a981be63bfa P 1c101e338f954ef086338e251deed19d [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:01.659665  3922 tablet_replica.cc:333] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d: stopping tablet replica
I20260709 12:18:01.660517  3922 raft_consensus.cc:2243] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:01.661113  3922 raft_consensus.cc:2272] T 85a1c543b632476b909b2a5fb50e9f78 P 1c101e338f954ef086338e251deed19d [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:01.662223 11491 consensus_peers.cc:597] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 -> Peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Couldn't send request to peer 1c101e338f954ef086338e251deed19d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:01.663941  3922 tablet_replica.cc:333] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d: stopping tablet replica
I20260709 12:18:01.664719  3922 raft_consensus.cc:2243] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:01.665261  3922 raft_consensus.cc:2272] T e896afa1887146dfade142338e2fc407 P 1c101e338f954ef086338e251deed19d [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:01.668130  3922 tablet_replica.cc:333] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d: stopping tablet replica
I20260709 12:18:01.668752  3922 raft_consensus.cc:2243] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:18:01.669963  3922 raft_consensus.cc:2272] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 1c101e338f954ef086338e251deed19d [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:01.718088 11565 consensus_peers.cc:597] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Couldn't send request to peer 1c101e338f954ef086338e251deed19d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:01.744663 11565 consensus_peers.cc:597] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 -> Peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Couldn't send request to peer 1c101e338f954ef086338e251deed19d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:01.781929 11565 consensus_peers.cc:597] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Couldn't send request to peer 1c101e338f954ef086338e251deed19d. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:41579: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:01.785085 11565 consensus_peers.cc:597] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Couldn't send request to peer 1c101e338f954ef086338e251deed19d. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:41579: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:01.802523 11565 consensus_peers.cc:597] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Couldn't send request to peer 1c101e338f954ef086338e251deed19d. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:41579: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:01.824083 11491 consensus_peers.cc:597] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 -> Peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Couldn't send request to peer 1c101e338f954ef086338e251deed19d. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:41579: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:01.865480 11565 consensus_peers.cc:597] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Couldn't send request to peer 1c101e338f954ef086338e251deed19d. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:41579: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:01.894547 11491 consensus_peers.cc:597] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 -> Peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Couldn't send request to peer 1c101e338f954ef086338e251deed19d. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:41579: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:01.924479 11491 consensus_peers.cc:597] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 -> Peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Couldn't send request to peer 1c101e338f954ef086338e251deed19d. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:41579: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:02.388550 11567 consensus_peers.cc:597] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:18:02.528467 14995 raft_consensus.cc:493] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:18:02.529050 14995 raft_consensus.cc:515] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:18:02.531388 14995 leader_election.cc:290] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
W20260709 12:18:02.537422 11493 leader_election.cc:336] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
W20260709 12:18:02.539403 11491 leader_election.cc:336] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Network error: Client connection negotiation failed: client connection to 127.3.212.130:41579: connect: Connection refused (error 111)
I20260709 12:18:02.539940 11491 leader_election.cc:304] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:18:02.541477 14995 raft_consensus.cc:2749] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:02.561080 15000 raft_consensus.cc:493] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:18:02.561749 15000 raft_consensus.cc:515] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
W20260709 12:18:02.563925 11493 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111) [suppressed 467 similar messages]
I20260709 12:18:02.564051 15000 leader_election.cc:290] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:18:02.567358 15006 raft_consensus.cc:493] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:18:02.567943 15006 raft_consensus.cc:515] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
W20260709 12:18:02.569602 11567 leader_election.cc:336] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:18:02.570361 15006 leader_election.cc:290] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
W20260709 12:18:02.575946 11565 leader_election.cc:336] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Network error: Client connection negotiation failed: client connection to 127.3.212.130:41579: connect: Connection refused (error 111)
I20260709 12:18:02.576190 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:18:02.576589 11565 leader_election.cc:304] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:18:02.577627 15000 raft_consensus.cc:2749] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:18:02.583760 11491 leader_election.cc:336] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Network error: Client connection negotiation failed: client connection to 127.3.212.130:41579: connect: Connection refused (error 111)
I20260709 12:18:02.584368 11491 leader_election.cc:304] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:18:02.585539 14995 raft_consensus.cc:2749] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:18:02.587052 11567 consensus_peers.cc:597] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:18:02.617261 15000 raft_consensus.cc:493] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:18:02.617825 15000 raft_consensus.cc:515] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:18:02.619587 15000 leader_election.cc:290] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
W20260709 12:18:02.623414 11565 leader_election.cc:336] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Network error: Client connection negotiation failed: client connection to 127.3.212.130:41579: connect: Connection refused (error 111)
W20260709 12:18:02.624040 11567 leader_election.cc:336] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:18:02.624469 11567 leader_election.cc:304] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:18:02.625624 15000 raft_consensus.cc:2749] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:02.626338 15000 raft_consensus.cc:493] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:18:02.626812 15000 raft_consensus.cc:515] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:18:02.628948 15000 leader_election.cc:290] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
W20260709 12:18:02.634840 11565 leader_election.cc:336] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Network error: Client connection negotiation failed: client connection to 127.3.212.130:41579: connect: Connection refused (error 111)
W20260709 12:18:02.635468 11567 leader_election.cc:336] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:18:02.635895 11567 leader_election.cc:304] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:18:02.636650 15000 raft_consensus.cc:2749] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:02.642233 15006 raft_consensus.cc:493] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:18:02.642747 15006 raft_consensus.cc:515] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:18:02.644613 15006 leader_election.cc:290] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
W20260709 12:18:02.649304 11491 leader_election.cc:336] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Network error: Client connection negotiation failed: client connection to 127.3.212.130:41579: connect: Connection refused (error 111)
W20260709 12:18:02.651051 11493 leader_election.cc:336] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:18:02.651499 11493 leader_election.cc:304] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:18:02.652428 15006 raft_consensus.cc:2749] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:02.652510 14995 raft_consensus.cc:493] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:18:02.653146 14995 raft_consensus.cc:515] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:18:02.653544 15006 raft_consensus.cc:493] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:18:02.654057 15006 raft_consensus.cc:515] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:18:02.655236 14995 leader_election.cc:290] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:18:02.655548 15006 leader_election.cc:290] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
W20260709 12:18:02.663522 11491 leader_election.cc:336] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Network error: Client connection negotiation failed: client connection to 127.3.212.130:41579: connect: Connection refused (error 111)
W20260709 12:18:02.664162 11491 leader_election.cc:336] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Network error: Client connection negotiation failed: client connection to 127.3.212.130:41579: connect: Connection refused (error 111)
W20260709 12:18:02.664368 11493 leader_election.cc:336] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:18:02.664861 11493 leader_election.cc:304] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:18:02.665584 15006 raft_consensus.cc:2749] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:18:02.665758 11493 leader_election.cc:336] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:18:02.666247 11493 leader_election.cc:304] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:18:02.666916 15006 raft_consensus.cc:2749] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:02.723997 15000 raft_consensus.cc:493] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:18:02.724574 15000 raft_consensus.cc:515] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:18:02.726827 15000 leader_election.cc:290] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
W20260709 12:18:02.732697 11567 leader_election.cc:336] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
W20260709 12:18:02.738050 11565 leader_election.cc:336] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Network error: Client connection negotiation failed: client connection to 127.3.212.130:41579: connect: Connection refused (error 111)
I20260709 12:18:02.738539 11565 leader_election.cc:304] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:18:02.739228 15000 raft_consensus.cc:2749] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:02.752426 15000 raft_consensus.cc:493] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:18:02.752928 15000 raft_consensus.cc:515] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:18:02.754766 15000 leader_election.cc:290] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
W20260709 12:18:02.758730 11565 leader_election.cc:336] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Network error: Client connection negotiation failed: client connection to 127.3.212.130:41579: connect: Connection refused (error 111)
W20260709 12:18:02.759276 11567 leader_election.cc:336] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:18:02.759697 11567 leader_election.cc:304] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:18:02.760290 15000 raft_consensus.cc:2749] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:18:02.777113 11567 consensus_peers.cc:597] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:18:02.779320  3922 tablet_server.cc:196] TabletServer@127.3.212.130:0 shutdown complete.
W20260709 12:18:02.801190 11567 consensus_peers.cc:597] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:18:02.801831 11567 consensus_peers.cc:597] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:18:02.832031 15006 raft_consensus.cc:493] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:18:02.832695 15006 raft_consensus.cc:515] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:18:02.833823 14995 raft_consensus.cc:493] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:18:02.834380 14995 raft_consensus.cc:515] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:18:02.835064 15006 leader_election.cc:290] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:18:02.837702 14995 leader_election.cc:290] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
W20260709 12:18:02.839663 11493 leader_election.cc:336] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
W20260709 12:18:02.841517 11491 leader_election.cc:336] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Network error: Client connection negotiation failed: client connection to 127.3.212.130:41579: connect: Connection refused (error 111)
I20260709 12:18:02.842059 11491 leader_election.cc:304] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:18:02.843501 14995 raft_consensus.cc:2749] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:18:02.843617 11493 leader_election.cc:336] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:18:02.846081 15000 raft_consensus.cc:493] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:18:02.846730 15000 raft_consensus.cc:515] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
W20260709 12:18:02.847405 11491 leader_election.cc:336] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Network error: Client connection negotiation failed: client connection to 127.3.212.130:41579: connect: Connection refused (error 111)
I20260709 12:18:02.847946 11491 leader_election.cc:304] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:18:02.848752 14995 raft_consensus.cc:2749] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:02.854198 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671" is_pre_election: true
I20260709 12:18:02.854940 11526 raft_consensus.cc:2468] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 9.
I20260709 12:18:02.856539 11566 leader_election.cc:304] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:18:02.856993 15000 leader_election.cc:290] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:18:02.857684 15000 raft_consensus.cc:2804] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:02.858084 15000 raft_consensus.cc:493] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:18:02.858475 15000 raft_consensus.cc:3060] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:02.861446 11565 leader_election.cc:336] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Network error: Client connection negotiation failed: client connection to 127.3.212.130:41579: connect: Connection refused (error 111)
I20260709 12:18:02.867061 15000 raft_consensus.cc:515] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:18:02.870079 15000 leader_election.cc:290] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:18:02.871248 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec97657dc1d40eeb0b7a225b412300f" candidate_uuid: "9da53be18b0f446aaa406216e20b0ec8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a03223e9e41247c3a36b7b7c3d476671"
I20260709 12:18:02.871909 11526 raft_consensus.cc:3060] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:02.874035 11565 leader_election.cc:336] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Network error: Client connection negotiation failed: client connection to 127.3.212.130:41579: connect: Connection refused (error 111)
I20260709 12:18:02.877818  3922 tablet_server.cc:179] TabletServer@127.3.212.131:0 shutting down...
I20260709 12:18:02.881585 11526 raft_consensus.cc:2468] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9da53be18b0f446aaa406216e20b0ec8 in term 10.
I20260709 12:18:02.885974 11566 leader_election.cc:304] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d
I20260709 12:18:02.886788 15000 raft_consensus.cc:2804] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:02.888183 15000 raft_consensus.cc:697] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 10 LEADER]: Becoming Leader. State: Replica: 9da53be18b0f446aaa406216e20b0ec8, State: Running, Role: LEADER
I20260709 12:18:02.889112 15000 consensus_queue.cc:237] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
W20260709 12:18:02.900221 11493 consensus_peers.cc:597] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:18:02.904132 11567 consensus_peers.cc:597] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:18:02.911134 11277 catalog_manager.cc:5697] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 reported cstate change: term changed from 9 to 10, leader changed from 1c101e338f954ef086338e251deed19d (127.3.212.130) to 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132). New cstate: current_term: 10 leader_uuid: "9da53be18b0f446aaa406216e20b0ec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:02.913705 15006 raft_consensus.cc:493] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:18:02.914343 15006 raft_consensus.cc:515] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:18:02.917403 14995 raft_consensus.cc:493] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:18:02.917938 14995 raft_consensus.cc:515] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:18:02.922237 14995 leader_election.cc:290] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:18:02.922741 15006 leader_election.cc:290] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:18:02.924713 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390e91331fd04f97a5235133a34875ee" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:18:02.925534 11491 leader_election.cc:336] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Network error: Client connection negotiation failed: client connection to 127.3.212.130:41579: connect: Connection refused (error 111)
W20260709 12:18:02.926994 11493 leader_election.cc:336] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:18:02.927577 11493 leader_election.cc:304] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:18:02.929582 15006 raft_consensus.cc:2749] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:18:02.931488 11491 leader_election.cc:336] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Network error: Client connection negotiation failed: client connection to 127.3.212.130:41579: connect: Connection refused (error 111)
I20260709 12:18:02.931942 11491 leader_election.cc:304] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:18:02.932708 15006 raft_consensus.cc:2749] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:18:02.945084 11566 consensus_peers.cc:597] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Couldn't send request to peer a03223e9e41247c3a36b7b7c3d476671. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:02.953058 15000 raft_consensus.cc:493] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:18:02.953675 15000 raft_consensus.cc:515] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:18:02.956121 15000 leader_election.cc:290] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:18:02.959446  3922 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:18:02.960510  3922 tablet_replica.cc:333] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671: stopping tablet replica
W20260709 12:18:02.961326 11567 leader_election.cc:336] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:18:02.961336  3922 raft_consensus.cc:2243] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:02.962368  3922 raft_consensus.cc:2272] T e7e4724ed93a467ea47763eec9a6de2e P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:02.963510 11565 leader_election.cc:336] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Network error: Client connection negotiation failed: client connection to 127.3.212.130:41579: connect: Connection refused (error 111)
I20260709 12:18:02.963990 11565 leader_election.cc:304] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:18:02.968182 15000 raft_consensus.cc:2749] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:18:02.969231 11566 consensus_peers.cc:597] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Couldn't send request to peer a03223e9e41247c3a36b7b7c3d476671. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:02.970256 11493 consensus_peers.cc:597] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:18:02.965346  3922 tablet_replica.cc:333] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671: stopping tablet replica
I20260709 12:18:02.971442  3922 raft_consensus.cc:2243] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:02.972158  3922 raft_consensus.cc:2272] T da6f4e0d7b894d0581c87d020e67b559 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:02.974911  3922 tablet_replica.cc:333] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671: stopping tablet replica
I20260709 12:18:02.975488  3922 raft_consensus.cc:2243] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:02.975991  3922 raft_consensus.cc:2272] T 2ec97657dc1d40eeb0b7a225b412300f P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:02.977864  3922 tablet_replica.cc:333] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671: stopping tablet replica
I20260709 12:18:02.978426  3922 raft_consensus.cc:2243] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:18:02.979311  3922 raft_consensus.cc:2272] T cc18a67cc3d24753b2677d72cfee35b4 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:02.981348  3922 tablet_replica.cc:333] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671: stopping tablet replica
I20260709 12:18:02.981948  3922 raft_consensus.cc:2243] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:02.982403  3922 raft_consensus.cc:2272] T cdf8217c2b5b47f68e62de34bb95e95d P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:02.984467 15000 raft_consensus.cc:493] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:18:02.984850  3922 tablet_replica.cc:333] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671: stopping tablet replica
I20260709 12:18:02.985033 15000 raft_consensus.cc:515] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } }
I20260709 12:18:02.985961  3922 raft_consensus.cc:2243] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:18:02.987080  3922 raft_consensus.cc:2272] T 773ed4105356479c90eb937ef6da81a5 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:02.987388 15000 leader_election.cc:290] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935), 1c101e338f954ef086338e251deed19d (127.3.212.130:41579)
I20260709 12:18:02.989017 15006 raft_consensus.cc:493] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:18:02.989957  3922 tablet_replica.cc:333] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671: stopping tablet replica
I20260709 12:18:02.989621 15006 raft_consensus.cc:515] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:18:02.990875  3922 raft_consensus.cc:2243] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:18:02.991333 15000 raft_consensus.cc:493] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:18:02.991958  3922 raft_consensus.cc:2272] T 381fa277bb844a948c90100e03a4059a P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:02.991873 15000 raft_consensus.cc:515] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:18:02.994045 15000 leader_election.cc:290] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
W20260709 12:18:02.994506 11567 leader_election.cc:336] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
I20260709 12:18:02.994772  3922 tablet_replica.cc:333] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671: stopping tablet replica
I20260709 12:18:02.995083 15006 leader_election.cc:290] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
W20260709 12:18:02.995822 11565 leader_election.cc:336] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Network error: Client connection negotiation failed: client connection to 127.3.212.130:41579: connect: Connection refused (error 111)
W20260709 12:18:02.995822 11566 consensus_peers.cc:597] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Couldn't send request to peer a03223e9e41247c3a36b7b7c3d476671. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:02.996783  3922 raft_consensus.cc:2243] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:02.997462  3922 raft_consensus.cc:2272] T a34e69406a86484482230bfec0edfcfa P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:02.997498 11565 leader_election.cc:304] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:18:02.999316 15000 raft_consensus.cc:2749] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:18:02.999400 11491 leader_election.cc:336] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Network error: Client connection negotiation failed: client connection to 127.3.212.130:41579: connect: Connection refused (error 111)
W20260709 12:18:03.000378 11566 leader_election.cc:336] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:03.000677  3922 tablet_replica.cc:333] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671: stopping tablet replica
I20260709 12:18:03.002703 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b270aad1134eb894de5aa7cc60f3a8" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
I20260709 12:18:03.003118  3922 raft_consensus.cc:2243] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:18:03.004323  3922 raft_consensus.cc:2272] T 2b52025153e440eebdadbe35d49837ff P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:03.004590 11565 leader_election.cc:336] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Network error: Client connection negotiation failed: client connection to 127.3.212.130:41579: connect: Connection refused (error 111)
I20260709 12:18:03.004714 11491 leader_election.cc:304] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, 9da53be18b0f446aaa406216e20b0ec8
I20260709 12:18:03.005065 11565 leader_election.cc:304] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:18:03.005584 15006 raft_consensus.cc:2749] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:03.005880 15000 raft_consensus.cc:2749] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:03.006899  3922 tablet_replica.cc:333] T da8741606df54c3f8b5cc5c1141862ea P a03223e9e41247c3a36b7b7c3d476671: stopping tablet replica
I20260709 12:18:03.007813  3922 raft_consensus.cc:2243] T da8741606df54c3f8b5cc5c1141862ea P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:03.008430  3922 raft_consensus.cc:2272] T da8741606df54c3f8b5cc5c1141862ea P a03223e9e41247c3a36b7b7c3d476671 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.009567 15006 raft_consensus.cc:493] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:18:03.009979 15006 raft_consensus.cc:515] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "b126028166e8480ba25541bf8f7fc6de" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37935 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } }
I20260709 12:18:03.010792  3922 tablet_replica.cc:333] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671: stopping tablet replica
I20260709 12:18:03.011511  3922 raft_consensus.cc:2243] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:18:03.011783 15006 leader_election.cc:290] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935)
I20260709 12:18:03.012486  3922 raft_consensus.cc:2272] T 35be292dd086433e8b50b99e6f150395 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:03.015703 11493 leader_election.cc:336] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111)
W20260709 12:18:03.016268 11491 leader_election.cc:336] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Network error: Client connection negotiation failed: client connection to 127.3.212.130:41579: connect: Connection refused (error 111)
I20260709 12:18:03.016299  3922 tablet_replica.cc:333] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671: stopping tablet replica
I20260709 12:18:03.016619 11491 leader_election.cc:304] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d, b126028166e8480ba25541bf8f7fc6de
I20260709 12:18:03.017081  3922 raft_consensus.cc:2243] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:18:03.017227 15006 raft_consensus.cc:2749] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:03.018383  3922 raft_consensus.cc:2272] T 4abcb35dfa874d3f9cb851efa0baaea5 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.020803  3922 tablet_replica.cc:333] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671: stopping tablet replica
I20260709 12:18:03.021435  3922 raft_consensus.cc:2243] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:18:03.022307  3922 raft_consensus.cc:2272] T 9a3a6ef0117045b19d2915baab58e53f P a03223e9e41247c3a36b7b7c3d476671 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.025031  3922 tablet_replica.cc:333] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671: stopping tablet replica
W20260709 12:18:03.025029 11566 consensus_peers.cc:597] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Couldn't send request to peer a03223e9e41247c3a36b7b7c3d476671. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:03.026050 15000 raft_consensus.cc:493] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:18:03.026136  3922 raft_consensus.cc:2243] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:03.027025  3922 raft_consensus.cc:2272] T 721df15d88f64a09bcaa4fe04a559f48 P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.026739 15000 raft_consensus.cc:515] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
W20260709 12:18:03.027618 11493 consensus_peers.cc:597] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:18:03.029203 15000 leader_election.cc:290] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:18:03.029958  3922 tablet_replica.cc:333] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671: stopping tablet replica
I20260709 12:18:03.030812  3922 raft_consensus.cc:2243] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Raft consensus shutting down.
W20260709 12:18:03.031378 11566 consensus_peers.cc:597] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Couldn't send request to peer a03223e9e41247c3a36b7b7c3d476671. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:03.031504  3922 raft_consensus.cc:2272] T f112ae9059f34e52b722c66748dbffe5 P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:03.032811 11566 leader_election.cc:336] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:18:03.033461 11565 leader_election.cc:336] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Network error: Client connection negotiation failed: client connection to 127.3.212.130:41579: connect: Connection refused (error 111)
I20260709 12:18:03.033833 11565 leader_election.cc:304] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:18:03.034430  3922 tablet_replica.cc:333] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671: stopping tablet replica
I20260709 12:18:03.034493 15000 raft_consensus.cc:2749] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:03.035126  3922 raft_consensus.cc:2243] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:03.035626  3922 raft_consensus.cc:2272] T 9b19a20c753d463babb75ec55ddd0ba8 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.037734  3922 tablet_replica.cc:333] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671: stopping tablet replica
I20260709 12:18:03.038309  3922 raft_consensus.cc:2243] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:18:03.039124  3922 raft_consensus.cc:2272] T 45c355b3902a4e7fb72bac6a91ea3316 P a03223e9e41247c3a36b7b7c3d476671 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.041112  3922 tablet_replica.cc:333] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671: stopping tablet replica
I20260709 12:18:03.041719  3922 raft_consensus.cc:2243] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:03.042161  3922 raft_consensus.cc:2272] T a5e58472d98540b986b1ed39edf597d4 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.044036  3922 tablet_replica.cc:333] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671: stopping tablet replica
I20260709 12:18:03.044603  3922 raft_consensus.cc:2243] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:18:03.045426  3922 raft_consensus.cc:2272] T 88412eb571b84fdc8d521a981be63bfa P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.047690  3922 tablet_replica.cc:333] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671: stopping tablet replica
I20260709 12:18:03.048626  3922 raft_consensus.cc:2243] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:18:03.049775  3922 raft_consensus.cc:2272] T 85a1c543b632476b909b2a5fb50e9f78 P a03223e9e41247c3a36b7b7c3d476671 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.052271  3922 tablet_replica.cc:333] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671: stopping tablet replica
I20260709 12:18:03.053052  3922 raft_consensus.cc:2243] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:03.053582  3922 raft_consensus.cc:2272] T f1589b98714c45ef8ed01287d13b8252 P a03223e9e41247c3a36b7b7c3d476671 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.056540  3922 tablet_replica.cc:333] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671: stopping tablet replica
W20260709 12:18:03.057196 11566 consensus_peers.cc:597] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 -> Peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Couldn't send request to peer a03223e9e41247c3a36b7b7c3d476671. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:03.057574  3922 raft_consensus.cc:2243] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:03.058386  3922 raft_consensus.cc:2272] T 281f1a743bd44c27af6ace022a8a3ad1 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.060429  3922 tablet_replica.cc:333] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671: stopping tablet replica
I20260709 12:18:03.061128  3922 raft_consensus.cc:2243] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:03.061311 15000 raft_consensus.cc:493] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:18:03.061740  3922 raft_consensus.cc:2272] T 876bdec904324677a10f21ffbc21f5e3 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.061913 15000 raft_consensus.cc:515] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:18:03.063910  3922 tablet_replica.cc:333] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671: stopping tablet replica
I20260709 12:18:03.063983 15000 leader_election.cc:290] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063)
I20260709 12:18:03.064793  3922 raft_consensus.cc:2243] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:18:03.065922  3922 raft_consensus.cc:2272] T 50204b9643974af9a0505210d261ee78 P a03223e9e41247c3a36b7b7c3d476671 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:03.067471 11566 leader_election.cc:336] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:18:03.068281 11565 leader_election.cc:336] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Network error: Client connection negotiation failed: client connection to 127.3.212.130:41579: connect: Connection refused (error 111)
I20260709 12:18:03.068560  3922 tablet_replica.cc:333] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671: stopping tablet replica
I20260709 12:18:03.068619 11565 leader_election.cc:304] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8; no voters: 1c101e338f954ef086338e251deed19d, a03223e9e41247c3a36b7b7c3d476671
I20260709 12:18:03.069258  3922 raft_consensus.cc:2243] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:03.069362 15000 raft_consensus.cc:2749] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:03.069864  3922 raft_consensus.cc:2272] T 390e91331fd04f97a5235133a34875ee P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.072395  3922 tablet_replica.cc:333] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671: stopping tablet replica
I20260709 12:18:03.073217  3922 raft_consensus.cc:2243] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:03.073885  3922 raft_consensus.cc:2272] T a690fb2f9e0548988bfefbe6ed3ab694 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.076699  3922 tablet_replica.cc:333] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671: stopping tablet replica
I20260709 12:18:03.077689  3922 raft_consensus.cc:2243] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 9 LEADER]: Raft consensus shutting down.
W20260709 12:18:03.078545 11567 consensus_peers.cc:597] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:18:03.078801  3922 raft_consensus.cc:2272] T ba25a071498548cdba1aaf992fa805e8 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.081095  3922 tablet_replica.cc:333] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671: stopping tablet replica
I20260709 12:18:03.081892  3922 raft_consensus.cc:2243] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:03.082378  3922 raft_consensus.cc:2272] T 4d8592bdb30445228c429e3c55360c25 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.082928 15006 raft_consensus.cc:493] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:18:03.083469 15006 raft_consensus.cc:515] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:18:03.085049  3922 tablet_replica.cc:333] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671: stopping tablet replica
I20260709 12:18:03.085566 15006 leader_election.cc:290] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:18:03.085974  3922 raft_consensus.cc:2243] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:18:03.087069  3922 raft_consensus.cc:2272] T b9c607d0d1e744b6babe5fc93505013b P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.088595 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8" is_pre_election: true
W20260709 12:18:03.088233 11567 consensus_peers.cc:597] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:18:03.089349 11600 raft_consensus.cc:2468] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 9.
I20260709 12:18:03.089627  3922 tablet_replica.cc:333] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671: stopping tablet replica
I20260709 12:18:03.090485  3922 raft_consensus.cc:2243] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:18:03.090598 11491 leader_election.cc:304] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 
I20260709 12:18:03.091431 15006 raft_consensus.cc:2804] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:03.091527  3922 raft_consensus.cc:2272] T 74b107ce07924505acbedf93698833e7 P a03223e9e41247c3a36b7b7c3d476671 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:03.091476 11491 leader_election.cc:336] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Network error: Client connection negotiation failed: client connection to 127.3.212.130:41579: connect: Connection refused (error 111)
I20260709 12:18:03.092116 15006 raft_consensus.cc:493] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1c101e338f954ef086338e251deed19d)
I20260709 12:18:03.092664 15006 raft_consensus.cc:3060] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:03.094784  3922 tablet_replica.cc:333] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671: stopping tablet replica
I20260709 12:18:03.095655  3922 raft_consensus.cc:2243] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:03.096490  3922 raft_consensus.cc:2272] T c67c223a5ec948b4bf18874bf0d591b5 P a03223e9e41247c3a36b7b7c3d476671 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.099092  3922 tablet_replica.cc:333] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671: stopping tablet replica
I20260709 12:18:03.099794  3922 raft_consensus.cc:2243] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [term 8 LEADER]: Raft consensus shutting down.
W20260709 12:18:03.099922 11566 consensus_peers.cc:597] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 -> Peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Couldn't send request to peer a03223e9e41247c3a36b7b7c3d476671. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:03.099761 15006 raft_consensus.cc:515] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:18:03.101074  3922 raft_consensus.cc:2272] T 2ff9fe9a94294836aec652338f44367d P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.102008 15006 leader_election.cc:290] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 election: Requested vote from peers 1c101e338f954ef086338e251deed19d (127.3.212.130:41579), 9da53be18b0f446aaa406216e20b0ec8 (127.3.212.132:34973)
I20260709 12:18:03.103813  3922 tablet_replica.cc:333] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671: stopping tablet replica
I20260709 12:18:03.104702  3922 raft_consensus.cc:2243] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:03.105418  3922 raft_consensus.cc:2272] T f8e9a700accc4fff8304eec59a498721 P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:03.107656 11567 consensus_peers.cc:597] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:18:03.108458  3922 tablet_replica.cc:333] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671: stopping tablet replica
W20260709 12:18:03.107646 11491 leader_election.cc:336] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Network error: Client connection negotiation failed: client connection to 127.3.212.130:41579: connect: Connection refused (error 111)
I20260709 12:18:03.108666 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3205ea0248f74fa5ba9de670d91b9568" candidate_uuid: "a03223e9e41247c3a36b7b7c3d476671" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9da53be18b0f446aaa406216e20b0ec8"
I20260709 12:18:03.109298  3922 raft_consensus.cc:2243] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:18:03.109305 11600 raft_consensus.cc:3060] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:03.110435  3922 raft_consensus.cc:2272] T e7458151705b45928221728d170b4024 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.112807  3922 tablet_replica.cc:333] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671: stopping tablet replica
I20260709 12:18:03.113569  3922 raft_consensus.cc:2243] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:03.114059  3922 raft_consensus.cc:2272] T 987e6a4207394b2f80be7c7d03b696bf P a03223e9e41247c3a36b7b7c3d476671 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.116041  3922 tablet_replica.cc:333] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671: stopping tablet replica
I20260709 12:18:03.116387 11600 raft_consensus.cc:2468] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a03223e9e41247c3a36b7b7c3d476671 in term 10.
I20260709 12:18:03.116585  3922 raft_consensus.cc:2243] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:03.117318  3922 raft_consensus.cc:2272] T 7b179748933846ae9a419549cdfb997a P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.118605 11491 leader_election.cc:304] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9da53be18b0f446aaa406216e20b0ec8, a03223e9e41247c3a36b7b7c3d476671; no voters: 1c101e338f954ef086338e251deed19d
I20260709 12:18:03.119442 15006 raft_consensus.cc:2804] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:03.119656  3922 tablet_replica.cc:333] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671: stopping tablet replica
I20260709 12:18:03.119859 15006 raft_consensus.cc:697] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 10 LEADER]: Becoming Leader. State: Replica: a03223e9e41247c3a36b7b7c3d476671, State: Running, Role: LEADER
I20260709 12:18:03.120425  3922 raft_consensus.cc:2243] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:18:03.120680 15006 consensus_queue.cc:237] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c101e338f954ef086338e251deed19d" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 41579 } } peers { permanent_uuid: "a03223e9e41247c3a36b7b7c3d476671" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 36063 } } peers { permanent_uuid: "9da53be18b0f446aaa406216e20b0ec8" member_type: VOTER last_known_addr { host: "127.3.212.132" port: 34973 } }
I20260709 12:18:03.121279  3922 raft_consensus.cc:2272] T 0b15621d7be54f2489041bbe8258bb79 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.123795  3922 tablet_replica.cc:333] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671: stopping tablet replica
I20260709 12:18:03.124573  3922 raft_consensus.cc:2243] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:03.125097  3922 raft_consensus.cc:2272] T 6480ef79a4dc499b94fdb7081ff36fdd P a03223e9e41247c3a36b7b7c3d476671 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.127777  3922 tablet_replica.cc:333] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671: stopping tablet replica
I20260709 12:18:03.128427  3922 raft_consensus.cc:2243] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:18:03.129510  3922 raft_consensus.cc:2272] T 985a868591ad444faeace7fc051862cd P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.131666  3922 tablet_replica.cc:333] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671: stopping tablet replica
I20260709 12:18:03.132184  3922 raft_consensus.cc:2243] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:18:03.132812  3922 pending_rounds.cc:70] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671: Trying to abort 1 pending ops.
I20260709 12:18:03.133033  3922 pending_rounds.cc:77] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671: Aborting op as it isn't in flight: id { term: 10 index: 6 } timestamp: 7305623482871066624 op_type: NO_OP noop_request { }
I20260709 12:18:03.133366  3922 raft_consensus.cc:2889] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 10 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:18:03.133662  3922 raft_consensus.cc:2272] T 3205ea0248f74fa5ba9de670d91b9568 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.136420  3922 tablet_replica.cc:333] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671: stopping tablet replica
I20260709 12:18:03.136950  3922 raft_consensus.cc:2243] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:03.137493  3922 raft_consensus.cc:2272] T 98cd3dfdeed3494ea7d5a7c45337ad3f P a03223e9e41247c3a36b7b7c3d476671 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.139578  3922 tablet_replica.cc:333] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671: stopping tablet replica
I20260709 12:18:03.140117  3922 raft_consensus.cc:2243] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:18:03.140954  3922 raft_consensus.cc:2272] T 183ead47e21645c289d90fbfe75fd319 P a03223e9e41247c3a36b7b7c3d476671 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.142998  3922 tablet_replica.cc:333] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671: stopping tablet replica
I20260709 12:18:03.143500  3922 raft_consensus.cc:2243] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [term 5 LEADER]: Raft consensus shutting down.
W20260709 12:18:03.143520 11567 consensus_peers.cc:597] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:18:03.144374  3922 raft_consensus.cc:2272] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P a03223e9e41247c3a36b7b7c3d476671 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.146445  3922 tablet_replica.cc:333] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671: stopping tablet replica
I20260709 12:18:03.146912  3922 raft_consensus.cc:2243] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:03.147396  3922 raft_consensus.cc:2272] T 49b270aad1134eb894de5aa7cc60f3a8 P a03223e9e41247c3a36b7b7c3d476671 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:03.167091 11566 consensus_peers.cc:597] T da8741606df54c3f8b5cc5c1141862ea P 9da53be18b0f446aaa406216e20b0ec8 -> Peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Couldn't send request to peer a03223e9e41247c3a36b7b7c3d476671. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:03.187414 11566 consensus_peers.cc:597] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 -> Peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Couldn't send request to peer a03223e9e41247c3a36b7b7c3d476671. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:03.188110 11566 consensus_peers.cc:597] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 -> Peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Couldn't send request to peer a03223e9e41247c3a36b7b7c3d476671. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:03.300655 11567 consensus_peers.cc:597] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:18:03.337563 11566 consensus_peers.cc:597] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Couldn't send request to peer a03223e9e41247c3a36b7b7c3d476671. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.131:36063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:03.361974 11567 consensus_peers.cc:597] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:18:03.376186 11566 consensus_peers.cc:597] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 -> Peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Couldn't send request to peer a03223e9e41247c3a36b7b7c3d476671. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.131:36063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:03.395922 11567 consensus_peers.cc:597] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:18:03.413597 11566 consensus_peers.cc:597] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 -> Peer a03223e9e41247c3a36b7b7c3d476671 (127.3.212.131:36063): Couldn't send request to peer a03223e9e41247c3a36b7b7c3d476671. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.131:36063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:03.458041 11565 consensus_peers.cc:597] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 -> Peer 1c101e338f954ef086338e251deed19d (127.3.212.130:41579): Couldn't send request to peer 1c101e338f954ef086338e251deed19d. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:41579: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:03.553900  3922 tablet_server.cc:196] TabletServer@127.3.212.131:0 shutdown complete.
I20260709 12:18:03.627991  3922 tablet_server.cc:179] TabletServer@127.3.212.132:0 shutting down...
I20260709 12:18:03.674227  3922 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:18:03.674943 11567 consensus_peers.cc:597] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 -> Peer b126028166e8480ba25541bf8f7fc6de (127.3.212.129:37935): Couldn't send request to peer b126028166e8480ba25541bf8f7fc6de. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37935: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:18:03.675134  3922 tablet_replica.cc:333] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8: stopping tablet replica
I20260709 12:18:03.675936  3922 raft_consensus.cc:2243] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:18:03.676786  3922 raft_consensus.cc:2272] T da6f4e0d7b894d0581c87d020e67b559 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.678956  3922 tablet_replica.cc:333] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8: stopping tablet replica
I20260709 12:18:03.679787  3922 raft_consensus.cc:2243] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:18:03.680672  3922 raft_consensus.cc:2272] T 2aaa267a7b85487a991ce0600309cac0 P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.683494  3922 tablet_replica.cc:333] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8: stopping tablet replica
I20260709 12:18:03.684046  3922 raft_consensus.cc:2243] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:18:03.684789  3922 pending_rounds.cc:70] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8: Trying to abort 1 pending ops.
I20260709 12:18:03.684947  3922 pending_rounds.cc:77] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8: Aborting op as it isn't in flight: id { term: 10 index: 6 } timestamp: 7305623481922801664 op_type: NO_OP noop_request { }
I20260709 12:18:03.685170  3922 raft_consensus.cc:2889] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 10 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:18:03.685436  3922 raft_consensus.cc:2272] T 2ec97657dc1d40eeb0b7a225b412300f P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.688247  3922 tablet_replica.cc:333] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8: stopping tablet replica
I20260709 12:18:03.688844  3922 raft_consensus.cc:2243] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:18:03.689695  3922 raft_consensus.cc:2272] T e7e4724ed93a467ea47763eec9a6de2e P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.691597  3922 tablet_replica.cc:333] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8: stopping tablet replica
I20260709 12:18:03.692122  3922 raft_consensus.cc:2243] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:03.692512  3922 raft_consensus.cc:2272] T 167448b175c040d180318f81f6d10c8d P 9da53be18b0f446aaa406216e20b0ec8 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.694502  3922 tablet_replica.cc:333] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8: stopping tablet replica
I20260709 12:18:03.695068  3922 raft_consensus.cc:2243] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:18:03.695823  3922 raft_consensus.cc:2272] T cdf8217c2b5b47f68e62de34bb95e95d P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.697773  3922 tablet_replica.cc:333] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8: stopping tablet replica
I20260709 12:18:03.698278  3922 raft_consensus.cc:2243] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:03.698671  3922 raft_consensus.cc:2272] T 2b52025153e440eebdadbe35d49837ff P 9da53be18b0f446aaa406216e20b0ec8 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.700697  3922 tablet_replica.cc:333] T da8741606df54c3f8b5cc5c1141862ea P 9da53be18b0f446aaa406216e20b0ec8: stopping tablet replica
I20260709 12:18:03.701264  3922 raft_consensus.cc:2243] T da8741606df54c3f8b5cc5c1141862ea P 9da53be18b0f446aaa406216e20b0ec8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:03.702081  3922 raft_consensus.cc:2272] T da8741606df54c3f8b5cc5c1141862ea P 9da53be18b0f446aaa406216e20b0ec8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.703970  3922 tablet_replica.cc:333] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8: stopping tablet replica
I20260709 12:18:03.704563  3922 raft_consensus.cc:2243] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:03.704967  3922 raft_consensus.cc:2272] T 35be292dd086433e8b50b99e6f150395 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.706863  3922 tablet_replica.cc:333] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8: stopping tablet replica
I20260709 12:18:03.707357  3922 raft_consensus.cc:2243] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:03.707736  3922 raft_consensus.cc:2272] T 2d78aaa911094df3ac90f175cd5c58fb P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.709632  3922 tablet_replica.cc:333] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8: stopping tablet replica
I20260709 12:18:03.710120  3922 raft_consensus.cc:2243] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:03.710537  3922 raft_consensus.cc:2272] T 193e9917816a4990998188f9a4e9d08c P 9da53be18b0f446aaa406216e20b0ec8 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.712381  3922 tablet_replica.cc:333] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8: stopping tablet replica
I20260709 12:18:03.712885  3922 raft_consensus.cc:2243] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:03.713249  3922 raft_consensus.cc:2272] T 4abcb35dfa874d3f9cb851efa0baaea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.715095  3922 tablet_replica.cc:333] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8: stopping tablet replica
I20260709 12:18:03.715606  3922 raft_consensus.cc:2243] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:03.716166  3922 raft_consensus.cc:2272] T 9a3a6ef0117045b19d2915baab58e53f P 9da53be18b0f446aaa406216e20b0ec8 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.718338  3922 tablet_replica.cc:333] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8: stopping tablet replica
I20260709 12:18:03.718951  3922 raft_consensus.cc:2243] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:18:03.719782  3922 raft_consensus.cc:2272] T 721df15d88f64a09bcaa4fe04a559f48 P 9da53be18b0f446aaa406216e20b0ec8 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.721724  3922 tablet_replica.cc:333] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8: stopping tablet replica
I20260709 12:18:03.722275  3922 raft_consensus.cc:2243] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:18:03.723064  3922 raft_consensus.cc:2272] T 281f1a743bd44c27af6ace022a8a3ad1 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.725035  3922 tablet_replica.cc:333] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8: stopping tablet replica
I20260709 12:18:03.725633  3922 raft_consensus.cc:2243] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:03.726090  3922 raft_consensus.cc:2272] T b9c607d0d1e744b6babe5fc93505013b P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.728108  3922 tablet_replica.cc:333] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8: stopping tablet replica
I20260709 12:18:03.728714  3922 raft_consensus.cc:2243] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:03.729135  3922 raft_consensus.cc:2272] T e916ed5651f842f99af4ebb1748cd1bb P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.731408  3922 tablet_replica.cc:333] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8: stopping tablet replica
I20260709 12:18:03.732028  3922 raft_consensus.cc:2243] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:03.732486  3922 raft_consensus.cc:2272] T 34d43eecbad746fd9ddce50c5b9fc3e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.734539  3922 tablet_replica.cc:333] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8: stopping tablet replica
I20260709 12:18:03.735118  3922 raft_consensus.cc:2243] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:03.735567  3922 raft_consensus.cc:2272] T 2ff9fe9a94294836aec652338f44367d P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.737581  3922 tablet_replica.cc:333] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8: stopping tablet replica
I20260709 12:18:03.738142  3922 raft_consensus.cc:2243] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:03.738651  3922 raft_consensus.cc:2272] T a215788da7ae4b548e5c307a6b294109 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.740617  3922 tablet_replica.cc:333] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8: stopping tablet replica
I20260709 12:18:03.741199  3922 raft_consensus.cc:2243] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:03.741693  3922 raft_consensus.cc:2272] T 390e91331fd04f97a5235133a34875ee P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.743633  3922 tablet_replica.cc:333] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8: stopping tablet replica
I20260709 12:18:03.744189  3922 raft_consensus.cc:2243] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:03.744683  3922 raft_consensus.cc:2272] T ba25a071498548cdba1aaf992fa805e8 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.746708  3922 tablet_replica.cc:333] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8: stopping tablet replica
I20260709 12:18:03.747299  3922 raft_consensus.cc:2243] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:18:03.748078  3922 raft_consensus.cc:2272] T 98cd3dfdeed3494ea7d5a7c45337ad3f P 9da53be18b0f446aaa406216e20b0ec8 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.750226  3922 tablet_replica.cc:333] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8: stopping tablet replica
I20260709 12:18:03.750785  3922 raft_consensus.cc:2243] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:03.751282  3922 raft_consensus.cc:2272] T 183ead47e21645c289d90fbfe75fd319 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.753237  3922 tablet_replica.cc:333] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8: stopping tablet replica
I20260709 12:18:03.754069  3922 raft_consensus.cc:2243] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:03.754740  3922 raft_consensus.cc:2272] T 773ed4105356479c90eb937ef6da81a5 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.757369  3922 tablet_replica.cc:333] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8: stopping tablet replica
I20260709 12:18:03.757949  3922 raft_consensus.cc:2243] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:18:03.759104  3922 raft_consensus.cc:2272] T 42cf7a9497dc4b2ebf7a4c7d4f4dbed4 P 9da53be18b0f446aaa406216e20b0ec8 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.761633  3922 tablet_replica.cc:333] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8: stopping tablet replica
I20260709 12:18:03.762254  3922 raft_consensus.cc:2243] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:03.762818  3922 raft_consensus.cc:2272] T 0b15621d7be54f2489041bbe8258bb79 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.764837  3922 tablet_replica.cc:333] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8: stopping tablet replica
I20260709 12:18:03.765360  3922 raft_consensus.cc:2243] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:18:03.766201  3922 raft_consensus.cc:2272] T 7b179748933846ae9a419549cdfb997a P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.768110  3922 tablet_replica.cc:333] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8: stopping tablet replica
I20260709 12:18:03.768618  3922 raft_consensus.cc:2243] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:18:03.769366  3922 raft_consensus.cc:2272] T a5e58472d98540b986b1ed39edf597d4 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.771688  3922 tablet_replica.cc:333] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8: stopping tablet replica
I20260709 12:18:03.772220  3922 raft_consensus.cc:2243] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:18:03.773056  3922 raft_consensus.cc:2272] T e3b977efa036417c9a75e3b30b19c72a P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.775071  3922 tablet_replica.cc:333] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8: stopping tablet replica
I20260709 12:18:03.775646  3922 raft_consensus.cc:2243] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:18:03.776484  3922 raft_consensus.cc:2272] T f112ae9059f34e52b722c66748dbffe5 P 9da53be18b0f446aaa406216e20b0ec8 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.778493  3922 tablet_replica.cc:333] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8: stopping tablet replica
I20260709 12:18:03.779009  3922 raft_consensus.cc:2243] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:18:03.779724  3922 raft_consensus.cc:2272] T 1d2554b9de634e0daa5c0257a1821025 P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.781777  3922 tablet_replica.cc:333] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8: stopping tablet replica
I20260709 12:18:03.782424  3922 raft_consensus.cc:2243] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:18:03.783311  3922 raft_consensus.cc:2272] T 9b19a20c753d463babb75ec55ddd0ba8 P 9da53be18b0f446aaa406216e20b0ec8 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.785245  3922 tablet_replica.cc:333] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8: stopping tablet replica
I20260709 12:18:03.785781  3922 raft_consensus.cc:2243] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:18:03.786531  3922 raft_consensus.cc:2272] T 5ffe47647c274723808482c166efa21c P 9da53be18b0f446aaa406216e20b0ec8 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.788381  3922 tablet_replica.cc:333] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8: stopping tablet replica
I20260709 12:18:03.788872  3922 raft_consensus.cc:2243] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:03.789340  3922 raft_consensus.cc:2272] T 45c355b3902a4e7fb72bac6a91ea3316 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.791203  3922 tablet_replica.cc:333] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8: stopping tablet replica
I20260709 12:18:03.791741  3922 raft_consensus.cc:2243] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:18:03.792546  3922 raft_consensus.cc:2272] T ef13d597f7a84434a1bbdc95857e6215 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.794765  3922 tablet_replica.cc:333] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8: stopping tablet replica
I20260709 12:18:03.795334  3922 raft_consensus.cc:2243] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:03.795971  3922 raft_consensus.cc:2272] T 381fa277bb844a948c90100e03a4059a P 9da53be18b0f446aaa406216e20b0ec8 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.798466  3922 tablet_replica.cc:333] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8: stopping tablet replica
I20260709 12:18:03.799070  3922 raft_consensus.cc:2243] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:18:03.799996  3922 raft_consensus.cc:2272] T e896afa1887146dfade142338e2fc407 P 9da53be18b0f446aaa406216e20b0ec8 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.802172  3922 tablet_replica.cc:333] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8: stopping tablet replica
I20260709 12:18:03.802704  3922 raft_consensus.cc:2243] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:03.803162  3922 raft_consensus.cc:2272] T a841f2f09ced40a4bbf33594e11bd7ad P 9da53be18b0f446aaa406216e20b0ec8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.805078  3922 tablet_replica.cc:333] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8: stopping tablet replica
I20260709 12:18:03.805616  3922 raft_consensus.cc:2243] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:18:03.806401  3922 raft_consensus.cc:2272] T cb7937e0cff84ef7a26c84247c8ffc08 P 9da53be18b0f446aaa406216e20b0ec8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.808308  3922 tablet_replica.cc:333] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8: stopping tablet replica
I20260709 12:18:03.808795  3922 raft_consensus.cc:2243] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:03.809275  3922 raft_consensus.cc:2272] T 3205ea0248f74fa5ba9de670d91b9568 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.811300  3922 tablet_replica.cc:333] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8: stopping tablet replica
I20260709 12:18:03.811789  3922 raft_consensus.cc:2243] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:03.812238  3922 raft_consensus.cc:2272] T 67ed4eeff0ae44d0bc1ebb8cbe3adea5 P 9da53be18b0f446aaa406216e20b0ec8 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.814204  3922 tablet_replica.cc:333] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8: stopping tablet replica
I20260709 12:18:03.814682  3922 raft_consensus.cc:2243] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:03.815181  3922 raft_consensus.cc:2272] T 49b270aad1134eb894de5aa7cc60f3a8 P 9da53be18b0f446aaa406216e20b0ec8 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:03.817133  3922 tablet_replica.cc:333] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8: stopping tablet replica
I20260709 12:18:03.817615  3922 raft_consensus.cc:2243] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:18:03.818451  3922 raft_consensus.cc:2272] T 987e6a4207394b2f80be7c7d03b696bf P 9da53be18b0f446aaa406216e20b0ec8 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:04.122447  3922 tablet_server.cc:196] TabletServer@127.3.212.132:0 shutdown complete.
I20260709 12:18:04.191578  3922 master.cc:562] Master@127.3.212.190:40671 shutting down...
I20260709 12:18:04.223591  3922 raft_consensus.cc:2243] T 00000000000000000000000000000000 P eb02cb678b0c4f28932bfb6c2377165e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:04.224138  3922 raft_consensus.cc:2272] T 00000000000000000000000000000000 P eb02cb678b0c4f28932bfb6c2377165e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:04.224444  3922 tablet_replica.cc:333] T 00000000000000000000000000000000 P eb02cb678b0c4f28932bfb6c2377165e: stopping tablet replica
I20260709 12:18:04.318174  3922 master.cc:584] Master@127.3.212.190:40671 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (109332 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 12:18:04.405285  3922 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.212.190:35487
I20260709 12:18:04.406424  3922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:04.412191 15016 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:04.412307 15017 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:04.413210 15019 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:04.413789  3922 server_base.cc:1061] running on GCE node
I20260709 12:18:04.415743  3922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:04.415944  3922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:04.416095  3922 hybrid_clock.cc:648] HybridClock initialized: now 1783599484416076 us; error 0 us; skew 500 ppm
I20260709 12:18:04.416632  3922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:04.419369  3922 webserver.cc:533] Webserver started at http://127.3.212.190:35629/ using document root <none> and password file <none>
I20260709 12:18:04.419890  3922 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:04.420071  3922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:04.420334  3922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:04.421569  3922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599103767690-3922-0/minicluster-data/master-0-root/instance:
uuid: "5c19ae896ee04283b888065a716678f4"
format_stamp: "Formatted at 2026-07-09 12:18:04 on dist-test-slave-442x"
I20260709 12:18:04.426244  3922 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:18:04.430075 15024 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:04.430925  3922 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:18:04.431253  3922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599103767690-3922-0/minicluster-data/master-0-root
uuid: "5c19ae896ee04283b888065a716678f4"
format_stamp: "Formatted at 2026-07-09 12:18:04 on dist-test-slave-442x"
I20260709 12:18:04.431574  3922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599103767690-3922-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599103767690-3922-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599103767690-3922-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:04.471326  3922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:04.472443  3922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:04.511366  3922 rpc_server.cc:307] RPC server started. Bound to: 127.3.212.190:35487
I20260709 12:18:04.511471 15075 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.212.190:35487 every 8 connection(s)
I20260709 12:18:04.515429 15076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:04.526389 15076 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c19ae896ee04283b888065a716678f4: Bootstrap starting.
I20260709 12:18:04.531095 15076 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5c19ae896ee04283b888065a716678f4: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:04.535452 15076 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c19ae896ee04283b888065a716678f4: No bootstrap required, opened a new log
I20260709 12:18:04.537813 15076 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5c19ae896ee04283b888065a716678f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c19ae896ee04283b888065a716678f4" member_type: VOTER }
I20260709 12:18:04.538220 15076 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5c19ae896ee04283b888065a716678f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:04.538455 15076 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5c19ae896ee04283b888065a716678f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c19ae896ee04283b888065a716678f4, State: Initialized, Role: FOLLOWER
I20260709 12:18:04.539095 15076 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5c19ae896ee04283b888065a716678f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c19ae896ee04283b888065a716678f4" member_type: VOTER }
I20260709 12:18:04.539542 15076 raft_consensus.cc:399] T 00000000000000000000000000000000 P 5c19ae896ee04283b888065a716678f4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:18:04.539772 15076 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5c19ae896ee04283b888065a716678f4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:18:04.540023 15076 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5c19ae896ee04283b888065a716678f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:04.544867 15076 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5c19ae896ee04283b888065a716678f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c19ae896ee04283b888065a716678f4" member_type: VOTER }
I20260709 12:18:04.545463 15076 leader_election.cc:304] T 00000000000000000000000000000000 P 5c19ae896ee04283b888065a716678f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5c19ae896ee04283b888065a716678f4; no voters: 
I20260709 12:18:04.546623 15076 leader_election.cc:290] T 00000000000000000000000000000000 P 5c19ae896ee04283b888065a716678f4 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:18:04.547061 15079 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5c19ae896ee04283b888065a716678f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:04.548339 15079 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5c19ae896ee04283b888065a716678f4 [term 1 LEADER]: Becoming Leader. State: Replica: 5c19ae896ee04283b888065a716678f4, State: Running, Role: LEADER
I20260709 12:18:04.548995 15079 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5c19ae896ee04283b888065a716678f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c19ae896ee04283b888065a716678f4" member_type: VOTER }
I20260709 12:18:04.549520 15076 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5c19ae896ee04283b888065a716678f4 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:18:04.553714 15081 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c19ae896ee04283b888065a716678f4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5c19ae896ee04283b888065a716678f4. Latest consensus state: current_term: 1 leader_uuid: "5c19ae896ee04283b888065a716678f4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c19ae896ee04283b888065a716678f4" member_type: VOTER } }
I20260709 12:18:04.554728 15081 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c19ae896ee04283b888065a716678f4 [sys.catalog]: This master's current role is: LEADER
I20260709 12:18:04.554507 15080 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c19ae896ee04283b888065a716678f4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5c19ae896ee04283b888065a716678f4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c19ae896ee04283b888065a716678f4" member_type: VOTER } }
I20260709 12:18:04.555452 15080 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c19ae896ee04283b888065a716678f4 [sys.catalog]: This master's current role is: LEADER
I20260709 12:18:04.557137 15086 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:18:04.563566 15086 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:18:04.564565  3922 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:18:04.572798 15086 catalog_manager.cc:1383] Generated new cluster ID: c8dcd39c5f4d4bcebe8bb840044de706
I20260709 12:18:04.573091 15086 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:18:04.607213 15086 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:18:04.608561 15086 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:18:04.624127 15086 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 5c19ae896ee04283b888065a716678f4: Generated new TSK 0
I20260709 12:18:04.624814 15086 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:18:04.631875  3922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:04.638526 15097 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:04.639140 15098 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:04.642568  3922 server_base.cc:1061] running on GCE node
W20260709 12:18:04.642488 15100 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:04.644481  3922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:04.644703  3922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:04.644865  3922 hybrid_clock.cc:648] HybridClock initialized: now 1783599484644845 us; error 0 us; skew 500 ppm
I20260709 12:18:04.645529  3922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:04.648099  3922 webserver.cc:533] Webserver started at http://127.3.212.129:42243/ using document root <none> and password file <none>
I20260709 12:18:04.648623  3922 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:04.648806  3922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:04.649073  3922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:04.650309  3922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599103767690-3922-0/minicluster-data/ts-0-root/instance:
uuid: "ce91bb31f1d64e2897dd0da8047981c7"
format_stamp: "Formatted at 2026-07-09 12:18:04 on dist-test-slave-442x"
I20260709 12:18:04.654794  3922 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 12:18:04.658452 15105 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:04.659336  3922 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:18:04.659648  3922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599103767690-3922-0/minicluster-data/ts-0-root
uuid: "ce91bb31f1d64e2897dd0da8047981c7"
format_stamp: "Formatted at 2026-07-09 12:18:04 on dist-test-slave-442x"
I20260709 12:18:04.659912  3922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599103767690-3922-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599103767690-3922-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599103767690-3922-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:04.680140  3922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:04.681427  3922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:04.682947  3922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:18:04.685304  3922 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:18:04.685535  3922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:04.685781  3922 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:18:04.685959  3922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:04.730624  3922 rpc_server.cc:307] RPC server started. Bound to: 127.3.212.129:33633
I20260709 12:18:04.730724 15167 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.212.129:33633 every 8 connection(s)
I20260709 12:18:04.735402  3922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:04.744315 15172 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:04.745245 15173 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:04.753262 15168 heartbeater.cc:344] Connected to a master server at 127.3.212.190:35487
I20260709 12:18:04.754096 15168 heartbeater.cc:461] Registering TS with master...
I20260709 12:18:04.755336 15168 heartbeater.cc:507] Master 127.3.212.190:35487 requested a full tablet report, sending...
I20260709 12:18:04.757542  3922 server_base.cc:1061] running on GCE node
W20260709 12:18:04.757983 15175 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:04.758908 15041 ts_manager.cc:194] Registered new tserver with Master: ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633)
I20260709 12:18:04.759517  3922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:04.759778  3922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:04.759948  3922 hybrid_clock.cc:648] HybridClock initialized: now 1783599484759920 us; error 0 us; skew 500 ppm
I20260709 12:18:04.760545  3922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:04.760985 15041 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35356
I20260709 12:18:04.764096  3922 webserver.cc:533] Webserver started at http://127.3.212.130:45955/ using document root <none> and password file <none>
I20260709 12:18:04.764828  3922 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:04.765027  3922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:04.765290  3922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:04.766498  3922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599103767690-3922-0/minicluster-data/ts-1-root/instance:
uuid: "2e7e05bf49114cf092451fa7b0876174"
format_stamp: "Formatted at 2026-07-09 12:18:04 on dist-test-slave-442x"
I20260709 12:18:04.771411  3922 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 12:18:04.775133 15180 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:04.776093  3922 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:18:04.776433  3922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599103767690-3922-0/minicluster-data/ts-1-root
uuid: "2e7e05bf49114cf092451fa7b0876174"
format_stamp: "Formatted at 2026-07-09 12:18:04 on dist-test-slave-442x"
I20260709 12:18:04.776729  3922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599103767690-3922-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599103767690-3922-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599103767690-3922-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:04.803884  3922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:04.805106  3922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:04.806664  3922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:18:04.808983  3922 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:18:04.809199  3922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:04.809468  3922 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:18:04.809621  3922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:04.853161  3922 rpc_server.cc:307] RPC server started. Bound to: 127.3.212.130:42215
I20260709 12:18:04.853304 15242 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.212.130:42215 every 8 connection(s)
I20260709 12:18:04.858111  3922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:04.865567 15246 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:04.867796 15247 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:04.868738 15249 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:04.869865  3922 server_base.cc:1061] running on GCE node
I20260709 12:18:04.870658 15243 heartbeater.cc:344] Connected to a master server at 127.3.212.190:35487
I20260709 12:18:04.870883  3922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:18:04.871049 15243 heartbeater.cc:461] Registering TS with master...
W20260709 12:18:04.871170  3922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:04.871441  3922 hybrid_clock.cc:648] HybridClock initialized: now 1783599484871425 us; error 0 us; skew 500 ppm
I20260709 12:18:04.871928 15243 heartbeater.cc:507] Master 127.3.212.190:35487 requested a full tablet report, sending...
I20260709 12:18:04.872057  3922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:04.874342 15041 ts_manager.cc:194] Registered new tserver with Master: 2e7e05bf49114cf092451fa7b0876174 (127.3.212.130:42215)
I20260709 12:18:04.874788  3922 webserver.cc:533] Webserver started at http://127.3.212.131:39333/ using document root <none> and password file <none>
I20260709 12:18:04.875319  3922 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:04.875504  3922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:04.875756  3922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:04.875819 15041 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39576
I20260709 12:18:04.876910  3922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599103767690-3922-0/minicluster-data/ts-2-root/instance:
uuid: "999de4d383954ea5b7c75c01802c6497"
format_stamp: "Formatted at 2026-07-09 12:18:04 on dist-test-slave-442x"
I20260709 12:18:04.881876  3922 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:18:04.885864 15254 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:04.886911  3922 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:18:04.887238  3922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599103767690-3922-0/minicluster-data/ts-2-root
uuid: "999de4d383954ea5b7c75c01802c6497"
format_stamp: "Formatted at 2026-07-09 12:18:04 on dist-test-slave-442x"
I20260709 12:18:04.887519  3922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599103767690-3922-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599103767690-3922-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599103767690-3922-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:04.903530  3922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:04.904794  3922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:04.906288  3922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:18:04.908555  3922 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:18:04.908782  3922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:04.909020  3922 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:18:04.909193  3922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:04.951061  3922 rpc_server.cc:307] RPC server started. Bound to: 127.3.212.131:33219
I20260709 12:18:04.951159 15316 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.212.131:33219 every 8 connection(s)
I20260709 12:18:04.966130 15317 heartbeater.cc:344] Connected to a master server at 127.3.212.190:35487
I20260709 12:18:04.966533 15317 heartbeater.cc:461] Registering TS with master...
I20260709 12:18:04.967404 15317 heartbeater.cc:507] Master 127.3.212.190:35487 requested a full tablet report, sending...
I20260709 12:18:04.969738 15041 ts_manager.cc:194] Registered new tserver with Master: 999de4d383954ea5b7c75c01802c6497 (127.3.212.131:33219)
I20260709 12:18:04.970794  3922 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01637305s
I20260709 12:18:04.971376 15041 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39590
I20260709 12:18:04.999017 15041 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39602:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:18:05.002012 15041 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:18:05.075712 15208 tablet_service.cc:1511] Processing CreateTablet for tablet a58b64f9a4be4ed1973d74fac507d0e3 (DEFAULT_TABLE table=test-workload [id=d27440b2538d45c6a4c61f55546fd195]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:18:05.076515 15133 tablet_service.cc:1511] Processing CreateTablet for tablet a58b64f9a4be4ed1973d74fac507d0e3 (DEFAULT_TABLE table=test-workload [id=d27440b2538d45c6a4c61f55546fd195]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:18:05.077247 15208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a58b64f9a4be4ed1973d74fac507d0e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.077937 15133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a58b64f9a4be4ed1973d74fac507d0e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.079231 15204 tablet_service.cc:1511] Processing CreateTablet for tablet c1991cd59d6441abac887582832f6a2a (DEFAULT_TABLE table=test-workload [id=d27440b2538d45c6a4c61f55546fd195]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:18:05.080664 15204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1991cd59d6441abac887582832f6a2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.080947 15132 tablet_service.cc:1511] Processing CreateTablet for tablet 424d7c56ad0c4822a8d009c4d824a8d2 (DEFAULT_TABLE table=test-workload [id=d27440b2538d45c6a4c61f55546fd195]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:18:05.082363 15132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 424d7c56ad0c4822a8d009c4d824a8d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.086962 15131 tablet_service.cc:1511] Processing CreateTablet for tablet 65fd6772c01e480181699cb1c8246779 (DEFAULT_TABLE table=test-workload [id=d27440b2538d45c6a4c61f55546fd195]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:18:05.088475 15131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65fd6772c01e480181699cb1c8246779. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.090550 15206 tablet_service.cc:1511] Processing CreateTablet for tablet 65fd6772c01e480181699cb1c8246779 (DEFAULT_TABLE table=test-workload [id=d27440b2538d45c6a4c61f55546fd195]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:18:05.092052 15206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65fd6772c01e480181699cb1c8246779. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.094641 15130 tablet_service.cc:1511] Processing CreateTablet for tablet 7978baf90ead4534804cd2aeeef77fe0 (DEFAULT_TABLE table=test-workload [id=d27440b2538d45c6a4c61f55546fd195]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:18:05.096232 15130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7978baf90ead4534804cd2aeeef77fe0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.098536 15205 tablet_service.cc:1511] Processing CreateTablet for tablet 7978baf90ead4534804cd2aeeef77fe0 (DEFAULT_TABLE table=test-workload [id=d27440b2538d45c6a4c61f55546fd195]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:18:05.099923 15205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7978baf90ead4534804cd2aeeef77fe0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.102679 15203 tablet_service.cc:1511] Processing CreateTablet for tablet 3366909acc834c76ac9845f902ce93f6 (DEFAULT_TABLE table=test-workload [id=d27440b2538d45c6a4c61f55546fd195]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:18:05.104199 15203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3366909acc834c76ac9845f902ce93f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.106003 15201 tablet_service.cc:1511] Processing CreateTablet for tablet b0a2c042781548d3bb7125a8f78942a5 (DEFAULT_TABLE table=test-workload [id=d27440b2538d45c6a4c61f55546fd195]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:18:05.106310 15200 tablet_service.cc:1511] Processing CreateTablet for tablet 4fe037cbd5e841c3ba79c2a066b045a9 (DEFAULT_TABLE table=test-workload [id=d27440b2538d45c6a4c61f55546fd195]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:18:05.107476 15201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0a2c042781548d3bb7125a8f78942a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.108520 15200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fe037cbd5e841c3ba79c2a066b045a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.109033 15207 tablet_service.cc:1511] Processing CreateTablet for tablet 424d7c56ad0c4822a8d009c4d824a8d2 (DEFAULT_TABLE table=test-workload [id=d27440b2538d45c6a4c61f55546fd195]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:18:05.110487 15207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 424d7c56ad0c4822a8d009c4d824a8d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.111984 15202 tablet_service.cc:1511] Processing CreateTablet for tablet be5df69cad7f48c19a5e4aa80dcede4c (DEFAULT_TABLE table=test-workload [id=d27440b2538d45c6a4c61f55546fd195]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:18:05.113181 15202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be5df69cad7f48c19a5e4aa80dcede4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.116119 15128 tablet_service.cc:1511] Processing CreateTablet for tablet 3366909acc834c76ac9845f902ce93f6 (DEFAULT_TABLE table=test-workload [id=d27440b2538d45c6a4c61f55546fd195]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:18:05.118700 15128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3366909acc834c76ac9845f902ce93f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.118549 15126 tablet_service.cc:1511] Processing CreateTablet for tablet b0a2c042781548d3bb7125a8f78942a5 (DEFAULT_TABLE table=test-workload [id=d27440b2538d45c6a4c61f55546fd195]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:18:05.119907 15126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0a2c042781548d3bb7125a8f78942a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.117007 15129 tablet_service.cc:1511] Processing CreateTablet for tablet c1991cd59d6441abac887582832f6a2a (DEFAULT_TABLE table=test-workload [id=d27440b2538d45c6a4c61f55546fd195]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:18:05.120921 15129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1991cd59d6441abac887582832f6a2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.121961 15125 tablet_service.cc:1511] Processing CreateTablet for tablet 4fe037cbd5e841c3ba79c2a066b045a9 (DEFAULT_TABLE table=test-workload [id=d27440b2538d45c6a4c61f55546fd195]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:18:05.123306 15125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fe037cbd5e841c3ba79c2a066b045a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.126186 15127 tablet_service.cc:1511] Processing CreateTablet for tablet be5df69cad7f48c19a5e4aa80dcede4c (DEFAULT_TABLE table=test-workload [id=d27440b2538d45c6a4c61f55546fd195]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:18:05.127609 15127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be5df69cad7f48c19a5e4aa80dcede4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.130805 15282 tablet_service.cc:1511] Processing CreateTablet for tablet a58b64f9a4be4ed1973d74fac507d0e3 (DEFAULT_TABLE table=test-workload [id=d27440b2538d45c6a4c61f55546fd195]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:18:05.132221 15282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a58b64f9a4be4ed1973d74fac507d0e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.134614 15280 tablet_service.cc:1511] Processing CreateTablet for tablet 65fd6772c01e480181699cb1c8246779 (DEFAULT_TABLE table=test-workload [id=d27440b2538d45c6a4c61f55546fd195]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:18:05.136153 15280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65fd6772c01e480181699cb1c8246779. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.138624 15278 tablet_service.cc:1511] Processing CreateTablet for tablet c1991cd59d6441abac887582832f6a2a (DEFAULT_TABLE table=test-workload [id=d27440b2538d45c6a4c61f55546fd195]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:18:05.140199 15278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1991cd59d6441abac887582832f6a2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.142652 15277 tablet_service.cc:1511] Processing CreateTablet for tablet 3366909acc834c76ac9845f902ce93f6 (DEFAULT_TABLE table=test-workload [id=d27440b2538d45c6a4c61f55546fd195]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:18:05.145303 15276 tablet_service.cc:1511] Processing CreateTablet for tablet be5df69cad7f48c19a5e4aa80dcede4c (DEFAULT_TABLE table=test-workload [id=d27440b2538d45c6a4c61f55546fd195]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:18:05.147775 15279 tablet_service.cc:1511] Processing CreateTablet for tablet 7978baf90ead4534804cd2aeeef77fe0 (DEFAULT_TABLE table=test-workload [id=d27440b2538d45c6a4c61f55546fd195]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:18:05.149039 15275 tablet_service.cc:1511] Processing CreateTablet for tablet b0a2c042781548d3bb7125a8f78942a5 (DEFAULT_TABLE table=test-workload [id=d27440b2538d45c6a4c61f55546fd195]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:18:05.151747 15274 tablet_service.cc:1511] Processing CreateTablet for tablet 4fe037cbd5e841c3ba79c2a066b045a9 (DEFAULT_TABLE table=test-workload [id=d27440b2538d45c6a4c61f55546fd195]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:18:05.154448 15281 tablet_service.cc:1511] Processing CreateTablet for tablet 424d7c56ad0c4822a8d009c4d824a8d2 (DEFAULT_TABLE table=test-workload [id=d27440b2538d45c6a4c61f55546fd195]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:18:05.155627 15273 tablet_service.cc:1511] Processing CreateTablet for tablet c647fad7e69f46048ebcc6927eac1a58 (DEFAULT_TABLE table=test-workload [id=d27440b2538d45c6a4c61f55546fd195]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:18:05.150606 15124 tablet_service.cc:1511] Processing CreateTablet for tablet c647fad7e69f46048ebcc6927eac1a58 (DEFAULT_TABLE table=test-workload [id=d27440b2538d45c6a4c61f55546fd195]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:18:05.166553 15124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c647fad7e69f46048ebcc6927eac1a58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.184180 15332 tablet_bootstrap.cc:492] T c1991cd59d6441abac887582832f6a2a P 2e7e05bf49114cf092451fa7b0876174: Bootstrap starting.
I20260709 12:18:05.184227 15208 tablet_service.cc:1511] Processing CreateTablet for tablet c647fad7e69f46048ebcc6927eac1a58 (DEFAULT_TABLE table=test-workload [id=d27440b2538d45c6a4c61f55546fd195]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:18:05.193657 15208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c647fad7e69f46048ebcc6927eac1a58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.215538 15277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3366909acc834c76ac9845f902ce93f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.255154 15333 tablet_bootstrap.cc:492] T c1991cd59d6441abac887582832f6a2a P ce91bb31f1d64e2897dd0da8047981c7: Bootstrap starting.
I20260709 12:18:05.235601 15332 tablet_bootstrap.cc:654] T c1991cd59d6441abac887582832f6a2a P 2e7e05bf49114cf092451fa7b0876174: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:05.264186 15334 tablet_bootstrap.cc:492] T a58b64f9a4be4ed1973d74fac507d0e3 P 999de4d383954ea5b7c75c01802c6497: Bootstrap starting.
I20260709 12:18:05.261278 15333 tablet_bootstrap.cc:654] T c1991cd59d6441abac887582832f6a2a P ce91bb31f1d64e2897dd0da8047981c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:05.281497 15275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0a2c042781548d3bb7125a8f78942a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.282371 15274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fe037cbd5e841c3ba79c2a066b045a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.284710 15279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7978baf90ead4534804cd2aeeef77fe0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.289798 15276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be5df69cad7f48c19a5e4aa80dcede4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.297784 15273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c647fad7e69f46048ebcc6927eac1a58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.305639 15281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 424d7c56ad0c4822a8d009c4d824a8d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:05.334582 15334 tablet_bootstrap.cc:654] T a58b64f9a4be4ed1973d74fac507d0e3 P 999de4d383954ea5b7c75c01802c6497: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:05.353683 15332 tablet_bootstrap.cc:492] T c1991cd59d6441abac887582832f6a2a P 2e7e05bf49114cf092451fa7b0876174: No bootstrap required, opened a new log
I20260709 12:18:05.354112 15332 ts_tablet_manager.cc:1403] T c1991cd59d6441abac887582832f6a2a P 2e7e05bf49114cf092451fa7b0876174: Time spent bootstrapping tablet: real 0.170s	user 0.010s	sys 0.014s
I20260709 12:18:05.356240 15332 raft_consensus.cc:359] T c1991cd59d6441abac887582832f6a2a P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.356752 15332 raft_consensus.cc:385] T c1991cd59d6441abac887582832f6a2a P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:05.357048 15332 raft_consensus.cc:740] T c1991cd59d6441abac887582832f6a2a P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e7e05bf49114cf092451fa7b0876174, State: Initialized, Role: FOLLOWER
I20260709 12:18:05.357894 15332 consensus_queue.cc:260] T c1991cd59d6441abac887582832f6a2a P 2e7e05bf49114cf092451fa7b0876174 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.360991 15332 ts_tablet_manager.cc:1434] T c1991cd59d6441abac887582832f6a2a P 2e7e05bf49114cf092451fa7b0876174: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:18:05.361652 15334 tablet_bootstrap.cc:492] T a58b64f9a4be4ed1973d74fac507d0e3 P 999de4d383954ea5b7c75c01802c6497: No bootstrap required, opened a new log
I20260709 12:18:05.361975 15332 tablet_bootstrap.cc:492] T a58b64f9a4be4ed1973d74fac507d0e3 P 2e7e05bf49114cf092451fa7b0876174: Bootstrap starting.
I20260709 12:18:05.361976 15333 tablet_bootstrap.cc:492] T c1991cd59d6441abac887582832f6a2a P ce91bb31f1d64e2897dd0da8047981c7: No bootstrap required, opened a new log
I20260709 12:18:05.362154 15334 ts_tablet_manager.cc:1403] T a58b64f9a4be4ed1973d74fac507d0e3 P 999de4d383954ea5b7c75c01802c6497: Time spent bootstrapping tablet: real 0.098s	user 0.007s	sys 0.008s
I20260709 12:18:05.362762 15333 ts_tablet_manager.cc:1403] T c1991cd59d6441abac887582832f6a2a P ce91bb31f1d64e2897dd0da8047981c7: Time spent bootstrapping tablet: real 0.108s	user 0.018s	sys 0.020s
I20260709 12:18:05.364733 15334 raft_consensus.cc:359] T a58b64f9a4be4ed1973d74fac507d0e3 P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.403669 15243 heartbeater.cc:499] Master 127.3.212.190:35487 was elected leader, sending a full tablet report...
W20260709 12:18:05.407109 15244 tablet.cc:2406] T c1991cd59d6441abac887582832f6a2a P 2e7e05bf49114cf092451fa7b0876174: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:18:05.365343 15334 raft_consensus.cc:385] T a58b64f9a4be4ed1973d74fac507d0e3 P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:05.431435 15334 raft_consensus.cc:740] T a58b64f9a4be4ed1973d74fac507d0e3 P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 999de4d383954ea5b7c75c01802c6497, State: Initialized, Role: FOLLOWER
I20260709 12:18:05.432749 15334 consensus_queue.cc:260] T a58b64f9a4be4ed1973d74fac507d0e3 P 999de4d383954ea5b7c75c01802c6497 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.409186 15333 raft_consensus.cc:359] T c1991cd59d6441abac887582832f6a2a P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.436918 15317 heartbeater.cc:499] Master 127.3.212.190:35487 was elected leader, sending a full tablet report...
I20260709 12:18:05.443149 15334 ts_tablet_manager.cc:1434] T a58b64f9a4be4ed1973d74fac507d0e3 P 999de4d383954ea5b7c75c01802c6497: Time spent starting tablet: real 0.080s	user 0.006s	sys 0.000s
I20260709 12:18:05.434540 15333 raft_consensus.cc:385] T c1991cd59d6441abac887582832f6a2a P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:05.443854 15333 raft_consensus.cc:740] T c1991cd59d6441abac887582832f6a2a P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce91bb31f1d64e2897dd0da8047981c7, State: Initialized, Role: FOLLOWER
I20260709 12:18:05.444995 15333 consensus_queue.cc:260] T c1991cd59d6441abac887582832f6a2a P ce91bb31f1d64e2897dd0da8047981c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.445861 15332 tablet_bootstrap.cc:654] T a58b64f9a4be4ed1973d74fac507d0e3 P 2e7e05bf49114cf092451fa7b0876174: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:05.447214 15334 tablet_bootstrap.cc:492] T 65fd6772c01e480181699cb1c8246779 P 999de4d383954ea5b7c75c01802c6497: Bootstrap starting.
I20260709 12:18:05.456563 15334 tablet_bootstrap.cc:654] T 65fd6772c01e480181699cb1c8246779 P 999de4d383954ea5b7c75c01802c6497: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:05.456910 15333 ts_tablet_manager.cc:1434] T c1991cd59d6441abac887582832f6a2a P ce91bb31f1d64e2897dd0da8047981c7: Time spent starting tablet: real 0.094s	user 0.007s	sys 0.007s
I20260709 12:18:05.458328 15168 heartbeater.cc:499] Master 127.3.212.190:35487 was elected leader, sending a full tablet report...
I20260709 12:18:05.469026 15334 tablet_bootstrap.cc:492] T 65fd6772c01e480181699cb1c8246779 P 999de4d383954ea5b7c75c01802c6497: No bootstrap required, opened a new log
I20260709 12:18:05.469728 15334 ts_tablet_manager.cc:1403] T 65fd6772c01e480181699cb1c8246779 P 999de4d383954ea5b7c75c01802c6497: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.007s
I20260709 12:18:05.470912 15333 tablet_bootstrap.cc:492] T b0a2c042781548d3bb7125a8f78942a5 P ce91bb31f1d64e2897dd0da8047981c7: Bootstrap starting.
I20260709 12:18:05.475630 15334 raft_consensus.cc:359] T 65fd6772c01e480181699cb1c8246779 P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.476490 15334 raft_consensus.cc:385] T 65fd6772c01e480181699cb1c8246779 P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:05.476825 15334 raft_consensus.cc:740] T 65fd6772c01e480181699cb1c8246779 P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 999de4d383954ea5b7c75c01802c6497, State: Initialized, Role: FOLLOWER
I20260709 12:18:05.477186 15332 tablet_bootstrap.cc:492] T a58b64f9a4be4ed1973d74fac507d0e3 P 2e7e05bf49114cf092451fa7b0876174: No bootstrap required, opened a new log
I20260709 12:18:05.477960 15332 ts_tablet_manager.cc:1403] T a58b64f9a4be4ed1973d74fac507d0e3 P 2e7e05bf49114cf092451fa7b0876174: Time spent bootstrapping tablet: real 0.116s	user 0.014s	sys 0.018s
I20260709 12:18:05.477972 15334 consensus_queue.cc:260] T 65fd6772c01e480181699cb1c8246779 P 999de4d383954ea5b7c75c01802c6497 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.480789 15334 ts_tablet_manager.cc:1434] T 65fd6772c01e480181699cb1c8246779 P 999de4d383954ea5b7c75c01802c6497: Time spent starting tablet: real 0.011s	user 0.000s	sys 0.008s
I20260709 12:18:05.482074 15334 tablet_bootstrap.cc:492] T 4fe037cbd5e841c3ba79c2a066b045a9 P 999de4d383954ea5b7c75c01802c6497: Bootstrap starting.
I20260709 12:18:05.482069 15332 raft_consensus.cc:359] T a58b64f9a4be4ed1973d74fac507d0e3 P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.483071 15332 raft_consensus.cc:385] T a58b64f9a4be4ed1973d74fac507d0e3 P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:05.483387 15332 raft_consensus.cc:740] T a58b64f9a4be4ed1973d74fac507d0e3 P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e7e05bf49114cf092451fa7b0876174, State: Initialized, Role: FOLLOWER
I20260709 12:18:05.484365 15332 consensus_queue.cc:260] T a58b64f9a4be4ed1973d74fac507d0e3 P 2e7e05bf49114cf092451fa7b0876174 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.485919 15333 tablet_bootstrap.cc:654] T b0a2c042781548d3bb7125a8f78942a5 P ce91bb31f1d64e2897dd0da8047981c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:05.491060 15334 tablet_bootstrap.cc:654] T 4fe037cbd5e841c3ba79c2a066b045a9 P 999de4d383954ea5b7c75c01802c6497: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:05.497684 15332 ts_tablet_manager.cc:1434] T a58b64f9a4be4ed1973d74fac507d0e3 P 2e7e05bf49114cf092451fa7b0876174: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.001s
I20260709 12:18:05.500336 15332 tablet_bootstrap.cc:492] T 65fd6772c01e480181699cb1c8246779 P 2e7e05bf49114cf092451fa7b0876174: Bootstrap starting.
I20260709 12:18:05.500280 15333 tablet_bootstrap.cc:492] T b0a2c042781548d3bb7125a8f78942a5 P ce91bb31f1d64e2897dd0da8047981c7: No bootstrap required, opened a new log
I20260709 12:18:05.501266 15333 ts_tablet_manager.cc:1403] T b0a2c042781548d3bb7125a8f78942a5 P ce91bb31f1d64e2897dd0da8047981c7: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.008s
I20260709 12:18:05.505100 15333 raft_consensus.cc:359] T b0a2c042781548d3bb7125a8f78942a5 P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.506006 15333 raft_consensus.cc:385] T b0a2c042781548d3bb7125a8f78942a5 P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:05.506371 15333 raft_consensus.cc:740] T b0a2c042781548d3bb7125a8f78942a5 P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce91bb31f1d64e2897dd0da8047981c7, State: Initialized, Role: FOLLOWER
I20260709 12:18:05.508571 15333 consensus_queue.cc:260] T b0a2c042781548d3bb7125a8f78942a5 P ce91bb31f1d64e2897dd0da8047981c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.509966 15334 tablet_bootstrap.cc:492] T 4fe037cbd5e841c3ba79c2a066b045a9 P 999de4d383954ea5b7c75c01802c6497: No bootstrap required, opened a new log
I20260709 12:18:05.510018 15332 tablet_bootstrap.cc:654] T 65fd6772c01e480181699cb1c8246779 P 2e7e05bf49114cf092451fa7b0876174: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:05.510658 15334 ts_tablet_manager.cc:1403] T 4fe037cbd5e841c3ba79c2a066b045a9 P 999de4d383954ea5b7c75c01802c6497: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.009s
I20260709 12:18:05.510924 15333 ts_tablet_manager.cc:1434] T b0a2c042781548d3bb7125a8f78942a5 P ce91bb31f1d64e2897dd0da8047981c7: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 12:18:05.512200 15333 tablet_bootstrap.cc:492] T 7978baf90ead4534804cd2aeeef77fe0 P ce91bb31f1d64e2897dd0da8047981c7: Bootstrap starting.
I20260709 12:18:05.513968 15334 raft_consensus.cc:359] T 4fe037cbd5e841c3ba79c2a066b045a9 P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.514803 15334 raft_consensus.cc:385] T 4fe037cbd5e841c3ba79c2a066b045a9 P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:05.515105 15334 raft_consensus.cc:740] T 4fe037cbd5e841c3ba79c2a066b045a9 P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 999de4d383954ea5b7c75c01802c6497, State: Initialized, Role: FOLLOWER
I20260709 12:18:05.515183 15339 raft_consensus.cc:493] T c1991cd59d6441abac887582832f6a2a P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:05.515873 15339 raft_consensus.cc:515] T c1991cd59d6441abac887582832f6a2a P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.516184 15334 consensus_queue.cc:260] T 4fe037cbd5e841c3ba79c2a066b045a9 P 999de4d383954ea5b7c75c01802c6497 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.518694 15334 ts_tablet_manager.cc:1434] T 4fe037cbd5e841c3ba79c2a066b045a9 P 999de4d383954ea5b7c75c01802c6497: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 12:18:05.519933 15334 tablet_bootstrap.cc:492] T 3366909acc834c76ac9845f902ce93f6 P 999de4d383954ea5b7c75c01802c6497: Bootstrap starting.
I20260709 12:18:05.527350 15334 tablet_bootstrap.cc:654] T 3366909acc834c76ac9845f902ce93f6 P 999de4d383954ea5b7c75c01802c6497: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:05.531694 15339 leader_election.cc:290] T c1991cd59d6441abac887582832f6a2a P 2e7e05bf49114cf092451fa7b0876174 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633), 999de4d383954ea5b7c75c01802c6497 (127.3.212.131:33219)
I20260709 12:18:05.533735 15332 tablet_bootstrap.cc:492] T 65fd6772c01e480181699cb1c8246779 P 2e7e05bf49114cf092451fa7b0876174: No bootstrap required, opened a new log
I20260709 12:18:05.534390 15332 ts_tablet_manager.cc:1403] T 65fd6772c01e480181699cb1c8246779 P 2e7e05bf49114cf092451fa7b0876174: Time spent bootstrapping tablet: real 0.034s	user 0.022s	sys 0.007s
I20260709 12:18:05.535409 15334 tablet_bootstrap.cc:492] T 3366909acc834c76ac9845f902ce93f6 P 999de4d383954ea5b7c75c01802c6497: No bootstrap required, opened a new log
I20260709 12:18:05.536005 15334 ts_tablet_manager.cc:1403] T 3366909acc834c76ac9845f902ce93f6 P 999de4d383954ea5b7c75c01802c6497: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.001s
I20260709 12:18:05.538051 15332 raft_consensus.cc:359] T 65fd6772c01e480181699cb1c8246779 P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.539239 15332 raft_consensus.cc:385] T 65fd6772c01e480181699cb1c8246779 P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:05.539572 15332 raft_consensus.cc:740] T 65fd6772c01e480181699cb1c8246779 P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e7e05bf49114cf092451fa7b0876174, State: Initialized, Role: FOLLOWER
I20260709 12:18:05.540493 15332 consensus_queue.cc:260] T 65fd6772c01e480181699cb1c8246779 P 2e7e05bf49114cf092451fa7b0876174 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.543035 15332 ts_tablet_manager.cc:1434] T 65fd6772c01e480181699cb1c8246779 P 2e7e05bf49114cf092451fa7b0876174: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 12:18:05.543421 15333 tablet_bootstrap.cc:654] T 7978baf90ead4534804cd2aeeef77fe0 P ce91bb31f1d64e2897dd0da8047981c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:05.544304 15332 tablet_bootstrap.cc:492] T 7978baf90ead4534804cd2aeeef77fe0 P 2e7e05bf49114cf092451fa7b0876174: Bootstrap starting.
I20260709 12:18:05.538661 15334 raft_consensus.cc:359] T 3366909acc834c76ac9845f902ce93f6 P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.545562 15334 raft_consensus.cc:385] T 3366909acc834c76ac9845f902ce93f6 P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:05.545944 15334 raft_consensus.cc:740] T 3366909acc834c76ac9845f902ce93f6 P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 999de4d383954ea5b7c75c01802c6497, State: Initialized, Role: FOLLOWER
I20260709 12:18:05.546962 15334 consensus_queue.cc:260] T 3366909acc834c76ac9845f902ce93f6 P 999de4d383954ea5b7c75c01802c6497 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.549604 15334 ts_tablet_manager.cc:1434] T 3366909acc834c76ac9845f902ce93f6 P 999de4d383954ea5b7c75c01802c6497: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:18:05.550989 15334 tablet_bootstrap.cc:492] T 7978baf90ead4534804cd2aeeef77fe0 P 999de4d383954ea5b7c75c01802c6497: Bootstrap starting.
I20260709 12:18:05.552491 15339 raft_consensus.cc:493] T a58b64f9a4be4ed1973d74fac507d0e3 P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:05.560051 15334 tablet_bootstrap.cc:654] T 7978baf90ead4534804cd2aeeef77fe0 P 999de4d383954ea5b7c75c01802c6497: Neither blocks nor log segments found. Creating new log.
W20260709 12:18:05.560489 15089 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:18:05.559947 15339 raft_consensus.cc:515] T a58b64f9a4be4ed1973d74fac507d0e3 P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.567777 15143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1991cd59d6441abac887582832f6a2a" candidate_uuid: "2e7e05bf49114cf092451fa7b0876174" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce91bb31f1d64e2897dd0da8047981c7" is_pre_election: true
I20260709 12:18:05.569221 15143 raft_consensus.cc:2468] T c1991cd59d6441abac887582832f6a2a P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e7e05bf49114cf092451fa7b0876174 in term 0.
I20260709 12:18:05.572556 15292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1991cd59d6441abac887582832f6a2a" candidate_uuid: "2e7e05bf49114cf092451fa7b0876174" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "999de4d383954ea5b7c75c01802c6497" is_pre_election: true
I20260709 12:18:05.573441 15291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a58b64f9a4be4ed1973d74fac507d0e3" candidate_uuid: "2e7e05bf49114cf092451fa7b0876174" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "999de4d383954ea5b7c75c01802c6497" is_pre_election: true
I20260709 12:18:05.574260 15291 raft_consensus.cc:2468] T a58b64f9a4be4ed1973d74fac507d0e3 P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e7e05bf49114cf092451fa7b0876174 in term 0.
I20260709 12:18:05.572536 15339 leader_election.cc:290] T a58b64f9a4be4ed1973d74fac507d0e3 P 2e7e05bf49114cf092451fa7b0876174 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633), 999de4d383954ea5b7c75c01802c6497 (127.3.212.131:33219)
I20260709 12:18:05.574419 15143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a58b64f9a4be4ed1973d74fac507d0e3" candidate_uuid: "2e7e05bf49114cf092451fa7b0876174" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce91bb31f1d64e2897dd0da8047981c7" is_pre_election: true
I20260709 12:18:05.573441 15182 leader_election.cc:304] T c1991cd59d6441abac887582832f6a2a P 2e7e05bf49114cf092451fa7b0876174 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e7e05bf49114cf092451fa7b0876174, ce91bb31f1d64e2897dd0da8047981c7; no voters: 
I20260709 12:18:05.576999 15339 raft_consensus.cc:2804] T c1991cd59d6441abac887582832f6a2a P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:05.577111 15332 tablet_bootstrap.cc:654] T 7978baf90ead4534804cd2aeeef77fe0 P 2e7e05bf49114cf092451fa7b0876174: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:05.577507 15339 raft_consensus.cc:493] T c1991cd59d6441abac887582832f6a2a P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:05.577796 15181 leader_election.cc:343] T c1991cd59d6441abac887582832f6a2a P 2e7e05bf49114cf092451fa7b0876174 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 999de4d383954ea5b7c75c01802c6497 (127.3.212.131:33219): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:18:05.577229 15182 leader_election.cc:343] T a58b64f9a4be4ed1973d74fac507d0e3 P 2e7e05bf49114cf092451fa7b0876174 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:05.579205 15181 leader_election.cc:304] T a58b64f9a4be4ed1973d74fac507d0e3 P 2e7e05bf49114cf092451fa7b0876174 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e7e05bf49114cf092451fa7b0876174, 999de4d383954ea5b7c75c01802c6497; no voters: ce91bb31f1d64e2897dd0da8047981c7
I20260709 12:18:05.580996 15339 raft_consensus.cc:3060] T c1991cd59d6441abac887582832f6a2a P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:05.583922 15333 tablet_bootstrap.cc:492] T 7978baf90ead4534804cd2aeeef77fe0 P ce91bb31f1d64e2897dd0da8047981c7: No bootstrap required, opened a new log
I20260709 12:18:05.584581 15333 ts_tablet_manager.cc:1403] T 7978baf90ead4534804cd2aeeef77fe0 P ce91bb31f1d64e2897dd0da8047981c7: Time spent bootstrapping tablet: real 0.073s	user 0.009s	sys 0.005s
I20260709 12:18:05.586349 15350 raft_consensus.cc:2804] T a58b64f9a4be4ed1973d74fac507d0e3 P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:05.587987 15333 raft_consensus.cc:359] T 7978baf90ead4534804cd2aeeef77fe0 P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.594944 15333 raft_consensus.cc:385] T 7978baf90ead4534804cd2aeeef77fe0 P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:05.595295 15333 raft_consensus.cc:740] T 7978baf90ead4534804cd2aeeef77fe0 P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce91bb31f1d64e2897dd0da8047981c7, State: Initialized, Role: FOLLOWER
I20260709 12:18:05.596169 15333 consensus_queue.cc:260] T 7978baf90ead4534804cd2aeeef77fe0 P ce91bb31f1d64e2897dd0da8047981c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.596532 15334 tablet_bootstrap.cc:492] T 7978baf90ead4534804cd2aeeef77fe0 P 999de4d383954ea5b7c75c01802c6497: No bootstrap required, opened a new log
I20260709 12:18:05.596504 15339 raft_consensus.cc:515] T c1991cd59d6441abac887582832f6a2a P 2e7e05bf49114cf092451fa7b0876174 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.597254 15334 ts_tablet_manager.cc:1403] T 7978baf90ead4534804cd2aeeef77fe0 P 999de4d383954ea5b7c75c01802c6497: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.028s
I20260709 12:18:05.598819 15333 ts_tablet_manager.cc:1434] T 7978baf90ead4534804cd2aeeef77fe0 P ce91bb31f1d64e2897dd0da8047981c7: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.002s
I20260709 12:18:05.599699 15143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1991cd59d6441abac887582832f6a2a" candidate_uuid: "2e7e05bf49114cf092451fa7b0876174" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce91bb31f1d64e2897dd0da8047981c7"
I20260709 12:18:05.590025 15332 tablet_bootstrap.cc:492] T 7978baf90ead4534804cd2aeeef77fe0 P 2e7e05bf49114cf092451fa7b0876174: No bootstrap required, opened a new log
I20260709 12:18:05.600301 15143 raft_consensus.cc:3060] T c1991cd59d6441abac887582832f6a2a P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:05.600513 15332 ts_tablet_manager.cc:1403] T 7978baf90ead4534804cd2aeeef77fe0 P 2e7e05bf49114cf092451fa7b0876174: Time spent bootstrapping tablet: real 0.056s	user 0.012s	sys 0.009s
I20260709 12:18:05.600570 15334 raft_consensus.cc:359] T 7978baf90ead4534804cd2aeeef77fe0 P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.601555 15334 raft_consensus.cc:385] T 7978baf90ead4534804cd2aeeef77fe0 P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:05.601918 15334 raft_consensus.cc:740] T 7978baf90ead4534804cd2aeeef77fe0 P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 999de4d383954ea5b7c75c01802c6497, State: Initialized, Role: FOLLOWER
I20260709 12:18:05.602763 15334 consensus_queue.cc:260] T 7978baf90ead4534804cd2aeeef77fe0 P 999de4d383954ea5b7c75c01802c6497 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.604110 15332 raft_consensus.cc:359] T 7978baf90ead4534804cd2aeeef77fe0 P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.604897 15332 raft_consensus.cc:385] T 7978baf90ead4534804cd2aeeef77fe0 P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:05.600039 15333 tablet_bootstrap.cc:492] T 3366909acc834c76ac9845f902ce93f6 P ce91bb31f1d64e2897dd0da8047981c7: Bootstrap starting.
I20260709 12:18:05.605094 15334 ts_tablet_manager.cc:1434] T 7978baf90ead4534804cd2aeeef77fe0 P 999de4d383954ea5b7c75c01802c6497: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.007s
I20260709 12:18:05.606559 15334 tablet_bootstrap.cc:492] T c1991cd59d6441abac887582832f6a2a P 999de4d383954ea5b7c75c01802c6497: Bootstrap starting.
I20260709 12:18:05.610659 15143 raft_consensus.cc:2468] T c1991cd59d6441abac887582832f6a2a P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e7e05bf49114cf092451fa7b0876174 in term 1.
I20260709 12:18:05.612094 15182 leader_election.cc:304] T c1991cd59d6441abac887582832f6a2a P 2e7e05bf49114cf092451fa7b0876174 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e7e05bf49114cf092451fa7b0876174, ce91bb31f1d64e2897dd0da8047981c7; no voters: 
I20260709 12:18:05.613268 15334 tablet_bootstrap.cc:654] T c1991cd59d6441abac887582832f6a2a P 999de4d383954ea5b7c75c01802c6497: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:05.613350 15332 raft_consensus.cc:740] T 7978baf90ead4534804cd2aeeef77fe0 P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e7e05bf49114cf092451fa7b0876174, State: Initialized, Role: FOLLOWER
I20260709 12:18:05.614385 15350 raft_consensus.cc:493] T a58b64f9a4be4ed1973d74fac507d0e3 P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:05.614812 15350 raft_consensus.cc:3060] T a58b64f9a4be4ed1973d74fac507d0e3 P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:05.617998 15339 leader_election.cc:290] T c1991cd59d6441abac887582832f6a2a P 2e7e05bf49114cf092451fa7b0876174 [CANDIDATE]: Term 1 election: Requested vote from peers ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633), 999de4d383954ea5b7c75c01802c6497 (127.3.212.131:33219)
I20260709 12:18:05.618716 15339 raft_consensus.cc:2804] T c1991cd59d6441abac887582832f6a2a P 2e7e05bf49114cf092451fa7b0876174 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:05.619181 15339 raft_consensus.cc:697] T c1991cd59d6441abac887582832f6a2a P 2e7e05bf49114cf092451fa7b0876174 [term 1 LEADER]: Becoming Leader. State: Replica: 2e7e05bf49114cf092451fa7b0876174, State: Running, Role: LEADER
I20260709 12:18:05.619274 15291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1991cd59d6441abac887582832f6a2a" candidate_uuid: "2e7e05bf49114cf092451fa7b0876174" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "999de4d383954ea5b7c75c01802c6497"
W20260709 12:18:05.621171 15181 leader_election.cc:343] T c1991cd59d6441abac887582832f6a2a P 2e7e05bf49114cf092451fa7b0876174 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 999de4d383954ea5b7c75c01802c6497 (127.3.212.131:33219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:05.620206 15339 consensus_queue.cc:237] T c1991cd59d6441abac887582832f6a2a P 2e7e05bf49114cf092451fa7b0876174 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.618002 15332 consensus_queue.cc:260] T 7978baf90ead4534804cd2aeeef77fe0 P 2e7e05bf49114cf092451fa7b0876174 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.613279 15333 tablet_bootstrap.cc:654] T 3366909acc834c76ac9845f902ce93f6 P ce91bb31f1d64e2897dd0da8047981c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:05.625331 15350 raft_consensus.cc:515] T a58b64f9a4be4ed1973d74fac507d0e3 P 2e7e05bf49114cf092451fa7b0876174 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.630800 15291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a58b64f9a4be4ed1973d74fac507d0e3" candidate_uuid: "2e7e05bf49114cf092451fa7b0876174" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "999de4d383954ea5b7c75c01802c6497"
I20260709 12:18:05.631515 15291 raft_consensus.cc:3060] T a58b64f9a4be4ed1973d74fac507d0e3 P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:05.633234 15350 leader_election.cc:290] T a58b64f9a4be4ed1973d74fac507d0e3 P 2e7e05bf49114cf092451fa7b0876174 [CANDIDATE]: Term 1 election: Requested vote from peers ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633), 999de4d383954ea5b7c75c01802c6497 (127.3.212.131:33219)
I20260709 12:18:05.637110 15332 ts_tablet_manager.cc:1434] T 7978baf90ead4534804cd2aeeef77fe0 P 2e7e05bf49114cf092451fa7b0876174: Time spent starting tablet: real 0.036s	user 0.011s	sys 0.000s
I20260709 12:18:05.638427 15332 tablet_bootstrap.cc:492] T 3366909acc834c76ac9845f902ce93f6 P 2e7e05bf49114cf092451fa7b0876174: Bootstrap starting.
I20260709 12:18:05.640161 15334 tablet_bootstrap.cc:492] T c1991cd59d6441abac887582832f6a2a P 999de4d383954ea5b7c75c01802c6497: No bootstrap required, opened a new log
I20260709 12:18:05.640813 15334 ts_tablet_manager.cc:1403] T c1991cd59d6441abac887582832f6a2a P 999de4d383954ea5b7c75c01802c6497: Time spent bootstrapping tablet: real 0.035s	user 0.019s	sys 0.008s
I20260709 12:18:05.643164 15291 raft_consensus.cc:2468] T a58b64f9a4be4ed1973d74fac507d0e3 P 999de4d383954ea5b7c75c01802c6497 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e7e05bf49114cf092451fa7b0876174 in term 1.
I20260709 12:18:05.644346 15334 raft_consensus.cc:359] T c1991cd59d6441abac887582832f6a2a P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.646807 15334 raft_consensus.cc:385] T c1991cd59d6441abac887582832f6a2a P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:05.647173 15334 raft_consensus.cc:740] T c1991cd59d6441abac887582832f6a2a P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 999de4d383954ea5b7c75c01802c6497, State: Initialized, Role: FOLLOWER
I20260709 12:18:05.648085 15334 consensus_queue.cc:260] T c1991cd59d6441abac887582832f6a2a P 999de4d383954ea5b7c75c01802c6497 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.644886 15181 leader_election.cc:304] T a58b64f9a4be4ed1973d74fac507d0e3 P 2e7e05bf49114cf092451fa7b0876174 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e7e05bf49114cf092451fa7b0876174, 999de4d383954ea5b7c75c01802c6497; no voters: 
I20260709 12:18:05.646646 15340 raft_consensus.cc:493] T 65fd6772c01e480181699cb1c8246779 P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:05.650332 15354 raft_consensus.cc:2804] T a58b64f9a4be4ed1973d74fac507d0e3 P 2e7e05bf49114cf092451fa7b0876174 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:05.651096 15354 raft_consensus.cc:697] T a58b64f9a4be4ed1973d74fac507d0e3 P 2e7e05bf49114cf092451fa7b0876174 [term 1 LEADER]: Becoming Leader. State: Replica: 2e7e05bf49114cf092451fa7b0876174, State: Running, Role: LEADER
I20260709 12:18:05.651652 15143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a58b64f9a4be4ed1973d74fac507d0e3" candidate_uuid: "2e7e05bf49114cf092451fa7b0876174" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce91bb31f1d64e2897dd0da8047981c7"
I20260709 12:18:05.651938 15354 consensus_queue.cc:237] T a58b64f9a4be4ed1973d74fac507d0e3 P 2e7e05bf49114cf092451fa7b0876174 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
W20260709 12:18:05.653432 15182 leader_election.cc:343] T a58b64f9a4be4ed1973d74fac507d0e3 P 2e7e05bf49114cf092451fa7b0876174 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:05.653967 15041 catalog_manager.cc:5697] T c1991cd59d6441abac887582832f6a2a P 2e7e05bf49114cf092451fa7b0876174 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e7e05bf49114cf092451fa7b0876174 (127.3.212.130). New cstate: current_term: 1 leader_uuid: "2e7e05bf49114cf092451fa7b0876174" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:05.650025 15340 raft_consensus.cc:515] T 65fd6772c01e480181699cb1c8246779 P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.658015 15332 tablet_bootstrap.cc:654] T 3366909acc834c76ac9845f902ce93f6 P 2e7e05bf49114cf092451fa7b0876174: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:05.660372 15340 leader_election.cc:290] T 65fd6772c01e480181699cb1c8246779 P 999de4d383954ea5b7c75c01802c6497 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633), 2e7e05bf49114cf092451fa7b0876174 (127.3.212.130:42215)
I20260709 12:18:05.676070 15334 ts_tablet_manager.cc:1434] T c1991cd59d6441abac887582832f6a2a P 999de4d383954ea5b7c75c01802c6497: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.016s
I20260709 12:18:05.677318 15334 tablet_bootstrap.cc:492] T be5df69cad7f48c19a5e4aa80dcede4c P 999de4d383954ea5b7c75c01802c6497: Bootstrap starting.
I20260709 12:18:05.678239 15333 tablet_bootstrap.cc:492] T 3366909acc834c76ac9845f902ce93f6 P ce91bb31f1d64e2897dd0da8047981c7: No bootstrap required, opened a new log
I20260709 12:18:05.678846 15333 ts_tablet_manager.cc:1403] T 3366909acc834c76ac9845f902ce93f6 P ce91bb31f1d64e2897dd0da8047981c7: Time spent bootstrapping tablet: real 0.079s	user 0.018s	sys 0.003s
I20260709 12:18:05.682286 15333 raft_consensus.cc:359] T 3366909acc834c76ac9845f902ce93f6 P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.683174 15333 raft_consensus.cc:385] T 3366909acc834c76ac9845f902ce93f6 P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:05.683512 15333 raft_consensus.cc:740] T 3366909acc834c76ac9845f902ce93f6 P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce91bb31f1d64e2897dd0da8047981c7, State: Initialized, Role: FOLLOWER
I20260709 12:18:05.684538 15333 consensus_queue.cc:260] T 3366909acc834c76ac9845f902ce93f6 P ce91bb31f1d64e2897dd0da8047981c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.687264 15334 tablet_bootstrap.cc:654] T be5df69cad7f48c19a5e4aa80dcede4c P 999de4d383954ea5b7c75c01802c6497: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:05.701102 15333 ts_tablet_manager.cc:1434] T 3366909acc834c76ac9845f902ce93f6 P ce91bb31f1d64e2897dd0da8047981c7: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:18:05.703902 15334 tablet_bootstrap.cc:492] T be5df69cad7f48c19a5e4aa80dcede4c P 999de4d383954ea5b7c75c01802c6497: No bootstrap required, opened a new log
I20260709 12:18:05.704527 15334 ts_tablet_manager.cc:1403] T be5df69cad7f48c19a5e4aa80dcede4c P 999de4d383954ea5b7c75c01802c6497: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.001s
I20260709 12:18:05.707229 15143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fd6772c01e480181699cb1c8246779" candidate_uuid: "999de4d383954ea5b7c75c01802c6497" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce91bb31f1d64e2897dd0da8047981c7" is_pre_election: true
I20260709 12:18:05.707719 15334 raft_consensus.cc:359] T be5df69cad7f48c19a5e4aa80dcede4c P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.708490 15334 raft_consensus.cc:385] T be5df69cad7f48c19a5e4aa80dcede4c P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:05.708778 15334 raft_consensus.cc:740] T be5df69cad7f48c19a5e4aa80dcede4c P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 999de4d383954ea5b7c75c01802c6497, State: Initialized, Role: FOLLOWER
W20260709 12:18:05.710132 15256 leader_election.cc:343] T 65fd6772c01e480181699cb1c8246779 P 999de4d383954ea5b7c75c01802c6497 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:05.714257 15333 tablet_bootstrap.cc:492] T a58b64f9a4be4ed1973d74fac507d0e3 P ce91bb31f1d64e2897dd0da8047981c7: Bootstrap starting.
I20260709 12:18:05.714533 15334 consensus_queue.cc:260] T be5df69cad7f48c19a5e4aa80dcede4c P 999de4d383954ea5b7c75c01802c6497 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.718897 15359 raft_consensus.cc:493] T 4fe037cbd5e841c3ba79c2a066b045a9 P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:05.719502 15359 raft_consensus.cc:515] T 4fe037cbd5e841c3ba79c2a066b045a9 P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.723018 15218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fd6772c01e480181699cb1c8246779" candidate_uuid: "999de4d383954ea5b7c75c01802c6497" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7e05bf49114cf092451fa7b0876174" is_pre_election: true
I20260709 12:18:05.723999 15218 raft_consensus.cc:2468] T 65fd6772c01e480181699cb1c8246779 P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 999de4d383954ea5b7c75c01802c6497 in term 0.
I20260709 12:18:05.725004 15359 leader_election.cc:290] T 4fe037cbd5e841c3ba79c2a066b045a9 P 999de4d383954ea5b7c75c01802c6497 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633), 2e7e05bf49114cf092451fa7b0876174 (127.3.212.130:42215)
I20260709 12:18:05.725716 15143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe037cbd5e841c3ba79c2a066b045a9" candidate_uuid: "999de4d383954ea5b7c75c01802c6497" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce91bb31f1d64e2897dd0da8047981c7" is_pre_election: true
I20260709 12:18:05.727583 15334 ts_tablet_manager.cc:1434] T be5df69cad7f48c19a5e4aa80dcede4c P 999de4d383954ea5b7c75c01802c6497: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.003s
I20260709 12:18:05.729279 15334 tablet_bootstrap.cc:492] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497: Bootstrap starting.
I20260709 12:18:05.735100 15255 leader_election.cc:304] T 65fd6772c01e480181699cb1c8246779 P 999de4d383954ea5b7c75c01802c6497 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e7e05bf49114cf092451fa7b0876174, 999de4d383954ea5b7c75c01802c6497; no voters: ce91bb31f1d64e2897dd0da8047981c7
I20260709 12:18:05.735536 15333 tablet_bootstrap.cc:654] T a58b64f9a4be4ed1973d74fac507d0e3 P ce91bb31f1d64e2897dd0da8047981c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:05.736601 15359 raft_consensus.cc:2804] T 65fd6772c01e480181699cb1c8246779 P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:05.736999 15359 raft_consensus.cc:493] T 65fd6772c01e480181699cb1c8246779 P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:05.737346 15359 raft_consensus.cc:3060] T 65fd6772c01e480181699cb1c8246779 P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:05.738505 15334 tablet_bootstrap.cc:654] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:05.743685 15218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe037cbd5e841c3ba79c2a066b045a9" candidate_uuid: "999de4d383954ea5b7c75c01802c6497" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7e05bf49114cf092451fa7b0876174" is_pre_election: true
W20260709 12:18:05.745694 15255 leader_election.cc:343] T 4fe037cbd5e841c3ba79c2a066b045a9 P 999de4d383954ea5b7c75c01802c6497 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e7e05bf49114cf092451fa7b0876174 (127.3.212.130:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:05.755283 15332 tablet_bootstrap.cc:492] T 3366909acc834c76ac9845f902ce93f6 P 2e7e05bf49114cf092451fa7b0876174: No bootstrap required, opened a new log
I20260709 12:18:05.766892 15332 ts_tablet_manager.cc:1403] T 3366909acc834c76ac9845f902ce93f6 P 2e7e05bf49114cf092451fa7b0876174: Time spent bootstrapping tablet: real 0.129s	user 0.010s	sys 0.034s
I20260709 12:18:05.767976 15359 raft_consensus.cc:515] T 65fd6772c01e480181699cb1c8246779 P 999de4d383954ea5b7c75c01802c6497 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.770349 15332 raft_consensus.cc:359] T 3366909acc834c76ac9845f902ce93f6 P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.771188 15332 raft_consensus.cc:385] T 3366909acc834c76ac9845f902ce93f6 P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:05.771493 15332 raft_consensus.cc:740] T 3366909acc834c76ac9845f902ce93f6 P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e7e05bf49114cf092451fa7b0876174, State: Initialized, Role: FOLLOWER
I20260709 12:18:05.772467 15332 consensus_queue.cc:260] T 3366909acc834c76ac9845f902ce93f6 P 2e7e05bf49114cf092451fa7b0876174 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.772895 15334 tablet_bootstrap.cc:492] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497: No bootstrap required, opened a new log
I20260709 12:18:05.773731 15333 tablet_bootstrap.cc:492] T a58b64f9a4be4ed1973d74fac507d0e3 P ce91bb31f1d64e2897dd0da8047981c7: No bootstrap required, opened a new log
I20260709 12:18:05.773912 15334 ts_tablet_manager.cc:1403] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497: Time spent bootstrapping tablet: real 0.045s	user 0.016s	sys 0.000s
I20260709 12:18:05.775034 15332 ts_tablet_manager.cc:1434] T 3366909acc834c76ac9845f902ce93f6 P 2e7e05bf49114cf092451fa7b0876174: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:18:05.776396 15332 tablet_bootstrap.cc:492] T b0a2c042781548d3bb7125a8f78942a5 P 2e7e05bf49114cf092451fa7b0876174: Bootstrap starting.
I20260709 12:18:05.776328 15218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fd6772c01e480181699cb1c8246779" candidate_uuid: "999de4d383954ea5b7c75c01802c6497" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7e05bf49114cf092451fa7b0876174"
I20260709 12:18:05.777012 15218 raft_consensus.cc:3060] T 65fd6772c01e480181699cb1c8246779 P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:05.777477 15334 raft_consensus.cc:359] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.778242 15334 raft_consensus.cc:385] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:05.778522 15334 raft_consensus.cc:740] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 999de4d383954ea5b7c75c01802c6497, State: Initialized, Role: FOLLOWER
I20260709 12:18:05.779755 15334 consensus_queue.cc:260] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.782388 15334 ts_tablet_manager.cc:1434] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:18:05.783459 15334 tablet_bootstrap.cc:492] T 424d7c56ad0c4822a8d009c4d824a8d2 P 999de4d383954ea5b7c75c01802c6497: Bootstrap starting.
I20260709 12:18:05.784420 15332 tablet_bootstrap.cc:654] T b0a2c042781548d3bb7125a8f78942a5 P 2e7e05bf49114cf092451fa7b0876174: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:05.787295 15333 ts_tablet_manager.cc:1403] T a58b64f9a4be4ed1973d74fac507d0e3 P ce91bb31f1d64e2897dd0da8047981c7: Time spent bootstrapping tablet: real 0.073s	user 0.024s	sys 0.000s
I20260709 12:18:05.790189 15334 tablet_bootstrap.cc:654] T 424d7c56ad0c4822a8d009c4d824a8d2 P 999de4d383954ea5b7c75c01802c6497: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:05.791893 15340 raft_consensus.cc:493] T be5df69cad7f48c19a5e4aa80dcede4c P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:05.792475 15340 raft_consensus.cc:515] T be5df69cad7f48c19a5e4aa80dcede4c P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.792922 15333 raft_consensus.cc:359] T a58b64f9a4be4ed1973d74fac507d0e3 P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.794030 15333 raft_consensus.cc:385] T a58b64f9a4be4ed1973d74fac507d0e3 P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:05.794384 15333 raft_consensus.cc:740] T a58b64f9a4be4ed1973d74fac507d0e3 P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce91bb31f1d64e2897dd0da8047981c7, State: Initialized, Role: FOLLOWER
I20260709 12:18:05.795215 15333 consensus_queue.cc:260] T a58b64f9a4be4ed1973d74fac507d0e3 P ce91bb31f1d64e2897dd0da8047981c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.787397 15359 leader_election.cc:290] T 65fd6772c01e480181699cb1c8246779 P 999de4d383954ea5b7c75c01802c6497 [CANDIDATE]: Term 1 election: Requested vote from peers ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633), 2e7e05bf49114cf092451fa7b0876174 (127.3.212.130:42215)
I20260709 12:18:05.786969 15218 raft_consensus.cc:2468] T 65fd6772c01e480181699cb1c8246779 P 2e7e05bf49114cf092451fa7b0876174 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 999de4d383954ea5b7c75c01802c6497 in term 1.
I20260709 12:18:05.798102 15255 leader_election.cc:304] T 65fd6772c01e480181699cb1c8246779 P 999de4d383954ea5b7c75c01802c6497 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e7e05bf49114cf092451fa7b0876174, 999de4d383954ea5b7c75c01802c6497; no voters: 
I20260709 12:18:05.798946 15359 raft_consensus.cc:2804] T 65fd6772c01e480181699cb1c8246779 P 999de4d383954ea5b7c75c01802c6497 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:05.800657 15334 tablet_bootstrap.cc:492] T 424d7c56ad0c4822a8d009c4d824a8d2 P 999de4d383954ea5b7c75c01802c6497: No bootstrap required, opened a new log
I20260709 12:18:05.801079 15332 tablet_bootstrap.cc:492] T b0a2c042781548d3bb7125a8f78942a5 P 2e7e05bf49114cf092451fa7b0876174: No bootstrap required, opened a new log
I20260709 12:18:05.801276 15334 ts_tablet_manager.cc:1403] T 424d7c56ad0c4822a8d009c4d824a8d2 P 999de4d383954ea5b7c75c01802c6497: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.000s
I20260709 12:18:05.801785 15332 ts_tablet_manager.cc:1403] T b0a2c042781548d3bb7125a8f78942a5 P 2e7e05bf49114cf092451fa7b0876174: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.003s
I20260709 12:18:05.804399 15334 raft_consensus.cc:359] T 424d7c56ad0c4822a8d009c4d824a8d2 P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.805007 15333 ts_tablet_manager.cc:1434] T a58b64f9a4be4ed1973d74fac507d0e3 P ce91bb31f1d64e2897dd0da8047981c7: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:18:05.805245 15334 raft_consensus.cc:385] T 424d7c56ad0c4822a8d009c4d824a8d2 P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:05.805629 15334 raft_consensus.cc:740] T 424d7c56ad0c4822a8d009c4d824a8d2 P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 999de4d383954ea5b7c75c01802c6497, State: Initialized, Role: FOLLOWER
I20260709 12:18:05.805720 15359 raft_consensus.cc:697] T 65fd6772c01e480181699cb1c8246779 P 999de4d383954ea5b7c75c01802c6497 [term 1 LEADER]: Becoming Leader. State: Replica: 999de4d383954ea5b7c75c01802c6497, State: Running, Role: LEADER
I20260709 12:18:05.806452 15334 consensus_queue.cc:260] T 424d7c56ad0c4822a8d009c4d824a8d2 P 999de4d383954ea5b7c75c01802c6497 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.806778 15359 consensus_queue.cc:237] T 65fd6772c01e480181699cb1c8246779 P 999de4d383954ea5b7c75c01802c6497 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.807873 15333 tablet_bootstrap.cc:492] T be5df69cad7f48c19a5e4aa80dcede4c P ce91bb31f1d64e2897dd0da8047981c7: Bootstrap starting.
I20260709 12:18:05.808717 15334 ts_tablet_manager.cc:1434] T 424d7c56ad0c4822a8d009c4d824a8d2 P 999de4d383954ea5b7c75c01802c6497: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:18:05.809773 15334 tablet_bootstrap.cc:492] T b0a2c042781548d3bb7125a8f78942a5 P 999de4d383954ea5b7c75c01802c6497: Bootstrap starting.
I20260709 12:18:05.806783 15332 raft_consensus.cc:359] T b0a2c042781548d3bb7125a8f78942a5 P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.812747 15332 raft_consensus.cc:385] T b0a2c042781548d3bb7125a8f78942a5 P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:05.813118 15332 raft_consensus.cc:740] T b0a2c042781548d3bb7125a8f78942a5 P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e7e05bf49114cf092451fa7b0876174, State: Initialized, Role: FOLLOWER
I20260709 12:18:05.814026 15332 consensus_queue.cc:260] T b0a2c042781548d3bb7125a8f78942a5 P 2e7e05bf49114cf092451fa7b0876174 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.817003 15332 ts_tablet_manager.cc:1434] T b0a2c042781548d3bb7125a8f78942a5 P 2e7e05bf49114cf092451fa7b0876174: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.003s
I20260709 12:18:05.819728 15332 tablet_bootstrap.cc:492] T 424d7c56ad0c4822a8d009c4d824a8d2 P 2e7e05bf49114cf092451fa7b0876174: Bootstrap starting.
I20260709 12:18:05.834437 15373 raft_consensus.cc:493] T c1991cd59d6441abac887582832f6a2a P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:05.835225 15373 raft_consensus.cc:515] T c1991cd59d6441abac887582832f6a2a P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.841192 15218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1991cd59d6441abac887582832f6a2a" candidate_uuid: "999de4d383954ea5b7c75c01802c6497" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7e05bf49114cf092451fa7b0876174" is_pre_election: true
I20260709 12:18:05.842630 15354 raft_consensus.cc:493] T 7978baf90ead4534804cd2aeeef77fe0 P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:05.843355 15354 raft_consensus.cc:515] T 7978baf90ead4534804cd2aeeef77fe0 P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.846109 15354 leader_election.cc:290] T 7978baf90ead4534804cd2aeeef77fe0 P 2e7e05bf49114cf092451fa7b0876174 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633), 999de4d383954ea5b7c75c01802c6497 (127.3.212.131:33219)
I20260709 12:18:05.848750 15373 leader_election.cc:290] T c1991cd59d6441abac887582832f6a2a P 999de4d383954ea5b7c75c01802c6497 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633), 2e7e05bf49114cf092451fa7b0876174 (127.3.212.130:42215)
I20260709 12:18:05.858767 15340 leader_election.cc:290] T be5df69cad7f48c19a5e4aa80dcede4c P 999de4d383954ea5b7c75c01802c6497 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633), 2e7e05bf49114cf092451fa7b0876174 (127.3.212.130:42215)
I20260709 12:18:05.859041 15218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5df69cad7f48c19a5e4aa80dcede4c" candidate_uuid: "999de4d383954ea5b7c75c01802c6497" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7e05bf49114cf092451fa7b0876174" is_pre_election: true
W20260709 12:18:05.861394 15255 leader_election.cc:343] T be5df69cad7f48c19a5e4aa80dcede4c P 999de4d383954ea5b7c75c01802c6497 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e7e05bf49114cf092451fa7b0876174 (127.3.212.130:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:05.867025 15341 raft_consensus.cc:493] T 3366909acc834c76ac9845f902ce93f6 P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:05.867964 15334 tablet_bootstrap.cc:654] T b0a2c042781548d3bb7125a8f78942a5 P 999de4d383954ea5b7c75c01802c6497: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:05.867859 15341 raft_consensus.cc:515] T 3366909acc834c76ac9845f902ce93f6 P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.878600 15341 leader_election.cc:290] T 3366909acc834c76ac9845f902ce93f6 P ce91bb31f1d64e2897dd0da8047981c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e7e05bf49114cf092451fa7b0876174 (127.3.212.130:42215), 999de4d383954ea5b7c75c01802c6497 (127.3.212.131:33219)
I20260709 12:18:05.880005 15332 tablet_bootstrap.cc:654] T 424d7c56ad0c4822a8d009c4d824a8d2 P 2e7e05bf49114cf092451fa7b0876174: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:05.880746 15333 tablet_bootstrap.cc:654] T be5df69cad7f48c19a5e4aa80dcede4c P ce91bb31f1d64e2897dd0da8047981c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:05.886257 15341 raft_consensus.cc:493] T 7978baf90ead4534804cd2aeeef77fe0 P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:05.887038 15341 raft_consensus.cc:515] T 7978baf90ead4534804cd2aeeef77fe0 P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.889999 15341 leader_election.cc:290] T 7978baf90ead4534804cd2aeeef77fe0 P ce91bb31f1d64e2897dd0da8047981c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e7e05bf49114cf092451fa7b0876174 (127.3.212.130:42215), 999de4d383954ea5b7c75c01802c6497 (127.3.212.131:33219)
I20260709 12:18:05.880220 15334 tablet_bootstrap.cc:492] T b0a2c042781548d3bb7125a8f78942a5 P 999de4d383954ea5b7c75c01802c6497: No bootstrap required, opened a new log
I20260709 12:18:05.892711 15334 ts_tablet_manager.cc:1403] T b0a2c042781548d3bb7125a8f78942a5 P 999de4d383954ea5b7c75c01802c6497: Time spent bootstrapping tablet: real 0.083s	user 0.031s	sys 0.024s
I20260709 12:18:05.895094 15332 tablet_bootstrap.cc:492] T 424d7c56ad0c4822a8d009c4d824a8d2 P 2e7e05bf49114cf092451fa7b0876174: No bootstrap required, opened a new log
I20260709 12:18:05.901580 15332 ts_tablet_manager.cc:1403] T 424d7c56ad0c4822a8d009c4d824a8d2 P 2e7e05bf49114cf092451fa7b0876174: Time spent bootstrapping tablet: real 0.082s	user 0.022s	sys 0.009s
I20260709 12:18:05.899192 15333 tablet_bootstrap.cc:492] T be5df69cad7f48c19a5e4aa80dcede4c P ce91bb31f1d64e2897dd0da8047981c7: No bootstrap required, opened a new log
I20260709 12:18:05.903614 15333 ts_tablet_manager.cc:1403] T be5df69cad7f48c19a5e4aa80dcede4c P ce91bb31f1d64e2897dd0da8047981c7: Time spent bootstrapping tablet: real 0.096s	user 0.022s	sys 0.026s
I20260709 12:18:05.907104 15333 raft_consensus.cc:359] T be5df69cad7f48c19a5e4aa80dcede4c P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.907846 15333 raft_consensus.cc:385] T be5df69cad7f48c19a5e4aa80dcede4c P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:05.908207 15333 raft_consensus.cc:740] T be5df69cad7f48c19a5e4aa80dcede4c P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce91bb31f1d64e2897dd0da8047981c7, State: Initialized, Role: FOLLOWER
I20260709 12:18:05.909065 15333 consensus_queue.cc:260] T be5df69cad7f48c19a5e4aa80dcede4c P ce91bb31f1d64e2897dd0da8047981c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.909590 15332 raft_consensus.cc:359] T 424d7c56ad0c4822a8d009c4d824a8d2 P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.910504 15332 raft_consensus.cc:385] T 424d7c56ad0c4822a8d009c4d824a8d2 P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:05.910828 15332 raft_consensus.cc:740] T 424d7c56ad0c4822a8d009c4d824a8d2 P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e7e05bf49114cf092451fa7b0876174, State: Initialized, Role: FOLLOWER
I20260709 12:18:05.895915 15334 raft_consensus.cc:359] T b0a2c042781548d3bb7125a8f78942a5 P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.911695 15332 consensus_queue.cc:260] T 424d7c56ad0c4822a8d009c4d824a8d2 P 2e7e05bf49114cf092451fa7b0876174 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.912204 15334 raft_consensus.cc:385] T b0a2c042781548d3bb7125a8f78942a5 P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:05.912580 15334 raft_consensus.cc:740] T b0a2c042781548d3bb7125a8f78942a5 P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 999de4d383954ea5b7c75c01802c6497, State: Initialized, Role: FOLLOWER
I20260709 12:18:05.913332 15334 consensus_queue.cc:260] T b0a2c042781548d3bb7125a8f78942a5 P 999de4d383954ea5b7c75c01802c6497 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.913863 15333 ts_tablet_manager.cc:1434] T be5df69cad7f48c19a5e4aa80dcede4c P ce91bb31f1d64e2897dd0da8047981c7: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.003s
I20260709 12:18:05.915192 15333 tablet_bootstrap.cc:492] T 65fd6772c01e480181699cb1c8246779 P ce91bb31f1d64e2897dd0da8047981c7: Bootstrap starting.
I20260709 12:18:05.915623 15334 ts_tablet_manager.cc:1434] T b0a2c042781548d3bb7125a8f78942a5 P 999de4d383954ea5b7c75c01802c6497: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.003s
I20260709 12:18:05.920107 15141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1991cd59d6441abac887582832f6a2a" candidate_uuid: "999de4d383954ea5b7c75c01802c6497" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce91bb31f1d64e2897dd0da8047981c7" is_pre_election: true
I20260709 12:18:05.921168 15141 raft_consensus.cc:2393] T c1991cd59d6441abac887582832f6a2a P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 999de4d383954ea5b7c75c01802c6497 in current term 1: Already voted for candidate 2e7e05bf49114cf092451fa7b0876174 in this term.
I20260709 12:18:05.922353 15333 tablet_bootstrap.cc:654] T 65fd6772c01e480181699cb1c8246779 P ce91bb31f1d64e2897dd0da8047981c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:05.922590 15140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5df69cad7f48c19a5e4aa80dcede4c" candidate_uuid: "999de4d383954ea5b7c75c01802c6497" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce91bb31f1d64e2897dd0da8047981c7" is_pre_election: true
I20260709 12:18:05.923368 15140 raft_consensus.cc:2468] T be5df69cad7f48c19a5e4aa80dcede4c P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 999de4d383954ea5b7c75c01802c6497 in term 0.
I20260709 12:18:05.930282 15142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fd6772c01e480181699cb1c8246779" candidate_uuid: "999de4d383954ea5b7c75c01802c6497" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce91bb31f1d64e2897dd0da8047981c7"
I20260709 12:18:05.945295 15333 tablet_bootstrap.cc:492] T 65fd6772c01e480181699cb1c8246779 P ce91bb31f1d64e2897dd0da8047981c7: No bootstrap required, opened a new log
I20260709 12:18:05.945984 15333 ts_tablet_manager.cc:1403] T 65fd6772c01e480181699cb1c8246779 P ce91bb31f1d64e2897dd0da8047981c7: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.007s
I20260709 12:18:05.949012 15333 raft_consensus.cc:359] T 65fd6772c01e480181699cb1c8246779 P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.949687 15333 raft_consensus.cc:385] T 65fd6772c01e480181699cb1c8246779 P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:05.949944 15333 raft_consensus.cc:740] T 65fd6772c01e480181699cb1c8246779 P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce91bb31f1d64e2897dd0da8047981c7, State: Initialized, Role: FOLLOWER
I20260709 12:18:05.950642 15333 consensus_queue.cc:260] T 65fd6772c01e480181699cb1c8246779 P ce91bb31f1d64e2897dd0da8047981c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.952347 15333 ts_tablet_manager.cc:1434] T 65fd6772c01e480181699cb1c8246779 P ce91bb31f1d64e2897dd0da8047981c7: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:18:05.953150 15333 tablet_bootstrap.cc:492] T c647fad7e69f46048ebcc6927eac1a58 P ce91bb31f1d64e2897dd0da8047981c7: Bootstrap starting.
I20260709 12:18:05.958541 15333 tablet_bootstrap.cc:654] T c647fad7e69f46048ebcc6927eac1a58 P ce91bb31f1d64e2897dd0da8047981c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:05.964202 15333 tablet_bootstrap.cc:492] T c647fad7e69f46048ebcc6927eac1a58 P ce91bb31f1d64e2897dd0da8047981c7: No bootstrap required, opened a new log
I20260709 12:18:05.964699 15333 ts_tablet_manager.cc:1403] T c647fad7e69f46048ebcc6927eac1a58 P ce91bb31f1d64e2897dd0da8047981c7: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:18:05.967108 15333 raft_consensus.cc:359] T c647fad7e69f46048ebcc6927eac1a58 P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.967669 15333 raft_consensus.cc:385] T c647fad7e69f46048ebcc6927eac1a58 P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:05.967929 15333 raft_consensus.cc:740] T c647fad7e69f46048ebcc6927eac1a58 P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce91bb31f1d64e2897dd0da8047981c7, State: Initialized, Role: FOLLOWER
I20260709 12:18:05.968678 15333 consensus_queue.cc:260] T c647fad7e69f46048ebcc6927eac1a58 P ce91bb31f1d64e2897dd0da8047981c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.970018 15382 raft_consensus.cc:493] T b0a2c042781548d3bb7125a8f78942a5 P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:05.970630 15382 raft_consensus.cc:515] T b0a2c042781548d3bb7125a8f78942a5 P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.971125 15333 ts_tablet_manager.cc:1434] T c647fad7e69f46048ebcc6927eac1a58 P ce91bb31f1d64e2897dd0da8047981c7: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:18:05.972204 15333 tablet_bootstrap.cc:492] T 424d7c56ad0c4822a8d009c4d824a8d2 P ce91bb31f1d64e2897dd0da8047981c7: Bootstrap starting.
I20260709 12:18:05.973924 15382 leader_election.cc:290] T b0a2c042781548d3bb7125a8f78942a5 P ce91bb31f1d64e2897dd0da8047981c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e7e05bf49114cf092451fa7b0876174 (127.3.212.130:42215), 999de4d383954ea5b7c75c01802c6497 (127.3.212.131:33219)
I20260709 12:18:05.979123 15333 tablet_bootstrap.cc:654] T 424d7c56ad0c4822a8d009c4d824a8d2 P ce91bb31f1d64e2897dd0da8047981c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:05.978822 15143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7978baf90ead4534804cd2aeeef77fe0" candidate_uuid: "2e7e05bf49114cf092451fa7b0876174" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce91bb31f1d64e2897dd0da8047981c7" is_pre_election: true
I20260709 12:18:05.922603 15332 ts_tablet_manager.cc:1434] T 424d7c56ad0c4822a8d009c4d824a8d2 P 2e7e05bf49114cf092451fa7b0876174: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.002s
I20260709 12:18:05.979656 15143 raft_consensus.cc:2468] T 7978baf90ead4534804cd2aeeef77fe0 P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e7e05bf49114cf092451fa7b0876174 in term 0.
I20260709 12:18:05.980526 15332 tablet_bootstrap.cc:492] T be5df69cad7f48c19a5e4aa80dcede4c P 2e7e05bf49114cf092451fa7b0876174: Bootstrap starting.
I20260709 12:18:05.981848 15182 leader_election.cc:304] T 7978baf90ead4534804cd2aeeef77fe0 P 2e7e05bf49114cf092451fa7b0876174 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e7e05bf49114cf092451fa7b0876174, ce91bb31f1d64e2897dd0da8047981c7; no voters: 
I20260709 12:18:05.985572 15333 tablet_bootstrap.cc:492] T 424d7c56ad0c4822a8d009c4d824a8d2 P ce91bb31f1d64e2897dd0da8047981c7: No bootstrap required, opened a new log
I20260709 12:18:05.986123 15333 ts_tablet_manager.cc:1403] T 424d7c56ad0c4822a8d009c4d824a8d2 P ce91bb31f1d64e2897dd0da8047981c7: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 12:18:05.987413 15332 tablet_bootstrap.cc:654] T be5df69cad7f48c19a5e4aa80dcede4c P 2e7e05bf49114cf092451fa7b0876174: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:05.990422 15339 raft_consensus.cc:493] T 424d7c56ad0c4822a8d009c4d824a8d2 P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:05.991070 15339 raft_consensus.cc:515] T 424d7c56ad0c4822a8d009c4d824a8d2 P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.991285 15333 raft_consensus.cc:359] T 424d7c56ad0c4822a8d009c4d824a8d2 P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.992249 15333 raft_consensus.cc:385] T 424d7c56ad0c4822a8d009c4d824a8d2 P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:05.992631 15333 raft_consensus.cc:740] T 424d7c56ad0c4822a8d009c4d824a8d2 P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce91bb31f1d64e2897dd0da8047981c7, State: Initialized, Role: FOLLOWER
I20260709 12:18:05.993687 15333 consensus_queue.cc:260] T 424d7c56ad0c4822a8d009c4d824a8d2 P ce91bb31f1d64e2897dd0da8047981c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:05.995478 15143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424d7c56ad0c4822a8d009c4d824a8d2" candidate_uuid: "2e7e05bf49114cf092451fa7b0876174" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce91bb31f1d64e2897dd0da8047981c7" is_pre_election: true
I20260709 12:18:05.996095 15333 ts_tablet_manager.cc:1434] T 424d7c56ad0c4822a8d009c4d824a8d2 P ce91bb31f1d64e2897dd0da8047981c7: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:18:05.998461 15333 tablet_bootstrap.cc:492] T 4fe037cbd5e841c3ba79c2a066b045a9 P ce91bb31f1d64e2897dd0da8047981c7: Bootstrap starting.
I20260709 12:18:06.000367 15291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3366909acc834c76ac9845f902ce93f6" candidate_uuid: "ce91bb31f1d64e2897dd0da8047981c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "999de4d383954ea5b7c75c01802c6497" is_pre_election: true
I20260709 12:18:06.001252 15291 raft_consensus.cc:2468] T 3366909acc834c76ac9845f902ce93f6 P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce91bb31f1d64e2897dd0da8047981c7 in term 0.
I20260709 12:18:06.002563 15292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7978baf90ead4534804cd2aeeef77fe0" candidate_uuid: "ce91bb31f1d64e2897dd0da8047981c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "999de4d383954ea5b7c75c01802c6497" is_pre_election: true
I20260709 12:18:06.003129 15332 tablet_bootstrap.cc:492] T be5df69cad7f48c19a5e4aa80dcede4c P 2e7e05bf49114cf092451fa7b0876174: No bootstrap required, opened a new log
I20260709 12:18:06.003319 15292 raft_consensus.cc:2468] T 7978baf90ead4534804cd2aeeef77fe0 P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce91bb31f1d64e2897dd0da8047981c7 in term 0.
I20260709 12:18:05.996158 15143 raft_consensus.cc:2468] T 424d7c56ad0c4822a8d009c4d824a8d2 P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e7e05bf49114cf092451fa7b0876174 in term 0.
I20260709 12:18:06.004539 15290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0a2c042781548d3bb7125a8f78942a5" candidate_uuid: "ce91bb31f1d64e2897dd0da8047981c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "999de4d383954ea5b7c75c01802c6497" is_pre_election: true
I20260709 12:18:06.002949 15354 raft_consensus.cc:2804] T 7978baf90ead4534804cd2aeeef77fe0 P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:06.005539 15333 tablet_bootstrap.cc:654] T 4fe037cbd5e841c3ba79c2a066b045a9 P ce91bb31f1d64e2897dd0da8047981c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:06.005205 15182 leader_election.cc:304] T 424d7c56ad0c4822a8d009c4d824a8d2 P 2e7e05bf49114cf092451fa7b0876174 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e7e05bf49114cf092451fa7b0876174, ce91bb31f1d64e2897dd0da8047981c7; no voters: 
I20260709 12:18:06.006357 15106 leader_election.cc:304] T 3366909acc834c76ac9845f902ce93f6 P ce91bb31f1d64e2897dd0da8047981c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 999de4d383954ea5b7c75c01802c6497, ce91bb31f1d64e2897dd0da8047981c7; no voters: 
I20260709 12:18:06.006908 15356 raft_consensus.cc:2804] T 424d7c56ad0c4822a8d009c4d824a8d2 P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:06.007367 15356 raft_consensus.cc:493] T 424d7c56ad0c4822a8d009c4d824a8d2 P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:06.007444 15106 leader_election.cc:304] T 7978baf90ead4534804cd2aeeef77fe0 P ce91bb31f1d64e2897dd0da8047981c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 999de4d383954ea5b7c75c01802c6497, ce91bb31f1d64e2897dd0da8047981c7; no voters: 
I20260709 12:18:06.007778 15356 raft_consensus.cc:3060] T 424d7c56ad0c4822a8d009c4d824a8d2 P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:06.008404 15332 ts_tablet_manager.cc:1403] T be5df69cad7f48c19a5e4aa80dcede4c P 2e7e05bf49114cf092451fa7b0876174: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.008s
I20260709 12:18:06.008445 15382 raft_consensus.cc:2804] T 3366909acc834c76ac9845f902ce93f6 P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:06.014987 15382 raft_consensus.cc:493] T 3366909acc834c76ac9845f902ce93f6 P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:06.015437 15382 raft_consensus.cc:3060] T 3366909acc834c76ac9845f902ce93f6 P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:06.005292 15290 raft_consensus.cc:2468] T b0a2c042781548d3bb7125a8f78942a5 P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce91bb31f1d64e2897dd0da8047981c7 in term 0.
I20260709 12:18:06.017607 15341 raft_consensus.cc:2804] T 7978baf90ead4534804cd2aeeef77fe0 P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:06.018079 15341 raft_consensus.cc:493] T 7978baf90ead4534804cd2aeeef77fe0 P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:06.018427 15341 raft_consensus.cc:3060] T 7978baf90ead4534804cd2aeeef77fe0 P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:06.018812 15106 leader_election.cc:304] T b0a2c042781548d3bb7125a8f78942a5 P ce91bb31f1d64e2897dd0da8047981c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 999de4d383954ea5b7c75c01802c6497, ce91bb31f1d64e2897dd0da8047981c7; no voters: 
I20260709 12:18:06.028360 15332 raft_consensus.cc:359] T be5df69cad7f48c19a5e4aa80dcede4c P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:06.029168 15332 raft_consensus.cc:385] T be5df69cad7f48c19a5e4aa80dcede4c P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:06.029299 15290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7978baf90ead4534804cd2aeeef77fe0" candidate_uuid: "2e7e05bf49114cf092451fa7b0876174" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "999de4d383954ea5b7c75c01802c6497" is_pre_election: true
I20260709 12:18:06.030290 15290 raft_consensus.cc:2468] T 7978baf90ead4534804cd2aeeef77fe0 P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e7e05bf49114cf092451fa7b0876174 in term 0.
I20260709 12:18:06.029492 15332 raft_consensus.cc:740] T be5df69cad7f48c19a5e4aa80dcede4c P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e7e05bf49114cf092451fa7b0876174, State: Initialized, Role: FOLLOWER
I20260709 12:18:06.033223 15332 consensus_queue.cc:260] T be5df69cad7f48c19a5e4aa80dcede4c P 2e7e05bf49114cf092451fa7b0876174 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:06.035589 15332 ts_tablet_manager.cc:1434] T be5df69cad7f48c19a5e4aa80dcede4c P 2e7e05bf49114cf092451fa7b0876174: Time spent starting tablet: real 0.027s	user 0.003s	sys 0.007s
I20260709 12:18:06.036638 15332 tablet_bootstrap.cc:492] T 4fe037cbd5e841c3ba79c2a066b045a9 P 2e7e05bf49114cf092451fa7b0876174: Bootstrap starting.
I20260709 12:18:06.036513 15382 raft_consensus.cc:515] T 3366909acc834c76ac9845f902ce93f6 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:06.005771 15354 raft_consensus.cc:493] T 7978baf90ead4534804cd2aeeef77fe0 P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:06.047967 15356 raft_consensus.cc:515] T 424d7c56ad0c4822a8d009c4d824a8d2 P 2e7e05bf49114cf092451fa7b0876174 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:06.050994 15143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424d7c56ad0c4822a8d009c4d824a8d2" candidate_uuid: "2e7e05bf49114cf092451fa7b0876174" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce91bb31f1d64e2897dd0da8047981c7"
I20260709 12:18:06.051635 15143 raft_consensus.cc:3060] T 424d7c56ad0c4822a8d009c4d824a8d2 P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:18:06.052665 15256 leader_election.cc:343] T 4fe037cbd5e841c3ba79c2a066b045a9 P 999de4d383954ea5b7c75c01802c6497 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:06.053306 15256 leader_election.cc:304] T 4fe037cbd5e841c3ba79c2a066b045a9 P 999de4d383954ea5b7c75c01802c6497 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 999de4d383954ea5b7c75c01802c6497; no voters: 2e7e05bf49114cf092451fa7b0876174, ce91bb31f1d64e2897dd0da8047981c7
I20260709 12:18:06.053992 15339 leader_election.cc:290] T 424d7c56ad0c4822a8d009c4d824a8d2 P 2e7e05bf49114cf092451fa7b0876174 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633), 999de4d383954ea5b7c75c01802c6497 (127.3.212.131:33219)
I20260709 12:18:06.042929 15354 raft_consensus.cc:3060] T 7978baf90ead4534804cd2aeeef77fe0 P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:06.055294 15290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424d7c56ad0c4822a8d009c4d824a8d2" candidate_uuid: "2e7e05bf49114cf092451fa7b0876174" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "999de4d383954ea5b7c75c01802c6497" is_pre_election: true
I20260709 12:18:06.056023 15290 raft_consensus.cc:2468] T 424d7c56ad0c4822a8d009c4d824a8d2 P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e7e05bf49114cf092451fa7b0876174 in term 0.
I20260709 12:18:06.061275 15341 raft_consensus.cc:515] T 7978baf90ead4534804cd2aeeef77fe0 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:06.062032 15359 raft_consensus.cc:2749] T 4fe037cbd5e841c3ba79c2a066b045a9 P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:06.063669 15256 leader_election.cc:304] T c1991cd59d6441abac887582832f6a2a P 999de4d383954ea5b7c75c01802c6497 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 999de4d383954ea5b7c75c01802c6497; no voters: 2e7e05bf49114cf092451fa7b0876174, ce91bb31f1d64e2897dd0da8047981c7
I20260709 12:18:06.064766 15359 raft_consensus.cc:3060] T c1991cd59d6441abac887582832f6a2a P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:06.066867 15041 catalog_manager.cc:5697] T a58b64f9a4be4ed1973d74fac507d0e3 P 2e7e05bf49114cf092451fa7b0876174 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e7e05bf49114cf092451fa7b0876174 (127.3.212.130). New cstate: current_term: 1 leader_uuid: "2e7e05bf49114cf092451fa7b0876174" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:06.069425 15382 leader_election.cc:290] T 3366909acc834c76ac9845f902ce93f6 P ce91bb31f1d64e2897dd0da8047981c7 [CANDIDATE]: Term 1 election: Requested vote from peers 2e7e05bf49114cf092451fa7b0876174 (127.3.212.130:42215), 999de4d383954ea5b7c75c01802c6497 (127.3.212.131:33219)
I20260709 12:18:06.071482 15382 raft_consensus.cc:2804] T b0a2c042781548d3bb7125a8f78942a5 P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:06.071969 15382 raft_consensus.cc:493] T b0a2c042781548d3bb7125a8f78942a5 P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:06.072423 15382 raft_consensus.cc:3060] T b0a2c042781548d3bb7125a8f78942a5 P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:06.074249 15256 leader_election.cc:304] T be5df69cad7f48c19a5e4aa80dcede4c P 999de4d383954ea5b7c75c01802c6497 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 999de4d383954ea5b7c75c01802c6497, ce91bb31f1d64e2897dd0da8047981c7; no voters: 2e7e05bf49114cf092451fa7b0876174
I20260709 12:18:06.070726 15341 leader_election.cc:290] T 7978baf90ead4534804cd2aeeef77fe0 P ce91bb31f1d64e2897dd0da8047981c7 [CANDIDATE]: Term 1 election: Requested vote from peers 2e7e05bf49114cf092451fa7b0876174 (127.3.212.130:42215), 999de4d383954ea5b7c75c01802c6497 (127.3.212.131:33219)
W20260709 12:18:06.075811 15256 leader_election.cc:343] T 65fd6772c01e480181699cb1c8246779 P 999de4d383954ea5b7c75c01802c6497 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:06.076493 15340 raft_consensus.cc:2804] T be5df69cad7f48c19a5e4aa80dcede4c P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:18:06.076913 15106 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.131:33219, user_credentials={real_user=slave}} blocked reactor thread for 58242.4us
I20260709 12:18:06.077641 15359 raft_consensus.cc:2749] T c1991cd59d6441abac887582832f6a2a P 999de4d383954ea5b7c75c01802c6497 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:06.078645 15339 raft_consensus.cc:493] T 3366909acc834c76ac9845f902ce93f6 P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.079159 15290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3366909acc834c76ac9845f902ce93f6" candidate_uuid: "ce91bb31f1d64e2897dd0da8047981c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "999de4d383954ea5b7c75c01802c6497"
I20260709 12:18:06.079800 15290 raft_consensus.cc:3060] T 3366909acc834c76ac9845f902ce93f6 P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:06.080425 15332 tablet_bootstrap.cc:654] T 4fe037cbd5e841c3ba79c2a066b045a9 P 2e7e05bf49114cf092451fa7b0876174: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:06.082568 15333 tablet_bootstrap.cc:492] T 4fe037cbd5e841c3ba79c2a066b045a9 P ce91bb31f1d64e2897dd0da8047981c7: No bootstrap required, opened a new log
I20260709 12:18:06.083113 15333 ts_tablet_manager.cc:1403] T 4fe037cbd5e841c3ba79c2a066b045a9 P ce91bb31f1d64e2897dd0da8047981c7: Time spent bootstrapping tablet: real 0.085s	user 0.020s	sys 0.023s
I20260709 12:18:06.079156 15339 raft_consensus.cc:515] T 3366909acc834c76ac9845f902ce93f6 P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:06.085943 15333 raft_consensus.cc:359] T 4fe037cbd5e841c3ba79c2a066b045a9 P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:06.086608 15333 raft_consensus.cc:385] T 4fe037cbd5e841c3ba79c2a066b045a9 P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:06.086871 15333 raft_consensus.cc:740] T 4fe037cbd5e841c3ba79c2a066b045a9 P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce91bb31f1d64e2897dd0da8047981c7, State: Initialized, Role: FOLLOWER
I20260709 12:18:06.087632 15333 consensus_queue.cc:260] T 4fe037cbd5e841c3ba79c2a066b045a9 P ce91bb31f1d64e2897dd0da8047981c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:06.087836 15142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3366909acc834c76ac9845f902ce93f6" candidate_uuid: "2e7e05bf49114cf092451fa7b0876174" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce91bb31f1d64e2897dd0da8047981c7" is_pre_election: true
I20260709 12:18:06.088117 15290 raft_consensus.cc:2468] T 3366909acc834c76ac9845f902ce93f6 P 999de4d383954ea5b7c75c01802c6497 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce91bb31f1d64e2897dd0da8047981c7 in term 1.
I20260709 12:18:06.088717 15142 raft_consensus.cc:2393] T 3366909acc834c76ac9845f902ce93f6 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e7e05bf49114cf092451fa7b0876174 in current term 1: Already voted for candidate ce91bb31f1d64e2897dd0da8047981c7 in this term.
I20260709 12:18:06.090550 15292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7978baf90ead4534804cd2aeeef77fe0" candidate_uuid: "ce91bb31f1d64e2897dd0da8047981c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "999de4d383954ea5b7c75c01802c6497"
I20260709 12:18:06.080325 15354 raft_consensus.cc:515] T 7978baf90ead4534804cd2aeeef77fe0 P 2e7e05bf49114cf092451fa7b0876174 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:06.091280 15292 raft_consensus.cc:3060] T 7978baf90ead4534804cd2aeeef77fe0 P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:06.076982 15340 raft_consensus.cc:493] T be5df69cad7f48c19a5e4aa80dcede4c P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:06.093036 15340 raft_consensus.cc:3060] T be5df69cad7f48c19a5e4aa80dcede4c P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:06.094592 15339 leader_election.cc:290] T 3366909acc834c76ac9845f902ce93f6 P 2e7e05bf49114cf092451fa7b0876174 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633), 999de4d383954ea5b7c75c01802c6497 (127.3.212.131:33219)
I20260709 12:18:06.100730 15292 raft_consensus.cc:2468] T 7978baf90ead4534804cd2aeeef77fe0 P 999de4d383954ea5b7c75c01802c6497 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce91bb31f1d64e2897dd0da8047981c7 in term 1.
I20260709 12:18:06.096563 15354 leader_election.cc:290] T 7978baf90ead4534804cd2aeeef77fe0 P 2e7e05bf49114cf092451fa7b0876174 [CANDIDATE]: Term 1 election: Requested vote from peers ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633), 999de4d383954ea5b7c75c01802c6497 (127.3.212.131:33219)
I20260709 12:18:06.102170 15106 leader_election.cc:304] T 3366909acc834c76ac9845f902ce93f6 P ce91bb31f1d64e2897dd0da8047981c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 999de4d383954ea5b7c75c01802c6497, ce91bb31f1d64e2897dd0da8047981c7; no voters: 
I20260709 12:18:06.103986 15386 raft_consensus.cc:2804] T 3366909acc834c76ac9845f902ce93f6 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:06.104523 15386 raft_consensus.cc:697] T 3366909acc834c76ac9845f902ce93f6 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 LEADER]: Becoming Leader. State: Replica: ce91bb31f1d64e2897dd0da8047981c7, State: Running, Role: LEADER
I20260709 12:18:06.105459 15217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7978baf90ead4534804cd2aeeef77fe0" candidate_uuid: "ce91bb31f1d64e2897dd0da8047981c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7e05bf49114cf092451fa7b0876174" is_pre_election: true
I20260709 12:18:06.106328 15217 raft_consensus.cc:2393] T 7978baf90ead4534804cd2aeeef77fe0 P 2e7e05bf49114cf092451fa7b0876174 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce91bb31f1d64e2897dd0da8047981c7 in current term 1: Already voted for candidate 2e7e05bf49114cf092451fa7b0876174 in this term.
I20260709 12:18:06.105901 15218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3366909acc834c76ac9845f902ce93f6" candidate_uuid: "ce91bb31f1d64e2897dd0da8047981c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7e05bf49114cf092451fa7b0876174" is_pre_election: true
I20260709 12:18:06.107052 15218 raft_consensus.cc:2468] T 3366909acc834c76ac9845f902ce93f6 P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce91bb31f1d64e2897dd0da8047981c7 in term 0.
I20260709 12:18:06.108340 15218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0a2c042781548d3bb7125a8f78942a5" candidate_uuid: "ce91bb31f1d64e2897dd0da8047981c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7e05bf49114cf092451fa7b0876174" is_pre_election: true
I20260709 12:18:06.108913 15218 raft_consensus.cc:2468] T b0a2c042781548d3bb7125a8f78942a5 P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce91bb31f1d64e2897dd0da8047981c7 in term 0.
I20260709 12:18:06.109309 15217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3366909acc834c76ac9845f902ce93f6" candidate_uuid: "ce91bb31f1d64e2897dd0da8047981c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7e05bf49114cf092451fa7b0876174"
I20260709 12:18:06.105477 15386 consensus_queue.cc:237] T 3366909acc834c76ac9845f902ce93f6 P ce91bb31f1d64e2897dd0da8047981c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:06.110083 15217 raft_consensus.cc:3060] T 3366909acc834c76ac9845f902ce93f6 P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:06.111891 15143 raft_consensus.cc:2468] T 424d7c56ad0c4822a8d009c4d824a8d2 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e7e05bf49114cf092451fa7b0876174 in term 1.
I20260709 12:18:06.098006 15142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7978baf90ead4534804cd2aeeef77fe0" candidate_uuid: "2e7e05bf49114cf092451fa7b0876174" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce91bb31f1d64e2897dd0da8047981c7"
I20260709 12:18:06.114058 15142 raft_consensus.cc:2393] T 7978baf90ead4534804cd2aeeef77fe0 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e7e05bf49114cf092451fa7b0876174 in current term 1: Already voted for candidate ce91bb31f1d64e2897dd0da8047981c7 in this term.
I20260709 12:18:06.098632 15291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3366909acc834c76ac9845f902ce93f6" candidate_uuid: "2e7e05bf49114cf092451fa7b0876174" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "999de4d383954ea5b7c75c01802c6497" is_pre_election: true
I20260709 12:18:06.115577 15291 raft_consensus.cc:2393] T 3366909acc834c76ac9845f902ce93f6 P 999de4d383954ea5b7c75c01802c6497 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e7e05bf49114cf092451fa7b0876174 in current term 1: Already voted for candidate ce91bb31f1d64e2897dd0da8047981c7 in this term.
I20260709 12:18:06.098687 15289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7978baf90ead4534804cd2aeeef77fe0" candidate_uuid: "2e7e05bf49114cf092451fa7b0876174" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "999de4d383954ea5b7c75c01802c6497"
I20260709 12:18:06.117066 15289 raft_consensus.cc:2393] T 7978baf90ead4534804cd2aeeef77fe0 P 999de4d383954ea5b7c75c01802c6497 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e7e05bf49114cf092451fa7b0876174 in current term 1: Already voted for candidate ce91bb31f1d64e2897dd0da8047981c7 in this term.
I20260709 12:18:06.098201 15333 ts_tablet_manager.cc:1434] T 4fe037cbd5e841c3ba79c2a066b045a9 P ce91bb31f1d64e2897dd0da8047981c7: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:18:06.118511 15106 leader_election.cc:304] T 7978baf90ead4534804cd2aeeef77fe0 P ce91bb31f1d64e2897dd0da8047981c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 999de4d383954ea5b7c75c01802c6497, ce91bb31f1d64e2897dd0da8047981c7; no voters: 
I20260709 12:18:06.118947 15181 leader_election.cc:304] T 3366909acc834c76ac9845f902ce93f6 P 2e7e05bf49114cf092451fa7b0876174 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e7e05bf49114cf092451fa7b0876174; no voters: 999de4d383954ea5b7c75c01802c6497, ce91bb31f1d64e2897dd0da8047981c7
I20260709 12:18:06.119357 15341 raft_consensus.cc:2804] T 7978baf90ead4534804cd2aeeef77fe0 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:06.118803 15218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7978baf90ead4534804cd2aeeef77fe0" candidate_uuid: "ce91bb31f1d64e2897dd0da8047981c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7e05bf49114cf092451fa7b0876174"
I20260709 12:18:06.121249 15218 raft_consensus.cc:2393] T 7978baf90ead4534804cd2aeeef77fe0 P 2e7e05bf49114cf092451fa7b0876174 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ce91bb31f1d64e2897dd0da8047981c7 in current term 1: Already voted for candidate 2e7e05bf49114cf092451fa7b0876174 in this term.
I20260709 12:18:06.120342 15181 leader_election.cc:304] T 7978baf90ead4534804cd2aeeef77fe0 P 2e7e05bf49114cf092451fa7b0876174 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e7e05bf49114cf092451fa7b0876174; no voters: 999de4d383954ea5b7c75c01802c6497, ce91bb31f1d64e2897dd0da8047981c7
I20260709 12:18:06.122818 15217 raft_consensus.cc:2468] T 3366909acc834c76ac9845f902ce93f6 P 2e7e05bf49114cf092451fa7b0876174 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce91bb31f1d64e2897dd0da8047981c7 in term 1.
I20260709 12:18:06.094844 15382 raft_consensus.cc:515] T b0a2c042781548d3bb7125a8f78942a5 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:06.123394 15354 raft_consensus.cc:2749] T 3366909acc834c76ac9845f902ce93f6 P 2e7e05bf49114cf092451fa7b0876174 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:06.124003 15290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424d7c56ad0c4822a8d009c4d824a8d2" candidate_uuid: "2e7e05bf49114cf092451fa7b0876174" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "999de4d383954ea5b7c75c01802c6497"
I20260709 12:18:06.102152 15356 leader_election.cc:290] T 424d7c56ad0c4822a8d009c4d824a8d2 P 2e7e05bf49114cf092451fa7b0876174 [CANDIDATE]: Term 1 election: Requested vote from peers ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633), 999de4d383954ea5b7c75c01802c6497 (127.3.212.131:33219)
I20260709 12:18:06.124679 15182 leader_election.cc:304] T 424d7c56ad0c4822a8d009c4d824a8d2 P 2e7e05bf49114cf092451fa7b0876174 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e7e05bf49114cf092451fa7b0876174, ce91bb31f1d64e2897dd0da8047981c7; no voters: 
I20260709 12:18:06.124630 15290 raft_consensus.cc:3060] T 424d7c56ad0c4822a8d009c4d824a8d2 P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:06.123380 15339 raft_consensus.cc:2749] T 7978baf90ead4534804cd2aeeef77fe0 P 2e7e05bf49114cf092451fa7b0876174 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:18:06.122349 15040 catalog_manager.cc:5697] T 65fd6772c01e480181699cb1c8246779 P 999de4d383954ea5b7c75c01802c6497 reported cstate change: term changed from 0 to 1, leader changed from <none> to 999de4d383954ea5b7c75c01802c6497 (127.3.212.131). New cstate: current_term: 1 leader_uuid: "999de4d383954ea5b7c75c01802c6497" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:06.127717 15382 leader_election.cc:290] T b0a2c042781548d3bb7125a8f78942a5 P ce91bb31f1d64e2897dd0da8047981c7 [CANDIDATE]: Term 1 election: Requested vote from peers 2e7e05bf49114cf092451fa7b0876174 (127.3.212.130:42215), 999de4d383954ea5b7c75c01802c6497 (127.3.212.131:33219)
I20260709 12:18:06.125962 15356 raft_consensus.cc:2804] T 424d7c56ad0c4822a8d009c4d824a8d2 P 2e7e05bf49114cf092451fa7b0876174 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:06.128652 15356 raft_consensus.cc:697] T 424d7c56ad0c4822a8d009c4d824a8d2 P 2e7e05bf49114cf092451fa7b0876174 [term 1 LEADER]: Becoming Leader. State: Replica: 2e7e05bf49114cf092451fa7b0876174, State: Running, Role: LEADER
I20260709 12:18:06.128970 15289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0a2c042781548d3bb7125a8f78942a5" candidate_uuid: "ce91bb31f1d64e2897dd0da8047981c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "999de4d383954ea5b7c75c01802c6497"
I20260709 12:18:06.129731 15289 raft_consensus.cc:3060] T b0a2c042781548d3bb7125a8f78942a5 P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:06.129575 15356 consensus_queue.cc:237] T 424d7c56ad0c4822a8d009c4d824a8d2 P 2e7e05bf49114cf092451fa7b0876174 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:06.137661 15340 raft_consensus.cc:515] T be5df69cad7f48c19a5e4aa80dcede4c P 999de4d383954ea5b7c75c01802c6497 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:06.139780 15217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0a2c042781548d3bb7125a8f78942a5" candidate_uuid: "ce91bb31f1d64e2897dd0da8047981c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7e05bf49114cf092451fa7b0876174"
I20260709 12:18:06.140455 15217 raft_consensus.cc:3060] T b0a2c042781548d3bb7125a8f78942a5 P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:06.140889 15143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5df69cad7f48c19a5e4aa80dcede4c" candidate_uuid: "999de4d383954ea5b7c75c01802c6497" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce91bb31f1d64e2897dd0da8047981c7"
I20260709 12:18:06.141553 15143 raft_consensus.cc:3060] T be5df69cad7f48c19a5e4aa80dcede4c P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:06.145763 15290 raft_consensus.cc:2468] T 424d7c56ad0c4822a8d009c4d824a8d2 P 999de4d383954ea5b7c75c01802c6497 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e7e05bf49114cf092451fa7b0876174 in term 1.
I20260709 12:18:06.150990 15340 leader_election.cc:290] T be5df69cad7f48c19a5e4aa80dcede4c P 999de4d383954ea5b7c75c01802c6497 [CANDIDATE]: Term 1 election: Requested vote from peers ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633), 2e7e05bf49114cf092451fa7b0876174 (127.3.212.130:42215)
I20260709 12:18:06.152391 15218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5df69cad7f48c19a5e4aa80dcede4c" candidate_uuid: "999de4d383954ea5b7c75c01802c6497" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7e05bf49114cf092451fa7b0876174"
I20260709 12:18:06.154294 15218 raft_consensus.cc:3060] T be5df69cad7f48c19a5e4aa80dcede4c P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:06.153635 15341 raft_consensus.cc:697] T 7978baf90ead4534804cd2aeeef77fe0 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 LEADER]: Becoming Leader. State: Replica: ce91bb31f1d64e2897dd0da8047981c7, State: Running, Role: LEADER
I20260709 12:18:06.158842 15341 consensus_queue.cc:237] T 7978baf90ead4534804cd2aeeef77fe0 P ce91bb31f1d64e2897dd0da8047981c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:06.150177 15339 consensus_queue.cc:1048] T c1991cd59d6441abac887582832f6a2a P 2e7e05bf49114cf092451fa7b0876174 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:18:06.156704 15289 raft_consensus.cc:2468] T b0a2c042781548d3bb7125a8f78942a5 P 999de4d383954ea5b7c75c01802c6497 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce91bb31f1d64e2897dd0da8047981c7 in term 1.
I20260709 12:18:06.157712 15217 raft_consensus.cc:2468] T b0a2c042781548d3bb7125a8f78942a5 P 2e7e05bf49114cf092451fa7b0876174 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce91bb31f1d64e2897dd0da8047981c7 in term 1.
I20260709 12:18:06.166767 15106 leader_election.cc:304] T b0a2c042781548d3bb7125a8f78942a5 P ce91bb31f1d64e2897dd0da8047981c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 999de4d383954ea5b7c75c01802c6497, ce91bb31f1d64e2897dd0da8047981c7; no voters: 
I20260709 12:18:06.166714 15354 consensus_queue.cc:1048] T a58b64f9a4be4ed1973d74fac507d0e3 P 2e7e05bf49114cf092451fa7b0876174 [LEADER]: Connected to new peer: Peer: permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:06.167593 15143 raft_consensus.cc:2468] T be5df69cad7f48c19a5e4aa80dcede4c P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 999de4d383954ea5b7c75c01802c6497 in term 1.
I20260709 12:18:06.168046 15382 raft_consensus.cc:2804] T b0a2c042781548d3bb7125a8f78942a5 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:06.168601 15382 raft_consensus.cc:697] T b0a2c042781548d3bb7125a8f78942a5 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 LEADER]: Becoming Leader. State: Replica: ce91bb31f1d64e2897dd0da8047981c7, State: Running, Role: LEADER
I20260709 12:18:06.168788 15256 leader_election.cc:304] T be5df69cad7f48c19a5e4aa80dcede4c P 999de4d383954ea5b7c75c01802c6497 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 999de4d383954ea5b7c75c01802c6497, ce91bb31f1d64e2897dd0da8047981c7; no voters: 
I20260709 12:18:06.169742 15340 raft_consensus.cc:2804] T be5df69cad7f48c19a5e4aa80dcede4c P 999de4d383954ea5b7c75c01802c6497 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:06.170321 15340 raft_consensus.cc:697] T be5df69cad7f48c19a5e4aa80dcede4c P 999de4d383954ea5b7c75c01802c6497 [term 1 LEADER]: Becoming Leader. State: Replica: 999de4d383954ea5b7c75c01802c6497, State: Running, Role: LEADER
I20260709 12:18:06.169694 15382 consensus_queue.cc:237] T b0a2c042781548d3bb7125a8f78942a5 P ce91bb31f1d64e2897dd0da8047981c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:06.171175 15340 consensus_queue.cc:237] T be5df69cad7f48c19a5e4aa80dcede4c P 999de4d383954ea5b7c75c01802c6497 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:06.166349 15389 raft_consensus.cc:493] T a58b64f9a4be4ed1973d74fac507d0e3 P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.172649 15389 raft_consensus.cc:515] T a58b64f9a4be4ed1973d74fac507d0e3 P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:06.173698 15140 raft_consensus.cc:3060] T a58b64f9a4be4ed1973d74fac507d0e3 P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:06.184222 15217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a58b64f9a4be4ed1973d74fac507d0e3" candidate_uuid: "ce91bb31f1d64e2897dd0da8047981c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7e05bf49114cf092451fa7b0876174" is_pre_election: true
I20260709 12:18:06.198385 15389 leader_election.cc:290] T a58b64f9a4be4ed1973d74fac507d0e3 P ce91bb31f1d64e2897dd0da8047981c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e7e05bf49114cf092451fa7b0876174 (127.3.212.130:42215), 999de4d383954ea5b7c75c01802c6497 (127.3.212.131:33219)
I20260709 12:18:06.198998 15290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a58b64f9a4be4ed1973d74fac507d0e3" candidate_uuid: "ce91bb31f1d64e2897dd0da8047981c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "999de4d383954ea5b7c75c01802c6497" is_pre_election: true
I20260709 12:18:06.200024 15340 raft_consensus.cc:493] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.200596 15340 raft_consensus.cc:515] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:06.200806 15106 leader_election.cc:304] T a58b64f9a4be4ed1973d74fac507d0e3 P ce91bb31f1d64e2897dd0da8047981c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce91bb31f1d64e2897dd0da8047981c7; no voters: 2e7e05bf49114cf092451fa7b0876174, 999de4d383954ea5b7c75c01802c6497
I20260709 12:18:06.166895 15332 tablet_bootstrap.cc:492] T 4fe037cbd5e841c3ba79c2a066b045a9 P 2e7e05bf49114cf092451fa7b0876174: No bootstrap required, opened a new log
I20260709 12:18:06.202201 15332 ts_tablet_manager.cc:1403] T 4fe037cbd5e841c3ba79c2a066b045a9 P 2e7e05bf49114cf092451fa7b0876174: Time spent bootstrapping tablet: real 0.166s	user 0.044s	sys 0.017s
I20260709 12:18:06.203579 15143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c647fad7e69f46048ebcc6927eac1a58" candidate_uuid: "999de4d383954ea5b7c75c01802c6497" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce91bb31f1d64e2897dd0da8047981c7" is_pre_election: true
I20260709 12:18:06.204277 15143 raft_consensus.cc:2468] T c647fad7e69f46048ebcc6927eac1a58 P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 999de4d383954ea5b7c75c01802c6497 in term 0.
I20260709 12:18:06.204006 15038 catalog_manager.cc:5697] T 424d7c56ad0c4822a8d009c4d824a8d2 P 2e7e05bf49114cf092451fa7b0876174 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e7e05bf49114cf092451fa7b0876174 (127.3.212.130). New cstate: current_term: 1 leader_uuid: "2e7e05bf49114cf092451fa7b0876174" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:06.205117 15332 raft_consensus.cc:359] T 4fe037cbd5e841c3ba79c2a066b045a9 P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:06.211002 15332 raft_consensus.cc:385] T 4fe037cbd5e841c3ba79c2a066b045a9 P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:06.211330 15332 raft_consensus.cc:740] T 4fe037cbd5e841c3ba79c2a066b045a9 P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e7e05bf49114cf092451fa7b0876174, State: Initialized, Role: FOLLOWER
I20260709 12:18:06.204243 15341 raft_consensus.cc:2749] T a58b64f9a4be4ed1973d74fac507d0e3 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:06.214421 15218 raft_consensus.cc:2468] T be5df69cad7f48c19a5e4aa80dcede4c P 2e7e05bf49114cf092451fa7b0876174 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 999de4d383954ea5b7c75c01802c6497 in term 1.
I20260709 12:18:06.218053 15332 consensus_queue.cc:260] T 4fe037cbd5e841c3ba79c2a066b045a9 P 2e7e05bf49114cf092451fa7b0876174 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:06.211195 15256 leader_election.cc:304] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 999de4d383954ea5b7c75c01802c6497, ce91bb31f1d64e2897dd0da8047981c7; no voters: 
I20260709 12:18:06.227687 15359 raft_consensus.cc:2804] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:06.228900 15359 raft_consensus.cc:493] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:06.229198 15359 raft_consensus.cc:3060] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:06.224645 15356 consensus_queue.cc:1048] T a58b64f9a4be4ed1973d74fac507d0e3 P 2e7e05bf49114cf092451fa7b0876174 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:18:06.237788 15339 consensus_queue.cc:1048] T c1991cd59d6441abac887582832f6a2a P 2e7e05bf49114cf092451fa7b0876174 [LEADER]: Connected to new peer: Peer: permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:06.238096 15038 catalog_manager.cc:5697] T be5df69cad7f48c19a5e4aa80dcede4c P 999de4d383954ea5b7c75c01802c6497 reported cstate change: term changed from 0 to 1, leader changed from <none> to 999de4d383954ea5b7c75c01802c6497 (127.3.212.131). New cstate: current_term: 1 leader_uuid: "999de4d383954ea5b7c75c01802c6497" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:06.242170 15332 ts_tablet_manager.cc:1434] T 4fe037cbd5e841c3ba79c2a066b045a9 P 2e7e05bf49114cf092451fa7b0876174: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.001s
I20260709 12:18:06.243317 15332 tablet_bootstrap.cc:492] T c647fad7e69f46048ebcc6927eac1a58 P 2e7e05bf49114cf092451fa7b0876174: Bootstrap starting.
I20260709 12:18:06.247960 15359 raft_consensus.cc:515] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:06.254051 15359 leader_election.cc:290] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497 [CANDIDATE]: Term 1 election: Requested vote from peers ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633), 2e7e05bf49114cf092451fa7b0876174 (127.3.212.130:42215)
I20260709 12:18:06.255234 15218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c647fad7e69f46048ebcc6927eac1a58" candidate_uuid: "999de4d383954ea5b7c75c01802c6497" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7e05bf49114cf092451fa7b0876174" is_pre_election: true
W20260709 12:18:06.256953 15255 leader_election.cc:343] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e7e05bf49114cf092451fa7b0876174 (127.3.212.130:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:06.258929 15332 tablet_bootstrap.cc:654] T c647fad7e69f46048ebcc6927eac1a58 P 2e7e05bf49114cf092451fa7b0876174: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:06.253711 15340 leader_election.cc:290] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633), 2e7e05bf49114cf092451fa7b0876174 (127.3.212.130:42215)
I20260709 12:18:06.264431 15332 tablet_bootstrap.cc:492] T c647fad7e69f46048ebcc6927eac1a58 P 2e7e05bf49114cf092451fa7b0876174: No bootstrap required, opened a new log
I20260709 12:18:06.253842 15217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c647fad7e69f46048ebcc6927eac1a58" candidate_uuid: "999de4d383954ea5b7c75c01802c6497" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7e05bf49114cf092451fa7b0876174"
I20260709 12:18:06.264930 15332 ts_tablet_manager.cc:1403] T c647fad7e69f46048ebcc6927eac1a58 P 2e7e05bf49114cf092451fa7b0876174: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.001s
W20260709 12:18:06.265934 15255 leader_election.cc:343] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2e7e05bf49114cf092451fa7b0876174 (127.3.212.130:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:06.267932 15332 raft_consensus.cc:359] T c647fad7e69f46048ebcc6927eac1a58 P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:06.268771 15332 raft_consensus.cc:385] T c647fad7e69f46048ebcc6927eac1a58 P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:06.269032 15332 raft_consensus.cc:740] T c647fad7e69f46048ebcc6927eac1a58 P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e7e05bf49114cf092451fa7b0876174, State: Initialized, Role: FOLLOWER
I20260709 12:18:06.270396 15332 consensus_queue.cc:260] T c647fad7e69f46048ebcc6927eac1a58 P 2e7e05bf49114cf092451fa7b0876174 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:06.271638 15142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c647fad7e69f46048ebcc6927eac1a58" candidate_uuid: "999de4d383954ea5b7c75c01802c6497" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce91bb31f1d64e2897dd0da8047981c7"
I20260709 12:18:06.272470 15142 raft_consensus.cc:3060] T c647fad7e69f46048ebcc6927eac1a58 P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:06.274875 15332 ts_tablet_manager.cc:1434] T c647fad7e69f46048ebcc6927eac1a58 P 2e7e05bf49114cf092451fa7b0876174: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:18:06.282845 15142 raft_consensus.cc:2468] T c647fad7e69f46048ebcc6927eac1a58 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 999de4d383954ea5b7c75c01802c6497 in term 1.
I20260709 12:18:06.282104 15040 catalog_manager.cc:5697] T 3366909acc834c76ac9845f902ce93f6 P ce91bb31f1d64e2897dd0da8047981c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129). New cstate: current_term: 1 leader_uuid: "ce91bb31f1d64e2897dd0da8047981c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:06.284140 15256 leader_election.cc:304] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 999de4d383954ea5b7c75c01802c6497, ce91bb31f1d64e2897dd0da8047981c7; no voters: 2e7e05bf49114cf092451fa7b0876174
I20260709 12:18:06.284050 15040 catalog_manager.cc:5697] T 7978baf90ead4534804cd2aeeef77fe0 P ce91bb31f1d64e2897dd0da8047981c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129). New cstate: current_term: 1 leader_uuid: "ce91bb31f1d64e2897dd0da8047981c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:06.285036 15340 raft_consensus.cc:2804] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:06.285532 15340 raft_consensus.cc:697] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497 [term 1 LEADER]: Becoming Leader. State: Replica: 999de4d383954ea5b7c75c01802c6497, State: Running, Role: LEADER
I20260709 12:18:06.285959 15040 catalog_manager.cc:5697] T b0a2c042781548d3bb7125a8f78942a5 P ce91bb31f1d64e2897dd0da8047981c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129). New cstate: current_term: 1 leader_uuid: "ce91bb31f1d64e2897dd0da8047981c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:06.286191 15340 consensus_queue.cc:237] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:06.305574 15039 catalog_manager.cc:5697] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497 reported cstate change: term changed from 0 to 1, leader changed from <none> to 999de4d383954ea5b7c75c01802c6497 (127.3.212.131). New cstate: current_term: 1 leader_uuid: "999de4d383954ea5b7c75c01802c6497" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:06.373274 15341 raft_consensus.cc:493] T 4fe037cbd5e841c3ba79c2a066b045a9 P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.373864 15341 raft_consensus.cc:515] T 4fe037cbd5e841c3ba79c2a066b045a9 P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:06.375851 15341 leader_election.cc:290] T 4fe037cbd5e841c3ba79c2a066b045a9 P ce91bb31f1d64e2897dd0da8047981c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e7e05bf49114cf092451fa7b0876174 (127.3.212.130:42215), 999de4d383954ea5b7c75c01802c6497 (127.3.212.131:33219)
I20260709 12:18:06.376688 15217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe037cbd5e841c3ba79c2a066b045a9" candidate_uuid: "ce91bb31f1d64e2897dd0da8047981c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7e05bf49114cf092451fa7b0876174" is_pre_election: true
I20260709 12:18:06.376979 15290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe037cbd5e841c3ba79c2a066b045a9" candidate_uuid: "ce91bb31f1d64e2897dd0da8047981c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "999de4d383954ea5b7c75c01802c6497" is_pre_election: true
I20260709 12:18:06.377259 15217 raft_consensus.cc:2468] T 4fe037cbd5e841c3ba79c2a066b045a9 P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce91bb31f1d64e2897dd0da8047981c7 in term 0.
I20260709 12:18:06.377799 15290 raft_consensus.cc:2468] T 4fe037cbd5e841c3ba79c2a066b045a9 P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce91bb31f1d64e2897dd0da8047981c7 in term 0.
I20260709 12:18:06.378499 15106 leader_election.cc:304] T 4fe037cbd5e841c3ba79c2a066b045a9 P ce91bb31f1d64e2897dd0da8047981c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e7e05bf49114cf092451fa7b0876174, ce91bb31f1d64e2897dd0da8047981c7; no voters: 
I20260709 12:18:06.379489 15341 raft_consensus.cc:2804] T 4fe037cbd5e841c3ba79c2a066b045a9 P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:06.379850 15341 raft_consensus.cc:493] T 4fe037cbd5e841c3ba79c2a066b045a9 P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:06.380162 15341 raft_consensus.cc:3060] T 4fe037cbd5e841c3ba79c2a066b045a9 P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:06.385339 15341 raft_consensus.cc:515] T 4fe037cbd5e841c3ba79c2a066b045a9 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:06.387248 15341 leader_election.cc:290] T 4fe037cbd5e841c3ba79c2a066b045a9 P ce91bb31f1d64e2897dd0da8047981c7 [CANDIDATE]: Term 1 election: Requested vote from peers 2e7e05bf49114cf092451fa7b0876174 (127.3.212.130:42215), 999de4d383954ea5b7c75c01802c6497 (127.3.212.131:33219)
I20260709 12:18:06.387864 15217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe037cbd5e841c3ba79c2a066b045a9" candidate_uuid: "ce91bb31f1d64e2897dd0da8047981c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7e05bf49114cf092451fa7b0876174"
I20260709 12:18:06.388228 15290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe037cbd5e841c3ba79c2a066b045a9" candidate_uuid: "ce91bb31f1d64e2897dd0da8047981c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "999de4d383954ea5b7c75c01802c6497"
I20260709 12:18:06.388532 15217 raft_consensus.cc:3060] T 4fe037cbd5e841c3ba79c2a066b045a9 P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:06.388936 15290 raft_consensus.cc:3060] T 4fe037cbd5e841c3ba79c2a066b045a9 P 999de4d383954ea5b7c75c01802c6497 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:06.393952 15217 raft_consensus.cc:2468] T 4fe037cbd5e841c3ba79c2a066b045a9 P 2e7e05bf49114cf092451fa7b0876174 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce91bb31f1d64e2897dd0da8047981c7 in term 1.
I20260709 12:18:06.393980 15290 raft_consensus.cc:2468] T 4fe037cbd5e841c3ba79c2a066b045a9 P 999de4d383954ea5b7c75c01802c6497 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce91bb31f1d64e2897dd0da8047981c7 in term 1.
I20260709 12:18:06.395088 15106 leader_election.cc:304] T 4fe037cbd5e841c3ba79c2a066b045a9 P ce91bb31f1d64e2897dd0da8047981c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e7e05bf49114cf092451fa7b0876174, ce91bb31f1d64e2897dd0da8047981c7; no voters: 
I20260709 12:18:06.395737 15341 raft_consensus.cc:2804] T 4fe037cbd5e841c3ba79c2a066b045a9 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:06.396202 15341 raft_consensus.cc:697] T 4fe037cbd5e841c3ba79c2a066b045a9 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 LEADER]: Becoming Leader. State: Replica: ce91bb31f1d64e2897dd0da8047981c7, State: Running, Role: LEADER
I20260709 12:18:06.396955 15341 consensus_queue.cc:237] T 4fe037cbd5e841c3ba79c2a066b045a9 P ce91bb31f1d64e2897dd0da8047981c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:06.399510 15142 raft_consensus.cc:3060] T 65fd6772c01e480181699cb1c8246779 P ce91bb31f1d64e2897dd0da8047981c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:06.406348 15340 consensus_queue.cc:1048] T 65fd6772c01e480181699cb1c8246779 P 999de4d383954ea5b7c75c01802c6497 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:06.410601 15039 catalog_manager.cc:5697] T 4fe037cbd5e841c3ba79c2a066b045a9 P ce91bb31f1d64e2897dd0da8047981c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129). New cstate: current_term: 1 leader_uuid: "ce91bb31f1d64e2897dd0da8047981c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:06.420197 15373 consensus_queue.cc:1048] T 65fd6772c01e480181699cb1c8246779 P 999de4d383954ea5b7c75c01802c6497 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:06.522908 15341 consensus_queue.cc:1048] T 3366909acc834c76ac9845f902ce93f6 P ce91bb31f1d64e2897dd0da8047981c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:06.535211 15341 consensus_queue.cc:1048] T 3366909acc834c76ac9845f902ce93f6 P ce91bb31f1d64e2897dd0da8047981c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:06.545225 15339 consensus_queue.cc:1048] T 424d7c56ad0c4822a8d009c4d824a8d2 P 2e7e05bf49114cf092451fa7b0876174 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:06.556911 15356 consensus_queue.cc:1048] T 424d7c56ad0c4822a8d009c4d824a8d2 P 2e7e05bf49114cf092451fa7b0876174 [LEADER]: Connected to new peer: Peer: permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:06.579066 15341 consensus_queue.cc:1048] T 7978baf90ead4534804cd2aeeef77fe0 P ce91bb31f1d64e2897dd0da8047981c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:06.580173 15389 consensus_queue.cc:1048] T b0a2c042781548d3bb7125a8f78942a5 P ce91bb31f1d64e2897dd0da8047981c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:06.593117 15382 consensus_queue.cc:1048] T b0a2c042781548d3bb7125a8f78942a5 P ce91bb31f1d64e2897dd0da8047981c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:06.594482 15389 consensus_queue.cc:1048] T 7978baf90ead4534804cd2aeeef77fe0 P ce91bb31f1d64e2897dd0da8047981c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:06.615110  3922 ts_manager.cc:295] Set tserver state for ce91bb31f1d64e2897dd0da8047981c7 to MAINTENANCE_MODE
I20260709 12:18:06.616340  3922 tablet_server.cc:179] TabletServer@127.3.212.129:0 shutting down...
W20260709 12:18:06.642897 15256 consensus_peers.cc:597] T be5df69cad7f48c19a5e4aa80dcede4c P 999de4d383954ea5b7c75c01802c6497 -> Peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Couldn't send request to peer ce91bb31f1d64e2897dd0da8047981c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:06.655886 15182 consensus_peers.cc:597] T a58b64f9a4be4ed1973d74fac507d0e3 P 2e7e05bf49114cf092451fa7b0876174 -> Peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Couldn't send request to peer ce91bb31f1d64e2897dd0da8047981c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:06.657711  3922 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:18:06.658507  3922 tablet_replica.cc:333] T 424d7c56ad0c4822a8d009c4d824a8d2 P ce91bb31f1d64e2897dd0da8047981c7: stopping tablet replica
I20260709 12:18:06.659204  3922 raft_consensus.cc:2243] T 424d7c56ad0c4822a8d009c4d824a8d2 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:06.659622  3922 raft_consensus.cc:2272] T 424d7c56ad0c4822a8d009c4d824a8d2 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:06.662045  3922 tablet_replica.cc:333] T c647fad7e69f46048ebcc6927eac1a58 P ce91bb31f1d64e2897dd0da8047981c7: stopping tablet replica
I20260709 12:18:06.662581  3922 raft_consensus.cc:2243] T c647fad7e69f46048ebcc6927eac1a58 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:06.662937  3922 raft_consensus.cc:2272] T c647fad7e69f46048ebcc6927eac1a58 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:06.664702  3922 tablet_replica.cc:333] T be5df69cad7f48c19a5e4aa80dcede4c P ce91bb31f1d64e2897dd0da8047981c7: stopping tablet replica
I20260709 12:18:06.665197  3922 raft_consensus.cc:2243] T be5df69cad7f48c19a5e4aa80dcede4c P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:06.665573  3922 raft_consensus.cc:2272] T be5df69cad7f48c19a5e4aa80dcede4c P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:06.667200  3922 tablet_replica.cc:333] T 65fd6772c01e480181699cb1c8246779 P ce91bb31f1d64e2897dd0da8047981c7: stopping tablet replica
I20260709 12:18:06.667793  3922 raft_consensus.cc:2243] T 65fd6772c01e480181699cb1c8246779 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:06.668210  3922 raft_consensus.cc:2272] T 65fd6772c01e480181699cb1c8246779 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:06.670780  3922 tablet_replica.cc:333] T a58b64f9a4be4ed1973d74fac507d0e3 P ce91bb31f1d64e2897dd0da8047981c7: stopping tablet replica
I20260709 12:18:06.671350  3922 raft_consensus.cc:2243] T a58b64f9a4be4ed1973d74fac507d0e3 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:06.671766  3922 raft_consensus.cc:2272] T a58b64f9a4be4ed1973d74fac507d0e3 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:06.674137  3922 tablet_replica.cc:333] T 3366909acc834c76ac9845f902ce93f6 P ce91bb31f1d64e2897dd0da8047981c7: stopping tablet replica
I20260709 12:18:06.674705  3922 raft_consensus.cc:2243] T 3366909acc834c76ac9845f902ce93f6 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:06.675560  3922 raft_consensus.cc:2272] T 3366909acc834c76ac9845f902ce93f6 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:06.677606  3922 tablet_replica.cc:333] T 7978baf90ead4534804cd2aeeef77fe0 P ce91bb31f1d64e2897dd0da8047981c7: stopping tablet replica
I20260709 12:18:06.678130  3922 raft_consensus.cc:2243] T 7978baf90ead4534804cd2aeeef77fe0 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:06.678915  3922 raft_consensus.cc:2272] T 7978baf90ead4534804cd2aeeef77fe0 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:06.681021  3922 tablet_replica.cc:333] T b0a2c042781548d3bb7125a8f78942a5 P ce91bb31f1d64e2897dd0da8047981c7: stopping tablet replica
I20260709 12:18:06.681631  3922 raft_consensus.cc:2243] T b0a2c042781548d3bb7125a8f78942a5 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:06.682390  3922 raft_consensus.cc:2272] T b0a2c042781548d3bb7125a8f78942a5 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:06.684419  3922 tablet_replica.cc:333] T 4fe037cbd5e841c3ba79c2a066b045a9 P ce91bb31f1d64e2897dd0da8047981c7: stopping tablet replica
I20260709 12:18:06.684918  3922 raft_consensus.cc:2243] T 4fe037cbd5e841c3ba79c2a066b045a9 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:06.685511  3922 pending_rounds.cc:70] T 4fe037cbd5e841c3ba79c2a066b045a9 P ce91bb31f1d64e2897dd0da8047981c7: Trying to abort 1 pending ops.
I20260709 12:18:06.685664  3922 pending_rounds.cc:77] T 4fe037cbd5e841c3ba79c2a066b045a9 P ce91bb31f1d64e2897dd0da8047981c7: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305623496289722368 op_type: NO_OP noop_request { }
I20260709 12:18:06.685938  3922 raft_consensus.cc:2889] T 4fe037cbd5e841c3ba79c2a066b045a9 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:18:06.686156  3922 raft_consensus.cc:2272] T 4fe037cbd5e841c3ba79c2a066b045a9 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:06.688172  3922 tablet_replica.cc:333] T c1991cd59d6441abac887582832f6a2a P ce91bb31f1d64e2897dd0da8047981c7: stopping tablet replica
I20260709 12:18:06.688638  3922 raft_consensus.cc:2243] T c1991cd59d6441abac887582832f6a2a P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:06.689006  3922 raft_consensus.cc:2272] T c1991cd59d6441abac887582832f6a2a P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:06.697597 15182 consensus_peers.cc:597] T c1991cd59d6441abac887582832f6a2a P 2e7e05bf49114cf092451fa7b0876174 -> Peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Couldn't send request to peer ce91bb31f1d64e2897dd0da8047981c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:06.698166 15217 raft_consensus.cc:3060] T c647fad7e69f46048ebcc6927eac1a58 P 2e7e05bf49114cf092451fa7b0876174 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:06.707171 15373 consensus_queue.cc:1048] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:18:06.732030 15256 consensus_peers.cc:597] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497 -> Peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Couldn't send request to peer ce91bb31f1d64e2897dd0da8047981c7. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:33633: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:06.757617 15340 consensus_queue.cc:1048] T be5df69cad7f48c19a5e4aa80dcede4c P 999de4d383954ea5b7c75c01802c6497 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:18:06.880630 15256 consensus_peers.cc:597] T 65fd6772c01e480181699cb1c8246779 P 999de4d383954ea5b7c75c01802c6497 -> Peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Couldn't send request to peer ce91bb31f1d64e2897dd0da8047981c7. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:33633: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:06.928870 15164 debug-util.cc:398] Leaking SignalData structure 0x7b0800058c00 after lost signal to thread 3925
W20260709 12:18:06.930137 15164 debug-util.cc:398] Leaking SignalData structure 0x7b08002c7460 after lost signal to thread 15075
W20260709 12:18:06.932996 15164 debug-util.cc:398] Leaking SignalData structure 0x7b08001e02c0 after lost signal to thread 15316
W20260709 12:18:06.980028 15182 consensus_peers.cc:597] T 424d7c56ad0c4822a8d009c4d824a8d2 P 2e7e05bf49114cf092451fa7b0876174 -> Peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Couldn't send request to peer ce91bb31f1d64e2897dd0da8047981c7. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:33633: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:07.579799 15089 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:18:07.671838 15256 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.212.129:33633: connect: Connection refused (error 111) [suppressed 168 similar messages]
W20260709 12:18:07.717600  3922 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 15164)
I20260709 12:18:08.034797 15373 raft_consensus.cc:493] T 3366909acc834c76ac9845f902ce93f6 P 999de4d383954ea5b7c75c01802c6497 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce91bb31f1d64e2897dd0da8047981c7)
I20260709 12:18:08.035488 15373 raft_consensus.cc:515] T 3366909acc834c76ac9845f902ce93f6 P 999de4d383954ea5b7c75c01802c6497 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:08.037835 15373 leader_election.cc:290] T 3366909acc834c76ac9845f902ce93f6 P 999de4d383954ea5b7c75c01802c6497 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633), 2e7e05bf49114cf092451fa7b0876174 (127.3.212.130:42215)
I20260709 12:18:08.039197 15356 raft_consensus.cc:493] T 3366909acc834c76ac9845f902ce93f6 P 2e7e05bf49114cf092451fa7b0876174 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce91bb31f1d64e2897dd0da8047981c7)
I20260709 12:18:08.039167 15217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3366909acc834c76ac9845f902ce93f6" candidate_uuid: "999de4d383954ea5b7c75c01802c6497" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e7e05bf49114cf092451fa7b0876174" is_pre_election: true
I20260709 12:18:08.040074 15356 raft_consensus.cc:515] T 3366909acc834c76ac9845f902ce93f6 P 2e7e05bf49114cf092451fa7b0876174 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:08.041821 15217 raft_consensus.cc:2468] T 3366909acc834c76ac9845f902ce93f6 P 2e7e05bf49114cf092451fa7b0876174 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 999de4d383954ea5b7c75c01802c6497 in term 1.
W20260709 12:18:08.042773 15256 leader_election.cc:336] T 3366909acc834c76ac9845f902ce93f6 P 999de4d383954ea5b7c75c01802c6497 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Network error: Client connection negotiation failed: client connection to 127.3.212.129:33633: connect: Connection refused (error 111)
I20260709 12:18:08.044221 15290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3366909acc834c76ac9845f902ce93f6" candidate_uuid: "2e7e05bf49114cf092451fa7b0876174" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "999de4d383954ea5b7c75c01802c6497" is_pre_election: true
I20260709 12:18:08.044978 15290 raft_consensus.cc:2468] T 3366909acc834c76ac9845f902ce93f6 P 999de4d383954ea5b7c75c01802c6497 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e7e05bf49114cf092451fa7b0876174 in term 1.
I20260709 12:18:08.044991 15356 leader_election.cc:290] T 3366909acc834c76ac9845f902ce93f6 P 2e7e05bf49114cf092451fa7b0876174 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633), 999de4d383954ea5b7c75c01802c6497 (127.3.212.131:33219)
I20260709 12:18:08.046211 15255 leader_election.cc:304] T 3366909acc834c76ac9845f902ce93f6 P 999de4d383954ea5b7c75c01802c6497 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e7e05bf49114cf092451fa7b0876174, 999de4d383954ea5b7c75c01802c6497; no voters: ce91bb31f1d64e2897dd0da8047981c7
I20260709 12:18:08.047008 15181 leader_election.cc:304] T 3366909acc834c76ac9845f902ce93f6 P 2e7e05bf49114cf092451fa7b0876174 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e7e05bf49114cf092451fa7b0876174, 999de4d383954ea5b7c75c01802c6497; no voters: 
I20260709 12:18:08.047582 15373 raft_consensus.cc:2804] T 3366909acc834c76ac9845f902ce93f6 P 999de4d383954ea5b7c75c01802c6497 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:08.047966 15356 raft_consensus.cc:2804] T 3366909acc834c76ac9845f902ce93f6 P 2e7e05bf49114cf092451fa7b0876174 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:08.048095 15373 raft_consensus.cc:493] T 3366909acc834c76ac9845f902ce93f6 P 999de4d383954ea5b7c75c01802c6497 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce91bb31f1d64e2897dd0da8047981c7)
I20260709 12:18:08.048445 15356 raft_consensus.cc:493] T 3366909acc834c76ac9845f902ce93f6 P 2e7e05bf49114cf092451fa7b0876174 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce91bb31f1d64e2897dd0da8047981c7)
I20260709 12:18:08.048684 15373 raft_consensus.cc:3060] T 3366909acc834c76ac9845f902ce93f6 P 999de4d383954ea5b7c75c01802c6497 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:08.048931 15356 raft_consensus.cc:3060] T 3366909acc834c76ac9845f902ce93f6 P 2e7e05bf49114cf092451fa7b0876174 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:18:08.048985 15182 leader_election.cc:336] T 3366909acc834c76ac9845f902ce93f6 P 2e7e05bf49114cf092451fa7b0876174 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Network error: Client connection negotiation failed: client connection to 127.3.212.129:33633: connect: Connection refused (error 111)
I20260709 12:18:08.056990 15356 raft_consensus.cc:515] T 3366909acc834c76ac9845f902ce93f6 P 2e7e05bf49114cf092451fa7b0876174 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:08.056990 15373 raft_consensus.cc:515] T 3366909acc834c76ac9845f902ce93f6 P 999de4d383954ea5b7c75c01802c6497 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:08.059549 15356 leader_election.cc:290] T 3366909acc834c76ac9845f902ce93f6 P 2e7e05bf49114cf092451fa7b0876174 [CANDIDATE]: Term 2 election: Requested vote from peers ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633), 999de4d383954ea5b7c75c01802c6497 (127.3.212.131:33219)
I20260709 12:18:08.060272 15373 leader_election.cc:290] T 3366909acc834c76ac9845f902ce93f6 P 999de4d383954ea5b7c75c01802c6497 [CANDIDATE]: Term 2 election: Requested vote from peers ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633), 2e7e05bf49114cf092451fa7b0876174 (127.3.212.130:42215)
I20260709 12:18:08.060761 15290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3366909acc834c76ac9845f902ce93f6" candidate_uuid: "2e7e05bf49114cf092451fa7b0876174" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "999de4d383954ea5b7c75c01802c6497"
I20260709 12:18:08.061270 15217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3366909acc834c76ac9845f902ce93f6" candidate_uuid: "999de4d383954ea5b7c75c01802c6497" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e7e05bf49114cf092451fa7b0876174"
I20260709 12:18:08.061667 15290 raft_consensus.cc:2393] T 3366909acc834c76ac9845f902ce93f6 P 999de4d383954ea5b7c75c01802c6497 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2e7e05bf49114cf092451fa7b0876174 in current term 2: Already voted for candidate 999de4d383954ea5b7c75c01802c6497 in this term.
I20260709 12:18:08.062180 15217 raft_consensus.cc:2393] T 3366909acc834c76ac9845f902ce93f6 P 2e7e05bf49114cf092451fa7b0876174 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 999de4d383954ea5b7c75c01802c6497 in current term 2: Already voted for candidate 2e7e05bf49114cf092451fa7b0876174 in this term.
W20260709 12:18:08.065527 15256 leader_election.cc:336] T 3366909acc834c76ac9845f902ce93f6 P 999de4d383954ea5b7c75c01802c6497 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Network error: Client connection negotiation failed: client connection to 127.3.212.129:33633: connect: Connection refused (error 111)
I20260709 12:18:08.065920 15256 leader_election.cc:304] T 3366909acc834c76ac9845f902ce93f6 P 999de4d383954ea5b7c75c01802c6497 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 999de4d383954ea5b7c75c01802c6497; no voters: 2e7e05bf49114cf092451fa7b0876174, ce91bb31f1d64e2897dd0da8047981c7
I20260709 12:18:08.066860 15373 raft_consensus.cc:2749] T 3366909acc834c76ac9845f902ce93f6 P 999de4d383954ea5b7c75c01802c6497 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:18:08.068416 15182 leader_election.cc:336] T 3366909acc834c76ac9845f902ce93f6 P 2e7e05bf49114cf092451fa7b0876174 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Network error: Client connection negotiation failed: client connection to 127.3.212.129:33633: connect: Connection refused (error 111)
I20260709 12:18:08.068964 15182 leader_election.cc:304] T 3366909acc834c76ac9845f902ce93f6 P 2e7e05bf49114cf092451fa7b0876174 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e7e05bf49114cf092451fa7b0876174; no voters: 999de4d383954ea5b7c75c01802c6497, ce91bb31f1d64e2897dd0da8047981c7
I20260709 12:18:08.069712 15356 raft_consensus.cc:2749] T 3366909acc834c76ac9845f902ce93f6 P 2e7e05bf49114cf092451fa7b0876174 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:18:08.091224 15373 raft_consensus.cc:493] T 7978baf90ead4534804cd2aeeef77fe0 P 999de4d383954ea5b7c75c01802c6497 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce91bb31f1d64e2897dd0da8047981c7)
I20260709 12:18:08.091784 15373 raft_consensus.cc:515] T 7978baf90ead4534804cd2aeeef77fe0 P 999de4d383954ea5b7c75c01802c6497 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:08.094749 15373 leader_election.cc:290] T 7978baf90ead4534804cd2aeeef77fe0 P 999de4d383954ea5b7c75c01802c6497 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633), 2e7e05bf49114cf092451fa7b0876174 (127.3.212.130:42215)
I20260709 12:18:08.095170 15217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7978baf90ead4534804cd2aeeef77fe0" candidate_uuid: "999de4d383954ea5b7c75c01802c6497" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e7e05bf49114cf092451fa7b0876174" is_pre_election: true
I20260709 12:18:08.098682 15356 raft_consensus.cc:493] T 7978baf90ead4534804cd2aeeef77fe0 P 2e7e05bf49114cf092451fa7b0876174 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce91bb31f1d64e2897dd0da8047981c7)
I20260709 12:18:08.099248 15356 raft_consensus.cc:515] T 7978baf90ead4534804cd2aeeef77fe0 P 2e7e05bf49114cf092451fa7b0876174 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
W20260709 12:18:08.099647 15256 leader_election.cc:336] T 7978baf90ead4534804cd2aeeef77fe0 P 999de4d383954ea5b7c75c01802c6497 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Network error: Client connection negotiation failed: client connection to 127.3.212.129:33633: connect: Connection refused (error 111)
I20260709 12:18:08.100239 15256 leader_election.cc:304] T 7978baf90ead4534804cd2aeeef77fe0 P 999de4d383954ea5b7c75c01802c6497 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 999de4d383954ea5b7c75c01802c6497; no voters: 2e7e05bf49114cf092451fa7b0876174, ce91bb31f1d64e2897dd0da8047981c7
I20260709 12:18:08.101084 15421 raft_consensus.cc:493] T b0a2c042781548d3bb7125a8f78942a5 P 999de4d383954ea5b7c75c01802c6497 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce91bb31f1d64e2897dd0da8047981c7)
I20260709 12:18:08.101706 15421 raft_consensus.cc:515] T b0a2c042781548d3bb7125a8f78942a5 P 999de4d383954ea5b7c75c01802c6497 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:08.102588 15356 leader_election.cc:290] T 7978baf90ead4534804cd2aeeef77fe0 P 2e7e05bf49114cf092451fa7b0876174 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633), 999de4d383954ea5b7c75c01802c6497 (127.3.212.131:33219)
I20260709 12:18:08.102929 15290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7978baf90ead4534804cd2aeeef77fe0" candidate_uuid: "2e7e05bf49114cf092451fa7b0876174" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "999de4d383954ea5b7c75c01802c6497" is_pre_election: true
I20260709 12:18:08.103067 15373 raft_consensus.cc:2749] T 7978baf90ead4534804cd2aeeef77fe0 P 999de4d383954ea5b7c75c01802c6497 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:08.104799 15290 raft_consensus.cc:2468] T 7978baf90ead4534804cd2aeeef77fe0 P 999de4d383954ea5b7c75c01802c6497 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e7e05bf49114cf092451fa7b0876174 in term 1.
I20260709 12:18:08.106209 15181 leader_election.cc:304] T 7978baf90ead4534804cd2aeeef77fe0 P 2e7e05bf49114cf092451fa7b0876174 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e7e05bf49114cf092451fa7b0876174, 999de4d383954ea5b7c75c01802c6497; no voters: 
W20260709 12:18:08.106806 15182 leader_election.cc:336] T 7978baf90ead4534804cd2aeeef77fe0 P 2e7e05bf49114cf092451fa7b0876174 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Network error: Client connection negotiation failed: client connection to 127.3.212.129:33633: connect: Connection refused (error 111)
I20260709 12:18:08.107445 15421 leader_election.cc:290] T b0a2c042781548d3bb7125a8f78942a5 P 999de4d383954ea5b7c75c01802c6497 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633), 2e7e05bf49114cf092451fa7b0876174 (127.3.212.130:42215)
I20260709 12:18:08.107761 15217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0a2c042781548d3bb7125a8f78942a5" candidate_uuid: "999de4d383954ea5b7c75c01802c6497" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e7e05bf49114cf092451fa7b0876174" is_pre_election: true
I20260709 12:18:08.108151 15356 raft_consensus.cc:2804] T 7978baf90ead4534804cd2aeeef77fe0 P 2e7e05bf49114cf092451fa7b0876174 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:08.109112 15356 raft_consensus.cc:493] T 7978baf90ead4534804cd2aeeef77fe0 P 2e7e05bf49114cf092451fa7b0876174 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce91bb31f1d64e2897dd0da8047981c7)
I20260709 12:18:08.109601 15356 raft_consensus.cc:3060] T 7978baf90ead4534804cd2aeeef77fe0 P 2e7e05bf49114cf092451fa7b0876174 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:18:08.112813 15256 leader_election.cc:336] T b0a2c042781548d3bb7125a8f78942a5 P 999de4d383954ea5b7c75c01802c6497 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Network error: Client connection negotiation failed: client connection to 127.3.212.129:33633: connect: Connection refused (error 111)
I20260709 12:18:08.113596 15256 leader_election.cc:304] T b0a2c042781548d3bb7125a8f78942a5 P 999de4d383954ea5b7c75c01802c6497 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 999de4d383954ea5b7c75c01802c6497; no voters: 2e7e05bf49114cf092451fa7b0876174, ce91bb31f1d64e2897dd0da8047981c7
I20260709 12:18:08.114494 15421 raft_consensus.cc:2749] T b0a2c042781548d3bb7125a8f78942a5 P 999de4d383954ea5b7c75c01802c6497 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:08.118067 15356 raft_consensus.cc:515] T 7978baf90ead4534804cd2aeeef77fe0 P 2e7e05bf49114cf092451fa7b0876174 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:08.120591 15422 raft_consensus.cc:493] T b0a2c042781548d3bb7125a8f78942a5 P 2e7e05bf49114cf092451fa7b0876174 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce91bb31f1d64e2897dd0da8047981c7)
I20260709 12:18:08.121246 15422 raft_consensus.cc:515] T b0a2c042781548d3bb7125a8f78942a5 P 2e7e05bf49114cf092451fa7b0876174 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:08.121685 15290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7978baf90ead4534804cd2aeeef77fe0" candidate_uuid: "2e7e05bf49114cf092451fa7b0876174" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "999de4d383954ea5b7c75c01802c6497"
I20260709 12:18:08.122334 15290 raft_consensus.cc:3060] T 7978baf90ead4534804cd2aeeef77fe0 P 999de4d383954ea5b7c75c01802c6497 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:08.123524 15422 leader_election.cc:290] T b0a2c042781548d3bb7125a8f78942a5 P 2e7e05bf49114cf092451fa7b0876174 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633), 999de4d383954ea5b7c75c01802c6497 (127.3.212.131:33219)
W20260709 12:18:08.126159 15182 leader_election.cc:336] T 7978baf90ead4534804cd2aeeef77fe0 P 2e7e05bf49114cf092451fa7b0876174 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Network error: Client connection negotiation failed: client connection to 127.3.212.129:33633: connect: Connection refused (error 111)
I20260709 12:18:08.128505 15289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0a2c042781548d3bb7125a8f78942a5" candidate_uuid: "2e7e05bf49114cf092451fa7b0876174" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "999de4d383954ea5b7c75c01802c6497" is_pre_election: true
I20260709 12:18:08.129288 15289 raft_consensus.cc:2468] T b0a2c042781548d3bb7125a8f78942a5 P 999de4d383954ea5b7c75c01802c6497 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e7e05bf49114cf092451fa7b0876174 in term 1.
I20260709 12:18:08.130543 15181 leader_election.cc:304] T b0a2c042781548d3bb7125a8f78942a5 P 2e7e05bf49114cf092451fa7b0876174 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e7e05bf49114cf092451fa7b0876174, 999de4d383954ea5b7c75c01802c6497; no voters: 
I20260709 12:18:08.131731 15422 raft_consensus.cc:2804] T b0a2c042781548d3bb7125a8f78942a5 P 2e7e05bf49114cf092451fa7b0876174 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:08.132553 15422 raft_consensus.cc:493] T b0a2c042781548d3bb7125a8f78942a5 P 2e7e05bf49114cf092451fa7b0876174 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ce91bb31f1d64e2897dd0da8047981c7)
I20260709 12:18:08.126755 15356 leader_election.cc:290] T 7978baf90ead4534804cd2aeeef77fe0 P 2e7e05bf49114cf092451fa7b0876174 [CANDIDATE]: Term 2 election: Requested vote from peers ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633), 999de4d383954ea5b7c75c01802c6497 (127.3.212.131:33219)
I20260709 12:18:08.133118 15422 raft_consensus.cc:3060] T b0a2c042781548d3bb7125a8f78942a5 P 2e7e05bf49114cf092451fa7b0876174 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:18:08.132921 15182 leader_election.cc:336] T b0a2c042781548d3bb7125a8f78942a5 P 2e7e05bf49114cf092451fa7b0876174 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Network error: Client connection negotiation failed: client connection to 127.3.212.129:33633: connect: Connection refused (error 111)
I20260709 12:18:08.138836 15290 raft_consensus.cc:2468] T 7978baf90ead4534804cd2aeeef77fe0 P 999de4d383954ea5b7c75c01802c6497 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e7e05bf49114cf092451fa7b0876174 in term 2.
I20260709 12:18:08.140400 15181 leader_election.cc:304] T 7978baf90ead4534804cd2aeeef77fe0 P 2e7e05bf49114cf092451fa7b0876174 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e7e05bf49114cf092451fa7b0876174, 999de4d383954ea5b7c75c01802c6497; no voters: ce91bb31f1d64e2897dd0da8047981c7
I20260709 12:18:08.141319 15356 raft_consensus.cc:2804] T 7978baf90ead4534804cd2aeeef77fe0 P 2e7e05bf49114cf092451fa7b0876174 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:08.142501 15356 raft_consensus.cc:697] T 7978baf90ead4534804cd2aeeef77fe0 P 2e7e05bf49114cf092451fa7b0876174 [term 2 LEADER]: Becoming Leader. State: Replica: 2e7e05bf49114cf092451fa7b0876174, State: Running, Role: LEADER
I20260709 12:18:08.142408 15422 raft_consensus.cc:515] T b0a2c042781548d3bb7125a8f78942a5 P 2e7e05bf49114cf092451fa7b0876174 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:08.144511 15422 leader_election.cc:290] T b0a2c042781548d3bb7125a8f78942a5 P 2e7e05bf49114cf092451fa7b0876174 [CANDIDATE]: Term 2 election: Requested vote from peers ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633), 999de4d383954ea5b7c75c01802c6497 (127.3.212.131:33219)
I20260709 12:18:08.143688 15356 consensus_queue.cc:237] T 7978baf90ead4534804cd2aeeef77fe0 P 2e7e05bf49114cf092451fa7b0876174 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:08.145787 15290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0a2c042781548d3bb7125a8f78942a5" candidate_uuid: "2e7e05bf49114cf092451fa7b0876174" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "999de4d383954ea5b7c75c01802c6497"
I20260709 12:18:08.146730 15290 raft_consensus.cc:3060] T b0a2c042781548d3bb7125a8f78942a5 P 999de4d383954ea5b7c75c01802c6497 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:18:08.150192 15182 leader_election.cc:336] T b0a2c042781548d3bb7125a8f78942a5 P 2e7e05bf49114cf092451fa7b0876174 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Network error: Client connection negotiation failed: client connection to 127.3.212.129:33633: connect: Connection refused (error 111)
I20260709 12:18:08.158370 15039 catalog_manager.cc:5697] T 7978baf90ead4534804cd2aeeef77fe0 P 2e7e05bf49114cf092451fa7b0876174 reported cstate change: term changed from 1 to 2, leader changed from ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129) to 2e7e05bf49114cf092451fa7b0876174 (127.3.212.130). New cstate: current_term: 2 leader_uuid: "2e7e05bf49114cf092451fa7b0876174" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:08.159711 15290 raft_consensus.cc:2468] T b0a2c042781548d3bb7125a8f78942a5 P 999de4d383954ea5b7c75c01802c6497 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e7e05bf49114cf092451fa7b0876174 in term 2.
I20260709 12:18:08.161269 15181 leader_election.cc:304] T b0a2c042781548d3bb7125a8f78942a5 P 2e7e05bf49114cf092451fa7b0876174 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e7e05bf49114cf092451fa7b0876174, 999de4d383954ea5b7c75c01802c6497; no voters: ce91bb31f1d64e2897dd0da8047981c7
I20260709 12:18:08.162552 15356 raft_consensus.cc:2804] T b0a2c042781548d3bb7125a8f78942a5 P 2e7e05bf49114cf092451fa7b0876174 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:08.162976 15356 raft_consensus.cc:697] T b0a2c042781548d3bb7125a8f78942a5 P 2e7e05bf49114cf092451fa7b0876174 [term 2 LEADER]: Becoming Leader. State: Replica: 2e7e05bf49114cf092451fa7b0876174, State: Running, Role: LEADER
I20260709 12:18:08.163712 15356 consensus_queue.cc:237] T b0a2c042781548d3bb7125a8f78942a5 P 2e7e05bf49114cf092451fa7b0876174 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:08.183784 15039 catalog_manager.cc:5697] T b0a2c042781548d3bb7125a8f78942a5 P 2e7e05bf49114cf092451fa7b0876174 reported cstate change: term changed from 1 to 2, leader changed from ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129) to 2e7e05bf49114cf092451fa7b0876174 (127.3.212.130). New cstate: current_term: 2 leader_uuid: "2e7e05bf49114cf092451fa7b0876174" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:08.362339 15356 raft_consensus.cc:493] T 4fe037cbd5e841c3ba79c2a066b045a9 P 2e7e05bf49114cf092451fa7b0876174 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:08.362928 15356 raft_consensus.cc:515] T 4fe037cbd5e841c3ba79c2a066b045a9 P 2e7e05bf49114cf092451fa7b0876174 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:08.365243 15356 leader_election.cc:290] T 4fe037cbd5e841c3ba79c2a066b045a9 P 2e7e05bf49114cf092451fa7b0876174 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633), 999de4d383954ea5b7c75c01802c6497 (127.3.212.131:33219)
I20260709 12:18:08.366626 15290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe037cbd5e841c3ba79c2a066b045a9" candidate_uuid: "2e7e05bf49114cf092451fa7b0876174" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "999de4d383954ea5b7c75c01802c6497" is_pre_election: true
I20260709 12:18:08.367343 15290 raft_consensus.cc:2468] T 4fe037cbd5e841c3ba79c2a066b045a9 P 999de4d383954ea5b7c75c01802c6497 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e7e05bf49114cf092451fa7b0876174 in term 1.
I20260709 12:18:08.368453 15181 leader_election.cc:304] T 4fe037cbd5e841c3ba79c2a066b045a9 P 2e7e05bf49114cf092451fa7b0876174 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e7e05bf49114cf092451fa7b0876174, 999de4d383954ea5b7c75c01802c6497; no voters: 
W20260709 12:18:08.369097 15182 leader_election.cc:336] T 4fe037cbd5e841c3ba79c2a066b045a9 P 2e7e05bf49114cf092451fa7b0876174 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Network error: Client connection negotiation failed: client connection to 127.3.212.129:33633: connect: Connection refused (error 111)
I20260709 12:18:08.369248 15356 raft_consensus.cc:2804] T 4fe037cbd5e841c3ba79c2a066b045a9 P 2e7e05bf49114cf092451fa7b0876174 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:18:08.369706 15356 raft_consensus.cc:493] T 4fe037cbd5e841c3ba79c2a066b045a9 P 2e7e05bf49114cf092451fa7b0876174 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:08.369998 15356 raft_consensus.cc:3060] T 4fe037cbd5e841c3ba79c2a066b045a9 P 2e7e05bf49114cf092451fa7b0876174 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:08.375342 15356 raft_consensus.cc:515] T 4fe037cbd5e841c3ba79c2a066b045a9 P 2e7e05bf49114cf092451fa7b0876174 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:08.376998 15356 leader_election.cc:290] T 4fe037cbd5e841c3ba79c2a066b045a9 P 2e7e05bf49114cf092451fa7b0876174 [CANDIDATE]: Term 2 election: Requested vote from peers ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633), 999de4d383954ea5b7c75c01802c6497 (127.3.212.131:33219)
I20260709 12:18:08.378244 15290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fe037cbd5e841c3ba79c2a066b045a9" candidate_uuid: "2e7e05bf49114cf092451fa7b0876174" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "999de4d383954ea5b7c75c01802c6497"
I20260709 12:18:08.378865 15290 raft_consensus.cc:3060] T 4fe037cbd5e841c3ba79c2a066b045a9 P 999de4d383954ea5b7c75c01802c6497 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:18:08.381758 15182 leader_election.cc:336] T 4fe037cbd5e841c3ba79c2a066b045a9 P 2e7e05bf49114cf092451fa7b0876174 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Network error: Client connection negotiation failed: client connection to 127.3.212.129:33633: connect: Connection refused (error 111)
I20260709 12:18:08.385672 15290 raft_consensus.cc:2468] T 4fe037cbd5e841c3ba79c2a066b045a9 P 999de4d383954ea5b7c75c01802c6497 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e7e05bf49114cf092451fa7b0876174 in term 2.
I20260709 12:18:08.386740 15181 leader_election.cc:304] T 4fe037cbd5e841c3ba79c2a066b045a9 P 2e7e05bf49114cf092451fa7b0876174 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e7e05bf49114cf092451fa7b0876174, 999de4d383954ea5b7c75c01802c6497; no voters: ce91bb31f1d64e2897dd0da8047981c7
I20260709 12:18:08.387568 15356 raft_consensus.cc:2804] T 4fe037cbd5e841c3ba79c2a066b045a9 P 2e7e05bf49114cf092451fa7b0876174 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:08.387951 15356 raft_consensus.cc:697] T 4fe037cbd5e841c3ba79c2a066b045a9 P 2e7e05bf49114cf092451fa7b0876174 [term 2 LEADER]: Becoming Leader. State: Replica: 2e7e05bf49114cf092451fa7b0876174, State: Running, Role: LEADER
I20260709 12:18:08.388720 15356 consensus_queue.cc:237] T 4fe037cbd5e841c3ba79c2a066b045a9 P 2e7e05bf49114cf092451fa7b0876174 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:08.396682 15039 catalog_manager.cc:5697] T 4fe037cbd5e841c3ba79c2a066b045a9 P 2e7e05bf49114cf092451fa7b0876174 reported cstate change: term changed from 1 to 2, leader changed from ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129) to 2e7e05bf49114cf092451fa7b0876174 (127.3.212.130). New cstate: current_term: 2 leader_uuid: "2e7e05bf49114cf092451fa7b0876174" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } health_report { overall_health: UNKNOWN } } }
W20260709 12:18:08.577739 15182 consensus_peers.cc:597] T 7978baf90ead4534804cd2aeeef77fe0 P 2e7e05bf49114cf092451fa7b0876174 -> Peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Couldn't send request to peer ce91bb31f1d64e2897dd0da8047981c7. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:33633: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:08.580859 15089 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:18:08.589017 15290 raft_consensus.cc:1275] T b0a2c042781548d3bb7125a8f78942a5 P 999de4d383954ea5b7c75c01802c6497 [term 2 FOLLOWER]: Refusing update from remote peer 2e7e05bf49114cf092451fa7b0876174: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:08.590543 15356 consensus_queue.cc:1048] T b0a2c042781548d3bb7125a8f78942a5 P 2e7e05bf49114cf092451fa7b0876174 [LEADER]: Connected to new peer: Peer: permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:18:08.609714 15182 consensus_peers.cc:597] T b0a2c042781548d3bb7125a8f78942a5 P 2e7e05bf49114cf092451fa7b0876174 -> Peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Couldn't send request to peer ce91bb31f1d64e2897dd0da8047981c7. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:33633: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:08.613080 15290 raft_consensus.cc:1275] T 7978baf90ead4534804cd2aeeef77fe0 P 999de4d383954ea5b7c75c01802c6497 [term 2 FOLLOWER]: Refusing update from remote peer 2e7e05bf49114cf092451fa7b0876174: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:08.614849 15423 consensus_queue.cc:1048] T 7978baf90ead4534804cd2aeeef77fe0 P 2e7e05bf49114cf092451fa7b0876174 [LEADER]: Connected to new peer: Peer: permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:18:08.718343  3922 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 15164)
W20260709 12:18:08.749814 15256 consensus_peers.cc:597] T be5df69cad7f48c19a5e4aa80dcede4c P 999de4d383954ea5b7c75c01802c6497 -> Peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Couldn't send request to peer ce91bb31f1d64e2897dd0da8047981c7. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:33633: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:08.854478 15256 consensus_peers.cc:597] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497 -> Peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Couldn't send request to peer ce91bb31f1d64e2897dd0da8047981c7. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:33633: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:18:08.869302 15290 raft_consensus.cc:1275] T 4fe037cbd5e841c3ba79c2a066b045a9 P 999de4d383954ea5b7c75c01802c6497 [term 2 FOLLOWER]: Refusing update from remote peer 2e7e05bf49114cf092451fa7b0876174: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:18:08.870719 15423 consensus_queue.cc:1048] T 4fe037cbd5e841c3ba79c2a066b045a9 P 2e7e05bf49114cf092451fa7b0876174 [LEADER]: Connected to new peer: Peer: permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:18:08.884088 15182 consensus_peers.cc:597] T 4fe037cbd5e841c3ba79c2a066b045a9 P 2e7e05bf49114cf092451fa7b0876174 -> Peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Couldn't send request to peer ce91bb31f1d64e2897dd0da8047981c7. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:33633: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:09.256076 15182 consensus_peers.cc:597] T a58b64f9a4be4ed1973d74fac507d0e3 P 2e7e05bf49114cf092451fa7b0876174 -> Peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Couldn't send request to peer ce91bb31f1d64e2897dd0da8047981c7. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:33633: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:09.273942 15256 consensus_peers.cc:597] T 65fd6772c01e480181699cb1c8246779 P 999de4d383954ea5b7c75c01802c6497 -> Peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Couldn't send request to peer ce91bb31f1d64e2897dd0da8047981c7. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:33633: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:09.410863 15182 consensus_peers.cc:597] T c1991cd59d6441abac887582832f6a2a P 2e7e05bf49114cf092451fa7b0876174 -> Peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Couldn't send request to peer ce91bb31f1d64e2897dd0da8047981c7. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:33633: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:09.582034 15089 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:18:09.693331 15182 consensus_peers.cc:597] T 424d7c56ad0c4822a8d009c4d824a8d2 P 2e7e05bf49114cf092451fa7b0876174 -> Peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Couldn't send request to peer ce91bb31f1d64e2897dd0da8047981c7. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:33633: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:09.719025  3922 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 15164)
I20260709 12:18:09.748739 15421 raft_consensus.cc:493] T 3366909acc834c76ac9845f902ce93f6 P 999de4d383954ea5b7c75c01802c6497 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:09.749301 15421 raft_consensus.cc:515] T 3366909acc834c76ac9845f902ce93f6 P 999de4d383954ea5b7c75c01802c6497 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:09.751318 15421 leader_election.cc:290] T 3366909acc834c76ac9845f902ce93f6 P 999de4d383954ea5b7c75c01802c6497 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633), 2e7e05bf49114cf092451fa7b0876174 (127.3.212.130:42215)
I20260709 12:18:09.752703 15217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3366909acc834c76ac9845f902ce93f6" candidate_uuid: "999de4d383954ea5b7c75c01802c6497" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e7e05bf49114cf092451fa7b0876174" is_pre_election: true
I20260709 12:18:09.753551 15217 raft_consensus.cc:2468] T 3366909acc834c76ac9845f902ce93f6 P 2e7e05bf49114cf092451fa7b0876174 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 999de4d383954ea5b7c75c01802c6497 in term 2.
I20260709 12:18:09.754884 15255 leader_election.cc:304] T 3366909acc834c76ac9845f902ce93f6 P 999de4d383954ea5b7c75c01802c6497 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e7e05bf49114cf092451fa7b0876174, 999de4d383954ea5b7c75c01802c6497; no voters: 
W20260709 12:18:09.755569 15256 leader_election.cc:336] T 3366909acc834c76ac9845f902ce93f6 P 999de4d383954ea5b7c75c01802c6497 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Network error: Client connection negotiation failed: client connection to 127.3.212.129:33633: connect: Connection refused (error 111)
I20260709 12:18:09.755777 15421 raft_consensus.cc:2804] T 3366909acc834c76ac9845f902ce93f6 P 999de4d383954ea5b7c75c01802c6497 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:09.756270 15421 raft_consensus.cc:493] T 3366909acc834c76ac9845f902ce93f6 P 999de4d383954ea5b7c75c01802c6497 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:09.756610 15421 raft_consensus.cc:3060] T 3366909acc834c76ac9845f902ce93f6 P 999de4d383954ea5b7c75c01802c6497 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:09.764833 15421 raft_consensus.cc:515] T 3366909acc834c76ac9845f902ce93f6 P 999de4d383954ea5b7c75c01802c6497 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:09.767052 15421 leader_election.cc:290] T 3366909acc834c76ac9845f902ce93f6 P 999de4d383954ea5b7c75c01802c6497 [CANDIDATE]: Term 3 election: Requested vote from peers ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633), 2e7e05bf49114cf092451fa7b0876174 (127.3.212.130:42215)
I20260709 12:18:09.768422 15217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3366909acc834c76ac9845f902ce93f6" candidate_uuid: "999de4d383954ea5b7c75c01802c6497" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e7e05bf49114cf092451fa7b0876174"
I20260709 12:18:09.769129 15217 raft_consensus.cc:3060] T 3366909acc834c76ac9845f902ce93f6 P 2e7e05bf49114cf092451fa7b0876174 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:18:09.770864 15256 leader_election.cc:336] T 3366909acc834c76ac9845f902ce93f6 P 999de4d383954ea5b7c75c01802c6497 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Network error: Client connection negotiation failed: client connection to 127.3.212.129:33633: connect: Connection refused (error 111)
I20260709 12:18:09.777171 15217 raft_consensus.cc:2468] T 3366909acc834c76ac9845f902ce93f6 P 2e7e05bf49114cf092451fa7b0876174 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 999de4d383954ea5b7c75c01802c6497 in term 3.
I20260709 12:18:09.778801 15255 leader_election.cc:304] T 3366909acc834c76ac9845f902ce93f6 P 999de4d383954ea5b7c75c01802c6497 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e7e05bf49114cf092451fa7b0876174, 999de4d383954ea5b7c75c01802c6497; no voters: ce91bb31f1d64e2897dd0da8047981c7
I20260709 12:18:09.779613 15421 raft_consensus.cc:2804] T 3366909acc834c76ac9845f902ce93f6 P 999de4d383954ea5b7c75c01802c6497 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:09.780937 15421 raft_consensus.cc:697] T 3366909acc834c76ac9845f902ce93f6 P 999de4d383954ea5b7c75c01802c6497 [term 3 LEADER]: Becoming Leader. State: Replica: 999de4d383954ea5b7c75c01802c6497, State: Running, Role: LEADER
I20260709 12:18:09.781994 15421 consensus_queue.cc:237] T 3366909acc834c76ac9845f902ce93f6 P 999de4d383954ea5b7c75c01802c6497 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:09.790215 15039 catalog_manager.cc:5697] T 3366909acc834c76ac9845f902ce93f6 P 999de4d383954ea5b7c75c01802c6497 reported cstate change: term changed from 1 to 3, leader changed from ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129) to 999de4d383954ea5b7c75c01802c6497 (127.3.212.131). New cstate: current_term: 3 leader_uuid: "999de4d383954ea5b7c75c01802c6497" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } health_report { overall_health: HEALTHY } } }
W20260709 12:18:10.177014 15256 consensus_peers.cc:597] T 3366909acc834c76ac9845f902ce93f6 P 999de4d383954ea5b7c75c01802c6497 -> Peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Couldn't send request to peer ce91bb31f1d64e2897dd0da8047981c7. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:33633: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:10.398450 15217 raft_consensus.cc:1275] T 3366909acc834c76ac9845f902ce93f6 P 2e7e05bf49114cf092451fa7b0876174 [term 3 FOLLOWER]: Refusing update from remote peer 999de4d383954ea5b7c75c01802c6497: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:18:10.399869 15438 consensus_queue.cc:1048] T 3366909acc834c76ac9845f902ce93f6 P 999de4d383954ea5b7c75c01802c6497 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:18:10.583143 15089 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:18:10.719662  3922 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 15164)
I20260709 12:18:10.842826  3922 tablet_server.cc:196] TabletServer@127.3.212.129:0 shutdown complete.
W20260709 12:18:10.952939 15182 consensus_peers.cc:597] T b0a2c042781548d3bb7125a8f78942a5 P 2e7e05bf49114cf092451fa7b0876174 -> Peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Couldn't send request to peer ce91bb31f1d64e2897dd0da8047981c7. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:33633: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:11.082353 15256 consensus_peers.cc:597] T be5df69cad7f48c19a5e4aa80dcede4c P 999de4d383954ea5b7c75c01802c6497 -> Peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Couldn't send request to peer ce91bb31f1d64e2897dd0da8047981c7. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:33633: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:18:11.084476 15182 consensus_peers.cc:597] T 7978baf90ead4534804cd2aeeef77fe0 P 2e7e05bf49114cf092451fa7b0876174 -> Peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Couldn't send request to peer ce91bb31f1d64e2897dd0da8047981c7. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:33633: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:11.497730 15256 consensus_peers.cc:597] T 65fd6772c01e480181699cb1c8246779 P 999de4d383954ea5b7c75c01802c6497 -> Peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Couldn't send request to peer ce91bb31f1d64e2897dd0da8047981c7. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:33633: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:18:11.558745 15256 consensus_peers.cc:597] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497 -> Peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Couldn't send request to peer ce91bb31f1d64e2897dd0da8047981c7. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:33633: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:18:11.584326 15089 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:18:11.678815 15182 consensus_peers.cc:597] T 4fe037cbd5e841c3ba79c2a066b045a9 P 2e7e05bf49114cf092451fa7b0876174 -> Peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Couldn't send request to peer ce91bb31f1d64e2897dd0da8047981c7. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:33633: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:11.752102 15182 consensus_peers.cc:597] T c1991cd59d6441abac887582832f6a2a P 2e7e05bf49114cf092451fa7b0876174 -> Peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Couldn't send request to peer ce91bb31f1d64e2897dd0da8047981c7. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:33633: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:18:11.812760 15182 consensus_peers.cc:597] T a58b64f9a4be4ed1973d74fac507d0e3 P 2e7e05bf49114cf092451fa7b0876174 -> Peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Couldn't send request to peer ce91bb31f1d64e2897dd0da8047981c7. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:33633: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:18:12.356915 15182 consensus_peers.cc:597] T 424d7c56ad0c4822a8d009c4d824a8d2 P 2e7e05bf49114cf092451fa7b0876174 -> Peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Couldn't send request to peer ce91bb31f1d64e2897dd0da8047981c7. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:33633: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:18:12.585657 15089 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:18:12.705117 15256 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.212.129:33633: connect: Connection refused (error 111) [suppressed 104 similar messages]
W20260709 12:18:12.842594 15256 consensus_peers.cc:597] T 3366909acc834c76ac9845f902ce93f6 P 999de4d383954ea5b7c75c01802c6497 -> Peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Couldn't send request to peer ce91bb31f1d64e2897dd0da8047981c7. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:33633: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:13.290262 15182 consensus_peers.cc:597] T 7978baf90ead4534804cd2aeeef77fe0 P 2e7e05bf49114cf092451fa7b0876174 -> Peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Couldn't send request to peer ce91bb31f1d64e2897dd0da8047981c7. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:33633: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:18:13.586568 15089 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:18:13.610181 15182 consensus_peers.cc:597] T b0a2c042781548d3bb7125a8f78942a5 P 2e7e05bf49114cf092451fa7b0876174 -> Peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Couldn't send request to peer ce91bb31f1d64e2897dd0da8047981c7. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:33633: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:18:13.822072 15256 consensus_peers.cc:597] T be5df69cad7f48c19a5e4aa80dcede4c P 999de4d383954ea5b7c75c01802c6497 -> Peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Couldn't send request to peer ce91bb31f1d64e2897dd0da8047981c7. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:33633: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:18:13.917075 15256 consensus_peers.cc:597] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497 -> Peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Couldn't send request to peer ce91bb31f1d64e2897dd0da8047981c7. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:33633: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:18:14.112367 15256 consensus_peers.cc:597] T 65fd6772c01e480181699cb1c8246779 P 999de4d383954ea5b7c75c01802c6497 -> Peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Couldn't send request to peer ce91bb31f1d64e2897dd0da8047981c7. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:33633: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:18:14.163676 15182 consensus_peers.cc:597] T c1991cd59d6441abac887582832f6a2a P 2e7e05bf49114cf092451fa7b0876174 -> Peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Couldn't send request to peer ce91bb31f1d64e2897dd0da8047981c7. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:33633: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:18:14.202286 15182 consensus_peers.cc:597] T 4fe037cbd5e841c3ba79c2a066b045a9 P 2e7e05bf49114cf092451fa7b0876174 -> Peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Couldn't send request to peer ce91bb31f1d64e2897dd0da8047981c7. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:33633: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:18:14.523334 15182 consensus_peers.cc:597] T a58b64f9a4be4ed1973d74fac507d0e3 P 2e7e05bf49114cf092451fa7b0876174 -> Peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Couldn't send request to peer ce91bb31f1d64e2897dd0da8047981c7. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:33633: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:18:14.587541 15089 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:18:14.687970 15182 consensus_peers.cc:597] T 424d7c56ad0c4822a8d009c4d824a8d2 P 2e7e05bf49114cf092451fa7b0876174 -> Peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Couldn't send request to peer ce91bb31f1d64e2897dd0da8047981c7. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:33633: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:18:15.133602 15256 consensus_peers.cc:597] T 3366909acc834c76ac9845f902ce93f6 P 999de4d383954ea5b7c75c01802c6497 -> Peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Couldn't send request to peer ce91bb31f1d64e2897dd0da8047981c7. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:33633: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:18:15.588946 15089 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:18:15.866056  3922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:15.874859 15456 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:15.875223 15457 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:15.876459 15459 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:15.878021  3922 server_base.cc:1061] running on GCE node
I20260709 12:18:15.882607  3922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:15.882895  3922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:15.883098  3922 hybrid_clock.cc:648] HybridClock initialized: now 1783599495883078 us; error 0 us; skew 500 ppm
I20260709 12:18:15.883703  3922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:15.887543  3922 webserver.cc:533] Webserver started at http://127.3.212.129:42243/ using document root <none> and password file <none>
I20260709 12:18:15.888306  3922 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:15.888525  3922 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:18:15.893584  3922 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:18:15.898378 15464 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:15.899437  3922 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.005s	sys 0.000s
I20260709 12:18:15.899755  3922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599103767690-3922-0/minicluster-data/ts-0-root
uuid: "ce91bb31f1d64e2897dd0da8047981c7"
format_stamp: "Formatted at 2026-07-09 12:18:04 on dist-test-slave-442x"
I20260709 12:18:15.900252  3922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599103767690-3922-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599103767690-3922-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599103767690-3922-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:15.924682  3922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:15.926038  3922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:15.927582  3922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:18:15.931703 15471 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 12:18:15.978098 15182 consensus_peers.cc:597] T 7978baf90ead4534804cd2aeeef77fe0 P 2e7e05bf49114cf092451fa7b0876174 -> Peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Couldn't send request to peer ce91bb31f1d64e2897dd0da8047981c7. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:33633: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:18:15.993841  3922 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 12:18:15.994218  3922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.063s	user 0.003s	sys 0.000s
I20260709 12:18:15.994530  3922 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 12:18:16.000664 15471 tablet_bootstrap.cc:492] T c647fad7e69f46048ebcc6927eac1a58 P ce91bb31f1d64e2897dd0da8047981c7: Bootstrap starting.
W20260709 12:18:16.014816 15256 consensus_peers.cc:597] T be5df69cad7f48c19a5e4aa80dcede4c P 999de4d383954ea5b7c75c01802c6497 -> Peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Couldn't send request to peer ce91bb31f1d64e2897dd0da8047981c7. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:33633: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:18:16.016309 15471 tablet_bootstrap.cc:492] T c647fad7e69f46048ebcc6927eac1a58 P ce91bb31f1d64e2897dd0da8047981c7: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:16.017040 15471 tablet_bootstrap.cc:492] T c647fad7e69f46048ebcc6927eac1a58 P ce91bb31f1d64e2897dd0da8047981c7: Bootstrap complete.
I20260709 12:18:16.017683 15471 ts_tablet_manager.cc:1403] T c647fad7e69f46048ebcc6927eac1a58 P ce91bb31f1d64e2897dd0da8047981c7: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.003s
I20260709 12:18:16.020066 15471 raft_consensus.cc:359] T c647fad7e69f46048ebcc6927eac1a58 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:16.020912 15471 raft_consensus.cc:740] T c647fad7e69f46048ebcc6927eac1a58 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce91bb31f1d64e2897dd0da8047981c7, State: Initialized, Role: FOLLOWER
I20260709 12:18:16.021636 15471 consensus_queue.cc:260] T c647fad7e69f46048ebcc6927eac1a58 P ce91bb31f1d64e2897dd0da8047981c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:16.024595 15471 ts_tablet_manager.cc:1434] T c647fad7e69f46048ebcc6927eac1a58 P ce91bb31f1d64e2897dd0da8047981c7: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:18:16.025415 15471 tablet_bootstrap.cc:492] T be5df69cad7f48c19a5e4aa80dcede4c P ce91bb31f1d64e2897dd0da8047981c7: Bootstrap starting.
I20260709 12:18:16.038635 15471 tablet_bootstrap.cc:492] T be5df69cad7f48c19a5e4aa80dcede4c P ce91bb31f1d64e2897dd0da8047981c7: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:16.039420 15471 tablet_bootstrap.cc:492] T be5df69cad7f48c19a5e4aa80dcede4c P ce91bb31f1d64e2897dd0da8047981c7: Bootstrap complete.
I20260709 12:18:16.040030 15471 ts_tablet_manager.cc:1403] T be5df69cad7f48c19a5e4aa80dcede4c P ce91bb31f1d64e2897dd0da8047981c7: Time spent bootstrapping tablet: real 0.015s	user 0.007s	sys 0.004s
I20260709 12:18:16.042325 15471 raft_consensus.cc:359] T be5df69cad7f48c19a5e4aa80dcede4c P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:16.042892 15471 raft_consensus.cc:740] T be5df69cad7f48c19a5e4aa80dcede4c P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce91bb31f1d64e2897dd0da8047981c7, State: Initialized, Role: FOLLOWER
I20260709 12:18:16.043569 15471 consensus_queue.cc:260] T be5df69cad7f48c19a5e4aa80dcede4c P ce91bb31f1d64e2897dd0da8047981c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:16.045145 15471 ts_tablet_manager.cc:1434] T be5df69cad7f48c19a5e4aa80dcede4c P ce91bb31f1d64e2897dd0da8047981c7: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.002s
I20260709 12:18:16.045869 15471 tablet_bootstrap.cc:492] T 65fd6772c01e480181699cb1c8246779 P ce91bb31f1d64e2897dd0da8047981c7: Bootstrap starting.
I20260709 12:18:16.047839  3922 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 12:18:16.048183  3922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.054s	user 0.048s	sys 0.004s
I20260709 12:18:16.063110 15471 tablet_bootstrap.cc:492] T 65fd6772c01e480181699cb1c8246779 P ce91bb31f1d64e2897dd0da8047981c7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:16.064034 15471 tablet_bootstrap.cc:492] T 65fd6772c01e480181699cb1c8246779 P ce91bb31f1d64e2897dd0da8047981c7: Bootstrap complete.
I20260709 12:18:16.064925 15471 ts_tablet_manager.cc:1403] T 65fd6772c01e480181699cb1c8246779 P ce91bb31f1d64e2897dd0da8047981c7: Time spent bootstrapping tablet: real 0.019s	user 0.003s	sys 0.012s
I20260709 12:18:16.067433 15471 raft_consensus.cc:359] T 65fd6772c01e480181699cb1c8246779 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:16.068050 15471 raft_consensus.cc:740] T 65fd6772c01e480181699cb1c8246779 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce91bb31f1d64e2897dd0da8047981c7, State: Initialized, Role: FOLLOWER
I20260709 12:18:16.068778 15471 consensus_queue.cc:260] T 65fd6772c01e480181699cb1c8246779 P ce91bb31f1d64e2897dd0da8047981c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:16.070783 15471 ts_tablet_manager.cc:1434] T 65fd6772c01e480181699cb1c8246779 P ce91bb31f1d64e2897dd0da8047981c7: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.003s
I20260709 12:18:16.071587 15471 tablet_bootstrap.cc:492] T 424d7c56ad0c4822a8d009c4d824a8d2 P ce91bb31f1d64e2897dd0da8047981c7: Bootstrap starting.
I20260709 12:18:16.085563 15471 tablet_bootstrap.cc:492] T 424d7c56ad0c4822a8d009c4d824a8d2 P ce91bb31f1d64e2897dd0da8047981c7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:16.086355 15471 tablet_bootstrap.cc:492] T 424d7c56ad0c4822a8d009c4d824a8d2 P ce91bb31f1d64e2897dd0da8047981c7: Bootstrap complete.
I20260709 12:18:16.087054 15471 ts_tablet_manager.cc:1403] T 424d7c56ad0c4822a8d009c4d824a8d2 P ce91bb31f1d64e2897dd0da8047981c7: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.003s
I20260709 12:18:16.089648 15471 raft_consensus.cc:359] T 424d7c56ad0c4822a8d009c4d824a8d2 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:16.090322 15471 raft_consensus.cc:740] T 424d7c56ad0c4822a8d009c4d824a8d2 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce91bb31f1d64e2897dd0da8047981c7, State: Initialized, Role: FOLLOWER
I20260709 12:18:16.091001 15471 consensus_queue.cc:260] T 424d7c56ad0c4822a8d009c4d824a8d2 P ce91bb31f1d64e2897dd0da8047981c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:16.093052 15471 ts_tablet_manager.cc:1434] T 424d7c56ad0c4822a8d009c4d824a8d2 P ce91bb31f1d64e2897dd0da8047981c7: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:18:16.093796 15471 tablet_bootstrap.cc:492] T 3366909acc834c76ac9845f902ce93f6 P ce91bb31f1d64e2897dd0da8047981c7: Bootstrap starting.
I20260709 12:18:16.108449 15471 tablet_bootstrap.cc:492] T 3366909acc834c76ac9845f902ce93f6 P ce91bb31f1d64e2897dd0da8047981c7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:16.109334 15471 tablet_bootstrap.cc:492] T 3366909acc834c76ac9845f902ce93f6 P ce91bb31f1d64e2897dd0da8047981c7: Bootstrap complete.
I20260709 12:18:16.110107 15471 ts_tablet_manager.cc:1403] T 3366909acc834c76ac9845f902ce93f6 P ce91bb31f1d64e2897dd0da8047981c7: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.001s
I20260709 12:18:16.112294 15471 raft_consensus.cc:359] T 3366909acc834c76ac9845f902ce93f6 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:16.112860 15471 raft_consensus.cc:740] T 3366909acc834c76ac9845f902ce93f6 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce91bb31f1d64e2897dd0da8047981c7, State: Initialized, Role: FOLLOWER
I20260709 12:18:16.113586 15471 consensus_queue.cc:260] T 3366909acc834c76ac9845f902ce93f6 P ce91bb31f1d64e2897dd0da8047981c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:16.114620  3922 rpc_server.cc:307] RPC server started. Bound to: 127.3.212.129:33633
I20260709 12:18:16.114750 15533 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.212.129:33633 every 8 connection(s)
I20260709 12:18:16.115244 15471 ts_tablet_manager.cc:1434] T 3366909acc834c76ac9845f902ce93f6 P ce91bb31f1d64e2897dd0da8047981c7: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:18:16.116041 15471 tablet_bootstrap.cc:492] T 4fe037cbd5e841c3ba79c2a066b045a9 P ce91bb31f1d64e2897dd0da8047981c7: Bootstrap starting.
I20260709 12:18:16.120641  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:16.145702 15471 tablet_bootstrap.cc:492] T 4fe037cbd5e841c3ba79c2a066b045a9 P ce91bb31f1d64e2897dd0da8047981c7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:18:16.146919 15471 tablet_bootstrap.cc:492] T 4fe037cbd5e841c3ba79c2a066b045a9 P ce91bb31f1d64e2897dd0da8047981c7: Bootstrap complete.
I20260709 12:18:16.147641 15471 ts_tablet_manager.cc:1403] T 4fe037cbd5e841c3ba79c2a066b045a9 P ce91bb31f1d64e2897dd0da8047981c7: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.005s
I20260709 12:18:16.150511 15471 raft_consensus.cc:359] T 4fe037cbd5e841c3ba79c2a066b045a9 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:16.151710 15471 raft_consensus.cc:740] T 4fe037cbd5e841c3ba79c2a066b045a9 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce91bb31f1d64e2897dd0da8047981c7, State: Initialized, Role: FOLLOWER
I20260709 12:18:16.152530 15471 consensus_queue.cc:260] T 4fe037cbd5e841c3ba79c2a066b045a9 P ce91bb31f1d64e2897dd0da8047981c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:16.153787 15534 heartbeater.cc:344] Connected to a master server at 127.3.212.190:35487
I20260709 12:18:16.154327 15534 heartbeater.cc:461] Registering TS with master...
I20260709 12:18:16.154511 15471 ts_tablet_manager.cc:1434] T 4fe037cbd5e841c3ba79c2a066b045a9 P ce91bb31f1d64e2897dd0da8047981c7: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:18:16.155344 15534 heartbeater.cc:507] Master 127.3.212.190:35487 requested a full tablet report, sending...
I20260709 12:18:16.155480 15471 tablet_bootstrap.cc:492] T a58b64f9a4be4ed1973d74fac507d0e3 P ce91bb31f1d64e2897dd0da8047981c7: Bootstrap starting.
I20260709 12:18:16.158375 15217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "424d7c56ad0c4822a8d009c4d824a8d2"
dest_uuid: "2e7e05bf49114cf092451fa7b0876174"
mode: GRACEFUL
new_leader_uuid: "999de4d383954ea5b7c75c01802c6497"
 from {username='slave'} at 127.0.0.1:38388
I20260709 12:18:16.159301 15217 raft_consensus.cc:606] T 424d7c56ad0c4822a8d009c4d824a8d2 P 2e7e05bf49114cf092451fa7b0876174 [term 1 LEADER]: Received request to transfer leadership to TS 999de4d383954ea5b7c75c01802c6497
I20260709 12:18:16.163870 15039 ts_manager.cc:194] Re-registered known tserver with Master: ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633)
I20260709 12:18:16.168569 15217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1991cd59d6441abac887582832f6a2a"
dest_uuid: "2e7e05bf49114cf092451fa7b0876174"
mode: GRACEFUL
new_leader_uuid: "999de4d383954ea5b7c75c01802c6497"
 from {username='slave'} at 127.0.0.1:38388
I20260709 12:18:16.169365 15217 raft_consensus.cc:606] T c1991cd59d6441abac887582832f6a2a P 2e7e05bf49114cf092451fa7b0876174 [term 1 LEADER]: Received request to transfer leadership to TS 999de4d383954ea5b7c75c01802c6497
I20260709 12:18:16.171139  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:18:16.171941  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:16.172900  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:16.174528 15471 tablet_bootstrap.cc:492] T a58b64f9a4be4ed1973d74fac507d0e3 P ce91bb31f1d64e2897dd0da8047981c7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:16.175556 15471 tablet_bootstrap.cc:492] T a58b64f9a4be4ed1973d74fac507d0e3 P ce91bb31f1d64e2897dd0da8047981c7: Bootstrap complete.
I20260709 12:18:16.176189 15471 ts_tablet_manager.cc:1403] T a58b64f9a4be4ed1973d74fac507d0e3 P ce91bb31f1d64e2897dd0da8047981c7: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.000s
W20260709 12:18:16.178036 15182 consensus_peers.cc:597] T b0a2c042781548d3bb7125a8f78942a5 P 2e7e05bf49114cf092451fa7b0876174 -> Peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Couldn't send request to peer ce91bb31f1d64e2897dd0da8047981c7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:18:16.182451 15039 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41210
I20260709 12:18:16.186237 15534 heartbeater.cc:499] Master 127.3.212.190:35487 was elected leader, sending a full tablet report...
I20260709 12:18:16.186075 15471 raft_consensus.cc:359] T a58b64f9a4be4ed1973d74fac507d0e3 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:16.186846 15471 raft_consensus.cc:740] T a58b64f9a4be4ed1973d74fac507d0e3 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce91bb31f1d64e2897dd0da8047981c7, State: Initialized, Role: FOLLOWER
I20260709 12:18:16.187530 15471 consensus_queue.cc:260] T a58b64f9a4be4ed1973d74fac507d0e3 P ce91bb31f1d64e2897dd0da8047981c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:16.189332 15471 ts_tablet_manager.cc:1434] T a58b64f9a4be4ed1973d74fac507d0e3 P ce91bb31f1d64e2897dd0da8047981c7: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:18:16.190204 15471 tablet_bootstrap.cc:492] T c1991cd59d6441abac887582832f6a2a P ce91bb31f1d64e2897dd0da8047981c7: Bootstrap starting.
I20260709 12:18:16.205727 15471 tablet_bootstrap.cc:492] T c1991cd59d6441abac887582832f6a2a P ce91bb31f1d64e2897dd0da8047981c7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:16.206782 15471 tablet_bootstrap.cc:492] T c1991cd59d6441abac887582832f6a2a P ce91bb31f1d64e2897dd0da8047981c7: Bootstrap complete.
I20260709 12:18:16.207499 15471 ts_tablet_manager.cc:1403] T c1991cd59d6441abac887582832f6a2a P ce91bb31f1d64e2897dd0da8047981c7: Time spent bootstrapping tablet: real 0.017s	user 0.016s	sys 0.000s
I20260709 12:18:16.209909 15471 raft_consensus.cc:359] T c1991cd59d6441abac887582832f6a2a P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:16.210390 15471 raft_consensus.cc:740] T c1991cd59d6441abac887582832f6a2a P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce91bb31f1d64e2897dd0da8047981c7, State: Initialized, Role: FOLLOWER
I20260709 12:18:16.210966 15471 consensus_queue.cc:260] T c1991cd59d6441abac887582832f6a2a P ce91bb31f1d64e2897dd0da8047981c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:16.212561 15471 ts_tablet_manager.cc:1434] T c1991cd59d6441abac887582832f6a2a P ce91bb31f1d64e2897dd0da8047981c7: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 12:18:16.213198 15471 tablet_bootstrap.cc:492] T 7978baf90ead4534804cd2aeeef77fe0 P ce91bb31f1d64e2897dd0da8047981c7: Bootstrap starting.
I20260709 12:18:16.226589 15471 tablet_bootstrap.cc:492] T 7978baf90ead4534804cd2aeeef77fe0 P ce91bb31f1d64e2897dd0da8047981c7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:16.227329 15471 tablet_bootstrap.cc:492] T 7978baf90ead4534804cd2aeeef77fe0 P ce91bb31f1d64e2897dd0da8047981c7: Bootstrap complete.
I20260709 12:18:16.227906 15471 ts_tablet_manager.cc:1403] T 7978baf90ead4534804cd2aeeef77fe0 P ce91bb31f1d64e2897dd0da8047981c7: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.003s
I20260709 12:18:16.229918 15471 raft_consensus.cc:359] T 7978baf90ead4534804cd2aeeef77fe0 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:16.230402 15471 raft_consensus.cc:740] T 7978baf90ead4534804cd2aeeef77fe0 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce91bb31f1d64e2897dd0da8047981c7, State: Initialized, Role: FOLLOWER
I20260709 12:18:16.231074 15471 consensus_queue.cc:260] T 7978baf90ead4534804cd2aeeef77fe0 P ce91bb31f1d64e2897dd0da8047981c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:16.232539 15471 ts_tablet_manager.cc:1434] T 7978baf90ead4534804cd2aeeef77fe0 P ce91bb31f1d64e2897dd0da8047981c7: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:18:16.233429 15471 tablet_bootstrap.cc:492] T b0a2c042781548d3bb7125a8f78942a5 P ce91bb31f1d64e2897dd0da8047981c7: Bootstrap starting.
I20260709 12:18:16.247974 15471 tablet_bootstrap.cc:492] T b0a2c042781548d3bb7125a8f78942a5 P ce91bb31f1d64e2897dd0da8047981c7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:16.248697 15471 tablet_bootstrap.cc:492] T b0a2c042781548d3bb7125a8f78942a5 P ce91bb31f1d64e2897dd0da8047981c7: Bootstrap complete.
I20260709 12:18:16.249190 15471 ts_tablet_manager.cc:1403] T b0a2c042781548d3bb7125a8f78942a5 P ce91bb31f1d64e2897dd0da8047981c7: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 12:18:16.251124 15471 raft_consensus.cc:359] T b0a2c042781548d3bb7125a8f78942a5 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:16.251587 15471 raft_consensus.cc:740] T b0a2c042781548d3bb7125a8f78942a5 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce91bb31f1d64e2897dd0da8047981c7, State: Initialized, Role: FOLLOWER
I20260709 12:18:16.252280 15471 consensus_queue.cc:260] T b0a2c042781548d3bb7125a8f78942a5 P ce91bb31f1d64e2897dd0da8047981c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:16.254273 15471 ts_tablet_manager.cc:1434] T b0a2c042781548d3bb7125a8f78942a5 P ce91bb31f1d64e2897dd0da8047981c7: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:18:16.322666 15455 raft_consensus.cc:993] T c1991cd59d6441abac887582832f6a2a P 2e7e05bf49114cf092451fa7b0876174: : Instructing follower 999de4d383954ea5b7c75c01802c6497 to start an election
I20260709 12:18:16.323173 15356 raft_consensus.cc:1081] T c1991cd59d6441abac887582832f6a2a P 2e7e05bf49114cf092451fa7b0876174 [term 1 LEADER]: Signalling peer 999de4d383954ea5b7c75c01802c6497 to start an election
I20260709 12:18:16.324966 15289 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c1991cd59d6441abac887582832f6a2a"
dest_uuid: "999de4d383954ea5b7c75c01802c6497"
 from {username='slave'} at 127.0.0.1:34530
I20260709 12:18:16.325515 15289 raft_consensus.cc:493] T c1991cd59d6441abac887582832f6a2a P 999de4d383954ea5b7c75c01802c6497 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:16.325826 15289 raft_consensus.cc:3060] T c1991cd59d6441abac887582832f6a2a P 999de4d383954ea5b7c75c01802c6497 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:16.332576 15289 raft_consensus.cc:515] T c1991cd59d6441abac887582832f6a2a P 999de4d383954ea5b7c75c01802c6497 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:16.334479 15289 leader_election.cc:290] T c1991cd59d6441abac887582832f6a2a P 999de4d383954ea5b7c75c01802c6497 [CANDIDATE]: Term 2 election: Requested vote from peers ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633), 2e7e05bf49114cf092451fa7b0876174 (127.3.212.130:42215)
I20260709 12:18:16.335417 15508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1991cd59d6441abac887582832f6a2a" candidate_uuid: "999de4d383954ea5b7c75c01802c6497" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce91bb31f1d64e2897dd0da8047981c7"
I20260709 12:18:16.335799 15217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1991cd59d6441abac887582832f6a2a" candidate_uuid: "999de4d383954ea5b7c75c01802c6497" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e7e05bf49114cf092451fa7b0876174"
I20260709 12:18:16.336277 15508 raft_consensus.cc:3060] T c1991cd59d6441abac887582832f6a2a P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:16.336522 15217 raft_consensus.cc:3055] T c1991cd59d6441abac887582832f6a2a P 2e7e05bf49114cf092451fa7b0876174 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:16.336861 15217 raft_consensus.cc:740] T c1991cd59d6441abac887582832f6a2a P 2e7e05bf49114cf092451fa7b0876174 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e7e05bf49114cf092451fa7b0876174, State: Running, Role: LEADER
I20260709 12:18:16.337889 15217 consensus_queue.cc:260] T c1991cd59d6441abac887582832f6a2a P 2e7e05bf49114cf092451fa7b0876174 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:16.339381 15217 raft_consensus.cc:3060] T c1991cd59d6441abac887582832f6a2a P 2e7e05bf49114cf092451fa7b0876174 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:16.345052 15508 raft_consensus.cc:2468] T c1991cd59d6441abac887582832f6a2a P ce91bb31f1d64e2897dd0da8047981c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 999de4d383954ea5b7c75c01802c6497 in term 2.
I20260709 12:18:16.346520 15256 leader_election.cc:304] T c1991cd59d6441abac887582832f6a2a P 999de4d383954ea5b7c75c01802c6497 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 999de4d383954ea5b7c75c01802c6497, ce91bb31f1d64e2897dd0da8047981c7; no voters: 
I20260709 12:18:16.347334 15421 raft_consensus.cc:2804] T c1991cd59d6441abac887582832f6a2a P 999de4d383954ea5b7c75c01802c6497 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:16.347678 15217 raft_consensus.cc:2468] T c1991cd59d6441abac887582832f6a2a P 2e7e05bf49114cf092451fa7b0876174 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 999de4d383954ea5b7c75c01802c6497 in term 2.
I20260709 12:18:16.348680 15421 raft_consensus.cc:697] T c1991cd59d6441abac887582832f6a2a P 999de4d383954ea5b7c75c01802c6497 [term 2 LEADER]: Becoming Leader. State: Replica: 999de4d383954ea5b7c75c01802c6497, State: Running, Role: LEADER
I20260709 12:18:16.350098 15421 consensus_queue.cc:237] T c1991cd59d6441abac887582832f6a2a P 999de4d383954ea5b7c75c01802c6497 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:16.358639 15039 catalog_manager.cc:5697] T c1991cd59d6441abac887582832f6a2a P 999de4d383954ea5b7c75c01802c6497 reported cstate change: term changed from 1 to 2, leader changed from 2e7e05bf49114cf092451fa7b0876174 (127.3.212.130) to 999de4d383954ea5b7c75c01802c6497 (127.3.212.131). New cstate: current_term: 2 leader_uuid: "999de4d383954ea5b7c75c01802c6497" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:16.377002 15356 raft_consensus.cc:993] T 424d7c56ad0c4822a8d009c4d824a8d2 P 2e7e05bf49114cf092451fa7b0876174: : Instructing follower 999de4d383954ea5b7c75c01802c6497 to start an election
I20260709 12:18:16.377558 15455 raft_consensus.cc:1081] T 424d7c56ad0c4822a8d009c4d824a8d2 P 2e7e05bf49114cf092451fa7b0876174 [term 1 LEADER]: Signalling peer 999de4d383954ea5b7c75c01802c6497 to start an election
I20260709 12:18:16.379590 15289 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "424d7c56ad0c4822a8d009c4d824a8d2"
dest_uuid: "999de4d383954ea5b7c75c01802c6497"
 from {username='slave'} at 127.0.0.1:34530
I20260709 12:18:16.380204 15289 raft_consensus.cc:493] T 424d7c56ad0c4822a8d009c4d824a8d2 P 999de4d383954ea5b7c75c01802c6497 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:16.380569 15289 raft_consensus.cc:3060] T 424d7c56ad0c4822a8d009c4d824a8d2 P 999de4d383954ea5b7c75c01802c6497 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:16.386435 15289 raft_consensus.cc:515] T 424d7c56ad0c4822a8d009c4d824a8d2 P 999de4d383954ea5b7c75c01802c6497 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:16.388090 15289 leader_election.cc:290] T 424d7c56ad0c4822a8d009c4d824a8d2 P 999de4d383954ea5b7c75c01802c6497 [CANDIDATE]: Term 2 election: Requested vote from peers ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633), 2e7e05bf49114cf092451fa7b0876174 (127.3.212.130:42215)
I20260709 12:18:16.388901 15508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424d7c56ad0c4822a8d009c4d824a8d2" candidate_uuid: "999de4d383954ea5b7c75c01802c6497" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce91bb31f1d64e2897dd0da8047981c7"
I20260709 12:18:16.389192 15217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424d7c56ad0c4822a8d009c4d824a8d2" candidate_uuid: "999de4d383954ea5b7c75c01802c6497" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e7e05bf49114cf092451fa7b0876174"
I20260709 12:18:16.389482 15508 raft_consensus.cc:3060] T 424d7c56ad0c4822a8d009c4d824a8d2 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:16.389832 15217 raft_consensus.cc:3055] T 424d7c56ad0c4822a8d009c4d824a8d2 P 2e7e05bf49114cf092451fa7b0876174 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:16.390157 15217 raft_consensus.cc:740] T 424d7c56ad0c4822a8d009c4d824a8d2 P 2e7e05bf49114cf092451fa7b0876174 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e7e05bf49114cf092451fa7b0876174, State: Running, Role: LEADER
I20260709 12:18:16.390787 15217 consensus_queue.cc:260] T 424d7c56ad0c4822a8d009c4d824a8d2 P 2e7e05bf49114cf092451fa7b0876174 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:16.394034 15217 raft_consensus.cc:3060] T 424d7c56ad0c4822a8d009c4d824a8d2 P 2e7e05bf49114cf092451fa7b0876174 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:16.394987 15508 raft_consensus.cc:2468] T 424d7c56ad0c4822a8d009c4d824a8d2 P ce91bb31f1d64e2897dd0da8047981c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 999de4d383954ea5b7c75c01802c6497 in term 2.
I20260709 12:18:16.396139 15256 leader_election.cc:304] T 424d7c56ad0c4822a8d009c4d824a8d2 P 999de4d383954ea5b7c75c01802c6497 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 999de4d383954ea5b7c75c01802c6497, ce91bb31f1d64e2897dd0da8047981c7; no voters: 
I20260709 12:18:16.396829 15421 raft_consensus.cc:2804] T 424d7c56ad0c4822a8d009c4d824a8d2 P 999de4d383954ea5b7c75c01802c6497 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:16.397315 15421 raft_consensus.cc:697] T 424d7c56ad0c4822a8d009c4d824a8d2 P 999de4d383954ea5b7c75c01802c6497 [term 2 LEADER]: Becoming Leader. State: Replica: 999de4d383954ea5b7c75c01802c6497, State: Running, Role: LEADER
I20260709 12:18:16.398594 15421 consensus_queue.cc:237] T 424d7c56ad0c4822a8d009c4d824a8d2 P 999de4d383954ea5b7c75c01802c6497 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:16.401340 15217 raft_consensus.cc:2468] T 424d7c56ad0c4822a8d009c4d824a8d2 P 2e7e05bf49114cf092451fa7b0876174 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 999de4d383954ea5b7c75c01802c6497 in term 2.
I20260709 12:18:16.407850 15039 catalog_manager.cc:5697] T 424d7c56ad0c4822a8d009c4d824a8d2 P 999de4d383954ea5b7c75c01802c6497 reported cstate change: term changed from 1 to 2, leader changed from 2e7e05bf49114cf092451fa7b0876174 (127.3.212.130) to 999de4d383954ea5b7c75c01802c6497 (127.3.212.131). New cstate: current_term: 2 leader_uuid: "999de4d383954ea5b7c75c01802c6497" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:16.424044 15508 raft_consensus.cc:3060] T 4fe037cbd5e841c3ba79c2a066b045a9 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:16.429553 15508 pending_rounds.cc:85] T 4fe037cbd5e841c3ba79c2a066b045a9 P ce91bb31f1d64e2897dd0da8047981c7: Aborting all ops after (but not including) 0
I20260709 12:18:16.429768 15508 pending_rounds.cc:107] T 4fe037cbd5e841c3ba79c2a066b045a9 P ce91bb31f1d64e2897dd0da8047981c7: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:18:16.430009 15508 raft_consensus.cc:2889] T 4fe037cbd5e841c3ba79c2a066b045a9 P ce91bb31f1d64e2897dd0da8047981c7 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:16.453765 15508 raft_consensus.cc:3060] T 7978baf90ead4534804cd2aeeef77fe0 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:18:16.590078 15089 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:18:16.602116 15508 raft_consensus.cc:3060] T b0a2c042781548d3bb7125a8f78942a5 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:16.682848 15508 raft_consensus.cc:3060] T 3366909acc834c76ac9845f902ce93f6 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:18:16.867677 15217 raft_consensus.cc:1275] T c1991cd59d6441abac887582832f6a2a P 2e7e05bf49114cf092451fa7b0876174 [term 2 FOLLOWER]: Refusing update from remote peer 999de4d383954ea5b7c75c01802c6497: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:16.868992 15560 consensus_queue.cc:1048] T c1991cd59d6441abac887582832f6a2a P 999de4d383954ea5b7c75c01802c6497 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:16.879635 15508 raft_consensus.cc:1275] T c1991cd59d6441abac887582832f6a2a P ce91bb31f1d64e2897dd0da8047981c7 [term 2 FOLLOWER]: Refusing update from remote peer 999de4d383954ea5b7c75c01802c6497: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:16.881762 15546 consensus_queue.cc:1048] T c1991cd59d6441abac887582832f6a2a P 999de4d383954ea5b7c75c01802c6497 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:16.890558 15217 raft_consensus.cc:1275] T 424d7c56ad0c4822a8d009c4d824a8d2 P 2e7e05bf49114cf092451fa7b0876174 [term 2 FOLLOWER]: Refusing update from remote peer 999de4d383954ea5b7c75c01802c6497: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:16.891969 15546 consensus_queue.cc:1048] T 424d7c56ad0c4822a8d009c4d824a8d2 P 999de4d383954ea5b7c75c01802c6497 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:16.903249 15508 raft_consensus.cc:1275] T 424d7c56ad0c4822a8d009c4d824a8d2 P ce91bb31f1d64e2897dd0da8047981c7 [term 2 FOLLOWER]: Refusing update from remote peer 999de4d383954ea5b7c75c01802c6497: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:16.905490 15421 consensus_queue.cc:1048] T 424d7c56ad0c4822a8d009c4d824a8d2 P 999de4d383954ea5b7c75c01802c6497 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:17.186379  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:17.204854 15289 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "65fd6772c01e480181699cb1c8246779"
dest_uuid: "999de4d383954ea5b7c75c01802c6497"
mode: GRACEFUL
new_leader_uuid: "2e7e05bf49114cf092451fa7b0876174"
 from {username='slave'} at 127.0.0.1:42386
I20260709 12:18:17.205356 15289 raft_consensus.cc:606] T 65fd6772c01e480181699cb1c8246779 P 999de4d383954ea5b7c75c01802c6497 [term 1 LEADER]: Received request to transfer leadership to TS 2e7e05bf49114cf092451fa7b0876174
I20260709 12:18:17.208011 15289 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c647fad7e69f46048ebcc6927eac1a58"
dest_uuid: "999de4d383954ea5b7c75c01802c6497"
mode: GRACEFUL
new_leader_uuid: "2e7e05bf49114cf092451fa7b0876174"
 from {username='slave'} at 127.0.0.1:42386
I20260709 12:18:17.208611 15289 raft_consensus.cc:606] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497 [term 1 LEADER]: Received request to transfer leadership to TS 2e7e05bf49114cf092451fa7b0876174
I20260709 12:18:17.209832  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:18:17.210469  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:17.211181  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:17.224229 15421 raft_consensus.cc:993] T 65fd6772c01e480181699cb1c8246779 P 999de4d383954ea5b7c75c01802c6497: : Instructing follower 2e7e05bf49114cf092451fa7b0876174 to start an election
I20260709 12:18:17.224673 15546 raft_consensus.cc:1081] T 65fd6772c01e480181699cb1c8246779 P 999de4d383954ea5b7c75c01802c6497 [term 1 LEADER]: Signalling peer 2e7e05bf49114cf092451fa7b0876174 to start an election
I20260709 12:18:17.226274 15217 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "65fd6772c01e480181699cb1c8246779"
dest_uuid: "2e7e05bf49114cf092451fa7b0876174"
 from {username='slave'} at 127.0.0.1:53124
I20260709 12:18:17.226708 15217 raft_consensus.cc:493] T 65fd6772c01e480181699cb1c8246779 P 2e7e05bf49114cf092451fa7b0876174 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:17.226934 15217 raft_consensus.cc:3060] T 65fd6772c01e480181699cb1c8246779 P 2e7e05bf49114cf092451fa7b0876174 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:17.231904 15217 raft_consensus.cc:515] T 65fd6772c01e480181699cb1c8246779 P 2e7e05bf49114cf092451fa7b0876174 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:17.233527 15217 leader_election.cc:290] T 65fd6772c01e480181699cb1c8246779 P 2e7e05bf49114cf092451fa7b0876174 [CANDIDATE]: Term 2 election: Requested vote from peers ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633), 999de4d383954ea5b7c75c01802c6497 (127.3.212.131:33219)
I20260709 12:18:17.234627 15289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fd6772c01e480181699cb1c8246779" candidate_uuid: "2e7e05bf49114cf092451fa7b0876174" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "999de4d383954ea5b7c75c01802c6497"
I20260709 12:18:17.234650 15508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65fd6772c01e480181699cb1c8246779" candidate_uuid: "2e7e05bf49114cf092451fa7b0876174" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce91bb31f1d64e2897dd0da8047981c7"
I20260709 12:18:17.235275 15289 raft_consensus.cc:3055] T 65fd6772c01e480181699cb1c8246779 P 999de4d383954ea5b7c75c01802c6497 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:17.235339 15508 raft_consensus.cc:3060] T 65fd6772c01e480181699cb1c8246779 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:17.235610 15289 raft_consensus.cc:740] T 65fd6772c01e480181699cb1c8246779 P 999de4d383954ea5b7c75c01802c6497 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 999de4d383954ea5b7c75c01802c6497, State: Running, Role: LEADER
I20260709 12:18:17.236478 15289 consensus_queue.cc:260] T 65fd6772c01e480181699cb1c8246779 P 999de4d383954ea5b7c75c01802c6497 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:17.237644 15289 raft_consensus.cc:3060] T 65fd6772c01e480181699cb1c8246779 P 999de4d383954ea5b7c75c01802c6497 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:17.241219 15508 raft_consensus.cc:2468] T 65fd6772c01e480181699cb1c8246779 P ce91bb31f1d64e2897dd0da8047981c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e7e05bf49114cf092451fa7b0876174 in term 2.
I20260709 12:18:17.242403 15182 leader_election.cc:304] T 65fd6772c01e480181699cb1c8246779 P 2e7e05bf49114cf092451fa7b0876174 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e7e05bf49114cf092451fa7b0876174, ce91bb31f1d64e2897dd0da8047981c7; no voters: 
I20260709 12:18:17.243341 15552 raft_consensus.cc:2804] T 65fd6772c01e480181699cb1c8246779 P 2e7e05bf49114cf092451fa7b0876174 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:17.243640 15289 raft_consensus.cc:2468] T 65fd6772c01e480181699cb1c8246779 P 999de4d383954ea5b7c75c01802c6497 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e7e05bf49114cf092451fa7b0876174 in term 2.
I20260709 12:18:17.243733 15552 raft_consensus.cc:697] T 65fd6772c01e480181699cb1c8246779 P 2e7e05bf49114cf092451fa7b0876174 [term 2 LEADER]: Becoming Leader. State: Replica: 2e7e05bf49114cf092451fa7b0876174, State: Running, Role: LEADER
I20260709 12:18:17.244865 15552 consensus_queue.cc:237] T 65fd6772c01e480181699cb1c8246779 P 2e7e05bf49114cf092451fa7b0876174 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:17.251730 15040 catalog_manager.cc:5697] T 65fd6772c01e480181699cb1c8246779 P 2e7e05bf49114cf092451fa7b0876174 reported cstate change: term changed from 1 to 2, leader changed from 999de4d383954ea5b7c75c01802c6497 (127.3.212.131) to 2e7e05bf49114cf092451fa7b0876174 (127.3.212.130). New cstate: current_term: 2 leader_uuid: "2e7e05bf49114cf092451fa7b0876174" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:17.466471 15421 raft_consensus.cc:993] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497: : Instructing follower 2e7e05bf49114cf092451fa7b0876174 to start an election
I20260709 12:18:17.467023 15546 raft_consensus.cc:1081] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497 [term 1 LEADER]: Signalling peer 2e7e05bf49114cf092451fa7b0876174 to start an election
I20260709 12:18:17.468812 15217 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c647fad7e69f46048ebcc6927eac1a58"
dest_uuid: "2e7e05bf49114cf092451fa7b0876174"
 from {username='slave'} at 127.0.0.1:53124
I20260709 12:18:17.469287 15217 raft_consensus.cc:493] T c647fad7e69f46048ebcc6927eac1a58 P 2e7e05bf49114cf092451fa7b0876174 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:17.469605 15217 raft_consensus.cc:3060] T c647fad7e69f46048ebcc6927eac1a58 P 2e7e05bf49114cf092451fa7b0876174 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:17.474754 15217 raft_consensus.cc:515] T c647fad7e69f46048ebcc6927eac1a58 P 2e7e05bf49114cf092451fa7b0876174 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:17.476300 15217 leader_election.cc:290] T c647fad7e69f46048ebcc6927eac1a58 P 2e7e05bf49114cf092451fa7b0876174 [CANDIDATE]: Term 2 election: Requested vote from peers ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633), 999de4d383954ea5b7c75c01802c6497 (127.3.212.131:33219)
I20260709 12:18:17.477298 15508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c647fad7e69f46048ebcc6927eac1a58" candidate_uuid: "2e7e05bf49114cf092451fa7b0876174" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce91bb31f1d64e2897dd0da8047981c7"
I20260709 12:18:17.477459 15289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c647fad7e69f46048ebcc6927eac1a58" candidate_uuid: "2e7e05bf49114cf092451fa7b0876174" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "999de4d383954ea5b7c75c01802c6497"
I20260709 12:18:17.477953 15508 raft_consensus.cc:3060] T c647fad7e69f46048ebcc6927eac1a58 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:17.478039 15289 raft_consensus.cc:3055] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:17.478477 15289 raft_consensus.cc:740] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 999de4d383954ea5b7c75c01802c6497, State: Running, Role: LEADER
I20260709 12:18:17.479261 15289 consensus_queue.cc:260] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:17.480523 15289 raft_consensus.cc:3060] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:17.483785 15508 raft_consensus.cc:2468] T c647fad7e69f46048ebcc6927eac1a58 P ce91bb31f1d64e2897dd0da8047981c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e7e05bf49114cf092451fa7b0876174 in term 2.
I20260709 12:18:17.484983 15182 leader_election.cc:304] T c647fad7e69f46048ebcc6927eac1a58 P 2e7e05bf49114cf092451fa7b0876174 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e7e05bf49114cf092451fa7b0876174, ce91bb31f1d64e2897dd0da8047981c7; no voters: 
I20260709 12:18:17.485687 15552 raft_consensus.cc:2804] T c647fad7e69f46048ebcc6927eac1a58 P 2e7e05bf49114cf092451fa7b0876174 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:17.486183 15552 raft_consensus.cc:697] T c647fad7e69f46048ebcc6927eac1a58 P 2e7e05bf49114cf092451fa7b0876174 [term 2 LEADER]: Becoming Leader. State: Replica: 2e7e05bf49114cf092451fa7b0876174, State: Running, Role: LEADER
I20260709 12:18:17.487175 15552 consensus_queue.cc:237] T c647fad7e69f46048ebcc6927eac1a58 P 2e7e05bf49114cf092451fa7b0876174 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:17.487521 15289 raft_consensus.cc:2468] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e7e05bf49114cf092451fa7b0876174 in term 2.
I20260709 12:18:17.494673 15040 catalog_manager.cc:5697] T c647fad7e69f46048ebcc6927eac1a58 P 2e7e05bf49114cf092451fa7b0876174 reported cstate change: term changed from 1 to 2, leader changed from 999de4d383954ea5b7c75c01802c6497 (127.3.212.131) to 2e7e05bf49114cf092451fa7b0876174 (127.3.212.130). New cstate: current_term: 2 leader_uuid: "2e7e05bf49114cf092451fa7b0876174" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } health_report { overall_health: UNKNOWN } } }
W20260709 12:18:17.591074 15089 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:18:17.784333 15289 raft_consensus.cc:1275] T 65fd6772c01e480181699cb1c8246779 P 999de4d383954ea5b7c75c01802c6497 [term 2 FOLLOWER]: Refusing update from remote peer 2e7e05bf49114cf092451fa7b0876174: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:17.785836 15552 consensus_queue.cc:1048] T 65fd6772c01e480181699cb1c8246779 P 2e7e05bf49114cf092451fa7b0876174 [LEADER]: Connected to new peer: Peer: permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:17.796478 15508 raft_consensus.cc:1275] T 65fd6772c01e480181699cb1c8246779 P ce91bb31f1d64e2897dd0da8047981c7 [term 2 FOLLOWER]: Refusing update from remote peer 2e7e05bf49114cf092451fa7b0876174: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:17.799783 15552 consensus_queue.cc:1048] T 65fd6772c01e480181699cb1c8246779 P 2e7e05bf49114cf092451fa7b0876174 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:17.876107 15289 raft_consensus.cc:1275] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497 [term 2 FOLLOWER]: Refusing update from remote peer 2e7e05bf49114cf092451fa7b0876174: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:17.877571 15552 consensus_queue.cc:1048] T c647fad7e69f46048ebcc6927eac1a58 P 2e7e05bf49114cf092451fa7b0876174 [LEADER]: Connected to new peer: Peer: permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:17.888358 15507 raft_consensus.cc:1275] T c647fad7e69f46048ebcc6927eac1a58 P ce91bb31f1d64e2897dd0da8047981c7 [term 2 FOLLOWER]: Refusing update from remote peer 2e7e05bf49114cf092451fa7b0876174: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:17.889752 15356 consensus_queue.cc:1048] T c647fad7e69f46048ebcc6927eac1a58 P 2e7e05bf49114cf092451fa7b0876174 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:18.218408  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:18.225785 15217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a58b64f9a4be4ed1973d74fac507d0e3"
dest_uuid: "2e7e05bf49114cf092451fa7b0876174"
mode: GRACEFUL
new_leader_uuid: "999de4d383954ea5b7c75c01802c6497"
 from {username='slave'} at 127.0.0.1:38388
I20260709 12:18:18.226364 15217 raft_consensus.cc:606] T a58b64f9a4be4ed1973d74fac507d0e3 P 2e7e05bf49114cf092451fa7b0876174 [term 1 LEADER]: Received request to transfer leadership to TS 999de4d383954ea5b7c75c01802c6497
I20260709 12:18:18.228958 15218 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c647fad7e69f46048ebcc6927eac1a58"
dest_uuid: "2e7e05bf49114cf092451fa7b0876174"
mode: GRACEFUL
new_leader_uuid: "999de4d383954ea5b7c75c01802c6497"
 from {username='slave'} at 127.0.0.1:38388
I20260709 12:18:18.229501 15218 raft_consensus.cc:606] T c647fad7e69f46048ebcc6927eac1a58 P 2e7e05bf49114cf092451fa7b0876174 [term 2 LEADER]: Received request to transfer leadership to TS 999de4d383954ea5b7c75c01802c6497
I20260709 12:18:18.230533  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:18:18.231015  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:18.231590  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:18.269177 15577 raft_consensus.cc:993] T a58b64f9a4be4ed1973d74fac507d0e3 P 2e7e05bf49114cf092451fa7b0876174: : Instructing follower 999de4d383954ea5b7c75c01802c6497 to start an election
I20260709 12:18:18.269819 15356 raft_consensus.cc:1081] T a58b64f9a4be4ed1973d74fac507d0e3 P 2e7e05bf49114cf092451fa7b0876174 [term 1 LEADER]: Signalling peer 999de4d383954ea5b7c75c01802c6497 to start an election
I20260709 12:18:18.271551 15289 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a58b64f9a4be4ed1973d74fac507d0e3"
dest_uuid: "999de4d383954ea5b7c75c01802c6497"
 from {username='slave'} at 127.0.0.1:34530
I20260709 12:18:18.272032 15289 raft_consensus.cc:493] T a58b64f9a4be4ed1973d74fac507d0e3 P 999de4d383954ea5b7c75c01802c6497 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:18.272338 15289 raft_consensus.cc:3060] T a58b64f9a4be4ed1973d74fac507d0e3 P 999de4d383954ea5b7c75c01802c6497 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:18.277503 15289 raft_consensus.cc:515] T a58b64f9a4be4ed1973d74fac507d0e3 P 999de4d383954ea5b7c75c01802c6497 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:18.279042 15289 leader_election.cc:290] T a58b64f9a4be4ed1973d74fac507d0e3 P 999de4d383954ea5b7c75c01802c6497 [CANDIDATE]: Term 2 election: Requested vote from peers ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633), 2e7e05bf49114cf092451fa7b0876174 (127.3.212.130:42215)
I20260709 12:18:18.279973 15507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a58b64f9a4be4ed1973d74fac507d0e3" candidate_uuid: "999de4d383954ea5b7c75c01802c6497" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce91bb31f1d64e2897dd0da8047981c7"
I20260709 12:18:18.280189 15218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a58b64f9a4be4ed1973d74fac507d0e3" candidate_uuid: "999de4d383954ea5b7c75c01802c6497" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e7e05bf49114cf092451fa7b0876174"
I20260709 12:18:18.280728 15507 raft_consensus.cc:3060] T a58b64f9a4be4ed1973d74fac507d0e3 P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:18.280758 15218 raft_consensus.cc:3055] T a58b64f9a4be4ed1973d74fac507d0e3 P 2e7e05bf49114cf092451fa7b0876174 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:18.281337 15218 raft_consensus.cc:740] T a58b64f9a4be4ed1973d74fac507d0e3 P 2e7e05bf49114cf092451fa7b0876174 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e7e05bf49114cf092451fa7b0876174, State: Running, Role: LEADER
I20260709 12:18:18.282284 15218 consensus_queue.cc:260] T a58b64f9a4be4ed1973d74fac507d0e3 P 2e7e05bf49114cf092451fa7b0876174 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:18.283749 15218 raft_consensus.cc:3060] T a58b64f9a4be4ed1973d74fac507d0e3 P 2e7e05bf49114cf092451fa7b0876174 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:18.287663 15577 raft_consensus.cc:993] T c647fad7e69f46048ebcc6927eac1a58 P 2e7e05bf49114cf092451fa7b0876174: : Instructing follower 999de4d383954ea5b7c75c01802c6497 to start an election
I20260709 12:18:18.288157 15356 raft_consensus.cc:1081] T c647fad7e69f46048ebcc6927eac1a58 P 2e7e05bf49114cf092451fa7b0876174 [term 2 LEADER]: Signalling peer 999de4d383954ea5b7c75c01802c6497 to start an election
I20260709 12:18:18.289657 15289 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c647fad7e69f46048ebcc6927eac1a58"
dest_uuid: "999de4d383954ea5b7c75c01802c6497"
 from {username='slave'} at 127.0.0.1:34530
I20260709 12:18:18.290102 15289 raft_consensus.cc:493] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:18.290082 15507 raft_consensus.cc:2468] T a58b64f9a4be4ed1973d74fac507d0e3 P ce91bb31f1d64e2897dd0da8047981c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 999de4d383954ea5b7c75c01802c6497 in term 2.
I20260709 12:18:18.290683 15289 raft_consensus.cc:3060] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:18.291584 15256 leader_election.cc:304] T a58b64f9a4be4ed1973d74fac507d0e3 P 999de4d383954ea5b7c75c01802c6497 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 999de4d383954ea5b7c75c01802c6497, ce91bb31f1d64e2897dd0da8047981c7; no voters: 
I20260709 12:18:18.292557 15218 raft_consensus.cc:2468] T a58b64f9a4be4ed1973d74fac507d0e3 P 2e7e05bf49114cf092451fa7b0876174 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 999de4d383954ea5b7c75c01802c6497 in term 2.
I20260709 12:18:18.292626 15546 raft_consensus.cc:2804] T a58b64f9a4be4ed1973d74fac507d0e3 P 999de4d383954ea5b7c75c01802c6497 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:18.293828 15546 raft_consensus.cc:697] T a58b64f9a4be4ed1973d74fac507d0e3 P 999de4d383954ea5b7c75c01802c6497 [term 2 LEADER]: Becoming Leader. State: Replica: 999de4d383954ea5b7c75c01802c6497, State: Running, Role: LEADER
I20260709 12:18:18.294934 15546 consensus_queue.cc:237] T a58b64f9a4be4ed1973d74fac507d0e3 P 999de4d383954ea5b7c75c01802c6497 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:18.297655 15289 raft_consensus.cc:515] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:18.300660 15289 leader_election.cc:290] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497 [CANDIDATE]: Term 3 election: Requested vote from peers ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633), 2e7e05bf49114cf092451fa7b0876174 (127.3.212.130:42215)
I20260709 12:18:18.300855 15218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c647fad7e69f46048ebcc6927eac1a58" candidate_uuid: "999de4d383954ea5b7c75c01802c6497" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2e7e05bf49114cf092451fa7b0876174"
I20260709 12:18:18.301630 15218 raft_consensus.cc:3055] T c647fad7e69f46048ebcc6927eac1a58 P 2e7e05bf49114cf092451fa7b0876174 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:18.300855 15507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c647fad7e69f46048ebcc6927eac1a58" candidate_uuid: "999de4d383954ea5b7c75c01802c6497" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ce91bb31f1d64e2897dd0da8047981c7"
I20260709 12:18:18.302016 15218 raft_consensus.cc:740] T c647fad7e69f46048ebcc6927eac1a58 P 2e7e05bf49114cf092451fa7b0876174 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2e7e05bf49114cf092451fa7b0876174, State: Running, Role: LEADER
I20260709 12:18:18.302386 15507 raft_consensus.cc:3060] T c647fad7e69f46048ebcc6927eac1a58 P ce91bb31f1d64e2897dd0da8047981c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:18.302879 15218 consensus_queue.cc:260] T c647fad7e69f46048ebcc6927eac1a58 P 2e7e05bf49114cf092451fa7b0876174 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:18.304508 15218 raft_consensus.cc:3060] T c647fad7e69f46048ebcc6927eac1a58 P 2e7e05bf49114cf092451fa7b0876174 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:18.304905 15040 catalog_manager.cc:5697] T a58b64f9a4be4ed1973d74fac507d0e3 P 999de4d383954ea5b7c75c01802c6497 reported cstate change: term changed from 1 to 2, leader changed from 2e7e05bf49114cf092451fa7b0876174 (127.3.212.130) to 999de4d383954ea5b7c75c01802c6497 (127.3.212.131). New cstate: current_term: 2 leader_uuid: "999de4d383954ea5b7c75c01802c6497" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:18.310460 15507 raft_consensus.cc:2468] T c647fad7e69f46048ebcc6927eac1a58 P ce91bb31f1d64e2897dd0da8047981c7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 999de4d383954ea5b7c75c01802c6497 in term 3.
I20260709 12:18:18.311722 15256 leader_election.cc:304] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 999de4d383954ea5b7c75c01802c6497, ce91bb31f1d64e2897dd0da8047981c7; no voters: 
I20260709 12:18:18.312572 15546 raft_consensus.cc:2804] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:18.313050 15546 raft_consensus.cc:697] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497 [term 3 LEADER]: Becoming Leader. State: Replica: 999de4d383954ea5b7c75c01802c6497, State: Running, Role: LEADER
I20260709 12:18:18.314051 15218 raft_consensus.cc:2468] T c647fad7e69f46048ebcc6927eac1a58 P 2e7e05bf49114cf092451fa7b0876174 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 999de4d383954ea5b7c75c01802c6497 in term 3.
I20260709 12:18:18.314246 15546 consensus_queue.cc:237] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:18.324489 15040 catalog_manager.cc:5697] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497 reported cstate change: term changed from 2 to 3, leader changed from 2e7e05bf49114cf092451fa7b0876174 (127.3.212.130) to 999de4d383954ea5b7c75c01802c6497 (127.3.212.131). New cstate: current_term: 3 leader_uuid: "999de4d383954ea5b7c75c01802c6497" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } health_report { overall_health: HEALTHY } } }
W20260709 12:18:18.592173 15089 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:18:18.678170 15218 raft_consensus.cc:1275] T a58b64f9a4be4ed1973d74fac507d0e3 P 2e7e05bf49114cf092451fa7b0876174 [term 2 FOLLOWER]: Refusing update from remote peer 999de4d383954ea5b7c75c01802c6497: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:18.679682 15546 consensus_queue.cc:1048] T a58b64f9a4be4ed1973d74fac507d0e3 P 999de4d383954ea5b7c75c01802c6497 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:18.690120 15507 raft_consensus.cc:1275] T a58b64f9a4be4ed1973d74fac507d0e3 P ce91bb31f1d64e2897dd0da8047981c7 [term 2 FOLLOWER]: Refusing update from remote peer 999de4d383954ea5b7c75c01802c6497: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:18.692003 15584 consensus_queue.cc:1048] T a58b64f9a4be4ed1973d74fac507d0e3 P 999de4d383954ea5b7c75c01802c6497 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:18.852126 15218 raft_consensus.cc:1275] T c647fad7e69f46048ebcc6927eac1a58 P 2e7e05bf49114cf092451fa7b0876174 [term 3 FOLLOWER]: Refusing update from remote peer 999de4d383954ea5b7c75c01802c6497: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:18.853701 15584 consensus_queue.cc:1048] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:18.862373 15507 raft_consensus.cc:1275] T c647fad7e69f46048ebcc6927eac1a58 P ce91bb31f1d64e2897dd0da8047981c7 [term 3 FOLLOWER]: Refusing update from remote peer 999de4d383954ea5b7c75c01802c6497: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:18.864439 15595 consensus_queue.cc:1048] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:19.238073  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:19.245788 15289 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "424d7c56ad0c4822a8d009c4d824a8d2"
dest_uuid: "999de4d383954ea5b7c75c01802c6497"
mode: GRACEFUL
new_leader_uuid: "2e7e05bf49114cf092451fa7b0876174"
 from {username='slave'} at 127.0.0.1:42386
I20260709 12:18:19.246290 15289 raft_consensus.cc:606] T 424d7c56ad0c4822a8d009c4d824a8d2 P 999de4d383954ea5b7c75c01802c6497 [term 2 LEADER]: Received request to transfer leadership to TS 2e7e05bf49114cf092451fa7b0876174
I20260709 12:18:19.248833 15289 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c647fad7e69f46048ebcc6927eac1a58"
dest_uuid: "999de4d383954ea5b7c75c01802c6497"
mode: GRACEFUL
new_leader_uuid: "2e7e05bf49114cf092451fa7b0876174"
 from {username='slave'} at 127.0.0.1:42386
I20260709 12:18:19.249432 15289 raft_consensus.cc:606] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497 [term 3 LEADER]: Received request to transfer leadership to TS 2e7e05bf49114cf092451fa7b0876174
I20260709 12:18:19.250659  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:18:19.251230  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:19.251819  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:19.424324 15546 raft_consensus.cc:993] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497: : Instructing follower 2e7e05bf49114cf092451fa7b0876174 to start an election
I20260709 12:18:19.424741 15546 raft_consensus.cc:1081] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497 [term 3 LEADER]: Signalling peer 2e7e05bf49114cf092451fa7b0876174 to start an election
I20260709 12:18:19.426405 15218 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c647fad7e69f46048ebcc6927eac1a58"
dest_uuid: "2e7e05bf49114cf092451fa7b0876174"
 from {username='slave'} at 127.0.0.1:53124
I20260709 12:18:19.426882 15218 raft_consensus.cc:493] T c647fad7e69f46048ebcc6927eac1a58 P 2e7e05bf49114cf092451fa7b0876174 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:19.427244 15218 raft_consensus.cc:3060] T c647fad7e69f46048ebcc6927eac1a58 P 2e7e05bf49114cf092451fa7b0876174 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:19.434043 15218 raft_consensus.cc:515] T c647fad7e69f46048ebcc6927eac1a58 P 2e7e05bf49114cf092451fa7b0876174 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:19.435665 15218 leader_election.cc:290] T c647fad7e69f46048ebcc6927eac1a58 P 2e7e05bf49114cf092451fa7b0876174 [CANDIDATE]: Term 4 election: Requested vote from peers ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633), 999de4d383954ea5b7c75c01802c6497 (127.3.212.131:33219)
I20260709 12:18:19.436528 15507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c647fad7e69f46048ebcc6927eac1a58" candidate_uuid: "2e7e05bf49114cf092451fa7b0876174" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ce91bb31f1d64e2897dd0da8047981c7"
I20260709 12:18:19.436781 15289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c647fad7e69f46048ebcc6927eac1a58" candidate_uuid: "2e7e05bf49114cf092451fa7b0876174" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "999de4d383954ea5b7c75c01802c6497"
I20260709 12:18:19.437340 15289 raft_consensus.cc:3055] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:19.437609 15289 raft_consensus.cc:740] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 999de4d383954ea5b7c75c01802c6497, State: Running, Role: LEADER
I20260709 12:18:19.437863 15507 raft_consensus.cc:3060] T c647fad7e69f46048ebcc6927eac1a58 P ce91bb31f1d64e2897dd0da8047981c7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:19.438292 15289 consensus_queue.cc:260] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:19.439229 15289 raft_consensus.cc:3060] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:19.444130 15507 raft_consensus.cc:2468] T c647fad7e69f46048ebcc6927eac1a58 P ce91bb31f1d64e2897dd0da8047981c7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e7e05bf49114cf092451fa7b0876174 in term 4.
I20260709 12:18:19.444551 15289 raft_consensus.cc:2468] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e7e05bf49114cf092451fa7b0876174 in term 4.
I20260709 12:18:19.445577 15182 leader_election.cc:304] T c647fad7e69f46048ebcc6927eac1a58 P 2e7e05bf49114cf092451fa7b0876174 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e7e05bf49114cf092451fa7b0876174, ce91bb31f1d64e2897dd0da8047981c7; no voters: 
I20260709 12:18:19.446388 15552 raft_consensus.cc:2804] T c647fad7e69f46048ebcc6927eac1a58 P 2e7e05bf49114cf092451fa7b0876174 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:19.447242 15552 raft_consensus.cc:697] T c647fad7e69f46048ebcc6927eac1a58 P 2e7e05bf49114cf092451fa7b0876174 [term 4 LEADER]: Becoming Leader. State: Replica: 2e7e05bf49114cf092451fa7b0876174, State: Running, Role: LEADER
I20260709 12:18:19.448340 15552 consensus_queue.cc:237] T c647fad7e69f46048ebcc6927eac1a58 P 2e7e05bf49114cf092451fa7b0876174 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:19.454574 15040 catalog_manager.cc:5697] T c647fad7e69f46048ebcc6927eac1a58 P 2e7e05bf49114cf092451fa7b0876174 reported cstate change: term changed from 3 to 4, leader changed from 999de4d383954ea5b7c75c01802c6497 (127.3.212.131) to 2e7e05bf49114cf092451fa7b0876174 (127.3.212.130). New cstate: current_term: 4 leader_uuid: "2e7e05bf49114cf092451fa7b0876174" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } health_report { overall_health: UNKNOWN } } }
W20260709 12:18:19.593003 15089 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:18:19.620431 15595 raft_consensus.cc:993] T 424d7c56ad0c4822a8d009c4d824a8d2 P 999de4d383954ea5b7c75c01802c6497: : Instructing follower 2e7e05bf49114cf092451fa7b0876174 to start an election
I20260709 12:18:19.620958 15546 raft_consensus.cc:1081] T 424d7c56ad0c4822a8d009c4d824a8d2 P 999de4d383954ea5b7c75c01802c6497 [term 2 LEADER]: Signalling peer 2e7e05bf49114cf092451fa7b0876174 to start an election
I20260709 12:18:19.622556 15218 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "424d7c56ad0c4822a8d009c4d824a8d2"
dest_uuid: "2e7e05bf49114cf092451fa7b0876174"
 from {username='slave'} at 127.0.0.1:53124
I20260709 12:18:19.623052 15218 raft_consensus.cc:493] T 424d7c56ad0c4822a8d009c4d824a8d2 P 2e7e05bf49114cf092451fa7b0876174 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:19.623488 15218 raft_consensus.cc:3060] T 424d7c56ad0c4822a8d009c4d824a8d2 P 2e7e05bf49114cf092451fa7b0876174 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:19.629204 15218 raft_consensus.cc:515] T 424d7c56ad0c4822a8d009c4d824a8d2 P 2e7e05bf49114cf092451fa7b0876174 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:19.631037 15218 leader_election.cc:290] T 424d7c56ad0c4822a8d009c4d824a8d2 P 2e7e05bf49114cf092451fa7b0876174 [CANDIDATE]: Term 3 election: Requested vote from peers ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633), 999de4d383954ea5b7c75c01802c6497 (127.3.212.131:33219)
I20260709 12:18:19.631991 15289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424d7c56ad0c4822a8d009c4d824a8d2" candidate_uuid: "2e7e05bf49114cf092451fa7b0876174" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "999de4d383954ea5b7c75c01802c6497"
I20260709 12:18:19.631912 15507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424d7c56ad0c4822a8d009c4d824a8d2" candidate_uuid: "2e7e05bf49114cf092451fa7b0876174" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ce91bb31f1d64e2897dd0da8047981c7"
I20260709 12:18:19.632658 15289 raft_consensus.cc:3055] T 424d7c56ad0c4822a8d009c4d824a8d2 P 999de4d383954ea5b7c75c01802c6497 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:19.632732 15507 raft_consensus.cc:3060] T 424d7c56ad0c4822a8d009c4d824a8d2 P ce91bb31f1d64e2897dd0da8047981c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:19.632951 15289 raft_consensus.cc:740] T 424d7c56ad0c4822a8d009c4d824a8d2 P 999de4d383954ea5b7c75c01802c6497 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 999de4d383954ea5b7c75c01802c6497, State: Running, Role: LEADER
I20260709 12:18:19.633790 15289 consensus_queue.cc:260] T 424d7c56ad0c4822a8d009c4d824a8d2 P 999de4d383954ea5b7c75c01802c6497 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:19.634647 15289 raft_consensus.cc:3060] T 424d7c56ad0c4822a8d009c4d824a8d2 P 999de4d383954ea5b7c75c01802c6497 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:19.638619 15507 raft_consensus.cc:2468] T 424d7c56ad0c4822a8d009c4d824a8d2 P ce91bb31f1d64e2897dd0da8047981c7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e7e05bf49114cf092451fa7b0876174 in term 3.
I20260709 12:18:19.639257 15289 raft_consensus.cc:2468] T 424d7c56ad0c4822a8d009c4d824a8d2 P 999de4d383954ea5b7c75c01802c6497 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e7e05bf49114cf092451fa7b0876174 in term 3.
I20260709 12:18:19.639717 15182 leader_election.cc:304] T 424d7c56ad0c4822a8d009c4d824a8d2 P 2e7e05bf49114cf092451fa7b0876174 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e7e05bf49114cf092451fa7b0876174, ce91bb31f1d64e2897dd0da8047981c7; no voters: 
I20260709 12:18:19.640488 15552 raft_consensus.cc:2804] T 424d7c56ad0c4822a8d009c4d824a8d2 P 2e7e05bf49114cf092451fa7b0876174 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:19.640877 15552 raft_consensus.cc:697] T 424d7c56ad0c4822a8d009c4d824a8d2 P 2e7e05bf49114cf092451fa7b0876174 [term 3 LEADER]: Becoming Leader. State: Replica: 2e7e05bf49114cf092451fa7b0876174, State: Running, Role: LEADER
I20260709 12:18:19.641619 15552 consensus_queue.cc:237] T 424d7c56ad0c4822a8d009c4d824a8d2 P 2e7e05bf49114cf092451fa7b0876174 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:19.649621 15040 catalog_manager.cc:5697] T 424d7c56ad0c4822a8d009c4d824a8d2 P 2e7e05bf49114cf092451fa7b0876174 reported cstate change: term changed from 2 to 3, leader changed from 999de4d383954ea5b7c75c01802c6497 (127.3.212.131) to 2e7e05bf49114cf092451fa7b0876174 (127.3.212.130). New cstate: current_term: 3 leader_uuid: "2e7e05bf49114cf092451fa7b0876174" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:19.999804 15507 raft_consensus.cc:1275] T c647fad7e69f46048ebcc6927eac1a58 P ce91bb31f1d64e2897dd0da8047981c7 [term 4 FOLLOWER]: Refusing update from remote peer 2e7e05bf49114cf092451fa7b0876174: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:18:20.001096 15552 consensus_queue.cc:1048] T c647fad7e69f46048ebcc6927eac1a58 P 2e7e05bf49114cf092451fa7b0876174 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:20.012192 15289 raft_consensus.cc:1275] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497 [term 4 FOLLOWER]: Refusing update from remote peer 2e7e05bf49114cf092451fa7b0876174: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:18:20.013784 15552 consensus_queue.cc:1048] T c647fad7e69f46048ebcc6927eac1a58 P 2e7e05bf49114cf092451fa7b0876174 [LEADER]: Connected to new peer: Peer: permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:20.185732 15507 raft_consensus.cc:1275] T 424d7c56ad0c4822a8d009c4d824a8d2 P ce91bb31f1d64e2897dd0da8047981c7 [term 3 FOLLOWER]: Refusing update from remote peer 2e7e05bf49114cf092451fa7b0876174: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:20.187317 15552 consensus_queue.cc:1048] T 424d7c56ad0c4822a8d009c4d824a8d2 P 2e7e05bf49114cf092451fa7b0876174 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:20.196209 15289 raft_consensus.cc:1275] T 424d7c56ad0c4822a8d009c4d824a8d2 P 999de4d383954ea5b7c75c01802c6497 [term 3 FOLLOWER]: Refusing update from remote peer 2e7e05bf49114cf092451fa7b0876174: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:20.198311 15552 consensus_queue.cc:1048] T 424d7c56ad0c4822a8d009c4d824a8d2 P 2e7e05bf49114cf092451fa7b0876174 [LEADER]: Connected to new peer: Peer: permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:20.259652  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:20.267733 15218 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7978baf90ead4534804cd2aeeef77fe0"
dest_uuid: "2e7e05bf49114cf092451fa7b0876174"
mode: GRACEFUL
new_leader_uuid: "999de4d383954ea5b7c75c01802c6497"
 from {username='slave'} at 127.0.0.1:38388
I20260709 12:18:20.268412 15218 raft_consensus.cc:606] T 7978baf90ead4534804cd2aeeef77fe0 P 2e7e05bf49114cf092451fa7b0876174 [term 2 LEADER]: Received request to transfer leadership to TS 999de4d383954ea5b7c75c01802c6497
I20260709 12:18:20.271319 15218 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b0a2c042781548d3bb7125a8f78942a5"
dest_uuid: "2e7e05bf49114cf092451fa7b0876174"
mode: GRACEFUL
new_leader_uuid: "999de4d383954ea5b7c75c01802c6497"
 from {username='slave'} at 127.0.0.1:38388
I20260709 12:18:20.271790 15218 raft_consensus.cc:606] T b0a2c042781548d3bb7125a8f78942a5 P 2e7e05bf49114cf092451fa7b0876174 [term 2 LEADER]: Received request to transfer leadership to TS 999de4d383954ea5b7c75c01802c6497
I20260709 12:18:20.272900  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:18:20.273542  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:20.274188  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:20.527392 15596 raft_consensus.cc:993] T 7978baf90ead4534804cd2aeeef77fe0 P 2e7e05bf49114cf092451fa7b0876174: : Instructing follower 999de4d383954ea5b7c75c01802c6497 to start an election
I20260709 12:18:20.527776 15609 raft_consensus.cc:993] T b0a2c042781548d3bb7125a8f78942a5 P 2e7e05bf49114cf092451fa7b0876174: : Instructing follower 999de4d383954ea5b7c75c01802c6497 to start an election
I20260709 12:18:20.527971 15610 raft_consensus.cc:1081] T 7978baf90ead4534804cd2aeeef77fe0 P 2e7e05bf49114cf092451fa7b0876174 [term 2 LEADER]: Signalling peer 999de4d383954ea5b7c75c01802c6497 to start an election
I20260709 12:18:20.528267 15596 raft_consensus.cc:1081] T b0a2c042781548d3bb7125a8f78942a5 P 2e7e05bf49114cf092451fa7b0876174 [term 2 LEADER]: Signalling peer 999de4d383954ea5b7c75c01802c6497 to start an election
I20260709 12:18:20.529839 15290 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7978baf90ead4534804cd2aeeef77fe0"
dest_uuid: "999de4d383954ea5b7c75c01802c6497"
 from {username='slave'} at 127.0.0.1:34530
I20260709 12:18:20.530263 15289 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b0a2c042781548d3bb7125a8f78942a5"
dest_uuid: "999de4d383954ea5b7c75c01802c6497"
 from {username='slave'} at 127.0.0.1:34530
I20260709 12:18:20.530390 15290 raft_consensus.cc:493] T 7978baf90ead4534804cd2aeeef77fe0 P 999de4d383954ea5b7c75c01802c6497 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:20.530872 15290 raft_consensus.cc:3060] T 7978baf90ead4534804cd2aeeef77fe0 P 999de4d383954ea5b7c75c01802c6497 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:20.530874 15289 raft_consensus.cc:493] T b0a2c042781548d3bb7125a8f78942a5 P 999de4d383954ea5b7c75c01802c6497 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:20.531424 15289 raft_consensus.cc:3060] T b0a2c042781548d3bb7125a8f78942a5 P 999de4d383954ea5b7c75c01802c6497 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:20.538575 15289 raft_consensus.cc:515] T b0a2c042781548d3bb7125a8f78942a5 P 999de4d383954ea5b7c75c01802c6497 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:20.538667 15290 raft_consensus.cc:515] T 7978baf90ead4534804cd2aeeef77fe0 P 999de4d383954ea5b7c75c01802c6497 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:20.540714 15290 leader_election.cc:290] T 7978baf90ead4534804cd2aeeef77fe0 P 999de4d383954ea5b7c75c01802c6497 [CANDIDATE]: Term 3 election: Requested vote from peers ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633), 2e7e05bf49114cf092451fa7b0876174 (127.3.212.130:42215)
I20260709 12:18:20.541456 15289 leader_election.cc:290] T b0a2c042781548d3bb7125a8f78942a5 P 999de4d383954ea5b7c75c01802c6497 [CANDIDATE]: Term 3 election: Requested vote from peers ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633), 2e7e05bf49114cf092451fa7b0876174 (127.3.212.130:42215)
I20260709 12:18:20.542172 15218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0a2c042781548d3bb7125a8f78942a5" candidate_uuid: "999de4d383954ea5b7c75c01802c6497" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2e7e05bf49114cf092451fa7b0876174"
I20260709 12:18:20.542428 15217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7978baf90ead4534804cd2aeeef77fe0" candidate_uuid: "999de4d383954ea5b7c75c01802c6497" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2e7e05bf49114cf092451fa7b0876174"
I20260709 12:18:20.542858 15218 raft_consensus.cc:3055] T b0a2c042781548d3bb7125a8f78942a5 P 2e7e05bf49114cf092451fa7b0876174 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:20.542924 15217 raft_consensus.cc:3055] T 7978baf90ead4534804cd2aeeef77fe0 P 2e7e05bf49114cf092451fa7b0876174 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:20.542987 15508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7978baf90ead4534804cd2aeeef77fe0" candidate_uuid: "999de4d383954ea5b7c75c01802c6497" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ce91bb31f1d64e2897dd0da8047981c7"
I20260709 12:18:20.543452 15218 raft_consensus.cc:740] T b0a2c042781548d3bb7125a8f78942a5 P 2e7e05bf49114cf092451fa7b0876174 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2e7e05bf49114cf092451fa7b0876174, State: Running, Role: LEADER
I20260709 12:18:20.543576 15217 raft_consensus.cc:740] T 7978baf90ead4534804cd2aeeef77fe0 P 2e7e05bf49114cf092451fa7b0876174 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2e7e05bf49114cf092451fa7b0876174, State: Running, Role: LEADER
I20260709 12:18:20.543900 15508 raft_consensus.cc:3060] T 7978baf90ead4534804cd2aeeef77fe0 P ce91bb31f1d64e2897dd0da8047981c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:20.544479 15217 consensus_queue.cc:260] T 7978baf90ead4534804cd2aeeef77fe0 P 2e7e05bf49114cf092451fa7b0876174 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:20.544480 15218 consensus_queue.cc:260] T b0a2c042781548d3bb7125a8f78942a5 P 2e7e05bf49114cf092451fa7b0876174 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:20.544657 15507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0a2c042781548d3bb7125a8f78942a5" candidate_uuid: "999de4d383954ea5b7c75c01802c6497" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ce91bb31f1d64e2897dd0da8047981c7"
I20260709 12:18:20.545863 15507 raft_consensus.cc:3060] T b0a2c042781548d3bb7125a8f78942a5 P ce91bb31f1d64e2897dd0da8047981c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:20.545944 15217 raft_consensus.cc:3060] T 7978baf90ead4534804cd2aeeef77fe0 P 2e7e05bf49114cf092451fa7b0876174 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:20.546169 15218 raft_consensus.cc:3060] T b0a2c042781548d3bb7125a8f78942a5 P 2e7e05bf49114cf092451fa7b0876174 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:20.553612 15217 raft_consensus.cc:2468] T 7978baf90ead4534804cd2aeeef77fe0 P 2e7e05bf49114cf092451fa7b0876174 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 999de4d383954ea5b7c75c01802c6497 in term 3.
I20260709 12:18:20.555032 15218 raft_consensus.cc:2468] T b0a2c042781548d3bb7125a8f78942a5 P 2e7e05bf49114cf092451fa7b0876174 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 999de4d383954ea5b7c75c01802c6497 in term 3.
I20260709 12:18:20.555327 15255 leader_election.cc:304] T 7978baf90ead4534804cd2aeeef77fe0 P 999de4d383954ea5b7c75c01802c6497 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e7e05bf49114cf092451fa7b0876174, 999de4d383954ea5b7c75c01802c6497; no voters: 
I20260709 12:18:20.555603 15507 raft_consensus.cc:2468] T b0a2c042781548d3bb7125a8f78942a5 P ce91bb31f1d64e2897dd0da8047981c7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 999de4d383954ea5b7c75c01802c6497 in term 3.
I20260709 12:18:20.555864 15508 raft_consensus.cc:2468] T 7978baf90ead4534804cd2aeeef77fe0 P ce91bb31f1d64e2897dd0da8047981c7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 999de4d383954ea5b7c75c01802c6497 in term 3.
I20260709 12:18:20.556391 15255 leader_election.cc:304] T b0a2c042781548d3bb7125a8f78942a5 P 999de4d383954ea5b7c75c01802c6497 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e7e05bf49114cf092451fa7b0876174, 999de4d383954ea5b7c75c01802c6497; no voters: 
I20260709 12:18:20.556525 15595 raft_consensus.cc:2804] T 7978baf90ead4534804cd2aeeef77fe0 P 999de4d383954ea5b7c75c01802c6497 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:20.558175 15595 raft_consensus.cc:697] T 7978baf90ead4534804cd2aeeef77fe0 P 999de4d383954ea5b7c75c01802c6497 [term 3 LEADER]: Becoming Leader. State: Replica: 999de4d383954ea5b7c75c01802c6497, State: Running, Role: LEADER
I20260709 12:18:20.558543 15612 raft_consensus.cc:2804] T b0a2c042781548d3bb7125a8f78942a5 P 999de4d383954ea5b7c75c01802c6497 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:20.559056 15612 raft_consensus.cc:697] T b0a2c042781548d3bb7125a8f78942a5 P 999de4d383954ea5b7c75c01802c6497 [term 3 LEADER]: Becoming Leader. State: Replica: 999de4d383954ea5b7c75c01802c6497, State: Running, Role: LEADER
I20260709 12:18:20.559249 15595 consensus_queue.cc:237] T 7978baf90ead4534804cd2aeeef77fe0 P 999de4d383954ea5b7c75c01802c6497 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:20.559949 15612 consensus_queue.cc:237] T b0a2c042781548d3bb7125a8f78942a5 P 999de4d383954ea5b7c75c01802c6497 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } }
I20260709 12:18:20.570994 15039 catalog_manager.cc:5697] T 7978baf90ead4534804cd2aeeef77fe0 P 999de4d383954ea5b7c75c01802c6497 reported cstate change: term changed from 2 to 3, leader changed from 2e7e05bf49114cf092451fa7b0876174 (127.3.212.130) to 999de4d383954ea5b7c75c01802c6497 (127.3.212.131). New cstate: current_term: 3 leader_uuid: "999de4d383954ea5b7c75c01802c6497" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:20.572212 15039 catalog_manager.cc:5697] T b0a2c042781548d3bb7125a8f78942a5 P 999de4d383954ea5b7c75c01802c6497 reported cstate change: term changed from 2 to 3, leader changed from 2e7e05bf49114cf092451fa7b0876174 (127.3.212.130) to 999de4d383954ea5b7c75c01802c6497 (127.3.212.131). New cstate: current_term: 3 leader_uuid: "999de4d383954ea5b7c75c01802c6497" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "999de4d383954ea5b7c75c01802c6497" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33219 } health_report { overall_health: HEALTHY } } }
W20260709 12:18:20.594007 15089 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:18:20.950440 15507 raft_consensus.cc:1275] T 7978baf90ead4534804cd2aeeef77fe0 P ce91bb31f1d64e2897dd0da8047981c7 [term 3 FOLLOWER]: Refusing update from remote peer 999de4d383954ea5b7c75c01802c6497: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:20.951951 15595 consensus_queue.cc:1048] T 7978baf90ead4534804cd2aeeef77fe0 P 999de4d383954ea5b7c75c01802c6497 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:20.962771 15218 raft_consensus.cc:1275] T 7978baf90ead4534804cd2aeeef77fe0 P 2e7e05bf49114cf092451fa7b0876174 [term 3 FOLLOWER]: Refusing update from remote peer 999de4d383954ea5b7c75c01802c6497: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:20.964421 15595 consensus_queue.cc:1048] T 7978baf90ead4534804cd2aeeef77fe0 P 999de4d383954ea5b7c75c01802c6497 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:20.971583 15217 raft_consensus.cc:1275] T b0a2c042781548d3bb7125a8f78942a5 P 2e7e05bf49114cf092451fa7b0876174 [term 3 FOLLOWER]: Refusing update from remote peer 999de4d383954ea5b7c75c01802c6497: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:20.972983 15595 consensus_queue.cc:1048] T b0a2c042781548d3bb7125a8f78942a5 P 999de4d383954ea5b7c75c01802c6497 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e7e05bf49114cf092451fa7b0876174" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:20.983042 15507 raft_consensus.cc:1275] T b0a2c042781548d3bb7125a8f78942a5 P ce91bb31f1d64e2897dd0da8047981c7 [term 3 FOLLOWER]: Refusing update from remote peer 999de4d383954ea5b7c75c01802c6497: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:20.984973 15612 consensus_queue.cc:1048] T b0a2c042781548d3bb7125a8f78942a5 P 999de4d383954ea5b7c75c01802c6497 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce91bb31f1d64e2897dd0da8047981c7" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 33633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:21.280692  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:21.307071  3922 tablet_server.cc:179] TabletServer@127.3.212.129:33633 shutting down...
I20260709 12:18:21.327862  3922 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:18:21.328601  3922 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:21.329226  3922 raft_consensus.cc:2243] T b0a2c042781548d3bb7125a8f78942a5 P ce91bb31f1d64e2897dd0da8047981c7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:21.329738  3922 raft_consensus.cc:2272] T b0a2c042781548d3bb7125a8f78942a5 P ce91bb31f1d64e2897dd0da8047981c7 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:21.330806 15182 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 68 similar messages]
I20260709 12:18:21.332494  3922 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:21.333467  3922 raft_consensus.cc:2243] T 7978baf90ead4534804cd2aeeef77fe0 P ce91bb31f1d64e2897dd0da8047981c7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:21.333935  3922 raft_consensus.cc:2272] T 7978baf90ead4534804cd2aeeef77fe0 P ce91bb31f1d64e2897dd0da8047981c7 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:21.334527 15182 consensus_peers.cc:597] T 4fe037cbd5e841c3ba79c2a066b045a9 P 2e7e05bf49114cf092451fa7b0876174 -> Peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Couldn't send request to peer ce91bb31f1d64e2897dd0da8047981c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:21.337360  3922 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:21.338023  3922 raft_consensus.cc:2243] T c1991cd59d6441abac887582832f6a2a P ce91bb31f1d64e2897dd0da8047981c7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:21.338404  3922 raft_consensus.cc:2272] T c1991cd59d6441abac887582832f6a2a P ce91bb31f1d64e2897dd0da8047981c7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:21.340217  3922 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:21.340736  3922 raft_consensus.cc:2243] T 4fe037cbd5e841c3ba79c2a066b045a9 P ce91bb31f1d64e2897dd0da8047981c7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:21.341107  3922 raft_consensus.cc:2272] T 4fe037cbd5e841c3ba79c2a066b045a9 P ce91bb31f1d64e2897dd0da8047981c7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:21.343492  3922 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:21.344050  3922 raft_consensus.cc:2243] T 3366909acc834c76ac9845f902ce93f6 P ce91bb31f1d64e2897dd0da8047981c7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:21.344453  3922 raft_consensus.cc:2272] T 3366909acc834c76ac9845f902ce93f6 P ce91bb31f1d64e2897dd0da8047981c7 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:21.346272 15256 consensus_peers.cc:597] T a58b64f9a4be4ed1973d74fac507d0e3 P 999de4d383954ea5b7c75c01802c6497 -> Peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Couldn't send request to peer ce91bb31f1d64e2897dd0da8047981c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:21.346519  3922 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:21.347124  3922 raft_consensus.cc:2243] T 424d7c56ad0c4822a8d009c4d824a8d2 P ce91bb31f1d64e2897dd0da8047981c7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:21.347618  3922 raft_consensus.cc:2272] T 424d7c56ad0c4822a8d009c4d824a8d2 P ce91bb31f1d64e2897dd0da8047981c7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:21.349560  3922 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:21.350081  3922 raft_consensus.cc:2243] T a58b64f9a4be4ed1973d74fac507d0e3 P ce91bb31f1d64e2897dd0da8047981c7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:21.350479  3922 raft_consensus.cc:2272] T a58b64f9a4be4ed1973d74fac507d0e3 P ce91bb31f1d64e2897dd0da8047981c7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:21.352404  3922 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:21.353088  3922 raft_consensus.cc:2243] T 65fd6772c01e480181699cb1c8246779 P ce91bb31f1d64e2897dd0da8047981c7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:21.353590  3922 raft_consensus.cc:2272] T 65fd6772c01e480181699cb1c8246779 P ce91bb31f1d64e2897dd0da8047981c7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:21.355667  3922 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:21.356371  3922 raft_consensus.cc:2243] T be5df69cad7f48c19a5e4aa80dcede4c P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:18:21.356443 15256 consensus_peers.cc:597] T c1991cd59d6441abac887582832f6a2a P 999de4d383954ea5b7c75c01802c6497 -> Peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Couldn't send request to peer ce91bb31f1d64e2897dd0da8047981c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:21.356791  3922 raft_consensus.cc:2272] T be5df69cad7f48c19a5e4aa80dcede4c P ce91bb31f1d64e2897dd0da8047981c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:21.358718  3922 tablet_replica.cc:333] stopping tablet replica
I20260709 12:18:21.359239  3922 raft_consensus.cc:2243] T c647fad7e69f46048ebcc6927eac1a58 P ce91bb31f1d64e2897dd0da8047981c7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:21.359656  3922 raft_consensus.cc:2272] T c647fad7e69f46048ebcc6927eac1a58 P ce91bb31f1d64e2897dd0da8047981c7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:21.388092  3922 tablet_server.cc:196] TabletServer@127.3.212.129:33633 shutdown complete.
W20260709 12:18:21.408048 15256 consensus_peers.cc:597] T b0a2c042781548d3bb7125a8f78942a5 P 999de4d383954ea5b7c75c01802c6497 -> Peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Couldn't send request to peer ce91bb31f1d64e2897dd0da8047981c7. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:33633: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:21.409617  3922 tablet_server.cc:179] TabletServer@127.3.212.130:0 shutting down...
I20260709 12:18:21.434084  3922 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:18:21.434899  3922 tablet_replica.cc:333] T c647fad7e69f46048ebcc6927eac1a58 P 2e7e05bf49114cf092451fa7b0876174: stopping tablet replica
I20260709 12:18:21.435595  3922 raft_consensus.cc:2243] T c647fad7e69f46048ebcc6927eac1a58 P 2e7e05bf49114cf092451fa7b0876174 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:18:21.436445  3922 raft_consensus.cc:2272] T c647fad7e69f46048ebcc6927eac1a58 P 2e7e05bf49114cf092451fa7b0876174 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:21.438632  3922 tablet_replica.cc:333] T be5df69cad7f48c19a5e4aa80dcede4c P 2e7e05bf49114cf092451fa7b0876174: stopping tablet replica
I20260709 12:18:21.439218  3922 raft_consensus.cc:2243] T be5df69cad7f48c19a5e4aa80dcede4c P 2e7e05bf49114cf092451fa7b0876174 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:21.439647  3922 raft_consensus.cc:2272] T be5df69cad7f48c19a5e4aa80dcede4c P 2e7e05bf49114cf092451fa7b0876174 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:21.441627  3922 tablet_replica.cc:333] T 424d7c56ad0c4822a8d009c4d824a8d2 P 2e7e05bf49114cf092451fa7b0876174: stopping tablet replica
I20260709 12:18:21.442159  3922 raft_consensus.cc:2243] T 424d7c56ad0c4822a8d009c4d824a8d2 P 2e7e05bf49114cf092451fa7b0876174 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:18:21.442876  3922 raft_consensus.cc:2272] T 424d7c56ad0c4822a8d009c4d824a8d2 P 2e7e05bf49114cf092451fa7b0876174 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:21.444926  3922 tablet_replica.cc:333] T b0a2c042781548d3bb7125a8f78942a5 P 2e7e05bf49114cf092451fa7b0876174: stopping tablet replica
I20260709 12:18:21.445493  3922 raft_consensus.cc:2243] T b0a2c042781548d3bb7125a8f78942a5 P 2e7e05bf49114cf092451fa7b0876174 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:21.445878  3922 raft_consensus.cc:2272] T b0a2c042781548d3bb7125a8f78942a5 P 2e7e05bf49114cf092451fa7b0876174 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:21.448406  3922 tablet_replica.cc:333] T 3366909acc834c76ac9845f902ce93f6 P 2e7e05bf49114cf092451fa7b0876174: stopping tablet replica
I20260709 12:18:21.449033  3922 raft_consensus.cc:2243] T 3366909acc834c76ac9845f902ce93f6 P 2e7e05bf49114cf092451fa7b0876174 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:21.449831  3922 raft_consensus.cc:2272] T 3366909acc834c76ac9845f902ce93f6 P 2e7e05bf49114cf092451fa7b0876174 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:21.453334  3922 tablet_replica.cc:333] T 7978baf90ead4534804cd2aeeef77fe0 P 2e7e05bf49114cf092451fa7b0876174: stopping tablet replica
W20260709 12:18:21.454118 15255 consensus_peers.cc:597] T b0a2c042781548d3bb7125a8f78942a5 P 999de4d383954ea5b7c75c01802c6497 -> Peer 2e7e05bf49114cf092451fa7b0876174 (127.3.212.130:42215): Couldn't send request to peer 2e7e05bf49114cf092451fa7b0876174. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:21.454279  3922 raft_consensus.cc:2243] T 7978baf90ead4534804cd2aeeef77fe0 P 2e7e05bf49114cf092451fa7b0876174 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:21.454979  3922 raft_consensus.cc:2272] T 7978baf90ead4534804cd2aeeef77fe0 P 2e7e05bf49114cf092451fa7b0876174 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:21.456101 15256 consensus_peers.cc:597] T 3366909acc834c76ac9845f902ce93f6 P 999de4d383954ea5b7c75c01802c6497 -> Peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Couldn't send request to peer ce91bb31f1d64e2897dd0da8047981c7. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:33633: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:21.458356  3922 tablet_replica.cc:333] T 65fd6772c01e480181699cb1c8246779 P 2e7e05bf49114cf092451fa7b0876174: stopping tablet replica
I20260709 12:18:21.458992  3922 raft_consensus.cc:2243] T 65fd6772c01e480181699cb1c8246779 P 2e7e05bf49114cf092451fa7b0876174 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:21.459798  3922 raft_consensus.cc:2272] T 65fd6772c01e480181699cb1c8246779 P 2e7e05bf49114cf092451fa7b0876174 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:21.462338  3922 tablet_replica.cc:333] T a58b64f9a4be4ed1973d74fac507d0e3 P 2e7e05bf49114cf092451fa7b0876174: stopping tablet replica
I20260709 12:18:21.463124  3922 raft_consensus.cc:2243] T a58b64f9a4be4ed1973d74fac507d0e3 P 2e7e05bf49114cf092451fa7b0876174 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:21.463619  3922 raft_consensus.cc:2272] T a58b64f9a4be4ed1973d74fac507d0e3 P 2e7e05bf49114cf092451fa7b0876174 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:21.465745 15255 consensus_peers.cc:597] T 7978baf90ead4534804cd2aeeef77fe0 P 999de4d383954ea5b7c75c01802c6497 -> Peer 2e7e05bf49114cf092451fa7b0876174 (127.3.212.130:42215): Couldn't send request to peer 2e7e05bf49114cf092451fa7b0876174. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:21.466688  3922 tablet_replica.cc:333] T 4fe037cbd5e841c3ba79c2a066b045a9 P 2e7e05bf49114cf092451fa7b0876174: stopping tablet replica
I20260709 12:18:21.467374  3922 raft_consensus.cc:2243] T 4fe037cbd5e841c3ba79c2a066b045a9 P 2e7e05bf49114cf092451fa7b0876174 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:21.468195  3922 raft_consensus.cc:2272] T 4fe037cbd5e841c3ba79c2a066b045a9 P 2e7e05bf49114cf092451fa7b0876174 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:21.470358  3922 tablet_replica.cc:333] T c1991cd59d6441abac887582832f6a2a P 2e7e05bf49114cf092451fa7b0876174: stopping tablet replica
I20260709 12:18:21.470839  3922 raft_consensus.cc:2243] T c1991cd59d6441abac887582832f6a2a P 2e7e05bf49114cf092451fa7b0876174 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:21.471333  3922 raft_consensus.cc:2272] T c1991cd59d6441abac887582832f6a2a P 2e7e05bf49114cf092451fa7b0876174 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:21.504508  3922 tablet_server.cc:196] TabletServer@127.3.212.130:0 shutdown complete.
W20260709 12:18:21.529968 15256 consensus_peers.cc:597] T 7978baf90ead4534804cd2aeeef77fe0 P 999de4d383954ea5b7c75c01802c6497 -> Peer ce91bb31f1d64e2897dd0da8047981c7 (127.3.212.129:33633): Couldn't send request to peer ce91bb31f1d64e2897dd0da8047981c7. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:33633: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:21.531201  3922 tablet_server.cc:179] TabletServer@127.3.212.131:0 shutting down...
I20260709 12:18:21.562377  3922 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:18:21.563092  3922 tablet_replica.cc:333] T b0a2c042781548d3bb7125a8f78942a5 P 999de4d383954ea5b7c75c01802c6497: stopping tablet replica
I20260709 12:18:21.563781  3922 raft_consensus.cc:2243] T b0a2c042781548d3bb7125a8f78942a5 P 999de4d383954ea5b7c75c01802c6497 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:18:21.564627  3922 raft_consensus.cc:2272] T b0a2c042781548d3bb7125a8f78942a5 P 999de4d383954ea5b7c75c01802c6497 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:21.567107  3922 tablet_replica.cc:333] T 424d7c56ad0c4822a8d009c4d824a8d2 P 999de4d383954ea5b7c75c01802c6497: stopping tablet replica
I20260709 12:18:21.567742  3922 raft_consensus.cc:2243] T 424d7c56ad0c4822a8d009c4d824a8d2 P 999de4d383954ea5b7c75c01802c6497 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:21.568185  3922 raft_consensus.cc:2272] T 424d7c56ad0c4822a8d009c4d824a8d2 P 999de4d383954ea5b7c75c01802c6497 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:21.570442  3922 tablet_replica.cc:333] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497: stopping tablet replica
I20260709 12:18:21.570978  3922 raft_consensus.cc:2243] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:21.571396  3922 raft_consensus.cc:2272] T c647fad7e69f46048ebcc6927eac1a58 P 999de4d383954ea5b7c75c01802c6497 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:21.573412  3922 tablet_replica.cc:333] T be5df69cad7f48c19a5e4aa80dcede4c P 999de4d383954ea5b7c75c01802c6497: stopping tablet replica
I20260709 12:18:21.574004  3922 raft_consensus.cc:2243] T be5df69cad7f48c19a5e4aa80dcede4c P 999de4d383954ea5b7c75c01802c6497 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:21.574756  3922 raft_consensus.cc:2272] T be5df69cad7f48c19a5e4aa80dcede4c P 999de4d383954ea5b7c75c01802c6497 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:21.577016  3922 tablet_replica.cc:333] T 3366909acc834c76ac9845f902ce93f6 P 999de4d383954ea5b7c75c01802c6497: stopping tablet replica
I20260709 12:18:21.577670  3922 raft_consensus.cc:2243] T 3366909acc834c76ac9845f902ce93f6 P 999de4d383954ea5b7c75c01802c6497 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:18:21.578495  3922 raft_consensus.cc:2272] T 3366909acc834c76ac9845f902ce93f6 P 999de4d383954ea5b7c75c01802c6497 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:21.580622  3922 tablet_replica.cc:333] T c1991cd59d6441abac887582832f6a2a P 999de4d383954ea5b7c75c01802c6497: stopping tablet replica
I20260709 12:18:21.581190  3922 raft_consensus.cc:2243] T c1991cd59d6441abac887582832f6a2a P 999de4d383954ea5b7c75c01802c6497 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:21.581985  3922 raft_consensus.cc:2272] T c1991cd59d6441abac887582832f6a2a P 999de4d383954ea5b7c75c01802c6497 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:21.584136  3922 tablet_replica.cc:333] T 4fe037cbd5e841c3ba79c2a066b045a9 P 999de4d383954ea5b7c75c01802c6497: stopping tablet replica
I20260709 12:18:21.584681  3922 raft_consensus.cc:2243] T 4fe037cbd5e841c3ba79c2a066b045a9 P 999de4d383954ea5b7c75c01802c6497 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:21.585131  3922 raft_consensus.cc:2272] T 4fe037cbd5e841c3ba79c2a066b045a9 P 999de4d383954ea5b7c75c01802c6497 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:21.587303  3922 tablet_replica.cc:333] T 7978baf90ead4534804cd2aeeef77fe0 P 999de4d383954ea5b7c75c01802c6497: stopping tablet replica
I20260709 12:18:21.587827  3922 raft_consensus.cc:2243] T 7978baf90ead4534804cd2aeeef77fe0 P 999de4d383954ea5b7c75c01802c6497 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:18:21.588655  3922 raft_consensus.cc:2272] T 7978baf90ead4534804cd2aeeef77fe0 P 999de4d383954ea5b7c75c01802c6497 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:21.591313  3922 tablet_replica.cc:333] T 65fd6772c01e480181699cb1c8246779 P 999de4d383954ea5b7c75c01802c6497: stopping tablet replica
I20260709 12:18:21.591876  3922 raft_consensus.cc:2243] T 65fd6772c01e480181699cb1c8246779 P 999de4d383954ea5b7c75c01802c6497 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:21.592346  3922 raft_consensus.cc:2272] T 65fd6772c01e480181699cb1c8246779 P 999de4d383954ea5b7c75c01802c6497 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:21.594420  3922 tablet_replica.cc:333] T a58b64f9a4be4ed1973d74fac507d0e3 P 999de4d383954ea5b7c75c01802c6497: stopping tablet replica
I20260709 12:18:21.594947  3922 raft_consensus.cc:2243] T a58b64f9a4be4ed1973d74fac507d0e3 P 999de4d383954ea5b7c75c01802c6497 [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:18:21.595002 15089 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:18:21.595746  3922 raft_consensus.cc:2272] T a58b64f9a4be4ed1973d74fac507d0e3 P 999de4d383954ea5b7c75c01802c6497 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:21.627482  3922 tablet_server.cc:196] TabletServer@127.3.212.131:0 shutdown complete.
I20260709 12:18:21.652901  3922 master.cc:562] Master@127.3.212.190:35487 shutting down...
I20260709 12:18:21.682776  3922 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 5c19ae896ee04283b888065a716678f4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:21.683320  3922 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 5c19ae896ee04283b888065a716678f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:21.683621  3922 tablet_replica.cc:333] T 00000000000000000000000000000000 P 5c19ae896ee04283b888065a716678f4: stopping tablet replica
I20260709 12:18:21.704610  3922 master.cc:584] Master@127.3.212.190:35487 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (17342 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 12:18:21.748068  3922 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.212.190:37053
I20260709 12:18:21.749199  3922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:21.754431 15632 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:21.754480 15633 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:21.756211 15635 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:21.757453  3922 server_base.cc:1061] running on GCE node
I20260709 12:18:21.758361  3922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:21.758534  3922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:21.758646  3922 hybrid_clock.cc:648] HybridClock initialized: now 1783599501758635 us; error 0 us; skew 500 ppm
I20260709 12:18:21.759207  3922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:21.761617  3922 webserver.cc:533] Webserver started at http://127.3.212.190:39507/ using document root <none> and password file <none>
I20260709 12:18:21.762089  3922 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:21.762248  3922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:21.762473  3922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:21.763561  3922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599103767690-3922-0/minicluster-data/master-0-root/instance:
uuid: "bd55d2ec2fcf4814b51fc6b0aa0b7519"
format_stamp: "Formatted at 2026-07-09 12:18:21 on dist-test-slave-442x"
I20260709 12:18:21.768488  3922 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 12:18:21.772503 15640 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:21.773464  3922 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:18:21.773756  3922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599103767690-3922-0/minicluster-data/master-0-root
uuid: "bd55d2ec2fcf4814b51fc6b0aa0b7519"
format_stamp: "Formatted at 2026-07-09 12:18:21 on dist-test-slave-442x"
I20260709 12:18:21.774047  3922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599103767690-3922-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599103767690-3922-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599103767690-3922-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:21.811515  3922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:21.812803  3922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:21.852392  3922 rpc_server.cc:307] RPC server started. Bound to: 127.3.212.190:37053
I20260709 12:18:21.852500 15691 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.212.190:37053 every 8 connection(s)
I20260709 12:18:21.856257 15692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:21.868779 15692 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd55d2ec2fcf4814b51fc6b0aa0b7519: Bootstrap starting.
I20260709 12:18:21.873889 15692 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bd55d2ec2fcf4814b51fc6b0aa0b7519: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:21.878712 15692 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd55d2ec2fcf4814b51fc6b0aa0b7519: No bootstrap required, opened a new log
I20260709 12:18:21.880949 15692 raft_consensus.cc:359] T 00000000000000000000000000000000 P bd55d2ec2fcf4814b51fc6b0aa0b7519 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd55d2ec2fcf4814b51fc6b0aa0b7519" member_type: VOTER }
I20260709 12:18:21.881423 15692 raft_consensus.cc:385] T 00000000000000000000000000000000 P bd55d2ec2fcf4814b51fc6b0aa0b7519 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:21.881705 15692 raft_consensus.cc:740] T 00000000000000000000000000000000 P bd55d2ec2fcf4814b51fc6b0aa0b7519 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd55d2ec2fcf4814b51fc6b0aa0b7519, State: Initialized, Role: FOLLOWER
I20260709 12:18:21.882393 15692 consensus_queue.cc:260] T 00000000000000000000000000000000 P bd55d2ec2fcf4814b51fc6b0aa0b7519 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd55d2ec2fcf4814b51fc6b0aa0b7519" member_type: VOTER }
I20260709 12:18:21.882824 15692 raft_consensus.cc:399] T 00000000000000000000000000000000 P bd55d2ec2fcf4814b51fc6b0aa0b7519 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:18:21.883018 15692 raft_consensus.cc:493] T 00000000000000000000000000000000 P bd55d2ec2fcf4814b51fc6b0aa0b7519 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:18:21.883417 15692 raft_consensus.cc:3060] T 00000000000000000000000000000000 P bd55d2ec2fcf4814b51fc6b0aa0b7519 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:21.888579 15692 raft_consensus.cc:515] T 00000000000000000000000000000000 P bd55d2ec2fcf4814b51fc6b0aa0b7519 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd55d2ec2fcf4814b51fc6b0aa0b7519" member_type: VOTER }
I20260709 12:18:21.889117 15692 leader_election.cc:304] T 00000000000000000000000000000000 P bd55d2ec2fcf4814b51fc6b0aa0b7519 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bd55d2ec2fcf4814b51fc6b0aa0b7519; no voters: 
I20260709 12:18:21.890354 15692 leader_election.cc:290] T 00000000000000000000000000000000 P bd55d2ec2fcf4814b51fc6b0aa0b7519 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:18:21.890771 15695 raft_consensus.cc:2804] T 00000000000000000000000000000000 P bd55d2ec2fcf4814b51fc6b0aa0b7519 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:21.892177 15695 raft_consensus.cc:697] T 00000000000000000000000000000000 P bd55d2ec2fcf4814b51fc6b0aa0b7519 [term 1 LEADER]: Becoming Leader. State: Replica: bd55d2ec2fcf4814b51fc6b0aa0b7519, State: Running, Role: LEADER
I20260709 12:18:21.892818 15695 consensus_queue.cc:237] T 00000000000000000000000000000000 P bd55d2ec2fcf4814b51fc6b0aa0b7519 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd55d2ec2fcf4814b51fc6b0aa0b7519" member_type: VOTER }
I20260709 12:18:21.893134 15692 sys_catalog.cc:565] T 00000000000000000000000000000000 P bd55d2ec2fcf4814b51fc6b0aa0b7519 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:18:21.896978 15696 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd55d2ec2fcf4814b51fc6b0aa0b7519 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bd55d2ec2fcf4814b51fc6b0aa0b7519" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd55d2ec2fcf4814b51fc6b0aa0b7519" member_type: VOTER } }
I20260709 12:18:21.897686 15696 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd55d2ec2fcf4814b51fc6b0aa0b7519 [sys.catalog]: This master's current role is: LEADER
I20260709 12:18:21.897444 15697 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd55d2ec2fcf4814b51fc6b0aa0b7519 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bd55d2ec2fcf4814b51fc6b0aa0b7519. Latest consensus state: current_term: 1 leader_uuid: "bd55d2ec2fcf4814b51fc6b0aa0b7519" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd55d2ec2fcf4814b51fc6b0aa0b7519" member_type: VOTER } }
I20260709 12:18:21.898550 15697 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd55d2ec2fcf4814b51fc6b0aa0b7519 [sys.catalog]: This master's current role is: LEADER
I20260709 12:18:21.900588 15703 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:18:21.907989 15703 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:18:21.908995  3922 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:18:21.916967 15703 catalog_manager.cc:1383] Generated new cluster ID: 7368fb7128b647a6aa751a2d0462aa7f
I20260709 12:18:21.917290 15703 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:18:21.937563 15703 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:18:21.938901 15703 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:18:21.950826 15703 catalog_manager.cc:6070] T 00000000000000000000000000000000 P bd55d2ec2fcf4814b51fc6b0aa0b7519: Generated new TSK 0
I20260709 12:18:21.951465 15703 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:18:21.976163  3922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:21.982404 15713 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:21.983376 15714 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:21.985169 15716 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:21.985905  3922 server_base.cc:1061] running on GCE node
I20260709 12:18:21.986847  3922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:21.987025  3922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:21.987144  3922 hybrid_clock.cc:648] HybridClock initialized: now 1783599501987134 us; error 0 us; skew 500 ppm
I20260709 12:18:21.987623  3922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:21.990000  3922 webserver.cc:533] Webserver started at http://127.3.212.129:37035/ using document root <none> and password file <none>
I20260709 12:18:21.990454  3922 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:21.990609  3922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:21.990839  3922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:21.991852  3922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599103767690-3922-0/minicluster-data/ts-0-root/instance:
uuid: "6a3ac9b7a6664089a9dfff2be770ae9f"
format_stamp: "Formatted at 2026-07-09 12:18:21 on dist-test-slave-442x"
I20260709 12:18:21.996526  3922 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:18:21.999857 15721 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:22.000761  3922 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:18:22.001077  3922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599103767690-3922-0/minicluster-data/ts-0-root
uuid: "6a3ac9b7a6664089a9dfff2be770ae9f"
format_stamp: "Formatted at 2026-07-09 12:18:21 on dist-test-slave-442x"
I20260709 12:18:22.001410  3922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599103767690-3922-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599103767690-3922-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599103767690-3922-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:22.019989  3922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:22.021219  3922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:22.022713  3922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:18:22.024956  3922 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:18:22.025152  3922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:22.025395  3922 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:18:22.025550  3922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:18:22.079447  3922 rpc_server.cc:307] RPC server started. Bound to: 127.3.212.129:35231
I20260709 12:18:22.079527 15783 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.212.129:35231 every 8 connection(s)
I20260709 12:18:22.085659  3922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:22.093909 15788 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:22.096673 15789 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:22.097630 15791 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:22.097818  3922 server_base.cc:1061] running on GCE node
I20260709 12:18:22.099498  3922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:22.099766  3922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:22.099917  3922 hybrid_clock.cc:648] HybridClock initialized: now 1783599502099905 us; error 0 us; skew 500 ppm
I20260709 12:18:22.100579  3922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:22.100950 15784 heartbeater.cc:344] Connected to a master server at 127.3.212.190:37053
I20260709 12:18:22.101465 15784 heartbeater.cc:461] Registering TS with master...
I20260709 12:18:22.102412 15784 heartbeater.cc:507] Master 127.3.212.190:37053 requested a full tablet report, sending...
I20260709 12:18:22.103376  3922 webserver.cc:533] Webserver started at http://127.3.212.130:43367/ using document root <none> and password file <none>
I20260709 12:18:22.103958  3922 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:22.104139  3922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:22.104425  3922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:22.104925 15657 ts_manager.cc:194] Registered new tserver with Master: 6a3ac9b7a6664089a9dfff2be770ae9f (127.3.212.129:35231)
I20260709 12:18:22.105875  3922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599103767690-3922-0/minicluster-data/ts-1-root/instance:
uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef"
format_stamp: "Formatted at 2026-07-09 12:18:22 on dist-test-slave-442x"
I20260709 12:18:22.107429 15657 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36546
I20260709 12:18:22.111647  3922 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:18:22.115465 15796 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:22.116539  3922 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:18:22.116853  3922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599103767690-3922-0/minicluster-data/ts-1-root
uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef"
format_stamp: "Formatted at 2026-07-09 12:18:22 on dist-test-slave-442x"
I20260709 12:18:22.117106  3922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599103767690-3922-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599103767690-3922-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599103767690-3922-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:22.141423  3922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:22.142690  3922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:22.144575  3922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:18:22.147353  3922 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:18:22.147557  3922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:22.147820  3922 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:18:22.147961  3922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:22.190871  3922 rpc_server.cc:307] RPC server started. Bound to: 127.3.212.130:46005
I20260709 12:18:22.190981 15858 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.212.130:46005 every 8 connection(s)
I20260709 12:18:22.195523  3922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:22.203548 15863 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:22.204176 15862 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:22.205157 15865 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:22.206847  3922 server_base.cc:1061] running on GCE node
I20260709 12:18:22.207715  3922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:22.207924  3922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:22.208061  3922 hybrid_clock.cc:648] HybridClock initialized: now 1783599502208050 us; error 0 us; skew 500 ppm
I20260709 12:18:22.208539  3922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:22.211072  3922 webserver.cc:533] Webserver started at http://127.3.212.131:35265/ using document root <none> and password file <none>
I20260709 12:18:22.211674  3922 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:22.211903  3922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:22.212200  3922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:22.213613 15859 heartbeater.cc:344] Connected to a master server at 127.3.212.190:37053
I20260709 12:18:22.213640  3922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599103767690-3922-0/minicluster-data/ts-2-root/instance:
uuid: "726e6a80e7de487892d687105e801764"
format_stamp: "Formatted at 2026-07-09 12:18:22 on dist-test-slave-442x"
I20260709 12:18:22.214046 15859 heartbeater.cc:461] Registering TS with master...
I20260709 12:18:22.214941 15859 heartbeater.cc:507] Master 127.3.212.190:37053 requested a full tablet report, sending...
I20260709 12:18:22.217092 15657 ts_manager.cc:194] Registered new tserver with Master: 7951a4e6c7b3466eb4556a6eb5fd70ef (127.3.212.130:46005)
I20260709 12:18:22.218662 15657 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36556
I20260709 12:18:22.218681  3922 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:18:22.222440 15870 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:22.223206  3922 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:18:22.223532  3922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599103767690-3922-0/minicluster-data/ts-2-root
uuid: "726e6a80e7de487892d687105e801764"
format_stamp: "Formatted at 2026-07-09 12:18:22 on dist-test-slave-442x"
I20260709 12:18:22.223784  3922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599103767690-3922-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599103767690-3922-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599103767690-3922-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:22.245266  3922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:22.246538  3922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:22.247980  3922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:18:22.250350  3922 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:18:22.250569  3922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:22.250808  3922 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:18:22.250964  3922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:22.294559  3922 rpc_server.cc:307] RPC server started. Bound to: 127.3.212.131:33873
I20260709 12:18:22.294750 15932 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.212.131:33873 every 8 connection(s)
I20260709 12:18:22.308697 15933 heartbeater.cc:344] Connected to a master server at 127.3.212.190:37053
I20260709 12:18:22.309157 15933 heartbeater.cc:461] Registering TS with master...
I20260709 12:18:22.309986 15933 heartbeater.cc:507] Master 127.3.212.190:37053 requested a full tablet report, sending...
I20260709 12:18:22.311923 15657 ts_manager.cc:194] Registered new tserver with Master: 726e6a80e7de487892d687105e801764 (127.3.212.131:33873)
I20260709 12:18:22.312750  3922 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015050109s
I20260709 12:18:22.313331 15657 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36568
I20260709 12:18:22.338443 15657 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36582:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:18:22.340551 15657 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:18:22.386404 15824 tablet_service.cc:1511] Processing CreateTablet for tablet a045569ee1ba41aa8f1cb7fd32e8cf2e (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=c21ffd2b94c0479788429815be2cdca1]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:18:22.388087 15824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a045569ee1ba41aa8f1cb7fd32e8cf2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:22.408365 15823 tablet_service.cc:1511] Processing CreateTablet for tablet cfbf335a1b2d4dc5b82b7e9e2e809fa5 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=c21ffd2b94c0479788429815be2cdca1]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:18:22.410115 15823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfbf335a1b2d4dc5b82b7e9e2e809fa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:22.411720 15898 tablet_service.cc:1511] Processing CreateTablet for tablet a045569ee1ba41aa8f1cb7fd32e8cf2e (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=c21ffd2b94c0479788429815be2cdca1]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:18:22.413311 15898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a045569ee1ba41aa8f1cb7fd32e8cf2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:22.414108 15897 tablet_service.cc:1511] Processing CreateTablet for tablet cfbf335a1b2d4dc5b82b7e9e2e809fa5 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=c21ffd2b94c0479788429815be2cdca1]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:18:22.415519 15897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfbf335a1b2d4dc5b82b7e9e2e809fa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:22.419534 15749 tablet_service.cc:1511] Processing CreateTablet for tablet a045569ee1ba41aa8f1cb7fd32e8cf2e (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=c21ffd2b94c0479788429815be2cdca1]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:18:22.421005 15749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a045569ee1ba41aa8f1cb7fd32e8cf2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:22.425590 15748 tablet_service.cc:1511] Processing CreateTablet for tablet cfbf335a1b2d4dc5b82b7e9e2e809fa5 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=c21ffd2b94c0479788429815be2cdca1]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:18:22.426996 15748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfbf335a1b2d4dc5b82b7e9e2e809fa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:22.442276 15949 tablet_bootstrap.cc:492] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 726e6a80e7de487892d687105e801764: Bootstrap starting.
I20260709 12:18:22.451139 15949 tablet_bootstrap.cc:654] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 726e6a80e7de487892d687105e801764: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:22.463735 15949 tablet_bootstrap.cc:492] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 726e6a80e7de487892d687105e801764: No bootstrap required, opened a new log
I20260709 12:18:22.464452 15949 ts_tablet_manager.cc:1403] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 726e6a80e7de487892d687105e801764: Time spent bootstrapping tablet: real 0.023s	user 0.020s	sys 0.000s
I20260709 12:18:22.468025 15949 raft_consensus.cc:359] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 726e6a80e7de487892d687105e801764 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 46005 } } peers { permanent_uuid: "726e6a80e7de487892d687105e801764" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33873 } } peers { permanent_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35231 } }
I20260709 12:18:22.470263 15951 tablet_bootstrap.cc:492] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 6a3ac9b7a6664089a9dfff2be770ae9f: Bootstrap starting.
I20260709 12:18:22.471879 15948 tablet_bootstrap.cc:492] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 7951a4e6c7b3466eb4556a6eb5fd70ef: Bootstrap starting.
I20260709 12:18:22.472294 15949 raft_consensus.cc:385] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 726e6a80e7de487892d687105e801764 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:22.472656 15949 raft_consensus.cc:740] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 726e6a80e7de487892d687105e801764 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 726e6a80e7de487892d687105e801764, State: Initialized, Role: FOLLOWER
I20260709 12:18:22.473352 15949 consensus_queue.cc:260] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 726e6a80e7de487892d687105e801764 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 46005 } } peers { permanent_uuid: "726e6a80e7de487892d687105e801764" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33873 } } peers { permanent_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35231 } }
I20260709 12:18:22.475546 15933 heartbeater.cc:499] Master 127.3.212.190:37053 was elected leader, sending a full tablet report...
I20260709 12:18:22.478389 15949 ts_tablet_manager.cc:1434] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 726e6a80e7de487892d687105e801764: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.004s
I20260709 12:18:22.479511 15948 tablet_bootstrap.cc:654] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 7951a4e6c7b3466eb4556a6eb5fd70ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:22.479596 15951 tablet_bootstrap.cc:654] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 6a3ac9b7a6664089a9dfff2be770ae9f: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:22.479503 15949 tablet_bootstrap.cc:492] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 726e6a80e7de487892d687105e801764: Bootstrap starting.
I20260709 12:18:22.488336 15951 tablet_bootstrap.cc:492] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 6a3ac9b7a6664089a9dfff2be770ae9f: No bootstrap required, opened a new log
I20260709 12:18:22.488498 15948 tablet_bootstrap.cc:492] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 7951a4e6c7b3466eb4556a6eb5fd70ef: No bootstrap required, opened a new log
I20260709 12:18:22.488879 15951 ts_tablet_manager.cc:1403] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 6a3ac9b7a6664089a9dfff2be770ae9f: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.003s
I20260709 12:18:22.489048 15948 ts_tablet_manager.cc:1403] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 7951a4e6c7b3466eb4556a6eb5fd70ef: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.009s
I20260709 12:18:22.492102 15949 tablet_bootstrap.cc:654] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 726e6a80e7de487892d687105e801764: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:22.492305 15948 raft_consensus.cc:359] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 7951a4e6c7b3466eb4556a6eb5fd70ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 46005 } } peers { permanent_uuid: "726e6a80e7de487892d687105e801764" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33873 } } peers { permanent_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35231 } }
I20260709 12:18:22.492683 15951 raft_consensus.cc:359] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 6a3ac9b7a6664089a9dfff2be770ae9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 46005 } } peers { permanent_uuid: "726e6a80e7de487892d687105e801764" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33873 } } peers { permanent_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35231 } }
I20260709 12:18:22.493165 15948 raft_consensus.cc:385] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 7951a4e6c7b3466eb4556a6eb5fd70ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:22.493602 15951 raft_consensus.cc:385] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 6a3ac9b7a6664089a9dfff2be770ae9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:22.493732 15948 raft_consensus.cc:740] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 7951a4e6c7b3466eb4556a6eb5fd70ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7951a4e6c7b3466eb4556a6eb5fd70ef, State: Initialized, Role: FOLLOWER
I20260709 12:18:22.494059 15951 raft_consensus.cc:740] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 6a3ac9b7a6664089a9dfff2be770ae9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a3ac9b7a6664089a9dfff2be770ae9f, State: Initialized, Role: FOLLOWER
I20260709 12:18:22.494726 15948 consensus_queue.cc:260] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 7951a4e6c7b3466eb4556a6eb5fd70ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 46005 } } peers { permanent_uuid: "726e6a80e7de487892d687105e801764" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33873 } } peers { permanent_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35231 } }
I20260709 12:18:22.495031 15951 consensus_queue.cc:260] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 6a3ac9b7a6664089a9dfff2be770ae9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 46005 } } peers { permanent_uuid: "726e6a80e7de487892d687105e801764" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33873 } } peers { permanent_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35231 } }
I20260709 12:18:22.498170 15951 ts_tablet_manager.cc:1434] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 6a3ac9b7a6664089a9dfff2be770ae9f: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:18:22.498320 15859 heartbeater.cc:499] Master 127.3.212.190:37053 was elected leader, sending a full tablet report...
I20260709 12:18:22.498857 15948 ts_tablet_manager.cc:1434] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 7951a4e6c7b3466eb4556a6eb5fd70ef: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:18:22.500203 15948 tablet_bootstrap.cc:492] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 7951a4e6c7b3466eb4556a6eb5fd70ef: Bootstrap starting.
I20260709 12:18:22.500381 15784 heartbeater.cc:499] Master 127.3.212.190:37053 was elected leader, sending a full tablet report...
I20260709 12:18:22.501128 15951 tablet_bootstrap.cc:492] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 6a3ac9b7a6664089a9dfff2be770ae9f: Bootstrap starting.
I20260709 12:18:22.503551 15949 tablet_bootstrap.cc:492] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 726e6a80e7de487892d687105e801764: No bootstrap required, opened a new log
I20260709 12:18:22.504354 15949 ts_tablet_manager.cc:1403] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 726e6a80e7de487892d687105e801764: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.002s
I20260709 12:18:22.507622 15949 raft_consensus.cc:359] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 726e6a80e7de487892d687105e801764 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35231 } } peers { permanent_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 46005 } } peers { permanent_uuid: "726e6a80e7de487892d687105e801764" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33873 } }
I20260709 12:18:22.508503 15949 raft_consensus.cc:385] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 726e6a80e7de487892d687105e801764 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:22.508662 15948 tablet_bootstrap.cc:654] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 7951a4e6c7b3466eb4556a6eb5fd70ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:22.508859 15949 raft_consensus.cc:740] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 726e6a80e7de487892d687105e801764 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 726e6a80e7de487892d687105e801764, State: Initialized, Role: FOLLOWER
I20260709 12:18:22.509943 15951 tablet_bootstrap.cc:654] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 6a3ac9b7a6664089a9dfff2be770ae9f: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:22.509822 15949 consensus_queue.cc:260] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 726e6a80e7de487892d687105e801764 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35231 } } peers { permanent_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 46005 } } peers { permanent_uuid: "726e6a80e7de487892d687105e801764" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33873 } }
I20260709 12:18:22.512158 15949 ts_tablet_manager.cc:1434] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 726e6a80e7de487892d687105e801764: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 12:18:22.513010 15956 raft_consensus.cc:493] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 6a3ac9b7a6664089a9dfff2be770ae9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.513722 15956 raft_consensus.cc:515] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 6a3ac9b7a6664089a9dfff2be770ae9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 46005 } } peers { permanent_uuid: "726e6a80e7de487892d687105e801764" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33873 } } peers { permanent_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35231 } }
I20260709 12:18:22.518436 15956 leader_election.cc:290] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 6a3ac9b7a6664089a9dfff2be770ae9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7951a4e6c7b3466eb4556a6eb5fd70ef (127.3.212.130:46005), 726e6a80e7de487892d687105e801764 (127.3.212.131:33873)
I20260709 12:18:22.522703 15948 tablet_bootstrap.cc:492] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 7951a4e6c7b3466eb4556a6eb5fd70ef: No bootstrap required, opened a new log
I20260709 12:18:22.523517 15948 ts_tablet_manager.cc:1403] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 7951a4e6c7b3466eb4556a6eb5fd70ef: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.007s
I20260709 12:18:22.525100 15951 tablet_bootstrap.cc:492] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 6a3ac9b7a6664089a9dfff2be770ae9f: No bootstrap required, opened a new log
I20260709 12:18:22.525749 15951 ts_tablet_manager.cc:1403] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 6a3ac9b7a6664089a9dfff2be770ae9f: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.003s
I20260709 12:18:22.527177 15948 raft_consensus.cc:359] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 7951a4e6c7b3466eb4556a6eb5fd70ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35231 } } peers { permanent_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 46005 } } peers { permanent_uuid: "726e6a80e7de487892d687105e801764" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33873 } }
I20260709 12:18:22.528116 15948 raft_consensus.cc:385] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 7951a4e6c7b3466eb4556a6eb5fd70ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:22.528479 15948 raft_consensus.cc:740] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 7951a4e6c7b3466eb4556a6eb5fd70ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7951a4e6c7b3466eb4556a6eb5fd70ef, State: Initialized, Role: FOLLOWER
I20260709 12:18:22.528963 15951 raft_consensus.cc:359] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 6a3ac9b7a6664089a9dfff2be770ae9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35231 } } peers { permanent_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 46005 } } peers { permanent_uuid: "726e6a80e7de487892d687105e801764" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33873 } }
I20260709 12:18:22.529433 15948 consensus_queue.cc:260] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 7951a4e6c7b3466eb4556a6eb5fd70ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35231 } } peers { permanent_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 46005 } } peers { permanent_uuid: "726e6a80e7de487892d687105e801764" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33873 } }
I20260709 12:18:22.530009 15951 raft_consensus.cc:385] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 6a3ac9b7a6664089a9dfff2be770ae9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:22.531679 15951 raft_consensus.cc:740] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 6a3ac9b7a6664089a9dfff2be770ae9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a3ac9b7a6664089a9dfff2be770ae9f, State: Initialized, Role: FOLLOWER
I20260709 12:18:22.532248 15948 ts_tablet_manager.cc:1434] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 7951a4e6c7b3466eb4556a6eb5fd70ef: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:18:22.532773 15951 consensus_queue.cc:260] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 6a3ac9b7a6664089a9dfff2be770ae9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35231 } } peers { permanent_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 46005 } } peers { permanent_uuid: "726e6a80e7de487892d687105e801764" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33873 } }
I20260709 12:18:22.535202 15951 ts_tablet_manager.cc:1434] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 6a3ac9b7a6664089a9dfff2be770ae9f: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:18:22.542366 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a045569ee1ba41aa8f1cb7fd32e8cf2e" candidate_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef" is_pre_election: true
I20260709 12:18:22.543236 15834 raft_consensus.cc:2468] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 7951a4e6c7b3466eb4556a6eb5fd70ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a3ac9b7a6664089a9dfff2be770ae9f in term 0.
I20260709 12:18:22.543603 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a045569ee1ba41aa8f1cb7fd32e8cf2e" candidate_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "726e6a80e7de487892d687105e801764" is_pre_election: true
I20260709 12:18:22.544445 15908 raft_consensus.cc:2468] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 726e6a80e7de487892d687105e801764 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a3ac9b7a6664089a9dfff2be770ae9f in term 0.
I20260709 12:18:22.544802 15724 leader_election.cc:304] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 6a3ac9b7a6664089a9dfff2be770ae9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a3ac9b7a6664089a9dfff2be770ae9f, 7951a4e6c7b3466eb4556a6eb5fd70ef; no voters: 
I20260709 12:18:22.545768 15956 raft_consensus.cc:2804] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 6a3ac9b7a6664089a9dfff2be770ae9f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:22.546126 15956 raft_consensus.cc:493] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 6a3ac9b7a6664089a9dfff2be770ae9f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:22.546437 15956 raft_consensus.cc:3060] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 6a3ac9b7a6664089a9dfff2be770ae9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:22.553537 15956 raft_consensus.cc:515] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 6a3ac9b7a6664089a9dfff2be770ae9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 46005 } } peers { permanent_uuid: "726e6a80e7de487892d687105e801764" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33873 } } peers { permanent_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35231 } }
I20260709 12:18:22.555173 15956 leader_election.cc:290] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 6a3ac9b7a6664089a9dfff2be770ae9f [CANDIDATE]: Term 1 election: Requested vote from peers 7951a4e6c7b3466eb4556a6eb5fd70ef (127.3.212.130:46005), 726e6a80e7de487892d687105e801764 (127.3.212.131:33873)
I20260709 12:18:22.555991 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a045569ee1ba41aa8f1cb7fd32e8cf2e" candidate_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef"
I20260709 12:18:22.556281 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a045569ee1ba41aa8f1cb7fd32e8cf2e" candidate_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "726e6a80e7de487892d687105e801764"
I20260709 12:18:22.556527 15834 raft_consensus.cc:3060] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 7951a4e6c7b3466eb4556a6eb5fd70ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:22.556875 15908 raft_consensus.cc:3060] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 726e6a80e7de487892d687105e801764 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:22.562979 15834 raft_consensus.cc:2468] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 7951a4e6c7b3466eb4556a6eb5fd70ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a3ac9b7a6664089a9dfff2be770ae9f in term 1.
I20260709 12:18:22.563334 15908 raft_consensus.cc:2468] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 726e6a80e7de487892d687105e801764 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a3ac9b7a6664089a9dfff2be770ae9f in term 1.
I20260709 12:18:22.564381 15724 leader_election.cc:304] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 6a3ac9b7a6664089a9dfff2be770ae9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a3ac9b7a6664089a9dfff2be770ae9f, 7951a4e6c7b3466eb4556a6eb5fd70ef; no voters: 
I20260709 12:18:22.565135 15956 raft_consensus.cc:2804] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 6a3ac9b7a6664089a9dfff2be770ae9f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:22.566408 15956 raft_consensus.cc:697] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 6a3ac9b7a6664089a9dfff2be770ae9f [term 1 LEADER]: Becoming Leader. State: Replica: 6a3ac9b7a6664089a9dfff2be770ae9f, State: Running, Role: LEADER
I20260709 12:18:22.567086 15956 consensus_queue.cc:237] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 6a3ac9b7a6664089a9dfff2be770ae9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 46005 } } peers { permanent_uuid: "726e6a80e7de487892d687105e801764" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33873 } } peers { permanent_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35231 } }
I20260709 12:18:22.575017 15655 catalog_manager.cc:5697] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 6a3ac9b7a6664089a9dfff2be770ae9f reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a3ac9b7a6664089a9dfff2be770ae9f (127.3.212.129). New cstate: current_term: 1 leader_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 46005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "726e6a80e7de487892d687105e801764" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35231 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:22.625895 15952 raft_consensus.cc:493] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 726e6a80e7de487892d687105e801764 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.626523 15952 raft_consensus.cc:515] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 726e6a80e7de487892d687105e801764 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35231 } } peers { permanent_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 46005 } } peers { permanent_uuid: "726e6a80e7de487892d687105e801764" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33873 } }
I20260709 12:18:22.628744 15952 leader_election.cc:290] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 726e6a80e7de487892d687105e801764 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a3ac9b7a6664089a9dfff2be770ae9f (127.3.212.129:35231), 7951a4e6c7b3466eb4556a6eb5fd70ef (127.3.212.130:46005)
I20260709 12:18:22.638805 15759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbf335a1b2d4dc5b82b7e9e2e809fa5" candidate_uuid: "726e6a80e7de487892d687105e801764" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" is_pre_election: true
I20260709 12:18:22.639469 15759 raft_consensus.cc:2468] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 6a3ac9b7a6664089a9dfff2be770ae9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 726e6a80e7de487892d687105e801764 in term 0.
I20260709 12:18:22.639978 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbf335a1b2d4dc5b82b7e9e2e809fa5" candidate_uuid: "726e6a80e7de487892d687105e801764" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef" is_pre_election: true
I20260709 12:18:22.640611 15834 raft_consensus.cc:2468] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 7951a4e6c7b3466eb4556a6eb5fd70ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 726e6a80e7de487892d687105e801764 in term 0.
I20260709 12:18:22.640805 15874 leader_election.cc:304] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 726e6a80e7de487892d687105e801764 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a3ac9b7a6664089a9dfff2be770ae9f, 726e6a80e7de487892d687105e801764; no voters: 
I20260709 12:18:22.641804 15952 raft_consensus.cc:2804] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 726e6a80e7de487892d687105e801764 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:22.642160 15952 raft_consensus.cc:493] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 726e6a80e7de487892d687105e801764 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:22.642419 15952 raft_consensus.cc:3060] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 726e6a80e7de487892d687105e801764 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:22.648451 15952 raft_consensus.cc:515] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 726e6a80e7de487892d687105e801764 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35231 } } peers { permanent_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 46005 } } peers { permanent_uuid: "726e6a80e7de487892d687105e801764" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33873 } }
I20260709 12:18:22.650290 15952 leader_election.cc:290] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 726e6a80e7de487892d687105e801764 [CANDIDATE]: Term 1 election: Requested vote from peers 6a3ac9b7a6664089a9dfff2be770ae9f (127.3.212.129:35231), 7951a4e6c7b3466eb4556a6eb5fd70ef (127.3.212.130:46005)
I20260709 12:18:22.651175 15759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbf335a1b2d4dc5b82b7e9e2e809fa5" candidate_uuid: "726e6a80e7de487892d687105e801764" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f"
I20260709 12:18:22.651311 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbf335a1b2d4dc5b82b7e9e2e809fa5" candidate_uuid: "726e6a80e7de487892d687105e801764" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef"
I20260709 12:18:22.651729 15759 raft_consensus.cc:3060] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 6a3ac9b7a6664089a9dfff2be770ae9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:22.651855 15834 raft_consensus.cc:3060] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 7951a4e6c7b3466eb4556a6eb5fd70ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:22.657313 15834 raft_consensus.cc:2468] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 7951a4e6c7b3466eb4556a6eb5fd70ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 726e6a80e7de487892d687105e801764 in term 1.
I20260709 12:18:22.657317 15759 raft_consensus.cc:2468] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 6a3ac9b7a6664089a9dfff2be770ae9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 726e6a80e7de487892d687105e801764 in term 1.
I20260709 12:18:22.658530 15873 leader_election.cc:304] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 726e6a80e7de487892d687105e801764 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 726e6a80e7de487892d687105e801764, 7951a4e6c7b3466eb4556a6eb5fd70ef; no voters: 
I20260709 12:18:22.659410 15952 raft_consensus.cc:2804] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 726e6a80e7de487892d687105e801764 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:22.660558 15952 raft_consensus.cc:697] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 726e6a80e7de487892d687105e801764 [term 1 LEADER]: Becoming Leader. State: Replica: 726e6a80e7de487892d687105e801764, State: Running, Role: LEADER
I20260709 12:18:22.661403 15952 consensus_queue.cc:237] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 726e6a80e7de487892d687105e801764 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35231 } } peers { permanent_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 46005 } } peers { permanent_uuid: "726e6a80e7de487892d687105e801764" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33873 } }
I20260709 12:18:22.668356 15655 catalog_manager.cc:5697] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 726e6a80e7de487892d687105e801764 reported cstate change: term changed from 0 to 1, leader changed from <none> to 726e6a80e7de487892d687105e801764 (127.3.212.131). New cstate: current_term: 1 leader_uuid: "726e6a80e7de487892d687105e801764" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 46005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "726e6a80e7de487892d687105e801764" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33873 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:22.729552 15655 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36590:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:18:22.731566 15655 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:18:22.755545 15749 tablet_service.cc:1511] Processing CreateTablet for tablet 738df617f1d34b6e974af9a8dd7b3fc4 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=8768b934d93243f0870e947d43fc5749]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:18:22.756889 15749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 738df617f1d34b6e974af9a8dd7b3fc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:22.756723 15824 tablet_service.cc:1511] Processing CreateTablet for tablet 738df617f1d34b6e974af9a8dd7b3fc4 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=8768b934d93243f0870e947d43fc5749]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:18:22.758090 15824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 738df617f1d34b6e974af9a8dd7b3fc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:22.758916 15897 tablet_service.cc:1511] Processing CreateTablet for tablet 738df617f1d34b6e974af9a8dd7b3fc4 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=8768b934d93243f0870e947d43fc5749]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:18:22.760205 15897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 738df617f1d34b6e974af9a8dd7b3fc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:22.762176 15823 tablet_service.cc:1511] Processing CreateTablet for tablet ded749e8d0d744478ca19dfae96779f2 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=8768b934d93243f0870e947d43fc5749]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:18:22.763573 15823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ded749e8d0d744478ca19dfae96779f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:22.763862 15748 tablet_service.cc:1511] Processing CreateTablet for tablet ded749e8d0d744478ca19dfae96779f2 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=8768b934d93243f0870e947d43fc5749]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:18:22.765110 15748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ded749e8d0d744478ca19dfae96779f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:22.770529 15898 tablet_service.cc:1511] Processing CreateTablet for tablet ded749e8d0d744478ca19dfae96779f2 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=8768b934d93243f0870e947d43fc5749]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:18:22.772164 15898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ded749e8d0d744478ca19dfae96779f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:22.775925 15951 tablet_bootstrap.cc:492] T 738df617f1d34b6e974af9a8dd7b3fc4 P 6a3ac9b7a6664089a9dfff2be770ae9f: Bootstrap starting.
I20260709 12:18:22.782516 15951 tablet_bootstrap.cc:654] T 738df617f1d34b6e974af9a8dd7b3fc4 P 6a3ac9b7a6664089a9dfff2be770ae9f: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:22.788856 15949 tablet_bootstrap.cc:492] T 738df617f1d34b6e974af9a8dd7b3fc4 P 726e6a80e7de487892d687105e801764: Bootstrap starting.
I20260709 12:18:22.797688 15949 tablet_bootstrap.cc:654] T 738df617f1d34b6e974af9a8dd7b3fc4 P 726e6a80e7de487892d687105e801764: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:22.797921 15948 tablet_bootstrap.cc:492] T 738df617f1d34b6e974af9a8dd7b3fc4 P 7951a4e6c7b3466eb4556a6eb5fd70ef: Bootstrap starting.
I20260709 12:18:22.802078 15951 tablet_bootstrap.cc:492] T 738df617f1d34b6e974af9a8dd7b3fc4 P 6a3ac9b7a6664089a9dfff2be770ae9f: No bootstrap required, opened a new log
I20260709 12:18:22.803640 15951 ts_tablet_manager.cc:1403] T 738df617f1d34b6e974af9a8dd7b3fc4 P 6a3ac9b7a6664089a9dfff2be770ae9f: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.009s
I20260709 12:18:22.804780 15948 tablet_bootstrap.cc:654] T 738df617f1d34b6e974af9a8dd7b3fc4 P 7951a4e6c7b3466eb4556a6eb5fd70ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:22.807286 15951 raft_consensus.cc:359] T 738df617f1d34b6e974af9a8dd7b3fc4 P 6a3ac9b7a6664089a9dfff2be770ae9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35231 } } peers { permanent_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 46005 } } peers { permanent_uuid: "726e6a80e7de487892d687105e801764" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33873 } }
I20260709 12:18:22.807695 15949 tablet_bootstrap.cc:492] T 738df617f1d34b6e974af9a8dd7b3fc4 P 726e6a80e7de487892d687105e801764: No bootstrap required, opened a new log
I20260709 12:18:22.807945 15951 raft_consensus.cc:385] T 738df617f1d34b6e974af9a8dd7b3fc4 P 6a3ac9b7a6664089a9dfff2be770ae9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:22.808255 15951 raft_consensus.cc:740] T 738df617f1d34b6e974af9a8dd7b3fc4 P 6a3ac9b7a6664089a9dfff2be770ae9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a3ac9b7a6664089a9dfff2be770ae9f, State: Initialized, Role: FOLLOWER
I20260709 12:18:22.808378 15949 ts_tablet_manager.cc:1403] T 738df617f1d34b6e974af9a8dd7b3fc4 P 726e6a80e7de487892d687105e801764: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.004s
I20260709 12:18:22.808917 15951 consensus_queue.cc:260] T 738df617f1d34b6e974af9a8dd7b3fc4 P 6a3ac9b7a6664089a9dfff2be770ae9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35231 } } peers { permanent_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 46005 } } peers { permanent_uuid: "726e6a80e7de487892d687105e801764" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33873 } }
I20260709 12:18:22.812252 15949 raft_consensus.cc:359] T 738df617f1d34b6e974af9a8dd7b3fc4 P 726e6a80e7de487892d687105e801764 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35231 } } peers { permanent_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 46005 } } peers { permanent_uuid: "726e6a80e7de487892d687105e801764" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33873 } }
I20260709 12:18:22.813202 15949 raft_consensus.cc:385] T 738df617f1d34b6e974af9a8dd7b3fc4 P 726e6a80e7de487892d687105e801764 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:22.813542 15949 raft_consensus.cc:740] T 738df617f1d34b6e974af9a8dd7b3fc4 P 726e6a80e7de487892d687105e801764 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 726e6a80e7de487892d687105e801764, State: Initialized, Role: FOLLOWER
I20260709 12:18:22.813977 15951 ts_tablet_manager.cc:1434] T 738df617f1d34b6e974af9a8dd7b3fc4 P 6a3ac9b7a6664089a9dfff2be770ae9f: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 12:18:22.814457 15949 consensus_queue.cc:260] T 738df617f1d34b6e974af9a8dd7b3fc4 P 726e6a80e7de487892d687105e801764 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35231 } } peers { permanent_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 46005 } } peers { permanent_uuid: "726e6a80e7de487892d687105e801764" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33873 } }
I20260709 12:18:22.815303 15951 tablet_bootstrap.cc:492] T ded749e8d0d744478ca19dfae96779f2 P 6a3ac9b7a6664089a9dfff2be770ae9f: Bootstrap starting.
I20260709 12:18:22.816906 15949 ts_tablet_manager.cc:1434] T 738df617f1d34b6e974af9a8dd7b3fc4 P 726e6a80e7de487892d687105e801764: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 12:18:22.819134 15949 tablet_bootstrap.cc:492] T ded749e8d0d744478ca19dfae96779f2 P 726e6a80e7de487892d687105e801764: Bootstrap starting.
I20260709 12:18:22.825359 15951 tablet_bootstrap.cc:654] T ded749e8d0d744478ca19dfae96779f2 P 6a3ac9b7a6664089a9dfff2be770ae9f: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:22.827651 15949 tablet_bootstrap.cc:654] T ded749e8d0d744478ca19dfae96779f2 P 726e6a80e7de487892d687105e801764: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:22.828090 15948 tablet_bootstrap.cc:492] T 738df617f1d34b6e974af9a8dd7b3fc4 P 7951a4e6c7b3466eb4556a6eb5fd70ef: No bootstrap required, opened a new log
I20260709 12:18:22.828771 15948 ts_tablet_manager.cc:1403] T 738df617f1d34b6e974af9a8dd7b3fc4 P 7951a4e6c7b3466eb4556a6eb5fd70ef: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.005s
I20260709 12:18:22.832366 15948 raft_consensus.cc:359] T 738df617f1d34b6e974af9a8dd7b3fc4 P 7951a4e6c7b3466eb4556a6eb5fd70ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35231 } } peers { permanent_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 46005 } } peers { permanent_uuid: "726e6a80e7de487892d687105e801764" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33873 } }
I20260709 12:18:22.833052 15948 raft_consensus.cc:385] T 738df617f1d34b6e974af9a8dd7b3fc4 P 7951a4e6c7b3466eb4556a6eb5fd70ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:22.833364 15948 raft_consensus.cc:740] T 738df617f1d34b6e974af9a8dd7b3fc4 P 7951a4e6c7b3466eb4556a6eb5fd70ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7951a4e6c7b3466eb4556a6eb5fd70ef, State: Initialized, Role: FOLLOWER
I20260709 12:18:22.834394 15949 tablet_bootstrap.cc:492] T ded749e8d0d744478ca19dfae96779f2 P 726e6a80e7de487892d687105e801764: No bootstrap required, opened a new log
I20260709 12:18:22.834168 15948 consensus_queue.cc:260] T 738df617f1d34b6e974af9a8dd7b3fc4 P 7951a4e6c7b3466eb4556a6eb5fd70ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35231 } } peers { permanent_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 46005 } } peers { permanent_uuid: "726e6a80e7de487892d687105e801764" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33873 } }
I20260709 12:18:22.834971 15949 ts_tablet_manager.cc:1403] T ded749e8d0d744478ca19dfae96779f2 P 726e6a80e7de487892d687105e801764: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.001s
I20260709 12:18:22.835127 15951 tablet_bootstrap.cc:492] T ded749e8d0d744478ca19dfae96779f2 P 6a3ac9b7a6664089a9dfff2be770ae9f: No bootstrap required, opened a new log
I20260709 12:18:22.835709 15951 ts_tablet_manager.cc:1403] T ded749e8d0d744478ca19dfae96779f2 P 6a3ac9b7a6664089a9dfff2be770ae9f: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.004s
I20260709 12:18:22.836452 15948 ts_tablet_manager.cc:1434] T 738df617f1d34b6e974af9a8dd7b3fc4 P 7951a4e6c7b3466eb4556a6eb5fd70ef: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
I20260709 12:18:22.837589 15948 tablet_bootstrap.cc:492] T ded749e8d0d744478ca19dfae96779f2 P 7951a4e6c7b3466eb4556a6eb5fd70ef: Bootstrap starting.
I20260709 12:18:22.838207 15949 raft_consensus.cc:359] T ded749e8d0d744478ca19dfae96779f2 P 726e6a80e7de487892d687105e801764 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35231 } } peers { permanent_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 46005 } } peers { permanent_uuid: "726e6a80e7de487892d687105e801764" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33873 } }
I20260709 12:18:22.838591 15951 raft_consensus.cc:359] T ded749e8d0d744478ca19dfae96779f2 P 6a3ac9b7a6664089a9dfff2be770ae9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35231 } } peers { permanent_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 46005 } } peers { permanent_uuid: "726e6a80e7de487892d687105e801764" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33873 } }
I20260709 12:18:22.838990 15949 raft_consensus.cc:385] T ded749e8d0d744478ca19dfae96779f2 P 726e6a80e7de487892d687105e801764 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:22.839322 15949 raft_consensus.cc:740] T ded749e8d0d744478ca19dfae96779f2 P 726e6a80e7de487892d687105e801764 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 726e6a80e7de487892d687105e801764, State: Initialized, Role: FOLLOWER
I20260709 12:18:22.840767 15949 consensus_queue.cc:260] T ded749e8d0d744478ca19dfae96779f2 P 726e6a80e7de487892d687105e801764 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35231 } } peers { permanent_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 46005 } } peers { permanent_uuid: "726e6a80e7de487892d687105e801764" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33873 } }
I20260709 12:18:22.843644 15949 ts_tablet_manager.cc:1434] T ded749e8d0d744478ca19dfae96779f2 P 726e6a80e7de487892d687105e801764: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.004s
I20260709 12:18:22.844857 15948 tablet_bootstrap.cc:654] T ded749e8d0d744478ca19dfae96779f2 P 7951a4e6c7b3466eb4556a6eb5fd70ef: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:22.839282 15951 raft_consensus.cc:385] T ded749e8d0d744478ca19dfae96779f2 P 6a3ac9b7a6664089a9dfff2be770ae9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:22.845892 15951 raft_consensus.cc:740] T ded749e8d0d744478ca19dfae96779f2 P 6a3ac9b7a6664089a9dfff2be770ae9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a3ac9b7a6664089a9dfff2be770ae9f, State: Initialized, Role: FOLLOWER
I20260709 12:18:22.846616 15951 consensus_queue.cc:260] T ded749e8d0d744478ca19dfae96779f2 P 6a3ac9b7a6664089a9dfff2be770ae9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35231 } } peers { permanent_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 46005 } } peers { permanent_uuid: "726e6a80e7de487892d687105e801764" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33873 } }
I20260709 12:18:22.850838 15948 tablet_bootstrap.cc:492] T ded749e8d0d744478ca19dfae96779f2 P 7951a4e6c7b3466eb4556a6eb5fd70ef: No bootstrap required, opened a new log
I20260709 12:18:22.851420 15948 ts_tablet_manager.cc:1403] T ded749e8d0d744478ca19dfae96779f2 P 7951a4e6c7b3466eb4556a6eb5fd70ef: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 12:18:22.852347 15951 ts_tablet_manager.cc:1434] T ded749e8d0d744478ca19dfae96779f2 P 6a3ac9b7a6664089a9dfff2be770ae9f: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 12:18:22.853807 15948 raft_consensus.cc:359] T ded749e8d0d744478ca19dfae96779f2 P 7951a4e6c7b3466eb4556a6eb5fd70ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35231 } } peers { permanent_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 46005 } } peers { permanent_uuid: "726e6a80e7de487892d687105e801764" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33873 } }
I20260709 12:18:22.854446 15948 raft_consensus.cc:385] T ded749e8d0d744478ca19dfae96779f2 P 7951a4e6c7b3466eb4556a6eb5fd70ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:22.854697 15948 raft_consensus.cc:740] T ded749e8d0d744478ca19dfae96779f2 P 7951a4e6c7b3466eb4556a6eb5fd70ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7951a4e6c7b3466eb4556a6eb5fd70ef, State: Initialized, Role: FOLLOWER
I20260709 12:18:22.854874 15956 raft_consensus.cc:493] T ded749e8d0d744478ca19dfae96779f2 P 6a3ac9b7a6664089a9dfff2be770ae9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.855449 15948 consensus_queue.cc:260] T ded749e8d0d744478ca19dfae96779f2 P 7951a4e6c7b3466eb4556a6eb5fd70ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35231 } } peers { permanent_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 46005 } } peers { permanent_uuid: "726e6a80e7de487892d687105e801764" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33873 } }
I20260709 12:18:22.855438 15956 raft_consensus.cc:515] T ded749e8d0d744478ca19dfae96779f2 P 6a3ac9b7a6664089a9dfff2be770ae9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35231 } } peers { permanent_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 46005 } } peers { permanent_uuid: "726e6a80e7de487892d687105e801764" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33873 } }
I20260709 12:18:22.857805 15948 ts_tablet_manager.cc:1434] T ded749e8d0d744478ca19dfae96779f2 P 7951a4e6c7b3466eb4556a6eb5fd70ef: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:18:22.858661 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded749e8d0d744478ca19dfae96779f2" candidate_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef" is_pre_election: true
I20260709 12:18:22.858914 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded749e8d0d744478ca19dfae96779f2" candidate_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "726e6a80e7de487892d687105e801764" is_pre_election: true
I20260709 12:18:22.859325 15834 raft_consensus.cc:2468] T ded749e8d0d744478ca19dfae96779f2 P 7951a4e6c7b3466eb4556a6eb5fd70ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a3ac9b7a6664089a9dfff2be770ae9f in term 0.
I20260709 12:18:22.859630 15908 raft_consensus.cc:2468] T ded749e8d0d744478ca19dfae96779f2 P 726e6a80e7de487892d687105e801764 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a3ac9b7a6664089a9dfff2be770ae9f in term 0.
I20260709 12:18:22.861852 15723 leader_election.cc:304] T ded749e8d0d744478ca19dfae96779f2 P 6a3ac9b7a6664089a9dfff2be770ae9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a3ac9b7a6664089a9dfff2be770ae9f, 726e6a80e7de487892d687105e801764; no voters: 
I20260709 12:18:22.862736 15956 leader_election.cc:290] T ded749e8d0d744478ca19dfae96779f2 P 6a3ac9b7a6664089a9dfff2be770ae9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7951a4e6c7b3466eb4556a6eb5fd70ef (127.3.212.130:46005), 726e6a80e7de487892d687105e801764 (127.3.212.131:33873)
I20260709 12:18:22.862845 15961 raft_consensus.cc:2804] T ded749e8d0d744478ca19dfae96779f2 P 6a3ac9b7a6664089a9dfff2be770ae9f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:22.863292 15961 raft_consensus.cc:493] T ded749e8d0d744478ca19dfae96779f2 P 6a3ac9b7a6664089a9dfff2be770ae9f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:22.863641 15961 raft_consensus.cc:3060] T ded749e8d0d744478ca19dfae96779f2 P 6a3ac9b7a6664089a9dfff2be770ae9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:22.871182 15961 raft_consensus.cc:515] T ded749e8d0d744478ca19dfae96779f2 P 6a3ac9b7a6664089a9dfff2be770ae9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35231 } } peers { permanent_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 46005 } } peers { permanent_uuid: "726e6a80e7de487892d687105e801764" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33873 } }
I20260709 12:18:22.872838 15961 leader_election.cc:290] T ded749e8d0d744478ca19dfae96779f2 P 6a3ac9b7a6664089a9dfff2be770ae9f [CANDIDATE]: Term 1 election: Requested vote from peers 7951a4e6c7b3466eb4556a6eb5fd70ef (127.3.212.130:46005), 726e6a80e7de487892d687105e801764 (127.3.212.131:33873)
I20260709 12:18:22.873778 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded749e8d0d744478ca19dfae96779f2" candidate_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef"
I20260709 12:18:22.873971 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded749e8d0d744478ca19dfae96779f2" candidate_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "726e6a80e7de487892d687105e801764"
I20260709 12:18:22.874364 15834 raft_consensus.cc:3060] T ded749e8d0d744478ca19dfae96779f2 P 7951a4e6c7b3466eb4556a6eb5fd70ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:22.874675 15908 raft_consensus.cc:3060] T ded749e8d0d744478ca19dfae96779f2 P 726e6a80e7de487892d687105e801764 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:22.879827 15834 raft_consensus.cc:2468] T ded749e8d0d744478ca19dfae96779f2 P 7951a4e6c7b3466eb4556a6eb5fd70ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a3ac9b7a6664089a9dfff2be770ae9f in term 1.
I20260709 12:18:22.879966 15908 raft_consensus.cc:2468] T ded749e8d0d744478ca19dfae96779f2 P 726e6a80e7de487892d687105e801764 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a3ac9b7a6664089a9dfff2be770ae9f in term 1.
I20260709 12:18:22.881188 15724 leader_election.cc:304] T ded749e8d0d744478ca19dfae96779f2 P 6a3ac9b7a6664089a9dfff2be770ae9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a3ac9b7a6664089a9dfff2be770ae9f, 7951a4e6c7b3466eb4556a6eb5fd70ef; no voters: 
I20260709 12:18:22.882498 15961 raft_consensus.cc:2804] T ded749e8d0d744478ca19dfae96779f2 P 6a3ac9b7a6664089a9dfff2be770ae9f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:22.882992 15961 raft_consensus.cc:697] T ded749e8d0d744478ca19dfae96779f2 P 6a3ac9b7a6664089a9dfff2be770ae9f [term 1 LEADER]: Becoming Leader. State: Replica: 6a3ac9b7a6664089a9dfff2be770ae9f, State: Running, Role: LEADER
I20260709 12:18:22.883731 15961 consensus_queue.cc:237] T ded749e8d0d744478ca19dfae96779f2 P 6a3ac9b7a6664089a9dfff2be770ae9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35231 } } peers { permanent_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 46005 } } peers { permanent_uuid: "726e6a80e7de487892d687105e801764" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33873 } }
I20260709 12:18:22.891661 15656 catalog_manager.cc:5697] T ded749e8d0d744478ca19dfae96779f2 P 6a3ac9b7a6664089a9dfff2be770ae9f reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a3ac9b7a6664089a9dfff2be770ae9f (127.3.212.129). New cstate: current_term: 1 leader_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 46005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "726e6a80e7de487892d687105e801764" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33873 } health_report { overall_health: UNKNOWN } } }
W20260709 12:18:22.902642 15705 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:18:22.972394 15961 consensus_queue.cc:1048] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 6a3ac9b7a6664089a9dfff2be770ae9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "726e6a80e7de487892d687105e801764" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:22.986060 15980 consensus_queue.cc:1048] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 6a3ac9b7a6664089a9dfff2be770ae9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 46005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:23.057544 15980 raft_consensus.cc:493] T 738df617f1d34b6e974af9a8dd7b3fc4 P 6a3ac9b7a6664089a9dfff2be770ae9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.058034 15980 raft_consensus.cc:515] T 738df617f1d34b6e974af9a8dd7b3fc4 P 6a3ac9b7a6664089a9dfff2be770ae9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35231 } } peers { permanent_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 46005 } } peers { permanent_uuid: "726e6a80e7de487892d687105e801764" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33873 } }
I20260709 12:18:23.059870 15980 leader_election.cc:290] T 738df617f1d34b6e974af9a8dd7b3fc4 P 6a3ac9b7a6664089a9dfff2be770ae9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7951a4e6c7b3466eb4556a6eb5fd70ef (127.3.212.130:46005), 726e6a80e7de487892d687105e801764 (127.3.212.131:33873)
I20260709 12:18:23.060835 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738df617f1d34b6e974af9a8dd7b3fc4" candidate_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef" is_pre_election: true
I20260709 12:18:23.060917 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738df617f1d34b6e974af9a8dd7b3fc4" candidate_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "726e6a80e7de487892d687105e801764" is_pre_election: true
I20260709 12:18:23.061866 15834 raft_consensus.cc:2468] T 738df617f1d34b6e974af9a8dd7b3fc4 P 7951a4e6c7b3466eb4556a6eb5fd70ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a3ac9b7a6664089a9dfff2be770ae9f in term 0.
I20260709 12:18:23.061928 15908 raft_consensus.cc:2468] T 738df617f1d34b6e974af9a8dd7b3fc4 P 726e6a80e7de487892d687105e801764 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a3ac9b7a6664089a9dfff2be770ae9f in term 0.
I20260709 12:18:23.062914 15724 leader_election.cc:304] T 738df617f1d34b6e974af9a8dd7b3fc4 P 6a3ac9b7a6664089a9dfff2be770ae9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a3ac9b7a6664089a9dfff2be770ae9f, 7951a4e6c7b3466eb4556a6eb5fd70ef; no voters: 
I20260709 12:18:23.063692 15980 raft_consensus.cc:2804] T 738df617f1d34b6e974af9a8dd7b3fc4 P 6a3ac9b7a6664089a9dfff2be770ae9f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:23.064016 15980 raft_consensus.cc:493] T 738df617f1d34b6e974af9a8dd7b3fc4 P 6a3ac9b7a6664089a9dfff2be770ae9f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:23.064292 15980 raft_consensus.cc:3060] T 738df617f1d34b6e974af9a8dd7b3fc4 P 6a3ac9b7a6664089a9dfff2be770ae9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:23.069757 15980 raft_consensus.cc:515] T 738df617f1d34b6e974af9a8dd7b3fc4 P 6a3ac9b7a6664089a9dfff2be770ae9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35231 } } peers { permanent_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 46005 } } peers { permanent_uuid: "726e6a80e7de487892d687105e801764" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33873 } }
I20260709 12:18:23.071398 15980 leader_election.cc:290] T 738df617f1d34b6e974af9a8dd7b3fc4 P 6a3ac9b7a6664089a9dfff2be770ae9f [CANDIDATE]: Term 1 election: Requested vote from peers 7951a4e6c7b3466eb4556a6eb5fd70ef (127.3.212.130:46005), 726e6a80e7de487892d687105e801764 (127.3.212.131:33873)
I20260709 12:18:23.072403 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738df617f1d34b6e974af9a8dd7b3fc4" candidate_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef"
I20260709 12:18:23.072649 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738df617f1d34b6e974af9a8dd7b3fc4" candidate_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "726e6a80e7de487892d687105e801764"
I20260709 12:18:23.073128 15834 raft_consensus.cc:3060] T 738df617f1d34b6e974af9a8dd7b3fc4 P 7951a4e6c7b3466eb4556a6eb5fd70ef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:23.073241 15908 raft_consensus.cc:3060] T 738df617f1d34b6e974af9a8dd7b3fc4 P 726e6a80e7de487892d687105e801764 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:23.080925 15908 raft_consensus.cc:2468] T 738df617f1d34b6e974af9a8dd7b3fc4 P 726e6a80e7de487892d687105e801764 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a3ac9b7a6664089a9dfff2be770ae9f in term 1.
I20260709 12:18:23.080925 15834 raft_consensus.cc:2468] T 738df617f1d34b6e974af9a8dd7b3fc4 P 7951a4e6c7b3466eb4556a6eb5fd70ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a3ac9b7a6664089a9dfff2be770ae9f in term 1.
I20260709 12:18:23.082363 15723 leader_election.cc:304] T 738df617f1d34b6e974af9a8dd7b3fc4 P 6a3ac9b7a6664089a9dfff2be770ae9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a3ac9b7a6664089a9dfff2be770ae9f, 726e6a80e7de487892d687105e801764; no voters: 
I20260709 12:18:23.083072 15980 raft_consensus.cc:2804] T 738df617f1d34b6e974af9a8dd7b3fc4 P 6a3ac9b7a6664089a9dfff2be770ae9f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:23.083585 15980 raft_consensus.cc:697] T 738df617f1d34b6e974af9a8dd7b3fc4 P 6a3ac9b7a6664089a9dfff2be770ae9f [term 1 LEADER]: Becoming Leader. State: Replica: 6a3ac9b7a6664089a9dfff2be770ae9f, State: Running, Role: LEADER
I20260709 12:18:23.084338 15980 consensus_queue.cc:237] T 738df617f1d34b6e974af9a8dd7b3fc4 P 6a3ac9b7a6664089a9dfff2be770ae9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35231 } } peers { permanent_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 46005 } } peers { permanent_uuid: "726e6a80e7de487892d687105e801764" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33873 } }
I20260709 12:18:23.092792 15655 catalog_manager.cc:5697] T 738df617f1d34b6e974af9a8dd7b3fc4 P 6a3ac9b7a6664089a9dfff2be770ae9f reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a3ac9b7a6664089a9dfff2be770ae9f (127.3.212.129). New cstate: current_term: 1 leader_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 46005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "726e6a80e7de487892d687105e801764" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33873 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:23.168751 15952 consensus_queue.cc:1048] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 726e6a80e7de487892d687105e801764 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 46005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:23.171679 15952 consensus_queue.cc:1048] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 726e6a80e7de487892d687105e801764 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:23.203146  3922 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 12:18:23.204731  3922 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 12:18:23.205123  3922 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 12:18:23.217710 15759 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ded749e8d0d744478ca19dfae96779f2"
dest_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f"
mode: GRACEFUL
new_leader_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef"
 from {username='slave'} at 127.0.0.1:59970
I20260709 12:18:23.218372 15759 raft_consensus.cc:606] T ded749e8d0d744478ca19dfae96779f2 P 6a3ac9b7a6664089a9dfff2be770ae9f [term 1 LEADER]: Received request to transfer leadership to TS 7951a4e6c7b3466eb4556a6eb5fd70ef
I20260709 12:18:23.219491  3922 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 12:18:23.282047 15980 consensus_queue.cc:1048] T ded749e8d0d744478ca19dfae96779f2 P 6a3ac9b7a6664089a9dfff2be770ae9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 46005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:23.290014 15961 raft_consensus.cc:993] T ded749e8d0d744478ca19dfae96779f2 P 6a3ac9b7a6664089a9dfff2be770ae9f: : Instructing follower 7951a4e6c7b3466eb4556a6eb5fd70ef to start an election
I20260709 12:18:23.290524 15956 raft_consensus.cc:1081] T ded749e8d0d744478ca19dfae96779f2 P 6a3ac9b7a6664089a9dfff2be770ae9f [term 1 LEADER]: Signalling peer 7951a4e6c7b3466eb4556a6eb5fd70ef to start an election
I20260709 12:18:23.292443 15833 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ded749e8d0d744478ca19dfae96779f2"
dest_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef"
 from {username='slave'} at 127.0.0.1:51876
I20260709 12:18:23.293401 15833 raft_consensus.cc:493] T ded749e8d0d744478ca19dfae96779f2 P 7951a4e6c7b3466eb4556a6eb5fd70ef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:23.293814 15833 raft_consensus.cc:3060] T ded749e8d0d744478ca19dfae96779f2 P 7951a4e6c7b3466eb4556a6eb5fd70ef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:23.299805 15961 consensus_queue.cc:1048] T ded749e8d0d744478ca19dfae96779f2 P 6a3ac9b7a6664089a9dfff2be770ae9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "726e6a80e7de487892d687105e801764" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:23.303056 15833 raft_consensus.cc:515] T ded749e8d0d744478ca19dfae96779f2 P 7951a4e6c7b3466eb4556a6eb5fd70ef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35231 } } peers { permanent_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 46005 } } peers { permanent_uuid: "726e6a80e7de487892d687105e801764" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33873 } }
I20260709 12:18:23.312270 15833 leader_election.cc:290] T ded749e8d0d744478ca19dfae96779f2 P 7951a4e6c7b3466eb4556a6eb5fd70ef [CANDIDATE]: Term 2 election: Requested vote from peers 6a3ac9b7a6664089a9dfff2be770ae9f (127.3.212.129:35231), 726e6a80e7de487892d687105e801764 (127.3.212.131:33873)
I20260709 12:18:23.324903 15759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded749e8d0d744478ca19dfae96779f2" candidate_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f"
I20260709 12:18:23.325636 15759 raft_consensus.cc:3055] T ded749e8d0d744478ca19dfae96779f2 P 6a3ac9b7a6664089a9dfff2be770ae9f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:23.325995 15759 raft_consensus.cc:740] T ded749e8d0d744478ca19dfae96779f2 P 6a3ac9b7a6664089a9dfff2be770ae9f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6a3ac9b7a6664089a9dfff2be770ae9f, State: Running, Role: LEADER
I20260709 12:18:23.326900 15759 consensus_queue.cc:260] T ded749e8d0d744478ca19dfae96779f2 P 6a3ac9b7a6664089a9dfff2be770ae9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35231 } } peers { permanent_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 46005 } } peers { permanent_uuid: "726e6a80e7de487892d687105e801764" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33873 } }
I20260709 12:18:23.327457 15908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ded749e8d0d744478ca19dfae96779f2" candidate_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "726e6a80e7de487892d687105e801764"
I20260709 12:18:23.328076 15759 raft_consensus.cc:3060] T ded749e8d0d744478ca19dfae96779f2 P 6a3ac9b7a6664089a9dfff2be770ae9f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:23.328088 15908 raft_consensus.cc:3060] T ded749e8d0d744478ca19dfae96779f2 P 726e6a80e7de487892d687105e801764 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:23.333279 15759 raft_consensus.cc:2468] T ded749e8d0d744478ca19dfae96779f2 P 6a3ac9b7a6664089a9dfff2be770ae9f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7951a4e6c7b3466eb4556a6eb5fd70ef in term 2.
I20260709 12:18:23.333473 15908 raft_consensus.cc:2468] T ded749e8d0d744478ca19dfae96779f2 P 726e6a80e7de487892d687105e801764 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7951a4e6c7b3466eb4556a6eb5fd70ef in term 2.
I20260709 12:18:23.334482 15800 leader_election.cc:304] T ded749e8d0d744478ca19dfae96779f2 P 7951a4e6c7b3466eb4556a6eb5fd70ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a3ac9b7a6664089a9dfff2be770ae9f, 7951a4e6c7b3466eb4556a6eb5fd70ef; no voters: 
I20260709 12:18:23.335336 15957 raft_consensus.cc:2804] T ded749e8d0d744478ca19dfae96779f2 P 7951a4e6c7b3466eb4556a6eb5fd70ef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:23.336234 15957 raft_consensus.cc:697] T ded749e8d0d744478ca19dfae96779f2 P 7951a4e6c7b3466eb4556a6eb5fd70ef [term 2 LEADER]: Becoming Leader. State: Replica: 7951a4e6c7b3466eb4556a6eb5fd70ef, State: Running, Role: LEADER
I20260709 12:18:23.336951 15957 consensus_queue.cc:237] T ded749e8d0d744478ca19dfae96779f2 P 7951a4e6c7b3466eb4556a6eb5fd70ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35231 } } peers { permanent_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 46005 } } peers { permanent_uuid: "726e6a80e7de487892d687105e801764" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33873 } }
I20260709 12:18:23.343072 15655 catalog_manager.cc:5697] T ded749e8d0d744478ca19dfae96779f2 P 7951a4e6c7b3466eb4556a6eb5fd70ef reported cstate change: term changed from 1 to 2, leader changed from 6a3ac9b7a6664089a9dfff2be770ae9f (127.3.212.129) to 7951a4e6c7b3466eb4556a6eb5fd70ef (127.3.212.130). New cstate: current_term: 2 leader_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3ac9b7a6664089a9dfff2be770ae9f" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 35231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7951a4e6c7b3466eb4556a6eb5fd70ef" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 46005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "726e6a80e7de487892d687105e801764" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 33873 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:23.369069  3922 tablet_server.cc:179] TabletServer@127.3.212.129:0 shutting down...
I20260709 12:18:23.392987  3922 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:18:23.393715  3922 tablet_replica.cc:333] T ded749e8d0d744478ca19dfae96779f2 P 6a3ac9b7a6664089a9dfff2be770ae9f: stopping tablet replica
I20260709 12:18:23.394342  3922 raft_consensus.cc:2243] T ded749e8d0d744478ca19dfae96779f2 P 6a3ac9b7a6664089a9dfff2be770ae9f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:23.394863  3922 raft_consensus.cc:2272] T ded749e8d0d744478ca19dfae96779f2 P 6a3ac9b7a6664089a9dfff2be770ae9f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:23.397131  3922 tablet_replica.cc:333] T 738df617f1d34b6e974af9a8dd7b3fc4 P 6a3ac9b7a6664089a9dfff2be770ae9f: stopping tablet replica
I20260709 12:18:23.397723  3922 raft_consensus.cc:2243] T 738df617f1d34b6e974af9a8dd7b3fc4 P 6a3ac9b7a6664089a9dfff2be770ae9f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:23.398310  3922 pending_rounds.cc:70] T 738df617f1d34b6e974af9a8dd7b3fc4 P 6a3ac9b7a6664089a9dfff2be770ae9f: Trying to abort 1 pending ops.
I20260709 12:18:23.398468  3922 pending_rounds.cc:77] T 738df617f1d34b6e974af9a8dd7b3fc4 P 6a3ac9b7a6664089a9dfff2be770ae9f: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305623564641177600 op_type: NO_OP noop_request { }
I20260709 12:18:23.398725  3922 raft_consensus.cc:2889] T 738df617f1d34b6e974af9a8dd7b3fc4 P 6a3ac9b7a6664089a9dfff2be770ae9f [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:18:23.398948  3922 raft_consensus.cc:2272] T 738df617f1d34b6e974af9a8dd7b3fc4 P 6a3ac9b7a6664089a9dfff2be770ae9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:23.401140  3922 tablet_replica.cc:333] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 6a3ac9b7a6664089a9dfff2be770ae9f: stopping tablet replica
I20260709 12:18:23.401834  3922 raft_consensus.cc:2243] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 6a3ac9b7a6664089a9dfff2be770ae9f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:23.402269  3922 raft_consensus.cc:2272] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 6a3ac9b7a6664089a9dfff2be770ae9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:23.404531  3922 tablet_replica.cc:333] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 6a3ac9b7a6664089a9dfff2be770ae9f: stopping tablet replica
I20260709 12:18:23.404999  3922 raft_consensus.cc:2243] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 6a3ac9b7a6664089a9dfff2be770ae9f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:23.405818  3922 raft_consensus.cc:2272] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 6a3ac9b7a6664089a9dfff2be770ae9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:23.430156  3922 tablet_server.cc:196] TabletServer@127.3.212.129:0 shutdown complete.
I20260709 12:18:23.442476  3922 tablet_server.cc:179] TabletServer@127.3.212.130:0 shutting down...
I20260709 12:18:23.460026  3922 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:18:23.460840  3922 tablet_replica.cc:333] T ded749e8d0d744478ca19dfae96779f2 P 7951a4e6c7b3466eb4556a6eb5fd70ef: stopping tablet replica
I20260709 12:18:23.461511  3922 raft_consensus.cc:2243] T ded749e8d0d744478ca19dfae96779f2 P 7951a4e6c7b3466eb4556a6eb5fd70ef [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:23.462152  3922 pending_rounds.cc:70] T ded749e8d0d744478ca19dfae96779f2 P 7951a4e6c7b3466eb4556a6eb5fd70ef: Trying to abort 1 pending ops.
I20260709 12:18:23.462332  3922 pending_rounds.cc:77] T ded749e8d0d744478ca19dfae96779f2 P 7951a4e6c7b3466eb4556a6eb5fd70ef: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305623565675016192 op_type: NO_OP noop_request { }
I20260709 12:18:23.462591  3922 raft_consensus.cc:2889] T ded749e8d0d744478ca19dfae96779f2 P 7951a4e6c7b3466eb4556a6eb5fd70ef [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:18:23.462862  3922 raft_consensus.cc:2272] T ded749e8d0d744478ca19dfae96779f2 P 7951a4e6c7b3466eb4556a6eb5fd70ef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:23.465216  3922 tablet_replica.cc:333] T 738df617f1d34b6e974af9a8dd7b3fc4 P 7951a4e6c7b3466eb4556a6eb5fd70ef: stopping tablet replica
I20260709 12:18:23.465816  3922 raft_consensus.cc:2243] T 738df617f1d34b6e974af9a8dd7b3fc4 P 7951a4e6c7b3466eb4556a6eb5fd70ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:23.466208  3922 raft_consensus.cc:2272] T 738df617f1d34b6e974af9a8dd7b3fc4 P 7951a4e6c7b3466eb4556a6eb5fd70ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:23.468060  3922 tablet_replica.cc:333] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 7951a4e6c7b3466eb4556a6eb5fd70ef: stopping tablet replica
I20260709 12:18:23.468577  3922 raft_consensus.cc:2243] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 7951a4e6c7b3466eb4556a6eb5fd70ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:23.469044  3922 raft_consensus.cc:2272] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 7951a4e6c7b3466eb4556a6eb5fd70ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:23.471520  3922 tablet_replica.cc:333] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 7951a4e6c7b3466eb4556a6eb5fd70ef: stopping tablet replica
I20260709 12:18:23.472070  3922 raft_consensus.cc:2243] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 7951a4e6c7b3466eb4556a6eb5fd70ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:23.472502  3922 raft_consensus.cc:2272] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 7951a4e6c7b3466eb4556a6eb5fd70ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:23.496209  3922 tablet_server.cc:196] TabletServer@127.3.212.130:0 shutdown complete.
I20260709 12:18:23.508510  3922 tablet_server.cc:179] TabletServer@127.3.212.131:0 shutting down...
I20260709 12:18:23.525344  3922 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:18:23.526098  3922 tablet_replica.cc:333] T ded749e8d0d744478ca19dfae96779f2 P 726e6a80e7de487892d687105e801764: stopping tablet replica
I20260709 12:18:23.526696  3922 raft_consensus.cc:2243] T ded749e8d0d744478ca19dfae96779f2 P 726e6a80e7de487892d687105e801764 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:23.527137  3922 raft_consensus.cc:2272] T ded749e8d0d744478ca19dfae96779f2 P 726e6a80e7de487892d687105e801764 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:23.529343  3922 tablet_replica.cc:333] T 738df617f1d34b6e974af9a8dd7b3fc4 P 726e6a80e7de487892d687105e801764: stopping tablet replica
I20260709 12:18:23.529902  3922 raft_consensus.cc:2243] T 738df617f1d34b6e974af9a8dd7b3fc4 P 726e6a80e7de487892d687105e801764 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:23.530282  3922 raft_consensus.cc:2272] T 738df617f1d34b6e974af9a8dd7b3fc4 P 726e6a80e7de487892d687105e801764 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:23.531992  3922 tablet_replica.cc:333] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 726e6a80e7de487892d687105e801764: stopping tablet replica
I20260709 12:18:23.532471  3922 raft_consensus.cc:2243] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 726e6a80e7de487892d687105e801764 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:23.533213  3922 raft_consensus.cc:2272] T cfbf335a1b2d4dc5b82b7e9e2e809fa5 P 726e6a80e7de487892d687105e801764 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:23.535458  3922 tablet_replica.cc:333] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 726e6a80e7de487892d687105e801764: stopping tablet replica
I20260709 12:18:23.535923  3922 raft_consensus.cc:2243] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 726e6a80e7de487892d687105e801764 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:23.536310  3922 raft_consensus.cc:2272] T a045569ee1ba41aa8f1cb7fd32e8cf2e P 726e6a80e7de487892d687105e801764 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:23.559944  3922 tablet_server.cc:196] TabletServer@127.3.212.131:0 shutdown complete.
I20260709 12:18:23.572715  3922 master.cc:562] Master@127.3.212.190:37053 shutting down...
I20260709 12:18:23.590018  3922 raft_consensus.cc:2243] T 00000000000000000000000000000000 P bd55d2ec2fcf4814b51fc6b0aa0b7519 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:23.590615  3922 raft_consensus.cc:2272] T 00000000000000000000000000000000 P bd55d2ec2fcf4814b51fc6b0aa0b7519 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:23.591027  3922 tablet_replica.cc:333] T 00000000000000000000000000000000 P bd55d2ec2fcf4814b51fc6b0aa0b7519: stopping tablet replica
I20260709 12:18:23.610179  3922 master.cc:584] Master@127.3.212.190:37053 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (1890 ms)
[----------] 6 tests from LeaderRebalancerTest (399702 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 12:18:23.638537  3922 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.212.190:42735
I20260709 12:18:23.639663  3922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:23.645670 15997 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:23.645968 15998 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:23.646631 16000 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:23.648655  3922 server_base.cc:1061] running on GCE node
I20260709 12:18:23.649649  3922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:23.649850  3922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:23.650002  3922 hybrid_clock.cc:648] HybridClock initialized: now 1783599503649988 us; error 0 us; skew 500 ppm
I20260709 12:18:23.650557  3922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:23.653245  3922 webserver.cc:533] Webserver started at http://127.3.212.190:40269/ using document root <none> and password file <none>
I20260709 12:18:23.653801  3922 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:23.653970  3922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:23.654230  3922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:23.655405  3922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599103767690-3922-0/minicluster-data/master-0-root/instance:
uuid: "c9919d343bce47aea8d50591a147abca"
format_stamp: "Formatted at 2026-07-09 12:18:23 on dist-test-slave-442x"
I20260709 12:18:23.660143  3922 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:18:23.664065 16005 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:23.664932  3922 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:18:23.665202  3922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599103767690-3922-0/minicluster-data/master-0-root
uuid: "c9919d343bce47aea8d50591a147abca"
format_stamp: "Formatted at 2026-07-09 12:18:23 on dist-test-slave-442x"
I20260709 12:18:23.665537  3922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599103767690-3922-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599103767690-3922-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599103767690-3922-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:23.678086  3922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:23.679121  3922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:23.715929  3922 rpc_server.cc:307] RPC server started. Bound to: 127.3.212.190:42735
I20260709 12:18:23.716022 16056 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.212.190:42735 every 8 connection(s)
I20260709 12:18:23.719931 16057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:23.731837 16057 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9919d343bce47aea8d50591a147abca: Bootstrap starting.
I20260709 12:18:23.736528 16057 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c9919d343bce47aea8d50591a147abca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:23.740953 16057 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9919d343bce47aea8d50591a147abca: No bootstrap required, opened a new log
I20260709 12:18:23.743238 16057 raft_consensus.cc:359] T 00000000000000000000000000000000 P c9919d343bce47aea8d50591a147abca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9919d343bce47aea8d50591a147abca" member_type: VOTER }
I20260709 12:18:23.743687 16057 raft_consensus.cc:385] T 00000000000000000000000000000000 P c9919d343bce47aea8d50591a147abca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:23.743940 16057 raft_consensus.cc:740] T 00000000000000000000000000000000 P c9919d343bce47aea8d50591a147abca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9919d343bce47aea8d50591a147abca, State: Initialized, Role: FOLLOWER
I20260709 12:18:23.744606 16057 consensus_queue.cc:260] T 00000000000000000000000000000000 P c9919d343bce47aea8d50591a147abca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9919d343bce47aea8d50591a147abca" member_type: VOTER }
I20260709 12:18:23.745090 16057 raft_consensus.cc:399] T 00000000000000000000000000000000 P c9919d343bce47aea8d50591a147abca [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:18:23.745340 16057 raft_consensus.cc:493] T 00000000000000000000000000000000 P c9919d343bce47aea8d50591a147abca [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:18:23.745620 16057 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c9919d343bce47aea8d50591a147abca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:23.750808 16057 raft_consensus.cc:515] T 00000000000000000000000000000000 P c9919d343bce47aea8d50591a147abca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9919d343bce47aea8d50591a147abca" member_type: VOTER }
I20260709 12:18:23.751586 16057 leader_election.cc:304] T 00000000000000000000000000000000 P c9919d343bce47aea8d50591a147abca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c9919d343bce47aea8d50591a147abca; no voters: 
I20260709 12:18:23.752885 16057 leader_election.cc:290] T 00000000000000000000000000000000 P c9919d343bce47aea8d50591a147abca [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:18:23.753214 16060 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c9919d343bce47aea8d50591a147abca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:23.754597 16060 raft_consensus.cc:697] T 00000000000000000000000000000000 P c9919d343bce47aea8d50591a147abca [term 1 LEADER]: Becoming Leader. State: Replica: c9919d343bce47aea8d50591a147abca, State: Running, Role: LEADER
I20260709 12:18:23.755317 16060 consensus_queue.cc:237] T 00000000000000000000000000000000 P c9919d343bce47aea8d50591a147abca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9919d343bce47aea8d50591a147abca" member_type: VOTER }
I20260709 12:18:23.755811 16057 sys_catalog.cc:565] T 00000000000000000000000000000000 P c9919d343bce47aea8d50591a147abca [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:18:23.758147 16061 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9919d343bce47aea8d50591a147abca [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c9919d343bce47aea8d50591a147abca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9919d343bce47aea8d50591a147abca" member_type: VOTER } }
I20260709 12:18:23.758162 16062 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9919d343bce47aea8d50591a147abca [sys.catalog]: SysCatalogTable state changed. Reason: New leader c9919d343bce47aea8d50591a147abca. Latest consensus state: current_term: 1 leader_uuid: "c9919d343bce47aea8d50591a147abca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9919d343bce47aea8d50591a147abca" member_type: VOTER } }
I20260709 12:18:23.758919 16061 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9919d343bce47aea8d50591a147abca [sys.catalog]: This master's current role is: LEADER
I20260709 12:18:23.758999 16062 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9919d343bce47aea8d50591a147abca [sys.catalog]: This master's current role is: LEADER
I20260709 12:18:23.762838 16065 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:18:23.770808 16065 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:18:23.775852  3922 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:18:23.782064 16065 catalog_manager.cc:1383] Generated new cluster ID: 637f5c16f8814f9ea1f3727d914f6f86
I20260709 12:18:23.782457 16065 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:18:23.804181 16065 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:18:23.805682 16065 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:18:23.818056 16065 catalog_manager.cc:6070] T 00000000000000000000000000000000 P c9919d343bce47aea8d50591a147abca: Generated new TSK 0
I20260709 12:18:23.818763 16065 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:18:23.843226  3922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:23.849695 16078 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:23.850250 16079 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:23.853757 16081 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:23.854526  3922 server_base.cc:1061] running on GCE node
I20260709 12:18:23.855559  3922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:23.855755  3922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:23.855919  3922 hybrid_clock.cc:648] HybridClock initialized: now 1783599503855899 us; error 0 us; skew 500 ppm
I20260709 12:18:23.856470  3922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:23.859018  3922 webserver.cc:533] Webserver started at http://127.3.212.129:44983/ using document root <none> and password file <none>
I20260709 12:18:23.859498  3922 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:23.859669  3922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:23.859935  3922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:23.861084  3922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599103767690-3922-0/minicluster-data/ts-0-root/instance:
uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8"
format_stamp: "Formatted at 2026-07-09 12:18:23 on dist-test-slave-442x"
I20260709 12:18:23.865626  3922 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:18:23.869938 16086 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:23.870812  3922 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:18:23.871097  3922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599103767690-3922-0/minicluster-data/ts-0-root
uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8"
format_stamp: "Formatted at 2026-07-09 12:18:23 on dist-test-slave-442x"
I20260709 12:18:23.871373  3922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599103767690-3922-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599103767690-3922-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599103767690-3922-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:23.898797  3922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:23.899950  3922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:23.901420  3922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:18:23.903591  3922 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:18:23.903779  3922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:23.904031  3922 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:18:23.904178  3922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:23.943544  3922 rpc_server.cc:307] RPC server started. Bound to: 127.3.212.129:37467
I20260709 12:18:23.943677 16148 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.212.129:37467 every 8 connection(s)
I20260709 12:18:23.948485  3922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:23.955348 16153 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:23.956342 16154 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:23.959424 16157 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:23.960001  3922 server_base.cc:1061] running on GCE node
I20260709 12:18:23.961076 16149 heartbeater.cc:344] Connected to a master server at 127.3.212.190:42735
I20260709 12:18:23.961463  3922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:18:23.961544 16149 heartbeater.cc:461] Registering TS with master...
W20260709 12:18:23.961722  3922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:23.961947  3922 hybrid_clock.cc:648] HybridClock initialized: now 1783599503961930 us; error 0 us; skew 500 ppm
I20260709 12:18:23.962481 16149 heartbeater.cc:507] Master 127.3.212.190:42735 requested a full tablet report, sending...
I20260709 12:18:23.962568  3922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:23.965029 16022 ts_manager.cc:194] Registered new tserver with Master: d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467)
I20260709 12:18:23.965595  3922 webserver.cc:533] Webserver started at http://127.3.212.130:37181/ using document root <none> and password file <none>
I20260709 12:18:23.966295  3922 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:23.966537  3922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:23.966864  3922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:23.967494 16022 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54162
I20260709 12:18:23.968498  3922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599103767690-3922-0/minicluster-data/ts-1-root/instance:
uuid: "b61c58ed04b046d48634e2172dc45851"
format_stamp: "Formatted at 2026-07-09 12:18:23 on dist-test-slave-442x"
I20260709 12:18:23.973145  3922 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.003s
I20260709 12:18:23.976768 16161 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:23.977700  3922 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:18:23.978008  3922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599103767690-3922-0/minicluster-data/ts-1-root
uuid: "b61c58ed04b046d48634e2172dc45851"
format_stamp: "Formatted at 2026-07-09 12:18:23 on dist-test-slave-442x"
I20260709 12:18:23.978305  3922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599103767690-3922-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599103767690-3922-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599103767690-3922-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:23.999372  3922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:24.000514  3922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:24.002128  3922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:18:24.004376  3922 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:18:24.004572  3922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:24.004801  3922 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:18:24.005136  3922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:24.044853  3922 rpc_server.cc:307] RPC server started. Bound to: 127.3.212.130:35005
I20260709 12:18:24.044947 16223 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.212.130:35005 every 8 connection(s)
I20260709 12:18:24.049819  3922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:24.056694 16227 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:24.058974 16228 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:24.060756 16230 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:24.061717  3922 server_base.cc:1061] running on GCE node
I20260709 12:18:24.062788  3922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:24.063066  3922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:24.063280  3922 hybrid_clock.cc:648] HybridClock initialized: now 1783599504063261 us; error 0 us; skew 500 ppm
I20260709 12:18:24.063313 16224 heartbeater.cc:344] Connected to a master server at 127.3.212.190:42735
I20260709 12:18:24.063733 16224 heartbeater.cc:461] Registering TS with master...
I20260709 12:18:24.063871  3922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:24.064647 16224 heartbeater.cc:507] Master 127.3.212.190:42735 requested a full tablet report, sending...
I20260709 12:18:24.066756  3922 webserver.cc:533] Webserver started at http://127.3.212.131:41057/ using document root <none> and password file <none>
I20260709 12:18:24.067370  3922 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:24.067242 16022 ts_manager.cc:194] Registered new tserver with Master: b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
I20260709 12:18:24.067749  3922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:24.068076  3922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:24.069109 16022 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54164
I20260709 12:18:24.069257  3922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599103767690-3922-0/minicluster-data/ts-2-root/instance:
uuid: "ce8113a88cac4c138552565af6c645ca"
format_stamp: "Formatted at 2026-07-09 12:18:24 on dist-test-slave-442x"
I20260709 12:18:24.074234  3922 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 12:18:24.077970 16235 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:24.078893  3922 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 12:18:24.079197  3922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599103767690-3922-0/minicluster-data/ts-2-root
uuid: "ce8113a88cac4c138552565af6c645ca"
format_stamp: "Formatted at 2026-07-09 12:18:24 on dist-test-slave-442x"
I20260709 12:18:24.079460  3922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599103767690-3922-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599103767690-3922-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599103767690-3922-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:24.090377  3922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:24.091590  3922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:24.093046  3922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:18:24.095414  3922 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:18:24.095633  3922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:24.095856  3922 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:18:24.096014  3922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:24.139150  3922 rpc_server.cc:307] RPC server started. Bound to: 127.3.212.131:45363
I20260709 12:18:24.139348 16297 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.212.131:45363 every 8 connection(s)
I20260709 12:18:24.154506 16298 heartbeater.cc:344] Connected to a master server at 127.3.212.190:42735
I20260709 12:18:24.154964 16298 heartbeater.cc:461] Registering TS with master...
I20260709 12:18:24.155699 16298 heartbeater.cc:507] Master 127.3.212.190:42735 requested a full tablet report, sending...
I20260709 12:18:24.158002 16022 ts_manager.cc:194] Registered new tserver with Master: ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:24.158181  3922 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015921139s
I20260709 12:18:24.160055 16022 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54166
I20260709 12:18:24.185518 16022 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54180:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:18:24.188299 16022 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:18:24.250432 16263 tablet_service.cc:1511] Processing CreateTablet for tablet 58fbda1848e042e5b821d2c689411fe7 (DEFAULT_TABLE table=test-workload [id=9c534eba40174f1e8483dbbcdee25296]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:18:24.251838 16263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58fbda1848e042e5b821d2c689411fe7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.260778 16262 tablet_service.cc:1511] Processing CreateTablet for tablet 554db18677e043199032d1d23ff3ac7d (DEFAULT_TABLE table=test-workload [id=9c534eba40174f1e8483dbbcdee25296]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:18:24.262389 16262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 554db18677e043199032d1d23ff3ac7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.267642 16261 tablet_service.cc:1511] Processing CreateTablet for tablet 3a632db0115e4b18a7e169bdf6d970ed (DEFAULT_TABLE table=test-workload [id=9c534eba40174f1e8483dbbcdee25296]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:18:24.268121 16188 tablet_service.cc:1511] Processing CreateTablet for tablet 554db18677e043199032d1d23ff3ac7d (DEFAULT_TABLE table=test-workload [id=9c534eba40174f1e8483dbbcdee25296]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:18:24.268690 16189 tablet_service.cc:1511] Processing CreateTablet for tablet 58fbda1848e042e5b821d2c689411fe7 (DEFAULT_TABLE table=test-workload [id=9c534eba40174f1e8483dbbcdee25296]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:18:24.269500 16188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 554db18677e043199032d1d23ff3ac7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.269412 16261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a632db0115e4b18a7e169bdf6d970ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.270385 16189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58fbda1848e042e5b821d2c689411fe7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.271572 16187 tablet_service.cc:1511] Processing CreateTablet for tablet 3a632db0115e4b18a7e169bdf6d970ed (DEFAULT_TABLE table=test-workload [id=9c534eba40174f1e8483dbbcdee25296]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:18:24.273018 16187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a632db0115e4b18a7e169bdf6d970ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.275915 16186 tablet_service.cc:1511] Processing CreateTablet for tablet cf4d45c1d3754356973b60c803375a36 (DEFAULT_TABLE table=test-workload [id=9c534eba40174f1e8483dbbcdee25296]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:18:24.277671 16186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf4d45c1d3754356973b60c803375a36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.279919 16185 tablet_service.cc:1511] Processing CreateTablet for tablet 62f91e00d01e497d9eda72bf862ce090 (DEFAULT_TABLE table=test-workload [id=9c534eba40174f1e8483dbbcdee25296]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:18:24.283025 16260 tablet_service.cc:1511] Processing CreateTablet for tablet cf4d45c1d3754356973b60c803375a36 (DEFAULT_TABLE table=test-workload [id=9c534eba40174f1e8483dbbcdee25296]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:18:24.284590 16260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf4d45c1d3754356973b60c803375a36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.286496 16184 tablet_service.cc:1511] Processing CreateTablet for tablet 6725f36431fc4b0fa0f740b0d8e8f7d9 (DEFAULT_TABLE table=test-workload [id=9c534eba40174f1e8483dbbcdee25296]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:18:24.293154 16183 tablet_service.cc:1511] Processing CreateTablet for tablet dbb55848f9c040ac9db9b7849e2a0d8a (DEFAULT_TABLE table=test-workload [id=9c534eba40174f1e8483dbbcdee25296]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:18:24.295197 16114 tablet_service.cc:1511] Processing CreateTablet for tablet 58fbda1848e042e5b821d2c689411fe7 (DEFAULT_TABLE table=test-workload [id=9c534eba40174f1e8483dbbcdee25296]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:18:24.296661 16114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58fbda1848e042e5b821d2c689411fe7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.298309 16258 tablet_service.cc:1511] Processing CreateTablet for tablet 6725f36431fc4b0fa0f740b0d8e8f7d9 (DEFAULT_TABLE table=test-workload [id=9c534eba40174f1e8483dbbcdee25296]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:18:24.299856 16258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6725f36431fc4b0fa0f740b0d8e8f7d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.301182 16111 tablet_service.cc:1511] Processing CreateTablet for tablet cf4d45c1d3754356973b60c803375a36 (DEFAULT_TABLE table=test-workload [id=9c534eba40174f1e8483dbbcdee25296]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:18:24.302690 16111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf4d45c1d3754356973b60c803375a36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.302469 16182 tablet_service.cc:1511] Processing CreateTablet for tablet ce427f23372c4482b0d022f844b46d32 (DEFAULT_TABLE table=test-workload [id=9c534eba40174f1e8483dbbcdee25296]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:18:24.296130 16259 tablet_service.cc:1511] Processing CreateTablet for tablet 62f91e00d01e497d9eda72bf862ce090 (DEFAULT_TABLE table=test-workload [id=9c534eba40174f1e8483dbbcdee25296]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:18:24.306555 16110 tablet_service.cc:1511] Processing CreateTablet for tablet 62f91e00d01e497d9eda72bf862ce090 (DEFAULT_TABLE table=test-workload [id=9c534eba40174f1e8483dbbcdee25296]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:18:24.307200 16259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62f91e00d01e497d9eda72bf862ce090. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.308539 16109 tablet_service.cc:1511] Processing CreateTablet for tablet 6725f36431fc4b0fa0f740b0d8e8f7d9 (DEFAULT_TABLE table=test-workload [id=9c534eba40174f1e8483dbbcdee25296]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:18:24.309561 16110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62f91e00d01e497d9eda72bf862ce090. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.310348 16109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6725f36431fc4b0fa0f740b0d8e8f7d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.310554 16181 tablet_service.cc:1511] Processing CreateTablet for tablet 08fa442667044198b448f66ee7350935 (DEFAULT_TABLE table=test-workload [id=9c534eba40174f1e8483dbbcdee25296]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:18:24.298381 16113 tablet_service.cc:1511] Processing CreateTablet for tablet 554db18677e043199032d1d23ff3ac7d (DEFAULT_TABLE table=test-workload [id=9c534eba40174f1e8483dbbcdee25296]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:18:24.314181 16113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 554db18677e043199032d1d23ff3ac7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.299476 16112 tablet_service.cc:1511] Processing CreateTablet for tablet 3a632db0115e4b18a7e169bdf6d970ed (DEFAULT_TABLE table=test-workload [id=9c534eba40174f1e8483dbbcdee25296]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:18:24.317829 16185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62f91e00d01e497d9eda72bf862ce090. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.318382 16112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a632db0115e4b18a7e169bdf6d970ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.318058 16256 tablet_service.cc:1511] Processing CreateTablet for tablet ce427f23372c4482b0d022f844b46d32 (DEFAULT_TABLE table=test-workload [id=9c534eba40174f1e8483dbbcdee25296]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:18:24.318930 16181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08fa442667044198b448f66ee7350935. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.312204 16108 tablet_service.cc:1511] Processing CreateTablet for tablet dbb55848f9c040ac9db9b7849e2a0d8a (DEFAULT_TABLE table=test-workload [id=9c534eba40174f1e8483dbbcdee25296]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:18:24.317672 16257 tablet_service.cc:1511] Processing CreateTablet for tablet dbb55848f9c040ac9db9b7849e2a0d8a (DEFAULT_TABLE table=test-workload [id=9c534eba40174f1e8483dbbcdee25296]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:18:24.319628 16183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbb55848f9c040ac9db9b7849e2a0d8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.320565 16108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbb55848f9c040ac9db9b7849e2a0d8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.321024 16182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce427f23372c4482b0d022f844b46d32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.320873 16255 tablet_service.cc:1511] Processing CreateTablet for tablet 08fa442667044198b448f66ee7350935 (DEFAULT_TABLE table=test-workload [id=9c534eba40174f1e8483dbbcdee25296]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:18:24.319555 16256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce427f23372c4482b0d022f844b46d32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.322177 16184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6725f36431fc4b0fa0f740b0d8e8f7d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.323076 16257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbb55848f9c040ac9db9b7849e2a0d8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.323766 16255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08fa442667044198b448f66ee7350935. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.326447 16107 tablet_service.cc:1511] Processing CreateTablet for tablet ce427f23372c4482b0d022f844b46d32 (DEFAULT_TABLE table=test-workload [id=9c534eba40174f1e8483dbbcdee25296]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:18:24.328017 16107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce427f23372c4482b0d022f844b46d32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.330660 16106 tablet_service.cc:1511] Processing CreateTablet for tablet 08fa442667044198b448f66ee7350935 (DEFAULT_TABLE table=test-workload [id=9c534eba40174f1e8483dbbcdee25296]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:18:24.332211 16106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08fa442667044198b448f66ee7350935. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:24.455397 16314 tablet_bootstrap.cc:492] T 62f91e00d01e497d9eda72bf862ce090 P d58c05fc6fdc40b1bafd92b0c61e34e8: Bootstrap starting.
I20260709 12:18:24.470116 16313 tablet_bootstrap.cc:492] T 58fbda1848e042e5b821d2c689411fe7 P b61c58ed04b046d48634e2172dc45851: Bootstrap starting.
I20260709 12:18:24.473335 16314 tablet_bootstrap.cc:654] T 62f91e00d01e497d9eda72bf862ce090 P d58c05fc6fdc40b1bafd92b0c61e34e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:24.482744 16313 tablet_bootstrap.cc:654] T 58fbda1848e042e5b821d2c689411fe7 P b61c58ed04b046d48634e2172dc45851: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:24.487000 16315 tablet_bootstrap.cc:492] T cf4d45c1d3754356973b60c803375a36 P ce8113a88cac4c138552565af6c645ca: Bootstrap starting.
I20260709 12:18:24.490206 16313 tablet_bootstrap.cc:492] T 58fbda1848e042e5b821d2c689411fe7 P b61c58ed04b046d48634e2172dc45851: No bootstrap required, opened a new log
I20260709 12:18:24.490763 16313 ts_tablet_manager.cc:1403] T 58fbda1848e042e5b821d2c689411fe7 P b61c58ed04b046d48634e2172dc45851: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.003s
I20260709 12:18:24.491255 16314 tablet_bootstrap.cc:492] T 62f91e00d01e497d9eda72bf862ce090 P d58c05fc6fdc40b1bafd92b0c61e34e8: No bootstrap required, opened a new log
I20260709 12:18:24.491768 16314 ts_tablet_manager.cc:1403] T 62f91e00d01e497d9eda72bf862ce090 P d58c05fc6fdc40b1bafd92b0c61e34e8: Time spent bootstrapping tablet: real 0.037s	user 0.014s	sys 0.004s
I20260709 12:18:24.492904 16315 tablet_bootstrap.cc:654] T cf4d45c1d3754356973b60c803375a36 P ce8113a88cac4c138552565af6c645ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:24.493721 16313 raft_consensus.cc:359] T 58fbda1848e042e5b821d2c689411fe7 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } } peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } }
I20260709 12:18:24.494467 16313 raft_consensus.cc:385] T 58fbda1848e042e5b821d2c689411fe7 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:24.494755 16313 raft_consensus.cc:740] T 58fbda1848e042e5b821d2c689411fe7 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b61c58ed04b046d48634e2172dc45851, State: Initialized, Role: FOLLOWER
I20260709 12:18:24.495687 16314 raft_consensus.cc:359] T 62f91e00d01e497d9eda72bf862ce090 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.495630 16313 consensus_queue.cc:260] T 58fbda1848e042e5b821d2c689411fe7 P b61c58ed04b046d48634e2172dc45851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } } peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } }
I20260709 12:18:24.496495 16314 raft_consensus.cc:385] T 62f91e00d01e497d9eda72bf862ce090 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:24.496817 16314 raft_consensus.cc:740] T 62f91e00d01e497d9eda72bf862ce090 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d58c05fc6fdc40b1bafd92b0c61e34e8, State: Initialized, Role: FOLLOWER
I20260709 12:18:24.497699 16314 consensus_queue.cc:260] T 62f91e00d01e497d9eda72bf862ce090 P d58c05fc6fdc40b1bafd92b0c61e34e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.498987 16315 tablet_bootstrap.cc:492] T cf4d45c1d3754356973b60c803375a36 P ce8113a88cac4c138552565af6c645ca: No bootstrap required, opened a new log
I20260709 12:18:24.499454 16315 ts_tablet_manager.cc:1403] T cf4d45c1d3754356973b60c803375a36 P ce8113a88cac4c138552565af6c645ca: Time spent bootstrapping tablet: real 0.013s	user 0.000s	sys 0.012s
I20260709 12:18:24.501870 16315 raft_consensus.cc:359] T cf4d45c1d3754356973b60c803375a36 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.502517 16149 heartbeater.cc:499] Master 127.3.212.190:42735 was elected leader, sending a full tablet report...
I20260709 12:18:24.502565 16315 raft_consensus.cc:385] T cf4d45c1d3754356973b60c803375a36 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:24.503099 16314 ts_tablet_manager.cc:1434] T 62f91e00d01e497d9eda72bf862ce090 P d58c05fc6fdc40b1bafd92b0c61e34e8: Time spent starting tablet: real 0.011s	user 0.011s	sys 0.000s
I20260709 12:18:24.503111 16315 raft_consensus.cc:740] T cf4d45c1d3754356973b60c803375a36 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce8113a88cac4c138552565af6c645ca, State: Initialized, Role: FOLLOWER
I20260709 12:18:24.504350 16314 tablet_bootstrap.cc:492] T 08fa442667044198b448f66ee7350935 P d58c05fc6fdc40b1bafd92b0c61e34e8: Bootstrap starting.
I20260709 12:18:24.504729 16224 heartbeater.cc:499] Master 127.3.212.190:42735 was elected leader, sending a full tablet report...
I20260709 12:18:24.504381 16315 consensus_queue.cc:260] T cf4d45c1d3754356973b60c803375a36 P ce8113a88cac4c138552565af6c645ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.510998 16314 tablet_bootstrap.cc:654] T 08fa442667044198b448f66ee7350935 P d58c05fc6fdc40b1bafd92b0c61e34e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:24.513294 16313 ts_tablet_manager.cc:1434] T 58fbda1848e042e5b821d2c689411fe7 P b61c58ed04b046d48634e2172dc45851: Time spent starting tablet: real 0.022s	user 0.010s	sys 0.004s
I20260709 12:18:24.514637 16313 tablet_bootstrap.cc:492] T 3a632db0115e4b18a7e169bdf6d970ed P b61c58ed04b046d48634e2172dc45851: Bootstrap starting.
I20260709 12:18:24.521929 16313 tablet_bootstrap.cc:654] T 3a632db0115e4b18a7e169bdf6d970ed P b61c58ed04b046d48634e2172dc45851: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:24.528045 16314 tablet_bootstrap.cc:492] T 08fa442667044198b448f66ee7350935 P d58c05fc6fdc40b1bafd92b0c61e34e8: No bootstrap required, opened a new log
I20260709 12:18:24.528580 16314 ts_tablet_manager.cc:1403] T 08fa442667044198b448f66ee7350935 P d58c05fc6fdc40b1bafd92b0c61e34e8: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.008s
I20260709 12:18:24.530388 16313 tablet_bootstrap.cc:492] T 3a632db0115e4b18a7e169bdf6d970ed P b61c58ed04b046d48634e2172dc45851: No bootstrap required, opened a new log
I20260709 12:18:24.530987 16313 ts_tablet_manager.cc:1403] T 3a632db0115e4b18a7e169bdf6d970ed P b61c58ed04b046d48634e2172dc45851: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.005s
I20260709 12:18:24.531522 16314 raft_consensus.cc:359] T 08fa442667044198b448f66ee7350935 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.532315 16314 raft_consensus.cc:385] T 08fa442667044198b448f66ee7350935 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:24.532627 16314 raft_consensus.cc:740] T 08fa442667044198b448f66ee7350935 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d58c05fc6fdc40b1bafd92b0c61e34e8, State: Initialized, Role: FOLLOWER
I20260709 12:18:24.533456 16314 consensus_queue.cc:260] T 08fa442667044198b448f66ee7350935 P d58c05fc6fdc40b1bafd92b0c61e34e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.533892 16313 raft_consensus.cc:359] T 3a632db0115e4b18a7e169bdf6d970ed P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.534613 16313 raft_consensus.cc:385] T 3a632db0115e4b18a7e169bdf6d970ed P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:24.534919 16313 raft_consensus.cc:740] T 3a632db0115e4b18a7e169bdf6d970ed P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b61c58ed04b046d48634e2172dc45851, State: Initialized, Role: FOLLOWER
I20260709 12:18:24.535866 16314 ts_tablet_manager.cc:1434] T 08fa442667044198b448f66ee7350935 P d58c05fc6fdc40b1bafd92b0c61e34e8: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 12:18:24.535714 16313 consensus_queue.cc:260] T 3a632db0115e4b18a7e169bdf6d970ed P b61c58ed04b046d48634e2172dc45851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.536906 16314 tablet_bootstrap.cc:492] T ce427f23372c4482b0d022f844b46d32 P d58c05fc6fdc40b1bafd92b0c61e34e8: Bootstrap starting.
I20260709 12:18:24.538194 16313 ts_tablet_manager.cc:1434] T 3a632db0115e4b18a7e169bdf6d970ed P b61c58ed04b046d48634e2172dc45851: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:18:24.539168 16313 tablet_bootstrap.cc:492] T 62f91e00d01e497d9eda72bf862ce090 P b61c58ed04b046d48634e2172dc45851: Bootstrap starting.
I20260709 12:18:24.543548 16314 tablet_bootstrap.cc:654] T ce427f23372c4482b0d022f844b46d32 P d58c05fc6fdc40b1bafd92b0c61e34e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:24.544956 16313 tablet_bootstrap.cc:654] T 62f91e00d01e497d9eda72bf862ce090 P b61c58ed04b046d48634e2172dc45851: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:24.552258 16319 raft_consensus.cc:493] T 58fbda1848e042e5b821d2c689411fe7 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.552964 16319 raft_consensus.cc:515] T 58fbda1848e042e5b821d2c689411fe7 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } } peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } }
I20260709 12:18:24.557124 16313 tablet_bootstrap.cc:492] T 62f91e00d01e497d9eda72bf862ce090 P b61c58ed04b046d48634e2172dc45851: No bootstrap required, opened a new log
I20260709 12:18:24.557865 16313 ts_tablet_manager.cc:1403] T 62f91e00d01e497d9eda72bf862ce090 P b61c58ed04b046d48634e2172dc45851: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 12:18:24.560436 16298 heartbeater.cc:499] Master 127.3.212.190:42735 was elected leader, sending a full tablet report...
I20260709 12:18:24.561764 16319 leader_election.cc:290] T 58fbda1848e042e5b821d2c689411fe7 P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363), d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467)
I20260709 12:18:24.562047 16313 raft_consensus.cc:359] T 62f91e00d01e497d9eda72bf862ce090 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.562974 16313 raft_consensus.cc:385] T 62f91e00d01e497d9eda72bf862ce090 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:24.563268 16313 raft_consensus.cc:740] T 62f91e00d01e497d9eda72bf862ce090 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b61c58ed04b046d48634e2172dc45851, State: Initialized, Role: FOLLOWER
I20260709 12:18:24.564028 16313 consensus_queue.cc:260] T 62f91e00d01e497d9eda72bf862ce090 P b61c58ed04b046d48634e2172dc45851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.566478 16313 ts_tablet_manager.cc:1434] T 62f91e00d01e497d9eda72bf862ce090 P b61c58ed04b046d48634e2172dc45851: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:18:24.567530 16313 tablet_bootstrap.cc:492] T 08fa442667044198b448f66ee7350935 P b61c58ed04b046d48634e2172dc45851: Bootstrap starting.
I20260709 12:18:24.571158 16315 ts_tablet_manager.cc:1434] T cf4d45c1d3754356973b60c803375a36 P ce8113a88cac4c138552565af6c645ca: Time spent starting tablet: real 0.071s	user 0.041s	sys 0.013s
I20260709 12:18:24.571846 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58fbda1848e042e5b821d2c689411fe7" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" is_pre_election: true
I20260709 12:18:24.573514 16314 tablet_bootstrap.cc:492] T ce427f23372c4482b0d022f844b46d32 P d58c05fc6fdc40b1bafd92b0c61e34e8: No bootstrap required, opened a new log
I20260709 12:18:24.573818 16313 tablet_bootstrap.cc:654] T 08fa442667044198b448f66ee7350935 P b61c58ed04b046d48634e2172dc45851: Neither blocks nor log segments found. Creating new log.
W20260709 12:18:24.573946 16164 leader_election.cc:343] T 58fbda1848e042e5b821d2c689411fe7 P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:24.574092 16314 ts_tablet_manager.cc:1403] T ce427f23372c4482b0d022f844b46d32 P d58c05fc6fdc40b1bafd92b0c61e34e8: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.003s
I20260709 12:18:24.573514 16315 tablet_bootstrap.cc:492] T 554db18677e043199032d1d23ff3ac7d P ce8113a88cac4c138552565af6c645ca: Bootstrap starting.
I20260709 12:18:24.577363 16314 raft_consensus.cc:359] T ce427f23372c4482b0d022f844b46d32 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.582842 16314 raft_consensus.cc:385] T ce427f23372c4482b0d022f844b46d32 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:24.583187 16314 raft_consensus.cc:740] T ce427f23372c4482b0d022f844b46d32 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d58c05fc6fdc40b1bafd92b0c61e34e8, State: Initialized, Role: FOLLOWER
I20260709 12:18:24.584067 16314 consensus_queue.cc:260] T ce427f23372c4482b0d022f844b46d32 P d58c05fc6fdc40b1bafd92b0c61e34e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.584491 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58fbda1848e042e5b821d2c689411fe7" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca" is_pre_election: true
W20260709 12:18:24.586187 16162 leader_election.cc:343] T 58fbda1848e042e5b821d2c689411fe7 P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:24.586650 16162 leader_election.cc:304] T 58fbda1848e042e5b821d2c689411fe7 P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b61c58ed04b046d48634e2172dc45851; no voters: ce8113a88cac4c138552565af6c645ca, d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:24.587577 16319 raft_consensus.cc:2749] T 58fbda1848e042e5b821d2c689411fe7 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:24.589211 16314 ts_tablet_manager.cc:1434] T ce427f23372c4482b0d022f844b46d32 P d58c05fc6fdc40b1bafd92b0c61e34e8: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:18:24.590399 16314 tablet_bootstrap.cc:492] T cf4d45c1d3754356973b60c803375a36 P d58c05fc6fdc40b1bafd92b0c61e34e8: Bootstrap starting.
I20260709 12:18:24.591526 16315 tablet_bootstrap.cc:654] T 554db18677e043199032d1d23ff3ac7d P ce8113a88cac4c138552565af6c645ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:24.592701 16313 tablet_bootstrap.cc:492] T 08fa442667044198b448f66ee7350935 P b61c58ed04b046d48634e2172dc45851: No bootstrap required, opened a new log
I20260709 12:18:24.593338 16313 ts_tablet_manager.cc:1403] T 08fa442667044198b448f66ee7350935 P b61c58ed04b046d48634e2172dc45851: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.010s
I20260709 12:18:24.596647 16313 raft_consensus.cc:359] T 08fa442667044198b448f66ee7350935 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.597834 16313 raft_consensus.cc:385] T 08fa442667044198b448f66ee7350935 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:24.598229 16313 raft_consensus.cc:740] T 08fa442667044198b448f66ee7350935 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b61c58ed04b046d48634e2172dc45851, State: Initialized, Role: FOLLOWER
I20260709 12:18:24.599125 16313 consensus_queue.cc:260] T 08fa442667044198b448f66ee7350935 P b61c58ed04b046d48634e2172dc45851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.604892 16313 ts_tablet_manager.cc:1434] T 08fa442667044198b448f66ee7350935 P b61c58ed04b046d48634e2172dc45851: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:18:24.605592 16314 tablet_bootstrap.cc:654] T cf4d45c1d3754356973b60c803375a36 P d58c05fc6fdc40b1bafd92b0c61e34e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:24.606372 16313 tablet_bootstrap.cc:492] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851: Bootstrap starting.
I20260709 12:18:24.609468 16315 tablet_bootstrap.cc:492] T 554db18677e043199032d1d23ff3ac7d P ce8113a88cac4c138552565af6c645ca: No bootstrap required, opened a new log
I20260709 12:18:24.610414 16315 ts_tablet_manager.cc:1403] T 554db18677e043199032d1d23ff3ac7d P ce8113a88cac4c138552565af6c645ca: Time spent bootstrapping tablet: real 0.037s	user 0.006s	sys 0.019s
I20260709 12:18:24.613310 16313 tablet_bootstrap.cc:654] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:24.613698 16315 raft_consensus.cc:359] T 554db18677e043199032d1d23ff3ac7d P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.614553 16315 raft_consensus.cc:385] T 554db18677e043199032d1d23ff3ac7d P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:24.614936 16315 raft_consensus.cc:740] T 554db18677e043199032d1d23ff3ac7d P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce8113a88cac4c138552565af6c645ca, State: Initialized, Role: FOLLOWER
I20260709 12:18:24.615842 16315 consensus_queue.cc:260] T 554db18677e043199032d1d23ff3ac7d P ce8113a88cac4c138552565af6c645ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.617424 16314 tablet_bootstrap.cc:492] T cf4d45c1d3754356973b60c803375a36 P d58c05fc6fdc40b1bafd92b0c61e34e8: No bootstrap required, opened a new log
I20260709 12:18:24.617995 16314 ts_tablet_manager.cc:1403] T cf4d45c1d3754356973b60c803375a36 P d58c05fc6fdc40b1bafd92b0c61e34e8: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.008s
I20260709 12:18:24.618373 16315 ts_tablet_manager.cc:1434] T 554db18677e043199032d1d23ff3ac7d P ce8113a88cac4c138552565af6c645ca: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:18:24.619004 16313 tablet_bootstrap.cc:492] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851: No bootstrap required, opened a new log
I20260709 12:18:24.619551 16313 ts_tablet_manager.cc:1403] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851: Time spent bootstrapping tablet: real 0.013s	user 0.006s	sys 0.004s
I20260709 12:18:24.619588 16315 tablet_bootstrap.cc:492] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca: Bootstrap starting.
I20260709 12:18:24.621197 16314 raft_consensus.cc:359] T cf4d45c1d3754356973b60c803375a36 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.622027 16314 raft_consensus.cc:385] T cf4d45c1d3754356973b60c803375a36 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:24.622339 16314 raft_consensus.cc:740] T cf4d45c1d3754356973b60c803375a36 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d58c05fc6fdc40b1bafd92b0c61e34e8, State: Initialized, Role: FOLLOWER
I20260709 12:18:24.622733 16313 raft_consensus.cc:359] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.623521 16313 raft_consensus.cc:385] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:24.623289 16314 consensus_queue.cc:260] T cf4d45c1d3754356973b60c803375a36 P d58c05fc6fdc40b1bafd92b0c61e34e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.623840 16313 raft_consensus.cc:740] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b61c58ed04b046d48634e2172dc45851, State: Initialized, Role: FOLLOWER
I20260709 12:18:24.624625 16313 consensus_queue.cc:260] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.626948 16313 ts_tablet_manager.cc:1434] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:18:24.628034 16313 tablet_bootstrap.cc:492] T 554db18677e043199032d1d23ff3ac7d P b61c58ed04b046d48634e2172dc45851: Bootstrap starting.
I20260709 12:18:24.633077 16315 tablet_bootstrap.cc:654] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:24.634799 16313 tablet_bootstrap.cc:654] T 554db18677e043199032d1d23ff3ac7d P b61c58ed04b046d48634e2172dc45851: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:24.637967 16320 raft_consensus.cc:493] T 62f91e00d01e497d9eda72bf862ce090 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.638634 16320 raft_consensus.cc:515] T 62f91e00d01e497d9eda72bf862ce090 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.642035 16319 raft_consensus.cc:493] T 08fa442667044198b448f66ee7350935 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.642720 16319 raft_consensus.cc:515] T 08fa442667044198b448f66ee7350935 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.646036 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fa442667044198b448f66ee7350935" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" is_pre_election: true
I20260709 12:18:24.646884 16124 raft_consensus.cc:2468] T 08fa442667044198b448f66ee7350935 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b61c58ed04b046d48634e2172dc45851 in term 0.
I20260709 12:18:24.645121 16319 leader_election.cc:290] T 08fa442667044198b448f66ee7350935 P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:24.648773 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fa442667044198b448f66ee7350935" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca" is_pre_election: true
W20260709 12:18:24.650544 16162 leader_election.cc:343] T 08fa442667044198b448f66ee7350935 P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:24.651129 16164 leader_election.cc:304] T 08fa442667044198b448f66ee7350935 P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: ce8113a88cac4c138552565af6c645ca
I20260709 12:18:24.652027 16319 raft_consensus.cc:2804] T 08fa442667044198b448f66ee7350935 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:24.652393 16319 raft_consensus.cc:493] T 08fa442667044198b448f66ee7350935 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:24.652707 16319 raft_consensus.cc:3060] T 08fa442667044198b448f66ee7350935 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:24.652822 16315 tablet_bootstrap.cc:492] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca: No bootstrap required, opened a new log
I20260709 12:18:24.653412 16315 ts_tablet_manager.cc:1403] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.013s
I20260709 12:18:24.656106 16320 leader_election.cc:290] T 62f91e00d01e497d9eda72bf862ce090 P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:24.656633 16315 raft_consensus.cc:359] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.657511 16315 raft_consensus.cc:385] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:24.657821 16315 raft_consensus.cc:740] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce8113a88cac4c138552565af6c645ca, State: Initialized, Role: FOLLOWER
I20260709 12:18:24.658646 16315 consensus_queue.cc:260] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.661257 16319 raft_consensus.cc:515] T 08fa442667044198b448f66ee7350935 P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.663918 16315 ts_tablet_manager.cc:1434] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 12:18:24.665078 16315 tablet_bootstrap.cc:492] T 62f91e00d01e497d9eda72bf862ce090 P ce8113a88cac4c138552565af6c645ca: Bootstrap starting.
I20260709 12:18:24.665046 16313 tablet_bootstrap.cc:492] T 554db18677e043199032d1d23ff3ac7d P b61c58ed04b046d48634e2172dc45851: No bootstrap required, opened a new log
I20260709 12:18:24.665453 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fa442667044198b448f66ee7350935" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8"
I20260709 12:18:24.665933 16319 leader_election.cc:290] T 08fa442667044198b448f66ee7350935 P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 1 election: Requested vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:24.666203 16124 raft_consensus.cc:3060] T 08fa442667044198b448f66ee7350935 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:24.666821 16319 raft_consensus.cc:493] T 3a632db0115e4b18a7e169bdf6d970ed P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.667073 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fa442667044198b448f66ee7350935" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca"
I20260709 12:18:24.667358 16319 raft_consensus.cc:515] T 3a632db0115e4b18a7e169bdf6d970ed P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
W20260709 12:18:24.668695 16162 leader_election.cc:343] T 08fa442667044198b448f66ee7350935 P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:24.670214 16313 ts_tablet_manager.cc:1403] T 554db18677e043199032d1d23ff3ac7d P b61c58ed04b046d48634e2172dc45851: Time spent bootstrapping tablet: real 0.042s	user 0.017s	sys 0.008s
I20260709 12:18:24.671003 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a632db0115e4b18a7e169bdf6d970ed" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca" is_pre_election: true
W20260709 12:18:24.672590 16162 leader_election.cc:343] T 3a632db0115e4b18a7e169bdf6d970ed P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:24.673205 16315 tablet_bootstrap.cc:654] T 62f91e00d01e497d9eda72bf862ce090 P ce8113a88cac4c138552565af6c645ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:24.673952 16313 raft_consensus.cc:359] T 554db18677e043199032d1d23ff3ac7d P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.674525 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a632db0115e4b18a7e169bdf6d970ed" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" is_pre_election: true
I20260709 12:18:24.675248 16313 raft_consensus.cc:385] T 554db18677e043199032d1d23ff3ac7d P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:24.675642 16313 raft_consensus.cc:740] T 554db18677e043199032d1d23ff3ac7d P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b61c58ed04b046d48634e2172dc45851, State: Initialized, Role: FOLLOWER
W20260709 12:18:24.676855 16164 leader_election.cc:343] T 3a632db0115e4b18a7e169bdf6d970ed P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:24.669839 16319 leader_election.cc:290] T 3a632db0115e4b18a7e169bdf6d970ed P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:24.677414 16164 leader_election.cc:304] T 3a632db0115e4b18a7e169bdf6d970ed P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b61c58ed04b046d48634e2172dc45851; no voters: ce8113a88cac4c138552565af6c645ca, d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:24.677551 16313 consensus_queue.cc:260] T 554db18677e043199032d1d23ff3ac7d P b61c58ed04b046d48634e2172dc45851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.680310 16313 ts_tablet_manager.cc:1434] T 554db18677e043199032d1d23ff3ac7d P b61c58ed04b046d48634e2172dc45851: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:18:24.681797 16319 raft_consensus.cc:2749] T 3a632db0115e4b18a7e169bdf6d970ed P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:24.683938 16313 tablet_bootstrap.cc:492] T ce427f23372c4482b0d022f844b46d32 P b61c58ed04b046d48634e2172dc45851: Bootstrap starting.
I20260709 12:18:24.684055 16314 ts_tablet_manager.cc:1434] T cf4d45c1d3754356973b60c803375a36 P d58c05fc6fdc40b1bafd92b0c61e34e8: Time spent starting tablet: real 0.066s	user 0.007s	sys 0.000s
I20260709 12:18:24.685158 16314 tablet_bootstrap.cc:492] T 3a632db0115e4b18a7e169bdf6d970ed P d58c05fc6fdc40b1bafd92b0c61e34e8: Bootstrap starting.
I20260709 12:18:24.675669 16124 raft_consensus.cc:2468] T 08fa442667044198b448f66ee7350935 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b61c58ed04b046d48634e2172dc45851 in term 1.
I20260709 12:18:24.687412 16164 leader_election.cc:304] T 08fa442667044198b448f66ee7350935 P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: ce8113a88cac4c138552565af6c645ca
I20260709 12:18:24.691416 16319 raft_consensus.cc:2804] T 08fa442667044198b448f66ee7350935 P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:24.691907 16319 raft_consensus.cc:697] T 08fa442667044198b448f66ee7350935 P b61c58ed04b046d48634e2172dc45851 [term 1 LEADER]: Becoming Leader. State: Replica: b61c58ed04b046d48634e2172dc45851, State: Running, Role: LEADER
I20260709 12:18:24.692720 16319 consensus_queue.cc:237] T 08fa442667044198b448f66ee7350935 P b61c58ed04b046d48634e2172dc45851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.697582 16313 tablet_bootstrap.cc:654] T ce427f23372c4482b0d022f844b46d32 P b61c58ed04b046d48634e2172dc45851: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:24.700636 16314 tablet_bootstrap.cc:654] T 3a632db0115e4b18a7e169bdf6d970ed P d58c05fc6fdc40b1bafd92b0c61e34e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:24.717558 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f91e00d01e497d9eda72bf862ce090" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca" is_pre_election: true
W20260709 12:18:24.719107 16087 leader_election.cc:343] T 62f91e00d01e497d9eda72bf862ce090 P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:24.715603 16019 catalog_manager.cc:5697] T 08fa442667044198b448f66ee7350935 P b61c58ed04b046d48634e2172dc45851 reported cstate change: term changed from 0 to 1, leader changed from <none> to b61c58ed04b046d48634e2172dc45851 (127.3.212.130). New cstate: current_term: 1 leader_uuid: "b61c58ed04b046d48634e2172dc45851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:24.723297 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f91e00d01e497d9eda72bf862ce090" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b61c58ed04b046d48634e2172dc45851" is_pre_election: true
I20260709 12:18:24.724258 16199 raft_consensus.cc:2468] T 62f91e00d01e497d9eda72bf862ce090 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d58c05fc6fdc40b1bafd92b0c61e34e8 in term 0.
I20260709 12:18:24.725762 16088 leader_election.cc:304] T 62f91e00d01e497d9eda72bf862ce090 P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: ce8113a88cac4c138552565af6c645ca
I20260709 12:18:24.726655 16320 raft_consensus.cc:2804] T 62f91e00d01e497d9eda72bf862ce090 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:24.727020 16320 raft_consensus.cc:493] T 62f91e00d01e497d9eda72bf862ce090 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:24.727357 16320 raft_consensus.cc:3060] T 62f91e00d01e497d9eda72bf862ce090 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:24.730861 16315 tablet_bootstrap.cc:492] T 62f91e00d01e497d9eda72bf862ce090 P ce8113a88cac4c138552565af6c645ca: No bootstrap required, opened a new log
I20260709 12:18:24.732127 16321 raft_consensus.cc:493] T cf4d45c1d3754356973b60c803375a36 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.732749 16321 raft_consensus.cc:515] T cf4d45c1d3754356973b60c803375a36 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.734216 16313 tablet_bootstrap.cc:492] T ce427f23372c4482b0d022f844b46d32 P b61c58ed04b046d48634e2172dc45851: No bootstrap required, opened a new log
I20260709 12:18:24.734776 16313 ts_tablet_manager.cc:1403] T ce427f23372c4482b0d022f844b46d32 P b61c58ed04b046d48634e2172dc45851: Time spent bootstrapping tablet: real 0.051s	user 0.020s	sys 0.021s
I20260709 12:18:24.735827 16314 tablet_bootstrap.cc:492] T 3a632db0115e4b18a7e169bdf6d970ed P d58c05fc6fdc40b1bafd92b0c61e34e8: No bootstrap required, opened a new log
I20260709 12:18:24.736363 16314 ts_tablet_manager.cc:1403] T 3a632db0115e4b18a7e169bdf6d970ed P d58c05fc6fdc40b1bafd92b0c61e34e8: Time spent bootstrapping tablet: real 0.051s	user 0.013s	sys 0.000s
I20260709 12:18:24.737368 16320 raft_consensus.cc:515] T 62f91e00d01e497d9eda72bf862ce090 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.737913 16313 raft_consensus.cc:359] T ce427f23372c4482b0d022f844b46d32 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.738677 16313 raft_consensus.cc:385] T ce427f23372c4482b0d022f844b46d32 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:24.738965 16313 raft_consensus.cc:740] T ce427f23372c4482b0d022f844b46d32 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b61c58ed04b046d48634e2172dc45851, State: Initialized, Role: FOLLOWER
I20260709 12:18:24.739769 16313 consensus_queue.cc:260] T ce427f23372c4482b0d022f844b46d32 P b61c58ed04b046d48634e2172dc45851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.741160 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f91e00d01e497d9eda72bf862ce090" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca"
I20260709 12:18:24.742127 16313 ts_tablet_manager.cc:1434] T ce427f23372c4482b0d022f844b46d32 P b61c58ed04b046d48634e2172dc45851: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
W20260709 12:18:24.742903 16087 leader_election.cc:343] T 62f91e00d01e497d9eda72bf862ce090 P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:24.743387 16313 tablet_bootstrap.cc:492] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P b61c58ed04b046d48634e2172dc45851: Bootstrap starting.
I20260709 12:18:24.745702 16320 leader_election.cc:290] T 62f91e00d01e497d9eda72bf862ce090 P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 1 election: Requested vote from peers b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:24.746320 16320 raft_consensus.cc:493] T cf4d45c1d3754356973b60c803375a36 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.746238 16321 leader_election.cc:290] T cf4d45c1d3754356973b60c803375a36 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
I20260709 12:18:24.746824 16320 raft_consensus.cc:515] T cf4d45c1d3754356973b60c803375a36 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.749967 16313 tablet_bootstrap.cc:654] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P b61c58ed04b046d48634e2172dc45851: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:24.751019 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4d45c1d3754356973b60c803375a36" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca" is_pre_election: true
I20260709 12:18:24.751747 16273 raft_consensus.cc:2468] T cf4d45c1d3754356973b60c803375a36 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d58c05fc6fdc40b1bafd92b0c61e34e8 in term 0.
I20260709 12:18:24.753033 16087 leader_election.cc:304] T cf4d45c1d3754356973b60c803375a36 P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce8113a88cac4c138552565af6c645ca, d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: 
I20260709 12:18:24.753846 16320 leader_election.cc:290] T cf4d45c1d3754356973b60c803375a36 P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:24.754366 16320 raft_consensus.cc:2804] T cf4d45c1d3754356973b60c803375a36 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:24.754683 16320 raft_consensus.cc:493] T cf4d45c1d3754356973b60c803375a36 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:24.754998 16320 raft_consensus.cc:3060] T cf4d45c1d3754356973b60c803375a36 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:24.758478 16315 ts_tablet_manager.cc:1403] T 62f91e00d01e497d9eda72bf862ce090 P ce8113a88cac4c138552565af6c645ca: Time spent bootstrapping tablet: real 0.094s	user 0.022s	sys 0.024s
I20260709 12:18:24.762701 16313 tablet_bootstrap.cc:492] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P b61c58ed04b046d48634e2172dc45851: No bootstrap required, opened a new log
I20260709 12:18:24.759750 16314 raft_consensus.cc:359] T 3a632db0115e4b18a7e169bdf6d970ed P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.763499 16313 ts_tablet_manager.cc:1403] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P b61c58ed04b046d48634e2172dc45851: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.008s
I20260709 12:18:24.763273 16320 raft_consensus.cc:515] T cf4d45c1d3754356973b60c803375a36 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.766238 16315 raft_consensus.cc:359] T 62f91e00d01e497d9eda72bf862ce090 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.766474 16313 raft_consensus.cc:359] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.767314 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4d45c1d3754356973b60c803375a36" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca"
I20260709 12:18:24.767733 16313 raft_consensus.cc:385] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:24.767956 16273 raft_consensus.cc:3060] T cf4d45c1d3754356973b60c803375a36 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:24.768131 16313 raft_consensus.cc:740] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b61c58ed04b046d48634e2172dc45851, State: Initialized, Role: FOLLOWER
I20260709 12:18:24.769140 16313 consensus_queue.cc:260] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P b61c58ed04b046d48634e2172dc45851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.767803 16315 raft_consensus.cc:385] T 62f91e00d01e497d9eda72bf862ce090 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:24.770098 16315 raft_consensus.cc:740] T 62f91e00d01e497d9eda72bf862ce090 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce8113a88cac4c138552565af6c645ca, State: Initialized, Role: FOLLOWER
I20260709 12:18:24.771941 16313 ts_tablet_manager.cc:1434] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P b61c58ed04b046d48634e2172dc45851: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 12:18:24.772091 16315 consensus_queue.cc:260] T 62f91e00d01e497d9eda72bf862ce090 P ce8113a88cac4c138552565af6c645ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.776530 16198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4d45c1d3754356973b60c803375a36" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b61c58ed04b046d48634e2172dc45851" is_pre_election: true
I20260709 12:18:24.778579 16315 ts_tablet_manager.cc:1434] T 62f91e00d01e497d9eda72bf862ce090 P ce8113a88cac4c138552565af6c645ca: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:18:24.779692 16315 tablet_bootstrap.cc:492] T 3a632db0115e4b18a7e169bdf6d970ed P ce8113a88cac4c138552565af6c645ca: Bootstrap starting.
I20260709 12:18:24.773002 16313 tablet_bootstrap.cc:492] T cf4d45c1d3754356973b60c803375a36 P b61c58ed04b046d48634e2172dc45851: Bootstrap starting.
W20260709 12:18:24.771086 16070 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:18:24.774793 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f91e00d01e497d9eda72bf862ce090" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b61c58ed04b046d48634e2172dc45851"
I20260709 12:18:24.781497 16320 leader_election.cc:290] T cf4d45c1d3754356973b60c803375a36 P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 1 election: Requested vote from peers b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:24.781962 16199 raft_consensus.cc:3060] T 62f91e00d01e497d9eda72bf862ce090 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:24.778810 16273 raft_consensus.cc:2468] T cf4d45c1d3754356973b60c803375a36 P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d58c05fc6fdc40b1bafd92b0c61e34e8 in term 1.
I20260709 12:18:24.784447 16087 leader_election.cc:304] T cf4d45c1d3754356973b60c803375a36 P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce8113a88cac4c138552565af6c645ca, d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: 
I20260709 12:18:24.763296 16314 raft_consensus.cc:385] T 3a632db0115e4b18a7e169bdf6d970ed P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:24.785468 16314 raft_consensus.cc:740] T 3a632db0115e4b18a7e169bdf6d970ed P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d58c05fc6fdc40b1bafd92b0c61e34e8, State: Initialized, Role: FOLLOWER
I20260709 12:18:24.786379 16314 consensus_queue.cc:260] T 3a632db0115e4b18a7e169bdf6d970ed P d58c05fc6fdc40b1bafd92b0c61e34e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.786672 16198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4d45c1d3754356973b60c803375a36" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b61c58ed04b046d48634e2172dc45851"
I20260709 12:18:24.790567 16198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4d45c1d3754356973b60c803375a36" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b61c58ed04b046d48634e2172dc45851" is_pre_election: true
I20260709 12:18:24.791505 16199 raft_consensus.cc:2468] T 62f91e00d01e497d9eda72bf862ce090 P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d58c05fc6fdc40b1bafd92b0c61e34e8 in term 1.
W20260709 12:18:24.792220 16237 leader_election.cc:343] T cf4d45c1d3754356973b60c803375a36 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:18:24.792418 16088 leader_election.cc:343] T cf4d45c1d3754356973b60c803375a36 P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:18:24.793534 16088 leader_election.cc:343] T cf4d45c1d3754356973b60c803375a36 P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:24.794549 16315 tablet_bootstrap.cc:654] T 3a632db0115e4b18a7e169bdf6d970ed P ce8113a88cac4c138552565af6c645ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:24.794394 16088 leader_election.cc:304] T 62f91e00d01e497d9eda72bf862ce090 P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: ce8113a88cac4c138552565af6c645ca
I20260709 12:18:24.795812 16320 raft_consensus.cc:2804] T cf4d45c1d3754356973b60c803375a36 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:24.797904 16314 ts_tablet_manager.cc:1434] T 3a632db0115e4b18a7e169bdf6d970ed P d58c05fc6fdc40b1bafd92b0c61e34e8: Time spent starting tablet: real 0.061s	user 0.009s	sys 0.000s
I20260709 12:18:24.786674 16313 tablet_bootstrap.cc:654] T cf4d45c1d3754356973b60c803375a36 P b61c58ed04b046d48634e2172dc45851: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:24.805195 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4d45c1d3754356973b60c803375a36" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" is_pre_election: true
I20260709 12:18:24.808120 16321 raft_consensus.cc:493] T 62f91e00d01e497d9eda72bf862ce090 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.807343 16341 raft_consensus.cc:2804] T 62f91e00d01e497d9eda72bf862ce090 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:24.809000 16341 raft_consensus.cc:697] T 62f91e00d01e497d9eda72bf862ce090 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 LEADER]: Becoming Leader. State: Replica: d58c05fc6fdc40b1bafd92b0c61e34e8, State: Running, Role: LEADER
I20260709 12:18:24.808707 16321 raft_consensus.cc:515] T 62f91e00d01e497d9eda72bf862ce090 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.810295 16314 tablet_bootstrap.cc:492] T 554db18677e043199032d1d23ff3ac7d P d58c05fc6fdc40b1bafd92b0c61e34e8: Bootstrap starting.
I20260709 12:18:24.810958 16321 leader_election.cc:290] T 62f91e00d01e497d9eda72bf862ce090 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
I20260709 12:18:24.813596 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f91e00d01e497d9eda72bf862ce090" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" is_pre_election: true
I20260709 12:18:24.814714 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f91e00d01e497d9eda72bf862ce090" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b61c58ed04b046d48634e2172dc45851" is_pre_election: true
I20260709 12:18:24.815583 16199 raft_consensus.cc:2393] T 62f91e00d01e497d9eda72bf862ce090 P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce8113a88cac4c138552565af6c645ca in current term 1: Already voted for candidate d58c05fc6fdc40b1bafd92b0c61e34e8 in this term.
I20260709 12:18:24.816745 16314 tablet_bootstrap.cc:654] T 554db18677e043199032d1d23ff3ac7d P d58c05fc6fdc40b1bafd92b0c61e34e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:24.817782 16320 raft_consensus.cc:697] T cf4d45c1d3754356973b60c803375a36 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 LEADER]: Becoming Leader. State: Replica: d58c05fc6fdc40b1bafd92b0c61e34e8, State: Running, Role: LEADER
I20260709 12:18:24.818244 16313 tablet_bootstrap.cc:492] T cf4d45c1d3754356973b60c803375a36 P b61c58ed04b046d48634e2172dc45851: No bootstrap required, opened a new log
I20260709 12:18:24.817870 16341 consensus_queue.cc:237] T 62f91e00d01e497d9eda72bf862ce090 P d58c05fc6fdc40b1bafd92b0c61e34e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.818749 16313 ts_tablet_manager.cc:1403] T cf4d45c1d3754356973b60c803375a36 P b61c58ed04b046d48634e2172dc45851: Time spent bootstrapping tablet: real 0.046s	user 0.009s	sys 0.004s
I20260709 12:18:24.818879 16320 consensus_queue.cc:237] T cf4d45c1d3754356973b60c803375a36 P d58c05fc6fdc40b1bafd92b0c61e34e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.822057 16315 tablet_bootstrap.cc:492] T 3a632db0115e4b18a7e169bdf6d970ed P ce8113a88cac4c138552565af6c645ca: No bootstrap required, opened a new log
I20260709 12:18:24.821940 16313 raft_consensus.cc:359] T cf4d45c1d3754356973b60c803375a36 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.822712 16313 raft_consensus.cc:385] T cf4d45c1d3754356973b60c803375a36 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:24.823051 16313 raft_consensus.cc:740] T cf4d45c1d3754356973b60c803375a36 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b61c58ed04b046d48634e2172dc45851, State: Initialized, Role: FOLLOWER
I20260709 12:18:24.822741 16315 ts_tablet_manager.cc:1403] T 3a632db0115e4b18a7e169bdf6d970ed P ce8113a88cac4c138552565af6c645ca: Time spent bootstrapping tablet: real 0.043s	user 0.016s	sys 0.004s
I20260709 12:18:24.823939 16313 consensus_queue.cc:260] T cf4d45c1d3754356973b60c803375a36 P b61c58ed04b046d48634e2172dc45851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.826596 16313 ts_tablet_manager.cc:1434] T cf4d45c1d3754356973b60c803375a36 P b61c58ed04b046d48634e2172dc45851: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:18:24.827020 16315 raft_consensus.cc:359] T 3a632db0115e4b18a7e169bdf6d970ed P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.827943 16315 raft_consensus.cc:385] T 3a632db0115e4b18a7e169bdf6d970ed P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:24.828277 16315 raft_consensus.cc:740] T 3a632db0115e4b18a7e169bdf6d970ed P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce8113a88cac4c138552565af6c645ca, State: Initialized, Role: FOLLOWER
I20260709 12:18:24.829205 16315 consensus_queue.cc:260] T 3a632db0115e4b18a7e169bdf6d970ed P ce8113a88cac4c138552565af6c645ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.833918 16238 leader_election.cc:304] T cf4d45c1d3754356973b60c803375a36 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce8113a88cac4c138552565af6c645ca; no voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:24.834555 16315 ts_tablet_manager.cc:1434] T 3a632db0115e4b18a7e169bdf6d970ed P ce8113a88cac4c138552565af6c645ca: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:18:24.835336 16321 raft_consensus.cc:2749] T cf4d45c1d3754356973b60c803375a36 P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:24.835709 16315 tablet_bootstrap.cc:492] T ce427f23372c4482b0d022f844b46d32 P ce8113a88cac4c138552565af6c645ca: Bootstrap starting.
I20260709 12:18:24.837301 16314 tablet_bootstrap.cc:492] T 554db18677e043199032d1d23ff3ac7d P d58c05fc6fdc40b1bafd92b0c61e34e8: No bootstrap required, opened a new log
I20260709 12:18:24.838047 16314 ts_tablet_manager.cc:1403] T 554db18677e043199032d1d23ff3ac7d P d58c05fc6fdc40b1bafd92b0c61e34e8: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.011s
I20260709 12:18:24.841495 16314 raft_consensus.cc:359] T 554db18677e043199032d1d23ff3ac7d P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.842613 16315 tablet_bootstrap.cc:654] T ce427f23372c4482b0d022f844b46d32 P ce8113a88cac4c138552565af6c645ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:24.842470 16314 raft_consensus.cc:385] T 554db18677e043199032d1d23ff3ac7d P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:24.844995 16314 raft_consensus.cc:740] T 554db18677e043199032d1d23ff3ac7d P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d58c05fc6fdc40b1bafd92b0c61e34e8, State: Initialized, Role: FOLLOWER
I20260709 12:18:24.845983 16314 consensus_queue.cc:260] T 554db18677e043199032d1d23ff3ac7d P d58c05fc6fdc40b1bafd92b0c61e34e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.848423 16314 ts_tablet_manager.cc:1434] T 554db18677e043199032d1d23ff3ac7d P d58c05fc6fdc40b1bafd92b0c61e34e8: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:18:24.849746 16321 raft_consensus.cc:493] T 554db18677e043199032d1d23ff3ac7d P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.849541 16238 leader_election.cc:304] T 62f91e00d01e497d9eda72bf862ce090 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce8113a88cac4c138552565af6c645ca; no voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:24.850687 16314 tablet_bootstrap.cc:492] T dbb55848f9c040ac9db9b7849e2a0d8a P d58c05fc6fdc40b1bafd92b0c61e34e8: Bootstrap starting.
I20260709 12:18:24.847378 16022 catalog_manager.cc:5697] T cf4d45c1d3754356973b60c803375a36 P d58c05fc6fdc40b1bafd92b0c61e34e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129). New cstate: current_term: 1 leader_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:24.851532 16321 raft_consensus.cc:515] T 554db18677e043199032d1d23ff3ac7d P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.854948 16315 tablet_bootstrap.cc:492] T ce427f23372c4482b0d022f844b46d32 P ce8113a88cac4c138552565af6c645ca: No bootstrap required, opened a new log
I20260709 12:18:24.856138 16315 ts_tablet_manager.cc:1403] T ce427f23372c4482b0d022f844b46d32 P ce8113a88cac4c138552565af6c645ca: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.002s
I20260709 12:18:24.856439 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554db18677e043199032d1d23ff3ac7d" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" is_pre_election: true
I20260709 12:18:24.857183 16123 raft_consensus.cc:2468] T 554db18677e043199032d1d23ff3ac7d P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce8113a88cac4c138552565af6c645ca in term 0.
I20260709 12:18:24.857452 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554db18677e043199032d1d23ff3ac7d" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b61c58ed04b046d48634e2172dc45851" is_pre_election: true
I20260709 12:18:24.858117 16199 raft_consensus.cc:2468] T 554db18677e043199032d1d23ff3ac7d P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce8113a88cac4c138552565af6c645ca in term 0.
I20260709 12:18:24.858577 16352 raft_consensus.cc:3060] T 62f91e00d01e497d9eda72bf862ce090 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:24.859226 16315 raft_consensus.cc:359] T ce427f23372c4482b0d022f844b46d32 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.860059 16315 raft_consensus.cc:385] T ce427f23372c4482b0d022f844b46d32 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:24.860494 16315 raft_consensus.cc:740] T ce427f23372c4482b0d022f844b46d32 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce8113a88cac4c138552565af6c645ca, State: Initialized, Role: FOLLOWER
I20260709 12:18:24.861470 16315 consensus_queue.cc:260] T ce427f23372c4482b0d022f844b46d32 P ce8113a88cac4c138552565af6c645ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.862181 16321 leader_election.cc:290] T 554db18677e043199032d1d23ff3ac7d P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
I20260709 12:18:24.858471 16238 leader_election.cc:304] T 554db18677e043199032d1d23ff3ac7d P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce8113a88cac4c138552565af6c645ca, d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: 
I20260709 12:18:24.862774 16321 raft_consensus.cc:493] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.867743 16352 raft_consensus.cc:2749] T 62f91e00d01e497d9eda72bf862ce090 P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:24.868498 16314 tablet_bootstrap.cc:654] T dbb55848f9c040ac9db9b7849e2a0d8a P d58c05fc6fdc40b1bafd92b0c61e34e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:24.868002 16353 raft_consensus.cc:2804] T 554db18677e043199032d1d23ff3ac7d P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:24.869093 16353 raft_consensus.cc:493] T 554db18677e043199032d1d23ff3ac7d P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:24.869488 16353 raft_consensus.cc:3060] T 554db18677e043199032d1d23ff3ac7d P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:24.867184 16321 raft_consensus.cc:515] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.873761 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6725f36431fc4b0fa0f740b0d8e8f7d9" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b61c58ed04b046d48634e2172dc45851" is_pre_election: true
I20260709 12:18:24.874413 16199 raft_consensus.cc:2468] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce8113a88cac4c138552565af6c645ca in term 0.
I20260709 12:18:24.873786 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6725f36431fc4b0fa0f740b0d8e8f7d9" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" is_pre_election: true
I20260709 12:18:24.875630 16237 leader_election.cc:304] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b61c58ed04b046d48634e2172dc45851, ce8113a88cac4c138552565af6c645ca; no voters: 
W20260709 12:18:24.876696 16238 leader_election.cc:343] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:24.878772 16321 leader_election.cc:290] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
I20260709 12:18:24.879738 16321 raft_consensus.cc:2804] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:24.880093 16321 raft_consensus.cc:493] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:24.880424 16321 raft_consensus.cc:3060] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:24.875603 16315 ts_tablet_manager.cc:1434] T ce427f23372c4482b0d022f844b46d32 P ce8113a88cac4c138552565af6c645ca: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.001s
I20260709 12:18:24.884470 16315 tablet_bootstrap.cc:492] T dbb55848f9c040ac9db9b7849e2a0d8a P ce8113a88cac4c138552565af6c645ca: Bootstrap starting.
I20260709 12:18:24.894793 16321 raft_consensus.cc:515] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.897083 16315 tablet_bootstrap.cc:654] T dbb55848f9c040ac9db9b7849e2a0d8a P ce8113a88cac4c138552565af6c645ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:24.897976 16321 leader_election.cc:290] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 1 election: Requested vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
I20260709 12:18:24.898154 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6725f36431fc4b0fa0f740b0d8e8f7d9" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8"
W20260709 12:18:24.900928 16238 leader_election.cc:343] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:24.900274 16021 catalog_manager.cc:5697] T 62f91e00d01e497d9eda72bf862ce090 P d58c05fc6fdc40b1bafd92b0c61e34e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129). New cstate: current_term: 1 leader_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:24.899009 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6725f36431fc4b0fa0f740b0d8e8f7d9" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b61c58ed04b046d48634e2172dc45851"
I20260709 12:18:24.901726 16199 raft_consensus.cc:3060] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:24.902391 16321 raft_consensus.cc:493] T ce427f23372c4482b0d022f844b46d32 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.903020 16321 raft_consensus.cc:515] T ce427f23372c4482b0d022f844b46d32 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.906366 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce427f23372c4482b0d022f844b46d32" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" is_pre_election: true
I20260709 12:18:24.907131 16123 raft_consensus.cc:2468] T ce427f23372c4482b0d022f844b46d32 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce8113a88cac4c138552565af6c645ca in term 0.
I20260709 12:18:24.908779 16238 leader_election.cc:304] T ce427f23372c4482b0d022f844b46d32 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce8113a88cac4c138552565af6c645ca, d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: 
I20260709 12:18:24.909400 16199 raft_consensus.cc:2468] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce8113a88cac4c138552565af6c645ca in term 1.
I20260709 12:18:24.910166 16354 raft_consensus.cc:2804] T ce427f23372c4482b0d022f844b46d32 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:24.910821 16237 leader_election.cc:304] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b61c58ed04b046d48634e2172dc45851, ce8113a88cac4c138552565af6c645ca; no voters: d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:24.911778 16321 leader_election.cc:290] T ce427f23372c4482b0d022f844b46d32 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
I20260709 12:18:24.912590 16321 raft_consensus.cc:2804] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:24.910811 16354 raft_consensus.cc:493] T ce427f23372c4482b0d022f844b46d32 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:24.913333 16354 raft_consensus.cc:3060] T ce427f23372c4482b0d022f844b46d32 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:24.913462 16198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce427f23372c4482b0d022f844b46d32" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b61c58ed04b046d48634e2172dc45851" is_pre_election: true
I20260709 12:18:24.914333 16198 raft_consensus.cc:2468] T ce427f23372c4482b0d022f844b46d32 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce8113a88cac4c138552565af6c645ca in term 0.
I20260709 12:18:24.915493 16314 tablet_bootstrap.cc:492] T dbb55848f9c040ac9db9b7849e2a0d8a P d58c05fc6fdc40b1bafd92b0c61e34e8: No bootstrap required, opened a new log
I20260709 12:18:24.916438 16314 ts_tablet_manager.cc:1403] T dbb55848f9c040ac9db9b7849e2a0d8a P d58c05fc6fdc40b1bafd92b0c61e34e8: Time spent bootstrapping tablet: real 0.066s	user 0.020s	sys 0.017s
I20260709 12:18:24.918155 16321 raft_consensus.cc:697] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca [term 1 LEADER]: Becoming Leader. State: Replica: ce8113a88cac4c138552565af6c645ca, State: Running, Role: LEADER
I20260709 12:18:24.919085 16321 consensus_queue.cc:237] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.919288 16314 raft_consensus.cc:359] T dbb55848f9c040ac9db9b7849e2a0d8a P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.920114 16314 raft_consensus.cc:385] T dbb55848f9c040ac9db9b7849e2a0d8a P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:24.920470 16314 raft_consensus.cc:740] T dbb55848f9c040ac9db9b7849e2a0d8a P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d58c05fc6fdc40b1bafd92b0c61e34e8, State: Initialized, Role: FOLLOWER
I20260709 12:18:24.915405 16353 raft_consensus.cc:515] T 554db18677e043199032d1d23ff3ac7d P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.920992 16315 tablet_bootstrap.cc:492] T dbb55848f9c040ac9db9b7849e2a0d8a P ce8113a88cac4c138552565af6c645ca: No bootstrap required, opened a new log
I20260709 12:18:24.921756 16315 ts_tablet_manager.cc:1403] T dbb55848f9c040ac9db9b7849e2a0d8a P ce8113a88cac4c138552565af6c645ca: Time spent bootstrapping tablet: real 0.038s	user 0.025s	sys 0.002s
I20260709 12:18:24.921437 16314 consensus_queue.cc:260] T dbb55848f9c040ac9db9b7849e2a0d8a P d58c05fc6fdc40b1bafd92b0c61e34e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.924188 16314 ts_tablet_manager.cc:1434] T dbb55848f9c040ac9db9b7849e2a0d8a P d58c05fc6fdc40b1bafd92b0c61e34e8: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:18:24.925334 16314 tablet_bootstrap.cc:492] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P d58c05fc6fdc40b1bafd92b0c61e34e8: Bootstrap starting.
I20260709 12:18:24.925045 16315 raft_consensus.cc:359] T dbb55848f9c040ac9db9b7849e2a0d8a P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.925994 16315 raft_consensus.cc:385] T dbb55848f9c040ac9db9b7849e2a0d8a P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:24.926191 16353 leader_election.cc:290] T 554db18677e043199032d1d23ff3ac7d P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 1 election: Requested vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
I20260709 12:18:24.926375 16315 raft_consensus.cc:740] T dbb55848f9c040ac9db9b7849e2a0d8a P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce8113a88cac4c138552565af6c645ca, State: Initialized, Role: FOLLOWER
I20260709 12:18:24.926091 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554db18677e043199032d1d23ff3ac7d" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b61c58ed04b046d48634e2172dc45851"
I20260709 12:18:24.927590 16199 raft_consensus.cc:3060] T 554db18677e043199032d1d23ff3ac7d P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:24.927456 16315 consensus_queue.cc:260] T dbb55848f9c040ac9db9b7849e2a0d8a P ce8113a88cac4c138552565af6c645ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.929992 16315 ts_tablet_manager.cc:1434] T dbb55848f9c040ac9db9b7849e2a0d8a P ce8113a88cac4c138552565af6c645ca: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:18:24.930109 16319 raft_consensus.cc:493] T cf4d45c1d3754356973b60c803375a36 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.930685 16319 raft_consensus.cc:515] T cf4d45c1d3754356973b60c803375a36 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.931257 16315 tablet_bootstrap.cc:492] T 58fbda1848e042e5b821d2c689411fe7 P ce8113a88cac4c138552565af6c645ca: Bootstrap starting.
I20260709 12:18:24.932147 16314 tablet_bootstrap.cc:654] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P d58c05fc6fdc40b1bafd92b0c61e34e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:24.934731 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4d45c1d3754356973b60c803375a36" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca" is_pre_election: true
I20260709 12:18:24.935643 16273 raft_consensus.cc:2393] T cf4d45c1d3754356973b60c803375a36 P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b61c58ed04b046d48634e2172dc45851 in current term 1: Already voted for candidate d58c05fc6fdc40b1bafd92b0c61e34e8 in this term.
I20260709 12:18:24.937074 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4d45c1d3754356973b60c803375a36" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" is_pre_election: true
I20260709 12:18:24.938920 16315 tablet_bootstrap.cc:654] T 58fbda1848e042e5b821d2c689411fe7 P ce8113a88cac4c138552565af6c645ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:24.939705 16164 leader_election.cc:304] T cf4d45c1d3754356973b60c803375a36 P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b61c58ed04b046d48634e2172dc45851; no voters: ce8113a88cac4c138552565af6c645ca, d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:24.940775 16335 raft_consensus.cc:3060] T cf4d45c1d3754356973b60c803375a36 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:24.926091 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554db18677e043199032d1d23ff3ac7d" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8"
I20260709 12:18:24.941879 16123 raft_consensus.cc:3060] T 554db18677e043199032d1d23ff3ac7d P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:24.943292 16319 leader_election.cc:290] T cf4d45c1d3754356973b60c803375a36 P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:24.949687 16335 raft_consensus.cc:2749] T cf4d45c1d3754356973b60c803375a36 P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:24.950553 16123 raft_consensus.cc:2468] T 554db18677e043199032d1d23ff3ac7d P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce8113a88cac4c138552565af6c645ca in term 1.
I20260709 12:18:24.952144 16238 leader_election.cc:304] T 554db18677e043199032d1d23ff3ac7d P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce8113a88cac4c138552565af6c645ca, d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: 
I20260709 12:18:24.953260 16353 raft_consensus.cc:2804] T 554db18677e043199032d1d23ff3ac7d P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:24.954090 16353 raft_consensus.cc:697] T 554db18677e043199032d1d23ff3ac7d P ce8113a88cac4c138552565af6c645ca [term 1 LEADER]: Becoming Leader. State: Replica: ce8113a88cac4c138552565af6c645ca, State: Running, Role: LEADER
I20260709 12:18:24.955008 16353 consensus_queue.cc:237] T 554db18677e043199032d1d23ff3ac7d P ce8113a88cac4c138552565af6c645ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.960879 16315 tablet_bootstrap.cc:492] T 58fbda1848e042e5b821d2c689411fe7 P ce8113a88cac4c138552565af6c645ca: No bootstrap required, opened a new log
I20260709 12:18:24.961721 16315 ts_tablet_manager.cc:1403] T 58fbda1848e042e5b821d2c689411fe7 P ce8113a88cac4c138552565af6c645ca: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.009s
I20260709 12:18:24.963814 16199 raft_consensus.cc:2468] T 554db18677e043199032d1d23ff3ac7d P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce8113a88cac4c138552565af6c645ca in term 1.
I20260709 12:18:24.961144 16354 raft_consensus.cc:515] T ce427f23372c4482b0d022f844b46d32 P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.965273 16315 raft_consensus.cc:359] T 58fbda1848e042e5b821d2c689411fe7 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } } peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } }
I20260709 12:18:24.966131 16335 raft_consensus.cc:493] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.966202 16315 raft_consensus.cc:385] T 58fbda1848e042e5b821d2c689411fe7 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:24.966751 16335 raft_consensus.cc:515] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.967231 16315 raft_consensus.cc:740] T 58fbda1848e042e5b821d2c689411fe7 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce8113a88cac4c138552565af6c645ca, State: Initialized, Role: FOLLOWER
I20260709 12:18:24.967710 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce427f23372c4482b0d022f844b46d32" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8"
I20260709 12:18:24.968451 16123 raft_consensus.cc:3060] T ce427f23372c4482b0d022f844b46d32 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:24.968786 16315 consensus_queue.cc:260] T 58fbda1848e042e5b821d2c689411fe7 P ce8113a88cac4c138552565af6c645ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } } peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } }
I20260709 12:18:24.969902 16314 tablet_bootstrap.cc:492] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P d58c05fc6fdc40b1bafd92b0c61e34e8: No bootstrap required, opened a new log
I20260709 12:18:24.970412 16314 ts_tablet_manager.cc:1403] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P d58c05fc6fdc40b1bafd92b0c61e34e8: Time spent bootstrapping tablet: real 0.045s	user 0.024s	sys 0.005s
I20260709 12:18:24.970921 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb55848f9c040ac9db9b7849e2a0d8a" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" is_pre_election: true
I20260709 12:18:24.971194 16315 ts_tablet_manager.cc:1434] T 58fbda1848e042e5b821d2c689411fe7 P ce8113a88cac4c138552565af6c645ca: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 12:18:24.970930 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb55848f9c040ac9db9b7849e2a0d8a" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca" is_pre_election: true
I20260709 12:18:24.971024 16335 leader_election.cc:290] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:24.971707 16124 raft_consensus.cc:2468] T dbb55848f9c040ac9db9b7849e2a0d8a P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b61c58ed04b046d48634e2172dc45851 in term 0.
I20260709 12:18:24.972600 16315 tablet_bootstrap.cc:492] T 08fa442667044198b448f66ee7350935 P ce8113a88cac4c138552565af6c645ca: Bootstrap starting.
I20260709 12:18:24.973454 16164 leader_election.cc:304] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: 
I20260709 12:18:24.973040 16314 raft_consensus.cc:359] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.974090 16314 raft_consensus.cc:385] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:24.974377 16314 raft_consensus.cc:740] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d58c05fc6fdc40b1bafd92b0c61e34e8, State: Initialized, Role: FOLLOWER
I20260709 12:18:24.974856 16273 raft_consensus.cc:2468] T dbb55848f9c040ac9db9b7849e2a0d8a P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b61c58ed04b046d48634e2172dc45851 in term 0.
I20260709 12:18:24.975283 16314 consensus_queue.cc:260] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P d58c05fc6fdc40b1bafd92b0c61e34e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.974315 16335 raft_consensus.cc:2804] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:24.976965 16335 raft_consensus.cc:493] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:24.977308 16335 raft_consensus.cc:3060] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:24.977638 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce427f23372c4482b0d022f844b46d32" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b61c58ed04b046d48634e2172dc45851"
I20260709 12:18:24.978279 16199 raft_consensus.cc:3060] T ce427f23372c4482b0d022f844b46d32 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:24.979413 16315 tablet_bootstrap.cc:654] T 08fa442667044198b448f66ee7350935 P ce8113a88cac4c138552565af6c645ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:24.979877 16354 leader_election.cc:290] T ce427f23372c4482b0d022f844b46d32 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 1 election: Requested vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
I20260709 12:18:24.984020 16123 raft_consensus.cc:2468] T ce427f23372c4482b0d022f844b46d32 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce8113a88cac4c138552565af6c645ca in term 1.
I20260709 12:18:24.985214 16314 ts_tablet_manager.cc:1434] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P d58c05fc6fdc40b1bafd92b0c61e34e8: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 12:18:24.985520 16238 leader_election.cc:304] T ce427f23372c4482b0d022f844b46d32 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce8113a88cac4c138552565af6c645ca, d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: 
I20260709 12:18:24.986872 16354 raft_consensus.cc:2804] T ce427f23372c4482b0d022f844b46d32 P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:24.987604 16354 raft_consensus.cc:697] T ce427f23372c4482b0d022f844b46d32 P ce8113a88cac4c138552565af6c645ca [term 1 LEADER]: Becoming Leader. State: Replica: ce8113a88cac4c138552565af6c645ca, State: Running, Role: LEADER
I20260709 12:18:24.988490 16354 consensus_queue.cc:237] T ce427f23372c4482b0d022f844b46d32 P ce8113a88cac4c138552565af6c645ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.990314 16335 raft_consensus.cc:515] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.993531 16021 catalog_manager.cc:5697] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca reported cstate change: term changed from 0 to 1, leader changed from <none> to ce8113a88cac4c138552565af6c645ca (127.3.212.131). New cstate: current_term: 1 leader_uuid: "ce8113a88cac4c138552565af6c645ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:24.995151 16314 tablet_bootstrap.cc:492] T 58fbda1848e042e5b821d2c689411fe7 P d58c05fc6fdc40b1bafd92b0c61e34e8: Bootstrap starting.
I20260709 12:18:24.996749 16335 leader_election.cc:290] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 1 election: Requested vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:24.997870 16341 raft_consensus.cc:493] T 3a632db0115e4b18a7e169bdf6d970ed P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.998436 16341 raft_consensus.cc:515] T 3a632db0115e4b18a7e169bdf6d970ed P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:24.999981 16315 tablet_bootstrap.cc:492] T 08fa442667044198b448f66ee7350935 P ce8113a88cac4c138552565af6c645ca: No bootstrap required, opened a new log
I20260709 12:18:24.999830 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb55848f9c040ac9db9b7849e2a0d8a" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca"
I20260709 12:18:25.000504 16273 raft_consensus.cc:3060] T dbb55848f9c040ac9db9b7849e2a0d8a P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:25.000560 16341 leader_election.cc:290] T 3a632db0115e4b18a7e169bdf6d970ed P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:25.002369 16198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a632db0115e4b18a7e169bdf6d970ed" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b61c58ed04b046d48634e2172dc45851" is_pre_election: true
I20260709 12:18:25.003068 16198 raft_consensus.cc:2468] T 3a632db0115e4b18a7e169bdf6d970ed P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d58c05fc6fdc40b1bafd92b0c61e34e8 in term 0.
I20260709 12:18:25.004413 16088 leader_election.cc:304] T 3a632db0115e4b18a7e169bdf6d970ed P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: 
I20260709 12:18:25.005601 16341 raft_consensus.cc:2804] T 3a632db0115e4b18a7e169bdf6d970ed P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:25.005980 16341 raft_consensus.cc:493] T 3a632db0115e4b18a7e169bdf6d970ed P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:25.006331 16341 raft_consensus.cc:3060] T 3a632db0115e4b18a7e169bdf6d970ed P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:25.008839 16273 raft_consensus.cc:2468] T dbb55848f9c040ac9db9b7849e2a0d8a P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b61c58ed04b046d48634e2172dc45851 in term 1.
I20260709 12:18:25.006424 16199 raft_consensus.cc:2468] T ce427f23372c4482b0d022f844b46d32 P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce8113a88cac4c138552565af6c645ca in term 1.
I20260709 12:18:25.009027 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb55848f9c040ac9db9b7849e2a0d8a" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8"
I20260709 12:18:25.010279 16162 leader_election.cc:304] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b61c58ed04b046d48634e2172dc45851, ce8113a88cac4c138552565af6c645ca; no voters: 
I20260709 12:18:25.010504 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a632db0115e4b18a7e169bdf6d970ed" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca" is_pre_election: true
I20260709 12:18:25.011216 16335 raft_consensus.cc:2804] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:25.011229 16272 raft_consensus.cc:2468] T 3a632db0115e4b18a7e169bdf6d970ed P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d58c05fc6fdc40b1bafd92b0c61e34e8 in term 0.
I20260709 12:18:25.011816 16335 raft_consensus.cc:697] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 [term 1 LEADER]: Becoming Leader. State: Replica: b61c58ed04b046d48634e2172dc45851, State: Running, Role: LEADER
I20260709 12:18:25.012653 16335 consensus_queue.cc:237] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:25.010525 16123 raft_consensus.cc:3060] T dbb55848f9c040ac9db9b7849e2a0d8a P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:25.014742 16315 ts_tablet_manager.cc:1403] T 08fa442667044198b448f66ee7350935 P ce8113a88cac4c138552565af6c645ca: Time spent bootstrapping tablet: real 0.042s	user 0.018s	sys 0.007s
I20260709 12:18:25.015537 16341 raft_consensus.cc:515] T 3a632db0115e4b18a7e169bdf6d970ed P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:25.017704 16315 raft_consensus.cc:359] T 08fa442667044198b448f66ee7350935 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:25.018848 16315 raft_consensus.cc:385] T 08fa442667044198b448f66ee7350935 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:25.019189 16315 raft_consensus.cc:740] T 08fa442667044198b448f66ee7350935 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce8113a88cac4c138552565af6c645ca, State: Initialized, Role: FOLLOWER
I20260709 12:18:25.017735 16341 leader_election.cc:290] T 3a632db0115e4b18a7e169bdf6d970ed P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 1 election: Requested vote from peers b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:25.019476 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a632db0115e4b18a7e169bdf6d970ed" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b61c58ed04b046d48634e2172dc45851"
I20260709 12:18:25.020205 16199 raft_consensus.cc:3060] T 3a632db0115e4b18a7e169bdf6d970ed P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:25.020190 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a632db0115e4b18a7e169bdf6d970ed" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca"
I20260709 12:18:25.020310 16314 tablet_bootstrap.cc:654] T 58fbda1848e042e5b821d2c689411fe7 P d58c05fc6fdc40b1bafd92b0c61e34e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:25.021740 16315 consensus_queue.cc:260] T 08fa442667044198b448f66ee7350935 P ce8113a88cac4c138552565af6c645ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:25.020990 16273 raft_consensus.cc:3060] T 3a632db0115e4b18a7e169bdf6d970ed P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:25.024420 16315 ts_tablet_manager.cc:1434] T 08fa442667044198b448f66ee7350935 P ce8113a88cac4c138552565af6c645ca: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:18:25.029111 16123 raft_consensus.cc:2468] T dbb55848f9c040ac9db9b7849e2a0d8a P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b61c58ed04b046d48634e2172dc45851 in term 1.
I20260709 12:18:25.030591 16019 catalog_manager.cc:5697] T 554db18677e043199032d1d23ff3ac7d P ce8113a88cac4c138552565af6c645ca reported cstate change: term changed from 0 to 1, leader changed from <none> to ce8113a88cac4c138552565af6c645ca (127.3.212.131). New cstate: current_term: 1 leader_uuid: "ce8113a88cac4c138552565af6c645ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:25.032660 16019 catalog_manager.cc:5697] T ce427f23372c4482b0d022f844b46d32 P ce8113a88cac4c138552565af6c645ca reported cstate change: term changed from 0 to 1, leader changed from <none> to ce8113a88cac4c138552565af6c645ca (127.3.212.131). New cstate: current_term: 1 leader_uuid: "ce8113a88cac4c138552565af6c645ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:25.036056 16314 tablet_bootstrap.cc:492] T 58fbda1848e042e5b821d2c689411fe7 P d58c05fc6fdc40b1bafd92b0c61e34e8: No bootstrap required, opened a new log
I20260709 12:18:25.036693 16314 ts_tablet_manager.cc:1403] T 58fbda1848e042e5b821d2c689411fe7 P d58c05fc6fdc40b1bafd92b0c61e34e8: Time spent bootstrapping tablet: real 0.042s	user 0.016s	sys 0.002s
I20260709 12:18:25.037971 16199 raft_consensus.cc:2468] T 3a632db0115e4b18a7e169bdf6d970ed P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d58c05fc6fdc40b1bafd92b0c61e34e8 in term 1.
I20260709 12:18:25.039330 16088 leader_election.cc:304] T 3a632db0115e4b18a7e169bdf6d970ed P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: 
I20260709 12:18:25.040145 16341 raft_consensus.cc:2804] T 3a632db0115e4b18a7e169bdf6d970ed P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:25.040627 16341 raft_consensus.cc:697] T 3a632db0115e4b18a7e169bdf6d970ed P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 LEADER]: Becoming Leader. State: Replica: d58c05fc6fdc40b1bafd92b0c61e34e8, State: Running, Role: LEADER
I20260709 12:18:25.041479 16341 consensus_queue.cc:237] T 3a632db0115e4b18a7e169bdf6d970ed P d58c05fc6fdc40b1bafd92b0c61e34e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:25.042368 16273 raft_consensus.cc:2468] T 3a632db0115e4b18a7e169bdf6d970ed P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d58c05fc6fdc40b1bafd92b0c61e34e8 in term 1.
I20260709 12:18:25.039605 16314 raft_consensus.cc:359] T 58fbda1848e042e5b821d2c689411fe7 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } } peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } }
I20260709 12:18:25.043326 16314 raft_consensus.cc:385] T 58fbda1848e042e5b821d2c689411fe7 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:25.043774 16314 raft_consensus.cc:740] T 58fbda1848e042e5b821d2c689411fe7 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d58c05fc6fdc40b1bafd92b0c61e34e8, State: Initialized, Role: FOLLOWER
I20260709 12:18:25.044524 16314 consensus_queue.cc:260] T 58fbda1848e042e5b821d2c689411fe7 P d58c05fc6fdc40b1bafd92b0c61e34e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } } peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } }
I20260709 12:18:25.046922 16314 ts_tablet_manager.cc:1434] T 58fbda1848e042e5b821d2c689411fe7 P d58c05fc6fdc40b1bafd92b0c61e34e8: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:18:25.046337 16021 catalog_manager.cc:5697] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 reported cstate change: term changed from 0 to 1, leader changed from <none> to b61c58ed04b046d48634e2172dc45851 (127.3.212.130). New cstate: current_term: 1 leader_uuid: "b61c58ed04b046d48634e2172dc45851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:25.048811 16341 raft_consensus.cc:493] T 58fbda1848e042e5b821d2c689411fe7 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.049348 16341 raft_consensus.cc:515] T 58fbda1848e042e5b821d2c689411fe7 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } } peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } }
I20260709 12:18:25.052459 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58fbda1848e042e5b821d2c689411fe7" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca" is_pre_election: true
I20260709 12:18:25.051824 16019 catalog_manager.cc:5697] T 3a632db0115e4b18a7e169bdf6d970ed P d58c05fc6fdc40b1bafd92b0c61e34e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129). New cstate: current_term: 1 leader_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:25.052721 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58fbda1848e042e5b821d2c689411fe7" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b61c58ed04b046d48634e2172dc45851" is_pre_election: true
I20260709 12:18:25.053184 16273 raft_consensus.cc:2468] T 58fbda1848e042e5b821d2c689411fe7 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d58c05fc6fdc40b1bafd92b0c61e34e8 in term 0.
I20260709 12:18:25.053493 16199 raft_consensus.cc:2468] T 58fbda1848e042e5b821d2c689411fe7 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d58c05fc6fdc40b1bafd92b0c61e34e8 in term 0.
I20260709 12:18:25.054636 16087 leader_election.cc:304] T 58fbda1848e042e5b821d2c689411fe7 P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce8113a88cac4c138552565af6c645ca, d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: 
I20260709 12:18:25.054958 16341 leader_election.cc:290] T 58fbda1848e042e5b821d2c689411fe7 P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
I20260709 12:18:25.055598 16341 raft_consensus.cc:2804] T 58fbda1848e042e5b821d2c689411fe7 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:25.056001 16341 raft_consensus.cc:493] T 58fbda1848e042e5b821d2c689411fe7 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:25.056352 16341 raft_consensus.cc:3060] T 58fbda1848e042e5b821d2c689411fe7 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:25.063289 16341 raft_consensus.cc:515] T 58fbda1848e042e5b821d2c689411fe7 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } } peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } }
I20260709 12:18:25.066349 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58fbda1848e042e5b821d2c689411fe7" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca"
I20260709 12:18:25.066638 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58fbda1848e042e5b821d2c689411fe7" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b61c58ed04b046d48634e2172dc45851"
I20260709 12:18:25.067086 16273 raft_consensus.cc:3060] T 58fbda1848e042e5b821d2c689411fe7 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:25.067323 16341 leader_election.cc:290] T 58fbda1848e042e5b821d2c689411fe7 P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 1 election: Requested vote from peers ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
I20260709 12:18:25.067400 16199 raft_consensus.cc:3060] T 58fbda1848e042e5b821d2c689411fe7 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:25.074617 16199 raft_consensus.cc:2468] T 58fbda1848e042e5b821d2c689411fe7 P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d58c05fc6fdc40b1bafd92b0c61e34e8 in term 1.
I20260709 12:18:25.075749 16088 leader_election.cc:304] T 58fbda1848e042e5b821d2c689411fe7 P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: 
I20260709 12:18:25.076522 16341 raft_consensus.cc:2804] T 58fbda1848e042e5b821d2c689411fe7 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:25.076768 16273 raft_consensus.cc:2468] T 58fbda1848e042e5b821d2c689411fe7 P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d58c05fc6fdc40b1bafd92b0c61e34e8 in term 1.
I20260709 12:18:25.076946 16341 raft_consensus.cc:697] T 58fbda1848e042e5b821d2c689411fe7 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 LEADER]: Becoming Leader. State: Replica: d58c05fc6fdc40b1bafd92b0c61e34e8, State: Running, Role: LEADER
I20260709 12:18:25.078016 16341 consensus_queue.cc:237] T 58fbda1848e042e5b821d2c689411fe7 P d58c05fc6fdc40b1bafd92b0c61e34e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } } peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } }
I20260709 12:18:25.085726 16021 catalog_manager.cc:5697] T 58fbda1848e042e5b821d2c689411fe7 P d58c05fc6fdc40b1bafd92b0c61e34e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129). New cstate: current_term: 1 leader_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:25.130390 16354 raft_consensus.cc:493] T 08fa442667044198b448f66ee7350935 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.131034 16354 raft_consensus.cc:515] T 08fa442667044198b448f66ee7350935 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:25.132818 16354 leader_election.cc:290] T 08fa442667044198b448f66ee7350935 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
I20260709 12:18:25.133744 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fa442667044198b448f66ee7350935" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" is_pre_election: true
I20260709 12:18:25.133903 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fa442667044198b448f66ee7350935" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b61c58ed04b046d48634e2172dc45851" is_pre_election: true
I20260709 12:18:25.134555 16123 raft_consensus.cc:2393] T 08fa442667044198b448f66ee7350935 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce8113a88cac4c138552565af6c645ca in current term 1: Already voted for candidate b61c58ed04b046d48634e2172dc45851 in this term.
I20260709 12:18:25.135586 16237 leader_election.cc:304] T 08fa442667044198b448f66ee7350935 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce8113a88cac4c138552565af6c645ca; no voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:25.136291 16354 raft_consensus.cc:3060] T 08fa442667044198b448f66ee7350935 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:25.141691 16354 raft_consensus.cc:2749] T 08fa442667044198b448f66ee7350935 P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:25.180315 16335 consensus_queue.cc:1048] T 08fa442667044198b448f66ee7350935 P b61c58ed04b046d48634e2172dc45851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:25.186923 16341 raft_consensus.cc:493] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.187754 16341 raft_consensus.cc:515] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:25.190888 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6725f36431fc4b0fa0f740b0d8e8f7d9" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b61c58ed04b046d48634e2172dc45851" is_pre_election: true
I20260709 12:18:25.191771 16199 raft_consensus.cc:2393] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d58c05fc6fdc40b1bafd92b0c61e34e8 in current term 1: Already voted for candidate ce8113a88cac4c138552565af6c645ca in this term.
I20260709 12:18:25.195529 16341 leader_election.cc:290] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:25.196507 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6725f36431fc4b0fa0f740b0d8e8f7d9" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca" is_pre_election: true
I20260709 12:18:25.204578 16087 leader_election.cc:304] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: b61c58ed04b046d48634e2172dc45851, ce8113a88cac4c138552565af6c645ca
I20260709 12:18:25.206076 16341 raft_consensus.cc:3060] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:25.214294 16371 consensus_queue.cc:1048] T 08fa442667044198b448f66ee7350935 P b61c58ed04b046d48634e2172dc45851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:25.214829 16320 consensus_queue.cc:1048] T 62f91e00d01e497d9eda72bf862ce090 P d58c05fc6fdc40b1bafd92b0c61e34e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:18:25.230804 16341 raft_consensus.cc:2749] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:25.231415 16320 consensus_queue.cc:1048] T 62f91e00d01e497d9eda72bf862ce090 P d58c05fc6fdc40b1bafd92b0c61e34e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:25.234062 16273 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "554db18677e043199032d1d23ff3ac7d"
dest_uuid: "ce8113a88cac4c138552565af6c645ca"
mode: GRACEFUL
new_leader_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8"
 from {username='slave'} at 127.0.0.1:51614
I20260709 12:18:25.234899 16273 raft_consensus.cc:606] T 554db18677e043199032d1d23ff3ac7d P ce8113a88cac4c138552565af6c645ca [term 1 LEADER]: Received request to transfer leadership to TS d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:25.273671 16123 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62f91e00d01e497d9eda72bf862ce090"
dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8"
mode: GRACEFUL
new_leader_uuid: "b61c58ed04b046d48634e2172dc45851"
 from {username='slave'} at 127.0.0.1:38430
I20260709 12:18:25.274389 16123 raft_consensus.cc:606] T 62f91e00d01e497d9eda72bf862ce090 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 LEADER]: Received request to transfer leadership to TS b61c58ed04b046d48634e2172dc45851
I20260709 12:18:25.281821 16272 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6725f36431fc4b0fa0f740b0d8e8f7d9"
dest_uuid: "ce8113a88cac4c138552565af6c645ca"
mode: GRACEFUL
new_leader_uuid: "b61c58ed04b046d48634e2172dc45851"
 from {username='slave'} at 127.0.0.1:51614
I20260709 12:18:25.282702 16272 raft_consensus.cc:606] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca [term 1 LEADER]: Received request to transfer leadership to TS b61c58ed04b046d48634e2172dc45851
I20260709 12:18:25.289340 16320 consensus_queue.cc:1048] T cf4d45c1d3754356973b60c803375a36 P d58c05fc6fdc40b1bafd92b0c61e34e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:25.294430 16273 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce427f23372c4482b0d022f844b46d32"
dest_uuid: "ce8113a88cac4c138552565af6c645ca"
mode: GRACEFUL
new_leader_uuid: "b61c58ed04b046d48634e2172dc45851"
 from {username='slave'} at 127.0.0.1:51614
I20260709 12:18:25.295156 16273 raft_consensus.cc:606] T ce427f23372c4482b0d022f844b46d32 P ce8113a88cac4c138552565af6c645ca [term 1 LEADER]: Received request to transfer leadership to TS b61c58ed04b046d48634e2172dc45851
I20260709 12:18:25.298241 16320 consensus_queue.cc:1048] T cf4d45c1d3754356973b60c803375a36 P d58c05fc6fdc40b1bafd92b0c61e34e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:25.328552 16199 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08fa442667044198b448f66ee7350935"
dest_uuid: "b61c58ed04b046d48634e2172dc45851"
mode: GRACEFUL
new_leader_uuid: "ce8113a88cac4c138552565af6c645ca"
 from {username='slave'} at 127.0.0.1:56450
I20260709 12:18:25.329182 16199 raft_consensus.cc:606] T 08fa442667044198b448f66ee7350935 P b61c58ed04b046d48634e2172dc45851 [term 1 LEADER]: Received request to transfer leadership to TS ce8113a88cac4c138552565af6c645ca
I20260709 12:18:25.337049 16354 consensus_queue.cc:1048] T 554db18677e043199032d1d23ff3ac7d P ce8113a88cac4c138552565af6c645ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:25.348788 16353 consensus_queue.cc:1048] T 554db18677e043199032d1d23ff3ac7d P ce8113a88cac4c138552565af6c645ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:25.357311 16354 raft_consensus.cc:993] T 554db18677e043199032d1d23ff3ac7d P ce8113a88cac4c138552565af6c645ca: : Instructing follower d58c05fc6fdc40b1bafd92b0c61e34e8 to start an election
I20260709 12:18:25.357894 16353 raft_consensus.cc:1081] T 554db18677e043199032d1d23ff3ac7d P ce8113a88cac4c138552565af6c645ca [term 1 LEADER]: Signalling peer d58c05fc6fdc40b1bafd92b0c61e34e8 to start an election
I20260709 12:18:25.359658 16123 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "554db18677e043199032d1d23ff3ac7d"
dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8"
 from {username='slave'} at 127.0.0.1:48586
I20260709 12:18:25.360311 16123 raft_consensus.cc:493] T 554db18677e043199032d1d23ff3ac7d P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:25.360699 16123 raft_consensus.cc:3060] T 554db18677e043199032d1d23ff3ac7d P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:25.366441 16123 raft_consensus.cc:515] T 554db18677e043199032d1d23ff3ac7d P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:25.368432 16123 leader_election.cc:290] T 554db18677e043199032d1d23ff3ac7d P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 2 election: Requested vote from peers b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:25.369251 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554db18677e043199032d1d23ff3ac7d" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b61c58ed04b046d48634e2172dc45851"
I20260709 12:18:25.369724 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554db18677e043199032d1d23ff3ac7d" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce8113a88cac4c138552565af6c645ca"
I20260709 12:18:25.370116 16199 raft_consensus.cc:3060] T 554db18677e043199032d1d23ff3ac7d P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:25.370437 16272 raft_consensus.cc:3055] T 554db18677e043199032d1d23ff3ac7d P ce8113a88cac4c138552565af6c645ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:25.370922 16272 raft_consensus.cc:740] T 554db18677e043199032d1d23ff3ac7d P ce8113a88cac4c138552565af6c645ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ce8113a88cac4c138552565af6c645ca, State: Running, Role: LEADER
I20260709 12:18:25.371766 16272 consensus_queue.cc:260] T 554db18677e043199032d1d23ff3ac7d P ce8113a88cac4c138552565af6c645ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:25.373085 16272 raft_consensus.cc:3060] T 554db18677e043199032d1d23ff3ac7d P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:25.376314 16199 raft_consensus.cc:2468] T 554db18677e043199032d1d23ff3ac7d P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d58c05fc6fdc40b1bafd92b0c61e34e8 in term 2.
I20260709 12:18:25.377535 16088 leader_election.cc:304] T 554db18677e043199032d1d23ff3ac7d P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: 
I20260709 12:18:25.378332 16320 raft_consensus.cc:2804] T 554db18677e043199032d1d23ff3ac7d P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:25.378743 16320 raft_consensus.cc:697] T 554db18677e043199032d1d23ff3ac7d P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 LEADER]: Becoming Leader. State: Replica: d58c05fc6fdc40b1bafd92b0c61e34e8, State: Running, Role: LEADER
I20260709 12:18:25.380033 16272 raft_consensus.cc:2468] T 554db18677e043199032d1d23ff3ac7d P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d58c05fc6fdc40b1bafd92b0c61e34e8 in term 2.
I20260709 12:18:25.379819 16320 consensus_queue.cc:237] T 554db18677e043199032d1d23ff3ac7d P d58c05fc6fdc40b1bafd92b0c61e34e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:25.380399 16353 consensus_queue.cc:1048] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:25.388019 16019 catalog_manager.cc:5697] T 554db18677e043199032d1d23ff3ac7d P d58c05fc6fdc40b1bafd92b0c61e34e8 reported cstate change: term changed from 1 to 2, leader changed from ce8113a88cac4c138552565af6c645ca (127.3.212.131) to d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129). New cstate: current_term: 2 leader_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:25.392760 16353 consensus_queue.cc:1048] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:25.401465 16321 raft_consensus.cc:993] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca: : Instructing follower b61c58ed04b046d48634e2172dc45851 to start an election
I20260709 12:18:25.402000 16353 raft_consensus.cc:1081] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca [term 1 LEADER]: Signalling peer b61c58ed04b046d48634e2172dc45851 to start an election
I20260709 12:18:25.403873 16199 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6725f36431fc4b0fa0f740b0d8e8f7d9"
dest_uuid: "b61c58ed04b046d48634e2172dc45851"
 from {username='slave'} at 127.0.0.1:54026
I20260709 12:18:25.404563 16199 raft_consensus.cc:493] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:25.404990 16199 raft_consensus.cc:3060] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:25.410688 16199 raft_consensus.cc:515] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:25.412410 16199 leader_election.cc:290] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 2 election: Requested vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:25.413635 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6725f36431fc4b0fa0f740b0d8e8f7d9" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8"
I20260709 12:18:25.413882 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6725f36431fc4b0fa0f740b0d8e8f7d9" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce8113a88cac4c138552565af6c645ca"
I20260709 12:18:25.414211 16123 raft_consensus.cc:3060] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:25.414551 16272 raft_consensus.cc:3055] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:25.414852 16272 raft_consensus.cc:740] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ce8113a88cac4c138552565af6c645ca, State: Running, Role: LEADER
I20260709 12:18:25.415527 16272 consensus_queue.cc:260] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:25.416499 16272 raft_consensus.cc:3060] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:25.421125 16123 raft_consensus.cc:2468] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b61c58ed04b046d48634e2172dc45851 in term 2.
I20260709 12:18:25.422303 16272 raft_consensus.cc:2468] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b61c58ed04b046d48634e2172dc45851 in term 2.
I20260709 12:18:25.422379 16164 leader_election.cc:304] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: 
I20260709 12:18:25.423182 16335 raft_consensus.cc:2804] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:25.423563 16335 raft_consensus.cc:697] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P b61c58ed04b046d48634e2172dc45851 [term 2 LEADER]: Becoming Leader. State: Replica: b61c58ed04b046d48634e2172dc45851, State: Running, Role: LEADER
I20260709 12:18:25.424237 16335 consensus_queue.cc:237] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P b61c58ed04b046d48634e2172dc45851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:25.431137 16019 catalog_manager.cc:5697] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P b61c58ed04b046d48634e2172dc45851 reported cstate change: term changed from 1 to 2, leader changed from ce8113a88cac4c138552565af6c645ca (127.3.212.131) to b61c58ed04b046d48634e2172dc45851 (127.3.212.130). New cstate: current_term: 2 leader_uuid: "b61c58ed04b046d48634e2172dc45851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:25.447899 16320 consensus_queue.cc:1048] T 3a632db0115e4b18a7e169bdf6d970ed P d58c05fc6fdc40b1bafd92b0c61e34e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:25.458953 16320 consensus_queue.cc:1048] T 3a632db0115e4b18a7e169bdf6d970ed P d58c05fc6fdc40b1bafd92b0c61e34e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:25.518939 16346 consensus_queue.cc:1048] T 58fbda1848e042e5b821d2c689411fe7 P d58c05fc6fdc40b1bafd92b0c61e34e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:18:25.520248 16335 consensus_queue.cc:1048] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:25.526008 16353 consensus_queue.cc:1048] T ce427f23372c4482b0d022f844b46d32 P ce8113a88cac4c138552565af6c645ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:25.551558 16335 consensus_queue.cc:1048] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:25.553524 16344 consensus_queue.cc:1048] T 58fbda1848e042e5b821d2c689411fe7 P d58c05fc6fdc40b1bafd92b0c61e34e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:25.569703 16353 consensus_queue.cc:1048] T ce427f23372c4482b0d022f844b46d32 P ce8113a88cac4c138552565af6c645ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:25.597606 16321 raft_consensus.cc:993] T ce427f23372c4482b0d022f844b46d32 P ce8113a88cac4c138552565af6c645ca: : Instructing follower b61c58ed04b046d48634e2172dc45851 to start an election
I20260709 12:18:25.598137 16353 raft_consensus.cc:1081] T ce427f23372c4482b0d022f844b46d32 P ce8113a88cac4c138552565af6c645ca [term 1 LEADER]: Signalling peer b61c58ed04b046d48634e2172dc45851 to start an election
I20260709 12:18:25.600445 16198 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ce427f23372c4482b0d022f844b46d32"
dest_uuid: "b61c58ed04b046d48634e2172dc45851"
 from {username='slave'} at 127.0.0.1:54026
I20260709 12:18:25.602581 16198 raft_consensus.cc:493] T ce427f23372c4482b0d022f844b46d32 P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:25.603230 16198 raft_consensus.cc:3060] T ce427f23372c4482b0d022f844b46d32 P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:25.614010 16198 raft_consensus.cc:515] T ce427f23372c4482b0d022f844b46d32 P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:25.615844 16198 leader_election.cc:290] T ce427f23372c4482b0d022f844b46d32 P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 2 election: Requested vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:25.617116 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce427f23372c4482b0d022f844b46d32" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8"
I20260709 12:18:25.617148 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce427f23372c4482b0d022f844b46d32" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce8113a88cac4c138552565af6c645ca"
I20260709 12:18:25.617822 16124 raft_consensus.cc:3060] T ce427f23372c4482b0d022f844b46d32 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:25.618059 16271 raft_consensus.cc:3055] T ce427f23372c4482b0d022f844b46d32 P ce8113a88cac4c138552565af6c645ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:25.618394 16271 raft_consensus.cc:740] T ce427f23372c4482b0d022f844b46d32 P ce8113a88cac4c138552565af6c645ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ce8113a88cac4c138552565af6c645ca, State: Running, Role: LEADER
I20260709 12:18:25.619305 16271 consensus_queue.cc:260] T ce427f23372c4482b0d022f844b46d32 P ce8113a88cac4c138552565af6c645ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:25.620414 16271 raft_consensus.cc:3060] T ce427f23372c4482b0d022f844b46d32 P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:25.625200 16124 raft_consensus.cc:2468] T ce427f23372c4482b0d022f844b46d32 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b61c58ed04b046d48634e2172dc45851 in term 2.
I20260709 12:18:25.626701 16164 leader_election.cc:304] T ce427f23372c4482b0d022f844b46d32 P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: 
I20260709 12:18:25.627591 16319 raft_consensus.cc:2804] T ce427f23372c4482b0d022f844b46d32 P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:25.628091 16319 raft_consensus.cc:697] T ce427f23372c4482b0d022f844b46d32 P b61c58ed04b046d48634e2172dc45851 [term 2 LEADER]: Becoming Leader. State: Replica: b61c58ed04b046d48634e2172dc45851, State: Running, Role: LEADER
I20260709 12:18:25.628360 16271 raft_consensus.cc:2468] T ce427f23372c4482b0d022f844b46d32 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b61c58ed04b046d48634e2172dc45851 in term 2.
I20260709 12:18:25.629215 16319 consensus_queue.cc:237] T ce427f23372c4482b0d022f844b46d32 P b61c58ed04b046d48634e2172dc45851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:25.636583 16022 catalog_manager.cc:5697] T ce427f23372c4482b0d022f844b46d32 P b61c58ed04b046d48634e2172dc45851 reported cstate change: term changed from 1 to 2, leader changed from ce8113a88cac4c138552565af6c645ca (127.3.212.131) to b61c58ed04b046d48634e2172dc45851 (127.3.212.130). New cstate: current_term: 2 leader_uuid: "b61c58ed04b046d48634e2172dc45851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:25.649354 16371 raft_consensus.cc:993] T 08fa442667044198b448f66ee7350935 P b61c58ed04b046d48634e2172dc45851: : Instructing follower ce8113a88cac4c138552565af6c645ca to start an election
I20260709 12:18:25.649866 16319 raft_consensus.cc:1081] T 08fa442667044198b448f66ee7350935 P b61c58ed04b046d48634e2172dc45851 [term 1 LEADER]: Signalling peer ce8113a88cac4c138552565af6c645ca to start an election
I20260709 12:18:25.651613 16271 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "08fa442667044198b448f66ee7350935"
dest_uuid: "ce8113a88cac4c138552565af6c645ca"
 from {username='slave'} at 127.0.0.1:56460
I20260709 12:18:25.652362 16271 raft_consensus.cc:493] T 08fa442667044198b448f66ee7350935 P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:25.652676 16271 raft_consensus.cc:3060] T 08fa442667044198b448f66ee7350935 P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:25.660019 16271 raft_consensus.cc:515] T 08fa442667044198b448f66ee7350935 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:25.662073 16271 leader_election.cc:290] T 08fa442667044198b448f66ee7350935 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 2 election: Requested vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
I20260709 12:18:25.663023 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fa442667044198b448f66ee7350935" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8"
I20260709 12:18:25.663398 16198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fa442667044198b448f66ee7350935" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b61c58ed04b046d48634e2172dc45851"
I20260709 12:18:25.663864 16124 raft_consensus.cc:3060] T 08fa442667044198b448f66ee7350935 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:25.664127 16198 raft_consensus.cc:3055] T 08fa442667044198b448f66ee7350935 P b61c58ed04b046d48634e2172dc45851 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:25.664485 16198 raft_consensus.cc:740] T 08fa442667044198b448f66ee7350935 P b61c58ed04b046d48634e2172dc45851 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b61c58ed04b046d48634e2172dc45851, State: Running, Role: LEADER
I20260709 12:18:25.665588 16198 consensus_queue.cc:260] T 08fa442667044198b448f66ee7350935 P b61c58ed04b046d48634e2172dc45851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:25.667121 16198 raft_consensus.cc:3060] T 08fa442667044198b448f66ee7350935 P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:25.672200 16124 raft_consensus.cc:2468] T 08fa442667044198b448f66ee7350935 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce8113a88cac4c138552565af6c645ca in term 2.
I20260709 12:18:25.673637 16238 leader_election.cc:304] T 08fa442667044198b448f66ee7350935 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce8113a88cac4c138552565af6c645ca, d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: 
I20260709 12:18:25.674597 16353 raft_consensus.cc:2804] T 08fa442667044198b448f66ee7350935 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:25.675056 16353 raft_consensus.cc:697] T 08fa442667044198b448f66ee7350935 P ce8113a88cac4c138552565af6c645ca [term 2 LEADER]: Becoming Leader. State: Replica: ce8113a88cac4c138552565af6c645ca, State: Running, Role: LEADER
I20260709 12:18:25.675169 16198 raft_consensus.cc:2468] T 08fa442667044198b448f66ee7350935 P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce8113a88cac4c138552565af6c645ca in term 2.
I20260709 12:18:25.676157 16353 consensus_queue.cc:237] T 08fa442667044198b448f66ee7350935 P ce8113a88cac4c138552565af6c645ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:25.683585 16022 catalog_manager.cc:5697] T 08fa442667044198b448f66ee7350935 P ce8113a88cac4c138552565af6c645ca reported cstate change: term changed from 1 to 2, leader changed from b61c58ed04b046d48634e2172dc45851 (127.3.212.130) to ce8113a88cac4c138552565af6c645ca (127.3.212.131). New cstate: current_term: 2 leader_uuid: "ce8113a88cac4c138552565af6c645ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:25.817709 16344 raft_consensus.cc:993] T 62f91e00d01e497d9eda72bf862ce090 P d58c05fc6fdc40b1bafd92b0c61e34e8: : Instructing follower b61c58ed04b046d48634e2172dc45851 to start an election
I20260709 12:18:25.818210 16344 raft_consensus.cc:1081] T 62f91e00d01e497d9eda72bf862ce090 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 LEADER]: Signalling peer b61c58ed04b046d48634e2172dc45851 to start an election
I20260709 12:18:25.819911 16198 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "62f91e00d01e497d9eda72bf862ce090"
dest_uuid: "b61c58ed04b046d48634e2172dc45851"
 from {username='slave'} at 127.0.0.1:54022
I20260709 12:18:25.820417 16198 raft_consensus.cc:493] T 62f91e00d01e497d9eda72bf862ce090 P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:25.820737 16198 raft_consensus.cc:3060] T 62f91e00d01e497d9eda72bf862ce090 P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:25.826380 16198 raft_consensus.cc:515] T 62f91e00d01e497d9eda72bf862ce090 P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:25.828199 16198 leader_election.cc:290] T 62f91e00d01e497d9eda72bf862ce090 P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 2 election: Requested vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:25.829334 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f91e00d01e497d9eda72bf862ce090" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8"
I20260709 12:18:25.829519 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f91e00d01e497d9eda72bf862ce090" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce8113a88cac4c138552565af6c645ca"
I20260709 12:18:25.829990 16124 raft_consensus.cc:3055] T 62f91e00d01e497d9eda72bf862ce090 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:25.830171 16271 raft_consensus.cc:3060] T 62f91e00d01e497d9eda72bf862ce090 P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:25.830317 16124 raft_consensus.cc:740] T 62f91e00d01e497d9eda72bf862ce090 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d58c05fc6fdc40b1bafd92b0c61e34e8, State: Running, Role: LEADER
I20260709 12:18:25.831281 16124 consensus_queue.cc:260] T 62f91e00d01e497d9eda72bf862ce090 P d58c05fc6fdc40b1bafd92b0c61e34e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:25.832633 16124 raft_consensus.cc:3060] T 62f91e00d01e497d9eda72bf862ce090 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:25.837029 16271 raft_consensus.cc:2468] T 62f91e00d01e497d9eda72bf862ce090 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b61c58ed04b046d48634e2172dc45851 in term 2.
I20260709 12:18:25.837742 16124 raft_consensus.cc:2468] T 62f91e00d01e497d9eda72bf862ce090 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b61c58ed04b046d48634e2172dc45851 in term 2.
I20260709 12:18:25.838811 16162 leader_election.cc:304] T 62f91e00d01e497d9eda72bf862ce090 P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b61c58ed04b046d48634e2172dc45851, ce8113a88cac4c138552565af6c645ca; no voters: 
I20260709 12:18:25.839787 16319 raft_consensus.cc:2804] T 62f91e00d01e497d9eda72bf862ce090 P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:25.840175 16319 raft_consensus.cc:697] T 62f91e00d01e497d9eda72bf862ce090 P b61c58ed04b046d48634e2172dc45851 [term 2 LEADER]: Becoming Leader. State: Replica: b61c58ed04b046d48634e2172dc45851, State: Running, Role: LEADER
I20260709 12:18:25.841046 16319 consensus_queue.cc:237] T 62f91e00d01e497d9eda72bf862ce090 P b61c58ed04b046d48634e2172dc45851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:25.848829 16022 catalog_manager.cc:5697] T 62f91e00d01e497d9eda72bf862ce090 P b61c58ed04b046d48634e2172dc45851 reported cstate change: term changed from 1 to 2, leader changed from d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129) to b61c58ed04b046d48634e2172dc45851 (127.3.212.130). New cstate: current_term: 2 leader_uuid: "b61c58ed04b046d48634e2172dc45851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:25.854884 16198 raft_consensus.cc:1275] T 554db18677e043199032d1d23ff3ac7d P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Refusing update from remote peer d58c05fc6fdc40b1bafd92b0c61e34e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:25.856295 16344 consensus_queue.cc:1048] T 554db18677e043199032d1d23ff3ac7d P d58c05fc6fdc40b1bafd92b0c61e34e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:25.864218 16271 raft_consensus.cc:1275] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Refusing update from remote peer b61c58ed04b046d48634e2172dc45851: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:25.866439 16271 raft_consensus.cc:1275] T 554db18677e043199032d1d23ff3ac7d P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Refusing update from remote peer d58c05fc6fdc40b1bafd92b0c61e34e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:25.867770 16371 consensus_queue.cc:1048] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P b61c58ed04b046d48634e2172dc45851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:25.870839 16344 consensus_queue.cc:1048] T 554db18677e043199032d1d23ff3ac7d P d58c05fc6fdc40b1bafd92b0c61e34e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:25.881283 16124 raft_consensus.cc:1275] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Refusing update from remote peer b61c58ed04b046d48634e2172dc45851: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:25.882889 16319 consensus_queue.cc:1048] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P b61c58ed04b046d48634e2172dc45851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:26.026968 16271 raft_consensus.cc:1275] T ce427f23372c4482b0d022f844b46d32 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Refusing update from remote peer b61c58ed04b046d48634e2172dc45851: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:26.028379 16319 consensus_queue.cc:1048] T ce427f23372c4482b0d022f844b46d32 P b61c58ed04b046d48634e2172dc45851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:26.036461 16124 raft_consensus.cc:1275] T ce427f23372c4482b0d022f844b46d32 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Refusing update from remote peer b61c58ed04b046d48634e2172dc45851: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:26.038120 16371 consensus_queue.cc:1048] T ce427f23372c4482b0d022f844b46d32 P b61c58ed04b046d48634e2172dc45851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:26.125358 16198 raft_consensus.cc:1275] T 08fa442667044198b448f66ee7350935 P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Refusing update from remote peer ce8113a88cac4c138552565af6c645ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:26.126785 16353 consensus_queue.cc:1048] T 08fa442667044198b448f66ee7350935 P ce8113a88cac4c138552565af6c645ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:26.137216 16124 raft_consensus.cc:1275] T 08fa442667044198b448f66ee7350935 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Refusing update from remote peer ce8113a88cac4c138552565af6c645ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:26.141609 16353 consensus_queue.cc:1048] T 08fa442667044198b448f66ee7350935 P ce8113a88cac4c138552565af6c645ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:26.283020 16271 raft_consensus.cc:1275] T 62f91e00d01e497d9eda72bf862ce090 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Refusing update from remote peer b61c58ed04b046d48634e2172dc45851: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:26.284264 16335 consensus_queue.cc:1048] T 62f91e00d01e497d9eda72bf862ce090 P b61c58ed04b046d48634e2172dc45851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:26.294914 16124 raft_consensus.cc:1275] T 62f91e00d01e497d9eda72bf862ce090 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Refusing update from remote peer b61c58ed04b046d48634e2172dc45851: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:26.296485 16319 consensus_queue.cc:1048] T 62f91e00d01e497d9eda72bf862ce090 P b61c58ed04b046d48634e2172dc45851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:28.365213 16019 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37242:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:18:28.367933 16019 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:18:28.420960 16114 tablet_service.cc:1511] Processing CreateTablet for tablet 7063d3a4c2fb4a2eb8cd6edcae5eb2ac (DEFAULT_TABLE table=soft_deleted_table [id=90f938c5385f45b4889932dadaae1cca]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:18:28.422082 16182 tablet_service.cc:1511] Processing CreateTablet for tablet 7063d3a4c2fb4a2eb8cd6edcae5eb2ac (DEFAULT_TABLE table=soft_deleted_table [id=90f938c5385f45b4889932dadaae1cca]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:18:28.422952 16114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7063d3a4c2fb4a2eb8cd6edcae5eb2ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:28.423799 16182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7063d3a4c2fb4a2eb8cd6edcae5eb2ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:28.425076 16109 tablet_service.cc:1511] Processing CreateTablet for tablet 1dcba4c6f61b41eab71ddaafd49ed11f (DEFAULT_TABLE table=soft_deleted_table [id=90f938c5385f45b4889932dadaae1cca]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:18:28.426651 16109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dcba4c6f61b41eab71ddaafd49ed11f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:28.426465 16260 tablet_service.cc:1511] Processing CreateTablet for tablet 7063d3a4c2fb4a2eb8cd6edcae5eb2ac (DEFAULT_TABLE table=soft_deleted_table [id=90f938c5385f45b4889932dadaae1cca]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:18:28.428073 16260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7063d3a4c2fb4a2eb8cd6edcae5eb2ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:28.430826 16186 tablet_service.cc:1511] Processing CreateTablet for tablet 1dcba4c6f61b41eab71ddaafd49ed11f (DEFAULT_TABLE table=soft_deleted_table [id=90f938c5385f45b4889932dadaae1cca]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:18:28.432051 16255 tablet_service.cc:1511] Processing CreateTablet for tablet 1dcba4c6f61b41eab71ddaafd49ed11f (DEFAULT_TABLE table=soft_deleted_table [id=90f938c5385f45b4889932dadaae1cca]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:18:28.435622 16184 tablet_service.cc:1511] Processing CreateTablet for tablet 7428466d80bc4b3b8fb4346741658617 (DEFAULT_TABLE table=soft_deleted_table [id=90f938c5385f45b4889932dadaae1cca]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:18:28.437709 16110 tablet_service.cc:1511] Processing CreateTablet for tablet 7428466d80bc4b3b8fb4346741658617 (DEFAULT_TABLE table=soft_deleted_table [id=90f938c5385f45b4889932dadaae1cca]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:18:28.439495 16110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7428466d80bc4b3b8fb4346741658617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:28.445806 16255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dcba4c6f61b41eab71ddaafd49ed11f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:28.446844 16263 tablet_service.cc:1511] Processing CreateTablet for tablet 7428466d80bc4b3b8fb4346741658617 (DEFAULT_TABLE table=soft_deleted_table [id=90f938c5385f45b4889932dadaae1cca]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:18:28.448534 16263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7428466d80bc4b3b8fb4346741658617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:28.449658 16189 tablet_service.cc:1511] Processing CreateTablet for tablet 1e0b2bd53e024a3c8e84fd8372196c8e (DEFAULT_TABLE table=soft_deleted_table [id=90f938c5385f45b4889932dadaae1cca]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:18:28.451968 16107 tablet_service.cc:1511] Processing CreateTablet for tablet 1e0b2bd53e024a3c8e84fd8372196c8e (DEFAULT_TABLE table=soft_deleted_table [id=90f938c5385f45b4889932dadaae1cca]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:18:28.453527 16107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e0b2bd53e024a3c8e84fd8372196c8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:28.455299 16188 tablet_service.cc:1511] Processing CreateTablet for tablet 3c0f4313ed9e402d9c4067f38e69a61d (DEFAULT_TABLE table=soft_deleted_table [id=90f938c5385f45b4889932dadaae1cca]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:18:28.458853 16183 tablet_service.cc:1511] Processing CreateTablet for tablet 4c50e97dfcc74bceb3b7d7db53a47278 (DEFAULT_TABLE table=soft_deleted_table [id=90f938c5385f45b4889932dadaae1cca]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:18:28.460014 16108 tablet_service.cc:1511] Processing CreateTablet for tablet 3c0f4313ed9e402d9c4067f38e69a61d (DEFAULT_TABLE table=soft_deleted_table [id=90f938c5385f45b4889932dadaae1cca]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:18:28.432665 16186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dcba4c6f61b41eab71ddaafd49ed11f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:28.462951 16112 tablet_service.cc:1511] Processing CreateTablet for tablet 4c50e97dfcc74bceb3b7d7db53a47278 (DEFAULT_TABLE table=soft_deleted_table [id=90f938c5385f45b4889932dadaae1cca]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:18:28.464820 16108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c0f4313ed9e402d9c4067f38e69a61d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:28.464488 16181 tablet_service.cc:1511] Processing CreateTablet for tablet 0e5a7f087bcb4438adaf7e1dd6aaf10e (DEFAULT_TABLE table=soft_deleted_table [id=90f938c5385f45b4889932dadaae1cca]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:18:28.465559 16183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c50e97dfcc74bceb3b7d7db53a47278. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:28.465998 16112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c50e97dfcc74bceb3b7d7db53a47278. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:28.466554 16188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c0f4313ed9e402d9c4067f38e69a61d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:28.468358 16189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e0b2bd53e024a3c8e84fd8372196c8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:28.469298 16181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e5a7f087bcb4438adaf7e1dd6aaf10e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:28.470489 16184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7428466d80bc4b3b8fb4346741658617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:28.472280 16257 tablet_service.cc:1511] Processing CreateTablet for tablet 1e0b2bd53e024a3c8e84fd8372196c8e (DEFAULT_TABLE table=soft_deleted_table [id=90f938c5385f45b4889932dadaae1cca]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:18:28.472657 16256 tablet_service.cc:1511] Processing CreateTablet for tablet 3c0f4313ed9e402d9c4067f38e69a61d (DEFAULT_TABLE table=soft_deleted_table [id=90f938c5385f45b4889932dadaae1cca]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:18:28.473817 16257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e0b2bd53e024a3c8e84fd8372196c8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:28.474231 16113 tablet_service.cc:1511] Processing CreateTablet for tablet 0e5a7f087bcb4438adaf7e1dd6aaf10e (DEFAULT_TABLE table=soft_deleted_table [id=90f938c5385f45b4889932dadaae1cca]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:18:28.475222 16261 tablet_service.cc:1511] Processing CreateTablet for tablet 4c50e97dfcc74bceb3b7d7db53a47278 (DEFAULT_TABLE table=soft_deleted_table [id=90f938c5385f45b4889932dadaae1cca]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:18:28.476583 16261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c50e97dfcc74bceb3b7d7db53a47278. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:28.475656 16113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e5a7f087bcb4438adaf7e1dd6aaf10e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:28.480804 16256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c0f4313ed9e402d9c4067f38e69a61d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:28.483029 16259 tablet_service.cc:1511] Processing CreateTablet for tablet 0e5a7f087bcb4438adaf7e1dd6aaf10e (DEFAULT_TABLE table=soft_deleted_table [id=90f938c5385f45b4889932dadaae1cca]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:18:28.485316 16259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e5a7f087bcb4438adaf7e1dd6aaf10e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:28.529438 16111 tablet_service.cc:1511] Processing CreateTablet for tablet 7934a0be864f472b90de8265010eb7d1 (DEFAULT_TABLE table=soft_deleted_table [id=90f938c5385f45b4889932dadaae1cca]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:18:28.530988 16111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7934a0be864f472b90de8265010eb7d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:28.532038 16185 tablet_service.cc:1511] Processing CreateTablet for tablet 7934a0be864f472b90de8265010eb7d1 (DEFAULT_TABLE table=soft_deleted_table [id=90f938c5385f45b4889932dadaae1cca]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:18:28.540328 16185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7934a0be864f472b90de8265010eb7d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:28.555840 16258 tablet_service.cc:1511] Processing CreateTablet for tablet 7934a0be864f472b90de8265010eb7d1 (DEFAULT_TABLE table=soft_deleted_table [id=90f938c5385f45b4889932dadaae1cca]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:18:28.557561 16258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7934a0be864f472b90de8265010eb7d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:28.576351 16106 tablet_service.cc:1511] Processing CreateTablet for tablet 5fef361fdd2840b6b5af55b92f7343a0 (DEFAULT_TABLE table=soft_deleted_table [id=90f938c5385f45b4889932dadaae1cca]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:18:28.577409 16187 tablet_service.cc:1511] Processing CreateTablet for tablet 5fef361fdd2840b6b5af55b92f7343a0 (DEFAULT_TABLE table=soft_deleted_table [id=90f938c5385f45b4889932dadaae1cca]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:18:28.577904 16106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fef361fdd2840b6b5af55b92f7343a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:28.578903 16187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fef361fdd2840b6b5af55b92f7343a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:28.584935 16262 tablet_service.cc:1511] Processing CreateTablet for tablet 5fef361fdd2840b6b5af55b92f7343a0 (DEFAULT_TABLE table=soft_deleted_table [id=90f938c5385f45b4889932dadaae1cca]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:18:28.586484 16262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fef361fdd2840b6b5af55b92f7343a0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:18:28.594405 16087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:45363, user_credentials={real_user=slave}} blocked reactor thread for 63224.8us
I20260709 12:18:28.599181 16409 tablet_bootstrap.cc:492] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P d58c05fc6fdc40b1bafd92b0c61e34e8: Bootstrap starting.
I20260709 12:18:28.649735 16411 tablet_bootstrap.cc:492] T 3c0f4313ed9e402d9c4067f38e69a61d P b61c58ed04b046d48634e2172dc45851: Bootstrap starting.
I20260709 12:18:28.653657 16412 tablet_bootstrap.cc:492] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca: Bootstrap starting.
I20260709 12:18:28.657452 16409 tablet_bootstrap.cc:654] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P d58c05fc6fdc40b1bafd92b0c61e34e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:28.661628 16412 tablet_bootstrap.cc:654] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:28.677273 16412 tablet_bootstrap.cc:492] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca: No bootstrap required, opened a new log
I20260709 12:18:28.678382 16412 ts_tablet_manager.cc:1403] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca: Time spent bootstrapping tablet: real 0.025s	user 0.005s	sys 0.010s
I20260709 12:18:28.678946 16411 tablet_bootstrap.cc:654] T 3c0f4313ed9e402d9c4067f38e69a61d P b61c58ed04b046d48634e2172dc45851: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:28.682328 16412 raft_consensus.cc:359] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:28.683432 16412 raft_consensus.cc:385] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:28.683693 16412 raft_consensus.cc:740] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce8113a88cac4c138552565af6c645ca, State: Initialized, Role: FOLLOWER
I20260709 12:18:28.684397 16412 consensus_queue.cc:260] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:28.686990 16412 ts_tablet_manager.cc:1434] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:18:28.688149 16412 tablet_bootstrap.cc:492] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca: Bootstrap starting.
I20260709 12:18:28.693203 16411 tablet_bootstrap.cc:492] T 3c0f4313ed9e402d9c4067f38e69a61d P b61c58ed04b046d48634e2172dc45851: No bootstrap required, opened a new log
I20260709 12:18:28.693950 16411 ts_tablet_manager.cc:1403] T 3c0f4313ed9e402d9c4067f38e69a61d P b61c58ed04b046d48634e2172dc45851: Time spent bootstrapping tablet: real 0.045s	user 0.014s	sys 0.007s
I20260709 12:18:28.697115 16412 tablet_bootstrap.cc:654] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:28.697444 16411 raft_consensus.cc:359] T 3c0f4313ed9e402d9c4067f38e69a61d P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:28.698348 16411 raft_consensus.cc:385] T 3c0f4313ed9e402d9c4067f38e69a61d P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:28.698633 16411 raft_consensus.cc:740] T 3c0f4313ed9e402d9c4067f38e69a61d P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b61c58ed04b046d48634e2172dc45851, State: Initialized, Role: FOLLOWER
I20260709 12:18:28.699496 16411 consensus_queue.cc:260] T 3c0f4313ed9e402d9c4067f38e69a61d P b61c58ed04b046d48634e2172dc45851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:28.703006 16411 ts_tablet_manager.cc:1434] T 3c0f4313ed9e402d9c4067f38e69a61d P b61c58ed04b046d48634e2172dc45851: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:18:28.704376 16411 tablet_bootstrap.cc:492] T 1e0b2bd53e024a3c8e84fd8372196c8e P b61c58ed04b046d48634e2172dc45851: Bootstrap starting.
I20260709 12:18:28.705166 16409 tablet_bootstrap.cc:492] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P d58c05fc6fdc40b1bafd92b0c61e34e8: No bootstrap required, opened a new log
I20260709 12:18:28.705891 16409 ts_tablet_manager.cc:1403] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P d58c05fc6fdc40b1bafd92b0c61e34e8: Time spent bootstrapping tablet: real 0.107s	user 0.019s	sys 0.020s
I20260709 12:18:28.710105 16409 raft_consensus.cc:359] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:28.710630 16319 raft_consensus.cc:493] T 3c0f4313ed9e402d9c4067f38e69a61d P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.710978 16409 raft_consensus.cc:385] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:28.711560 16409 raft_consensus.cc:740] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d58c05fc6fdc40b1bafd92b0c61e34e8, State: Initialized, Role: FOLLOWER
I20260709 12:18:28.711520 16319 raft_consensus.cc:515] T 3c0f4313ed9e402d9c4067f38e69a61d P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:28.712080 16411 tablet_bootstrap.cc:654] T 1e0b2bd53e024a3c8e84fd8372196c8e P b61c58ed04b046d48634e2172dc45851: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:28.712455 16409 consensus_queue.cc:260] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P d58c05fc6fdc40b1bafd92b0c61e34e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:28.715180 16409 ts_tablet_manager.cc:1434] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P d58c05fc6fdc40b1bafd92b0c61e34e8: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:18:28.716445 16409 tablet_bootstrap.cc:492] T 1dcba4c6f61b41eab71ddaafd49ed11f P d58c05fc6fdc40b1bafd92b0c61e34e8: Bootstrap starting.
I20260709 12:18:28.717975 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0f4313ed9e402d9c4067f38e69a61d" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" is_pre_election: true
W20260709 12:18:28.719777 16164 leader_election.cc:343] T 3c0f4313ed9e402d9c4067f38e69a61d P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:28.724344 16409 tablet_bootstrap.cc:654] T 1dcba4c6f61b41eab71ddaafd49ed11f P d58c05fc6fdc40b1bafd92b0c61e34e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:28.725566 16319 leader_election.cc:290] T 3c0f4313ed9e402d9c4067f38e69a61d P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:28.744588 16412 tablet_bootstrap.cc:492] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca: No bootstrap required, opened a new log
I20260709 12:18:28.745237 16412 ts_tablet_manager.cc:1403] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca: Time spent bootstrapping tablet: real 0.057s	user 0.007s	sys 0.006s
I20260709 12:18:28.747653 16411 tablet_bootstrap.cc:492] T 1e0b2bd53e024a3c8e84fd8372196c8e P b61c58ed04b046d48634e2172dc45851: No bootstrap required, opened a new log
I20260709 12:18:28.748420 16411 ts_tablet_manager.cc:1403] T 1e0b2bd53e024a3c8e84fd8372196c8e P b61c58ed04b046d48634e2172dc45851: Time spent bootstrapping tablet: real 0.044s	user 0.021s	sys 0.020s
I20260709 12:18:28.747924 16412 raft_consensus.cc:359] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:28.748997 16412 raft_consensus.cc:385] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:28.750766 16412 raft_consensus.cc:740] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce8113a88cac4c138552565af6c645ca, State: Initialized, Role: FOLLOWER
I20260709 12:18:28.751758 16412 consensus_queue.cc:260] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:28.752449 16409 tablet_bootstrap.cc:492] T 1dcba4c6f61b41eab71ddaafd49ed11f P d58c05fc6fdc40b1bafd92b0c61e34e8: No bootstrap required, opened a new log
I20260709 12:18:28.753042 16409 ts_tablet_manager.cc:1403] T 1dcba4c6f61b41eab71ddaafd49ed11f P d58c05fc6fdc40b1bafd92b0c61e34e8: Time spent bootstrapping tablet: real 0.037s	user 0.027s	sys 0.007s
I20260709 12:18:28.752007 16411 raft_consensus.cc:359] T 1e0b2bd53e024a3c8e84fd8372196c8e P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:28.754427 16411 raft_consensus.cc:385] T 1e0b2bd53e024a3c8e84fd8372196c8e P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:28.754726 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0f4313ed9e402d9c4067f38e69a61d" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca" is_pre_election: true
W20260709 12:18:28.756283 16162 leader_election.cc:343] T 3c0f4313ed9e402d9c4067f38e69a61d P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:28.756953 16162 leader_election.cc:304] T 3c0f4313ed9e402d9c4067f38e69a61d P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b61c58ed04b046d48634e2172dc45851; no voters: ce8113a88cac4c138552565af6c645ca, d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:28.757792 16418 raft_consensus.cc:2749] T 3c0f4313ed9e402d9c4067f38e69a61d P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:28.756246 16409 raft_consensus.cc:359] T 1dcba4c6f61b41eab71ddaafd49ed11f P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:28.759019 16409 raft_consensus.cc:385] T 1dcba4c6f61b41eab71ddaafd49ed11f P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:28.754742 16411 raft_consensus.cc:740] T 1e0b2bd53e024a3c8e84fd8372196c8e P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b61c58ed04b046d48634e2172dc45851, State: Initialized, Role: FOLLOWER
I20260709 12:18:28.759861 16409 raft_consensus.cc:740] T 1dcba4c6f61b41eab71ddaafd49ed11f P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d58c05fc6fdc40b1bafd92b0c61e34e8, State: Initialized, Role: FOLLOWER
I20260709 12:18:28.760334 16411 consensus_queue.cc:260] T 1e0b2bd53e024a3c8e84fd8372196c8e P b61c58ed04b046d48634e2172dc45851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:28.760722 16409 consensus_queue.cc:260] T 1dcba4c6f61b41eab71ddaafd49ed11f P d58c05fc6fdc40b1bafd92b0c61e34e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:28.762742 16411 ts_tablet_manager.cc:1434] T 1e0b2bd53e024a3c8e84fd8372196c8e P b61c58ed04b046d48634e2172dc45851: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.007s
I20260709 12:18:28.763387 16409 ts_tablet_manager.cc:1434] T 1dcba4c6f61b41eab71ddaafd49ed11f P d58c05fc6fdc40b1bafd92b0c61e34e8: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:18:28.763919 16411 tablet_bootstrap.cc:492] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P b61c58ed04b046d48634e2172dc45851: Bootstrap starting.
I20260709 12:18:28.764438 16409 tablet_bootstrap.cc:492] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P d58c05fc6fdc40b1bafd92b0c61e34e8: Bootstrap starting.
I20260709 12:18:28.759012 16412 ts_tablet_manager.cc:1434] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:18:28.766499 16412 tablet_bootstrap.cc:492] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca: Bootstrap starting.
I20260709 12:18:28.771683 16409 tablet_bootstrap.cc:654] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P d58c05fc6fdc40b1bafd92b0c61e34e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:28.771903 16411 tablet_bootstrap.cc:654] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P b61c58ed04b046d48634e2172dc45851: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:28.773958 16412 tablet_bootstrap.cc:654] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:28.787799 16412 tablet_bootstrap.cc:492] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca: No bootstrap required, opened a new log
I20260709 12:18:28.788592 16412 ts_tablet_manager.cc:1403] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.001s
I20260709 12:18:28.790002 16411 tablet_bootstrap.cc:492] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P b61c58ed04b046d48634e2172dc45851: No bootstrap required, opened a new log
I20260709 12:18:28.790697 16411 ts_tablet_manager.cc:1403] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P b61c58ed04b046d48634e2172dc45851: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.015s
I20260709 12:18:28.791894 16412 raft_consensus.cc:359] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:28.792743 16412 raft_consensus.cc:385] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:28.793041 16412 raft_consensus.cc:740] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce8113a88cac4c138552565af6c645ca, State: Initialized, Role: FOLLOWER
I20260709 12:18:28.793892 16412 consensus_queue.cc:260] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:28.794245 16411 raft_consensus.cc:359] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:28.795142 16411 raft_consensus.cc:385] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:28.795491 16411 raft_consensus.cc:740] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b61c58ed04b046d48634e2172dc45851, State: Initialized, Role: FOLLOWER
I20260709 12:18:28.796406 16412 ts_tablet_manager.cc:1434] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:18:28.796396 16411 consensus_queue.cc:260] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P b61c58ed04b046d48634e2172dc45851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:28.797617 16412 tablet_bootstrap.cc:492] T 1dcba4c6f61b41eab71ddaafd49ed11f P ce8113a88cac4c138552565af6c645ca: Bootstrap starting.
I20260709 12:18:28.799139 16411 ts_tablet_manager.cc:1434] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P b61c58ed04b046d48634e2172dc45851: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.005s
I20260709 12:18:28.799391 16409 tablet_bootstrap.cc:492] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P d58c05fc6fdc40b1bafd92b0c61e34e8: No bootstrap required, opened a new log
I20260709 12:18:28.799935 16409 ts_tablet_manager.cc:1403] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P d58c05fc6fdc40b1bafd92b0c61e34e8: Time spent bootstrapping tablet: real 0.036s	user 0.005s	sys 0.025s
I20260709 12:18:28.803416 16409 raft_consensus.cc:359] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:28.804194 16409 raft_consensus.cc:385] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:28.804339 16411 tablet_bootstrap.cc:492] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P b61c58ed04b046d48634e2172dc45851: Bootstrap starting.
I20260709 12:18:28.804519 16409 raft_consensus.cc:740] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d58c05fc6fdc40b1bafd92b0c61e34e8, State: Initialized, Role: FOLLOWER
I20260709 12:18:28.805689 16412 tablet_bootstrap.cc:654] T 1dcba4c6f61b41eab71ddaafd49ed11f P ce8113a88cac4c138552565af6c645ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:28.805609 16409 consensus_queue.cc:260] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P d58c05fc6fdc40b1bafd92b0c61e34e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:28.808120 16409 ts_tablet_manager.cc:1434] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P d58c05fc6fdc40b1bafd92b0c61e34e8: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:18:28.809430 16409 tablet_bootstrap.cc:492] T 3c0f4313ed9e402d9c4067f38e69a61d P d58c05fc6fdc40b1bafd92b0c61e34e8: Bootstrap starting.
I20260709 12:18:28.813779 16411 tablet_bootstrap.cc:654] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P b61c58ed04b046d48634e2172dc45851: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:28.816541 16409 tablet_bootstrap.cc:654] T 3c0f4313ed9e402d9c4067f38e69a61d P d58c05fc6fdc40b1bafd92b0c61e34e8: Neither blocks nor log segments found. Creating new log.
W20260709 12:18:28.819722 16070 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:18:28.823113 16412 tablet_bootstrap.cc:492] T 1dcba4c6f61b41eab71ddaafd49ed11f P ce8113a88cac4c138552565af6c645ca: No bootstrap required, opened a new log
I20260709 12:18:28.823827 16412 ts_tablet_manager.cc:1403] T 1dcba4c6f61b41eab71ddaafd49ed11f P ce8113a88cac4c138552565af6c645ca: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.009s
I20260709 12:18:28.827693 16411 tablet_bootstrap.cc:492] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P b61c58ed04b046d48634e2172dc45851: No bootstrap required, opened a new log
I20260709 12:18:28.827407 16412 raft_consensus.cc:359] T 1dcba4c6f61b41eab71ddaafd49ed11f P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:28.828297 16412 raft_consensus.cc:385] T 1dcba4c6f61b41eab71ddaafd49ed11f P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:28.828467 16411 ts_tablet_manager.cc:1403] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P b61c58ed04b046d48634e2172dc45851: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.008s
I20260709 12:18:28.828703 16412 raft_consensus.cc:740] T 1dcba4c6f61b41eab71ddaafd49ed11f P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce8113a88cac4c138552565af6c645ca, State: Initialized, Role: FOLLOWER
I20260709 12:18:28.829665 16412 consensus_queue.cc:260] T 1dcba4c6f61b41eab71ddaafd49ed11f P ce8113a88cac4c138552565af6c645ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:28.832386 16411 raft_consensus.cc:359] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:28.833300 16411 raft_consensus.cc:385] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:28.833688 16411 raft_consensus.cc:740] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b61c58ed04b046d48634e2172dc45851, State: Initialized, Role: FOLLOWER
I20260709 12:18:28.834628 16411 consensus_queue.cc:260] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P b61c58ed04b046d48634e2172dc45851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:28.838502 16409 tablet_bootstrap.cc:492] T 3c0f4313ed9e402d9c4067f38e69a61d P d58c05fc6fdc40b1bafd92b0c61e34e8: No bootstrap required, opened a new log
I20260709 12:18:28.838776 16411 ts_tablet_manager.cc:1434] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P b61c58ed04b046d48634e2172dc45851: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:18:28.839161 16409 ts_tablet_manager.cc:1403] T 3c0f4313ed9e402d9c4067f38e69a61d P d58c05fc6fdc40b1bafd92b0c61e34e8: Time spent bootstrapping tablet: real 0.030s	user 0.007s	sys 0.019s
I20260709 12:18:28.839996 16412 ts_tablet_manager.cc:1434] T 1dcba4c6f61b41eab71ddaafd49ed11f P ce8113a88cac4c138552565af6c645ca: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.003s
I20260709 12:18:28.840410 16411 tablet_bootstrap.cc:492] T 5fef361fdd2840b6b5af55b92f7343a0 P b61c58ed04b046d48634e2172dc45851: Bootstrap starting.
I20260709 12:18:28.841331 16412 tablet_bootstrap.cc:492] T 7428466d80bc4b3b8fb4346741658617 P ce8113a88cac4c138552565af6c645ca: Bootstrap starting.
I20260709 12:18:28.842684 16409 raft_consensus.cc:359] T 3c0f4313ed9e402d9c4067f38e69a61d P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:28.843494 16409 raft_consensus.cc:385] T 3c0f4313ed9e402d9c4067f38e69a61d P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:28.843791 16409 raft_consensus.cc:740] T 3c0f4313ed9e402d9c4067f38e69a61d P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d58c05fc6fdc40b1bafd92b0c61e34e8, State: Initialized, Role: FOLLOWER
I20260709 12:18:28.844568 16409 consensus_queue.cc:260] T 3c0f4313ed9e402d9c4067f38e69a61d P d58c05fc6fdc40b1bafd92b0c61e34e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:28.847301 16409 ts_tablet_manager.cc:1434] T 3c0f4313ed9e402d9c4067f38e69a61d P d58c05fc6fdc40b1bafd92b0c61e34e8: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:18:28.848450 16409 tablet_bootstrap.cc:492] T 4c50e97dfcc74bceb3b7d7db53a47278 P d58c05fc6fdc40b1bafd92b0c61e34e8: Bootstrap starting.
I20260709 12:18:28.848588 16411 tablet_bootstrap.cc:654] T 5fef361fdd2840b6b5af55b92f7343a0 P b61c58ed04b046d48634e2172dc45851: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:28.857563 16412 tablet_bootstrap.cc:654] T 7428466d80bc4b3b8fb4346741658617 P ce8113a88cac4c138552565af6c645ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:28.860937 16409 tablet_bootstrap.cc:654] T 4c50e97dfcc74bceb3b7d7db53a47278 P d58c05fc6fdc40b1bafd92b0c61e34e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:28.869616 16411 tablet_bootstrap.cc:492] T 5fef361fdd2840b6b5af55b92f7343a0 P b61c58ed04b046d48634e2172dc45851: No bootstrap required, opened a new log
I20260709 12:18:28.870373 16411 ts_tablet_manager.cc:1403] T 5fef361fdd2840b6b5af55b92f7343a0 P b61c58ed04b046d48634e2172dc45851: Time spent bootstrapping tablet: real 0.030s	user 0.018s	sys 0.009s
I20260709 12:18:28.873760 16412 tablet_bootstrap.cc:492] T 7428466d80bc4b3b8fb4346741658617 P ce8113a88cac4c138552565af6c645ca: No bootstrap required, opened a new log
I20260709 12:18:28.874420 16412 ts_tablet_manager.cc:1403] T 7428466d80bc4b3b8fb4346741658617 P ce8113a88cac4c138552565af6c645ca: Time spent bootstrapping tablet: real 0.033s	user 0.006s	sys 0.008s
I20260709 12:18:28.874104 16411 raft_consensus.cc:359] T 5fef361fdd2840b6b5af55b92f7343a0 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:28.874948 16409 tablet_bootstrap.cc:492] T 4c50e97dfcc74bceb3b7d7db53a47278 P d58c05fc6fdc40b1bafd92b0c61e34e8: No bootstrap required, opened a new log
I20260709 12:18:28.874943 16411 raft_consensus.cc:385] T 5fef361fdd2840b6b5af55b92f7343a0 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:28.875643 16411 raft_consensus.cc:740] T 5fef361fdd2840b6b5af55b92f7343a0 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b61c58ed04b046d48634e2172dc45851, State: Initialized, Role: FOLLOWER
I20260709 12:18:28.875790 16409 ts_tablet_manager.cc:1403] T 4c50e97dfcc74bceb3b7d7db53a47278 P d58c05fc6fdc40b1bafd92b0c61e34e8: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.013s
I20260709 12:18:28.876554 16411 consensus_queue.cc:260] T 5fef361fdd2840b6b5af55b92f7343a0 P b61c58ed04b046d48634e2172dc45851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:28.879452 16411 ts_tablet_manager.cc:1434] T 5fef361fdd2840b6b5af55b92f7343a0 P b61c58ed04b046d48634e2172dc45851: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:18:28.880038 16412 raft_consensus.cc:359] T 7428466d80bc4b3b8fb4346741658617 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:28.880553 16411 tablet_bootstrap.cc:492] T 7428466d80bc4b3b8fb4346741658617 P b61c58ed04b046d48634e2172dc45851: Bootstrap starting.
I20260709 12:18:28.880959 16412 raft_consensus.cc:385] T 7428466d80bc4b3b8fb4346741658617 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:28.879464 16409 raft_consensus.cc:359] T 4c50e97dfcc74bceb3b7d7db53a47278 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:28.881665 16412 raft_consensus.cc:740] T 7428466d80bc4b3b8fb4346741658617 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce8113a88cac4c138552565af6c645ca, State: Initialized, Role: FOLLOWER
I20260709 12:18:28.882030 16409 raft_consensus.cc:385] T 4c50e97dfcc74bceb3b7d7db53a47278 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:28.882396 16409 raft_consensus.cc:740] T 4c50e97dfcc74bceb3b7d7db53a47278 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d58c05fc6fdc40b1bafd92b0c61e34e8, State: Initialized, Role: FOLLOWER
I20260709 12:18:28.882720 16412 consensus_queue.cc:260] T 7428466d80bc4b3b8fb4346741658617 P ce8113a88cac4c138552565af6c645ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:28.883376 16409 consensus_queue.cc:260] T 4c50e97dfcc74bceb3b7d7db53a47278 P d58c05fc6fdc40b1bafd92b0c61e34e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:28.886250 16409 ts_tablet_manager.cc:1434] T 4c50e97dfcc74bceb3b7d7db53a47278 P d58c05fc6fdc40b1bafd92b0c61e34e8: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:18:28.887308 16409 tablet_bootstrap.cc:492] T 7934a0be864f472b90de8265010eb7d1 P d58c05fc6fdc40b1bafd92b0c61e34e8: Bootstrap starting.
I20260709 12:18:28.888465 16411 tablet_bootstrap.cc:654] T 7428466d80bc4b3b8fb4346741658617 P b61c58ed04b046d48634e2172dc45851: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:28.892755 16412 ts_tablet_manager.cc:1434] T 7428466d80bc4b3b8fb4346741658617 P ce8113a88cac4c138552565af6c645ca: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:18:28.894250 16412 tablet_bootstrap.cc:492] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P ce8113a88cac4c138552565af6c645ca: Bootstrap starting.
I20260709 12:18:28.894318 16409 tablet_bootstrap.cc:654] T 7934a0be864f472b90de8265010eb7d1 P d58c05fc6fdc40b1bafd92b0c61e34e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:28.909904 16412 tablet_bootstrap.cc:654] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P ce8113a88cac4c138552565af6c645ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:28.913300 16411 tablet_bootstrap.cc:492] T 7428466d80bc4b3b8fb4346741658617 P b61c58ed04b046d48634e2172dc45851: No bootstrap required, opened a new log
I20260709 12:18:28.913990 16411 ts_tablet_manager.cc:1403] T 7428466d80bc4b3b8fb4346741658617 P b61c58ed04b046d48634e2172dc45851: Time spent bootstrapping tablet: real 0.034s	user 0.022s	sys 0.008s
I20260709 12:18:28.917403 16411 raft_consensus.cc:359] T 7428466d80bc4b3b8fb4346741658617 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:28.918154 16409 tablet_bootstrap.cc:492] T 7934a0be864f472b90de8265010eb7d1 P d58c05fc6fdc40b1bafd92b0c61e34e8: No bootstrap required, opened a new log
I20260709 12:18:28.918352 16411 raft_consensus.cc:385] T 7428466d80bc4b3b8fb4346741658617 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:28.918668 16412 tablet_bootstrap.cc:492] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P ce8113a88cac4c138552565af6c645ca: No bootstrap required, opened a new log
I20260709 12:18:28.918752 16409 ts_tablet_manager.cc:1403] T 7934a0be864f472b90de8265010eb7d1 P d58c05fc6fdc40b1bafd92b0c61e34e8: Time spent bootstrapping tablet: real 0.032s	user 0.008s	sys 0.021s
I20260709 12:18:28.918830 16411 raft_consensus.cc:740] T 7428466d80bc4b3b8fb4346741658617 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b61c58ed04b046d48634e2172dc45851, State: Initialized, Role: FOLLOWER
I20260709 12:18:28.919571 16412 ts_tablet_manager.cc:1403] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P ce8113a88cac4c138552565af6c645ca: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.000s
I20260709 12:18:28.920198 16411 consensus_queue.cc:260] T 7428466d80bc4b3b8fb4346741658617 P b61c58ed04b046d48634e2172dc45851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:28.922490 16412 raft_consensus.cc:359] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:28.923138 16412 raft_consensus.cc:385] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:28.923374 16412 raft_consensus.cc:740] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce8113a88cac4c138552565af6c645ca, State: Initialized, Role: FOLLOWER
I20260709 12:18:28.924043 16412 consensus_queue.cc:260] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P ce8113a88cac4c138552565af6c645ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:28.924749 16411 ts_tablet_manager.cc:1434] T 7428466d80bc4b3b8fb4346741658617 P b61c58ed04b046d48634e2172dc45851: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:18:28.925861 16411 tablet_bootstrap.cc:492] T 1dcba4c6f61b41eab71ddaafd49ed11f P b61c58ed04b046d48634e2172dc45851: Bootstrap starting.
I20260709 12:18:28.926242 16412 ts_tablet_manager.cc:1434] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P ce8113a88cac4c138552565af6c645ca: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:18:28.927357 16412 tablet_bootstrap.cc:492] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P ce8113a88cac4c138552565af6c645ca: Bootstrap starting.
I20260709 12:18:28.922346 16409 raft_consensus.cc:359] T 7934a0be864f472b90de8265010eb7d1 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:28.929548 16409 raft_consensus.cc:385] T 7934a0be864f472b90de8265010eb7d1 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:28.929862 16409 raft_consensus.cc:740] T 7934a0be864f472b90de8265010eb7d1 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d58c05fc6fdc40b1bafd92b0c61e34e8, State: Initialized, Role: FOLLOWER
I20260709 12:18:28.930752 16409 consensus_queue.cc:260] T 7934a0be864f472b90de8265010eb7d1 P d58c05fc6fdc40b1bafd92b0c61e34e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:28.932650 16411 tablet_bootstrap.cc:654] T 1dcba4c6f61b41eab71ddaafd49ed11f P b61c58ed04b046d48634e2172dc45851: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:28.935024 16409 ts_tablet_manager.cc:1434] T 7934a0be864f472b90de8265010eb7d1 P d58c05fc6fdc40b1bafd92b0c61e34e8: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.002s
I20260709 12:18:28.936205 16409 tablet_bootstrap.cc:492] T 1e0b2bd53e024a3c8e84fd8372196c8e P d58c05fc6fdc40b1bafd92b0c61e34e8: Bootstrap starting.
I20260709 12:18:28.943085 16409 tablet_bootstrap.cc:654] T 1e0b2bd53e024a3c8e84fd8372196c8e P d58c05fc6fdc40b1bafd92b0c61e34e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:28.946849 16412 tablet_bootstrap.cc:654] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P ce8113a88cac4c138552565af6c645ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:28.958310 16409 tablet_bootstrap.cc:492] T 1e0b2bd53e024a3c8e84fd8372196c8e P d58c05fc6fdc40b1bafd92b0c61e34e8: No bootstrap required, opened a new log
I20260709 12:18:28.958999 16409 ts_tablet_manager.cc:1403] T 1e0b2bd53e024a3c8e84fd8372196c8e P d58c05fc6fdc40b1bafd92b0c61e34e8: Time spent bootstrapping tablet: real 0.023s	user 0.019s	sys 0.000s
I20260709 12:18:28.961292 16412 tablet_bootstrap.cc:492] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P ce8113a88cac4c138552565af6c645ca: No bootstrap required, opened a new log
I20260709 12:18:28.961622 16411 tablet_bootstrap.cc:492] T 1dcba4c6f61b41eab71ddaafd49ed11f P b61c58ed04b046d48634e2172dc45851: No bootstrap required, opened a new log
I20260709 12:18:28.961880 16412 ts_tablet_manager.cc:1403] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P ce8113a88cac4c138552565af6c645ca: Time spent bootstrapping tablet: real 0.035s	user 0.015s	sys 0.006s
I20260709 12:18:28.962190 16411 ts_tablet_manager.cc:1403] T 1dcba4c6f61b41eab71ddaafd49ed11f P b61c58ed04b046d48634e2172dc45851: Time spent bootstrapping tablet: real 0.037s	user 0.023s	sys 0.008s
I20260709 12:18:28.962157 16409 raft_consensus.cc:359] T 1e0b2bd53e024a3c8e84fd8372196c8e P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:28.963153 16409 raft_consensus.cc:385] T 1e0b2bd53e024a3c8e84fd8372196c8e P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:28.963460 16409 raft_consensus.cc:740] T 1e0b2bd53e024a3c8e84fd8372196c8e P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d58c05fc6fdc40b1bafd92b0c61e34e8, State: Initialized, Role: FOLLOWER
I20260709 12:18:28.964354 16409 consensus_queue.cc:260] T 1e0b2bd53e024a3c8e84fd8372196c8e P d58c05fc6fdc40b1bafd92b0c61e34e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:28.964584 16412 raft_consensus.cc:359] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:28.965276 16412 raft_consensus.cc:385] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:28.965569 16412 raft_consensus.cc:740] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce8113a88cac4c138552565af6c645ca, State: Initialized, Role: FOLLOWER
I20260709 12:18:28.965795 16411 raft_consensus.cc:359] T 1dcba4c6f61b41eab71ddaafd49ed11f P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:28.966240 16412 consensus_queue.cc:260] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P ce8113a88cac4c138552565af6c645ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:28.966570 16411 raft_consensus.cc:385] T 1dcba4c6f61b41eab71ddaafd49ed11f P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:28.967015 16411 raft_consensus.cc:740] T 1dcba4c6f61b41eab71ddaafd49ed11f P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b61c58ed04b046d48634e2172dc45851, State: Initialized, Role: FOLLOWER
I20260709 12:18:28.967964 16411 consensus_queue.cc:260] T 1dcba4c6f61b41eab71ddaafd49ed11f P b61c58ed04b046d48634e2172dc45851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:28.968699 16412 ts_tablet_manager.cc:1434] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P ce8113a88cac4c138552565af6c645ca: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:18:28.969848 16412 tablet_bootstrap.cc:492] T 7934a0be864f472b90de8265010eb7d1 P ce8113a88cac4c138552565af6c645ca: Bootstrap starting.
I20260709 12:18:28.973340 16411 ts_tablet_manager.cc:1434] T 1dcba4c6f61b41eab71ddaafd49ed11f P b61c58ed04b046d48634e2172dc45851: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.005s
I20260709 12:18:28.974012 16409 ts_tablet_manager.cc:1434] T 1e0b2bd53e024a3c8e84fd8372196c8e P d58c05fc6fdc40b1bafd92b0c61e34e8: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.001s
I20260709 12:18:28.973981 16418 raft_consensus.cc:493] T 7428466d80bc4b3b8fb4346741658617 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.974798 16418 raft_consensus.cc:515] T 7428466d80bc4b3b8fb4346741658617 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:28.975421 16409 tablet_bootstrap.cc:492] T 7428466d80bc4b3b8fb4346741658617 P d58c05fc6fdc40b1bafd92b0c61e34e8: Bootstrap starting.
I20260709 12:18:28.977003 16418 leader_election.cc:290] T 7428466d80bc4b3b8fb4346741658617 P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:28.977195 16412 tablet_bootstrap.cc:654] T 7934a0be864f472b90de8265010eb7d1 P ce8113a88cac4c138552565af6c645ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:28.979184 16411 tablet_bootstrap.cc:492] T 4c50e97dfcc74bceb3b7d7db53a47278 P b61c58ed04b046d48634e2172dc45851: Bootstrap starting.
I20260709 12:18:28.979820 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7428466d80bc4b3b8fb4346741658617" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca" is_pre_election: true
I20260709 12:18:28.980615 16273 raft_consensus.cc:2468] T 7428466d80bc4b3b8fb4346741658617 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b61c58ed04b046d48634e2172dc45851 in term 0.
I20260709 12:18:28.982374 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7428466d80bc4b3b8fb4346741658617" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" is_pre_election: true
I20260709 12:18:28.982854 16409 tablet_bootstrap.cc:654] T 7428466d80bc4b3b8fb4346741658617 P d58c05fc6fdc40b1bafd92b0c61e34e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:28.984298 16162 leader_election.cc:304] T 7428466d80bc4b3b8fb4346741658617 P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b61c58ed04b046d48634e2172dc45851, ce8113a88cac4c138552565af6c645ca; no voters: 
I20260709 12:18:28.985281 16410 raft_consensus.cc:493] T 1dcba4c6f61b41eab71ddaafd49ed11f P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.985411 16418 raft_consensus.cc:2804] T 7428466d80bc4b3b8fb4346741658617 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:28.986141 16418 raft_consensus.cc:493] T 7428466d80bc4b3b8fb4346741658617 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:28.986488 16418 raft_consensus.cc:3060] T 7428466d80bc4b3b8fb4346741658617 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:28.987142 16410 raft_consensus.cc:515] T 1dcba4c6f61b41eab71ddaafd49ed11f P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:28.992095 16410 leader_election.cc:290] T 1dcba4c6f61b41eab71ddaafd49ed11f P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
W20260709 12:18:28.990658 16164 leader_election.cc:343] T 7428466d80bc4b3b8fb4346741658617 P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:28.998414 16198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcba4c6f61b41eab71ddaafd49ed11f" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b61c58ed04b046d48634e2172dc45851" is_pre_election: true
I20260709 12:18:28.999267 16198 raft_consensus.cc:2468] T 1dcba4c6f61b41eab71ddaafd49ed11f P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d58c05fc6fdc40b1bafd92b0c61e34e8 in term 0.
I20260709 12:18:29.000264 16412 tablet_bootstrap.cc:492] T 7934a0be864f472b90de8265010eb7d1 P ce8113a88cac4c138552565af6c645ca: No bootstrap required, opened a new log
I20260709 12:18:29.000851 16412 ts_tablet_manager.cc:1403] T 7934a0be864f472b90de8265010eb7d1 P ce8113a88cac4c138552565af6c645ca: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.008s
I20260709 12:18:29.001320 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcba4c6f61b41eab71ddaafd49ed11f" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca" is_pre_election: true
I20260709 12:18:29.002184 16273 raft_consensus.cc:2468] T 1dcba4c6f61b41eab71ddaafd49ed11f P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d58c05fc6fdc40b1bafd92b0c61e34e8 in term 0.
I20260709 12:18:29.003595 16412 raft_consensus.cc:359] T 7934a0be864f472b90de8265010eb7d1 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:29.003952 16087 leader_election.cc:304] T 1dcba4c6f61b41eab71ddaafd49ed11f P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce8113a88cac4c138552565af6c645ca, d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: 
I20260709 12:18:29.004348 16412 raft_consensus.cc:385] T 7934a0be864f472b90de8265010eb7d1 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:29.004748 16412 raft_consensus.cc:740] T 7934a0be864f472b90de8265010eb7d1 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce8113a88cac4c138552565af6c645ca, State: Initialized, Role: FOLLOWER
I20260709 12:18:29.005033 16398 raft_consensus.cc:2804] T 1dcba4c6f61b41eab71ddaafd49ed11f P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:29.005505 16398 raft_consensus.cc:493] T 1dcba4c6f61b41eab71ddaafd49ed11f P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:29.005887 16398 raft_consensus.cc:3060] T 1dcba4c6f61b41eab71ddaafd49ed11f P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:29.005609 16412 consensus_queue.cc:260] T 7934a0be864f472b90de8265010eb7d1 P ce8113a88cac4c138552565af6c645ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:29.014937 16412 ts_tablet_manager.cc:1434] T 7934a0be864f472b90de8265010eb7d1 P ce8113a88cac4c138552565af6c645ca: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.003s
I20260709 12:18:29.016141 16412 tablet_bootstrap.cc:492] T 1e0b2bd53e024a3c8e84fd8372196c8e P ce8113a88cac4c138552565af6c645ca: Bootstrap starting.
I20260709 12:18:29.018532 16398 raft_consensus.cc:515] T 1dcba4c6f61b41eab71ddaafd49ed11f P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:29.016062 16411 tablet_bootstrap.cc:654] T 4c50e97dfcc74bceb3b7d7db53a47278 P b61c58ed04b046d48634e2172dc45851: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:29.021853 16396 raft_consensus.cc:493] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.025748 16412 tablet_bootstrap.cc:654] T 1e0b2bd53e024a3c8e84fd8372196c8e P ce8113a88cac4c138552565af6c645ca: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:29.022898 16396 raft_consensus.cc:515] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:29.031040 16409 tablet_bootstrap.cc:492] T 7428466d80bc4b3b8fb4346741658617 P d58c05fc6fdc40b1bafd92b0c61e34e8: No bootstrap required, opened a new log
I20260709 12:18:29.032253 16409 ts_tablet_manager.cc:1403] T 7428466d80bc4b3b8fb4346741658617 P d58c05fc6fdc40b1bafd92b0c61e34e8: Time spent bootstrapping tablet: real 0.057s	user 0.027s	sys 0.013s
I20260709 12:18:29.031031 16198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcba4c6f61b41eab71ddaafd49ed11f" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b61c58ed04b046d48634e2172dc45851"
I20260709 12:18:29.033958 16396 leader_election.cc:290] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
I20260709 12:18:29.034166 16198 raft_consensus.cc:3060] T 1dcba4c6f61b41eab71ddaafd49ed11f P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:29.029340 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0f4313ed9e402d9c4067f38e69a61d" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" is_pre_election: true
I20260709 12:18:29.036187 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcba4c6f61b41eab71ddaafd49ed11f" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca"
I20260709 12:18:29.036384 16124 raft_consensus.cc:2468] T 3c0f4313ed9e402d9c4067f38e69a61d P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce8113a88cac4c138552565af6c645ca in term 0.
I20260709 12:18:29.036804 16273 raft_consensus.cc:3060] T 1dcba4c6f61b41eab71ddaafd49ed11f P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:29.038868 16238 leader_election.cc:304] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce8113a88cac4c138552565af6c645ca, d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: 
I20260709 12:18:29.039909 16396 raft_consensus.cc:2804] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:29.040295 16396 raft_consensus.cc:493] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:29.040594 16396 raft_consensus.cc:3060] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:29.041642 16398 leader_election.cc:290] T 1dcba4c6f61b41eab71ddaafd49ed11f P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 1 election: Requested vote from peers b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:29.043159 16198 raft_consensus.cc:2468] T 1dcba4c6f61b41eab71ddaafd49ed11f P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d58c05fc6fdc40b1bafd92b0c61e34e8 in term 1.
I20260709 12:18:29.044977 16088 leader_election.cc:304] T 1dcba4c6f61b41eab71ddaafd49ed11f P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: 
I20260709 12:18:29.045958 16398 raft_consensus.cc:2804] T 1dcba4c6f61b41eab71ddaafd49ed11f P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:29.047230 16409 raft_consensus.cc:359] T 7428466d80bc4b3b8fb4346741658617 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:29.048223 16409 raft_consensus.cc:385] T 7428466d80bc4b3b8fb4346741658617 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:29.029140 16418 raft_consensus.cc:515] T 7428466d80bc4b3b8fb4346741658617 P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:29.048521 16409 raft_consensus.cc:740] T 7428466d80bc4b3b8fb4346741658617 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d58c05fc6fdc40b1bafd92b0c61e34e8, State: Initialized, Role: FOLLOWER
I20260709 12:18:29.049407 16409 consensus_queue.cc:260] T 7428466d80bc4b3b8fb4346741658617 P d58c05fc6fdc40b1bafd92b0c61e34e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:29.050838 16418 leader_election.cc:290] T 7428466d80bc4b3b8fb4346741658617 P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 1 election: Requested vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:29.051841 16409 ts_tablet_manager.cc:1434] T 7428466d80bc4b3b8fb4346741658617 P d58c05fc6fdc40b1bafd92b0c61e34e8: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.003s
I20260709 12:18:29.052917 16409 tablet_bootstrap.cc:492] T 5fef361fdd2840b6b5af55b92f7343a0 P d58c05fc6fdc40b1bafd92b0c61e34e8: Bootstrap starting.
I20260709 12:18:29.052786 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7428466d80bc4b3b8fb4346741658617" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8"
I20260709 12:18:29.053174 16410 raft_consensus.cc:493] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.053448 16124 raft_consensus.cc:3060] T 7428466d80bc4b3b8fb4346741658617 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:29.047216 16398 raft_consensus.cc:697] T 1dcba4c6f61b41eab71ddaafd49ed11f P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 LEADER]: Becoming Leader. State: Replica: d58c05fc6fdc40b1bafd92b0c61e34e8, State: Running, Role: LEADER
I20260709 12:18:29.073891 16409 tablet_bootstrap.cc:654] T 5fef361fdd2840b6b5af55b92f7343a0 P d58c05fc6fdc40b1bafd92b0c61e34e8: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:29.076107 16398 consensus_queue.cc:237] T 1dcba4c6f61b41eab71ddaafd49ed11f P d58c05fc6fdc40b1bafd92b0c61e34e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:29.076937 16396 raft_consensus.cc:515] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:29.064179 16418 raft_consensus.cc:493] T 1e0b2bd53e024a3c8e84fd8372196c8e P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.057616 16273 raft_consensus.cc:2468] T 1dcba4c6f61b41eab71ddaafd49ed11f P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d58c05fc6fdc40b1bafd92b0c61e34e8 in term 1.
I20260709 12:18:29.057214 16198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0f4313ed9e402d9c4067f38e69a61d" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b61c58ed04b046d48634e2172dc45851" is_pre_election: true
I20260709 12:18:29.057930 16410 raft_consensus.cc:515] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:29.071532 16438 raft_consensus.cc:493] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.071236 16124 raft_consensus.cc:2468] T 7428466d80bc4b3b8fb4346741658617 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b61c58ed04b046d48634e2172dc45851 in term 1.
I20260709 12:18:29.084884 16442 raft_consensus.cc:493] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.086562 16164 leader_election.cc:304] T 7428466d80bc4b3b8fb4346741658617 P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: 
I20260709 12:18:29.079432 16418 raft_consensus.cc:515] T 1e0b2bd53e024a3c8e84fd8372196c8e P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:29.087939 16419 raft_consensus.cc:2804] T 7428466d80bc4b3b8fb4346741658617 P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:29.090602 16412 tablet_bootstrap.cc:492] T 1e0b2bd53e024a3c8e84fd8372196c8e P ce8113a88cac4c138552565af6c645ca: No bootstrap required, opened a new log
I20260709 12:18:29.090000 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5a7f087bcb4438adaf7e1dd6aaf10e" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b61c58ed04b046d48634e2172dc45851" is_pre_election: true
I20260709 12:18:29.089979 16319 raft_consensus.cc:493] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.092229 16199 raft_consensus.cc:2468] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d58c05fc6fdc40b1bafd92b0c61e34e8 in term 0.
I20260709 12:18:29.093268 16412 ts_tablet_manager.cc:1403] T 1e0b2bd53e024a3c8e84fd8372196c8e P ce8113a88cac4c138552565af6c645ca: Time spent bootstrapping tablet: real 0.077s	user 0.020s	sys 0.001s
I20260709 12:18:29.080727 16198 raft_consensus.cc:2468] T 3c0f4313ed9e402d9c4067f38e69a61d P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce8113a88cac4c138552565af6c645ca in term 0.
I20260709 12:18:29.096324 16410 leader_election.cc:290] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:29.092377 16319 raft_consensus.cc:515] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:29.096828 16088 leader_election.cc:304] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: 
I20260709 12:18:29.103992 16319 leader_election.cc:290] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:29.104280 16411 tablet_bootstrap.cc:492] T 4c50e97dfcc74bceb3b7d7db53a47278 P b61c58ed04b046d48634e2172dc45851: No bootstrap required, opened a new log
I20260709 12:18:29.104620 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0b2bd53e024a3c8e84fd8372196c8e" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" is_pre_election: true
I20260709 12:18:29.105324 16123 raft_consensus.cc:2468] T 1e0b2bd53e024a3c8e84fd8372196c8e P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b61c58ed04b046d48634e2172dc45851 in term 0.
I20260709 12:18:29.105904 16418 leader_election.cc:290] T 1e0b2bd53e024a3c8e84fd8372196c8e P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:29.085698 16442 raft_consensus.cc:515] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:29.106969 16164 leader_election.cc:304] T 1e0b2bd53e024a3c8e84fd8372196c8e P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: 
I20260709 12:18:29.104853 16411 ts_tablet_manager.cc:1403] T 4c50e97dfcc74bceb3b7d7db53a47278 P b61c58ed04b046d48634e2172dc45851: Time spent bootstrapping tablet: real 0.126s	user 0.016s	sys 0.033s
I20260709 12:18:29.109987 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5a7f087bcb4438adaf7e1dd6aaf10e" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" is_pre_election: true
I20260709 12:18:29.111621 16411 raft_consensus.cc:359] T 4c50e97dfcc74bceb3b7d7db53a47278 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:29.112514 16411 raft_consensus.cc:385] T 4c50e97dfcc74bceb3b7d7db53a47278 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:29.112864 16411 raft_consensus.cc:740] T 4c50e97dfcc74bceb3b7d7db53a47278 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b61c58ed04b046d48634e2172dc45851, State: Initialized, Role: FOLLOWER
I20260709 12:18:29.115825 16446 raft_consensus.cc:493] T 4c50e97dfcc74bceb3b7d7db53a47278 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.116530 16446 raft_consensus.cc:515] T 4c50e97dfcc74bceb3b7d7db53a47278 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:29.119400 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5a7f087bcb4438adaf7e1dd6aaf10e" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca" is_pre_election: true
I20260709 12:18:29.114477 16419 raft_consensus.cc:697] T 7428466d80bc4b3b8fb4346741658617 P b61c58ed04b046d48634e2172dc45851 [term 1 LEADER]: Becoming Leader. State: Replica: b61c58ed04b046d48634e2172dc45851, State: Running, Role: LEADER
I20260709 12:18:29.120252 16273 raft_consensus.cc:2468] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d58c05fc6fdc40b1bafd92b0c61e34e8 in term 0.
I20260709 12:18:29.113785 16418 raft_consensus.cc:2804] T 1e0b2bd53e024a3c8e84fd8372196c8e P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:29.121111 16419 consensus_queue.cc:237] T 7428466d80bc4b3b8fb4346741658617 P b61c58ed04b046d48634e2172dc45851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:29.121819 16418 raft_consensus.cc:493] T 1e0b2bd53e024a3c8e84fd8372196c8e P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:29.122238 16418 raft_consensus.cc:3060] T 1e0b2bd53e024a3c8e84fd8372196c8e P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:29.091195 16438 raft_consensus.cc:515] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:29.124367 16121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0f4313ed9e402d9c4067f38e69a61d" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8"
I20260709 12:18:29.125133 16121 raft_consensus.cc:3060] T 3c0f4313ed9e402d9c4067f38e69a61d P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:29.125847 16438 leader_election.cc:290] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
I20260709 12:18:29.126528 16438 raft_consensus.cc:493] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.127988 16411 consensus_queue.cc:260] T 4c50e97dfcc74bceb3b7d7db53a47278 P b61c58ed04b046d48634e2172dc45851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:29.129520 16198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50e97dfcc74bceb3b7d7db53a47278" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b61c58ed04b046d48634e2172dc45851" is_pre_election: true
I20260709 12:18:29.130008 16411 ts_tablet_manager.cc:1434] T 4c50e97dfcc74bceb3b7d7db53a47278 P b61c58ed04b046d48634e2172dc45851: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260709 12:18:29.119530 16446 leader_election.cc:290] T 4c50e97dfcc74bceb3b7d7db53a47278 P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:29.132154 16411 tablet_bootstrap.cc:492] T 7934a0be864f472b90de8265010eb7d1 P b61c58ed04b046d48634e2172dc45851: Bootstrap starting.
W20260709 12:18:29.136817 16237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:35005, user_credentials={real_user=slave}} blocked reactor thread for 55731.4us
I20260709 12:18:29.138125 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7428466d80bc4b3b8fb4346741658617" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca"
I20260709 12:18:29.138726 16273 raft_consensus.cc:3060] T 7428466d80bc4b3b8fb4346741658617 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:29.139962 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fef361fdd2840b6b5af55b92f7343a0" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b61c58ed04b046d48634e2172dc45851" is_pre_election: true
I20260709 12:18:29.139812 16412 raft_consensus.cc:359] T 1e0b2bd53e024a3c8e84fd8372196c8e P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:29.140698 16199 raft_consensus.cc:2468] T 5fef361fdd2840b6b5af55b92f7343a0 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce8113a88cac4c138552565af6c645ca in term 0.
I20260709 12:18:29.141006 16412 raft_consensus.cc:385] T 1e0b2bd53e024a3c8e84fd8372196c8e P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:29.141965 16446 raft_consensus.cc:493] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.142284 16396 leader_election.cc:290] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 1 election: Requested vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
I20260709 12:18:29.142850 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0b2bd53e024a3c8e84fd8372196c8e" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca" is_pre_election: true
I20260709 12:18:29.146850 16121 raft_consensus.cc:2468] T 3c0f4313ed9e402d9c4067f38e69a61d P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce8113a88cac4c138552565af6c645ca in term 1.
I20260709 12:18:29.148216 16238 leader_election.cc:304] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce8113a88cac4c138552565af6c645ca, d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: 
I20260709 12:18:29.114765 16123 raft_consensus.cc:2468] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce8113a88cac4c138552565af6c645ca in term 0.
I20260709 12:18:29.144133 16412 raft_consensus.cc:740] T 1e0b2bd53e024a3c8e84fd8372196c8e P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce8113a88cac4c138552565af6c645ca, State: Initialized, Role: FOLLOWER
I20260709 12:18:29.142217 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7063d3a4c2fb4a2eb8cd6edcae5eb2ac" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca" is_pre_election: true
I20260709 12:18:29.144644 16122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fef361fdd2840b6b5af55b92f7343a0" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" is_pre_election: true
I20260709 12:18:29.132222 16438 raft_consensus.cc:515] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:29.150367 16412 consensus_queue.cc:260] T 1e0b2bd53e024a3c8e84fd8372196c8e P ce8113a88cac4c138552565af6c645ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:29.150767 16238 leader_election.cc:304] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce8113a88cac4c138552565af6c645ca, d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: 
I20260709 12:18:29.144987 16446 raft_consensus.cc:515] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:29.151430 16270 raft_consensus.cc:2468] T 1e0b2bd53e024a3c8e84fd8372196c8e P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b61c58ed04b046d48634e2172dc45851 in term 0.
I20260709 12:18:29.149945 16410 raft_consensus.cc:2804] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:29.152318 16438 leader_election.cc:290] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
I20260709 12:18:29.150127 16272 raft_consensus.cc:2468] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b61c58ed04b046d48634e2172dc45851 in term 0.
I20260709 12:18:29.145980 16442 leader_election.cc:290] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
I20260709 12:18:29.149261 16396 raft_consensus.cc:2804] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:29.153062 16446 leader_election.cc:290] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:29.153918 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7063d3a4c2fb4a2eb8cd6edcae5eb2ac" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b61c58ed04b046d48634e2172dc45851" is_pre_election: true
I20260709 12:18:29.136404 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7063d3a4c2fb4a2eb8cd6edcae5eb2ac" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" is_pre_election: true
I20260709 12:18:29.143263 16237 leader_election.cc:304] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b61c58ed04b046d48634e2172dc45851, ce8113a88cac4c138552565af6c645ca; no voters: 
I20260709 12:18:29.152946 16438 raft_consensus.cc:2804] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:29.154443 16396 raft_consensus.cc:697] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca [term 1 LEADER]: Becoming Leader. State: Replica: ce8113a88cac4c138552565af6c645ca, State: Running, Role: LEADER
I20260709 12:18:29.157784 16412 ts_tablet_manager.cc:1434] T 1e0b2bd53e024a3c8e84fd8372196c8e P ce8113a88cac4c138552565af6c645ca: Time spent starting tablet: real 0.064s	user 0.006s	sys 0.001s
I20260709 12:18:29.160758 16442 raft_consensus.cc:2804] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:29.161240 16442 raft_consensus.cc:493] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:29.161686 16409 tablet_bootstrap.cc:492] T 5fef361fdd2840b6b5af55b92f7343a0 P d58c05fc6fdc40b1bafd92b0c61e34e8: No bootstrap required, opened a new log
I20260709 12:18:29.161778 16442 raft_consensus.cc:3060] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:29.162302 16409 ts_tablet_manager.cc:1403] T 5fef361fdd2840b6b5af55b92f7343a0 P d58c05fc6fdc40b1bafd92b0c61e34e8: Time spent bootstrapping tablet: real 0.110s	user 0.033s	sys 0.031s
I20260709 12:18:29.155304 16199 raft_consensus.cc:2468] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d58c05fc6fdc40b1bafd92b0c61e34e8 in term 0.
I20260709 12:18:29.165416 16409 raft_consensus.cc:359] T 5fef361fdd2840b6b5af55b92f7343a0 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:29.166145 16409 raft_consensus.cc:385] T 5fef361fdd2840b6b5af55b92f7343a0 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:29.166831 16088 leader_election.cc:304] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: 
W20260709 12:18:29.158658 16238 leader_election.cc:343] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:29.167790 16273 raft_consensus.cc:2468] T 7428466d80bc4b3b8fb4346741658617 P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b61c58ed04b046d48634e2172dc45851 in term 1.
I20260709 12:18:29.166604 16409 raft_consensus.cc:740] T 5fef361fdd2840b6b5af55b92f7343a0 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d58c05fc6fdc40b1bafd92b0c61e34e8, State: Initialized, Role: FOLLOWER
I20260709 12:18:29.169421 16396 consensus_queue.cc:237] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:29.169220 16409 consensus_queue.cc:260] T 5fef361fdd2840b6b5af55b92f7343a0 P d58c05fc6fdc40b1bafd92b0c61e34e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:29.171940 16409 ts_tablet_manager.cc:1434] T 5fef361fdd2840b6b5af55b92f7343a0 P d58c05fc6fdc40b1bafd92b0c61e34e8: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:18:29.135673 16198 raft_consensus.cc:2468] T 4c50e97dfcc74bceb3b7d7db53a47278 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d58c05fc6fdc40b1bafd92b0c61e34e8 in term 0.
I20260709 12:18:29.175812 16088 leader_election.cc:304] T 4c50e97dfcc74bceb3b7d7db53a47278 P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: 
I20260709 12:18:29.176407 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50e97dfcc74bceb3b7d7db53a47278" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca" is_pre_election: true
I20260709 12:18:29.159053 16124 raft_consensus.cc:2468] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b61c58ed04b046d48634e2172dc45851 in term 0.
I20260709 12:18:29.177642 16446 raft_consensus.cc:2804] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:29.177163 16441 raft_consensus.cc:2804] T 4c50e97dfcc74bceb3b7d7db53a47278 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:29.178357 16441 raft_consensus.cc:493] T 4c50e97dfcc74bceb3b7d7db53a47278 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:29.178723 16441 raft_consensus.cc:3060] T 4c50e97dfcc74bceb3b7d7db53a47278 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:29.178880 16446 raft_consensus.cc:493] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:29.179394 16446 raft_consensus.cc:3060] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:29.179104 16442 raft_consensus.cc:515] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:29.158504 16438 raft_consensus.cc:493] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:29.182484 16121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50e97dfcc74bceb3b7d7db53a47278" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" is_pre_election: true
I20260709 12:18:29.183352 16410 raft_consensus.cc:493] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:29.189522 16410 raft_consensus.cc:3060] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:29.177161 16273 raft_consensus.cc:2468] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d58c05fc6fdc40b1bafd92b0c61e34e8 in term 0.
I20260709 12:18:29.189689 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7063d3a4c2fb4a2eb8cd6edcae5eb2ac" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca" is_pre_election: true
I20260709 12:18:29.190420 16270 raft_consensus.cc:2468] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d58c05fc6fdc40b1bafd92b0c61e34e8 in term 0.
I20260709 12:18:29.191928 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fef361fdd2840b6b5af55b92f7343a0" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8"
I20260709 12:18:29.192684 16124 raft_consensus.cc:3060] T 5fef361fdd2840b6b5af55b92f7343a0 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:29.194388 16164 leader_election.cc:304] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: 
I20260709 12:18:29.186837 16438 raft_consensus.cc:3060] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:29.197175 16319 raft_consensus.cc:2804] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:29.197618 16319 raft_consensus.cc:493] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:29.197971 16319 raft_consensus.cc:3060] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:29.184451 16411 tablet_bootstrap.cc:654] T 7934a0be864f472b90de8265010eb7d1 P b61c58ed04b046d48634e2172dc45851: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:29.187755 16442 leader_election.cc:290] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 1 election: Requested vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
I20260709 12:18:29.203017 16418 raft_consensus.cc:515] T 1e0b2bd53e024a3c8e84fd8372196c8e P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:29.206521 16122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0b2bd53e024a3c8e84fd8372196c8e" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8"
I20260709 12:18:29.207175 16122 raft_consensus.cc:3060] T 1e0b2bd53e024a3c8e84fd8372196c8e P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:29.208387 16197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5a7f087bcb4438adaf7e1dd6aaf10e" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b61c58ed04b046d48634e2172dc45851" is_pre_election: true
I20260709 12:18:29.209103 16197 raft_consensus.cc:2468] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce8113a88cac4c138552565af6c645ca in term 0.
I20260709 12:18:29.208201 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0f4313ed9e402d9c4067f38e69a61d" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b61c58ed04b046d48634e2172dc45851"
I20260709 12:18:29.209913 16199 raft_consensus.cc:3060] T 3c0f4313ed9e402d9c4067f38e69a61d P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:29.214800 16197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50e97dfcc74bceb3b7d7db53a47278" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b61c58ed04b046d48634e2172dc45851" is_pre_election: true
I20260709 12:18:29.215616 16197 raft_consensus.cc:2468] T 4c50e97dfcc74bceb3b7d7db53a47278 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce8113a88cac4c138552565af6c645ca in term 0.
I20260709 12:18:29.210173 16446 raft_consensus.cc:515] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:29.220068 16197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fef361fdd2840b6b5af55b92f7343a0" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b61c58ed04b046d48634e2172dc45851"
I20260709 12:18:29.220737 16197 raft_consensus.cc:3060] T 5fef361fdd2840b6b5af55b92f7343a0 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:29.222325 16319 raft_consensus.cc:515] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:29.224206 16196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7063d3a4c2fb4a2eb8cd6edcae5eb2ac" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b61c58ed04b046d48634e2172dc45851"
I20260709 12:18:29.225134 16020 catalog_manager.cc:5697] T 1dcba4c6f61b41eab71ddaafd49ed11f P d58c05fc6fdc40b1bafd92b0c61e34e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129). New cstate: current_term: 1 leader_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:29.225189 16196 raft_consensus.cc:2393] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d58c05fc6fdc40b1bafd92b0c61e34e8 in current term 1: Already voted for candidate b61c58ed04b046d48634e2172dc45851 in this term.
I20260709 12:18:29.228618 16124 raft_consensus.cc:2468] T 5fef361fdd2840b6b5af55b92f7343a0 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce8113a88cac4c138552565af6c645ca in term 1.
I20260709 12:18:29.230522 16197 raft_consensus.cc:2468] T 5fef361fdd2840b6b5af55b92f7343a0 P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce8113a88cac4c138552565af6c645ca in term 1.
I20260709 12:18:29.235589 16238 leader_election.cc:304] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce8113a88cac4c138552565af6c645ca, d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: 
I20260709 12:18:29.236001 16237 leader_election.cc:304] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b61c58ed04b046d48634e2172dc45851, ce8113a88cac4c138552565af6c645ca; no voters: 
I20260709 12:18:29.237221 16396 raft_consensus.cc:2804] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:29.237651 16396 raft_consensus.cc:493] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:29.237967 16396 raft_consensus.cc:3060] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:29.239966 16442 raft_consensus.cc:2804] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:29.240506 16442 raft_consensus.cc:697] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca [term 1 LEADER]: Becoming Leader. State: Replica: ce8113a88cac4c138552565af6c645ca, State: Running, Role: LEADER
I20260709 12:18:29.241462 16442 consensus_queue.cc:237] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:29.248152 16446 leader_election.cc:290] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 1 election: Requested vote from peers b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:29.259400 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7063d3a4c2fb4a2eb8cd6edcae5eb2ac" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca"
I20260709 12:18:29.259534 16396 raft_consensus.cc:515] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:29.260259 16273 raft_consensus.cc:3060] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:29.259609 16438 raft_consensus.cc:515] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:29.263005 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50e97dfcc74bceb3b7d7db53a47278" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8"
I20260709 12:18:29.265547 16396 leader_election.cc:290] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 1 election: Requested vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
I20260709 12:18:29.273398 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5a7f087bcb4438adaf7e1dd6aaf10e" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8"
I20260709 12:18:29.274256 16122 raft_consensus.cc:2468] T 1e0b2bd53e024a3c8e84fd8372196c8e P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b61c58ed04b046d48634e2172dc45851 in term 1.
I20260709 12:18:29.275777 16164 leader_election.cc:304] T 1e0b2bd53e024a3c8e84fd8372196c8e P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: 
I20260709 12:18:29.276787 16419 raft_consensus.cc:2804] T 1e0b2bd53e024a3c8e84fd8372196c8e P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:29.277412 16419 raft_consensus.cc:697] T 1e0b2bd53e024a3c8e84fd8372196c8e P b61c58ed04b046d48634e2172dc45851 [term 1 LEADER]: Becoming Leader. State: Replica: b61c58ed04b046d48634e2172dc45851, State: Running, Role: LEADER
I20260709 12:18:29.278932 16419 consensus_queue.cc:237] T 1e0b2bd53e024a3c8e84fd8372196c8e P b61c58ed04b046d48634e2172dc45851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:29.282308 16410 raft_consensus.cc:515] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:29.277444 16199 raft_consensus.cc:2468] T 3c0f4313ed9e402d9c4067f38e69a61d P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce8113a88cac4c138552565af6c645ca in term 1.
I20260709 12:18:29.277252 16438 leader_election.cc:290] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 1 election: Requested vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
I20260709 12:18:29.283900 16124 raft_consensus.cc:2393] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ce8113a88cac4c138552565af6c645ca in current term 1: Already voted for candidate d58c05fc6fdc40b1bafd92b0c61e34e8 in this term.
I20260709 12:18:29.286479 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50e97dfcc74bceb3b7d7db53a47278" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b61c58ed04b046d48634e2172dc45851"
I20260709 12:18:29.287238 16199 raft_consensus.cc:3060] T 4c50e97dfcc74bceb3b7d7db53a47278 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:29.286137 16198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5a7f087bcb4438adaf7e1dd6aaf10e" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b61c58ed04b046d48634e2172dc45851"
I20260709 12:18:29.289273 16198 raft_consensus.cc:3060] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:29.295674 16199 raft_consensus.cc:2468] T 4c50e97dfcc74bceb3b7d7db53a47278 P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce8113a88cac4c138552565af6c645ca in term 1.
I20260709 12:18:29.254866 16418 leader_election.cc:290] T 1e0b2bd53e024a3c8e84fd8372196c8e P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 1 election: Requested vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:29.272770 16273 raft_consensus.cc:2468] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d58c05fc6fdc40b1bafd92b0c61e34e8 in term 1.
I20260709 12:18:29.278683 16441 raft_consensus.cc:515] T 4c50e97dfcc74bceb3b7d7db53a47278 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:29.304570 16121 raft_consensus.cc:2393] T 4c50e97dfcc74bceb3b7d7db53a47278 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce8113a88cac4c138552565af6c645ca in current term 1: Already voted for candidate d58c05fc6fdc40b1bafd92b0c61e34e8 in this term.
I20260709 12:18:29.305650 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7063d3a4c2fb4a2eb8cd6edcae5eb2ac" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8"
I20260709 12:18:29.306536 16124 raft_consensus.cc:2393] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b61c58ed04b046d48634e2172dc45851 in current term 1: Already voted for candidate d58c05fc6fdc40b1bafd92b0c61e34e8 in this term.
I20260709 12:18:29.307531 16237 leader_election.cc:304] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b61c58ed04b046d48634e2172dc45851, ce8113a88cac4c138552565af6c645ca; no voters: d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:29.308328 16438 raft_consensus.cc:2804] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:29.308848 16438 raft_consensus.cc:697] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca [term 1 LEADER]: Becoming Leader. State: Replica: ce8113a88cac4c138552565af6c645ca, State: Running, Role: LEADER
I20260709 12:18:29.309079 16441 leader_election.cc:290] T 4c50e97dfcc74bceb3b7d7db53a47278 P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 1 election: Requested vote from peers b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:29.309990 16411 tablet_bootstrap.cc:492] T 7934a0be864f472b90de8265010eb7d1 P b61c58ed04b046d48634e2172dc45851: No bootstrap required, opened a new log
I20260709 12:18:29.309767 16438 consensus_queue.cc:237] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:29.310496 16411 ts_tablet_manager.cc:1403] T 7934a0be864f472b90de8265010eb7d1 P b61c58ed04b046d48634e2172dc45851: Time spent bootstrapping tablet: real 0.179s	user 0.015s	sys 0.009s
I20260709 12:18:29.313086 16319 leader_election.cc:290] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 1 election: Requested vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:29.301105 16198 raft_consensus.cc:2468] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce8113a88cac4c138552565af6c645ca in term 1.
I20260709 12:18:29.304368 16087 leader_election.cc:304] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ce8113a88cac4c138552565af6c645ca, d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: b61c58ed04b046d48634e2172dc45851
I20260709 12:18:29.318841 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50e97dfcc74bceb3b7d7db53a47278" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b61c58ed04b046d48634e2172dc45851"
I20260709 12:18:29.319339 16197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5a7f087bcb4438adaf7e1dd6aaf10e" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b61c58ed04b046d48634e2172dc45851"
I20260709 12:18:29.319977 16199 raft_consensus.cc:2393] T 4c50e97dfcc74bceb3b7d7db53a47278 P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d58c05fc6fdc40b1bafd92b0c61e34e8 in current term 1: Already voted for candidate ce8113a88cac4c138552565af6c645ca in this term.
I20260709 12:18:29.320225 16197 raft_consensus.cc:2393] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d58c05fc6fdc40b1bafd92b0c61e34e8 in current term 1: Already voted for candidate ce8113a88cac4c138552565af6c645ca in this term.
I20260709 12:18:29.320218 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0b2bd53e024a3c8e84fd8372196c8e" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca"
I20260709 12:18:29.326784 16237 leader_election.cc:304] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b61c58ed04b046d48634e2172dc45851, ce8113a88cac4c138552565af6c645ca; no voters: d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:29.324813 16019 catalog_manager.cc:5697] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca reported cstate change: term changed from 0 to 1, leader changed from <none> to ce8113a88cac4c138552565af6c645ca (127.3.212.131). New cstate: current_term: 1 leader_uuid: "ce8113a88cac4c138552565af6c645ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:29.365891 16270 raft_consensus.cc:3060] T 1e0b2bd53e024a3c8e84fd8372196c8e P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:29.366250 16396 raft_consensus.cc:2804] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:29.366880 16396 raft_consensus.cc:697] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P ce8113a88cac4c138552565af6c645ca [term 1 LEADER]: Becoming Leader. State: Replica: ce8113a88cac4c138552565af6c645ca, State: Running, Role: LEADER
I20260709 12:18:29.367054 16019 catalog_manager.cc:5697] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca reported cstate change: term changed from 0 to 1, leader changed from <none> to ce8113a88cac4c138552565af6c645ca (127.3.212.131). New cstate: current_term: 1 leader_uuid: "ce8113a88cac4c138552565af6c645ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:29.341498 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5a7f087bcb4438adaf7e1dd6aaf10e" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca"
I20260709 12:18:29.368230 16396 consensus_queue.cc:237] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P ce8113a88cac4c138552565af6c645ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:29.370358 16087 leader_election.cc:304] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: b61c58ed04b046d48634e2172dc45851, ce8113a88cac4c138552565af6c645ca
I20260709 12:18:29.371253 16446 raft_consensus.cc:2749] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:18:29.350178 16398 raft_consensus.cc:493] T 7934a0be864f472b90de8265010eb7d1 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.372632 16398 raft_consensus.cc:515] T 7934a0be864f472b90de8265010eb7d1 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:29.327836 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50e97dfcc74bceb3b7d7db53a47278" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca"
I20260709 12:18:29.336614 16441 raft_consensus.cc:2804] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:29.375320 16441 raft_consensus.cc:697] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 LEADER]: Becoming Leader. State: Replica: d58c05fc6fdc40b1bafd92b0c61e34e8, State: Running, Role: LEADER
W20260709 12:18:29.373241 16237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.130:35005, user_credentials={real_user=slave}} blocked reactor thread for 47699.6us
I20260709 12:18:29.376173 16441 consensus_queue.cc:237] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P d58c05fc6fdc40b1bafd92b0c61e34e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:29.339890 16410 leader_election.cc:290] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 1 election: Requested vote from peers b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:29.376737 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7063d3a4c2fb4a2eb8cd6edcae5eb2ac" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca"
I20260709 12:18:29.378007 16272 raft_consensus.cc:2393] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b61c58ed04b046d48634e2172dc45851 in current term 1: Already voted for candidate d58c05fc6fdc40b1bafd92b0c61e34e8 in this term.
I20260709 12:18:29.378214 16087 leader_election.cc:304] T 4c50e97dfcc74bceb3b7d7db53a47278 P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: b61c58ed04b046d48634e2172dc45851, ce8113a88cac4c138552565af6c645ca
I20260709 12:18:29.378937 16270 raft_consensus.cc:2468] T 1e0b2bd53e024a3c8e84fd8372196c8e P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b61c58ed04b046d48634e2172dc45851 in term 1.
I20260709 12:18:29.379086 16410 raft_consensus.cc:2749] T 4c50e97dfcc74bceb3b7d7db53a47278 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:18:29.379667 16162 leader_election.cc:304] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b61c58ed04b046d48634e2172dc45851; no voters: ce8113a88cac4c138552565af6c645ca, d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:29.380424 16319 raft_consensus.cc:2749] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:18:29.381956 16198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7934a0be864f472b90de8265010eb7d1" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b61c58ed04b046d48634e2172dc45851" is_pre_election: true
I20260709 12:18:29.383363 16398 leader_election.cc:290] T 7934a0be864f472b90de8265010eb7d1 P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:29.384497 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7934a0be864f472b90de8265010eb7d1" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca" is_pre_election: true
I20260709 12:18:29.322031 16411 raft_consensus.cc:359] T 7934a0be864f472b90de8265010eb7d1 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:29.386811 16411 raft_consensus.cc:385] T 7934a0be864f472b90de8265010eb7d1 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:29.385237 16270 raft_consensus.cc:2468] T 7934a0be864f472b90de8265010eb7d1 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d58c05fc6fdc40b1bafd92b0c61e34e8 in term 0.
I20260709 12:18:29.388224 16087 leader_election.cc:304] T 7934a0be864f472b90de8265010eb7d1 P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce8113a88cac4c138552565af6c645ca, d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: 
I20260709 12:18:29.389024 16410 raft_consensus.cc:2804] T 7934a0be864f472b90de8265010eb7d1 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:29.389393 16411 raft_consensus.cc:740] T 7934a0be864f472b90de8265010eb7d1 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b61c58ed04b046d48634e2172dc45851, State: Initialized, Role: FOLLOWER
I20260709 12:18:29.389772 16410 raft_consensus.cc:493] T 7934a0be864f472b90de8265010eb7d1 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:29.390169 16410 raft_consensus.cc:3060] T 7934a0be864f472b90de8265010eb7d1 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:29.390443 16411 consensus_queue.cc:260] T 7934a0be864f472b90de8265010eb7d1 P b61c58ed04b046d48634e2172dc45851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:29.391393 16198 raft_consensus.cc:2468] T 7934a0be864f472b90de8265010eb7d1 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d58c05fc6fdc40b1bafd92b0c61e34e8 in term 0.
I20260709 12:18:29.394104 16411 ts_tablet_manager.cc:1434] T 7934a0be864f472b90de8265010eb7d1 P b61c58ed04b046d48634e2172dc45851: Time spent starting tablet: real 0.083s	user 0.007s	sys 0.000s
I20260709 12:18:29.403079 16410 raft_consensus.cc:515] T 7934a0be864f472b90de8265010eb7d1 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:29.408573 16021 catalog_manager.cc:5697] T 7428466d80bc4b3b8fb4346741658617 P b61c58ed04b046d48634e2172dc45851 reported cstate change: term changed from 0 to 1, leader changed from <none> to b61c58ed04b046d48634e2172dc45851 (127.3.212.130). New cstate: current_term: 1 leader_uuid: "b61c58ed04b046d48634e2172dc45851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:29.412654 16021 catalog_manager.cc:5697] T 1e0b2bd53e024a3c8e84fd8372196c8e P b61c58ed04b046d48634e2172dc45851 reported cstate change: term changed from 0 to 1, leader changed from <none> to b61c58ed04b046d48634e2172dc45851 (127.3.212.130). New cstate: current_term: 1 leader_uuid: "b61c58ed04b046d48634e2172dc45851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:29.414031 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7934a0be864f472b90de8265010eb7d1" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b61c58ed04b046d48634e2172dc45851"
I20260709 12:18:29.414759 16199 raft_consensus.cc:3060] T 7934a0be864f472b90de8265010eb7d1 P b61c58ed04b046d48634e2172dc45851 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:29.422310 16199 raft_consensus.cc:2468] T 7934a0be864f472b90de8265010eb7d1 P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d58c05fc6fdc40b1bafd92b0c61e34e8 in term 1.
I20260709 12:18:29.422492 16410 leader_election.cc:290] T 7934a0be864f472b90de8265010eb7d1 P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 1 election: Requested vote from peers b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:29.423169 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7934a0be864f472b90de8265010eb7d1" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca"
I20260709 12:18:29.423888 16019 catalog_manager.cc:5697] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P ce8113a88cac4c138552565af6c645ca reported cstate change: term changed from 0 to 1, leader changed from <none> to ce8113a88cac4c138552565af6c645ca (127.3.212.131). New cstate: current_term: 1 leader_uuid: "ce8113a88cac4c138552565af6c645ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:29.434674 16088 leader_election.cc:304] T 7934a0be864f472b90de8265010eb7d1 P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: 
I20260709 12:18:29.426733 16020 catalog_manager.cc:5697] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P d58c05fc6fdc40b1bafd92b0c61e34e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129). New cstate: current_term: 1 leader_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:29.435422 16019 catalog_manager.cc:5697] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca reported cstate change: term changed from 0 to 1, leader changed from <none> to ce8113a88cac4c138552565af6c645ca (127.3.212.131). New cstate: current_term: 1 leader_uuid: "ce8113a88cac4c138552565af6c645ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:29.436244 16410 raft_consensus.cc:2804] T 7934a0be864f472b90de8265010eb7d1 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:29.434787 16272 raft_consensus.cc:3060] T 7934a0be864f472b90de8265010eb7d1 P ce8113a88cac4c138552565af6c645ca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:29.438500 16410 raft_consensus.cc:697] T 7934a0be864f472b90de8265010eb7d1 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 LEADER]: Becoming Leader. State: Replica: d58c05fc6fdc40b1bafd92b0c61e34e8, State: Running, Role: LEADER
I20260709 12:18:29.439496 16410 consensus_queue.cc:237] T 7934a0be864f472b90de8265010eb7d1 P d58c05fc6fdc40b1bafd92b0c61e34e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:29.445622 16272 raft_consensus.cc:2468] T 7934a0be864f472b90de8265010eb7d1 P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d58c05fc6fdc40b1bafd92b0c61e34e8 in term 1.
I20260709 12:18:29.452021 16020 catalog_manager.cc:5697] T 7934a0be864f472b90de8265010eb7d1 P d58c05fc6fdc40b1bafd92b0c61e34e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129). New cstate: current_term: 1 leader_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:29.476737 16410 consensus_queue.cc:1048] T 1dcba4c6f61b41eab71ddaafd49ed11f P d58c05fc6fdc40b1bafd92b0c61e34e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:29.490578 16441 consensus_queue.cc:1048] T 1dcba4c6f61b41eab71ddaafd49ed11f P d58c05fc6fdc40b1bafd92b0c61e34e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:29.538209 16319 consensus_queue.cc:1048] T 7428466d80bc4b3b8fb4346741658617 P b61c58ed04b046d48634e2172dc45851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:29.548928 16319 consensus_queue.cc:1048] T 7428466d80bc4b3b8fb4346741658617 P b61c58ed04b046d48634e2172dc45851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:29.560312 16438 consensus_queue.cc:1048] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:29.572521 16443 consensus_queue.cc:1048] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:29.643532 16199 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7428466d80bc4b3b8fb4346741658617"
dest_uuid: "b61c58ed04b046d48634e2172dc45851"
mode: GRACEFUL
new_leader_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8"
 from {username='slave'} at 127.0.0.1:56450
I20260709 12:18:29.644114 16199 raft_consensus.cc:606] T 7428466d80bc4b3b8fb4346741658617 P b61c58ed04b046d48634e2172dc45851 [term 1 LEADER]: Received request to transfer leadership to TS d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:29.649264 16199 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e0b2bd53e024a3c8e84fd8372196c8e"
dest_uuid: "b61c58ed04b046d48634e2172dc45851"
mode: GRACEFUL
new_leader_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8"
 from {username='slave'} at 127.0.0.1:56450
I20260709 12:18:29.649875 16199 raft_consensus.cc:606] T 1e0b2bd53e024a3c8e84fd8372196c8e P b61c58ed04b046d48634e2172dc45851 [term 1 LEADER]: Received request to transfer leadership to TS d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:29.654929 16272 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c0f4313ed9e402d9c4067f38e69a61d"
dest_uuid: "ce8113a88cac4c138552565af6c645ca"
mode: GRACEFUL
new_leader_uuid: "b61c58ed04b046d48634e2172dc45851"
 from {username='slave'} at 127.0.0.1:51614
I20260709 12:18:29.655480 16272 raft_consensus.cc:606] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca [term 1 LEADER]: Received request to transfer leadership to TS b61c58ed04b046d48634e2172dc45851
I20260709 12:18:29.661235 16272 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c50e97dfcc74bceb3b7d7db53a47278"
dest_uuid: "ce8113a88cac4c138552565af6c645ca"
mode: GRACEFUL
new_leader_uuid: "b61c58ed04b046d48634e2172dc45851"
 from {username='slave'} at 127.0.0.1:51614
I20260709 12:18:29.661826 16272 raft_consensus.cc:606] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca [term 1 LEADER]: Received request to transfer leadership to TS b61c58ed04b046d48634e2172dc45851
I20260709 12:18:29.666891 16272 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e5a7f087bcb4438adaf7e1dd6aaf10e"
dest_uuid: "ce8113a88cac4c138552565af6c645ca"
mode: GRACEFUL
new_leader_uuid: "b61c58ed04b046d48634e2172dc45851"
 from {username='slave'} at 127.0.0.1:51614
I20260709 12:18:29.667461 16272 raft_consensus.cc:606] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P ce8113a88cac4c138552565af6c645ca [term 1 LEADER]: Received request to transfer leadership to TS b61c58ed04b046d48634e2172dc45851
I20260709 12:18:29.672942 16122 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7934a0be864f472b90de8265010eb7d1"
dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8"
mode: GRACEFUL
new_leader_uuid: "b61c58ed04b046d48634e2172dc45851"
 from {username='slave'} at 127.0.0.1:38430
I20260709 12:18:29.673662 16122 raft_consensus.cc:606] T 7934a0be864f472b90de8265010eb7d1 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 LEADER]: Received request to transfer leadership to TS b61c58ed04b046d48634e2172dc45851
I20260709 12:18:29.721159 16396 consensus_queue.cc:1048] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:29.728350 16443 raft_consensus.cc:993] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca: : Instructing follower b61c58ed04b046d48634e2172dc45851 to start an election
I20260709 12:18:29.728855 16443 raft_consensus.cc:1081] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca [term 1 LEADER]: Signalling peer b61c58ed04b046d48634e2172dc45851 to start an election
I20260709 12:18:29.731156 16198 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4c50e97dfcc74bceb3b7d7db53a47278"
dest_uuid: "b61c58ed04b046d48634e2172dc45851"
 from {username='slave'} at 127.0.0.1:54026
I20260709 12:18:29.731873 16198 raft_consensus.cc:493] T 4c50e97dfcc74bceb3b7d7db53a47278 P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:29.732254 16198 raft_consensus.cc:3060] T 4c50e97dfcc74bceb3b7d7db53a47278 P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:29.734458 16442 consensus_queue.cc:1048] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:29.740903 16198 raft_consensus.cc:515] T 4c50e97dfcc74bceb3b7d7db53a47278 P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:29.742110 16199 raft_consensus.cc:1240] T 4c50e97dfcc74bceb3b7d7db53a47278 P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Rejecting Update request from peer ce8113a88cac4c138552565af6c645ca for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:29.743993 16122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50e97dfcc74bceb3b7d7db53a47278" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8"
I20260709 12:18:29.744411 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50e97dfcc74bceb3b7d7db53a47278" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce8113a88cac4c138552565af6c645ca"
I20260709 12:18:29.744743 16122 raft_consensus.cc:3060] T 4c50e97dfcc74bceb3b7d7db53a47278 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:29.745023 16198 leader_election.cc:290] T 4c50e97dfcc74bceb3b7d7db53a47278 P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 2 election: Requested vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:29.745106 16272 raft_consensus.cc:3055] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:29.745790 16272 raft_consensus.cc:740] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ce8113a88cac4c138552565af6c645ca, State: Running, Role: LEADER
I20260709 12:18:29.746654 16272 consensus_queue.cc:260] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:29.747828 16272 raft_consensus.cc:3060] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:29.753098 16442 consensus_queue.cc:1048] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:29.755080 16122 raft_consensus.cc:2468] T 4c50e97dfcc74bceb3b7d7db53a47278 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b61c58ed04b046d48634e2172dc45851 in term 2.
I20260709 12:18:29.755285 16272 raft_consensus.cc:2468] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b61c58ed04b046d48634e2172dc45851 in term 2.
I20260709 12:18:29.756318 16162 leader_election.cc:304] T 4c50e97dfcc74bceb3b7d7db53a47278 P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b61c58ed04b046d48634e2172dc45851, ce8113a88cac4c138552565af6c645ca; no voters: 
I20260709 12:18:29.757246 16319 raft_consensus.cc:2804] T 4c50e97dfcc74bceb3b7d7db53a47278 P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:29.757850 16319 raft_consensus.cc:697] T 4c50e97dfcc74bceb3b7d7db53a47278 P b61c58ed04b046d48634e2172dc45851 [term 2 LEADER]: Becoming Leader. State: Replica: b61c58ed04b046d48634e2172dc45851, State: Running, Role: LEADER
I20260709 12:18:29.758706 16319 consensus_queue.cc:237] T 4c50e97dfcc74bceb3b7d7db53a47278 P b61c58ed04b046d48634e2172dc45851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:29.765081 16443 consensus_queue.cc:1048] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:29.771111 16019 catalog_manager.cc:5697] T 4c50e97dfcc74bceb3b7d7db53a47278 P b61c58ed04b046d48634e2172dc45851 reported cstate change: term changed from 1 to 2, leader changed from ce8113a88cac4c138552565af6c645ca (127.3.212.131) to b61c58ed04b046d48634e2172dc45851 (127.3.212.130). New cstate: current_term: 2 leader_uuid: "b61c58ed04b046d48634e2172dc45851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:29.803771 16319 consensus_queue.cc:1048] T 1e0b2bd53e024a3c8e84fd8372196c8e P b61c58ed04b046d48634e2172dc45851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:29.815219 16419 consensus_queue.cc:1048] T 1e0b2bd53e024a3c8e84fd8372196c8e P b61c58ed04b046d48634e2172dc45851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:29.825480 16419 raft_consensus.cc:993] T 1e0b2bd53e024a3c8e84fd8372196c8e P b61c58ed04b046d48634e2172dc45851: : Instructing follower d58c05fc6fdc40b1bafd92b0c61e34e8 to start an election
I20260709 12:18:29.825974 16447 raft_consensus.cc:1081] T 1e0b2bd53e024a3c8e84fd8372196c8e P b61c58ed04b046d48634e2172dc45851 [term 1 LEADER]: Signalling peer d58c05fc6fdc40b1bafd92b0c61e34e8 to start an election
I20260709 12:18:29.827589 16124 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1e0b2bd53e024a3c8e84fd8372196c8e"
dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8"
 from {username='slave'} at 127.0.0.1:48584
I20260709 12:18:29.828172 16124 raft_consensus.cc:493] T 1e0b2bd53e024a3c8e84fd8372196c8e P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:29.828497 16124 raft_consensus.cc:3060] T 1e0b2bd53e024a3c8e84fd8372196c8e P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:29.833880 16124 raft_consensus.cc:515] T 1e0b2bd53e024a3c8e84fd8372196c8e P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:29.837558 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0b2bd53e024a3c8e84fd8372196c8e" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce8113a88cac4c138552565af6c645ca"
I20260709 12:18:29.838204 16272 raft_consensus.cc:3060] T 1e0b2bd53e024a3c8e84fd8372196c8e P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:29.840960 16443 consensus_queue.cc:1048] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P ce8113a88cac4c138552565af6c645ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:29.842200 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0b2bd53e024a3c8e84fd8372196c8e" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b61c58ed04b046d48634e2172dc45851"
I20260709 12:18:29.842866 16199 raft_consensus.cc:3055] T 1e0b2bd53e024a3c8e84fd8372196c8e P b61c58ed04b046d48634e2172dc45851 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:29.843148 16199 raft_consensus.cc:740] T 1e0b2bd53e024a3c8e84fd8372196c8e P b61c58ed04b046d48634e2172dc45851 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b61c58ed04b046d48634e2172dc45851, State: Running, Role: LEADER
I20260709 12:18:29.843935 16199 consensus_queue.cc:260] T 1e0b2bd53e024a3c8e84fd8372196c8e P b61c58ed04b046d48634e2172dc45851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:29.845036 16199 raft_consensus.cc:3060] T 1e0b2bd53e024a3c8e84fd8372196c8e P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:29.848335 16272 raft_consensus.cc:2468] T 1e0b2bd53e024a3c8e84fd8372196c8e P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d58c05fc6fdc40b1bafd92b0c61e34e8 in term 2.
I20260709 12:18:29.849516 16124 leader_election.cc:290] T 1e0b2bd53e024a3c8e84fd8372196c8e P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 2 election: Requested vote from peers b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:29.849879 16087 leader_election.cc:304] T 1e0b2bd53e024a3c8e84fd8372196c8e P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce8113a88cac4c138552565af6c645ca, d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: 
I20260709 12:18:29.850862 16410 raft_consensus.cc:2804] T 1e0b2bd53e024a3c8e84fd8372196c8e P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:29.851351 16410 raft_consensus.cc:697] T 1e0b2bd53e024a3c8e84fd8372196c8e P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 LEADER]: Becoming Leader. State: Replica: d58c05fc6fdc40b1bafd92b0c61e34e8, State: Running, Role: LEADER
I20260709 12:18:29.852197 16410 consensus_queue.cc:237] T 1e0b2bd53e024a3c8e84fd8372196c8e P d58c05fc6fdc40b1bafd92b0c61e34e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:29.857339 16441 consensus_queue.cc:1048] T 7934a0be864f472b90de8265010eb7d1 P d58c05fc6fdc40b1bafd92b0c61e34e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:29.859705 16199 raft_consensus.cc:2468] T 1e0b2bd53e024a3c8e84fd8372196c8e P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d58c05fc6fdc40b1bafd92b0c61e34e8 in term 2.
I20260709 12:18:29.864290 16021 catalog_manager.cc:5697] T 1e0b2bd53e024a3c8e84fd8372196c8e P d58c05fc6fdc40b1bafd92b0c61e34e8 reported cstate change: term changed from 1 to 2, leader changed from b61c58ed04b046d48634e2172dc45851 (127.3.212.130) to d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129). New cstate: current_term: 2 leader_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:29.871614 16398 raft_consensus.cc:993] T 7934a0be864f472b90de8265010eb7d1 P d58c05fc6fdc40b1bafd92b0c61e34e8: : Instructing follower b61c58ed04b046d48634e2172dc45851 to start an election
I20260709 12:18:29.871424 16443 consensus_queue.cc:1048] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P ce8113a88cac4c138552565af6c645ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:29.872141 16398 raft_consensus.cc:1081] T 7934a0be864f472b90de8265010eb7d1 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 LEADER]: Signalling peer b61c58ed04b046d48634e2172dc45851 to start an election
I20260709 12:18:29.879124 16199 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7934a0be864f472b90de8265010eb7d1"
dest_uuid: "b61c58ed04b046d48634e2172dc45851"
 from {username='slave'} at 127.0.0.1:54022
I20260709 12:18:29.879710 16199 raft_consensus.cc:493] T 7934a0be864f472b90de8265010eb7d1 P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:29.880105 16199 raft_consensus.cc:3060] T 7934a0be864f472b90de8265010eb7d1 P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:29.880460 16410 consensus_queue.cc:1048] T 7934a0be864f472b90de8265010eb7d1 P d58c05fc6fdc40b1bafd92b0c61e34e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:29.890389 16199 raft_consensus.cc:515] T 7934a0be864f472b90de8265010eb7d1 P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:29.892834 16199 leader_election.cc:290] T 7934a0be864f472b90de8265010eb7d1 P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 2 election: Requested vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:29.894227 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7934a0be864f472b90de8265010eb7d1" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce8113a88cac4c138552565af6c645ca"
I20260709 12:18:29.894526 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7934a0be864f472b90de8265010eb7d1" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8"
I20260709 12:18:29.895707 16124 raft_consensus.cc:3055] T 7934a0be864f472b90de8265010eb7d1 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:29.896049 16124 raft_consensus.cc:740] T 7934a0be864f472b90de8265010eb7d1 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d58c05fc6fdc40b1bafd92b0c61e34e8, State: Running, Role: LEADER
I20260709 12:18:29.896879 16124 consensus_queue.cc:260] T 7934a0be864f472b90de8265010eb7d1 P d58c05fc6fdc40b1bafd92b0c61e34e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:29.898083 16124 raft_consensus.cc:3060] T 7934a0be864f472b90de8265010eb7d1 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:29.905038 16124 raft_consensus.cc:2468] T 7934a0be864f472b90de8265010eb7d1 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b61c58ed04b046d48634e2172dc45851 in term 2.
I20260709 12:18:29.909768 16164 leader_election.cc:304] T 7934a0be864f472b90de8265010eb7d1 P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: ce8113a88cac4c138552565af6c645ca
I20260709 12:18:29.911525 16447 raft_consensus.cc:2804] T 7934a0be864f472b90de8265010eb7d1 P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:29.912067 16447 raft_consensus.cc:697] T 7934a0be864f472b90de8265010eb7d1 P b61c58ed04b046d48634e2172dc45851 [term 2 LEADER]: Becoming Leader. State: Replica: b61c58ed04b046d48634e2172dc45851, State: Running, Role: LEADER
I20260709 12:18:29.913007 16447 consensus_queue.cc:237] T 7934a0be864f472b90de8265010eb7d1 P b61c58ed04b046d48634e2172dc45851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:29.916322 16442 raft_consensus.cc:993] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P ce8113a88cac4c138552565af6c645ca: : Instructing follower b61c58ed04b046d48634e2172dc45851 to start an election
I20260709 12:18:29.916865 16442 raft_consensus.cc:1081] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P ce8113a88cac4c138552565af6c645ca [term 1 LEADER]: Signalling peer b61c58ed04b046d48634e2172dc45851 to start an election
I20260709 12:18:29.919795 16199 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e5a7f087bcb4438adaf7e1dd6aaf10e"
dest_uuid: "b61c58ed04b046d48634e2172dc45851"
 from {username='slave'} at 127.0.0.1:54026
I20260709 12:18:29.920562 16199 raft_consensus.cc:493] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:29.921007 16199 raft_consensus.cc:3060] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:29.928310 16199 raft_consensus.cc:515] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:29.930557 16199 leader_election.cc:290] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 2 election: Requested vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:29.931224 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5a7f087bcb4438adaf7e1dd6aaf10e" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8"
I20260709 12:18:29.932072 16124 raft_consensus.cc:3060] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:29.932191 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e5a7f087bcb4438adaf7e1dd6aaf10e" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce8113a88cac4c138552565af6c645ca"
I20260709 12:18:29.932928 16272 raft_consensus.cc:3055] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P ce8113a88cac4c138552565af6c645ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:29.933220 16272 raft_consensus.cc:740] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P ce8113a88cac4c138552565af6c645ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ce8113a88cac4c138552565af6c645ca, State: Running, Role: LEADER
I20260709 12:18:29.934158 16272 consensus_queue.cc:260] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P ce8113a88cac4c138552565af6c645ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:29.935560 16272 raft_consensus.cc:3060] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:29.935866 16021 catalog_manager.cc:5697] T 7934a0be864f472b90de8265010eb7d1 P b61c58ed04b046d48634e2172dc45851 reported cstate change: term changed from 1 to 2, leader changed from d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129) to b61c58ed04b046d48634e2172dc45851 (127.3.212.130). New cstate: current_term: 2 leader_uuid: "b61c58ed04b046d48634e2172dc45851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:29.941704 16124 raft_consensus.cc:2468] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b61c58ed04b046d48634e2172dc45851 in term 2.
I20260709 12:18:29.942924 16272 raft_consensus.cc:2468] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b61c58ed04b046d48634e2172dc45851 in term 2.
I20260709 12:18:29.943094 16164 leader_election.cc:304] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: 
I20260709 12:18:29.943892 16447 raft_consensus.cc:2804] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:29.944334 16447 raft_consensus.cc:697] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P b61c58ed04b046d48634e2172dc45851 [term 2 LEADER]: Becoming Leader. State: Replica: b61c58ed04b046d48634e2172dc45851, State: Running, Role: LEADER
I20260709 12:18:29.945043 16447 consensus_queue.cc:237] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P b61c58ed04b046d48634e2172dc45851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:29.952051 16021 catalog_manager.cc:5697] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P b61c58ed04b046d48634e2172dc45851 reported cstate change: term changed from 1 to 2, leader changed from ce8113a88cac4c138552565af6c645ca (127.3.212.131) to b61c58ed04b046d48634e2172dc45851 (127.3.212.130). New cstate: current_term: 2 leader_uuid: "b61c58ed04b046d48634e2172dc45851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:29.999042 16398 consensus_queue.cc:1048] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P d58c05fc6fdc40b1bafd92b0c61e34e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:30.004333 16447 raft_consensus.cc:993] T 7428466d80bc4b3b8fb4346741658617 P b61c58ed04b046d48634e2172dc45851: : Instructing follower d58c05fc6fdc40b1bafd92b0c61e34e8 to start an election
I20260709 12:18:30.004974 16419 raft_consensus.cc:1081] T 7428466d80bc4b3b8fb4346741658617 P b61c58ed04b046d48634e2172dc45851 [term 1 LEADER]: Signalling peer d58c05fc6fdc40b1bafd92b0c61e34e8 to start an election
I20260709 12:18:30.007135 16124 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7428466d80bc4b3b8fb4346741658617"
dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8"
 from {username='slave'} at 127.0.0.1:48584
I20260709 12:18:30.009038 16124 raft_consensus.cc:493] T 7428466d80bc4b3b8fb4346741658617 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:30.008641 16398 consensus_queue.cc:1048] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P d58c05fc6fdc40b1bafd92b0c61e34e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:30.009907 16124 raft_consensus.cc:3060] T 7428466d80bc4b3b8fb4346741658617 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:30.020551 16124 raft_consensus.cc:515] T 7428466d80bc4b3b8fb4346741658617 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:30.023125 16124 leader_election.cc:290] T 7428466d80bc4b3b8fb4346741658617 P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 2 election: Requested vote from peers b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:30.023960 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7428466d80bc4b3b8fb4346741658617" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce8113a88cac4c138552565af6c645ca"
I20260709 12:18:30.024669 16270 raft_consensus.cc:3060] T 7428466d80bc4b3b8fb4346741658617 P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:30.025920 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7428466d80bc4b3b8fb4346741658617" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b61c58ed04b046d48634e2172dc45851"
I20260709 12:18:30.026558 16199 raft_consensus.cc:3055] T 7428466d80bc4b3b8fb4346741658617 P b61c58ed04b046d48634e2172dc45851 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:30.026857 16199 raft_consensus.cc:740] T 7428466d80bc4b3b8fb4346741658617 P b61c58ed04b046d48634e2172dc45851 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b61c58ed04b046d48634e2172dc45851, State: Running, Role: LEADER
I20260709 12:18:30.027582 16199 consensus_queue.cc:260] T 7428466d80bc4b3b8fb4346741658617 P b61c58ed04b046d48634e2172dc45851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:30.028630 16199 raft_consensus.cc:3060] T 7428466d80bc4b3b8fb4346741658617 P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:30.032960 16270 raft_consensus.cc:2468] T 7428466d80bc4b3b8fb4346741658617 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d58c05fc6fdc40b1bafd92b0c61e34e8 in term 2.
I20260709 12:18:30.037485 16087 leader_election.cc:304] T 7428466d80bc4b3b8fb4346741658617 P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce8113a88cac4c138552565af6c645ca, d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: 
I20260709 12:18:30.039712 16410 raft_consensus.cc:2804] T 7428466d80bc4b3b8fb4346741658617 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:30.040246 16410 raft_consensus.cc:697] T 7428466d80bc4b3b8fb4346741658617 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 LEADER]: Becoming Leader. State: Replica: d58c05fc6fdc40b1bafd92b0c61e34e8, State: Running, Role: LEADER
I20260709 12:18:30.041087 16410 consensus_queue.cc:237] T 7428466d80bc4b3b8fb4346741658617 P d58c05fc6fdc40b1bafd92b0c61e34e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:30.042016 16199 raft_consensus.cc:2468] T 7428466d80bc4b3b8fb4346741658617 P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d58c05fc6fdc40b1bafd92b0c61e34e8 in term 2.
I20260709 12:18:30.052065 16020 catalog_manager.cc:5697] T 7428466d80bc4b3b8fb4346741658617 P d58c05fc6fdc40b1bafd92b0c61e34e8 reported cstate change: term changed from 1 to 2, leader changed from b61c58ed04b046d48634e2172dc45851 (127.3.212.130) to d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129). New cstate: current_term: 2 leader_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:30.144182 16124 raft_consensus.cc:1275] T 4c50e97dfcc74bceb3b7d7db53a47278 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Refusing update from remote peer b61c58ed04b046d48634e2172dc45851: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:30.145433 16447 consensus_queue.cc:1048] T 4c50e97dfcc74bceb3b7d7db53a47278 P b61c58ed04b046d48634e2172dc45851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:30.153774 16270 raft_consensus.cc:1275] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Refusing update from remote peer b61c58ed04b046d48634e2172dc45851: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:30.155704 16418 consensus_queue.cc:1048] T 4c50e97dfcc74bceb3b7d7db53a47278 P b61c58ed04b046d48634e2172dc45851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:30.181993 16438 raft_consensus.cc:993] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca: : Instructing follower b61c58ed04b046d48634e2172dc45851 to start an election
I20260709 12:18:30.182533 16443 raft_consensus.cc:1081] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca [term 1 LEADER]: Signalling peer b61c58ed04b046d48634e2172dc45851 to start an election
I20260709 12:18:30.184262 16199 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c0f4313ed9e402d9c4067f38e69a61d"
dest_uuid: "b61c58ed04b046d48634e2172dc45851"
 from {username='slave'} at 127.0.0.1:54026
I20260709 12:18:30.184796 16199 raft_consensus.cc:493] T 3c0f4313ed9e402d9c4067f38e69a61d P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:30.185086 16199 raft_consensus.cc:3060] T 3c0f4313ed9e402d9c4067f38e69a61d P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:30.189987 16199 raft_consensus.cc:515] T 3c0f4313ed9e402d9c4067f38e69a61d P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:30.191390 16199 leader_election.cc:290] T 3c0f4313ed9e402d9c4067f38e69a61d P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 2 election: Requested vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:30.192304 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0f4313ed9e402d9c4067f38e69a61d" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8"
I20260709 12:18:30.192430 16270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0f4313ed9e402d9c4067f38e69a61d" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ce8113a88cac4c138552565af6c645ca"
I20260709 12:18:30.193044 16124 raft_consensus.cc:3060] T 3c0f4313ed9e402d9c4067f38e69a61d P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:30.193348 16270 raft_consensus.cc:3055] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:30.193670 16270 raft_consensus.cc:740] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ce8113a88cac4c138552565af6c645ca, State: Running, Role: LEADER
I20260709 12:18:30.194340 16270 consensus_queue.cc:260] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:30.195326 16270 raft_consensus.cc:3060] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:30.198282 16124 raft_consensus.cc:2468] T 3c0f4313ed9e402d9c4067f38e69a61d P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b61c58ed04b046d48634e2172dc45851 in term 2.
I20260709 12:18:30.199551 16164 leader_election.cc:304] T 3c0f4313ed9e402d9c4067f38e69a61d P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: 
I20260709 12:18:30.200484 16418 raft_consensus.cc:2804] T 3c0f4313ed9e402d9c4067f38e69a61d P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:30.200901 16418 raft_consensus.cc:697] T 3c0f4313ed9e402d9c4067f38e69a61d P b61c58ed04b046d48634e2172dc45851 [term 2 LEADER]: Becoming Leader. State: Replica: b61c58ed04b046d48634e2172dc45851, State: Running, Role: LEADER
I20260709 12:18:30.201326 16270 raft_consensus.cc:2468] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b61c58ed04b046d48634e2172dc45851 in term 2.
I20260709 12:18:30.201681 16418 consensus_queue.cc:237] T 3c0f4313ed9e402d9c4067f38e69a61d P b61c58ed04b046d48634e2172dc45851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:30.209079 16020 catalog_manager.cc:5697] T 3c0f4313ed9e402d9c4067f38e69a61d P b61c58ed04b046d48634e2172dc45851 reported cstate change: term changed from 1 to 2, leader changed from ce8113a88cac4c138552565af6c645ca (127.3.212.131) to b61c58ed04b046d48634e2172dc45851 (127.3.212.130). New cstate: current_term: 2 leader_uuid: "b61c58ed04b046d48634e2172dc45851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:30.283522 16199 raft_consensus.cc:1275] T 1e0b2bd53e024a3c8e84fd8372196c8e P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Refusing update from remote peer d58c05fc6fdc40b1bafd92b0c61e34e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:30.285107 16410 consensus_queue.cc:1048] T 1e0b2bd53e024a3c8e84fd8372196c8e P d58c05fc6fdc40b1bafd92b0c61e34e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:30.297982 16270 raft_consensus.cc:1275] T 1e0b2bd53e024a3c8e84fd8372196c8e P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Refusing update from remote peer d58c05fc6fdc40b1bafd92b0c61e34e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:30.300434 16410 consensus_queue.cc:1048] T 1e0b2bd53e024a3c8e84fd8372196c8e P d58c05fc6fdc40b1bafd92b0c61e34e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:30.336367 16272 raft_consensus.cc:1275] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Refusing update from remote peer b61c58ed04b046d48634e2172dc45851: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:30.337743 16418 consensus_queue.cc:1048] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P b61c58ed04b046d48634e2172dc45851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:30.345400 16124 raft_consensus.cc:1275] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Refusing update from remote peer b61c58ed04b046d48634e2172dc45851: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:30.347160 16319 consensus_queue.cc:1048] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P b61c58ed04b046d48634e2172dc45851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:30.429065 16124 raft_consensus.cc:1275] T 7934a0be864f472b90de8265010eb7d1 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Refusing update from remote peer b61c58ed04b046d48634e2172dc45851: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:30.430403 16319 consensus_queue.cc:1048] T 7934a0be864f472b90de8265010eb7d1 P b61c58ed04b046d48634e2172dc45851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:30.437914 16272 raft_consensus.cc:3060] T 7934a0be864f472b90de8265010eb7d1 P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:30.446339 16272 raft_consensus.cc:1275] T 7934a0be864f472b90de8265010eb7d1 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Refusing update from remote peer b61c58ed04b046d48634e2172dc45851: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:30.447860 16447 consensus_queue.cc:1048] T 7934a0be864f472b90de8265010eb7d1 P b61c58ed04b046d48634e2172dc45851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:30.452754 16199 raft_consensus.cc:1275] T 7428466d80bc4b3b8fb4346741658617 P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Refusing update from remote peer d58c05fc6fdc40b1bafd92b0c61e34e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:30.454149 16441 consensus_queue.cc:1048] T 7428466d80bc4b3b8fb4346741658617 P d58c05fc6fdc40b1bafd92b0c61e34e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:30.466621 16272 raft_consensus.cc:1275] T 7428466d80bc4b3b8fb4346741658617 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Refusing update from remote peer d58c05fc6fdc40b1bafd92b0c61e34e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:30.468397 16441 consensus_queue.cc:1048] T 7428466d80bc4b3b8fb4346741658617 P d58c05fc6fdc40b1bafd92b0c61e34e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:30.686954 16272 raft_consensus.cc:1275] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Refusing update from remote peer b61c58ed04b046d48634e2172dc45851: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:30.688870 16319 consensus_queue.cc:1048] T 3c0f4313ed9e402d9c4067f38e69a61d P b61c58ed04b046d48634e2172dc45851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:30.698388 16124 raft_consensus.cc:1275] T 3c0f4313ed9e402d9c4067f38e69a61d P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Refusing update from remote peer b61c58ed04b046d48634e2172dc45851: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:30.700428 16447 consensus_queue.cc:1048] T 3c0f4313ed9e402d9c4067f38e69a61d P b61c58ed04b046d48634e2172dc45851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:32.680742 16019 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37242:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:18:32.701992 16019 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37242:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:18:32.840559  3922 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 12:18:32.954061 16504 log.cc:927] Time spent T 1e0b2bd53e024a3c8e84fd8372196c8e P d58c05fc6fdc40b1bafd92b0c61e34e8: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
W20260709 12:18:32.961288 16513 log.cc:927] Time spent T 7934a0be864f472b90de8265010eb7d1 P b61c58ed04b046d48634e2172dc45851: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:18:32.907670 16509 tablet.cc:1724] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P d58c05fc6fdc40b1bafd92b0c61e34e8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:18:32.959865 16507 log.cc:927] Time spent T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
W20260709 12:18:32.974669 16515 log.cc:927] Time spent T 4c50e97dfcc74bceb3b7d7db53a47278 P b61c58ed04b046d48634e2172dc45851: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 12:18:32.980237 16150 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:7063d3a4c2fb4a2eb8cd6edcae5eb2ac)
W20260709 12:18:32.984501 16150 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:7063d3a4c2fb4a2eb8cd6edcae5eb2ac)
I20260709 12:18:33.031286 16532 tablet.cc:1724] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P ce8113a88cac4c138552565af6c645ca: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:18:33.127471 16299 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:7063d3a4c2fb4a2eb8cd6edcae5eb2ac)
I20260709 12:18:33.140024 16548 tablet.cc:1724] T 5fef361fdd2840b6b5af55b92f7343a0 P b61c58ed04b046d48634e2172dc45851: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:33.111392 16541 tablet.cc:1724] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:33.148994 16546 tablet.cc:1724] T 1e0b2bd53e024a3c8e84fd8372196c8e P d58c05fc6fdc40b1bafd92b0c61e34e8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:33.159000 16547 tablet.cc:1724] T 3c0f4313ed9e402d9c4067f38e69a61d P b61c58ed04b046d48634e2172dc45851: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:33.155014 16551 tablet.cc:1724] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P b61c58ed04b046d48634e2172dc45851: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:33.155179 16532 tablet.cc:1724] T 1dcba4c6f61b41eab71ddaafd49ed11f P ce8113a88cac4c138552565af6c645ca: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:33.153685 16550 tablet.cc:1724] T 7428466d80bc4b3b8fb4346741658617 P d58c05fc6fdc40b1bafd92b0c61e34e8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:33.270344 16552 tablet.cc:1724] T 7428466d80bc4b3b8fb4346741658617 P b61c58ed04b046d48634e2172dc45851: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:33.277221 16556 tablet.cc:1724] T 3c0f4313ed9e402d9c4067f38e69a61d P d58c05fc6fdc40b1bafd92b0c61e34e8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:33.302448 16560 tablet.cc:1724] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:33.304642 16547 tablet.cc:1724] T 1e0b2bd53e024a3c8e84fd8372196c8e P b61c58ed04b046d48634e2172dc45851: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:33.319531 16547 tablet.cc:1724] T 7934a0be864f472b90de8265010eb7d1 P b61c58ed04b046d48634e2172dc45851: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:33.319523 16546 tablet.cc:1724] T 5fef361fdd2840b6b5af55b92f7343a0 P d58c05fc6fdc40b1bafd92b0c61e34e8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:33.327179 16121 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7063d3a4c2fb4a2eb8cd6edcae5eb2ac"
dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8"
mode: GRACEFUL
new_leader_uuid: "ce8113a88cac4c138552565af6c645ca"
 from {username='slave'} at 127.0.0.1:38446
I20260709 12:18:33.327984 16121 raft_consensus.cc:606] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 LEADER]: Received request to transfer leadership to TS ce8113a88cac4c138552565af6c645ca
I20260709 12:18:33.330386 16551 tablet.cc:1724] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P b61c58ed04b046d48634e2172dc45851: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:33.333344 16560 tablet.cc:1724] T 7934a0be864f472b90de8265010eb7d1 P ce8113a88cac4c138552565af6c645ca: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:33.332988 16547 tablet.cc:1724] T 1dcba4c6f61b41eab71ddaafd49ed11f P b61c58ed04b046d48634e2172dc45851: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:33.213038 16509 tablet.cc:1724] T 1dcba4c6f61b41eab71ddaafd49ed11f P d58c05fc6fdc40b1bafd92b0c61e34e8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:33.349650 16556 tablet.cc:1724] T 7934a0be864f472b90de8265010eb7d1 P d58c05fc6fdc40b1bafd92b0c61e34e8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:33.368557 16561 tablet.cc:1724] T 1e0b2bd53e024a3c8e84fd8372196c8e P ce8113a88cac4c138552565af6c645ca: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:33.371019 16546 tablet.cc:1724] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P d58c05fc6fdc40b1bafd92b0c61e34e8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:18:33.374771 16162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:45363, user_credentials={real_user=slave}} blocked reactor thread for 64199.2us
I20260709 12:18:33.380667 16551 tablet.cc:1724] T 4c50e97dfcc74bceb3b7d7db53a47278 P b61c58ed04b046d48634e2172dc45851: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:33.395884 16532 tablet.cc:1724] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P ce8113a88cac4c138552565af6c645ca: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:33.398993 16560 tablet.cc:1724] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:33.412835 16556 tablet.cc:1724] T 4c50e97dfcc74bceb3b7d7db53a47278 P d58c05fc6fdc40b1bafd92b0c61e34e8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:33.421196 16561 tablet.cc:1724] T 7428466d80bc4b3b8fb4346741658617 P ce8113a88cac4c138552565af6c645ca: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:18:33.450476 16197 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7934a0be864f472b90de8265010eb7d1"
dest_uuid: "b61c58ed04b046d48634e2172dc45851"
mode: GRACEFUL
new_leader_uuid: "ce8113a88cac4c138552565af6c645ca"
 from {username='slave'} at 127.0.0.1:56462
I20260709 12:18:33.451206 16197 raft_consensus.cc:606] T 7934a0be864f472b90de8265010eb7d1 P b61c58ed04b046d48634e2172dc45851 [term 2 LEADER]: Received request to transfer leadership to TS ce8113a88cac4c138552565af6c645ca
I20260709 12:18:33.452899  3922 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 12:18:33.453470  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:33.455377 16021 catalog_manager.cc:6242] T 00000000000000000000000000000000 P c9919d343bce47aea8d50591a147abca: soft_deleted_table [id=90f938c5385f45b4889932dadaae1cca] alter complete (version 1)
I20260709 12:18:33.468818 16123 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a632db0115e4b18a7e169bdf6d970ed"
dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8"
mode: GRACEFUL
new_leader_uuid: "ce8113a88cac4c138552565af6c645ca"
 from {username='slave'} at 127.0.0.1:38446
I20260709 12:18:33.469344 16123 raft_consensus.cc:606] T 3a632db0115e4b18a7e169bdf6d970ed P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 LEADER]: Received request to transfer leadership to TS ce8113a88cac4c138552565af6c645ca
I20260709 12:18:33.472136 16197 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dbb55848f9c040ac9db9b7849e2a0d8a"
dest_uuid: "b61c58ed04b046d48634e2172dc45851"
mode: GRACEFUL
new_leader_uuid: "ce8113a88cac4c138552565af6c645ca"
 from {username='slave'} at 127.0.0.1:56462
I20260709 12:18:33.472944 16197 raft_consensus.cc:606] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 [term 1 LEADER]: Received request to transfer leadership to TS ce8113a88cac4c138552565af6c645ca
I20260709 12:18:33.474231  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:18:33.474833  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:33.489342 16529 raft_consensus.cc:993] T 3a632db0115e4b18a7e169bdf6d970ed P d58c05fc6fdc40b1bafd92b0c61e34e8: : Instructing follower ce8113a88cac4c138552565af6c645ca to start an election
I20260709 12:18:33.490252 16529 raft_consensus.cc:1081] T 3a632db0115e4b18a7e169bdf6d970ed P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 LEADER]: Signalling peer ce8113a88cac4c138552565af6c645ca to start an election
I20260709 12:18:33.492069 16273 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3a632db0115e4b18a7e169bdf6d970ed"
dest_uuid: "ce8113a88cac4c138552565af6c645ca"
 from {username='slave'} at 127.0.0.1:56470
I20260709 12:18:33.492710 16273 raft_consensus.cc:493] T 3a632db0115e4b18a7e169bdf6d970ed P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:33.493010 16273 raft_consensus.cc:3060] T 3a632db0115e4b18a7e169bdf6d970ed P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:33.499828 16273 raft_consensus.cc:515] T 3a632db0115e4b18a7e169bdf6d970ed P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:33.502135 16273 leader_election.cc:290] T 3a632db0115e4b18a7e169bdf6d970ed P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 2 election: Requested vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
I20260709 12:18:33.502966 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a632db0115e4b18a7e169bdf6d970ed" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8"
I20260709 12:18:33.503710 16123 raft_consensus.cc:3055] T 3a632db0115e4b18a7e169bdf6d970ed P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:33.503789 16197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a632db0115e4b18a7e169bdf6d970ed" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b61c58ed04b046d48634e2172dc45851"
I20260709 12:18:33.503993 16123 raft_consensus.cc:740] T 3a632db0115e4b18a7e169bdf6d970ed P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d58c05fc6fdc40b1bafd92b0c61e34e8, State: Running, Role: LEADER
I20260709 12:18:33.504452 16197 raft_consensus.cc:3060] T 3a632db0115e4b18a7e169bdf6d970ed P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:33.504979 16123 consensus_queue.cc:260] T 3a632db0115e4b18a7e169bdf6d970ed P d58c05fc6fdc40b1bafd92b0c61e34e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:33.506105 16123 raft_consensus.cc:3060] T 3a632db0115e4b18a7e169bdf6d970ed P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:33.510004 16197 raft_consensus.cc:2468] T 3a632db0115e4b18a7e169bdf6d970ed P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce8113a88cac4c138552565af6c645ca in term 2.
I20260709 12:18:33.511224 16237 leader_election.cc:304] T 3a632db0115e4b18a7e169bdf6d970ed P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b61c58ed04b046d48634e2172dc45851, ce8113a88cac4c138552565af6c645ca; no voters: 
I20260709 12:18:33.512038 16438 raft_consensus.cc:2804] T 3a632db0115e4b18a7e169bdf6d970ed P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:33.512276 16123 raft_consensus.cc:2468] T 3a632db0115e4b18a7e169bdf6d970ed P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce8113a88cac4c138552565af6c645ca in term 2.
I20260709 12:18:33.512442 16438 raft_consensus.cc:697] T 3a632db0115e4b18a7e169bdf6d970ed P ce8113a88cac4c138552565af6c645ca [term 2 LEADER]: Becoming Leader. State: Replica: ce8113a88cac4c138552565af6c645ca, State: Running, Role: LEADER
I20260709 12:18:33.513419 16438 consensus_queue.cc:237] T 3a632db0115e4b18a7e169bdf6d970ed P ce8113a88cac4c138552565af6c645ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:33.522331 16019 catalog_manager.cc:5697] T 3a632db0115e4b18a7e169bdf6d970ed P ce8113a88cac4c138552565af6c645ca reported cstate change: term changed from 1 to 2, leader changed from d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129) to ce8113a88cac4c138552565af6c645ca (127.3.212.131). New cstate: current_term: 2 leader_uuid: "ce8113a88cac4c138552565af6c645ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:33.637470 16529 raft_consensus.cc:993] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P d58c05fc6fdc40b1bafd92b0c61e34e8: : Instructing follower ce8113a88cac4c138552565af6c645ca to start an election
I20260709 12:18:33.637916 16523 raft_consensus.cc:1081] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 LEADER]: Signalling peer ce8113a88cac4c138552565af6c645ca to start an election
I20260709 12:18:33.639557 16273 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7063d3a4c2fb4a2eb8cd6edcae5eb2ac"
dest_uuid: "ce8113a88cac4c138552565af6c645ca"
 from {username='slave'} at 127.0.0.1:56470
I20260709 12:18:33.640074 16273 raft_consensus.cc:493] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:33.640372 16273 raft_consensus.cc:3060] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:33.645799 16273 raft_consensus.cc:515] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:33.647922 16273 leader_election.cc:290] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 2 election: Requested vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
I20260709 12:18:33.648964 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7063d3a4c2fb4a2eb8cd6edcae5eb2ac" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8"
I20260709 12:18:33.649202 16197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7063d3a4c2fb4a2eb8cd6edcae5eb2ac" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "b61c58ed04b046d48634e2172dc45851"
I20260709 12:18:33.649715 16123 raft_consensus.cc:3055] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:33.649852 16197 raft_consensus.cc:3060] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:33.650022 16123 raft_consensus.cc:740] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d58c05fc6fdc40b1bafd92b0c61e34e8, State: Running, Role: LEADER
I20260709 12:18:33.650848 16123 consensus_queue.cc:260] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P d58c05fc6fdc40b1bafd92b0c61e34e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:33.652112 16123 raft_consensus.cc:3060] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:33.656867 16197 raft_consensus.cc:2468] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce8113a88cac4c138552565af6c645ca in term 2.
I20260709 12:18:33.658007 16123 raft_consensus.cc:2468] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce8113a88cac4c138552565af6c645ca in term 2.
I20260709 12:18:33.658012 16237 leader_election.cc:304] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b61c58ed04b046d48634e2172dc45851, ce8113a88cac4c138552565af6c645ca; no voters: 
I20260709 12:18:33.659148 16438 raft_consensus.cc:2804] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:33.659682 16438 raft_consensus.cc:697] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P ce8113a88cac4c138552565af6c645ca [term 2 LEADER]: Becoming Leader. State: Replica: ce8113a88cac4c138552565af6c645ca, State: Running, Role: LEADER
I20260709 12:18:33.660497 16438 consensus_queue.cc:237] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P ce8113a88cac4c138552565af6c645ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:33.670627 16019 catalog_manager.cc:5697] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P ce8113a88cac4c138552565af6c645ca reported cstate change: term changed from 1 to 2, leader changed from d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129) to ce8113a88cac4c138552565af6c645ca (127.3.212.131). New cstate: current_term: 2 leader_uuid: "ce8113a88cac4c138552565af6c645ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:33.683887 16525 raft_consensus.cc:993] T 7934a0be864f472b90de8265010eb7d1 P b61c58ed04b046d48634e2172dc45851: : Instructing follower ce8113a88cac4c138552565af6c645ca to start an election
I20260709 12:18:33.684413 16525 raft_consensus.cc:1081] T 7934a0be864f472b90de8265010eb7d1 P b61c58ed04b046d48634e2172dc45851 [term 2 LEADER]: Signalling peer ce8113a88cac4c138552565af6c645ca to start an election
I20260709 12:18:33.685875 16273 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7934a0be864f472b90de8265010eb7d1"
dest_uuid: "ce8113a88cac4c138552565af6c645ca"
 from {username='slave'} at 127.0.0.1:56460
I20260709 12:18:33.686431 16273 raft_consensus.cc:493] T 7934a0be864f472b90de8265010eb7d1 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:33.686817 16273 raft_consensus.cc:3060] T 7934a0be864f472b90de8265010eb7d1 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:33.692494 16273 raft_consensus.cc:515] T 7934a0be864f472b90de8265010eb7d1 P ce8113a88cac4c138552565af6c645ca [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:33.694238 16273 leader_election.cc:290] T 7934a0be864f472b90de8265010eb7d1 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 election: Requested vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
I20260709 12:18:33.695514 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7934a0be864f472b90de8265010eb7d1" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8"
I20260709 12:18:33.695525 16197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7934a0be864f472b90de8265010eb7d1" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "b61c58ed04b046d48634e2172dc45851"
I20260709 12:18:33.696082 16123 raft_consensus.cc:3060] T 7934a0be864f472b90de8265010eb7d1 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:33.696173 16197 raft_consensus.cc:3055] T 7934a0be864f472b90de8265010eb7d1 P b61c58ed04b046d48634e2172dc45851 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:33.696599 16197 raft_consensus.cc:740] T 7934a0be864f472b90de8265010eb7d1 P b61c58ed04b046d48634e2172dc45851 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b61c58ed04b046d48634e2172dc45851, State: Running, Role: LEADER
I20260709 12:18:33.697235 16197 consensus_queue.cc:260] T 7934a0be864f472b90de8265010eb7d1 P b61c58ed04b046d48634e2172dc45851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:33.698378 16197 raft_consensus.cc:3060] T 7934a0be864f472b90de8265010eb7d1 P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:33.701756 16123 raft_consensus.cc:2468] T 7934a0be864f472b90de8265010eb7d1 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce8113a88cac4c138552565af6c645ca in term 3.
I20260709 12:18:33.703030 16238 leader_election.cc:304] T 7934a0be864f472b90de8265010eb7d1 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce8113a88cac4c138552565af6c645ca, d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: 
I20260709 12:18:33.703795 16197 raft_consensus.cc:2468] T 7934a0be864f472b90de8265010eb7d1 P b61c58ed04b046d48634e2172dc45851 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce8113a88cac4c138552565af6c645ca in term 3.
I20260709 12:18:33.703984 16438 raft_consensus.cc:2804] T 7934a0be864f472b90de8265010eb7d1 P ce8113a88cac4c138552565af6c645ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:33.704528 16438 raft_consensus.cc:697] T 7934a0be864f472b90de8265010eb7d1 P ce8113a88cac4c138552565af6c645ca [term 3 LEADER]: Becoming Leader. State: Replica: ce8113a88cac4c138552565af6c645ca, State: Running, Role: LEADER
I20260709 12:18:33.705267 16438 consensus_queue.cc:237] T 7934a0be864f472b90de8265010eb7d1 P ce8113a88cac4c138552565af6c645ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:33.712257 16019 catalog_manager.cc:5697] T 7934a0be864f472b90de8265010eb7d1 P ce8113a88cac4c138552565af6c645ca reported cstate change: term changed from 2 to 3, leader changed from b61c58ed04b046d48634e2172dc45851 (127.3.212.130) to ce8113a88cac4c138552565af6c645ca (127.3.212.131). New cstate: current_term: 3 leader_uuid: "ce8113a88cac4c138552565af6c645ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:33.785634 16562 raft_consensus.cc:993] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851: : Instructing follower ce8113a88cac4c138552565af6c645ca to start an election
I20260709 12:18:33.786073 16562 raft_consensus.cc:1081] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 [term 1 LEADER]: Signalling peer ce8113a88cac4c138552565af6c645ca to start an election
I20260709 12:18:33.787568 16273 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dbb55848f9c040ac9db9b7849e2a0d8a"
dest_uuid: "ce8113a88cac4c138552565af6c645ca"
 from {username='slave'} at 127.0.0.1:56460
I20260709 12:18:33.788046 16273 raft_consensus.cc:493] T dbb55848f9c040ac9db9b7849e2a0d8a P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:33.788318 16273 raft_consensus.cc:3060] T dbb55848f9c040ac9db9b7849e2a0d8a P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:33.793035 16273 raft_consensus.cc:515] T dbb55848f9c040ac9db9b7849e2a0d8a P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:33.794643 16273 leader_election.cc:290] T dbb55848f9c040ac9db9b7849e2a0d8a P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 2 election: Requested vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
I20260709 12:18:33.795722 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb55848f9c040ac9db9b7849e2a0d8a" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8"
I20260709 12:18:33.795846 16197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb55848f9c040ac9db9b7849e2a0d8a" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b61c58ed04b046d48634e2172dc45851"
I20260709 12:18:33.796320 16123 raft_consensus.cc:3060] T dbb55848f9c040ac9db9b7849e2a0d8a P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:33.796415 16197 raft_consensus.cc:3055] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:33.796803 16197 raft_consensus.cc:740] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b61c58ed04b046d48634e2172dc45851, State: Running, Role: LEADER
I20260709 12:18:33.797550 16197 consensus_queue.cc:260] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:33.798576 16197 raft_consensus.cc:3060] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:33.801899 16123 raft_consensus.cc:2468] T dbb55848f9c040ac9db9b7849e2a0d8a P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce8113a88cac4c138552565af6c645ca in term 2.
I20260709 12:18:33.803036 16238 leader_election.cc:304] T dbb55848f9c040ac9db9b7849e2a0d8a P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce8113a88cac4c138552565af6c645ca, d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: 
I20260709 12:18:33.803766 16438 raft_consensus.cc:2804] T dbb55848f9c040ac9db9b7849e2a0d8a P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:33.803992 16197 raft_consensus.cc:2468] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce8113a88cac4c138552565af6c645ca in term 2.
I20260709 12:18:33.804309 16438 raft_consensus.cc:697] T dbb55848f9c040ac9db9b7849e2a0d8a P ce8113a88cac4c138552565af6c645ca [term 2 LEADER]: Becoming Leader. State: Replica: ce8113a88cac4c138552565af6c645ca, State: Running, Role: LEADER
I20260709 12:18:33.805307 16438 consensus_queue.cc:237] T dbb55848f9c040ac9db9b7849e2a0d8a P ce8113a88cac4c138552565af6c645ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:33.813124 16019 catalog_manager.cc:5697] T dbb55848f9c040ac9db9b7849e2a0d8a P ce8113a88cac4c138552565af6c645ca reported cstate change: term changed from 1 to 2, leader changed from b61c58ed04b046d48634e2172dc45851 (127.3.212.130) to ce8113a88cac4c138552565af6c645ca (127.3.212.131). New cstate: current_term: 2 leader_uuid: "ce8113a88cac4c138552565af6c645ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:33.971566 16121 raft_consensus.cc:1275] T 3a632db0115e4b18a7e169bdf6d970ed P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Refusing update from remote peer ce8113a88cac4c138552565af6c645ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:33.972843 16438 consensus_queue.cc:1048] T 3a632db0115e4b18a7e169bdf6d970ed P ce8113a88cac4c138552565af6c645ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:33.984236 16197 raft_consensus.cc:1275] T 3a632db0115e4b18a7e169bdf6d970ed P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Refusing update from remote peer ce8113a88cac4c138552565af6c645ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:33.986881 16571 consensus_queue.cc:1048] T 3a632db0115e4b18a7e169bdf6d970ed P ce8113a88cac4c138552565af6c645ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:34.145119 16197 raft_consensus.cc:1275] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Refusing update from remote peer ce8113a88cac4c138552565af6c645ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:18:34.146603 16571 consensus_queue.cc:1048] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P ce8113a88cac4c138552565af6c645ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:34.156605 16121 raft_consensus.cc:1275] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Refusing update from remote peer ce8113a88cac4c138552565af6c645ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:18:34.158095 16534 consensus_queue.cc:1048] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P ce8113a88cac4c138552565af6c645ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:34.200460 16121 raft_consensus.cc:1275] T 7934a0be864f472b90de8265010eb7d1 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 3 FOLLOWER]: Refusing update from remote peer ce8113a88cac4c138552565af6c645ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:18:34.201879 16534 consensus_queue.cc:1048] T 7934a0be864f472b90de8265010eb7d1 P ce8113a88cac4c138552565af6c645ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:34.209630 16197 raft_consensus.cc:1275] T 7934a0be864f472b90de8265010eb7d1 P b61c58ed04b046d48634e2172dc45851 [term 3 FOLLOWER]: Refusing update from remote peer ce8113a88cac4c138552565af6c645ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:18:34.211668 16575 consensus_queue.cc:1048] T 7934a0be864f472b90de8265010eb7d1 P ce8113a88cac4c138552565af6c645ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:34.225293 16121 raft_consensus.cc:1275] T dbb55848f9c040ac9db9b7849e2a0d8a P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Refusing update from remote peer ce8113a88cac4c138552565af6c645ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:34.226887 16575 consensus_queue.cc:1048] T dbb55848f9c040ac9db9b7849e2a0d8a P ce8113a88cac4c138552565af6c645ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:34.240454 16197 raft_consensus.cc:1275] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Refusing update from remote peer ce8113a88cac4c138552565af6c645ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:34.242123 16438 consensus_queue.cc:1048] T dbb55848f9c040ac9db9b7849e2a0d8a P ce8113a88cac4c138552565af6c645ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:34.476063  3922 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:18:34.482041  3922 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:18:34.482602  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:34.489061  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:34.489794  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:35.491008  3922 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:18:35.496263  3922 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:18:35.496740  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:35.502292  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:35.502714  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:36.504295  3922 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:18:36.512632  3922 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:18:36.513115  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:36.518790  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:36.519191  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:37.520335  3922 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:18:37.526561  3922 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:18:37.527017  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:37.531790  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:37.532271  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:38.820024 16590 raft_consensus.cc:493] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce8113a88cac4c138552565af6c645ca)
I20260709 12:18:38.821321 16590 raft_consensus.cc:515] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:38.837436 16589 raft_consensus.cc:493] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce8113a88cac4c138552565af6c645ca)
I20260709 12:18:38.838351 16589 raft_consensus.cc:515] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:38.839879 16593 raft_consensus.cc:493] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b61c58ed04b046d48634e2172dc45851)
I20260709 12:18:38.850917 16593 raft_consensus.cc:515] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:38.841799 16589 leader_election.cc:290] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:38.825093 16590 leader_election.cc:290] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:38.903021 16590 raft_consensus.cc:493] T 1e0b2bd53e024a3c8e84fd8372196c8e P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d58c05fc6fdc40b1bafd92b0c61e34e8)
I20260709 12:18:38.905820 16593 leader_election.cc:290] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
I20260709 12:18:38.904615 16590 raft_consensus.cc:515] T 1e0b2bd53e024a3c8e84fd8372196c8e P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:38.910883 16195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7063d3a4c2fb4a2eb8cd6edcae5eb2ac" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b61c58ed04b046d48634e2172dc45851" is_pre_election: true
I20260709 12:18:38.912730 16198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50e97dfcc74bceb3b7d7db53a47278" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b61c58ed04b046d48634e2172dc45851" is_pre_election: true
I20260709 12:18:38.915557 16594 raft_consensus.cc:493] T 62f91e00d01e497d9eda72bf862ce090 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b61c58ed04b046d48634e2172dc45851)
I20260709 12:18:38.916277 16594 raft_consensus.cc:515] T 62f91e00d01e497d9eda72bf862ce090 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:38.916822 16590 leader_election.cc:290] T 1e0b2bd53e024a3c8e84fd8372196c8e P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:38.918911 16591 raft_consensus.cc:493] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b61c58ed04b046d48634e2172dc45851)
I20260709 12:18:38.923592 16591 raft_consensus.cc:515] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:38.919598 16592 raft_consensus.cc:493] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b61c58ed04b046d48634e2172dc45851)
I20260709 12:18:38.928211 16592 raft_consensus.cc:515] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:38.929848 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f91e00d01e497d9eda72bf862ce090" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b61c58ed04b046d48634e2172dc45851" is_pre_election: true
I20260709 12:18:38.931115 16592 leader_election.cc:290] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
I20260709 12:18:38.924899 16594 leader_election.cc:290] T 62f91e00d01e497d9eda72bf862ce090 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
I20260709 12:18:38.936311 16596 raft_consensus.cc:493] T 7428466d80bc4b3b8fb4346741658617 P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d58c05fc6fdc40b1bafd92b0c61e34e8)
I20260709 12:18:38.943862 16596 raft_consensus.cc:515] T 7428466d80bc4b3b8fb4346741658617 P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:38.939059 16589 raft_consensus.cc:493] T 3c0f4313ed9e402d9c4067f38e69a61d P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b61c58ed04b046d48634e2172dc45851)
I20260709 12:18:38.944691 16595 raft_consensus.cc:493] T 3a632db0115e4b18a7e169bdf6d970ed P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce8113a88cac4c138552565af6c645ca)
I20260709 12:18:38.945233 16589 raft_consensus.cc:515] T 3c0f4313ed9e402d9c4067f38e69a61d P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:38.945420 16595 raft_consensus.cc:515] T 3a632db0115e4b18a7e169bdf6d970ed P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:38.948057 16595 leader_election.cc:290] T 3a632db0115e4b18a7e169bdf6d970ed P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:38.948155 16589 leader_election.cc:290] T 3c0f4313ed9e402d9c4067f38e69a61d P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:38.948990 16589 raft_consensus.cc:493] T 4c50e97dfcc74bceb3b7d7db53a47278 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b61c58ed04b046d48634e2172dc45851)
I20260709 12:18:38.951164 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0f4313ed9e402d9c4067f38e69a61d" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b61c58ed04b046d48634e2172dc45851" is_pre_election: true
I20260709 12:18:38.957860 16266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0f4313ed9e402d9c4067f38e69a61d" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca" is_pre_election: true
I20260709 12:18:38.952656 16196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a632db0115e4b18a7e169bdf6d970ed" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b61c58ed04b046d48634e2172dc45851" is_pre_election: true
I20260709 12:18:38.958756 16266 raft_consensus.cc:2468] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d58c05fc6fdc40b1bafd92b0c61e34e8 in term 2.
I20260709 12:18:38.957914 16267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a632db0115e4b18a7e169bdf6d970ed" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca" is_pre_election: true
I20260709 12:18:38.960048 16595 raft_consensus.cc:493] T dbb55848f9c040ac9db9b7849e2a0d8a P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce8113a88cac4c138552565af6c645ca)
I20260709 12:18:38.960793 16595 raft_consensus.cc:515] T dbb55848f9c040ac9db9b7849e2a0d8a P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:38.961397 16589 raft_consensus.cc:515] T 4c50e97dfcc74bceb3b7d7db53a47278 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:38.957991 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7063d3a4c2fb4a2eb8cd6edcae5eb2ac" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca" is_pre_election: true
I20260709 12:18:38.963174 16595 leader_election.cc:290] T dbb55848f9c040ac9db9b7849e2a0d8a P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:38.963819 16595 raft_consensus.cc:493] T 08fa442667044198b448f66ee7350935 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce8113a88cac4c138552565af6c645ca)
I20260709 12:18:38.964515 16595 raft_consensus.cc:515] T 08fa442667044198b448f66ee7350935 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:38.964845 16589 leader_election.cc:290] T 4c50e97dfcc74bceb3b7d7db53a47278 P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:38.968735 16122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0b2bd53e024a3c8e84fd8372196c8e" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" is_pre_election: true
I20260709 12:18:38.972352 16087 leader_election.cc:304] T 3c0f4313ed9e402d9c4067f38e69a61d P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce8113a88cac4c138552565af6c645ca, d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: 
I20260709 12:18:38.938192 16600 raft_consensus.cc:493] T 5fef361fdd2840b6b5af55b92f7343a0 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ce8113a88cac4c138552565af6c645ca)
I20260709 12:18:38.966497 16121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb55848f9c040ac9db9b7849e2a0d8a" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" is_pre_election: true
I20260709 12:18:38.973039 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb55848f9c040ac9db9b7849e2a0d8a" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca" is_pre_election: true
I20260709 12:18:38.973548 16121 raft_consensus.cc:2468] T dbb55848f9c040ac9db9b7849e2a0d8a P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b61c58ed04b046d48634e2172dc45851 in term 2.
I20260709 12:18:38.940249 16591 leader_election.cc:290] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
I20260709 12:18:38.978982 16597 raft_consensus.cc:2804] T 3c0f4313ed9e402d9c4067f38e69a61d P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:38.979571 16597 raft_consensus.cc:493] T 3c0f4313ed9e402d9c4067f38e69a61d P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b61c58ed04b046d48634e2172dc45851)
I20260709 12:18:38.981745 16597 raft_consensus.cc:3060] T 3c0f4313ed9e402d9c4067f38e69a61d P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:38.981928 16600 raft_consensus.cc:515] T 5fef361fdd2840b6b5af55b92f7343a0 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:38.982451 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50e97dfcc74bceb3b7d7db53a47278" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca" is_pre_election: true
I20260709 12:18:38.983210 16269 raft_consensus.cc:2468] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d58c05fc6fdc40b1bafd92b0c61e34e8 in term 2.
I20260709 12:18:38.987263 16118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f91e00d01e497d9eda72bf862ce090" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" is_pre_election: true
W20260709 12:18:38.987856 16237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:35005, user_credentials={real_user=slave}} blocked reactor thread for 56176.8us
I20260709 12:18:38.988801 16124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50e97dfcc74bceb3b7d7db53a47278" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" is_pre_election: true
I20260709 12:18:38.988288 16120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0f4313ed9e402d9c4067f38e69a61d" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" is_pre_election: true
I20260709 12:18:38.984480 16600 leader_election.cc:290] T 5fef361fdd2840b6b5af55b92f7343a0 P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:38.990095 16196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6725f36431fc4b0fa0f740b0d8e8f7d9" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b61c58ed04b046d48634e2172dc45851" is_pre_election: true
I20260709 12:18:38.980039 16087 leader_election.cc:304] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: b61c58ed04b046d48634e2172dc45851, ce8113a88cac4c138552565af6c645ca
I20260709 12:18:38.991823 16600 raft_consensus.cc:2749] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:38.992722 16196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0f4313ed9e402d9c4067f38e69a61d" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b61c58ed04b046d48634e2172dc45851" is_pre_election: true
I20260709 12:18:38.995378 16164 leader_election.cc:304] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: 
I20260709 12:18:38.996070 16595 leader_election.cc:290] T 08fa442667044198b448f66ee7350935 P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:38.998023 16598 raft_consensus.cc:2804] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:38.979506 16596 leader_election.cc:290] T 7428466d80bc4b3b8fb4346741658617 P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:38.996275 16238 leader_election.cc:304] T 62f91e00d01e497d9eda72bf862ce090 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce8113a88cac4c138552565af6c645ca; no voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:38.992580 16087 leader_election.cc:304] T 4c50e97dfcc74bceb3b7d7db53a47278 P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce8113a88cac4c138552565af6c645ca, d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: 
I20260709 12:18:38.999140 16120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7428466d80bc4b3b8fb4346741658617" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" is_pre_election: true
I20260709 12:18:38.998533 16598 raft_consensus.cc:493] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ce8113a88cac4c138552565af6c645ca)
I20260709 12:18:39.000298 16238 leader_election.cc:304] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce8113a88cac4c138552565af6c645ca; no voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:39.001303 16598 raft_consensus.cc:3060] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:39.001830 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fef361fdd2840b6b5af55b92f7343a0" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca" is_pre_election: true
I20260709 12:18:38.999478 16602 raft_consensus.cc:2749] T 62f91e00d01e497d9eda72bf862ce090 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:39.003116 16238 leader_election.cc:304] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce8113a88cac4c138552565af6c645ca; no voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:39.004211 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fa442667044198b448f66ee7350935" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca" is_pre_election: true
I20260709 12:18:39.004902 16591 raft_consensus.cc:2749] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:39.002275 16593 raft_consensus.cc:2749] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:38.998595 16597 raft_consensus.cc:515] T 3c0f4313ed9e402d9c4067f38e69a61d P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:38.997320 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6725f36431fc4b0fa0f740b0d8e8f7d9" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" is_pre_election: true
I20260709 12:18:39.009691 16238 leader_election.cc:304] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce8113a88cac4c138552565af6c645ca; no voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:39.010792 16591 raft_consensus.cc:2749] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:39.011642 16589 raft_consensus.cc:2804] T 4c50e97dfcc74bceb3b7d7db53a47278 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:39.012537 16589 raft_consensus.cc:493] T 4c50e97dfcc74bceb3b7d7db53a47278 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b61c58ed04b046d48634e2172dc45851)
I20260709 12:18:39.012984 16589 raft_consensus.cc:3060] T 4c50e97dfcc74bceb3b7d7db53a47278 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:39.014915 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0f4313ed9e402d9c4067f38e69a61d" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca"
I20260709 12:18:39.015923 16269 raft_consensus.cc:3060] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:39.016463 16196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb55848f9c040ac9db9b7849e2a0d8a" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b61c58ed04b046d48634e2172dc45851" is_pre_election: true
I20260709 12:18:39.016983 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb55848f9c040ac9db9b7849e2a0d8a" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca" is_pre_election: true
I20260709 12:18:39.018334 16196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50e97dfcc74bceb3b7d7db53a47278" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b61c58ed04b046d48634e2172dc45851" is_pre_election: true
I20260709 12:18:39.021577 16196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fef361fdd2840b6b5af55b92f7343a0" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b61c58ed04b046d48634e2172dc45851" is_pre_election: true
I20260709 12:18:39.023339 16196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fa442667044198b448f66ee7350935" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b61c58ed04b046d48634e2172dc45851" is_pre_election: true
I20260709 12:18:39.023790 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7428466d80bc4b3b8fb4346741658617" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca" is_pre_election: true
I20260709 12:18:39.025079 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e0b2bd53e024a3c8e84fd8372196c8e" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca" is_pre_election: true
I20260709 12:18:39.025324 16196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0f4313ed9e402d9c4067f38e69a61d" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b61c58ed04b046d48634e2172dc45851"
I20260709 12:18:39.027019 16597 leader_election.cc:290] T 3c0f4313ed9e402d9c4067f38e69a61d P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 3 election: Requested vote from peers b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:39.027694 16162 leader_election.cc:304] T 7428466d80bc4b3b8fb4346741658617 P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b61c58ed04b046d48634e2172dc45851; no voters: ce8113a88cac4c138552565af6c645ca, d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:39.028910 16601 raft_consensus.cc:2749] T 7428466d80bc4b3b8fb4346741658617 P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:39.029071 16162 leader_election.cc:304] T 1e0b2bd53e024a3c8e84fd8372196c8e P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b61c58ed04b046d48634e2172dc45851; no voters: ce8113a88cac4c138552565af6c645ca, d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:39.030089 16601 raft_consensus.cc:2749] T 1e0b2bd53e024a3c8e84fd8372196c8e P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:39.030592 16598 raft_consensus.cc:515] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:39.016978 16088 leader_election.cc:304] T 3a632db0115e4b18a7e169bdf6d970ed P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: b61c58ed04b046d48634e2172dc45851, ce8113a88cac4c138552565af6c645ca
I20260709 12:18:39.033624 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb55848f9c040ac9db9b7849e2a0d8a" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca"
I20260709 12:18:39.033627 16120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb55848f9c040ac9db9b7849e2a0d8a" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8"
I20260709 12:18:39.034941 16088 leader_election.cc:304] T dbb55848f9c040ac9db9b7849e2a0d8a P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: b61c58ed04b046d48634e2172dc45851, ce8113a88cac4c138552565af6c645ca
I20260709 12:18:39.036041 16164 leader_election.cc:304] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b61c58ed04b046d48634e2172dc45851; no voters: ce8113a88cac4c138552565af6c645ca, d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:39.036932 16601 raft_consensus.cc:2749] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:39.036972 16605 raft_consensus.cc:2749] T dbb55848f9c040ac9db9b7849e2a0d8a P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:39.034246 16597 raft_consensus.cc:2749] T 3a632db0115e4b18a7e169bdf6d970ed P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:39.036926 16088 leader_election.cc:304] T 5fef361fdd2840b6b5af55b92f7343a0 P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: b61c58ed04b046d48634e2172dc45851, ce8113a88cac4c138552565af6c645ca
I20260709 12:18:39.038312 16598 leader_election.cc:290] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 3 election: Requested vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:39.038686 16597 raft_consensus.cc:2749] T 5fef361fdd2840b6b5af55b92f7343a0 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:39.033576 16269 raft_consensus.cc:2468] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d58c05fc6fdc40b1bafd92b0c61e34e8 in term 3.
I20260709 12:18:39.039113 16088 leader_election.cc:304] T 08fa442667044198b448f66ee7350935 P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: b61c58ed04b046d48634e2172dc45851, ce8113a88cac4c138552565af6c645ca
I20260709 12:18:39.040042 16271 raft_consensus.cc:1240] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca [term 3 FOLLOWER]: Rejecting Update request from peer b61c58ed04b046d48634e2172dc45851 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:39.040030 16597 raft_consensus.cc:2749] T 08fa442667044198b448f66ee7350935 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:39.040644 16087 leader_election.cc:304] T 3c0f4313ed9e402d9c4067f38e69a61d P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce8113a88cac4c138552565af6c645ca, d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: 
I20260709 12:18:39.039749 16589 raft_consensus.cc:515] T 4c50e97dfcc74bceb3b7d7db53a47278 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:39.041474 16597 raft_consensus.cc:2804] T 3c0f4313ed9e402d9c4067f38e69a61d P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:39.042049 16597 raft_consensus.cc:697] T 3c0f4313ed9e402d9c4067f38e69a61d P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 3 LEADER]: Becoming Leader. State: Replica: d58c05fc6fdc40b1bafd92b0c61e34e8, State: Running, Role: LEADER
I20260709 12:18:39.043363 16589 leader_election.cc:290] T 4c50e97dfcc74bceb3b7d7db53a47278 P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 3 election: Requested vote from peers b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:39.043237 16597 consensus_queue.cc:237] T 3c0f4313ed9e402d9c4067f38e69a61d P d58c05fc6fdc40b1bafd92b0c61e34e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:39.044518 16598 consensus_queue.cc:1059] T 3c0f4313ed9e402d9c4067f38e69a61d P b61c58ed04b046d48634e2172dc45851 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:39.044907 16196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50e97dfcc74bceb3b7d7db53a47278" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b61c58ed04b046d48634e2172dc45851"
I20260709 12:18:39.045753 16601 raft_consensus.cc:3055] T 3c0f4313ed9e402d9c4067f38e69a61d P b61c58ed04b046d48634e2172dc45851 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:39.046119 16601 raft_consensus.cc:740] T 3c0f4313ed9e402d9c4067f38e69a61d P b61c58ed04b046d48634e2172dc45851 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b61c58ed04b046d48634e2172dc45851, State: Running, Role: LEADER
I20260709 12:18:39.046329 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50e97dfcc74bceb3b7d7db53a47278" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca"
I20260709 12:18:39.047175 16601 consensus_queue.cc:260] T 3c0f4313ed9e402d9c4067f38e69a61d P b61c58ed04b046d48634e2172dc45851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:39.047883 16087 leader_election.cc:304] T 4c50e97dfcc74bceb3b7d7db53a47278 P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: b61c58ed04b046d48634e2172dc45851, ce8113a88cac4c138552565af6c645ca
I20260709 12:18:39.048754 16589 raft_consensus.cc:2749] T 4c50e97dfcc74bceb3b7d7db53a47278 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:39.048748 16601 raft_consensus.cc:3060] T 3c0f4313ed9e402d9c4067f38e69a61d P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:39.058872 16020 catalog_manager.cc:5697] T 3c0f4313ed9e402d9c4067f38e69a61d P d58c05fc6fdc40b1bafd92b0c61e34e8 reported cstate change: term changed from 2 to 3, leader changed from b61c58ed04b046d48634e2172dc45851 (127.3.212.130) to d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129). New cstate: current_term: 3 leader_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:39.405025 16196 raft_consensus.cc:1240] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 [term 3 FOLLOWER]: Rejecting Update request from peer ce8113a88cac4c138552565af6c645ca for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:39.406387 16602 consensus_queue.cc:1059] T dbb55848f9c040ac9db9b7849e2a0d8a P ce8113a88cac4c138552565af6c645ca [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:39.407249 16591 raft_consensus.cc:3055] T dbb55848f9c040ac9db9b7849e2a0d8a P ce8113a88cac4c138552565af6c645ca [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:39.407524 16591 raft_consensus.cc:740] T dbb55848f9c040ac9db9b7849e2a0d8a P ce8113a88cac4c138552565af6c645ca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ce8113a88cac4c138552565af6c645ca, State: Running, Role: LEADER
I20260709 12:18:39.408420 16591 consensus_queue.cc:260] T dbb55848f9c040ac9db9b7849e2a0d8a P ce8113a88cac4c138552565af6c645ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:39.409821 16591 raft_consensus.cc:3060] T dbb55848f9c040ac9db9b7849e2a0d8a P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:39.441570 16123 raft_consensus.cc:1240] T 4c50e97dfcc74bceb3b7d7db53a47278 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 3 FOLLOWER]: Rejecting Update request from peer b61c58ed04b046d48634e2172dc45851 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:39.443017 16598 consensus_queue.cc:1059] T 4c50e97dfcc74bceb3b7d7db53a47278 P b61c58ed04b046d48634e2172dc45851 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:39.443987 16601 raft_consensus.cc:3055] T 4c50e97dfcc74bceb3b7d7db53a47278 P b61c58ed04b046d48634e2172dc45851 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:39.444384 16601 raft_consensus.cc:740] T 4c50e97dfcc74bceb3b7d7db53a47278 P b61c58ed04b046d48634e2172dc45851 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b61c58ed04b046d48634e2172dc45851, State: Running, Role: LEADER
I20260709 12:18:39.445425 16601 consensus_queue.cc:260] T 4c50e97dfcc74bceb3b7d7db53a47278 P b61c58ed04b046d48634e2172dc45851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:39.446864 16601 raft_consensus.cc:3060] T 4c50e97dfcc74bceb3b7d7db53a47278 P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:39.602093 16196 raft_consensus.cc:1275] T 3c0f4313ed9e402d9c4067f38e69a61d P b61c58ed04b046d48634e2172dc45851 [term 3 FOLLOWER]: Refusing update from remote peer d58c05fc6fdc40b1bafd92b0c61e34e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:18:39.602924 16269 raft_consensus.cc:1275] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca [term 3 FOLLOWER]: Refusing update from remote peer d58c05fc6fdc40b1bafd92b0c61e34e8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:18:39.603415 16597 consensus_queue.cc:1048] T 3c0f4313ed9e402d9c4067f38e69a61d P d58c05fc6fdc40b1bafd92b0c61e34e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:39.604266 16611 consensus_queue.cc:1048] T 3c0f4313ed9e402d9c4067f38e69a61d P d58c05fc6fdc40b1bafd92b0c61e34e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:39.764384  3922 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:18:39.772950 16123 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c0f4313ed9e402d9c4067f38e69a61d"
dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8"
mode: GRACEFUL
new_leader_uuid: "b61c58ed04b046d48634e2172dc45851"
 from {username='slave'} at 127.0.0.1:38446
I20260709 12:18:39.773608 16123 raft_consensus.cc:606] T 3c0f4313ed9e402d9c4067f38e69a61d P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 3 LEADER]: Received request to transfer leadership to TS b61c58ed04b046d48634e2172dc45851
I20260709 12:18:39.775005  3922 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 1
I20260709 12:18:39.775554  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:39.781250  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:39.781749  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:18:39.786903 16294 debug-util.cc:398] Leaking SignalData structure 0x7b08000a4a60 after lost signal to thread 3925
W20260709 12:18:39.788059 16294 debug-util.cc:398] Leaking SignalData structure 0x7b080004f3c0 after lost signal to thread 16056
W20260709 12:18:39.789305 16294 debug-util.cc:398] Leaking SignalData structure 0x7b080015fcc0 after lost signal to thread 16148
W20260709 12:18:39.790360 16294 debug-util.cc:398] Leaking SignalData structure 0x7b0800155520 after lost signal to thread 16223
W20260709 12:18:39.791316 16294 debug-util.cc:398] Leaking SignalData structure 0x7b0800176580 after lost signal to thread 16297
I20260709 12:18:40.060302 16617 raft_consensus.cc:993] T 3c0f4313ed9e402d9c4067f38e69a61d P d58c05fc6fdc40b1bafd92b0c61e34e8: : Instructing follower b61c58ed04b046d48634e2172dc45851 to start an election
I20260709 12:18:40.060842 16597 raft_consensus.cc:1081] T 3c0f4313ed9e402d9c4067f38e69a61d P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 3 LEADER]: Signalling peer b61c58ed04b046d48634e2172dc45851 to start an election
I20260709 12:18:40.062371 16196 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c0f4313ed9e402d9c4067f38e69a61d"
dest_uuid: "b61c58ed04b046d48634e2172dc45851"
 from {username='slave'} at 127.0.0.1:54022
I20260709 12:18:40.063105 16196 raft_consensus.cc:493] T 3c0f4313ed9e402d9c4067f38e69a61d P b61c58ed04b046d48634e2172dc45851 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:40.063467 16196 raft_consensus.cc:3060] T 3c0f4313ed9e402d9c4067f38e69a61d P b61c58ed04b046d48634e2172dc45851 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:40.073144 16196 raft_consensus.cc:515] T 3c0f4313ed9e402d9c4067f38e69a61d P b61c58ed04b046d48634e2172dc45851 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:40.075979 16196 leader_election.cc:290] T 3c0f4313ed9e402d9c4067f38e69a61d P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 4 election: Requested vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:40.076803 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0f4313ed9e402d9c4067f38e69a61d" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8"
I20260709 12:18:40.077544 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0f4313ed9e402d9c4067f38e69a61d" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "ce8113a88cac4c138552565af6c645ca"
I20260709 12:18:40.077845 16123 raft_consensus.cc:3055] T 3c0f4313ed9e402d9c4067f38e69a61d P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:40.078158 16123 raft_consensus.cc:740] T 3c0f4313ed9e402d9c4067f38e69a61d P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d58c05fc6fdc40b1bafd92b0c61e34e8, State: Running, Role: LEADER
I20260709 12:18:40.078222 16269 raft_consensus.cc:3060] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:40.079071 16123 consensus_queue.cc:260] T 3c0f4313ed9e402d9c4067f38e69a61d P d58c05fc6fdc40b1bafd92b0c61e34e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:40.080297 16123 raft_consensus.cc:3060] T 3c0f4313ed9e402d9c4067f38e69a61d P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:40.087595 16269 raft_consensus.cc:2468] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b61c58ed04b046d48634e2172dc45851 in term 4.
I20260709 12:18:40.089102 16162 leader_election.cc:304] T 3c0f4313ed9e402d9c4067f38e69a61d P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b61c58ed04b046d48634e2172dc45851, ce8113a88cac4c138552565af6c645ca; no voters: 
I20260709 12:18:40.089416 16123 raft_consensus.cc:2468] T 3c0f4313ed9e402d9c4067f38e69a61d P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b61c58ed04b046d48634e2172dc45851 in term 4.
I20260709 12:18:40.090083 16601 raft_consensus.cc:2804] T 3c0f4313ed9e402d9c4067f38e69a61d P b61c58ed04b046d48634e2172dc45851 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:40.091403 16601 raft_consensus.cc:697] T 3c0f4313ed9e402d9c4067f38e69a61d P b61c58ed04b046d48634e2172dc45851 [term 4 LEADER]: Becoming Leader. State: Replica: b61c58ed04b046d48634e2172dc45851, State: Running, Role: LEADER
I20260709 12:18:40.092861 16601 consensus_queue.cc:237] T 3c0f4313ed9e402d9c4067f38e69a61d P b61c58ed04b046d48634e2172dc45851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:40.101577 16019 catalog_manager.cc:5697] T 3c0f4313ed9e402d9c4067f38e69a61d P b61c58ed04b046d48634e2172dc45851 reported cstate change: term changed from 3 to 4, leader changed from d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129) to b61c58ed04b046d48634e2172dc45851 (127.3.212.130). New cstate: current_term: 4 leader_uuid: "b61c58ed04b046d48634e2172dc45851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:40.522399 16591 raft_consensus.cc:493] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b61c58ed04b046d48634e2172dc45851)
I20260709 12:18:40.522921 16591 raft_consensus.cc:515] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:40.525164 16591 leader_election.cc:290] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
I20260709 12:18:40.525997 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50e97dfcc74bceb3b7d7db53a47278" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" is_pre_election: true
I20260709 12:18:40.526223 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50e97dfcc74bceb3b7d7db53a47278" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b61c58ed04b046d48634e2172dc45851" is_pre_election: true
I20260709 12:18:40.526834 16123 raft_consensus.cc:2393] T 4c50e97dfcc74bceb3b7d7db53a47278 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ce8113a88cac4c138552565af6c645ca in current term 3: Already voted for candidate d58c05fc6fdc40b1bafd92b0c61e34e8 in this term.
I20260709 12:18:40.526801 16199 raft_consensus.cc:2468] T 4c50e97dfcc74bceb3b7d7db53a47278 P b61c58ed04b046d48634e2172dc45851 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce8113a88cac4c138552565af6c645ca in term 3.
I20260709 12:18:40.528164 16237 leader_election.cc:304] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b61c58ed04b046d48634e2172dc45851, ce8113a88cac4c138552565af6c645ca; no voters: d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:40.528972 16591 raft_consensus.cc:2804] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:40.529299 16591 raft_consensus.cc:493] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Starting leader election (detected failure of leader b61c58ed04b046d48634e2172dc45851)
I20260709 12:18:40.529623 16591 raft_consensus.cc:3060] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:40.535468 16591 raft_consensus.cc:515] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:40.537335 16591 leader_election.cc:290] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 election: Requested vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
I20260709 12:18:40.538151 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50e97dfcc74bceb3b7d7db53a47278" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8"
I20260709 12:18:40.538582 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50e97dfcc74bceb3b7d7db53a47278" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b61c58ed04b046d48634e2172dc45851"
I20260709 12:18:40.539197 16123 raft_consensus.cc:2393] T 4c50e97dfcc74bceb3b7d7db53a47278 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ce8113a88cac4c138552565af6c645ca in current term 3: Already voted for candidate d58c05fc6fdc40b1bafd92b0c61e34e8 in this term.
I20260709 12:18:40.544749 16199 raft_consensus.cc:2468] T 4c50e97dfcc74bceb3b7d7db53a47278 P b61c58ed04b046d48634e2172dc45851 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce8113a88cac4c138552565af6c645ca in term 3.
I20260709 12:18:40.545884 16237 leader_election.cc:304] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b61c58ed04b046d48634e2172dc45851, ce8113a88cac4c138552565af6c645ca; no voters: d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:40.546787 16591 raft_consensus.cc:2804] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:40.547871 16591 raft_consensus.cc:697] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca [term 3 LEADER]: Becoming Leader. State: Replica: ce8113a88cac4c138552565af6c645ca, State: Running, Role: LEADER
I20260709 12:18:40.548854 16591 consensus_queue.cc:237] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:40.557802 16019 catalog_manager.cc:5697] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca reported cstate change: term changed from 2 to 3, leader changed from b61c58ed04b046d48634e2172dc45851 (127.3.212.130) to ce8113a88cac4c138552565af6c645ca (127.3.212.131). New cstate: current_term: 3 leader_uuid: "ce8113a88cac4c138552565af6c645ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:40.614971 16123 raft_consensus.cc:1275] T 3c0f4313ed9e402d9c4067f38e69a61d P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 4 FOLLOWER]: Refusing update from remote peer b61c58ed04b046d48634e2172dc45851: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:18:40.616557 16601 consensus_queue.cc:1048] T 3c0f4313ed9e402d9c4067f38e69a61d P b61c58ed04b046d48634e2172dc45851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:40.629457 16269 raft_consensus.cc:1275] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca [term 4 FOLLOWER]: Refusing update from remote peer b61c58ed04b046d48634e2172dc45851: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:18:40.633455 16627 consensus_queue.cc:1048] T 3c0f4313ed9e402d9c4067f38e69a61d P b61c58ed04b046d48634e2172dc45851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:40.781164 16627 raft_consensus.cc:493] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.781783 16627 raft_consensus.cc:515] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:40.782975  3922 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:18:40.784132 16627 leader_election.cc:290] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:40.784946 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb55848f9c040ac9db9b7849e2a0d8a" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" is_pre_election: true
I20260709 12:18:40.787029 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb55848f9c040ac9db9b7849e2a0d8a" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca" is_pre_election: true
I20260709 12:18:40.787873 16269 raft_consensus.cc:2468] T dbb55848f9c040ac9db9b7849e2a0d8a P ce8113a88cac4c138552565af6c645ca [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b61c58ed04b046d48634e2172dc45851 in term 3.
I20260709 12:18:40.789456 16162 leader_election.cc:304] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b61c58ed04b046d48634e2172dc45851, ce8113a88cac4c138552565af6c645ca; no voters: d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:40.790330 16627 raft_consensus.cc:2804] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:40.790701 16627 raft_consensus.cc:493] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:40.791038 16627 raft_consensus.cc:3060] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:40.800459 16627 raft_consensus.cc:515] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:40.804217 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb55848f9c040ac9db9b7849e2a0d8a" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8"
I20260709 12:18:40.806807 16627 leader_election.cc:290] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 4 election: Requested vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:40.807898 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb55848f9c040ac9db9b7849e2a0d8a" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca"
I20260709 12:18:40.808591 16269 raft_consensus.cc:3060] T dbb55848f9c040ac9db9b7849e2a0d8a P ce8113a88cac4c138552565af6c645ca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:40.816840 16269 raft_consensus.cc:2468] T dbb55848f9c040ac9db9b7849e2a0d8a P ce8113a88cac4c138552565af6c645ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b61c58ed04b046d48634e2172dc45851 in term 4.
I20260709 12:18:40.818235 16162 leader_election.cc:304] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b61c58ed04b046d48634e2172dc45851, ce8113a88cac4c138552565af6c645ca; no voters: d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:40.819571 16627 raft_consensus.cc:2804] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:40.820909 16627 raft_consensus.cc:697] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 [term 4 LEADER]: Becoming Leader. State: Replica: b61c58ed04b046d48634e2172dc45851, State: Running, Role: LEADER
I20260709 12:18:40.822041 16627 consensus_queue.cc:237] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:40.823086 16269 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5fef361fdd2840b6b5af55b92f7343a0"
dest_uuid: "ce8113a88cac4c138552565af6c645ca"
mode: GRACEFUL
new_leader_uuid: "b61c58ed04b046d48634e2172dc45851"
 from {username='slave'} at 127.0.0.1:37076
I20260709 12:18:40.823827 16269 raft_consensus.cc:606] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca [term 1 LEADER]: Received request to transfer leadership to TS b61c58ed04b046d48634e2172dc45851
I20260709 12:18:40.825567  3922 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 1
I20260709 12:18:40.826267  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:40.833263  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:40.833783  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:40.833494 16021 catalog_manager.cc:5697] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 reported cstate change: term changed from 2 to 4, leader changed from ce8113a88cac4c138552565af6c645ca (127.3.212.131) to b61c58ed04b046d48634e2172dc45851 (127.3.212.130). New cstate: current_term: 4 leader_uuid: "b61c58ed04b046d48634e2172dc45851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:40.845643 16625 raft_consensus.cc:993] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca: : Instructing follower b61c58ed04b046d48634e2172dc45851 to start an election
I20260709 12:18:40.846199 16591 raft_consensus.cc:1081] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca [term 1 LEADER]: Signalling peer b61c58ed04b046d48634e2172dc45851 to start an election
I20260709 12:18:40.847774 16199 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5fef361fdd2840b6b5af55b92f7343a0"
dest_uuid: "b61c58ed04b046d48634e2172dc45851"
 from {username='slave'} at 127.0.0.1:54026
I20260709 12:18:40.848235 16199 raft_consensus.cc:493] T 5fef361fdd2840b6b5af55b92f7343a0 P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:40.848553 16199 raft_consensus.cc:3060] T 5fef361fdd2840b6b5af55b92f7343a0 P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:40.852506 16617 raft_consensus.cc:493] T dbb55848f9c040ac9db9b7849e2a0d8a P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce8113a88cac4c138552565af6c645ca)
I20260709 12:18:40.853113 16617 raft_consensus.cc:515] T dbb55848f9c040ac9db9b7849e2a0d8a P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:40.854311 16199 raft_consensus.cc:515] T 5fef361fdd2840b6b5af55b92f7343a0 P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:40.856074 16617 leader_election.cc:290] T dbb55848f9c040ac9db9b7849e2a0d8a P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:40.857262 16123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fef361fdd2840b6b5af55b92f7343a0" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8"
I20260709 12:18:40.859897 16123 raft_consensus.cc:3060] T 5fef361fdd2840b6b5af55b92f7343a0 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:40.857280 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb55848f9c040ac9db9b7849e2a0d8a" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca" is_pre_election: true
I20260709 12:18:40.858259 16199 leader_election.cc:290] T 5fef361fdd2840b6b5af55b92f7343a0 P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 2 election: Requested vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:40.861891 16269 raft_consensus.cc:2368] T dbb55848f9c040ac9db9b7849e2a0d8a P ce8113a88cac4c138552565af6c645ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d58c05fc6fdc40b1bafd92b0c61e34e8 for earlier term 3. Current term is 4.
I20260709 12:18:40.858282 16196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb55848f9c040ac9db9b7849e2a0d8a" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b61c58ed04b046d48634e2172dc45851" is_pre_election: true
I20260709 12:18:40.859298 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fef361fdd2840b6b5af55b92f7343a0" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "ce8113a88cac4c138552565af6c645ca"
I20260709 12:18:40.862794 16271 raft_consensus.cc:3055] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:40.863081 16271 raft_consensus.cc:740] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ce8113a88cac4c138552565af6c645ca, State: Running, Role: LEADER
I20260709 12:18:40.863935 16271 consensus_queue.cc:260] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:40.864607 16087 leader_election.cc:400] T dbb55848f9c040ac9db9b7849e2a0d8a P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 3 pre-election: Vote denied by peer ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363) with higher term. Message: Invalid argument: T dbb55848f9c040ac9db9b7849e2a0d8a P ce8113a88cac4c138552565af6c645ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d58c05fc6fdc40b1bafd92b0c61e34e8 for earlier term 3. Current term is 4.
I20260709 12:18:40.864980 16087 leader_election.cc:403] T dbb55848f9c040ac9db9b7849e2a0d8a P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:40.865264 16271 raft_consensus.cc:3060] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:40.865659 16597 raft_consensus.cc:3060] T dbb55848f9c040ac9db9b7849e2a0d8a P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:18:40.870213 16123 raft_consensus.cc:2468] T 5fef361fdd2840b6b5af55b92f7343a0 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b61c58ed04b046d48634e2172dc45851 in term 2.
I20260709 12:18:40.871876 16164 leader_election.cc:304] T 5fef361fdd2840b6b5af55b92f7343a0 P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: 
I20260709 12:18:40.874804 16597 raft_consensus.cc:2749] T dbb55848f9c040ac9db9b7849e2a0d8a P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363) with higher term. Message: Invalid argument: T dbb55848f9c040ac9db9b7849e2a0d8a P ce8113a88cac4c138552565af6c645ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d58c05fc6fdc40b1bafd92b0c61e34e8 for earlier term 3. Current term is 4.
I20260709 12:18:40.875941 16271 raft_consensus.cc:2468] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b61c58ed04b046d48634e2172dc45851 in term 2.
I20260709 12:18:40.878706 16627 raft_consensus.cc:2804] T 5fef361fdd2840b6b5af55b92f7343a0 P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:40.879359 16627 raft_consensus.cc:697] T 5fef361fdd2840b6b5af55b92f7343a0 P b61c58ed04b046d48634e2172dc45851 [term 2 LEADER]: Becoming Leader. State: Replica: b61c58ed04b046d48634e2172dc45851, State: Running, Role: LEADER
I20260709 12:18:40.880164 16627 consensus_queue.cc:237] T 5fef361fdd2840b6b5af55b92f7343a0 P b61c58ed04b046d48634e2172dc45851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:40.889775 16021 catalog_manager.cc:5697] T 5fef361fdd2840b6b5af55b92f7343a0 P b61c58ed04b046d48634e2172dc45851 reported cstate change: term changed from 1 to 2, leader changed from ce8113a88cac4c138552565af6c645ca (127.3.212.131) to b61c58ed04b046d48634e2172dc45851 (127.3.212.130). New cstate: current_term: 2 leader_uuid: "b61c58ed04b046d48634e2172dc45851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:41.064353 16123 raft_consensus.cc:1275] T 4c50e97dfcc74bceb3b7d7db53a47278 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 3 FOLLOWER]: Refusing update from remote peer ce8113a88cac4c138552565af6c645ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:18:41.065590 16591 consensus_queue.cc:1048] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:41.075784 16199 raft_consensus.cc:1275] T 4c50e97dfcc74bceb3b7d7db53a47278 P b61c58ed04b046d48634e2172dc45851 [term 3 FOLLOWER]: Refusing update from remote peer ce8113a88cac4c138552565af6c645ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:18:41.078344 16591 consensus_queue.cc:1048] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:41.238121 16123 raft_consensus.cc:1275] T dbb55848f9c040ac9db9b7849e2a0d8a P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 4 FOLLOWER]: Refusing update from remote peer b61c58ed04b046d48634e2172dc45851: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:41.239563 16639 consensus_queue.cc:1048] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:41.253103 16271 raft_consensus.cc:1275] T dbb55848f9c040ac9db9b7849e2a0d8a P ce8113a88cac4c138552565af6c645ca [term 4 FOLLOWER]: Refusing update from remote peer b61c58ed04b046d48634e2172dc45851: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:41.255007 16627 consensus_queue.cc:1048] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:41.281188 16123 raft_consensus.cc:1275] T 5fef361fdd2840b6b5af55b92f7343a0 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Refusing update from remote peer b61c58ed04b046d48634e2172dc45851: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:18:41.282826 16601 consensus_queue.cc:1048] T 5fef361fdd2840b6b5af55b92f7343a0 P b61c58ed04b046d48634e2172dc45851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:41.295744 16271 raft_consensus.cc:1275] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Refusing update from remote peer b61c58ed04b046d48634e2172dc45851: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:18:41.298319 16601 consensus_queue.cc:1048] T 5fef361fdd2840b6b5af55b92f7343a0 P b61c58ed04b046d48634e2172dc45851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:41.834890  3922 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:18:41.840551  3922 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:18:41.841002  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:41.848037 16199 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62f91e00d01e497d9eda72bf862ce090"
dest_uuid: "b61c58ed04b046d48634e2172dc45851"
mode: GRACEFUL
new_leader_uuid: "ce8113a88cac4c138552565af6c645ca"
 from {username='slave'} at 127.0.0.1:56462
I20260709 12:18:41.848680 16199 raft_consensus.cc:606] T 62f91e00d01e497d9eda72bf862ce090 P b61c58ed04b046d48634e2172dc45851 [term 2 LEADER]: Received request to transfer leadership to TS ce8113a88cac4c138552565af6c645ca
I20260709 12:18:41.850250  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:18:41.850807  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:42.105209 16601 raft_consensus.cc:993] T 62f91e00d01e497d9eda72bf862ce090 P b61c58ed04b046d48634e2172dc45851: : Instructing follower ce8113a88cac4c138552565af6c645ca to start an election
I20260709 12:18:42.105811 16643 raft_consensus.cc:1081] T 62f91e00d01e497d9eda72bf862ce090 P b61c58ed04b046d48634e2172dc45851 [term 2 LEADER]: Signalling peer ce8113a88cac4c138552565af6c645ca to start an election
I20260709 12:18:42.107503 16271 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "62f91e00d01e497d9eda72bf862ce090"
dest_uuid: "ce8113a88cac4c138552565af6c645ca"
 from {username='slave'} at 127.0.0.1:56460
I20260709 12:18:42.107985 16271 raft_consensus.cc:493] T 62f91e00d01e497d9eda72bf862ce090 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:42.108389 16271 raft_consensus.cc:3060] T 62f91e00d01e497d9eda72bf862ce090 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:42.113471 16271 raft_consensus.cc:515] T 62f91e00d01e497d9eda72bf862ce090 P ce8113a88cac4c138552565af6c645ca [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:42.114961 16271 leader_election.cc:290] T 62f91e00d01e497d9eda72bf862ce090 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 election: Requested vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
I20260709 12:18:42.116123 16120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f91e00d01e497d9eda72bf862ce090" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8"
I20260709 12:18:42.116132 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f91e00d01e497d9eda72bf862ce090" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b61c58ed04b046d48634e2172dc45851"
I20260709 12:18:42.117069 16120 raft_consensus.cc:3060] T 62f91e00d01e497d9eda72bf862ce090 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:42.117657 16199 raft_consensus.cc:3055] T 62f91e00d01e497d9eda72bf862ce090 P b61c58ed04b046d48634e2172dc45851 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:42.117944 16199 raft_consensus.cc:740] T 62f91e00d01e497d9eda72bf862ce090 P b61c58ed04b046d48634e2172dc45851 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b61c58ed04b046d48634e2172dc45851, State: Running, Role: LEADER
I20260709 12:18:42.118716 16199 consensus_queue.cc:260] T 62f91e00d01e497d9eda72bf862ce090 P b61c58ed04b046d48634e2172dc45851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:42.119774 16199 raft_consensus.cc:3060] T 62f91e00d01e497d9eda72bf862ce090 P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:42.124557 16199 raft_consensus.cc:2468] T 62f91e00d01e497d9eda72bf862ce090 P b61c58ed04b046d48634e2172dc45851 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce8113a88cac4c138552565af6c645ca in term 3.
I20260709 12:18:42.125638 16237 leader_election.cc:304] T 62f91e00d01e497d9eda72bf862ce090 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b61c58ed04b046d48634e2172dc45851, ce8113a88cac4c138552565af6c645ca; no voters: 
I20260709 12:18:42.125862 16120 raft_consensus.cc:2468] T 62f91e00d01e497d9eda72bf862ce090 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce8113a88cac4c138552565af6c645ca in term 3.
I20260709 12:18:42.126286 16645 raft_consensus.cc:2804] T 62f91e00d01e497d9eda72bf862ce090 P ce8113a88cac4c138552565af6c645ca [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:42.126904 16645 raft_consensus.cc:697] T 62f91e00d01e497d9eda72bf862ce090 P ce8113a88cac4c138552565af6c645ca [term 3 LEADER]: Becoming Leader. State: Replica: ce8113a88cac4c138552565af6c645ca, State: Running, Role: LEADER
I20260709 12:18:42.127947 16645 consensus_queue.cc:237] T 62f91e00d01e497d9eda72bf862ce090 P ce8113a88cac4c138552565af6c645ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:42.139724 16021 catalog_manager.cc:5697] T 62f91e00d01e497d9eda72bf862ce090 P ce8113a88cac4c138552565af6c645ca reported cstate change: term changed from 2 to 3, leader changed from b61c58ed04b046d48634e2172dc45851 (127.3.212.130) to ce8113a88cac4c138552565af6c645ca (127.3.212.131). New cstate: current_term: 3 leader_uuid: "ce8113a88cac4c138552565af6c645ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:42.624403 16199 raft_consensus.cc:1275] T 62f91e00d01e497d9eda72bf862ce090 P b61c58ed04b046d48634e2172dc45851 [term 3 FOLLOWER]: Refusing update from remote peer ce8113a88cac4c138552565af6c645ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:42.625670 16645 consensus_queue.cc:1048] T 62f91e00d01e497d9eda72bf862ce090 P ce8113a88cac4c138552565af6c645ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:42.640987 16120 raft_consensus.cc:1275] T 62f91e00d01e497d9eda72bf862ce090 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 3 FOLLOWER]: Refusing update from remote peer ce8113a88cac4c138552565af6c645ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:42.642628 16653 consensus_queue.cc:1048] T 62f91e00d01e497d9eda72bf862ce090 P ce8113a88cac4c138552565af6c645ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:42.851868  3922 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:18:42.857995  3922 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:18:42.858598  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:42.864800  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:42.865340  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:43.866497  3922 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:18:43.872889  3922 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:18:43.873309  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:43.878786  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:18:43.879222  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:18:45.728240 16239 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.001s	sys 0.020s
W20260709 12:18:45.728722 16239 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.001s	sys 0.020s
W20260709 12:18:45.765619 16238 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.816s	user 0.024s	sys 0.024s
W20260709 12:18:45.767431 16238 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.025s	sys 0.024s
I20260709 12:18:45.841077 16669 raft_consensus.cc:493] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b61c58ed04b046d48634e2172dc45851)
I20260709 12:18:45.842633 16669 raft_consensus.cc:515] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:45.851637 16674 raft_consensus.cc:493] T 7934a0be864f472b90de8265010eb7d1 P b61c58ed04b046d48634e2172dc45851 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce8113a88cac4c138552565af6c645ca)
I20260709 12:18:45.852037 16643 raft_consensus.cc:493] T 08fa442667044198b448f66ee7350935 P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ce8113a88cac4c138552565af6c645ca)
I20260709 12:18:45.852756 16674 raft_consensus.cc:515] T 7934a0be864f472b90de8265010eb7d1 P b61c58ed04b046d48634e2172dc45851 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:45.853224 16643 raft_consensus.cc:515] T 08fa442667044198b448f66ee7350935 P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:45.856213 16643 leader_election.cc:290] T 08fa442667044198b448f66ee7350935 P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:45.851747 16669 leader_election.cc:290] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:45.858266 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fa442667044198b448f66ee7350935" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca" is_pre_election: true
I20260709 12:18:45.868108 16674 leader_election.cc:290] T 7934a0be864f472b90de8265010eb7d1 P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:45.956907 16271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6725f36431fc4b0fa0f740b0d8e8f7d9" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca" is_pre_election: true
I20260709 12:18:45.963027  3922 tablet_server.cc:179] TabletServer@127.3.212.129:0 shutting down...
I20260709 12:18:45.965338 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7934a0be864f472b90de8265010eb7d1" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca" is_pre_election: true
I20260709 12:18:45.973965 16660 raft_consensus.cc:493] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b61c58ed04b046d48634e2172dc45851)
I20260709 12:18:45.975085 16660 raft_consensus.cc:515] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
W20260709 12:18:45.979717 16238 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 7 similar messages]
I20260709 12:18:45.981650 16660 leader_election.cc:290] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
I20260709 12:18:46.012393 16675 raft_consensus.cc:493] T 4c50e97dfcc74bceb3b7d7db53a47278 P b61c58ed04b046d48634e2172dc45851 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce8113a88cac4c138552565af6c645ca)
I20260709 12:18:46.045040 16675 raft_consensus.cc:515] T 4c50e97dfcc74bceb3b7d7db53a47278 P b61c58ed04b046d48634e2172dc45851 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:46.051092 16675 leader_election.cc:290] T 4c50e97dfcc74bceb3b7d7db53a47278 P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:46.076345 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50e97dfcc74bceb3b7d7db53a47278" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca" is_pre_election: true
I20260709 12:18:46.094184 16669 raft_consensus.cc:493] T ce427f23372c4482b0d022f844b46d32 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b61c58ed04b046d48634e2172dc45851)
I20260709 12:18:46.095139 16669 raft_consensus.cc:515] T ce427f23372c4482b0d022f844b46d32 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:46.095431 16663 raft_consensus.cc:493] T 3c0f4313ed9e402d9c4067f38e69a61d P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b61c58ed04b046d48634e2172dc45851)
I20260709 12:18:46.096314 16663 raft_consensus.cc:515] T 3c0f4313ed9e402d9c4067f38e69a61d P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:46.098884 16669 leader_election.cc:290] T ce427f23372c4482b0d022f844b46d32 P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:46.099575 16663 leader_election.cc:290] T 3c0f4313ed9e402d9c4067f38e69a61d P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:46.100611 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0f4313ed9e402d9c4067f38e69a61d" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca" is_pre_election: true
I20260709 12:18:46.102218 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce427f23372c4482b0d022f844b46d32" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca" is_pre_election: true
W20260709 12:18:46.104242 16053 debug-util.cc:398] Leaking SignalData structure 0x7b0800057ba0 after lost signal to thread 3925
W20260709 12:18:46.106539 16053 debug-util.cc:398] Leaking SignalData structure 0x7b08002b18a0 after lost signal to thread 16056
I20260709 12:18:46.108033 16198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fef361fdd2840b6b5af55b92f7343a0" candidate_uuid: "ce8113a88cac4c138552565af6c645ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b61c58ed04b046d48634e2172dc45851" is_pre_election: true
W20260709 12:18:46.109086 16053 debug-util.cc:398] Leaking SignalData structure 0x7b08002e2980 after lost signal to thread 16148
I20260709 12:18:46.111595 16662 raft_consensus.cc:493] T 554db18677e043199032d1d23ff3ac7d P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d58c05fc6fdc40b1bafd92b0c61e34e8)
I20260709 12:18:46.112385 16662 raft_consensus.cc:515] T 554db18677e043199032d1d23ff3ac7d P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:46.116812 16672 raft_consensus.cc:493] T 62f91e00d01e497d9eda72bf862ce090 P b61c58ed04b046d48634e2172dc45851 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ce8113a88cac4c138552565af6c645ca)
W20260709 12:18:46.117874 16053 debug-util.cc:398] Leaking SignalData structure 0x7b08000f1a60 after lost signal to thread 16223
I20260709 12:18:46.117601 16672 raft_consensus.cc:515] T 62f91e00d01e497d9eda72bf862ce090 P b61c58ed04b046d48634e2172dc45851 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:46.116750 16662 leader_election.cc:290] T 554db18677e043199032d1d23ff3ac7d P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:46.119993 16643 raft_consensus.cc:493] T 1dcba4c6f61b41eab71ddaafd49ed11f P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d58c05fc6fdc40b1bafd92b0c61e34e8)
I20260709 12:18:46.120926 16643 raft_consensus.cc:515] T 1dcba4c6f61b41eab71ddaafd49ed11f P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:46.121965 16672 leader_election.cc:290] T 62f91e00d01e497d9eda72bf862ce090 P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
W20260709 12:18:46.123319 16053 debug-util.cc:398] Leaking SignalData structure 0x7b08002f9a40 after lost signal to thread 16297
I20260709 12:18:46.124359 16643 leader_election.cc:290] T 1dcba4c6f61b41eab71ddaafd49ed11f P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:46.122118 16673 raft_consensus.cc:493] T cf4d45c1d3754356973b60c803375a36 P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d58c05fc6fdc40b1bafd92b0c61e34e8)
W20260709 12:18:46.127010 16238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.3.212.129:37467, user_credentials={real_user=slave}} blocked reactor thread for 147334us
I20260709 12:18:46.153076 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcba4c6f61b41eab71ddaafd49ed11f" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca" is_pre_election: true
I20260709 12:18:46.146082 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "554db18677e043199032d1d23ff3ac7d" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca" is_pre_election: true
I20260709 12:18:46.153568 16273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f91e00d01e497d9eda72bf862ce090" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca" is_pre_election: true
W20260709 12:18:46.149577 16238 leader_election.cc:336] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:46.128135 16673 raft_consensus.cc:515] T cf4d45c1d3754356973b60c803375a36 P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:46.155750 16238 leader_election.cc:304] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce8113a88cac4c138552565af6c645ca; no voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:46.148053 16674 raft_consensus.cc:493] T 7428466d80bc4b3b8fb4346741658617 P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d58c05fc6fdc40b1bafd92b0c61e34e8)
W20260709 12:18:46.157624 16164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:37467, user_credentials={real_user=slave}} blocked reactor thread for 110659us
I20260709 12:18:46.157971 16674 raft_consensus.cc:515] T 7428466d80bc4b3b8fb4346741658617 P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:46.160058 16673 leader_election.cc:290] T cf4d45c1d3754356973b60c803375a36 P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:46.160980 16674 leader_election.cc:290] T 7428466d80bc4b3b8fb4346741658617 P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:46.163396 16670 raft_consensus.cc:2749] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:46.164609 16269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4d45c1d3754356973b60c803375a36" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca" is_pre_election: true
I20260709 12:18:46.164319 16266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7428466d80bc4b3b8fb4346741658617" candidate_uuid: "b61c58ed04b046d48634e2172dc45851" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca" is_pre_election: true
W20260709 12:18:46.169219 16238 consensus_peers.cc:597] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P ce8113a88cac4c138552565af6c645ca -> Peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Couldn't send request to peer d58c05fc6fdc40b1bafd92b0c61e34e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:46.188087 16663 raft_consensus.cc:493] T dbb55848f9c040ac9db9b7849e2a0d8a P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b61c58ed04b046d48634e2172dc45851)
I20260709 12:18:46.189019 16663 raft_consensus.cc:515] T dbb55848f9c040ac9db9b7849e2a0d8a P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:46.189935  3922 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:18:46.191502 16663 leader_election.cc:290] T dbb55848f9c040ac9db9b7849e2a0d8a P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005), ce8113a88cac4c138552565af6c645ca (127.3.212.131:45363)
I20260709 12:18:46.192605  3922 tablet_replica.cc:333] T 7428466d80bc4b3b8fb4346741658617 P d58c05fc6fdc40b1bafd92b0c61e34e8: stopping tablet replica
I20260709 12:18:46.193989 16272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb55848f9c040ac9db9b7849e2a0d8a" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ce8113a88cac4c138552565af6c645ca" is_pre_election: true
I20260709 12:18:46.194327  3922 raft_consensus.cc:2243] T 7428466d80bc4b3b8fb4346741658617 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:46.195667  3922 raft_consensus.cc:2272] T 7428466d80bc4b3b8fb4346741658617 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:46.198762 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6725f36431fc4b0fa0f740b0d8e8f7d9" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b61c58ed04b046d48634e2172dc45851" is_pre_election: true
I20260709 12:18:46.200472  3922 tablet_replica.cc:333] T 1e0b2bd53e024a3c8e84fd8372196c8e P d58c05fc6fdc40b1bafd92b0c61e34e8: stopping tablet replica
I20260709 12:18:46.201066 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0f4313ed9e402d9c4067f38e69a61d" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b61c58ed04b046d48634e2172dc45851" is_pre_election: true
I20260709 12:18:46.202050  3922 raft_consensus.cc:2243] T 1e0b2bd53e024a3c8e84fd8372196c8e P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:46.203680  3922 raft_consensus.cc:2272] T 1e0b2bd53e024a3c8e84fd8372196c8e P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:46.203819 16198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbb55848f9c040ac9db9b7849e2a0d8a" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b61c58ed04b046d48634e2172dc45851" is_pre_election: true
I20260709 12:18:46.204942 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce427f23372c4482b0d022f844b46d32" candidate_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b61c58ed04b046d48634e2172dc45851" is_pre_election: true
W20260709 12:18:46.188127 16238 consensus_peers.cc:597] T 62f91e00d01e497d9eda72bf862ce090 P ce8113a88cac4c138552565af6c645ca -> Peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Couldn't send request to peer d58c05fc6fdc40b1bafd92b0c61e34e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:46.207753  3922 tablet_replica.cc:333] T 7934a0be864f472b90de8265010eb7d1 P d58c05fc6fdc40b1bafd92b0c61e34e8: stopping tablet replica
I20260709 12:18:46.208792  3922 raft_consensus.cc:2243] T 7934a0be864f472b90de8265010eb7d1 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:46.209837  3922 raft_consensus.cc:2272] T 7934a0be864f472b90de8265010eb7d1 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:46.214416  3922 tablet_replica.cc:333] T 4c50e97dfcc74bceb3b7d7db53a47278 P d58c05fc6fdc40b1bafd92b0c61e34e8: stopping tablet replica
I20260709 12:18:46.215690  3922 raft_consensus.cc:2243] T 4c50e97dfcc74bceb3b7d7db53a47278 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:46.217363  3922 raft_consensus.cc:2272] T 4c50e97dfcc74bceb3b7d7db53a47278 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:46.220003 16238 consensus_peers.cc:597] T 3a632db0115e4b18a7e169bdf6d970ed P ce8113a88cac4c138552565af6c645ca -> Peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Couldn't send request to peer d58c05fc6fdc40b1bafd92b0c61e34e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:46.222131  3922 tablet_replica.cc:333] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P d58c05fc6fdc40b1bafd92b0c61e34e8: stopping tablet replica
I20260709 12:18:46.223388  3922 raft_consensus.cc:2243] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:46.224428  3922 raft_consensus.cc:2272] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:46.232527  3922 tablet_replica.cc:333] T cf4d45c1d3754356973b60c803375a36 P d58c05fc6fdc40b1bafd92b0c61e34e8: stopping tablet replica
I20260709 12:18:46.233671  3922 raft_consensus.cc:2243] T cf4d45c1d3754356973b60c803375a36 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:46.235357  3922 raft_consensus.cc:2272] T cf4d45c1d3754356973b60c803375a36 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:46.239429  3922 tablet_replica.cc:333] T 58fbda1848e042e5b821d2c689411fe7 P d58c05fc6fdc40b1bafd92b0c61e34e8: stopping tablet replica
I20260709 12:18:46.240466  3922 raft_consensus.cc:2243] T 58fbda1848e042e5b821d2c689411fe7 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:46.241535 16088 leader_election.cc:304] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: b61c58ed04b046d48634e2172dc45851, ce8113a88cac4c138552565af6c645ca
I20260709 12:18:46.242228  3922 raft_consensus.cc:2272] T 58fbda1848e042e5b821d2c689411fe7 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:46.242873 16663 raft_consensus.cc:2749] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:46.244136 16088 leader_election.cc:304] T 3c0f4313ed9e402d9c4067f38e69a61d P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: b61c58ed04b046d48634e2172dc45851, ce8113a88cac4c138552565af6c645ca
I20260709 12:18:46.245352 16663 raft_consensus.cc:2749] T 3c0f4313ed9e402d9c4067f38e69a61d P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:46.246349  3922 tablet_replica.cc:333] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P d58c05fc6fdc40b1bafd92b0c61e34e8: stopping tablet replica
I20260709 12:18:46.246809 16088 leader_election.cc:304] T dbb55848f9c040ac9db9b7849e2a0d8a P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: b61c58ed04b046d48634e2172dc45851, ce8113a88cac4c138552565af6c645ca
I20260709 12:18:46.247465  3922 raft_consensus.cc:2243] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:46.248041 16663 raft_consensus.cc:2749] T dbb55848f9c040ac9db9b7849e2a0d8a P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:46.248355  3922 raft_consensus.cc:2272] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:46.249491 16088 leader_election.cc:304] T ce427f23372c4482b0d022f844b46d32 P d58c05fc6fdc40b1bafd92b0c61e34e8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d58c05fc6fdc40b1bafd92b0c61e34e8; no voters: b61c58ed04b046d48634e2172dc45851, ce8113a88cac4c138552565af6c645ca
I20260709 12:18:46.255887  3922 tablet_replica.cc:333] T 5fef361fdd2840b6b5af55b92f7343a0 P d58c05fc6fdc40b1bafd92b0c61e34e8: stopping tablet replica
I20260709 12:18:46.257531 16663 raft_consensus.cc:2749] T ce427f23372c4482b0d022f844b46d32 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:46.258292  3922 raft_consensus.cc:2243] T 5fef361fdd2840b6b5af55b92f7343a0 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:46.259413  3922 raft_consensus.cc:2272] T 5fef361fdd2840b6b5af55b92f7343a0 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:46.261407 16164 consensus_peers.cc:597] T 3c0f4313ed9e402d9c4067f38e69a61d P b61c58ed04b046d48634e2172dc45851 -> Peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Couldn't send request to peer d58c05fc6fdc40b1bafd92b0c61e34e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:46.265937 16164 consensus_peers.cc:597] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P b61c58ed04b046d48634e2172dc45851 -> Peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Couldn't send request to peer d58c05fc6fdc40b1bafd92b0c61e34e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:46.266695 16164 consensus_peers.cc:597] T ce427f23372c4482b0d022f844b46d32 P b61c58ed04b046d48634e2172dc45851 -> Peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Couldn't send request to peer d58c05fc6fdc40b1bafd92b0c61e34e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:46.267320 16164 leader_election.cc:336] T 7934a0be864f472b90de8265010eb7d1 P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:18:46.267823 16238 consensus_peers.cc:597] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca -> Peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Couldn't send request to peer d58c05fc6fdc40b1bafd92b0c61e34e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:46.269932  3922 tablet_replica.cc:333] T 3a632db0115e4b18a7e169bdf6d970ed P d58c05fc6fdc40b1bafd92b0c61e34e8: stopping tablet replica
I20260709 12:18:46.270025 16164 leader_election.cc:304] T 7934a0be864f472b90de8265010eb7d1 P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b61c58ed04b046d48634e2172dc45851; no voters: ce8113a88cac4c138552565af6c645ca, d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:46.271091  3922 raft_consensus.cc:2243] T 3a632db0115e4b18a7e169bdf6d970ed P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:46.271167 16672 raft_consensus.cc:2749] T 7934a0be864f472b90de8265010eb7d1 P b61c58ed04b046d48634e2172dc45851 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:18:46.271708 16164 leader_election.cc:336] T 08fa442667044198b448f66ee7350935 P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:46.272277  3922 raft_consensus.cc:2272] T 3a632db0115e4b18a7e169bdf6d970ed P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:46.272258 16164 leader_election.cc:304] T 08fa442667044198b448f66ee7350935 P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b61c58ed04b046d48634e2172dc45851; no voters: ce8113a88cac4c138552565af6c645ca, d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:46.273275 16672 raft_consensus.cc:2749] T 08fa442667044198b448f66ee7350935 P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:18:46.273842 16164 consensus_peers.cc:597] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 -> Peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Couldn't send request to peer d58c05fc6fdc40b1bafd92b0c61e34e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:46.276950  3922 tablet_replica.cc:333] T 3c0f4313ed9e402d9c4067f38e69a61d P d58c05fc6fdc40b1bafd92b0c61e34e8: stopping tablet replica
I20260709 12:18:46.278184  3922 raft_consensus.cc:2243] T 3c0f4313ed9e402d9c4067f38e69a61d P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:46.279191  3922 raft_consensus.cc:2272] T 3c0f4313ed9e402d9c4067f38e69a61d P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:46.283640  3922 tablet_replica.cc:333] T 554db18677e043199032d1d23ff3ac7d P d58c05fc6fdc40b1bafd92b0c61e34e8: stopping tablet replica
I20260709 12:18:46.284807  3922 raft_consensus.cc:2243] T 554db18677e043199032d1d23ff3ac7d P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:46.286413  3922 raft_consensus.cc:2272] T 554db18677e043199032d1d23ff3ac7d P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:46.287724 16238 consensus_peers.cc:597] T 08fa442667044198b448f66ee7350935 P ce8113a88cac4c138552565af6c645ca -> Peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Couldn't send request to peer d58c05fc6fdc40b1bafd92b0c61e34e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:46.281240 16164 leader_election.cc:336] T 4c50e97dfcc74bceb3b7d7db53a47278 P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:46.288525 16164 leader_election.cc:304] T 4c50e97dfcc74bceb3b7d7db53a47278 P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b61c58ed04b046d48634e2172dc45851; no voters: ce8113a88cac4c138552565af6c645ca, d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:46.289438 16672 raft_consensus.cc:2749] T 4c50e97dfcc74bceb3b7d7db53a47278 P b61c58ed04b046d48634e2172dc45851 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:18:46.289909 16164 leader_election.cc:336] T 554db18677e043199032d1d23ff3ac7d P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:46.290580 16164 leader_election.cc:304] T 554db18677e043199032d1d23ff3ac7d P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b61c58ed04b046d48634e2172dc45851; no voters: ce8113a88cac4c138552565af6c645ca, d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:46.291158  3922 tablet_replica.cc:333] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P d58c05fc6fdc40b1bafd92b0c61e34e8: stopping tablet replica
I20260709 12:18:46.291379 16672 raft_consensus.cc:2749] T 554db18677e043199032d1d23ff3ac7d P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:18:46.291817 16164 leader_election.cc:336] T 62f91e00d01e497d9eda72bf862ce090 P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:46.292235  3922 raft_consensus.cc:2243] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:46.292275 16164 leader_election.cc:304] T 62f91e00d01e497d9eda72bf862ce090 P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b61c58ed04b046d48634e2172dc45851; no voters: ce8113a88cac4c138552565af6c645ca, d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:46.293365 16675 raft_consensus.cc:2749] T 62f91e00d01e497d9eda72bf862ce090 P b61c58ed04b046d48634e2172dc45851 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:18:46.293777 16164 leader_election.cc:336] T 1dcba4c6f61b41eab71ddaafd49ed11f P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:46.293359  3922 raft_consensus.cc:2272] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:46.294210 16164 leader_election.cc:304] T 1dcba4c6f61b41eab71ddaafd49ed11f P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b61c58ed04b046d48634e2172dc45851; no voters: ce8113a88cac4c138552565af6c645ca, d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:46.295322 16675 raft_consensus.cc:2749] T 1dcba4c6f61b41eab71ddaafd49ed11f P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:18:46.295684 16164 leader_election.cc:336] T cf4d45c1d3754356973b60c803375a36 P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:46.296182 16164 leader_election.cc:304] T cf4d45c1d3754356973b60c803375a36 P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b61c58ed04b046d48634e2172dc45851; no voters: ce8113a88cac4c138552565af6c645ca, d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:46.296934 16672 raft_consensus.cc:2749] T cf4d45c1d3754356973b60c803375a36 P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:18:46.297324 16164 leader_election.cc:336] T 7428466d80bc4b3b8fb4346741658617 P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:18:46.297927 16164 leader_election.cc:304] T 7428466d80bc4b3b8fb4346741658617 P b61c58ed04b046d48634e2172dc45851 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b61c58ed04b046d48634e2172dc45851; no voters: ce8113a88cac4c138552565af6c645ca, d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:46.298748 16672 raft_consensus.cc:2749] T 7428466d80bc4b3b8fb4346741658617 P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:46.301129  3922 tablet_replica.cc:333] T 1dcba4c6f61b41eab71ddaafd49ed11f P d58c05fc6fdc40b1bafd92b0c61e34e8: stopping tablet replica
I20260709 12:18:46.302174  3922 raft_consensus.cc:2243] T 1dcba4c6f61b41eab71ddaafd49ed11f P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:46.303675  3922 raft_consensus.cc:2272] T 1dcba4c6f61b41eab71ddaafd49ed11f P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:46.309713  3922 tablet_replica.cc:333] T 08fa442667044198b448f66ee7350935 P d58c05fc6fdc40b1bafd92b0c61e34e8: stopping tablet replica
I20260709 12:18:46.310619  3922 raft_consensus.cc:2243] T 08fa442667044198b448f66ee7350935 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:46.311522  3922 raft_consensus.cc:2272] T 08fa442667044198b448f66ee7350935 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:46.315644  3922 tablet_replica.cc:333] T ce427f23372c4482b0d022f844b46d32 P d58c05fc6fdc40b1bafd92b0c61e34e8: stopping tablet replica
I20260709 12:18:46.316489  3922 raft_consensus.cc:2243] T ce427f23372c4482b0d022f844b46d32 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:46.317250  3922 raft_consensus.cc:2272] T ce427f23372c4482b0d022f844b46d32 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:46.321297  3922 tablet_replica.cc:333] T dbb55848f9c040ac9db9b7849e2a0d8a P d58c05fc6fdc40b1bafd92b0c61e34e8: stopping tablet replica
W20260709 12:18:46.321646 16238 consensus_peers.cc:597] T 7934a0be864f472b90de8265010eb7d1 P ce8113a88cac4c138552565af6c645ca -> Peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Couldn't send request to peer d58c05fc6fdc40b1bafd92b0c61e34e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:46.322118  3922 raft_consensus.cc:2243] T dbb55848f9c040ac9db9b7849e2a0d8a P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:46.322963  3922 raft_consensus.cc:2272] T dbb55848f9c040ac9db9b7849e2a0d8a P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:46.326398  3922 tablet_replica.cc:333] T 62f91e00d01e497d9eda72bf862ce090 P d58c05fc6fdc40b1bafd92b0c61e34e8: stopping tablet replica
I20260709 12:18:46.327155  3922 raft_consensus.cc:2243] T 62f91e00d01e497d9eda72bf862ce090 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:46.327859  3922 raft_consensus.cc:2272] T 62f91e00d01e497d9eda72bf862ce090 P d58c05fc6fdc40b1bafd92b0c61e34e8 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:46.376458 16164 connection.cc:573] client connection to 127.3.212.129:37467 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260709 12:18:46.392464  3922 tablet_server.cc:196] TabletServer@127.3.212.129:0 shutdown complete.
I20260709 12:18:46.455176  3922 tablet_server.cc:179] TabletServer@127.3.212.130:0 shutting down...
W20260709 12:18:46.468675 16237 consensus_peers.cc:597] T 08fa442667044198b448f66ee7350935 P ce8113a88cac4c138552565af6c645ca -> Peer b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005): Couldn't send request to peer b61c58ed04b046d48634e2172dc45851. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:46.469585 16164 consensus_peers.cc:597] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P b61c58ed04b046d48634e2172dc45851 -> Peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Couldn't send request to peer d58c05fc6fdc40b1bafd92b0c61e34e8. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37467: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:46.502727  3922 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:18:46.503544  3922 tablet_replica.cc:333] T 7934a0be864f472b90de8265010eb7d1 P b61c58ed04b046d48634e2172dc45851: stopping tablet replica
I20260709 12:18:46.504626  3922 raft_consensus.cc:2243] T 7934a0be864f472b90de8265010eb7d1 P b61c58ed04b046d48634e2172dc45851 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:46.505347  3922 raft_consensus.cc:2272] T 7934a0be864f472b90de8265010eb7d1 P b61c58ed04b046d48634e2172dc45851 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:46.508435  3922 tablet_replica.cc:333] T 4c50e97dfcc74bceb3b7d7db53a47278 P b61c58ed04b046d48634e2172dc45851: stopping tablet replica
I20260709 12:18:46.509176  3922 raft_consensus.cc:2243] T 4c50e97dfcc74bceb3b7d7db53a47278 P b61c58ed04b046d48634e2172dc45851 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:46.509722  3922 raft_consensus.cc:2272] T 4c50e97dfcc74bceb3b7d7db53a47278 P b61c58ed04b046d48634e2172dc45851 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:46.512292  3922 tablet_replica.cc:333] T 7428466d80bc4b3b8fb4346741658617 P b61c58ed04b046d48634e2172dc45851: stopping tablet replica
I20260709 12:18:46.512876  3922 raft_consensus.cc:2243] T 7428466d80bc4b3b8fb4346741658617 P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:46.513518  3922 raft_consensus.cc:2272] T 7428466d80bc4b3b8fb4346741658617 P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:46.516042  3922 tablet_replica.cc:333] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P b61c58ed04b046d48634e2172dc45851: stopping tablet replica
I20260709 12:18:46.516681  3922 raft_consensus.cc:2243] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P b61c58ed04b046d48634e2172dc45851 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:46.517706  3922 raft_consensus.cc:2272] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:46.520195  3922 tablet_replica.cc:333] T 58fbda1848e042e5b821d2c689411fe7 P b61c58ed04b046d48634e2172dc45851: stopping tablet replica
I20260709 12:18:46.520836  3922 raft_consensus.cc:2243] T 58fbda1848e042e5b821d2c689411fe7 P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:46.521415  3922 raft_consensus.cc:2272] T 58fbda1848e042e5b821d2c689411fe7 P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:46.524133  3922 tablet_replica.cc:333] T cf4d45c1d3754356973b60c803375a36 P b61c58ed04b046d48634e2172dc45851: stopping tablet replica
I20260709 12:18:46.524712  3922 raft_consensus.cc:2243] T cf4d45c1d3754356973b60c803375a36 P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:46.525146  3922 raft_consensus.cc:2272] T cf4d45c1d3754356973b60c803375a36 P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:46.527813  3922 tablet_replica.cc:333] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P b61c58ed04b046d48634e2172dc45851: stopping tablet replica
I20260709 12:18:46.528465  3922 raft_consensus.cc:2243] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P b61c58ed04b046d48634e2172dc45851 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:46.529371  3922 raft_consensus.cc:2272] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:46.531889  3922 tablet_replica.cc:333] T ce427f23372c4482b0d022f844b46d32 P b61c58ed04b046d48634e2172dc45851: stopping tablet replica
I20260709 12:18:46.532469  3922 raft_consensus.cc:2243] T ce427f23372c4482b0d022f844b46d32 P b61c58ed04b046d48634e2172dc45851 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:46.533347  3922 raft_consensus.cc:2272] T ce427f23372c4482b0d022f844b46d32 P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:46.535856  3922 tablet_replica.cc:333] T 1e0b2bd53e024a3c8e84fd8372196c8e P b61c58ed04b046d48634e2172dc45851: stopping tablet replica
I20260709 12:18:46.536487  3922 raft_consensus.cc:2243] T 1e0b2bd53e024a3c8e84fd8372196c8e P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:46.537077  3922 raft_consensus.cc:2272] T 1e0b2bd53e024a3c8e84fd8372196c8e P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:46.539830  3922 tablet_replica.cc:333] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P b61c58ed04b046d48634e2172dc45851: stopping tablet replica
I20260709 12:18:46.540452  3922 raft_consensus.cc:2243] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:46.541121  3922 raft_consensus.cc:2272] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:46.543746  3922 tablet_replica.cc:333] T 554db18677e043199032d1d23ff3ac7d P b61c58ed04b046d48634e2172dc45851: stopping tablet replica
I20260709 12:18:46.544324  3922 raft_consensus.cc:2243] T 554db18677e043199032d1d23ff3ac7d P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:46.544878  3922 raft_consensus.cc:2272] T 554db18677e043199032d1d23ff3ac7d P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:46.547196  3922 tablet_replica.cc:333] T 62f91e00d01e497d9eda72bf862ce090 P b61c58ed04b046d48634e2172dc45851: stopping tablet replica
I20260709 12:18:46.547791  3922 raft_consensus.cc:2243] T 62f91e00d01e497d9eda72bf862ce090 P b61c58ed04b046d48634e2172dc45851 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:46.548383  3922 raft_consensus.cc:2272] T 62f91e00d01e497d9eda72bf862ce090 P b61c58ed04b046d48634e2172dc45851 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:46.551043  3922 tablet_replica.cc:333] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851: stopping tablet replica
I20260709 12:18:46.551637  3922 raft_consensus.cc:2243] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:18:46.552543  3922 raft_consensus.cc:2272] T dbb55848f9c040ac9db9b7849e2a0d8a P b61c58ed04b046d48634e2172dc45851 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:46.555068  3922 tablet_replica.cc:333] T 3c0f4313ed9e402d9c4067f38e69a61d P b61c58ed04b046d48634e2172dc45851: stopping tablet replica
I20260709 12:18:46.555655  3922 raft_consensus.cc:2243] T 3c0f4313ed9e402d9c4067f38e69a61d P b61c58ed04b046d48634e2172dc45851 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:18:46.556559  3922 raft_consensus.cc:2272] T 3c0f4313ed9e402d9c4067f38e69a61d P b61c58ed04b046d48634e2172dc45851 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:46.559111  3922 tablet_replica.cc:333] T 1dcba4c6f61b41eab71ddaafd49ed11f P b61c58ed04b046d48634e2172dc45851: stopping tablet replica
I20260709 12:18:46.559672  3922 raft_consensus.cc:2243] T 1dcba4c6f61b41eab71ddaafd49ed11f P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:46.560218  3922 raft_consensus.cc:2272] T 1dcba4c6f61b41eab71ddaafd49ed11f P b61c58ed04b046d48634e2172dc45851 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:46.563005  3922 tablet_replica.cc:333] T 08fa442667044198b448f66ee7350935 P b61c58ed04b046d48634e2172dc45851: stopping tablet replica
I20260709 12:18:46.563735  3922 raft_consensus.cc:2243] T 08fa442667044198b448f66ee7350935 P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:46.564229  3922 raft_consensus.cc:2272] T 08fa442667044198b448f66ee7350935 P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:46.566789  3922 tablet_replica.cc:333] T 5fef361fdd2840b6b5af55b92f7343a0 P b61c58ed04b046d48634e2172dc45851: stopping tablet replica
I20260709 12:18:46.567521  3922 raft_consensus.cc:2243] T 5fef361fdd2840b6b5af55b92f7343a0 P b61c58ed04b046d48634e2172dc45851 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:46.568677  3922 raft_consensus.cc:2272] T 5fef361fdd2840b6b5af55b92f7343a0 P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:46.571436  3922 tablet_replica.cc:333] T 3a632db0115e4b18a7e169bdf6d970ed P b61c58ed04b046d48634e2172dc45851: stopping tablet replica
I20260709 12:18:46.571916  3922 raft_consensus.cc:2243] T 3a632db0115e4b18a7e169bdf6d970ed P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:46.572469  3922 raft_consensus.cc:2272] T 3a632db0115e4b18a7e169bdf6d970ed P b61c58ed04b046d48634e2172dc45851 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:46.596657 16237 consensus_peers.cc:597] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P ce8113a88cac4c138552565af6c645ca -> Peer b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005): Couldn't send request to peer b61c58ed04b046d48634e2172dc45851. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:46.670328 16237 consensus_peers.cc:597] T 7934a0be864f472b90de8265010eb7d1 P ce8113a88cac4c138552565af6c645ca -> Peer b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005): Couldn't send request to peer b61c58ed04b046d48634e2172dc45851. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:35005: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:46.744880 16237 consensus_peers.cc:597] T 62f91e00d01e497d9eda72bf862ce090 P ce8113a88cac4c138552565af6c645ca -> Peer b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005): Couldn't send request to peer b61c58ed04b046d48634e2172dc45851. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:35005: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:46.790395 16237 consensus_peers.cc:597] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca -> Peer b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005): Couldn't send request to peer b61c58ed04b046d48634e2172dc45851. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:35005: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:46.807943 16237 consensus_peers.cc:597] T 3a632db0115e4b18a7e169bdf6d970ed P ce8113a88cac4c138552565af6c645ca -> Peer b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005): Couldn't send request to peer b61c58ed04b046d48634e2172dc45851. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:35005: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:47.023399 16220 debug-util.cc:398] Leaking SignalData structure 0x7b08001bae40 after lost signal to thread 3925
W20260709 12:18:47.024657 16220 debug-util.cc:398] Leaking SignalData structure 0x7b08002a6a60 after lost signal to thread 16056
W20260709 12:18:47.026038 16220 debug-util.cc:398] Leaking SignalData structure 0x7b08002eb1c0 after lost signal to thread 16148
W20260709 12:18:47.027417 16220 debug-util.cc:398] Leaking SignalData structure 0x7b0800210d80 after lost signal to thread 16223
W20260709 12:18:47.028692 16220 debug-util.cc:398] Leaking SignalData structure 0x7b08002f13e0 after lost signal to thread 16297
I20260709 12:18:47.293452 16671 raft_consensus.cc:493] T 1e0b2bd53e024a3c8e84fd8372196c8e P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d58c05fc6fdc40b1bafd92b0c61e34e8)
I20260709 12:18:47.294286 16671 raft_consensus.cc:515] T 1e0b2bd53e024a3c8e84fd8372196c8e P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:47.296461 16671 leader_election.cc:290] T 1e0b2bd53e024a3c8e84fd8372196c8e P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
I20260709 12:18:47.298345 16671 raft_consensus.cc:493] T 1dcba4c6f61b41eab71ddaafd49ed11f P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d58c05fc6fdc40b1bafd92b0c61e34e8)
I20260709 12:18:47.298970 16671 raft_consensus.cc:515] T 1dcba4c6f61b41eab71ddaafd49ed11f P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:47.301530 16671 leader_election.cc:290] T 1dcba4c6f61b41eab71ddaafd49ed11f P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
W20260709 12:18:47.309013 16238 leader_election.cc:336] T 1e0b2bd53e024a3c8e84fd8372196c8e P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37467: connect: Connection refused (error 111)
W20260709 12:18:47.309664 16238 leader_election.cc:336] T 1dcba4c6f61b41eab71ddaafd49ed11f P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37467: connect: Connection refused (error 111)
W20260709 12:18:47.313026 16237 leader_election.cc:336] T 1e0b2bd53e024a3c8e84fd8372196c8e P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005): Network error: Client connection negotiation failed: client connection to 127.3.212.130:35005: connect: Connection refused (error 111)
I20260709 12:18:47.313562 16237 leader_election.cc:304] T 1e0b2bd53e024a3c8e84fd8372196c8e P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce8113a88cac4c138552565af6c645ca; no voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:47.314358 16683 raft_consensus.cc:2749] T 1e0b2bd53e024a3c8e84fd8372196c8e P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:18:47.314517 16237 leader_election.cc:336] T 1dcba4c6f61b41eab71ddaafd49ed11f P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005): Network error: Client connection negotiation failed: client connection to 127.3.212.130:35005: connect: Connection refused (error 111)
I20260709 12:18:47.315019 16237 leader_election.cc:304] T 1dcba4c6f61b41eab71ddaafd49ed11f P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce8113a88cac4c138552565af6c645ca; no voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:47.315712 16683 raft_consensus.cc:2749] T 1dcba4c6f61b41eab71ddaafd49ed11f P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:47.617635 16683 raft_consensus.cc:493] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b61c58ed04b046d48634e2172dc45851)
I20260709 12:18:47.618247 16683 raft_consensus.cc:515] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:47.620829 16683 leader_election.cc:290] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
W20260709 12:18:47.623986  3922 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 16220)
W20260709 12:18:47.626871 16237 leader_election.cc:336] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005): Network error: Client connection negotiation failed: client connection to 127.3.212.130:35005: connect: Connection refused (error 111)
W20260709 12:18:47.627573 16238 leader_election.cc:336] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37467: connect: Connection refused (error 111)
I20260709 12:18:47.627997 16238 leader_election.cc:304] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce8113a88cac4c138552565af6c645ca; no voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:47.628719 16683 raft_consensus.cc:2749] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:47.655450 16683 raft_consensus.cc:493] T dbb55848f9c040ac9db9b7849e2a0d8a P ce8113a88cac4c138552565af6c645ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b61c58ed04b046d48634e2172dc45851)
I20260709 12:18:47.656044 16683 raft_consensus.cc:515] T dbb55848f9c040ac9db9b7849e2a0d8a P ce8113a88cac4c138552565af6c645ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:47.658452 16683 leader_election.cc:290] T dbb55848f9c040ac9db9b7849e2a0d8a P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
W20260709 12:18:47.664314 16238 leader_election.cc:336] T dbb55848f9c040ac9db9b7849e2a0d8a P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37467: connect: Connection refused (error 111)
W20260709 12:18:47.665066 16237 leader_election.cc:336] T dbb55848f9c040ac9db9b7849e2a0d8a P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005): Network error: Client connection negotiation failed: client connection to 127.3.212.130:35005: connect: Connection refused (error 111)
I20260709 12:18:47.665539 16237 leader_election.cc:304] T dbb55848f9c040ac9db9b7849e2a0d8a P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce8113a88cac4c138552565af6c645ca; no voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:47.666344 16683 raft_consensus.cc:2749] T dbb55848f9c040ac9db9b7849e2a0d8a P ce8113a88cac4c138552565af6c645ca [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:47.674062 16671 raft_consensus.cc:493] T cf4d45c1d3754356973b60c803375a36 P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d58c05fc6fdc40b1bafd92b0c61e34e8)
I20260709 12:18:47.674672 16671 raft_consensus.cc:515] T cf4d45c1d3754356973b60c803375a36 P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:47.677268 16671 leader_election.cc:290] T cf4d45c1d3754356973b60c803375a36 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
W20260709 12:18:47.681356 16237 leader_election.cc:336] T cf4d45c1d3754356973b60c803375a36 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005): Network error: Client connection negotiation failed: client connection to 127.3.212.130:35005: connect: Connection refused (error 111)
I20260709 12:18:47.682318 16671 raft_consensus.cc:493] T 7428466d80bc4b3b8fb4346741658617 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d58c05fc6fdc40b1bafd92b0c61e34e8)
I20260709 12:18:47.682883 16671 raft_consensus.cc:515] T 7428466d80bc4b3b8fb4346741658617 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
W20260709 12:18:47.683822 16238 leader_election.cc:336] T cf4d45c1d3754356973b60c803375a36 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37467: connect: Connection refused (error 111)
I20260709 12:18:47.684324 16238 leader_election.cc:304] T cf4d45c1d3754356973b60c803375a36 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce8113a88cac4c138552565af6c645ca; no voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:47.685060 16683 raft_consensus.cc:2749] T cf4d45c1d3754356973b60c803375a36 P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:47.685071 16671 leader_election.cc:290] T 7428466d80bc4b3b8fb4346741658617 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
W20260709 12:18:47.692919 16237 leader_election.cc:336] T 7428466d80bc4b3b8fb4346741658617 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005): Network error: Client connection negotiation failed: client connection to 127.3.212.130:35005: connect: Connection refused (error 111)
W20260709 12:18:47.695641 16238 leader_election.cc:336] T 7428466d80bc4b3b8fb4346741658617 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37467: connect: Connection refused (error 111)
I20260709 12:18:47.696099 16238 leader_election.cc:304] T 7428466d80bc4b3b8fb4346741658617 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce8113a88cac4c138552565af6c645ca; no voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:47.696904 16683 raft_consensus.cc:2749] T 7428466d80bc4b3b8fb4346741658617 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:47.713181 16683 raft_consensus.cc:493] T 58fbda1848e042e5b821d2c689411fe7 P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d58c05fc6fdc40b1bafd92b0c61e34e8)
I20260709 12:18:47.713977 16683 raft_consensus.cc:515] T 58fbda1848e042e5b821d2c689411fe7 P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } } peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } }
I20260709 12:18:47.716542 16683 leader_election.cc:290] T 58fbda1848e042e5b821d2c689411fe7 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
W20260709 12:18:47.722774 16237 leader_election.cc:336] T 58fbda1848e042e5b821d2c689411fe7 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005): Network error: Client connection negotiation failed: client connection to 127.3.212.130:35005: connect: Connection refused (error 111)
W20260709 12:18:47.723599 16238 leader_election.cc:336] T 58fbda1848e042e5b821d2c689411fe7 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37467: connect: Connection refused (error 111)
I20260709 12:18:47.725214 16238 leader_election.cc:304] T 58fbda1848e042e5b821d2c689411fe7 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce8113a88cac4c138552565af6c645ca; no voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:47.726076 16683 raft_consensus.cc:2749] T 58fbda1848e042e5b821d2c689411fe7 P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:47.753180 16683 raft_consensus.cc:493] T 554db18677e043199032d1d23ff3ac7d P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d58c05fc6fdc40b1bafd92b0c61e34e8)
I20260709 12:18:47.753851 16683 raft_consensus.cc:515] T 554db18677e043199032d1d23ff3ac7d P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:47.756307 16683 leader_election.cc:290] T 554db18677e043199032d1d23ff3ac7d P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
W20260709 12:18:47.762131 16238 leader_election.cc:336] T 554db18677e043199032d1d23ff3ac7d P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37467: connect: Connection refused (error 111)
W20260709 12:18:47.762761 16237 leader_election.cc:336] T 554db18677e043199032d1d23ff3ac7d P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005): Network error: Client connection negotiation failed: client connection to 127.3.212.130:35005: connect: Connection refused (error 111)
I20260709 12:18:47.763265 16237 leader_election.cc:304] T 554db18677e043199032d1d23ff3ac7d P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce8113a88cac4c138552565af6c645ca; no voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:47.763994 16683 raft_consensus.cc:2749] T 554db18677e043199032d1d23ff3ac7d P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:47.796847 16683 raft_consensus.cc:493] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b61c58ed04b046d48634e2172dc45851)
I20260709 12:18:47.797667 16683 raft_consensus.cc:515] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:47.800115 16683 leader_election.cc:290] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
W20260709 12:18:47.805459 16237 leader_election.cc:336] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005): Network error: Client connection negotiation failed: client connection to 127.3.212.130:35005: connect: Connection refused (error 111)
W20260709 12:18:47.807440 16238 leader_election.cc:336] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37467: connect: Connection refused (error 111)
I20260709 12:18:47.807889 16238 leader_election.cc:304] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce8113a88cac4c138552565af6c645ca; no voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:47.808671 16683 raft_consensus.cc:2749] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:47.892040 16683 raft_consensus.cc:493] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b61c58ed04b046d48634e2172dc45851)
I20260709 12:18:47.892803 16683 raft_consensus.cc:515] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:47.895210 16683 leader_election.cc:290] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
W20260709 12:18:47.900003 16238 leader_election.cc:336] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37467: connect: Connection refused (error 111)
W20260709 12:18:47.902841 16237 leader_election.cc:336] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005): Network error: Client connection negotiation failed: client connection to 127.3.212.130:35005: connect: Connection refused (error 111)
I20260709 12:18:47.903420 16237 leader_election.cc:304] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce8113a88cac4c138552565af6c645ca; no voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:47.904722 16683 raft_consensus.cc:2749] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:47.992231 16683 raft_consensus.cc:493] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b61c58ed04b046d48634e2172dc45851)
I20260709 12:18:47.992834 16683 raft_consensus.cc:515] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:47.993080 16671 raft_consensus.cc:493] T ce427f23372c4482b0d022f844b46d32 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b61c58ed04b046d48634e2172dc45851)
I20260709 12:18:47.993803 16671 raft_consensus.cc:515] T ce427f23372c4482b0d022f844b46d32 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:47.995242 16683 leader_election.cc:290] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
I20260709 12:18:47.995966 16671 leader_election.cc:290] T ce427f23372c4482b0d022f844b46d32 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
W20260709 12:18:48.002076 16238 leader_election.cc:336] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37467: connect: Connection refused (error 111)
W20260709 12:18:48.002707 16238 leader_election.cc:336] T ce427f23372c4482b0d022f844b46d32 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37467: connect: Connection refused (error 111)
W20260709 12:18:48.002816 16237 leader_election.cc:336] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005): Network error: Client connection negotiation failed: client connection to 127.3.212.130:35005: connect: Connection refused (error 111)
I20260709 12:18:48.003417 16237 leader_election.cc:304] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce8113a88cac4c138552565af6c645ca; no voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:48.004158 16671 raft_consensus.cc:2749] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:18:48.004307 16237 leader_election.cc:336] T ce427f23372c4482b0d022f844b46d32 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005): Network error: Client connection negotiation failed: client connection to 127.3.212.130:35005: connect: Connection refused (error 111)
I20260709 12:18:48.004823 16237 leader_election.cc:304] T ce427f23372c4482b0d022f844b46d32 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce8113a88cac4c138552565af6c645ca; no voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:48.005507 16671 raft_consensus.cc:2749] T ce427f23372c4482b0d022f844b46d32 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:18:48.590426 16238 consensus_peers.cc:597] T 08fa442667044198b448f66ee7350935 P ce8113a88cac4c138552565af6c645ca -> Peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Couldn't send request to peer d58c05fc6fdc40b1bafd92b0c61e34e8. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37467: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:48.621742 16238 consensus_peers.cc:597] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca -> Peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Couldn't send request to peer d58c05fc6fdc40b1bafd92b0c61e34e8. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37467: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:48.622277 16238 consensus_peers.cc:597] T 62f91e00d01e497d9eda72bf862ce090 P ce8113a88cac4c138552565af6c645ca -> Peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Couldn't send request to peer d58c05fc6fdc40b1bafd92b0c61e34e8. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37467: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:48.624537  3922 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 16220)
W20260709 12:18:48.641059 16238 consensus_peers.cc:597] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P ce8113a88cac4c138552565af6c645ca -> Peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Couldn't send request to peer d58c05fc6fdc40b1bafd92b0c61e34e8. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37467: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:48.680116 16238 consensus_peers.cc:597] T 3a632db0115e4b18a7e169bdf6d970ed P ce8113a88cac4c138552565af6c645ca -> Peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Couldn't send request to peer d58c05fc6fdc40b1bafd92b0c61e34e8. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37467: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:48.757725 16237 consensus_peers.cc:597] T 08fa442667044198b448f66ee7350935 P ce8113a88cac4c138552565af6c645ca -> Peer b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005): Couldn't send request to peer b61c58ed04b046d48634e2172dc45851. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:35005: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:48.906248 16237 consensus_peers.cc:597] T 7934a0be864f472b90de8265010eb7d1 P ce8113a88cac4c138552565af6c645ca -> Peer b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005): Couldn't send request to peer b61c58ed04b046d48634e2172dc45851. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:35005: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:18:48.918323 16671 raft_consensus.cc:493] T 1e0b2bd53e024a3c8e84fd8372196c8e P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d58c05fc6fdc40b1bafd92b0c61e34e8)
I20260709 12:18:48.919035 16671 raft_consensus.cc:515] T 1e0b2bd53e024a3c8e84fd8372196c8e P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:48.921450 16671 leader_election.cc:290] T 1e0b2bd53e024a3c8e84fd8372196c8e P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
W20260709 12:18:48.936076 16238 leader_election.cc:336] T 1e0b2bd53e024a3c8e84fd8372196c8e P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37467: connect: Connection refused (error 111)
W20260709 12:18:48.942106 16237 leader_election.cc:336] T 1e0b2bd53e024a3c8e84fd8372196c8e P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005): Network error: Client connection negotiation failed: client connection to 127.3.212.130:35005: connect: Connection refused (error 111)
I20260709 12:18:48.942626 16237 leader_election.cc:304] T 1e0b2bd53e024a3c8e84fd8372196c8e P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce8113a88cac4c138552565af6c645ca; no voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:48.943445 16671 raft_consensus.cc:2749] T 1e0b2bd53e024a3c8e84fd8372196c8e P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:18:49.093225 16237 consensus_peers.cc:597] T 62f91e00d01e497d9eda72bf862ce090 P ce8113a88cac4c138552565af6c645ca -> Peer b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005): Couldn't send request to peer b61c58ed04b046d48634e2172dc45851. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:35005: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:49.100678 16238 consensus_peers.cc:597] T 7934a0be864f472b90de8265010eb7d1 P ce8113a88cac4c138552565af6c645ca -> Peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Couldn't send request to peer d58c05fc6fdc40b1bafd92b0c61e34e8. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37467: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:18:49.157493 16237 consensus_peers.cc:597] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P ce8113a88cac4c138552565af6c645ca -> Peer b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005): Couldn't send request to peer b61c58ed04b046d48634e2172dc45851. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:35005: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:18:49.201910 16671 raft_consensus.cc:493] T 1dcba4c6f61b41eab71ddaafd49ed11f P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d58c05fc6fdc40b1bafd92b0c61e34e8)
I20260709 12:18:49.202482 16671 raft_consensus.cc:515] T 1dcba4c6f61b41eab71ddaafd49ed11f P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
W20260709 12:18:49.202934 16237 consensus_peers.cc:597] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca -> Peer b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005): Couldn't send request to peer b61c58ed04b046d48634e2172dc45851. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:35005: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:18:49.204870 16671 leader_election.cc:290] T 1dcba4c6f61b41eab71ddaafd49ed11f P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
W20260709 12:18:49.209563 16238 leader_election.cc:336] T 1dcba4c6f61b41eab71ddaafd49ed11f P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37467: connect: Connection refused (error 111)
W20260709 12:18:49.210422 16237 leader_election.cc:336] T 1dcba4c6f61b41eab71ddaafd49ed11f P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005): Network error: Client connection negotiation failed: client connection to 127.3.212.130:35005: connect: Connection refused (error 111)
I20260709 12:18:49.210832 16237 leader_election.cc:304] T 1dcba4c6f61b41eab71ddaafd49ed11f P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce8113a88cac4c138552565af6c645ca; no voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:49.211549 16671 raft_consensus.cc:2749] T 1dcba4c6f61b41eab71ddaafd49ed11f P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:49.247727 16671 raft_consensus.cc:493] T 7428466d80bc4b3b8fb4346741658617 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d58c05fc6fdc40b1bafd92b0c61e34e8)
I20260709 12:18:49.248449 16671 raft_consensus.cc:515] T 7428466d80bc4b3b8fb4346741658617 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:49.250996 16671 leader_election.cc:290] T 7428466d80bc4b3b8fb4346741658617 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
W20260709 12:18:49.257259 16237 leader_election.cc:336] T 7428466d80bc4b3b8fb4346741658617 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005): Network error: Client connection negotiation failed: client connection to 127.3.212.130:35005: connect: Connection refused (error 111)
W20260709 12:18:49.257941 16238 leader_election.cc:336] T 7428466d80bc4b3b8fb4346741658617 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37467: connect: Connection refused (error 111)
I20260709 12:18:49.258427 16238 leader_election.cc:304] T 7428466d80bc4b3b8fb4346741658617 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce8113a88cac4c138552565af6c645ca; no voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:49.259243 16671 raft_consensus.cc:2749] T 7428466d80bc4b3b8fb4346741658617 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:18:49.290867 16237 consensus_peers.cc:597] T 3a632db0115e4b18a7e169bdf6d970ed P ce8113a88cac4c138552565af6c645ca -> Peer b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005): Couldn't send request to peer b61c58ed04b046d48634e2172dc45851. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:35005: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:18:49.322703 16671 raft_consensus.cc:493] T 58fbda1848e042e5b821d2c689411fe7 P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d58c05fc6fdc40b1bafd92b0c61e34e8)
I20260709 12:18:49.323395 16671 raft_consensus.cc:515] T 58fbda1848e042e5b821d2c689411fe7 P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } } peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } }
I20260709 12:18:49.325965 16671 leader_election.cc:290] T 58fbda1848e042e5b821d2c689411fe7 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
W20260709 12:18:49.331295 16237 leader_election.cc:336] T 58fbda1848e042e5b821d2c689411fe7 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005): Network error: Client connection negotiation failed: client connection to 127.3.212.130:35005: connect: Connection refused (error 111)
W20260709 12:18:49.331911 16238 leader_election.cc:336] T 58fbda1848e042e5b821d2c689411fe7 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37467: connect: Connection refused (error 111)
I20260709 12:18:49.332391 16238 leader_election.cc:304] T 58fbda1848e042e5b821d2c689411fe7 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce8113a88cac4c138552565af6c645ca; no voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:49.333122 16671 raft_consensus.cc:2749] T 58fbda1848e042e5b821d2c689411fe7 P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:49.373134 16671 raft_consensus.cc:493] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b61c58ed04b046d48634e2172dc45851)
I20260709 12:18:49.373801 16671 raft_consensus.cc:515] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:49.376123 16671 leader_election.cc:290] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
I20260709 12:18:49.381498 16671 raft_consensus.cc:493] T dbb55848f9c040ac9db9b7849e2a0d8a P ce8113a88cac4c138552565af6c645ca [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b61c58ed04b046d48634e2172dc45851)
I20260709 12:18:49.382164 16671 raft_consensus.cc:515] T dbb55848f9c040ac9db9b7849e2a0d8a P ce8113a88cac4c138552565af6c645ca [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
W20260709 12:18:49.382871 16237 leader_election.cc:336] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005): Network error: Client connection negotiation failed: client connection to 127.3.212.130:35005: connect: Connection refused (error 111)
W20260709 12:18:49.383744 16238 leader_election.cc:336] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37467: connect: Connection refused (error 111)
I20260709 12:18:49.384217 16238 leader_election.cc:304] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce8113a88cac4c138552565af6c645ca; no voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:49.386808 16671 leader_election.cc:290] T dbb55848f9c040ac9db9b7849e2a0d8a P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
I20260709 12:18:49.387552 16671 raft_consensus.cc:2749] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:18:49.391772 16237 leader_election.cc:336] T dbb55848f9c040ac9db9b7849e2a0d8a P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005): Network error: Client connection negotiation failed: client connection to 127.3.212.130:35005: connect: Connection refused (error 111)
W20260709 12:18:49.396678 16238 leader_election.cc:336] T dbb55848f9c040ac9db9b7849e2a0d8a P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37467: connect: Connection refused (error 111)
I20260709 12:18:49.397146 16238 leader_election.cc:304] T dbb55848f9c040ac9db9b7849e2a0d8a P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce8113a88cac4c138552565af6c645ca; no voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:49.397969 16692 raft_consensus.cc:2749] T dbb55848f9c040ac9db9b7849e2a0d8a P ce8113a88cac4c138552565af6c645ca [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:49.479383 16692 raft_consensus.cc:493] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b61c58ed04b046d48634e2172dc45851)
I20260709 12:18:49.479986 16692 raft_consensus.cc:515] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:49.482379 16692 leader_election.cc:290] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
W20260709 12:18:49.487908 16237 leader_election.cc:336] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005): Network error: Client connection negotiation failed: client connection to 127.3.212.130:35005: connect: Connection refused (error 111)
W20260709 12:18:49.488718 16238 leader_election.cc:336] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37467: connect: Connection refused (error 111)
I20260709 12:18:49.489157 16238 leader_election.cc:304] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce8113a88cac4c138552565af6c645ca; no voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:49.489910 16692 raft_consensus.cc:2749] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:18:49.625144  3922 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 16220)
I20260709 12:18:49.626464 16692 raft_consensus.cc:493] T ce427f23372c4482b0d022f844b46d32 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b61c58ed04b046d48634e2172dc45851)
I20260709 12:18:49.627118 16692 raft_consensus.cc:515] T ce427f23372c4482b0d022f844b46d32 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:49.630725 16671 raft_consensus.cc:493] T cf4d45c1d3754356973b60c803375a36 P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d58c05fc6fdc40b1bafd92b0c61e34e8)
I20260709 12:18:49.631345 16671 raft_consensus.cc:515] T cf4d45c1d3754356973b60c803375a36 P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:49.634011 16671 leader_election.cc:290] T cf4d45c1d3754356973b60c803375a36 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
I20260709 12:18:49.635309 16692 leader_election.cc:290] T ce427f23372c4482b0d022f844b46d32 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
W20260709 12:18:49.639678 16238 leader_election.cc:336] T ce427f23372c4482b0d022f844b46d32 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37467: connect: Connection refused (error 111)
W20260709 12:18:49.640281 16238 leader_election.cc:336] T cf4d45c1d3754356973b60c803375a36 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37467: connect: Connection refused (error 111)
W20260709 12:18:49.642309 16237 leader_election.cc:336] T ce427f23372c4482b0d022f844b46d32 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005): Network error: Client connection negotiation failed: client connection to 127.3.212.130:35005: connect: Connection refused (error 111)
I20260709 12:18:49.642844 16237 leader_election.cc:304] T ce427f23372c4482b0d022f844b46d32 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce8113a88cac4c138552565af6c645ca; no voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:49.643596 16692 raft_consensus.cc:2749] T ce427f23372c4482b0d022f844b46d32 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:18:49.645787 16237 leader_election.cc:336] T cf4d45c1d3754356973b60c803375a36 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005): Network error: Client connection negotiation failed: client connection to 127.3.212.130:35005: connect: Connection refused (error 111)
I20260709 12:18:49.646302 16237 leader_election.cc:304] T cf4d45c1d3754356973b60c803375a36 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce8113a88cac4c138552565af6c645ca; no voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:49.647073 16692 raft_consensus.cc:2749] T cf4d45c1d3754356973b60c803375a36 P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:18:49.772646 16692 raft_consensus.cc:493] T 554db18677e043199032d1d23ff3ac7d P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d58c05fc6fdc40b1bafd92b0c61e34e8)
I20260709 12:18:49.773206 16692 raft_consensus.cc:515] T 554db18677e043199032d1d23ff3ac7d P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:49.774988 16692 leader_election.cc:290] T 554db18677e043199032d1d23ff3ac7d P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
W20260709 12:18:49.779560 16237 leader_election.cc:336] T 554db18677e043199032d1d23ff3ac7d P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005): Network error: Client connection negotiation failed: client connection to 127.3.212.130:35005: connect: Connection refused (error 111)
W20260709 12:18:49.780000 16238 leader_election.cc:336] T 554db18677e043199032d1d23ff3ac7d P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37467: connect: Connection refused (error 111)
I20260709 12:18:49.780350 16238 leader_election.cc:304] T 554db18677e043199032d1d23ff3ac7d P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce8113a88cac4c138552565af6c645ca; no voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:49.780948 16692 raft_consensus.cc:2749] T 554db18677e043199032d1d23ff3ac7d P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:49.786365 16692 raft_consensus.cc:493] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b61c58ed04b046d48634e2172dc45851)
I20260709 12:18:49.786906 16692 raft_consensus.cc:515] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:49.789018 16692 leader_election.cc:290] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
W20260709 12:18:49.793085 16238 leader_election.cc:336] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37467: connect: Connection refused (error 111)
W20260709 12:18:49.793671 16237 leader_election.cc:336] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005): Network error: Client connection negotiation failed: client connection to 127.3.212.130:35005: connect: Connection refused (error 111)
I20260709 12:18:49.794003 16237 leader_election.cc:304] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce8113a88cac4c138552565af6c645ca; no voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:49.794585 16692 raft_consensus.cc:2749] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:49.892714 16692 raft_consensus.cc:493] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b61c58ed04b046d48634e2172dc45851)
I20260709 12:18:49.893198 16692 raft_consensus.cc:515] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:49.895052 16692 leader_election.cc:290] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
W20260709 12:18:49.899446 16237 leader_election.cc:336] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005): Network error: Client connection negotiation failed: client connection to 127.3.212.130:35005: connect: Connection refused (error 111)
W20260709 12:18:49.899978 16238 leader_election.cc:336] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37467: connect: Connection refused (error 111)
I20260709 12:18:49.900316 16238 leader_election.cc:304] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce8113a88cac4c138552565af6c645ca; no voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:49.901036 16692 raft_consensus.cc:2749] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:50.453063 16692 raft_consensus.cc:493] T 1e0b2bd53e024a3c8e84fd8372196c8e P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d58c05fc6fdc40b1bafd92b0c61e34e8)
I20260709 12:18:50.453698 16692 raft_consensus.cc:515] T 1e0b2bd53e024a3c8e84fd8372196c8e P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:50.455700 16692 leader_election.cc:290] T 1e0b2bd53e024a3c8e84fd8372196c8e P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
W20260709 12:18:50.459192 16237 leader_election.cc:336] T 1e0b2bd53e024a3c8e84fd8372196c8e P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005): Network error: Client connection negotiation failed: client connection to 127.3.212.130:35005: connect: Connection refused (error 111)
W20260709 12:18:50.459973 16238 leader_election.cc:336] T 1e0b2bd53e024a3c8e84fd8372196c8e P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37467: connect: Connection refused (error 111)
I20260709 12:18:50.460358 16238 leader_election.cc:304] T 1e0b2bd53e024a3c8e84fd8372196c8e P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce8113a88cac4c138552565af6c645ca; no voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:50.461194 16692 raft_consensus.cc:2749] T 1e0b2bd53e024a3c8e84fd8372196c8e P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:18:50.625785  3922 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 16220)
W20260709 12:18:50.855391 16238 consensus_peers.cc:597] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P ce8113a88cac4c138552565af6c645ca -> Peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Couldn't send request to peer d58c05fc6fdc40b1bafd92b0c61e34e8. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37467: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:18:50.992110 16237 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.212.130:35005: connect: Connection refused (error 111) [suppressed 182 similar messages]
W20260709 12:18:51.011822 16237 consensus_peers.cc:597] T 08fa442667044198b448f66ee7350935 P ce8113a88cac4c138552565af6c645ca -> Peer b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005): Couldn't send request to peer b61c58ed04b046d48634e2172dc45851. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:35005: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:18:51.040268 16692 raft_consensus.cc:493] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b61c58ed04b046d48634e2172dc45851)
I20260709 12:18:51.040872 16692 raft_consensus.cc:515] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d58c05fc6fdc40b1bafd92b0c61e34e8" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 37467 } } peers { permanent_uuid: "b61c58ed04b046d48634e2172dc45851" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 35005 } } peers { permanent_uuid: "ce8113a88cac4c138552565af6c645ca" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 45363 } }
I20260709 12:18:51.042400  3922 tablet_server.cc:196] TabletServer@127.3.212.130:0 shutdown complete.
I20260709 12:18:51.042868 16692 leader_election.cc:290] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467), b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005)
W20260709 12:18:51.047156 16238 leader_election.cc:336] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Network error: Client connection negotiation failed: client connection to 127.3.212.129:37467: connect: Connection refused (error 111)
W20260709 12:18:51.047776 16237 leader_election.cc:336] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b61c58ed04b046d48634e2172dc45851 (127.3.212.130:35005): Network error: Client connection negotiation failed: client connection to 127.3.212.130:35005: connect: Connection refused (error 111)
I20260709 12:18:51.048178 16237 leader_election.cc:304] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce8113a88cac4c138552565af6c645ca; no voters: b61c58ed04b046d48634e2172dc45851, d58c05fc6fdc40b1bafd92b0c61e34e8
I20260709 12:18:51.048794 16692 raft_consensus.cc:2749] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:18:51.059530 16238 consensus_peers.cc:597] T 3a632db0115e4b18a7e169bdf6d970ed P ce8113a88cac4c138552565af6c645ca -> Peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Couldn't send request to peer d58c05fc6fdc40b1bafd92b0c61e34e8. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37467: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:18:51.088460  3922 tablet_server.cc:179] TabletServer@127.3.212.131:0 shutting down...
W20260709 12:18:51.092684 16238 consensus_peers.cc:597] T 08fa442667044198b448f66ee7350935 P ce8113a88cac4c138552565af6c645ca -> Peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Couldn't send request to peer d58c05fc6fdc40b1bafd92b0c61e34e8. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37467: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:18:51.124606  3922 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:18:51.125507  3922 tablet_replica.cc:333] T 1e0b2bd53e024a3c8e84fd8372196c8e P ce8113a88cac4c138552565af6c645ca: stopping tablet replica
I20260709 12:18:51.126469  3922 raft_consensus.cc:2243] T 1e0b2bd53e024a3c8e84fd8372196c8e P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:51.127259  3922 raft_consensus.cc:2272] T 1e0b2bd53e024a3c8e84fd8372196c8e P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:51.129637  3922 tablet_replica.cc:333] T 7934a0be864f472b90de8265010eb7d1 P ce8113a88cac4c138552565af6c645ca: stopping tablet replica
I20260709 12:18:51.130281  3922 raft_consensus.cc:2243] T 7934a0be864f472b90de8265010eb7d1 P ce8113a88cac4c138552565af6c645ca [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:18:51.131233  3922 raft_consensus.cc:2272] T 7934a0be864f472b90de8265010eb7d1 P ce8113a88cac4c138552565af6c645ca [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:51.134013  3922 tablet_replica.cc:333] T 7428466d80bc4b3b8fb4346741658617 P ce8113a88cac4c138552565af6c645ca: stopping tablet replica
I20260709 12:18:51.134794  3922 raft_consensus.cc:2243] T 7428466d80bc4b3b8fb4346741658617 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:51.135434  3922 raft_consensus.cc:2272] T 7428466d80bc4b3b8fb4346741658617 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:18:51.135790 16238 consensus_peers.cc:597] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca -> Peer d58c05fc6fdc40b1bafd92b0c61e34e8 (127.3.212.129:37467): Couldn't send request to peer d58c05fc6fdc40b1bafd92b0c61e34e8. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:37467: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:18:51.137810  3922 tablet_replica.cc:333] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca: stopping tablet replica
I20260709 12:18:51.138542  3922 raft_consensus.cc:2243] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:51.139014  3922 raft_consensus.cc:2272] T 3c0f4313ed9e402d9c4067f38e69a61d P ce8113a88cac4c138552565af6c645ca [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:51.141271  3922 tablet_replica.cc:333] T 3a632db0115e4b18a7e169bdf6d970ed P ce8113a88cac4c138552565af6c645ca: stopping tablet replica
I20260709 12:18:51.142009  3922 raft_consensus.cc:2243] T 3a632db0115e4b18a7e169bdf6d970ed P ce8113a88cac4c138552565af6c645ca [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:51.142864  3922 raft_consensus.cc:2272] T 3a632db0115e4b18a7e169bdf6d970ed P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:51.145036  3922 tablet_replica.cc:333] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca: stopping tablet replica
I20260709 12:18:51.145645  3922 raft_consensus.cc:2243] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:51.146101  3922 raft_consensus.cc:2272] T 5fef361fdd2840b6b5af55b92f7343a0 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:51.148255  3922 tablet_replica.cc:333] T 1dcba4c6f61b41eab71ddaafd49ed11f P ce8113a88cac4c138552565af6c645ca: stopping tablet replica
I20260709 12:18:51.148834  3922 raft_consensus.cc:2243] T 1dcba4c6f61b41eab71ddaafd49ed11f P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:51.149312  3922 raft_consensus.cc:2272] T 1dcba4c6f61b41eab71ddaafd49ed11f P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:51.151695  3922 tablet_replica.cc:333] T 08fa442667044198b448f66ee7350935 P ce8113a88cac4c138552565af6c645ca: stopping tablet replica
I20260709 12:18:51.152300  3922 raft_consensus.cc:2243] T 08fa442667044198b448f66ee7350935 P ce8113a88cac4c138552565af6c645ca [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:51.153102  3922 raft_consensus.cc:2272] T 08fa442667044198b448f66ee7350935 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:51.155438  3922 tablet_replica.cc:333] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P ce8113a88cac4c138552565af6c645ca: stopping tablet replica
I20260709 12:18:51.155947  3922 raft_consensus.cc:2243] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:51.156453  3922 raft_consensus.cc:2272] T 0e5a7f087bcb4438adaf7e1dd6aaf10e P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:51.158752  3922 tablet_replica.cc:333] T cf4d45c1d3754356973b60c803375a36 P ce8113a88cac4c138552565af6c645ca: stopping tablet replica
I20260709 12:18:51.159292  3922 raft_consensus.cc:2243] T cf4d45c1d3754356973b60c803375a36 P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:51.159757  3922 raft_consensus.cc:2272] T cf4d45c1d3754356973b60c803375a36 P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:51.161965  3922 tablet_replica.cc:333] T 58fbda1848e042e5b821d2c689411fe7 P ce8113a88cac4c138552565af6c645ca: stopping tablet replica
I20260709 12:18:51.162500  3922 raft_consensus.cc:2243] T 58fbda1848e042e5b821d2c689411fe7 P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:51.162921  3922 raft_consensus.cc:2272] T 58fbda1848e042e5b821d2c689411fe7 P ce8113a88cac4c138552565af6c645ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:51.164947  3922 tablet_replica.cc:333] T ce427f23372c4482b0d022f844b46d32 P ce8113a88cac4c138552565af6c645ca: stopping tablet replica
I20260709 12:18:51.165509  3922 raft_consensus.cc:2243] T ce427f23372c4482b0d022f844b46d32 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:51.166010  3922 raft_consensus.cc:2272] T ce427f23372c4482b0d022f844b46d32 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:51.168162  3922 tablet_replica.cc:333] T dbb55848f9c040ac9db9b7849e2a0d8a P ce8113a88cac4c138552565af6c645ca: stopping tablet replica
I20260709 12:18:51.168675  3922 raft_consensus.cc:2243] T dbb55848f9c040ac9db9b7849e2a0d8a P ce8113a88cac4c138552565af6c645ca [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:51.169122  3922 raft_consensus.cc:2272] T dbb55848f9c040ac9db9b7849e2a0d8a P ce8113a88cac4c138552565af6c645ca [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:51.171365  3922 tablet_replica.cc:333] T 62f91e00d01e497d9eda72bf862ce090 P ce8113a88cac4c138552565af6c645ca: stopping tablet replica
I20260709 12:18:51.171859  3922 raft_consensus.cc:2243] T 62f91e00d01e497d9eda72bf862ce090 P ce8113a88cac4c138552565af6c645ca [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:18:51.172703  3922 raft_consensus.cc:2272] T 62f91e00d01e497d9eda72bf862ce090 P ce8113a88cac4c138552565af6c645ca [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:51.174769  3922 tablet_replica.cc:333] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P ce8113a88cac4c138552565af6c645ca: stopping tablet replica
I20260709 12:18:51.175315  3922 raft_consensus.cc:2243] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P ce8113a88cac4c138552565af6c645ca [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:18:51.176106  3922 raft_consensus.cc:2272] T 7063d3a4c2fb4a2eb8cd6edcae5eb2ac P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:51.178303  3922 tablet_replica.cc:333] T 554db18677e043199032d1d23ff3ac7d P ce8113a88cac4c138552565af6c645ca: stopping tablet replica
I20260709 12:18:51.178844  3922 raft_consensus.cc:2243] T 554db18677e043199032d1d23ff3ac7d P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:51.179333  3922 raft_consensus.cc:2272] T 554db18677e043199032d1d23ff3ac7d P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:51.181484  3922 tablet_replica.cc:333] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca: stopping tablet replica
I20260709 12:18:51.181984  3922 raft_consensus.cc:2243] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:18:51.182756  3922 raft_consensus.cc:2272] T 4c50e97dfcc74bceb3b7d7db53a47278 P ce8113a88cac4c138552565af6c645ca [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:51.185020  3922 tablet_replica.cc:333] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca: stopping tablet replica
I20260709 12:18:51.185555  3922 raft_consensus.cc:2243] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:51.186025  3922 raft_consensus.cc:2272] T 6725f36431fc4b0fa0f740b0d8e8f7d9 P ce8113a88cac4c138552565af6c645ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:51.246963  3922 tablet_server.cc:196] TabletServer@127.3.212.131:0 shutdown complete.
I20260709 12:18:51.285435  3922 master.cc:562] Master@127.3.212.190:42735 shutting down...
I20260709 12:18:51.310240  3922 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c9919d343bce47aea8d50591a147abca [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:18:51.310796  3922 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c9919d343bce47aea8d50591a147abca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:51.311090  3922 tablet_replica.cc:333] T 00000000000000000000000000000000 P c9919d343bce47aea8d50591a147abca: stopping tablet replica
I20260709 12:18:51.351245  3922 master.cc:584] Master@127.3.212.190:42735 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (27769 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 12:18:51.407960  3922 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.212.190:43871
I20260709 12:18:51.409202  3922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:51.415144 16695 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:51.415282 16694 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:51.416399 16697 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:51.416440  3922 server_base.cc:1061] running on GCE node
I20260709 12:18:51.420982  3922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:51.421202  3922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:51.421355  3922 hybrid_clock.cc:648] HybridClock initialized: now 1783599531421337 us; error 0 us; skew 500 ppm
I20260709 12:18:51.421926  3922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:51.424564  3922 webserver.cc:533] Webserver started at http://127.3.212.190:43655/ using document root <none> and password file <none>
I20260709 12:18:51.425037  3922 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:51.425204  3922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:51.425503  3922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:51.426723  3922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599103767690-3922-0/minicluster-data/master-0-root/instance:
uuid: "324613a4e3ff41f29c52539c92ead285"
format_stamp: "Formatted at 2026-07-09 12:18:51 on dist-test-slave-442x"
I20260709 12:18:51.431311  3922 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 12:18:51.435171 16702 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:51.436005  3922 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:18:51.436322  3922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599103767690-3922-0/minicluster-data/master-0-root
uuid: "324613a4e3ff41f29c52539c92ead285"
format_stamp: "Formatted at 2026-07-09 12:18:51 on dist-test-slave-442x"
I20260709 12:18:51.436609  3922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599103767690-3922-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599103767690-3922-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599103767690-3922-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:51.457329  3922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:51.459085  3922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:51.500403  3922 rpc_server.cc:307] RPC server started. Bound to: 127.3.212.190:43871
I20260709 12:18:51.500545 16753 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.212.190:43871 every 8 connection(s)
I20260709 12:18:51.504492 16754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:51.516758 16754 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 324613a4e3ff41f29c52539c92ead285: Bootstrap starting.
I20260709 12:18:51.522018 16754 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 324613a4e3ff41f29c52539c92ead285: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:51.527263 16754 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 324613a4e3ff41f29c52539c92ead285: No bootstrap required, opened a new log
I20260709 12:18:51.529613 16754 raft_consensus.cc:359] T 00000000000000000000000000000000 P 324613a4e3ff41f29c52539c92ead285 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "324613a4e3ff41f29c52539c92ead285" member_type: VOTER }
I20260709 12:18:51.530009 16754 raft_consensus.cc:385] T 00000000000000000000000000000000 P 324613a4e3ff41f29c52539c92ead285 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:51.530251 16754 raft_consensus.cc:740] T 00000000000000000000000000000000 P 324613a4e3ff41f29c52539c92ead285 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 324613a4e3ff41f29c52539c92ead285, State: Initialized, Role: FOLLOWER
I20260709 12:18:51.530867 16754 consensus_queue.cc:260] T 00000000000000000000000000000000 P 324613a4e3ff41f29c52539c92ead285 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "324613a4e3ff41f29c52539c92ead285" member_type: VOTER }
I20260709 12:18:51.531347 16754 raft_consensus.cc:399] T 00000000000000000000000000000000 P 324613a4e3ff41f29c52539c92ead285 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:18:51.531558 16754 raft_consensus.cc:493] T 00000000000000000000000000000000 P 324613a4e3ff41f29c52539c92ead285 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:18:51.531800 16754 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 324613a4e3ff41f29c52539c92ead285 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:51.536810 16754 raft_consensus.cc:515] T 00000000000000000000000000000000 P 324613a4e3ff41f29c52539c92ead285 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "324613a4e3ff41f29c52539c92ead285" member_type: VOTER }
I20260709 12:18:51.537357 16754 leader_election.cc:304] T 00000000000000000000000000000000 P 324613a4e3ff41f29c52539c92ead285 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 324613a4e3ff41f29c52539c92ead285; no voters: 
I20260709 12:18:51.538625 16754 leader_election.cc:290] T 00000000000000000000000000000000 P 324613a4e3ff41f29c52539c92ead285 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:18:51.538981 16757 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 324613a4e3ff41f29c52539c92ead285 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:51.540434 16757 raft_consensus.cc:697] T 00000000000000000000000000000000 P 324613a4e3ff41f29c52539c92ead285 [term 1 LEADER]: Becoming Leader. State: Replica: 324613a4e3ff41f29c52539c92ead285, State: Running, Role: LEADER
I20260709 12:18:51.541095 16757 consensus_queue.cc:237] T 00000000000000000000000000000000 P 324613a4e3ff41f29c52539c92ead285 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "324613a4e3ff41f29c52539c92ead285" member_type: VOTER }
I20260709 12:18:51.541685 16754 sys_catalog.cc:565] T 00000000000000000000000000000000 P 324613a4e3ff41f29c52539c92ead285 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:18:51.545606 16758 sys_catalog.cc:455] T 00000000000000000000000000000000 P 324613a4e3ff41f29c52539c92ead285 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "324613a4e3ff41f29c52539c92ead285" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "324613a4e3ff41f29c52539c92ead285" member_type: VOTER } }
I20260709 12:18:51.546695 16759 sys_catalog.cc:455] T 00000000000000000000000000000000 P 324613a4e3ff41f29c52539c92ead285 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 324613a4e3ff41f29c52539c92ead285. Latest consensus state: current_term: 1 leader_uuid: "324613a4e3ff41f29c52539c92ead285" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "324613a4e3ff41f29c52539c92ead285" member_type: VOTER } }
I20260709 12:18:51.547366 16758 sys_catalog.cc:458] T 00000000000000000000000000000000 P 324613a4e3ff41f29c52539c92ead285 [sys.catalog]: This master's current role is: LEADER
I20260709 12:18:51.547420 16759 sys_catalog.cc:458] T 00000000000000000000000000000000 P 324613a4e3ff41f29c52539c92ead285 [sys.catalog]: This master's current role is: LEADER
I20260709 12:18:51.549592 16764 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:18:51.557328 16764 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:18:51.558465  3922 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:18:51.567278 16764 catalog_manager.cc:1383] Generated new cluster ID: d6407a09ac3c4573aef72950d8282a64
I20260709 12:18:51.567616 16764 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:18:51.595111 16764 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:18:51.596498 16764 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:18:51.612040 16764 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 324613a4e3ff41f29c52539c92ead285: Generated new TSK 0
I20260709 12:18:51.612682 16764 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:18:51.626407  3922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:51.633010 16775 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:51.633848 16776 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:51.636379 16778 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:51.642851  3922 server_base.cc:1061] running on GCE node
I20260709 12:18:51.646090  3922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:51.646406  3922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:51.646528  3922 hybrid_clock.cc:648] HybridClock initialized: now 1783599531646516 us; error 0 us; skew 500 ppm
I20260709 12:18:51.647053  3922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:51.649428  3922 webserver.cc:533] Webserver started at http://127.3.212.129:33583/ using document root <none> and password file <none>
I20260709 12:18:51.649924  3922 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:51.650094  3922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:51.650354  3922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:51.651418  3922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599103767690-3922-0/minicluster-data/ts-0-root/instance:
uuid: "5b0ce9a34e224f65aee2d205dd874ba2"
format_stamp: "Formatted at 2026-07-09 12:18:51 on dist-test-slave-442x"
I20260709 12:18:51.655994  3922 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:18:51.659654 16783 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:51.660512  3922 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:18:51.660877  3922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599103767690-3922-0/minicluster-data/ts-0-root
uuid: "5b0ce9a34e224f65aee2d205dd874ba2"
format_stamp: "Formatted at 2026-07-09 12:18:51 on dist-test-slave-442x"
I20260709 12:18:51.661226  3922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599103767690-3922-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599103767690-3922-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599103767690-3922-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:51.678388  3922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:51.679594  3922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:51.681063  3922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:18:51.683573  3922 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:18:51.683808  3922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:51.684051  3922 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:18:51.684218  3922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:51.726459  3922 rpc_server.cc:307] RPC server started. Bound to: 127.3.212.129:45979
I20260709 12:18:51.726558 16845 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.212.129:45979 every 8 connection(s)
I20260709 12:18:51.731490  3922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:51.739720 16850 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:51.741515 16851 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:51.744930  3922 server_base.cc:1061] running on GCE node
W20260709 12:18:51.745276 16853 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:51.746433  3922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:51.746678  3922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:51.746897  3922 hybrid_clock.cc:648] HybridClock initialized: now 1783599531746875 us; error 0 us; skew 500 ppm
I20260709 12:18:51.747450  3922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:51.750447  3922 webserver.cc:533] Webserver started at http://127.3.212.130:41663/ using document root <none> and password file <none>
I20260709 12:18:51.750690 16846 heartbeater.cc:344] Connected to a master server at 127.3.212.190:43871
I20260709 12:18:51.750968  3922 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:51.751173 16846 heartbeater.cc:461] Registering TS with master...
I20260709 12:18:51.751267  3922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:51.751724  3922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:51.752161 16846 heartbeater.cc:507] Master 127.3.212.190:43871 requested a full tablet report, sending...
I20260709 12:18:51.752938  3922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599103767690-3922-0/minicluster-data/ts-1-root/instance:
uuid: "d641bfb9187942e9907fe05411aaac98"
format_stamp: "Formatted at 2026-07-09 12:18:51 on dist-test-slave-442x"
I20260709 12:18:51.754627 16719 ts_manager.cc:194] Registered new tserver with Master: 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979)
I20260709 12:18:51.757231 16719 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36896
I20260709 12:18:51.759413  3922 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.003s	sys 0.002s
I20260709 12:18:51.763497 16858 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:51.764289  3922 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 12:18:51.764564  3922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599103767690-3922-0/minicluster-data/ts-1-root
uuid: "d641bfb9187942e9907fe05411aaac98"
format_stamp: "Formatted at 2026-07-09 12:18:51 on dist-test-slave-442x"
I20260709 12:18:51.764895  3922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599103767690-3922-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599103767690-3922-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599103767690-3922-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:51.781744  3922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:51.782931  3922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:51.784471  3922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:18:51.786813  3922 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:18:51.787027  3922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:51.787263  3922 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:18:51.787416  3922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:51.829649  3922 rpc_server.cc:307] RPC server started. Bound to: 127.3.212.130:44221
I20260709 12:18:51.829761 16920 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.212.130:44221 every 8 connection(s)
I20260709 12:18:51.834870  3922 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:18:51.842938 16924 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:51.844858 16925 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:18:51.846081 16927 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:18:51.847326  3922 server_base.cc:1061] running on GCE node
I20260709 12:18:51.848194  3922 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:18:51.848397  3922 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:18:51.848584  3922 hybrid_clock.cc:648] HybridClock initialized: now 1783599531848569 us; error 0 us; skew 500 ppm
I20260709 12:18:51.849171  3922 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:18:51.859870  3922 webserver.cc:533] Webserver started at http://127.3.212.131:36325/ using document root <none> and password file <none>
I20260709 12:18:51.860401  3922 fs_manager.cc:362] Metadata directory not provided
I20260709 12:18:51.860652  3922 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:18:51.860993  3922 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:18:51.861416 16921 heartbeater.cc:344] Connected to a master server at 127.3.212.190:43871
I20260709 12:18:51.861857 16921 heartbeater.cc:461] Registering TS with master...
I20260709 12:18:51.862380  3922 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599103767690-3922-0/minicluster-data/ts-2-root/instance:
uuid: "631194f763324d39a224b5728199751f"
format_stamp: "Formatted at 2026-07-09 12:18:51 on dist-test-slave-442x"
I20260709 12:18:51.862659 16921 heartbeater.cc:507] Master 127.3.212.190:43871 requested a full tablet report, sending...
I20260709 12:18:51.864940 16719 ts_manager.cc:194] Registered new tserver with Master: d641bfb9187942e9907fe05411aaac98 (127.3.212.130:44221)
I20260709 12:18:51.866919 16719 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36898
I20260709 12:18:51.868319  3922 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:18:51.872408 16932 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:51.873257  3922 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260709 12:18:51.873625  3922 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599103767690-3922-0/minicluster-data/ts-2-root
uuid: "631194f763324d39a224b5728199751f"
format_stamp: "Formatted at 2026-07-09 12:18:51 on dist-test-slave-442x"
I20260709 12:18:51.873961  3922 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599103767690-3922-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599103767690-3922-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskR5zseM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599103767690-3922-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:18:51.887441  3922 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:18:51.888931  3922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:18:51.890530  3922 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:18:51.892923  3922 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:18:51.893159  3922 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:51.893425  3922 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:18:51.893585  3922 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:18:51.934955  3922 rpc_server.cc:307] RPC server started. Bound to: 127.3.212.131:32987
I20260709 12:18:51.935050 16994 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.212.131:32987 every 8 connection(s)
I20260709 12:18:51.949239 16995 heartbeater.cc:344] Connected to a master server at 127.3.212.190:43871
I20260709 12:18:51.949772 16995 heartbeater.cc:461] Registering TS with master...
I20260709 12:18:51.950548 16995 heartbeater.cc:507] Master 127.3.212.190:43871 requested a full tablet report, sending...
I20260709 12:18:51.952791 16719 ts_manager.cc:194] Registered new tserver with Master: 631194f763324d39a224b5728199751f (127.3.212.131:32987)
I20260709 12:18:51.952945  3922 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01506076s
I20260709 12:18:51.954310 16719 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36910
I20260709 12:18:51.980494 16719 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36916:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:18:51.983325 16719 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:18:52.066210 16811 tablet_service.cc:1511] Processing CreateTablet for tablet aababa64926d4ed2a9c906dbae553e1f (DEFAULT_TABLE table=test-workload [id=c4bd0d2c83c941058e31121d3d041836]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:18:52.067736 16811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aababa64926d4ed2a9c906dbae553e1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.070453 16810 tablet_service.cc:1511] Processing CreateTablet for tablet f556bc405348447bacc2d6bce606766e (DEFAULT_TABLE table=test-workload [id=c4bd0d2c83c941058e31121d3d041836]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:18:52.072054 16810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f556bc405348447bacc2d6bce606766e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.074595 16809 tablet_service.cc:1511] Processing CreateTablet for tablet 0408a37e9dc84eb8b74b3d8fc57ffef7 (DEFAULT_TABLE table=test-workload [id=c4bd0d2c83c941058e31121d3d041836]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:18:52.076427 16809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0408a37e9dc84eb8b74b3d8fc57ffef7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.078732 16886 tablet_service.cc:1511] Processing CreateTablet for tablet aababa64926d4ed2a9c906dbae553e1f (DEFAULT_TABLE table=test-workload [id=c4bd0d2c83c941058e31121d3d041836]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:18:52.074563 16808 tablet_service.cc:1511] Processing CreateTablet for tablet 847b3169447b428ba3af26a55cb0229a (DEFAULT_TABLE table=test-workload [id=c4bd0d2c83c941058e31121d3d041836]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:18:52.082086 16808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 847b3169447b428ba3af26a55cb0229a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.081722 16885 tablet_service.cc:1511] Processing CreateTablet for tablet f556bc405348447bacc2d6bce606766e (DEFAULT_TABLE table=test-workload [id=c4bd0d2c83c941058e31121d3d041836]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:18:52.083897 16880 tablet_service.cc:1511] Processing CreateTablet for tablet a6f975cf54944342ae97c0a5b2bd6d3a (DEFAULT_TABLE table=test-workload [id=c4bd0d2c83c941058e31121d3d041836]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:18:52.085947 16806 tablet_service.cc:1511] Processing CreateTablet for tablet d821b440bbe34471b1ffd70da3afe069 (DEFAULT_TABLE table=test-workload [id=c4bd0d2c83c941058e31121d3d041836]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:18:52.086619 16807 tablet_service.cc:1511] Processing CreateTablet for tablet 3b08a6f7d06940f395425d7fef9f0977 (DEFAULT_TABLE table=test-workload [id=c4bd0d2c83c941058e31121d3d041836]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:18:52.087417 16806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d821b440bbe34471b1ffd70da3afe069. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.081722 16882 tablet_service.cc:1511] Processing CreateTablet for tablet 3b08a6f7d06940f395425d7fef9f0977 (DEFAULT_TABLE table=test-workload [id=c4bd0d2c83c941058e31121d3d041836]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:18:52.084995 16884 tablet_service.cc:1511] Processing CreateTablet for tablet 0408a37e9dc84eb8b74b3d8fc57ffef7 (DEFAULT_TABLE table=test-workload [id=c4bd0d2c83c941058e31121d3d041836]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:18:52.090906 16807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b08a6f7d06940f395425d7fef9f0977. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.090687 16805 tablet_service.cc:1511] Processing CreateTablet for tablet a6f975cf54944342ae97c0a5b2bd6d3a (DEFAULT_TABLE table=test-workload [id=c4bd0d2c83c941058e31121d3d041836]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:18:52.092042 16805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6f975cf54944342ae97c0a5b2bd6d3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.080338 16886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aababa64926d4ed2a9c906dbae553e1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.080416 16883 tablet_service.cc:1511] Processing CreateTablet for tablet 847b3169447b428ba3af26a55cb0229a (DEFAULT_TABLE table=test-workload [id=c4bd0d2c83c941058e31121d3d041836]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:18:52.095111 16960 tablet_service.cc:1511] Processing CreateTablet for tablet aababa64926d4ed2a9c906dbae553e1f (DEFAULT_TABLE table=test-workload [id=c4bd0d2c83c941058e31121d3d041836]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:18:52.095531 16880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6f975cf54944342ae97c0a5b2bd6d3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.096557 16960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aababa64926d4ed2a9c906dbae553e1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.098059 16885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f556bc405348447bacc2d6bce606766e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.100128 16959 tablet_service.cc:1511] Processing CreateTablet for tablet f556bc405348447bacc2d6bce606766e (DEFAULT_TABLE table=test-workload [id=c4bd0d2c83c941058e31121d3d041836]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:18:52.100862 16882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b08a6f7d06940f395425d7fef9f0977. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.101886 16883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 847b3169447b428ba3af26a55cb0229a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.102581 16884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0408a37e9dc84eb8b74b3d8fc57ffef7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.102147 16956 tablet_service.cc:1511] Processing CreateTablet for tablet 3b08a6f7d06940f395425d7fef9f0977 (DEFAULT_TABLE table=test-workload [id=c4bd0d2c83c941058e31121d3d041836]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:18:52.103781 16956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b08a6f7d06940f395425d7fef9f0977. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.105911 16955 tablet_service.cc:1511] Processing CreateTablet for tablet d821b440bbe34471b1ffd70da3afe069 (DEFAULT_TABLE table=test-workload [id=c4bd0d2c83c941058e31121d3d041836]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:18:52.107517 16955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d821b440bbe34471b1ffd70da3afe069. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.109723 16958 tablet_service.cc:1511] Processing CreateTablet for tablet 0408a37e9dc84eb8b74b3d8fc57ffef7 (DEFAULT_TABLE table=test-workload [id=c4bd0d2c83c941058e31121d3d041836]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:18:52.111356 16958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0408a37e9dc84eb8b74b3d8fc57ffef7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.113694 16804 tablet_service.cc:1511] Processing CreateTablet for tablet 9e3e70fc532a4fb48fcd5d6696714964 (DEFAULT_TABLE table=test-workload [id=c4bd0d2c83c941058e31121d3d041836]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:18:52.115487 16804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e3e70fc532a4fb48fcd5d6696714964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.100265 16954 tablet_service.cc:1511] Processing CreateTablet for tablet a6f975cf54944342ae97c0a5b2bd6d3a (DEFAULT_TABLE table=test-workload [id=c4bd0d2c83c941058e31121d3d041836]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:18:52.118378 16881 tablet_service.cc:1511] Processing CreateTablet for tablet d821b440bbe34471b1ffd70da3afe069 (DEFAULT_TABLE table=test-workload [id=c4bd0d2c83c941058e31121d3d041836]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:18:52.098207 16957 tablet_service.cc:1511] Processing CreateTablet for tablet 847b3169447b428ba3af26a55cb0229a (DEFAULT_TABLE table=test-workload [id=c4bd0d2c83c941058e31121d3d041836]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:18:52.120002 16881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d821b440bbe34471b1ffd70da3afe069. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.120107 16957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 847b3169447b428ba3af26a55cb0229a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.122131 16954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6f975cf54944342ae97c0a5b2bd6d3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.126124 16959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f556bc405348447bacc2d6bce606766e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.137444 16879 tablet_service.cc:1511] Processing CreateTablet for tablet 9e3e70fc532a4fb48fcd5d6696714964 (DEFAULT_TABLE table=test-workload [id=c4bd0d2c83c941058e31121d3d041836]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:18:52.145457 16879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e3e70fc532a4fb48fcd5d6696714964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.153564 16953 tablet_service.cc:1511] Processing CreateTablet for tablet 9e3e70fc532a4fb48fcd5d6696714964 (DEFAULT_TABLE table=test-workload [id=c4bd0d2c83c941058e31121d3d041836]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:18:52.155197 16953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e3e70fc532a4fb48fcd5d6696714964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.163079 17010 tablet_bootstrap.cc:492] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 5b0ce9a34e224f65aee2d205dd874ba2: Bootstrap starting.
I20260709 12:18:52.164773 16803 tablet_service.cc:1511] Processing CreateTablet for tablet 18210c7ef7cc4e2f8d96c1a686d66464 (DEFAULT_TABLE table=test-workload [id=c4bd0d2c83c941058e31121d3d041836]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:18:52.182364 16803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18210c7ef7cc4e2f8d96c1a686d66464. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.188035 16878 tablet_service.cc:1511] Processing CreateTablet for tablet 18210c7ef7cc4e2f8d96c1a686d66464 (DEFAULT_TABLE table=test-workload [id=c4bd0d2c83c941058e31121d3d041836]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:18:52.189750 16878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18210c7ef7cc4e2f8d96c1a686d66464. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.202661 16952 tablet_service.cc:1511] Processing CreateTablet for tablet 18210c7ef7cc4e2f8d96c1a686d66464 (DEFAULT_TABLE table=test-workload [id=c4bd0d2c83c941058e31121d3d041836]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:18:52.204126 16952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18210c7ef7cc4e2f8d96c1a686d66464. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:52.229069 17010 tablet_bootstrap.cc:654] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 5b0ce9a34e224f65aee2d205dd874ba2: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:52.287722 17010 tablet_bootstrap.cc:492] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 5b0ce9a34e224f65aee2d205dd874ba2: No bootstrap required, opened a new log
I20260709 12:18:52.288318 17010 ts_tablet_manager.cc:1403] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 5b0ce9a34e224f65aee2d205dd874ba2: Time spent bootstrapping tablet: real 0.126s	user 0.011s	sys 0.004s
I20260709 12:18:52.289853 17011 tablet_bootstrap.cc:492] T 847b3169447b428ba3af26a55cb0229a P 631194f763324d39a224b5728199751f: Bootstrap starting.
I20260709 12:18:52.291662 17010 raft_consensus.cc:359] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.297407 17012 tablet_bootstrap.cc:492] T d821b440bbe34471b1ffd70da3afe069 P d641bfb9187942e9907fe05411aaac98: Bootstrap starting.
I20260709 12:18:52.312616 17010 raft_consensus.cc:385] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:52.313030 17010 raft_consensus.cc:740] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b0ce9a34e224f65aee2d205dd874ba2, State: Initialized, Role: FOLLOWER
I20260709 12:18:52.297240 17011 tablet_bootstrap.cc:654] T 847b3169447b428ba3af26a55cb0229a P 631194f763324d39a224b5728199751f: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:52.313740 17010 consensus_queue.cc:260] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 5b0ce9a34e224f65aee2d205dd874ba2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.315881 16846 heartbeater.cc:499] Master 127.3.212.190:43871 was elected leader, sending a full tablet report...
I20260709 12:18:52.316406 17010 ts_tablet_manager.cc:1434] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 5b0ce9a34e224f65aee2d205dd874ba2: Time spent starting tablet: real 0.028s	user 0.003s	sys 0.004s
I20260709 12:18:52.317555 17010 tablet_bootstrap.cc:492] T d821b440bbe34471b1ffd70da3afe069 P 5b0ce9a34e224f65aee2d205dd874ba2: Bootstrap starting.
I20260709 12:18:52.321573 17012 tablet_bootstrap.cc:654] T d821b440bbe34471b1ffd70da3afe069 P d641bfb9187942e9907fe05411aaac98: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:52.323622 17010 tablet_bootstrap.cc:654] T d821b440bbe34471b1ffd70da3afe069 P 5b0ce9a34e224f65aee2d205dd874ba2: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:52.327031 17011 tablet_bootstrap.cc:492] T 847b3169447b428ba3af26a55cb0229a P 631194f763324d39a224b5728199751f: No bootstrap required, opened a new log
I20260709 12:18:52.327761 17011 ts_tablet_manager.cc:1403] T 847b3169447b428ba3af26a55cb0229a P 631194f763324d39a224b5728199751f: Time spent bootstrapping tablet: real 0.038s	user 0.011s	sys 0.007s
I20260709 12:18:52.331310 17011 raft_consensus.cc:359] T 847b3169447b428ba3af26a55cb0229a P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.332297 17011 raft_consensus.cc:385] T 847b3169447b428ba3af26a55cb0229a P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:52.332679 17011 raft_consensus.cc:740] T 847b3169447b428ba3af26a55cb0229a P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631194f763324d39a224b5728199751f, State: Initialized, Role: FOLLOWER
I20260709 12:18:52.334282 17012 tablet_bootstrap.cc:492] T d821b440bbe34471b1ffd70da3afe069 P d641bfb9187942e9907fe05411aaac98: No bootstrap required, opened a new log
I20260709 12:18:52.333602 17011 consensus_queue.cc:260] T 847b3169447b428ba3af26a55cb0229a P 631194f763324d39a224b5728199751f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.335047 17012 ts_tablet_manager.cc:1403] T d821b440bbe34471b1ffd70da3afe069 P d641bfb9187942e9907fe05411aaac98: Time spent bootstrapping tablet: real 0.042s	user 0.002s	sys 0.019s
I20260709 12:18:52.337682 17010 tablet_bootstrap.cc:492] T d821b440bbe34471b1ffd70da3afe069 P 5b0ce9a34e224f65aee2d205dd874ba2: No bootstrap required, opened a new log
I20260709 12:18:52.338434 17010 ts_tablet_manager.cc:1403] T d821b440bbe34471b1ffd70da3afe069 P 5b0ce9a34e224f65aee2d205dd874ba2: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.011s
I20260709 12:18:52.339054 17012 raft_consensus.cc:359] T d821b440bbe34471b1ffd70da3afe069 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.339980 17012 raft_consensus.cc:385] T d821b440bbe34471b1ffd70da3afe069 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:52.340274 17012 raft_consensus.cc:740] T d821b440bbe34471b1ffd70da3afe069 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d641bfb9187942e9907fe05411aaac98, State: Initialized, Role: FOLLOWER
I20260709 12:18:52.341274 17012 consensus_queue.cc:260] T d821b440bbe34471b1ffd70da3afe069 P d641bfb9187942e9907fe05411aaac98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.342383 17010 raft_consensus.cc:359] T d821b440bbe34471b1ffd70da3afe069 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.343503 17010 raft_consensus.cc:385] T d821b440bbe34471b1ffd70da3afe069 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:52.344327 17010 raft_consensus.cc:740] T d821b440bbe34471b1ffd70da3afe069 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b0ce9a34e224f65aee2d205dd874ba2, State: Initialized, Role: FOLLOWER
I20260709 12:18:52.345650 17011 ts_tablet_manager.cc:1434] T 847b3169447b428ba3af26a55cb0229a P 631194f763324d39a224b5728199751f: Time spent starting tablet: real 0.017s	user 0.013s	sys 0.003s
I20260709 12:18:52.345263 17010 consensus_queue.cc:260] T d821b440bbe34471b1ffd70da3afe069 P 5b0ce9a34e224f65aee2d205dd874ba2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.346660 16995 heartbeater.cc:499] Master 127.3.212.190:43871 was elected leader, sending a full tablet report...
I20260709 12:18:52.346932 17011 tablet_bootstrap.cc:492] T a6f975cf54944342ae97c0a5b2bd6d3a P 631194f763324d39a224b5728199751f: Bootstrap starting.
I20260709 12:18:52.348158 17010 ts_tablet_manager.cc:1434] T d821b440bbe34471b1ffd70da3afe069 P 5b0ce9a34e224f65aee2d205dd874ba2: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:18:52.349453 17010 tablet_bootstrap.cc:492] T 18210c7ef7cc4e2f8d96c1a686d66464 P 5b0ce9a34e224f65aee2d205dd874ba2: Bootstrap starting.
I20260709 12:18:52.355110 17011 tablet_bootstrap.cc:654] T a6f975cf54944342ae97c0a5b2bd6d3a P 631194f763324d39a224b5728199751f: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:52.356662 17010 tablet_bootstrap.cc:654] T 18210c7ef7cc4e2f8d96c1a686d66464 P 5b0ce9a34e224f65aee2d205dd874ba2: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:52.360646 17012 ts_tablet_manager.cc:1434] T d821b440bbe34471b1ffd70da3afe069 P d641bfb9187942e9907fe05411aaac98: Time spent starting tablet: real 0.025s	user 0.012s	sys 0.009s
I20260709 12:18:52.361639 16921 heartbeater.cc:499] Master 127.3.212.190:43871 was elected leader, sending a full tablet report...
I20260709 12:18:52.368129 17012 tablet_bootstrap.cc:492] T 18210c7ef7cc4e2f8d96c1a686d66464 P d641bfb9187942e9907fe05411aaac98: Bootstrap starting.
I20260709 12:18:52.374558 17011 tablet_bootstrap.cc:492] T a6f975cf54944342ae97c0a5b2bd6d3a P 631194f763324d39a224b5728199751f: No bootstrap required, opened a new log
I20260709 12:18:52.375339 17011 ts_tablet_manager.cc:1403] T a6f975cf54944342ae97c0a5b2bd6d3a P 631194f763324d39a224b5728199751f: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.000s
I20260709 12:18:52.375888 17012 tablet_bootstrap.cc:654] T 18210c7ef7cc4e2f8d96c1a686d66464 P d641bfb9187942e9907fe05411aaac98: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:52.376533 17010 tablet_bootstrap.cc:492] T 18210c7ef7cc4e2f8d96c1a686d66464 P 5b0ce9a34e224f65aee2d205dd874ba2: No bootstrap required, opened a new log
I20260709 12:18:52.377171 17010 ts_tablet_manager.cc:1403] T 18210c7ef7cc4e2f8d96c1a686d66464 P 5b0ce9a34e224f65aee2d205dd874ba2: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.006s
I20260709 12:18:52.378120 17014 raft_consensus.cc:493] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.378729 17014 raft_consensus.cc:515] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.379216 17011 raft_consensus.cc:359] T a6f975cf54944342ae97c0a5b2bd6d3a P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.384301 17011 raft_consensus.cc:385] T a6f975cf54944342ae97c0a5b2bd6d3a P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:52.384678 17011 raft_consensus.cc:740] T a6f975cf54944342ae97c0a5b2bd6d3a P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631194f763324d39a224b5728199751f, State: Initialized, Role: FOLLOWER
I20260709 12:18:52.386837 17011 consensus_queue.cc:260] T a6f975cf54944342ae97c0a5b2bd6d3a P 631194f763324d39a224b5728199751f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.389689 17011 ts_tablet_manager.cc:1434] T a6f975cf54944342ae97c0a5b2bd6d3a P 631194f763324d39a224b5728199751f: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.004s
I20260709 12:18:52.390630 17014 leader_election.cc:290] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 5b0ce9a34e224f65aee2d205dd874ba2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d641bfb9187942e9907fe05411aaac98 (127.3.212.130:44221), 631194f763324d39a224b5728199751f (127.3.212.131:32987)
I20260709 12:18:52.394052 17019 raft_consensus.cc:493] T d821b440bbe34471b1ffd70da3afe069 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.394827 17019 raft_consensus.cc:515] T d821b440bbe34471b1ffd70da3afe069 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.396365 17012 tablet_bootstrap.cc:492] T 18210c7ef7cc4e2f8d96c1a686d66464 P d641bfb9187942e9907fe05411aaac98: No bootstrap required, opened a new log
I20260709 12:18:52.396996 17012 ts_tablet_manager.cc:1403] T 18210c7ef7cc4e2f8d96c1a686d66464 P d641bfb9187942e9907fe05411aaac98: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.010s
I20260709 12:18:52.396551 17010 raft_consensus.cc:359] T 18210c7ef7cc4e2f8d96c1a686d66464 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.399005 17010 raft_consensus.cc:385] T 18210c7ef7cc4e2f8d96c1a686d66464 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:52.399416 17010 raft_consensus.cc:740] T 18210c7ef7cc4e2f8d96c1a686d66464 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b0ce9a34e224f65aee2d205dd874ba2, State: Initialized, Role: FOLLOWER
I20260709 12:18:52.400249 17010 consensus_queue.cc:260] T 18210c7ef7cc4e2f8d96c1a686d66464 P 5b0ce9a34e224f65aee2d205dd874ba2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.405508 17010 ts_tablet_manager.cc:1434] T 18210c7ef7cc4e2f8d96c1a686d66464 P 5b0ce9a34e224f65aee2d205dd874ba2: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.002s
I20260709 12:18:52.400441 17012 raft_consensus.cc:359] T 18210c7ef7cc4e2f8d96c1a686d66464 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.410007 17012 raft_consensus.cc:385] T 18210c7ef7cc4e2f8d96c1a686d66464 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:52.410449 17012 raft_consensus.cc:740] T 18210c7ef7cc4e2f8d96c1a686d66464 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d641bfb9187942e9907fe05411aaac98, State: Initialized, Role: FOLLOWER
I20260709 12:18:52.405862 17019 leader_election.cc:290] T d821b440bbe34471b1ffd70da3afe069 P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979), 631194f763324d39a224b5728199751f (127.3.212.131:32987)
I20260709 12:18:52.390960 17011 tablet_bootstrap.cc:492] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 631194f763324d39a224b5728199751f: Bootstrap starting.
I20260709 12:18:52.418370 16896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0408a37e9dc84eb8b74b3d8fc57ffef7" candidate_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d641bfb9187942e9907fe05411aaac98" is_pre_election: true
I20260709 12:18:52.411324 17012 consensus_queue.cc:260] T 18210c7ef7cc4e2f8d96c1a686d66464 P d641bfb9187942e9907fe05411aaac98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
W20260709 12:18:52.420364 16784 leader_election.cc:343] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 5b0ce9a34e224f65aee2d205dd874ba2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d641bfb9187942e9907fe05411aaac98 (127.3.212.130:44221): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:52.412832 17010 tablet_bootstrap.cc:492] T f556bc405348447bacc2d6bce606766e P 5b0ce9a34e224f65aee2d205dd874ba2: Bootstrap starting.
I20260709 12:18:52.421314 17012 ts_tablet_manager.cc:1434] T 18210c7ef7cc4e2f8d96c1a686d66464 P d641bfb9187942e9907fe05411aaac98: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.001s
I20260709 12:18:52.422608 17011 tablet_bootstrap.cc:654] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 631194f763324d39a224b5728199751f: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:52.427593 17012 tablet_bootstrap.cc:492] T aababa64926d4ed2a9c906dbae553e1f P d641bfb9187942e9907fe05411aaac98: Bootstrap starting.
I20260709 12:18:52.436372 17012 tablet_bootstrap.cc:654] T aababa64926d4ed2a9c906dbae553e1f P d641bfb9187942e9907fe05411aaac98: Neither blocks nor log segments found. Creating new log.
W20260709 12:18:52.439311 16996 tablet.cc:2406] T 847b3169447b428ba3af26a55cb0229a P 631194f763324d39a224b5728199751f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:18:52.440593 16970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d821b440bbe34471b1ffd70da3afe069" candidate_uuid: "d641bfb9187942e9907fe05411aaac98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631194f763324d39a224b5728199751f" is_pre_election: true
W20260709 12:18:52.442441 16862 leader_election.cc:343] T d821b440bbe34471b1ffd70da3afe069 P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 631194f763324d39a224b5728199751f (127.3.212.131:32987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:52.442338 16821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d821b440bbe34471b1ffd70da3afe069" candidate_uuid: "d641bfb9187942e9907fe05411aaac98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" is_pre_election: true
I20260709 12:18:52.443919 16970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0408a37e9dc84eb8b74b3d8fc57ffef7" candidate_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631194f763324d39a224b5728199751f" is_pre_election: true
I20260709 12:18:52.436447 17010 tablet_bootstrap.cc:654] T f556bc405348447bacc2d6bce606766e P 5b0ce9a34e224f65aee2d205dd874ba2: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:52.444350 16821 raft_consensus.cc:2468] T d821b440bbe34471b1ffd70da3afe069 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d641bfb9187942e9907fe05411aaac98 in term 0.
W20260709 12:18:52.445972 16787 leader_election.cc:343] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 5b0ce9a34e224f65aee2d205dd874ba2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 631194f763324d39a224b5728199751f (127.3.212.131:32987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:52.446489 16787 leader_election.cc:304] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 5b0ce9a34e224f65aee2d205dd874ba2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b0ce9a34e224f65aee2d205dd874ba2; no voters: 631194f763324d39a224b5728199751f, d641bfb9187942e9907fe05411aaac98
I20260709 12:18:52.447372 17014 raft_consensus.cc:2749] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:52.448349 16859 leader_election.cc:304] T d821b440bbe34471b1ffd70da3afe069 P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b0ce9a34e224f65aee2d205dd874ba2, d641bfb9187942e9907fe05411aaac98; no voters: 631194f763324d39a224b5728199751f
I20260709 12:18:52.449577 17012 tablet_bootstrap.cc:492] T aababa64926d4ed2a9c906dbae553e1f P d641bfb9187942e9907fe05411aaac98: No bootstrap required, opened a new log
I20260709 12:18:52.449875 17019 raft_consensus.cc:2804] T d821b440bbe34471b1ffd70da3afe069 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:52.450143 17012 ts_tablet_manager.cc:1403] T aababa64926d4ed2a9c906dbae553e1f P d641bfb9187942e9907fe05411aaac98: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.006s
I20260709 12:18:52.450378 17019 raft_consensus.cc:493] T d821b440bbe34471b1ffd70da3afe069 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:52.450824 17019 raft_consensus.cc:3060] T d821b440bbe34471b1ffd70da3afe069 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:52.452826 17012 raft_consensus.cc:359] T aababa64926d4ed2a9c906dbae553e1f P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.453488 17012 raft_consensus.cc:385] T aababa64926d4ed2a9c906dbae553e1f P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:52.453729 17012 raft_consensus.cc:740] T aababa64926d4ed2a9c906dbae553e1f P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d641bfb9187942e9907fe05411aaac98, State: Initialized, Role: FOLLOWER
I20260709 12:18:52.454404 17012 consensus_queue.cc:260] T aababa64926d4ed2a9c906dbae553e1f P d641bfb9187942e9907fe05411aaac98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.459327 17011 tablet_bootstrap.cc:492] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 631194f763324d39a224b5728199751f: No bootstrap required, opened a new log
I20260709 12:18:52.459662 17019 raft_consensus.cc:515] T d821b440bbe34471b1ffd70da3afe069 P d641bfb9187942e9907fe05411aaac98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.460157 17011 ts_tablet_manager.cc:1403] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 631194f763324d39a224b5728199751f: Time spent bootstrapping tablet: real 0.069s	user 0.021s	sys 0.000s
I20260709 12:18:52.460976 17010 tablet_bootstrap.cc:492] T f556bc405348447bacc2d6bce606766e P 5b0ce9a34e224f65aee2d205dd874ba2: No bootstrap required, opened a new log
I20260709 12:18:52.461651 17010 ts_tablet_manager.cc:1403] T f556bc405348447bacc2d6bce606766e P 5b0ce9a34e224f65aee2d205dd874ba2: Time spent bootstrapping tablet: real 0.049s	user 0.013s	sys 0.007s
I20260709 12:18:52.462931 16821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d821b440bbe34471b1ffd70da3afe069" candidate_uuid: "d641bfb9187942e9907fe05411aaac98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b0ce9a34e224f65aee2d205dd874ba2"
I20260709 12:18:52.463562 16821 raft_consensus.cc:3060] T d821b440bbe34471b1ffd70da3afe069 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:52.463572 17011 raft_consensus.cc:359] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.464362 17011 raft_consensus.cc:385] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:52.464664 17011 raft_consensus.cc:740] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631194f763324d39a224b5728199751f, State: Initialized, Role: FOLLOWER
I20260709 12:18:52.464527 17010 raft_consensus.cc:359] T f556bc405348447bacc2d6bce606766e P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.465417 17010 raft_consensus.cc:385] T f556bc405348447bacc2d6bce606766e P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:52.465700 17011 consensus_queue.cc:260] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 631194f763324d39a224b5728199751f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.465713 17010 raft_consensus.cc:740] T f556bc405348447bacc2d6bce606766e P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b0ce9a34e224f65aee2d205dd874ba2, State: Initialized, Role: FOLLOWER
I20260709 12:18:52.466861 17012 ts_tablet_manager.cc:1434] T aababa64926d4ed2a9c906dbae553e1f P d641bfb9187942e9907fe05411aaac98: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.006s
I20260709 12:18:52.467933 17010 consensus_queue.cc:260] T f556bc405348447bacc2d6bce606766e P 5b0ce9a34e224f65aee2d205dd874ba2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.469813 17012 tablet_bootstrap.cc:492] T 3b08a6f7d06940f395425d7fef9f0977 P d641bfb9187942e9907fe05411aaac98: Bootstrap starting.
I20260709 12:18:52.473186 16821 raft_consensus.cc:2468] T d821b440bbe34471b1ffd70da3afe069 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d641bfb9187942e9907fe05411aaac98 in term 1.
I20260709 12:18:52.476089 16970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d821b440bbe34471b1ffd70da3afe069" candidate_uuid: "d641bfb9187942e9907fe05411aaac98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631194f763324d39a224b5728199751f"
I20260709 12:18:52.476696 16859 leader_election.cc:304] T d821b440bbe34471b1ffd70da3afe069 P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b0ce9a34e224f65aee2d205dd874ba2, d641bfb9187942e9907fe05411aaac98; no voters: 
I20260709 12:18:52.473526 17010 ts_tablet_manager.cc:1434] T f556bc405348447bacc2d6bce606766e P 5b0ce9a34e224f65aee2d205dd874ba2: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
W20260709 12:18:52.477584 16862 leader_election.cc:343] T d821b440bbe34471b1ffd70da3afe069 P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 631194f763324d39a224b5728199751f (127.3.212.131:32987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:52.477731 17031 raft_consensus.cc:2804] T d821b440bbe34471b1ffd70da3afe069 P d641bfb9187942e9907fe05411aaac98 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:52.478549 17010 tablet_bootstrap.cc:492] T a6f975cf54944342ae97c0a5b2bd6d3a P 5b0ce9a34e224f65aee2d205dd874ba2: Bootstrap starting.
I20260709 12:18:52.470060 17011 ts_tablet_manager.cc:1434] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 631194f763324d39a224b5728199751f: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:18:52.480165 17012 tablet_bootstrap.cc:654] T 3b08a6f7d06940f395425d7fef9f0977 P d641bfb9187942e9907fe05411aaac98: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:52.480979 17011 tablet_bootstrap.cc:492] T f556bc405348447bacc2d6bce606766e P 631194f763324d39a224b5728199751f: Bootstrap starting.
I20260709 12:18:52.483377 17031 raft_consensus.cc:697] T d821b440bbe34471b1ffd70da3afe069 P d641bfb9187942e9907fe05411aaac98 [term 1 LEADER]: Becoming Leader. State: Replica: d641bfb9187942e9907fe05411aaac98, State: Running, Role: LEADER
I20260709 12:18:52.484372 17031 consensus_queue.cc:237] T d821b440bbe34471b1ffd70da3afe069 P d641bfb9187942e9907fe05411aaac98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.475207 17019 leader_election.cc:290] T d821b440bbe34471b1ffd70da3afe069 P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 1 election: Requested vote from peers 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979), 631194f763324d39a224b5728199751f (127.3.212.131:32987)
I20260709 12:18:52.496591 17011 tablet_bootstrap.cc:654] T f556bc405348447bacc2d6bce606766e P 631194f763324d39a224b5728199751f: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:52.493285 17010 tablet_bootstrap.cc:654] T a6f975cf54944342ae97c0a5b2bd6d3a P 5b0ce9a34e224f65aee2d205dd874ba2: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:52.503095 17012 tablet_bootstrap.cc:492] T 3b08a6f7d06940f395425d7fef9f0977 P d641bfb9187942e9907fe05411aaac98: No bootstrap required, opened a new log
I20260709 12:18:52.503729 17012 ts_tablet_manager.cc:1403] T 3b08a6f7d06940f395425d7fef9f0977 P d641bfb9187942e9907fe05411aaac98: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.019s
I20260709 12:18:52.503332 16717 catalog_manager.cc:5697] T d821b440bbe34471b1ffd70da3afe069 P d641bfb9187942e9907fe05411aaac98 reported cstate change: term changed from 0 to 1, leader changed from <none> to d641bfb9187942e9907fe05411aaac98 (127.3.212.130). New cstate: current_term: 1 leader_uuid: "d641bfb9187942e9907fe05411aaac98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:52.505511 17011 tablet_bootstrap.cc:492] T f556bc405348447bacc2d6bce606766e P 631194f763324d39a224b5728199751f: No bootstrap required, opened a new log
I20260709 12:18:52.506067 17011 ts_tablet_manager.cc:1403] T f556bc405348447bacc2d6bce606766e P 631194f763324d39a224b5728199751f: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.007s
I20260709 12:18:52.507004 17012 raft_consensus.cc:359] T 3b08a6f7d06940f395425d7fef9f0977 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.507855 17012 raft_consensus.cc:385] T 3b08a6f7d06940f395425d7fef9f0977 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:52.508170 17012 raft_consensus.cc:740] T 3b08a6f7d06940f395425d7fef9f0977 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d641bfb9187942e9907fe05411aaac98, State: Initialized, Role: FOLLOWER
I20260709 12:18:52.508991 17012 consensus_queue.cc:260] T 3b08a6f7d06940f395425d7fef9f0977 P d641bfb9187942e9907fe05411aaac98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.509433 17011 raft_consensus.cc:359] T f556bc405348447bacc2d6bce606766e P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.510522 17011 raft_consensus.cc:385] T f556bc405348447bacc2d6bce606766e P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:52.510862 17011 raft_consensus.cc:740] T f556bc405348447bacc2d6bce606766e P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631194f763324d39a224b5728199751f, State: Initialized, Role: FOLLOWER
I20260709 12:18:52.511394 17012 ts_tablet_manager.cc:1434] T 3b08a6f7d06940f395425d7fef9f0977 P d641bfb9187942e9907fe05411aaac98: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:18:52.511883 17011 consensus_queue.cc:260] T f556bc405348447bacc2d6bce606766e P 631194f763324d39a224b5728199751f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.512537 17012 tablet_bootstrap.cc:492] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P d641bfb9187942e9907fe05411aaac98: Bootstrap starting.
I20260709 12:18:52.519959 17012 tablet_bootstrap.cc:654] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P d641bfb9187942e9907fe05411aaac98: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:52.521795 17018 raft_consensus.cc:493] T a6f975cf54944342ae97c0a5b2bd6d3a P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.522482 17018 raft_consensus.cc:515] T a6f975cf54944342ae97c0a5b2bd6d3a P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.528199 17018 leader_election.cc:290] T a6f975cf54944342ae97c0a5b2bd6d3a P 631194f763324d39a224b5728199751f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979), d641bfb9187942e9907fe05411aaac98 (127.3.212.130:44221)
I20260709 12:18:52.532766 17010 tablet_bootstrap.cc:492] T a6f975cf54944342ae97c0a5b2bd6d3a P 5b0ce9a34e224f65aee2d205dd874ba2: No bootstrap required, opened a new log
I20260709 12:18:52.533505 17011 ts_tablet_manager.cc:1434] T f556bc405348447bacc2d6bce606766e P 631194f763324d39a224b5728199751f: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 12:18:52.533545 17010 ts_tablet_manager.cc:1403] T a6f975cf54944342ae97c0a5b2bd6d3a P 5b0ce9a34e224f65aee2d205dd874ba2: Time spent bootstrapping tablet: real 0.055s	user 0.023s	sys 0.012s
I20260709 12:18:52.538921 17010 raft_consensus.cc:359] T a6f975cf54944342ae97c0a5b2bd6d3a P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.542974 17010 raft_consensus.cc:385] T a6f975cf54944342ae97c0a5b2bd6d3a P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:52.543430 17010 raft_consensus.cc:740] T a6f975cf54944342ae97c0a5b2bd6d3a P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b0ce9a34e224f65aee2d205dd874ba2, State: Initialized, Role: FOLLOWER
I20260709 12:18:52.543762 17011 tablet_bootstrap.cc:492] T d821b440bbe34471b1ffd70da3afe069 P 631194f763324d39a224b5728199751f: Bootstrap starting.
I20260709 12:18:52.545924 16896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6f975cf54944342ae97c0a5b2bd6d3a" candidate_uuid: "631194f763324d39a224b5728199751f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d641bfb9187942e9907fe05411aaac98" is_pre_election: true
I20260709 12:18:52.545650 17010 consensus_queue.cc:260] T a6f975cf54944342ae97c0a5b2bd6d3a P 5b0ce9a34e224f65aee2d205dd874ba2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.547148 17012 tablet_bootstrap.cc:492] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P d641bfb9187942e9907fe05411aaac98: No bootstrap required, opened a new log
I20260709 12:18:52.547823 17012 ts_tablet_manager.cc:1403] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P d641bfb9187942e9907fe05411aaac98: Time spent bootstrapping tablet: real 0.036s	user 0.021s	sys 0.013s
I20260709 12:18:52.548173 17010 ts_tablet_manager.cc:1434] T a6f975cf54944342ae97c0a5b2bd6d3a P 5b0ce9a34e224f65aee2d205dd874ba2: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
W20260709 12:18:52.552729 16767 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:18:52.551363 17012 raft_consensus.cc:359] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.553602 16821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6f975cf54944342ae97c0a5b2bd6d3a" candidate_uuid: "631194f763324d39a224b5728199751f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" is_pre_election: true
W20260709 12:18:52.554090 16933 leader_election.cc:343] T a6f975cf54944342ae97c0a5b2bd6d3a P 631194f763324d39a224b5728199751f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d641bfb9187942e9907fe05411aaac98 (127.3.212.130:44221): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:52.554396 16821 raft_consensus.cc:2468] T a6f975cf54944342ae97c0a5b2bd6d3a P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631194f763324d39a224b5728199751f in term 0.
I20260709 12:18:52.554764 17011 tablet_bootstrap.cc:654] T d821b440bbe34471b1ffd70da3afe069 P 631194f763324d39a224b5728199751f: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:52.553481 17012 raft_consensus.cc:385] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:52.555239 17012 raft_consensus.cc:740] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d641bfb9187942e9907fe05411aaac98, State: Initialized, Role: FOLLOWER
I20260709 12:18:52.555889 16933 leader_election.cc:304] T a6f975cf54944342ae97c0a5b2bd6d3a P 631194f763324d39a224b5728199751f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b0ce9a34e224f65aee2d205dd874ba2, 631194f763324d39a224b5728199751f; no voters: d641bfb9187942e9907fe05411aaac98
I20260709 12:18:52.556274 17012 consensus_queue.cc:260] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P d641bfb9187942e9907fe05411aaac98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.557220 17018 raft_consensus.cc:2804] T a6f975cf54944342ae97c0a5b2bd6d3a P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:52.557672 17018 raft_consensus.cc:493] T a6f975cf54944342ae97c0a5b2bd6d3a P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:52.558004 17018 raft_consensus.cc:3060] T a6f975cf54944342ae97c0a5b2bd6d3a P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:52.554163 17031 raft_consensus.cc:493] T 3b08a6f7d06940f395425d7fef9f0977 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.558888 17031 raft_consensus.cc:515] T 3b08a6f7d06940f395425d7fef9f0977 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.564296 17031 leader_election.cc:290] T 3b08a6f7d06940f395425d7fef9f0977 P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979), 631194f763324d39a224b5728199751f (127.3.212.131:32987)
I20260709 12:18:52.566442 16821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b08a6f7d06940f395425d7fef9f0977" candidate_uuid: "d641bfb9187942e9907fe05411aaac98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" is_pre_election: true
I20260709 12:18:52.567031 16970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b08a6f7d06940f395425d7fef9f0977" candidate_uuid: "d641bfb9187942e9907fe05411aaac98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631194f763324d39a224b5728199751f" is_pre_election: true
W20260709 12:18:52.568436 16859 leader_election.cc:343] T 3b08a6f7d06940f395425d7fef9f0977 P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:18:52.568918 16862 leader_election.cc:343] T 3b08a6f7d06940f395425d7fef9f0977 P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 631194f763324d39a224b5728199751f (127.3.212.131:32987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:52.569368 16862 leader_election.cc:304] T 3b08a6f7d06940f395425d7fef9f0977 P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d641bfb9187942e9907fe05411aaac98; no voters: 5b0ce9a34e224f65aee2d205dd874ba2, 631194f763324d39a224b5728199751f
I20260709 12:18:52.570801 17031 raft_consensus.cc:2749] T 3b08a6f7d06940f395425d7fef9f0977 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:52.570991 17012 ts_tablet_manager.cc:1434] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P d641bfb9187942e9907fe05411aaac98: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 12:18:52.571463 17018 raft_consensus.cc:515] T a6f975cf54944342ae97c0a5b2bd6d3a P 631194f763324d39a224b5728199751f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.573459 17018 leader_election.cc:290] T a6f975cf54944342ae97c0a5b2bd6d3a P 631194f763324d39a224b5728199751f [CANDIDATE]: Term 1 election: Requested vote from peers 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979), d641bfb9187942e9907fe05411aaac98 (127.3.212.130:44221)
I20260709 12:18:52.574301 16821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6f975cf54944342ae97c0a5b2bd6d3a" candidate_uuid: "631194f763324d39a224b5728199751f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b0ce9a34e224f65aee2d205dd874ba2"
I20260709 12:18:52.575119 16821 raft_consensus.cc:3060] T a6f975cf54944342ae97c0a5b2bd6d3a P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:52.575886 16896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6f975cf54944342ae97c0a5b2bd6d3a" candidate_uuid: "631194f763324d39a224b5728199751f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d641bfb9187942e9907fe05411aaac98"
I20260709 12:18:52.576747 17012 tablet_bootstrap.cc:492] T a6f975cf54944342ae97c0a5b2bd6d3a P d641bfb9187942e9907fe05411aaac98: Bootstrap starting.
I20260709 12:18:52.574288 17010 tablet_bootstrap.cc:492] T 847b3169447b428ba3af26a55cb0229a P 5b0ce9a34e224f65aee2d205dd874ba2: Bootstrap starting.
W20260709 12:18:52.580240 16933 leader_election.cc:343] T a6f975cf54944342ae97c0a5b2bd6d3a P 631194f763324d39a224b5728199751f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d641bfb9187942e9907fe05411aaac98 (127.3.212.130:44221): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:52.583832 16821 raft_consensus.cc:2468] T a6f975cf54944342ae97c0a5b2bd6d3a P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631194f763324d39a224b5728199751f in term 1.
I20260709 12:18:52.584182 17011 tablet_bootstrap.cc:492] T d821b440bbe34471b1ffd70da3afe069 P 631194f763324d39a224b5728199751f: No bootstrap required, opened a new log
I20260709 12:18:52.585330 17011 ts_tablet_manager.cc:1403] T d821b440bbe34471b1ffd70da3afe069 P 631194f763324d39a224b5728199751f: Time spent bootstrapping tablet: real 0.042s	user 0.019s	sys 0.010s
I20260709 12:18:52.585536 16933 leader_election.cc:304] T a6f975cf54944342ae97c0a5b2bd6d3a P 631194f763324d39a224b5728199751f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b0ce9a34e224f65aee2d205dd874ba2, 631194f763324d39a224b5728199751f; no voters: d641bfb9187942e9907fe05411aaac98
I20260709 12:18:52.585848 17012 tablet_bootstrap.cc:654] T a6f975cf54944342ae97c0a5b2bd6d3a P d641bfb9187942e9907fe05411aaac98: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:52.586896 17018 raft_consensus.cc:2804] T a6f975cf54944342ae97c0a5b2bd6d3a P 631194f763324d39a224b5728199751f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:52.587481 17010 tablet_bootstrap.cc:654] T 847b3169447b428ba3af26a55cb0229a P 5b0ce9a34e224f65aee2d205dd874ba2: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:52.588912 17011 raft_consensus.cc:359] T d821b440bbe34471b1ffd70da3afe069 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.589906 17011 raft_consensus.cc:385] T d821b440bbe34471b1ffd70da3afe069 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:52.590278 17011 raft_consensus.cc:740] T d821b440bbe34471b1ffd70da3afe069 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631194f763324d39a224b5728199751f, State: Initialized, Role: FOLLOWER
I20260709 12:18:52.591256 17011 consensus_queue.cc:260] T d821b440bbe34471b1ffd70da3afe069 P 631194f763324d39a224b5728199751f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.592288 17031 raft_consensus.cc:493] T aababa64926d4ed2a9c906dbae553e1f P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.592957 17031 raft_consensus.cc:515] T aababa64926d4ed2a9c906dbae553e1f P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.597393 17031 leader_election.cc:290] T aababa64926d4ed2a9c906dbae553e1f P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979), 631194f763324d39a224b5728199751f (127.3.212.131:32987)
I20260709 12:18:52.597617 16970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aababa64926d4ed2a9c906dbae553e1f" candidate_uuid: "d641bfb9187942e9907fe05411aaac98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631194f763324d39a224b5728199751f" is_pre_election: true
W20260709 12:18:52.599274 16862 leader_election.cc:343] T aababa64926d4ed2a9c906dbae553e1f P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 631194f763324d39a224b5728199751f (127.3.212.131:32987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:52.597638 16821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aababa64926d4ed2a9c906dbae553e1f" candidate_uuid: "d641bfb9187942e9907fe05411aaac98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" is_pre_election: true
W20260709 12:18:52.601737 16859 leader_election.cc:343] T aababa64926d4ed2a9c906dbae553e1f P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:52.602334 16859 leader_election.cc:304] T aababa64926d4ed2a9c906dbae553e1f P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d641bfb9187942e9907fe05411aaac98; no voters: 5b0ce9a34e224f65aee2d205dd874ba2, 631194f763324d39a224b5728199751f
I20260709 12:18:52.602228 17010 tablet_bootstrap.cc:492] T 847b3169447b428ba3af26a55cb0229a P 5b0ce9a34e224f65aee2d205dd874ba2: No bootstrap required, opened a new log
I20260709 12:18:52.603686 17010 ts_tablet_manager.cc:1403] T 847b3169447b428ba3af26a55cb0229a P 5b0ce9a34e224f65aee2d205dd874ba2: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.004s
I20260709 12:18:52.603785 17012 tablet_bootstrap.cc:492] T a6f975cf54944342ae97c0a5b2bd6d3a P d641bfb9187942e9907fe05411aaac98: No bootstrap required, opened a new log
I20260709 12:18:52.603868 17031 raft_consensus.cc:2749] T aababa64926d4ed2a9c906dbae553e1f P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:52.604373 17012 ts_tablet_manager.cc:1403] T a6f975cf54944342ae97c0a5b2bd6d3a P d641bfb9187942e9907fe05411aaac98: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.000s
I20260709 12:18:52.605026 17018 raft_consensus.cc:697] T a6f975cf54944342ae97c0a5b2bd6d3a P 631194f763324d39a224b5728199751f [term 1 LEADER]: Becoming Leader. State: Replica: 631194f763324d39a224b5728199751f, State: Running, Role: LEADER
I20260709 12:18:52.606547 17011 ts_tablet_manager.cc:1434] T d821b440bbe34471b1ffd70da3afe069 P 631194f763324d39a224b5728199751f: Time spent starting tablet: real 0.021s	user 0.010s	sys 0.005s
I20260709 12:18:52.606271 17018 consensus_queue.cc:237] T a6f975cf54944342ae97c0a5b2bd6d3a P 631194f763324d39a224b5728199751f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.607964 17011 tablet_bootstrap.cc:492] T 18210c7ef7cc4e2f8d96c1a686d66464 P 631194f763324d39a224b5728199751f: Bootstrap starting.
I20260709 12:18:52.608050 17010 raft_consensus.cc:359] T 847b3169447b428ba3af26a55cb0229a P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.608625 17012 raft_consensus.cc:359] T a6f975cf54944342ae97c0a5b2bd6d3a P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.609151 17010 raft_consensus.cc:385] T 847b3169447b428ba3af26a55cb0229a P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:52.609422 17012 raft_consensus.cc:385] T a6f975cf54944342ae97c0a5b2bd6d3a P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:52.609557 17010 raft_consensus.cc:740] T 847b3169447b428ba3af26a55cb0229a P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b0ce9a34e224f65aee2d205dd874ba2, State: Initialized, Role: FOLLOWER
I20260709 12:18:52.609854 17012 raft_consensus.cc:740] T a6f975cf54944342ae97c0a5b2bd6d3a P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d641bfb9187942e9907fe05411aaac98, State: Initialized, Role: FOLLOWER
I20260709 12:18:52.610533 17010 consensus_queue.cc:260] T 847b3169447b428ba3af26a55cb0229a P 5b0ce9a34e224f65aee2d205dd874ba2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.610809 17012 consensus_queue.cc:260] T a6f975cf54944342ae97c0a5b2bd6d3a P d641bfb9187942e9907fe05411aaac98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.613101 17010 ts_tablet_manager.cc:1434] T 847b3169447b428ba3af26a55cb0229a P 5b0ce9a34e224f65aee2d205dd874ba2: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:18:52.613101 17012 ts_tablet_manager.cc:1434] T a6f975cf54944342ae97c0a5b2bd6d3a P d641bfb9187942e9907fe05411aaac98: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:18:52.614480 17012 tablet_bootstrap.cc:492] T f556bc405348447bacc2d6bce606766e P d641bfb9187942e9907fe05411aaac98: Bootstrap starting.
I20260709 12:18:52.614480 17010 tablet_bootstrap.cc:492] T aababa64926d4ed2a9c906dbae553e1f P 5b0ce9a34e224f65aee2d205dd874ba2: Bootstrap starting.
I20260709 12:18:52.618803 17011 tablet_bootstrap.cc:654] T 18210c7ef7cc4e2f8d96c1a686d66464 P 631194f763324d39a224b5728199751f: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:52.619639 17031 raft_consensus.cc:493] T 18210c7ef7cc4e2f8d96c1a686d66464 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.620203 17031 raft_consensus.cc:515] T 18210c7ef7cc4e2f8d96c1a686d66464 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.622233 17010 tablet_bootstrap.cc:654] T aababa64926d4ed2a9c906dbae553e1f P 5b0ce9a34e224f65aee2d205dd874ba2: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:52.622241 17012 tablet_bootstrap.cc:654] T f556bc405348447bacc2d6bce606766e P d641bfb9187942e9907fe05411aaac98: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:52.625939 16821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18210c7ef7cc4e2f8d96c1a686d66464" candidate_uuid: "d641bfb9187942e9907fe05411aaac98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" is_pre_election: true
I20260709 12:18:52.626708 16821 raft_consensus.cc:2468] T 18210c7ef7cc4e2f8d96c1a686d66464 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d641bfb9187942e9907fe05411aaac98 in term 0.
I20260709 12:18:52.627147 16970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18210c7ef7cc4e2f8d96c1a686d66464" candidate_uuid: "d641bfb9187942e9907fe05411aaac98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631194f763324d39a224b5728199751f" is_pre_election: true
I20260709 12:18:52.628136 16859 leader_election.cc:304] T 18210c7ef7cc4e2f8d96c1a686d66464 P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b0ce9a34e224f65aee2d205dd874ba2, d641bfb9187942e9907fe05411aaac98; no voters: 
I20260709 12:18:52.622476 17031 leader_election.cc:290] T 18210c7ef7cc4e2f8d96c1a686d66464 P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979), 631194f763324d39a224b5728199751f (127.3.212.131:32987)
I20260709 12:18:52.628996 17019 raft_consensus.cc:2804] T 18210c7ef7cc4e2f8d96c1a686d66464 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:18:52.628921 16862 leader_election.cc:343] T 18210c7ef7cc4e2f8d96c1a686d66464 P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 631194f763324d39a224b5728199751f (127.3.212.131:32987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:52.629642 17019 raft_consensus.cc:493] T 18210c7ef7cc4e2f8d96c1a686d66464 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:52.630338 17019 raft_consensus.cc:3060] T 18210c7ef7cc4e2f8d96c1a686d66464 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:52.640434 17019 raft_consensus.cc:515] T 18210c7ef7cc4e2f8d96c1a686d66464 P d641bfb9187942e9907fe05411aaac98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.642779 16719 catalog_manager.cc:5697] T a6f975cf54944342ae97c0a5b2bd6d3a P 631194f763324d39a224b5728199751f reported cstate change: term changed from 0 to 1, leader changed from <none> to 631194f763324d39a224b5728199751f (127.3.212.131). New cstate: current_term: 1 leader_uuid: "631194f763324d39a224b5728199751f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:52.646728 16821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18210c7ef7cc4e2f8d96c1a686d66464" candidate_uuid: "d641bfb9187942e9907fe05411aaac98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b0ce9a34e224f65aee2d205dd874ba2"
I20260709 12:18:52.647619 16821 raft_consensus.cc:3060] T 18210c7ef7cc4e2f8d96c1a686d66464 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:52.649680 16970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18210c7ef7cc4e2f8d96c1a686d66464" candidate_uuid: "d641bfb9187942e9907fe05411aaac98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631194f763324d39a224b5728199751f"
W20260709 12:18:52.651670 16862 leader_election.cc:343] T 18210c7ef7cc4e2f8d96c1a686d66464 P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 631194f763324d39a224b5728199751f (127.3.212.131:32987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:52.652519 17019 leader_election.cc:290] T 18210c7ef7cc4e2f8d96c1a686d66464 P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 1 election: Requested vote from peers 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979), 631194f763324d39a224b5728199751f (127.3.212.131:32987)
I20260709 12:18:52.659211 17012 tablet_bootstrap.cc:492] T f556bc405348447bacc2d6bce606766e P d641bfb9187942e9907fe05411aaac98: No bootstrap required, opened a new log
I20260709 12:18:52.660089 17012 ts_tablet_manager.cc:1403] T f556bc405348447bacc2d6bce606766e P d641bfb9187942e9907fe05411aaac98: Time spent bootstrapping tablet: real 0.046s	user 0.013s	sys 0.004s
I20260709 12:18:52.662709 17014 raft_consensus.cc:493] T 847b3169447b428ba3af26a55cb0229a P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.663314 17014 raft_consensus.cc:515] T 847b3169447b428ba3af26a55cb0229a P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.664139 17012 raft_consensus.cc:359] T f556bc405348447bacc2d6bce606766e P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.664904 17012 raft_consensus.cc:385] T f556bc405348447bacc2d6bce606766e P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:52.665198 17012 raft_consensus.cc:740] T f556bc405348447bacc2d6bce606766e P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d641bfb9187942e9907fe05411aaac98, State: Initialized, Role: FOLLOWER
I20260709 12:18:52.666270 17012 consensus_queue.cc:260] T f556bc405348447bacc2d6bce606766e P d641bfb9187942e9907fe05411aaac98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.667795 16970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847b3169447b428ba3af26a55cb0229a" candidate_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631194f763324d39a224b5728199751f" is_pre_election: true
I20260709 12:18:52.668501 16970 raft_consensus.cc:2468] T 847b3169447b428ba3af26a55cb0229a P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b0ce9a34e224f65aee2d205dd874ba2 in term 0.
I20260709 12:18:52.669709 16896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847b3169447b428ba3af26a55cb0229a" candidate_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d641bfb9187942e9907fe05411aaac98" is_pre_election: true
W20260709 12:18:52.671432 16784 leader_election.cc:343] T 847b3169447b428ba3af26a55cb0229a P 5b0ce9a34e224f65aee2d205dd874ba2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d641bfb9187942e9907fe05411aaac98 (127.3.212.130:44221): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:52.672732 16787 leader_election.cc:304] T 847b3169447b428ba3af26a55cb0229a P 5b0ce9a34e224f65aee2d205dd874ba2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b0ce9a34e224f65aee2d205dd874ba2, 631194f763324d39a224b5728199751f; no voters: d641bfb9187942e9907fe05411aaac98
I20260709 12:18:52.674057 17014 leader_election.cc:290] T 847b3169447b428ba3af26a55cb0229a P 5b0ce9a34e224f65aee2d205dd874ba2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d641bfb9187942e9907fe05411aaac98 (127.3.212.130:44221), 631194f763324d39a224b5728199751f (127.3.212.131:32987)
I20260709 12:18:52.674744 17014 raft_consensus.cc:2804] T 847b3169447b428ba3af26a55cb0229a P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:52.675139 17014 raft_consensus.cc:493] T 847b3169447b428ba3af26a55cb0229a P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:52.675617 17014 raft_consensus.cc:3060] T 847b3169447b428ba3af26a55cb0229a P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:52.676821 17012 ts_tablet_manager.cc:1434] T f556bc405348447bacc2d6bce606766e P d641bfb9187942e9907fe05411aaac98: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:18:52.678732 16821 raft_consensus.cc:2468] T 18210c7ef7cc4e2f8d96c1a686d66464 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d641bfb9187942e9907fe05411aaac98 in term 1.
I20260709 12:18:52.681326 17012 tablet_bootstrap.cc:492] T 847b3169447b428ba3af26a55cb0229a P d641bfb9187942e9907fe05411aaac98: Bootstrap starting.
I20260709 12:18:52.685369 17011 tablet_bootstrap.cc:492] T 18210c7ef7cc4e2f8d96c1a686d66464 P 631194f763324d39a224b5728199751f: No bootstrap required, opened a new log
I20260709 12:18:52.685951 17011 ts_tablet_manager.cc:1403] T 18210c7ef7cc4e2f8d96c1a686d66464 P 631194f763324d39a224b5728199751f: Time spent bootstrapping tablet: real 0.078s	user 0.032s	sys 0.022s
I20260709 12:18:52.688365 17011 raft_consensus.cc:359] T 18210c7ef7cc4e2f8d96c1a686d66464 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.688977 17011 raft_consensus.cc:385] T 18210c7ef7cc4e2f8d96c1a686d66464 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:52.689325 17012 tablet_bootstrap.cc:654] T 847b3169447b428ba3af26a55cb0229a P d641bfb9187942e9907fe05411aaac98: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:52.688900 17014 raft_consensus.cc:515] T 847b3169447b428ba3af26a55cb0229a P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.689637 17011 raft_consensus.cc:740] T 18210c7ef7cc4e2f8d96c1a686d66464 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631194f763324d39a224b5728199751f, State: Initialized, Role: FOLLOWER
I20260709 12:18:52.690697 17011 consensus_queue.cc:260] T 18210c7ef7cc4e2f8d96c1a686d66464 P 631194f763324d39a224b5728199751f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.691555 17010 tablet_bootstrap.cc:492] T aababa64926d4ed2a9c906dbae553e1f P 5b0ce9a34e224f65aee2d205dd874ba2: No bootstrap required, opened a new log
I20260709 12:18:52.692152 17010 ts_tablet_manager.cc:1403] T aababa64926d4ed2a9c906dbae553e1f P 5b0ce9a34e224f65aee2d205dd874ba2: Time spent bootstrapping tablet: real 0.078s	user 0.021s	sys 0.023s
I20260709 12:18:52.692375 16896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847b3169447b428ba3af26a55cb0229a" candidate_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d641bfb9187942e9907fe05411aaac98"
W20260709 12:18:52.694056 16784 leader_election.cc:343] T 847b3169447b428ba3af26a55cb0229a P 5b0ce9a34e224f65aee2d205dd874ba2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d641bfb9187942e9907fe05411aaac98 (127.3.212.130:44221): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:52.695117 17014 leader_election.cc:290] T 847b3169447b428ba3af26a55cb0229a P 5b0ce9a34e224f65aee2d205dd874ba2 [CANDIDATE]: Term 1 election: Requested vote from peers d641bfb9187942e9907fe05411aaac98 (127.3.212.130:44221), 631194f763324d39a224b5728199751f (127.3.212.131:32987)
I20260709 12:18:52.695446 17010 raft_consensus.cc:359] T aababa64926d4ed2a9c906dbae553e1f P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.696303 17010 raft_consensus.cc:385] T aababa64926d4ed2a9c906dbae553e1f P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:52.696600 17010 raft_consensus.cc:740] T aababa64926d4ed2a9c906dbae553e1f P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b0ce9a34e224f65aee2d205dd874ba2, State: Initialized, Role: FOLLOWER
I20260709 12:18:52.698284 17012 tablet_bootstrap.cc:492] T 847b3169447b428ba3af26a55cb0229a P d641bfb9187942e9907fe05411aaac98: No bootstrap required, opened a new log
I20260709 12:18:52.698583 17010 consensus_queue.cc:260] T aababa64926d4ed2a9c906dbae553e1f P 5b0ce9a34e224f65aee2d205dd874ba2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.699155 17012 ts_tablet_manager.cc:1403] T 847b3169447b428ba3af26a55cb0229a P d641bfb9187942e9907fe05411aaac98: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.007s
I20260709 12:18:52.699520 16970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847b3169447b428ba3af26a55cb0229a" candidate_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631194f763324d39a224b5728199751f"
I20260709 12:18:52.700242 16970 raft_consensus.cc:3060] T 847b3169447b428ba3af26a55cb0229a P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:52.701012 17010 ts_tablet_manager.cc:1434] T aababa64926d4ed2a9c906dbae553e1f P 5b0ce9a34e224f65aee2d205dd874ba2: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:18:52.701013 17011 ts_tablet_manager.cc:1434] T 18210c7ef7cc4e2f8d96c1a686d66464 P 631194f763324d39a224b5728199751f: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:18:52.702293 17010 tablet_bootstrap.cc:492] T 9e3e70fc532a4fb48fcd5d6696714964 P 5b0ce9a34e224f65aee2d205dd874ba2: Bootstrap starting.
I20260709 12:18:52.698370 16859 leader_election.cc:304] T 18210c7ef7cc4e2f8d96c1a686d66464 P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b0ce9a34e224f65aee2d205dd874ba2, d641bfb9187942e9907fe05411aaac98; no voters: 631194f763324d39a224b5728199751f
I20260709 12:18:52.706849 17011 tablet_bootstrap.cc:492] T 9e3e70fc532a4fb48fcd5d6696714964 P 631194f763324d39a224b5728199751f: Bootstrap starting.
I20260709 12:18:52.707489 17014 raft_consensus.cc:493] T aababa64926d4ed2a9c906dbae553e1f P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.708321 17014 raft_consensus.cc:515] T aababa64926d4ed2a9c906dbae553e1f P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.706974 17019 raft_consensus.cc:2804] T 18210c7ef7cc4e2f8d96c1a686d66464 P d641bfb9187942e9907fe05411aaac98 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:52.709247 17019 raft_consensus.cc:697] T 18210c7ef7cc4e2f8d96c1a686d66464 P d641bfb9187942e9907fe05411aaac98 [term 1 LEADER]: Becoming Leader. State: Replica: d641bfb9187942e9907fe05411aaac98, State: Running, Role: LEADER
I20260709 12:18:52.709455 17010 tablet_bootstrap.cc:654] T 9e3e70fc532a4fb48fcd5d6696714964 P 5b0ce9a34e224f65aee2d205dd874ba2: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:52.710966 17019 consensus_queue.cc:237] T 18210c7ef7cc4e2f8d96c1a686d66464 P d641bfb9187942e9907fe05411aaac98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.713603 17012 raft_consensus.cc:359] T 847b3169447b428ba3af26a55cb0229a P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.714484 17012 raft_consensus.cc:385] T 847b3169447b428ba3af26a55cb0229a P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:52.714810 17012 raft_consensus.cc:740] T 847b3169447b428ba3af26a55cb0229a P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d641bfb9187942e9907fe05411aaac98, State: Initialized, Role: FOLLOWER
I20260709 12:18:52.715487 17011 tablet_bootstrap.cc:654] T 9e3e70fc532a4fb48fcd5d6696714964 P 631194f763324d39a224b5728199751f: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:52.715539 17012 consensus_queue.cc:260] T 847b3169447b428ba3af26a55cb0229a P d641bfb9187942e9907fe05411aaac98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.720227 16896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aababa64926d4ed2a9c906dbae553e1f" candidate_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d641bfb9187942e9907fe05411aaac98" is_pre_election: true
I20260709 12:18:52.721040 16896 raft_consensus.cc:2468] T aababa64926d4ed2a9c906dbae553e1f P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b0ce9a34e224f65aee2d205dd874ba2 in term 0.
I20260709 12:18:52.722129 17010 tablet_bootstrap.cc:492] T 9e3e70fc532a4fb48fcd5d6696714964 P 5b0ce9a34e224f65aee2d205dd874ba2: No bootstrap required, opened a new log
I20260709 12:18:52.722402 17011 tablet_bootstrap.cc:492] T 9e3e70fc532a4fb48fcd5d6696714964 P 631194f763324d39a224b5728199751f: No bootstrap required, opened a new log
I20260709 12:18:52.722440 16784 leader_election.cc:304] T aababa64926d4ed2a9c906dbae553e1f P 5b0ce9a34e224f65aee2d205dd874ba2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b0ce9a34e224f65aee2d205dd874ba2, d641bfb9187942e9907fe05411aaac98; no voters: 
I20260709 12:18:52.723078 17011 ts_tablet_manager.cc:1403] T 9e3e70fc532a4fb48fcd5d6696714964 P 631194f763324d39a224b5728199751f: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 12:18:52.723258 17012 ts_tablet_manager.cc:1434] T 847b3169447b428ba3af26a55cb0229a P d641bfb9187942e9907fe05411aaac98: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.002s
I20260709 12:18:52.723984 17049 raft_consensus.cc:2804] T aababa64926d4ed2a9c906dbae553e1f P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:52.724408 17049 raft_consensus.cc:493] T aababa64926d4ed2a9c906dbae553e1f P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:52.724459 17012 tablet_bootstrap.cc:492] T 9e3e70fc532a4fb48fcd5d6696714964 P d641bfb9187942e9907fe05411aaac98: Bootstrap starting.
I20260709 12:18:52.724771 17049 raft_consensus.cc:3060] T aababa64926d4ed2a9c906dbae553e1f P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:52.725179 17014 leader_election.cc:290] T aababa64926d4ed2a9c906dbae553e1f P 5b0ce9a34e224f65aee2d205dd874ba2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d641bfb9187942e9907fe05411aaac98 (127.3.212.130:44221), 631194f763324d39a224b5728199751f (127.3.212.131:32987)
I20260709 12:18:52.726873 17011 raft_consensus.cc:359] T 9e3e70fc532a4fb48fcd5d6696714964 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.727689 17011 raft_consensus.cc:385] T 9e3e70fc532a4fb48fcd5d6696714964 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:52.728022 17011 raft_consensus.cc:740] T 9e3e70fc532a4fb48fcd5d6696714964 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631194f763324d39a224b5728199751f, State: Initialized, Role: FOLLOWER
I20260709 12:18:52.728996 17011 consensus_queue.cc:260] T 9e3e70fc532a4fb48fcd5d6696714964 P 631194f763324d39a224b5728199751f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.730017 16969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aababa64926d4ed2a9c906dbae553e1f" candidate_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631194f763324d39a224b5728199751f" is_pre_election: true
I20260709 12:18:52.731142 16970 raft_consensus.cc:2468] T 847b3169447b428ba3af26a55cb0229a P 631194f763324d39a224b5728199751f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b0ce9a34e224f65aee2d205dd874ba2 in term 1.
I20260709 12:18:52.731396 17012 tablet_bootstrap.cc:654] T 9e3e70fc532a4fb48fcd5d6696714964 P d641bfb9187942e9907fe05411aaac98: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:52.731427 17011 ts_tablet_manager.cc:1434] T 9e3e70fc532a4fb48fcd5d6696714964 P 631194f763324d39a224b5728199751f: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
W20260709 12:18:52.732102 16787 leader_election.cc:343] T aababa64926d4ed2a9c906dbae553e1f P 5b0ce9a34e224f65aee2d205dd874ba2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 631194f763324d39a224b5728199751f (127.3.212.131:32987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:52.733342 17011 tablet_bootstrap.cc:492] T aababa64926d4ed2a9c906dbae553e1f P 631194f763324d39a224b5728199751f: Bootstrap starting.
I20260709 12:18:52.733292 16787 leader_election.cc:304] T 847b3169447b428ba3af26a55cb0229a P 5b0ce9a34e224f65aee2d205dd874ba2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b0ce9a34e224f65aee2d205dd874ba2, 631194f763324d39a224b5728199751f; no voters: d641bfb9187942e9907fe05411aaac98
I20260709 12:18:52.734688 17014 raft_consensus.cc:2804] T 847b3169447b428ba3af26a55cb0229a P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:52.744079 17014 raft_consensus.cc:697] T 847b3169447b428ba3af26a55cb0229a P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 LEADER]: Becoming Leader. State: Replica: 5b0ce9a34e224f65aee2d205dd874ba2, State: Running, Role: LEADER
I20260709 12:18:52.745180 17014 consensus_queue.cc:237] T 847b3169447b428ba3af26a55cb0229a P 5b0ce9a34e224f65aee2d205dd874ba2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.747130 17011 tablet_bootstrap.cc:654] T aababa64926d4ed2a9c906dbae553e1f P 631194f763324d39a224b5728199751f: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:52.752209 17012 tablet_bootstrap.cc:492] T 9e3e70fc532a4fb48fcd5d6696714964 P d641bfb9187942e9907fe05411aaac98: No bootstrap required, opened a new log
I20260709 12:18:52.722793 17010 ts_tablet_manager.cc:1403] T 9e3e70fc532a4fb48fcd5d6696714964 P 5b0ce9a34e224f65aee2d205dd874ba2: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.008s
I20260709 12:18:52.752842 17012 ts_tablet_manager.cc:1403] T 9e3e70fc532a4fb48fcd5d6696714964 P d641bfb9187942e9907fe05411aaac98: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.002s
I20260709 12:18:52.755261 17010 raft_consensus.cc:359] T 9e3e70fc532a4fb48fcd5d6696714964 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.755887 17010 raft_consensus.cc:385] T 9e3e70fc532a4fb48fcd5d6696714964 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:52.755062 16718 catalog_manager.cc:5697] T 847b3169447b428ba3af26a55cb0229a P 5b0ce9a34e224f65aee2d205dd874ba2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129). New cstate: current_term: 1 leader_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:52.756122 17010 raft_consensus.cc:740] T 9e3e70fc532a4fb48fcd5d6696714964 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b0ce9a34e224f65aee2d205dd874ba2, State: Initialized, Role: FOLLOWER
I20260709 12:18:52.756094 17012 raft_consensus.cc:359] T 9e3e70fc532a4fb48fcd5d6696714964 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.756642 17019 raft_consensus.cc:493] T a6f975cf54944342ae97c0a5b2bd6d3a P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.752720 16719 catalog_manager.cc:5697] T 18210c7ef7cc4e2f8d96c1a686d66464 P d641bfb9187942e9907fe05411aaac98 reported cstate change: term changed from 0 to 1, leader changed from <none> to d641bfb9187942e9907fe05411aaac98 (127.3.212.130). New cstate: current_term: 1 leader_uuid: "d641bfb9187942e9907fe05411aaac98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:52.761907 17012 raft_consensus.cc:385] T 9e3e70fc532a4fb48fcd5d6696714964 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:52.761534 17010 consensus_queue.cc:260] T 9e3e70fc532a4fb48fcd5d6696714964 P 5b0ce9a34e224f65aee2d205dd874ba2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.759138 17011 tablet_bootstrap.cc:492] T aababa64926d4ed2a9c906dbae553e1f P 631194f763324d39a224b5728199751f: No bootstrap required, opened a new log
I20260709 12:18:52.762940 17011 ts_tablet_manager.cc:1403] T aababa64926d4ed2a9c906dbae553e1f P 631194f763324d39a224b5728199751f: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.000s
I20260709 12:18:52.761685 17019 raft_consensus.cc:515] T a6f975cf54944342ae97c0a5b2bd6d3a P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.762231 17012 raft_consensus.cc:740] T 9e3e70fc532a4fb48fcd5d6696714964 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d641bfb9187942e9907fe05411aaac98, State: Initialized, Role: FOLLOWER
I20260709 12:18:52.764894 17019 leader_election.cc:290] T a6f975cf54944342ae97c0a5b2bd6d3a P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979), 631194f763324d39a224b5728199751f (127.3.212.131:32987)
I20260709 12:18:52.766201 17010 ts_tablet_manager.cc:1434] T 9e3e70fc532a4fb48fcd5d6696714964 P 5b0ce9a34e224f65aee2d205dd874ba2: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 12:18:52.766073 16970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6f975cf54944342ae97c0a5b2bd6d3a" candidate_uuid: "d641bfb9187942e9907fe05411aaac98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631194f763324d39a224b5728199751f" is_pre_election: true
I20260709 12:18:52.765772 17012 consensus_queue.cc:260] T 9e3e70fc532a4fb48fcd5d6696714964 P d641bfb9187942e9907fe05411aaac98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.766731 16821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6f975cf54944342ae97c0a5b2bd6d3a" candidate_uuid: "d641bfb9187942e9907fe05411aaac98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" is_pre_election: true
I20260709 12:18:52.767313 17010 tablet_bootstrap.cc:492] T 3b08a6f7d06940f395425d7fef9f0977 P 5b0ce9a34e224f65aee2d205dd874ba2: Bootstrap starting.
I20260709 12:18:52.767544 16821 raft_consensus.cc:2393] T a6f975cf54944342ae97c0a5b2bd6d3a P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d641bfb9187942e9907fe05411aaac98 in current term 1: Already voted for candidate 631194f763324d39a224b5728199751f in this term.
I20260709 12:18:52.768307 17012 ts_tablet_manager.cc:1434] T 9e3e70fc532a4fb48fcd5d6696714964 P d641bfb9187942e9907fe05411aaac98: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 12:18:52.770242 16859 leader_election.cc:304] T a6f975cf54944342ae97c0a5b2bd6d3a P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d641bfb9187942e9907fe05411aaac98; no voters: 5b0ce9a34e224f65aee2d205dd874ba2, 631194f763324d39a224b5728199751f
I20260709 12:18:52.771384 17011 raft_consensus.cc:359] T aababa64926d4ed2a9c906dbae553e1f P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.772202 17011 raft_consensus.cc:385] T aababa64926d4ed2a9c906dbae553e1f P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:52.756321 17049 raft_consensus.cc:515] T aababa64926d4ed2a9c906dbae553e1f P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.772552 17011 raft_consensus.cc:740] T aababa64926d4ed2a9c906dbae553e1f P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631194f763324d39a224b5728199751f, State: Initialized, Role: FOLLOWER
I20260709 12:18:52.773432 17011 consensus_queue.cc:260] T aababa64926d4ed2a9c906dbae553e1f P 631194f763324d39a224b5728199751f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.774158 17010 tablet_bootstrap.cc:654] T 3b08a6f7d06940f395425d7fef9f0977 P 5b0ce9a34e224f65aee2d205dd874ba2: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:52.775420 16896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aababa64926d4ed2a9c906dbae553e1f" candidate_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d641bfb9187942e9907fe05411aaac98"
I20260709 12:18:52.771586 17019 raft_consensus.cc:3060] T a6f975cf54944342ae97c0a5b2bd6d3a P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:52.776121 16896 raft_consensus.cc:3060] T aababa64926d4ed2a9c906dbae553e1f P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:52.778110 17049 leader_election.cc:290] T aababa64926d4ed2a9c906dbae553e1f P 5b0ce9a34e224f65aee2d205dd874ba2 [CANDIDATE]: Term 1 election: Requested vote from peers d641bfb9187942e9907fe05411aaac98 (127.3.212.130:44221), 631194f763324d39a224b5728199751f (127.3.212.131:32987)
I20260709 12:18:52.780720 16970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aababa64926d4ed2a9c906dbae553e1f" candidate_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631194f763324d39a224b5728199751f"
I20260709 12:18:52.781510 16970 raft_consensus.cc:3060] T aababa64926d4ed2a9c906dbae553e1f P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:52.785437 17019 raft_consensus.cc:2749] T a6f975cf54944342ae97c0a5b2bd6d3a P d641bfb9187942e9907fe05411aaac98 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:52.789811 16970 raft_consensus.cc:2468] T aababa64926d4ed2a9c906dbae553e1f P 631194f763324d39a224b5728199751f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b0ce9a34e224f65aee2d205dd874ba2 in term 1.
I20260709 12:18:52.791365 16787 leader_election.cc:304] T aababa64926d4ed2a9c906dbae553e1f P 5b0ce9a34e224f65aee2d205dd874ba2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b0ce9a34e224f65aee2d205dd874ba2, 631194f763324d39a224b5728199751f; no voters: 
I20260709 12:18:52.791712 16896 raft_consensus.cc:2468] T aababa64926d4ed2a9c906dbae553e1f P d641bfb9187942e9907fe05411aaac98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b0ce9a34e224f65aee2d205dd874ba2 in term 1.
I20260709 12:18:52.775686 17011 ts_tablet_manager.cc:1434] T aababa64926d4ed2a9c906dbae553e1f P 631194f763324d39a224b5728199751f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:18:52.793500 17011 tablet_bootstrap.cc:492] T 3b08a6f7d06940f395425d7fef9f0977 P 631194f763324d39a224b5728199751f: Bootstrap starting.
I20260709 12:18:52.792471 17049 raft_consensus.cc:2804] T aababa64926d4ed2a9c906dbae553e1f P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:52.794363 17049 raft_consensus.cc:697] T aababa64926d4ed2a9c906dbae553e1f P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 LEADER]: Becoming Leader. State: Replica: 5b0ce9a34e224f65aee2d205dd874ba2, State: Running, Role: LEADER
I20260709 12:18:52.795327 17049 consensus_queue.cc:237] T aababa64926d4ed2a9c906dbae553e1f P 5b0ce9a34e224f65aee2d205dd874ba2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.796844 17014 raft_consensus.cc:493] T f556bc405348447bacc2d6bce606766e P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.797431 17014 raft_consensus.cc:515] T f556bc405348447bacc2d6bce606766e P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.799847 17014 leader_election.cc:290] T f556bc405348447bacc2d6bce606766e P 5b0ce9a34e224f65aee2d205dd874ba2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d641bfb9187942e9907fe05411aaac98 (127.3.212.130:44221), 631194f763324d39a224b5728199751f (127.3.212.131:32987)
I20260709 12:18:52.800381 17011 tablet_bootstrap.cc:654] T 3b08a6f7d06940f395425d7fef9f0977 P 631194f763324d39a224b5728199751f: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:52.801659 16896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f556bc405348447bacc2d6bce606766e" candidate_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d641bfb9187942e9907fe05411aaac98" is_pre_election: true
I20260709 12:18:52.802472 16896 raft_consensus.cc:2468] T f556bc405348447bacc2d6bce606766e P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b0ce9a34e224f65aee2d205dd874ba2 in term 0.
I20260709 12:18:52.803881 16784 leader_election.cc:304] T f556bc405348447bacc2d6bce606766e P 5b0ce9a34e224f65aee2d205dd874ba2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b0ce9a34e224f65aee2d205dd874ba2, d641bfb9187942e9907fe05411aaac98; no voters: 
I20260709 12:18:52.804987 17014 raft_consensus.cc:2804] T f556bc405348447bacc2d6bce606766e P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:52.805418 17014 raft_consensus.cc:493] T f556bc405348447bacc2d6bce606766e P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:52.805622 16970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f556bc405348447bacc2d6bce606766e" candidate_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631194f763324d39a224b5728199751f" is_pre_election: true
I20260709 12:18:52.805751 17014 raft_consensus.cc:3060] T f556bc405348447bacc2d6bce606766e P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:52.806599 16970 raft_consensus.cc:2468] T f556bc405348447bacc2d6bce606766e P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b0ce9a34e224f65aee2d205dd874ba2 in term 0.
I20260709 12:18:52.815717 17018 raft_consensus.cc:493] T d821b440bbe34471b1ffd70da3afe069 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.816283 17018 raft_consensus.cc:515] T d821b440bbe34471b1ffd70da3afe069 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.817255 17019 raft_consensus.cc:493] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.817842 17019 raft_consensus.cc:515] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.818637 17018 leader_election.cc:290] T d821b440bbe34471b1ffd70da3afe069 P 631194f763324d39a224b5728199751f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979), d641bfb9187942e9907fe05411aaac98 (127.3.212.130:44221)
I20260709 12:18:52.820070 17019 leader_election.cc:290] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979), 631194f763324d39a224b5728199751f (127.3.212.131:32987)
I20260709 12:18:52.821394 16821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d821b440bbe34471b1ffd70da3afe069" candidate_uuid: "631194f763324d39a224b5728199751f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" is_pre_election: true
I20260709 12:18:52.820704 16717 catalog_manager.cc:5697] T aababa64926d4ed2a9c906dbae553e1f P 5b0ce9a34e224f65aee2d205dd874ba2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129). New cstate: current_term: 1 leader_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:52.822252 16821 raft_consensus.cc:2393] T d821b440bbe34471b1ffd70da3afe069 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631194f763324d39a224b5728199751f in current term 1: Already voted for candidate d641bfb9187942e9907fe05411aaac98 in this term.
I20260709 12:18:52.824677 16896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d821b440bbe34471b1ffd70da3afe069" candidate_uuid: "631194f763324d39a224b5728199751f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d641bfb9187942e9907fe05411aaac98" is_pre_election: true
I20260709 12:18:52.822727 16820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0408a37e9dc84eb8b74b3d8fc57ffef7" candidate_uuid: "d641bfb9187942e9907fe05411aaac98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" is_pre_election: true
I20260709 12:18:52.826030 16820 raft_consensus.cc:2468] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d641bfb9187942e9907fe05411aaac98 in term 0.
I20260709 12:18:52.826382 17014 raft_consensus.cc:515] T f556bc405348447bacc2d6bce606766e P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.826820 16933 leader_election.cc:304] T d821b440bbe34471b1ffd70da3afe069 P 631194f763324d39a224b5728199751f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631194f763324d39a224b5728199751f; no voters: 5b0ce9a34e224f65aee2d205dd874ba2, d641bfb9187942e9907fe05411aaac98
I20260709 12:18:52.827394 16859 leader_election.cc:304] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b0ce9a34e224f65aee2d205dd874ba2, d641bfb9187942e9907fe05411aaac98; no voters: 
I20260709 12:18:52.827806 17011 tablet_bootstrap.cc:492] T 3b08a6f7d06940f395425d7fef9f0977 P 631194f763324d39a224b5728199751f: No bootstrap required, opened a new log
I20260709 12:18:52.828317 17019 raft_consensus.cc:2804] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:52.822279 16970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0408a37e9dc84eb8b74b3d8fc57ffef7" candidate_uuid: "d641bfb9187942e9907fe05411aaac98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631194f763324d39a224b5728199751f" is_pre_election: true
I20260709 12:18:52.828940 17019 raft_consensus.cc:493] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:52.829465 17019 raft_consensus.cc:3060] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:52.829556 16970 raft_consensus.cc:2468] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d641bfb9187942e9907fe05411aaac98 in term 0.
I20260709 12:18:52.830134 17010 tablet_bootstrap.cc:492] T 3b08a6f7d06940f395425d7fef9f0977 P 5b0ce9a34e224f65aee2d205dd874ba2: No bootstrap required, opened a new log
I20260709 12:18:52.828387 17011 ts_tablet_manager.cc:1403] T 3b08a6f7d06940f395425d7fef9f0977 P 631194f763324d39a224b5728199751f: Time spent bootstrapping tablet: real 0.035s	user 0.017s	sys 0.015s
I20260709 12:18:52.830650 17010 ts_tablet_manager.cc:1403] T 3b08a6f7d06940f395425d7fef9f0977 P 5b0ce9a34e224f65aee2d205dd874ba2: Time spent bootstrapping tablet: real 0.064s	user 0.020s	sys 0.014s
I20260709 12:18:52.833446 17011 raft_consensus.cc:359] T 3b08a6f7d06940f395425d7fef9f0977 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.834158 17011 raft_consensus.cc:385] T 3b08a6f7d06940f395425d7fef9f0977 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:52.834450 17011 raft_consensus.cc:740] T 3b08a6f7d06940f395425d7fef9f0977 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631194f763324d39a224b5728199751f, State: Initialized, Role: FOLLOWER
I20260709 12:18:52.828303 17018 raft_consensus.cc:3060] T d821b440bbe34471b1ffd70da3afe069 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:52.834903 17014 leader_election.cc:290] T f556bc405348447bacc2d6bce606766e P 5b0ce9a34e224f65aee2d205dd874ba2 [CANDIDATE]: Term 1 election: Requested vote from peers d641bfb9187942e9907fe05411aaac98 (127.3.212.130:44221), 631194f763324d39a224b5728199751f (127.3.212.131:32987)
I20260709 12:18:52.835285 17011 consensus_queue.cc:260] T 3b08a6f7d06940f395425d7fef9f0977 P 631194f763324d39a224b5728199751f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.834152 17010 raft_consensus.cc:359] T 3b08a6f7d06940f395425d7fef9f0977 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.836465 17010 raft_consensus.cc:385] T 3b08a6f7d06940f395425d7fef9f0977 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:52.836779 17010 raft_consensus.cc:740] T 3b08a6f7d06940f395425d7fef9f0977 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b0ce9a34e224f65aee2d205dd874ba2, State: Initialized, Role: FOLLOWER
I20260709 12:18:52.837646 17011 ts_tablet_manager.cc:1434] T 3b08a6f7d06940f395425d7fef9f0977 P 631194f763324d39a224b5728199751f: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:18:52.837793 16896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f556bc405348447bacc2d6bce606766e" candidate_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d641bfb9187942e9907fe05411aaac98"
I20260709 12:18:52.838389 16896 raft_consensus.cc:3060] T f556bc405348447bacc2d6bce606766e P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:52.839495 16970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f556bc405348447bacc2d6bce606766e" candidate_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631194f763324d39a224b5728199751f"
I20260709 12:18:52.840166 16970 raft_consensus.cc:3060] T f556bc405348447bacc2d6bce606766e P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:52.841867 17010 consensus_queue.cc:260] T 3b08a6f7d06940f395425d7fef9f0977 P 5b0ce9a34e224f65aee2d205dd874ba2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.844467 17010 ts_tablet_manager.cc:1434] T 3b08a6f7d06940f395425d7fef9f0977 P 5b0ce9a34e224f65aee2d205dd874ba2: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:18:52.847395 17041 raft_consensus.cc:493] T 18210c7ef7cc4e2f8d96c1a686d66464 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.848018 17041 raft_consensus.cc:515] T 18210c7ef7cc4e2f8d96c1a686d66464 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.850296 17041 leader_election.cc:290] T 18210c7ef7cc4e2f8d96c1a686d66464 P 631194f763324d39a224b5728199751f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979), d641bfb9187942e9907fe05411aaac98 (127.3.212.130:44221)
I20260709 12:18:52.852686 16820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18210c7ef7cc4e2f8d96c1a686d66464" candidate_uuid: "631194f763324d39a224b5728199751f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" is_pre_election: true
I20260709 12:18:52.853720 16896 raft_consensus.cc:2468] T f556bc405348447bacc2d6bce606766e P d641bfb9187942e9907fe05411aaac98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b0ce9a34e224f65aee2d205dd874ba2 in term 1.
I20260709 12:18:52.853897 16820 raft_consensus.cc:2393] T 18210c7ef7cc4e2f8d96c1a686d66464 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 631194f763324d39a224b5728199751f in current term 1: Already voted for candidate d641bfb9187942e9907fe05411aaac98 in this term.
I20260709 12:18:52.855085 16895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18210c7ef7cc4e2f8d96c1a686d66464" candidate_uuid: "631194f763324d39a224b5728199751f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d641bfb9187942e9907fe05411aaac98" is_pre_election: true
I20260709 12:18:52.852720 16970 raft_consensus.cc:2468] T f556bc405348447bacc2d6bce606766e P 631194f763324d39a224b5728199751f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b0ce9a34e224f65aee2d205dd874ba2 in term 1.
I20260709 12:18:52.856405 17018 raft_consensus.cc:2749] T d821b440bbe34471b1ffd70da3afe069 P 631194f763324d39a224b5728199751f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:52.857173 17041 raft_consensus.cc:493] T 9e3e70fc532a4fb48fcd5d6696714964 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.858723 17041 raft_consensus.cc:515] T 9e3e70fc532a4fb48fcd5d6696714964 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.859308 17019 raft_consensus.cc:515] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P d641bfb9187942e9907fe05411aaac98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.861057 17041 leader_election.cc:290] T 9e3e70fc532a4fb48fcd5d6696714964 P 631194f763324d39a224b5728199751f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979), d641bfb9187942e9907fe05411aaac98 (127.3.212.130:44221)
I20260709 12:18:52.861253 17019 leader_election.cc:290] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 1 election: Requested vote from peers 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979), 631194f763324d39a224b5728199751f (127.3.212.131:32987)
I20260709 12:18:52.858167 16933 leader_election.cc:304] T 18210c7ef7cc4e2f8d96c1a686d66464 P 631194f763324d39a224b5728199751f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631194f763324d39a224b5728199751f; no voters: 5b0ce9a34e224f65aee2d205dd874ba2, d641bfb9187942e9907fe05411aaac98
I20260709 12:18:52.857565 16784 leader_election.cc:304] T f556bc405348447bacc2d6bce606766e P 5b0ce9a34e224f65aee2d205dd874ba2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b0ce9a34e224f65aee2d205dd874ba2, d641bfb9187942e9907fe05411aaac98; no voters: 
I20260709 12:18:52.862836 17041 raft_consensus.cc:3060] T 18210c7ef7cc4e2f8d96c1a686d66464 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:52.863081 17014 raft_consensus.cc:2804] T f556bc405348447bacc2d6bce606766e P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:52.863675 17014 raft_consensus.cc:697] T f556bc405348447bacc2d6bce606766e P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 LEADER]: Becoming Leader. State: Replica: 5b0ce9a34e224f65aee2d205dd874ba2, State: Running, Role: LEADER
I20260709 12:18:52.864558 16895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3e70fc532a4fb48fcd5d6696714964" candidate_uuid: "631194f763324d39a224b5728199751f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d641bfb9187942e9907fe05411aaac98" is_pre_election: true
I20260709 12:18:52.865458 16895 raft_consensus.cc:2468] T 9e3e70fc532a4fb48fcd5d6696714964 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631194f763324d39a224b5728199751f in term 0.
I20260709 12:18:52.866015 16820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3e70fc532a4fb48fcd5d6696714964" candidate_uuid: "631194f763324d39a224b5728199751f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" is_pre_election: true
I20260709 12:18:52.867260 16820 raft_consensus.cc:2468] T 9e3e70fc532a4fb48fcd5d6696714964 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631194f763324d39a224b5728199751f in term 0.
I20260709 12:18:52.867547 16933 leader_election.cc:304] T 9e3e70fc532a4fb48fcd5d6696714964 P 631194f763324d39a224b5728199751f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631194f763324d39a224b5728199751f, d641bfb9187942e9907fe05411aaac98; no voters: 
I20260709 12:18:52.868378 16821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0408a37e9dc84eb8b74b3d8fc57ffef7" candidate_uuid: "d641bfb9187942e9907fe05411aaac98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b0ce9a34e224f65aee2d205dd874ba2"
I20260709 12:18:52.867568 16970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0408a37e9dc84eb8b74b3d8fc57ffef7" candidate_uuid: "d641bfb9187942e9907fe05411aaac98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631194f763324d39a224b5728199751f"
I20260709 12:18:52.868723 17018 raft_consensus.cc:2804] T 9e3e70fc532a4fb48fcd5d6696714964 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:52.869205 16970 raft_consensus.cc:3060] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:52.869347 17018 raft_consensus.cc:493] T 9e3e70fc532a4fb48fcd5d6696714964 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:52.869818 16821 raft_consensus.cc:3060] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:52.869910 17018 raft_consensus.cc:3060] T 9e3e70fc532a4fb48fcd5d6696714964 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:52.864569 17014 consensus_queue.cc:237] T f556bc405348447bacc2d6bce606766e P 5b0ce9a34e224f65aee2d205dd874ba2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.872303 17041 raft_consensus.cc:2749] T 18210c7ef7cc4e2f8d96c1a686d66464 P 631194f763324d39a224b5728199751f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:52.878329 16970 raft_consensus.cc:2468] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 631194f763324d39a224b5728199751f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d641bfb9187942e9907fe05411aaac98 in term 1.
I20260709 12:18:52.878326 17018 raft_consensus.cc:515] T 9e3e70fc532a4fb48fcd5d6696714964 P 631194f763324d39a224b5728199751f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.879994 16862 leader_election.cc:304] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631194f763324d39a224b5728199751f, d641bfb9187942e9907fe05411aaac98; no voters: 
I20260709 12:18:52.880970 17019 raft_consensus.cc:2804] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P d641bfb9187942e9907fe05411aaac98 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:52.881695 17019 raft_consensus.cc:697] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P d641bfb9187942e9907fe05411aaac98 [term 1 LEADER]: Becoming Leader. State: Replica: d641bfb9187942e9907fe05411aaac98, State: Running, Role: LEADER
I20260709 12:18:52.882572 17019 consensus_queue.cc:237] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P d641bfb9187942e9907fe05411aaac98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.883715 16821 raft_consensus.cc:2468] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d641bfb9187942e9907fe05411aaac98 in term 1.
I20260709 12:18:52.883162 16719 catalog_manager.cc:5697] T f556bc405348447bacc2d6bce606766e P 5b0ce9a34e224f65aee2d205dd874ba2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129). New cstate: current_term: 1 leader_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:52.884399 17032 raft_consensus.cc:493] T 847b3169447b428ba3af26a55cb0229a P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.884696 16895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3e70fc532a4fb48fcd5d6696714964" candidate_uuid: "631194f763324d39a224b5728199751f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d641bfb9187942e9907fe05411aaac98"
I20260709 12:18:52.885340 16895 raft_consensus.cc:3060] T 9e3e70fc532a4fb48fcd5d6696714964 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:52.884974 17032 raft_consensus.cc:515] T 847b3169447b428ba3af26a55cb0229a P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.886003 16820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3e70fc532a4fb48fcd5d6696714964" candidate_uuid: "631194f763324d39a224b5728199751f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b0ce9a34e224f65aee2d205dd874ba2"
I20260709 12:18:52.886627 16820 raft_consensus.cc:3060] T 9e3e70fc532a4fb48fcd5d6696714964 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:52.887297 17032 leader_election.cc:290] T 847b3169447b428ba3af26a55cb0229a P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979), 631194f763324d39a224b5728199751f (127.3.212.131:32987)
I20260709 12:18:52.889164 16970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847b3169447b428ba3af26a55cb0229a" candidate_uuid: "d641bfb9187942e9907fe05411aaac98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631194f763324d39a224b5728199751f" is_pre_election: true
I20260709 12:18:52.890057 16970 raft_consensus.cc:2393] T 847b3169447b428ba3af26a55cb0229a P 631194f763324d39a224b5728199751f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d641bfb9187942e9907fe05411aaac98 in current term 1: Already voted for candidate 5b0ce9a34e224f65aee2d205dd874ba2 in this term.
I20260709 12:18:52.880945 17018 leader_election.cc:290] T 9e3e70fc532a4fb48fcd5d6696714964 P 631194f763324d39a224b5728199751f [CANDIDATE]: Term 1 election: Requested vote from peers 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979), d641bfb9187942e9907fe05411aaac98 (127.3.212.130:44221)
I20260709 12:18:52.895785 16821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847b3169447b428ba3af26a55cb0229a" candidate_uuid: "d641bfb9187942e9907fe05411aaac98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" is_pre_election: true
I20260709 12:18:52.897161 16859 leader_election.cc:304] T 847b3169447b428ba3af26a55cb0229a P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d641bfb9187942e9907fe05411aaac98; no voters: 5b0ce9a34e224f65aee2d205dd874ba2, 631194f763324d39a224b5728199751f
I20260709 12:18:52.897579 16820 raft_consensus.cc:2468] T 9e3e70fc532a4fb48fcd5d6696714964 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631194f763324d39a224b5728199751f in term 1.
I20260709 12:18:52.898780 17019 raft_consensus.cc:3060] T 847b3169447b428ba3af26a55cb0229a P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:52.899151 16933 leader_election.cc:304] T 9e3e70fc532a4fb48fcd5d6696714964 P 631194f763324d39a224b5728199751f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b0ce9a34e224f65aee2d205dd874ba2, 631194f763324d39a224b5728199751f; no voters: 
I20260709 12:18:52.899331 16895 raft_consensus.cc:2468] T 9e3e70fc532a4fb48fcd5d6696714964 P d641bfb9187942e9907fe05411aaac98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631194f763324d39a224b5728199751f in term 1.
I20260709 12:18:52.900166 16719 catalog_manager.cc:5697] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P d641bfb9187942e9907fe05411aaac98 reported cstate change: term changed from 0 to 1, leader changed from <none> to d641bfb9187942e9907fe05411aaac98 (127.3.212.130). New cstate: current_term: 1 leader_uuid: "d641bfb9187942e9907fe05411aaac98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:52.900194 17018 raft_consensus.cc:2804] T 9e3e70fc532a4fb48fcd5d6696714964 P 631194f763324d39a224b5728199751f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:52.902009 17018 raft_consensus.cc:697] T 9e3e70fc532a4fb48fcd5d6696714964 P 631194f763324d39a224b5728199751f [term 1 LEADER]: Becoming Leader. State: Replica: 631194f763324d39a224b5728199751f, State: Running, Role: LEADER
I20260709 12:18:52.902890 17018 consensus_queue.cc:237] T 9e3e70fc532a4fb48fcd5d6696714964 P 631194f763324d39a224b5728199751f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.905612 17019 raft_consensus.cc:2749] T 847b3169447b428ba3af26a55cb0229a P d641bfb9187942e9907fe05411aaac98 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:52.911454 16717 catalog_manager.cc:5697] T 9e3e70fc532a4fb48fcd5d6696714964 P 631194f763324d39a224b5728199751f reported cstate change: term changed from 0 to 1, leader changed from <none> to 631194f763324d39a224b5728199751f (127.3.212.131). New cstate: current_term: 1 leader_uuid: "631194f763324d39a224b5728199751f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:52.922703 17019 consensus_queue.cc:1048] T d821b440bbe34471b1ffd70da3afe069 P d641bfb9187942e9907fe05411aaac98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:52.931931 17014 raft_consensus.cc:493] T 3b08a6f7d06940f395425d7fef9f0977 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.932533 17014 raft_consensus.cc:515] T 3b08a6f7d06940f395425d7fef9f0977 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.934914 17014 leader_election.cc:290] T 3b08a6f7d06940f395425d7fef9f0977 P 5b0ce9a34e224f65aee2d205dd874ba2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d641bfb9187942e9907fe05411aaac98 (127.3.212.130:44221), 631194f763324d39a224b5728199751f (127.3.212.131:32987)
I20260709 12:18:52.936616 16895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b08a6f7d06940f395425d7fef9f0977" candidate_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d641bfb9187942e9907fe05411aaac98" is_pre_election: true
I20260709 12:18:52.937340 16895 raft_consensus.cc:2468] T 3b08a6f7d06940f395425d7fef9f0977 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b0ce9a34e224f65aee2d205dd874ba2 in term 0.
I20260709 12:18:52.938804 16784 leader_election.cc:304] T 3b08a6f7d06940f395425d7fef9f0977 P 5b0ce9a34e224f65aee2d205dd874ba2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b0ce9a34e224f65aee2d205dd874ba2, d641bfb9187942e9907fe05411aaac98; no voters: 
I20260709 12:18:52.938956 16970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b08a6f7d06940f395425d7fef9f0977" candidate_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631194f763324d39a224b5728199751f" is_pre_election: true
I20260709 12:18:52.939693 16970 raft_consensus.cc:2468] T 3b08a6f7d06940f395425d7fef9f0977 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b0ce9a34e224f65aee2d205dd874ba2 in term 0.
I20260709 12:18:52.940376 17014 raft_consensus.cc:2804] T 3b08a6f7d06940f395425d7fef9f0977 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:52.940495 17031 consensus_queue.cc:1048] T d821b440bbe34471b1ffd70da3afe069 P d641bfb9187942e9907fe05411aaac98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:52.940961 17014 raft_consensus.cc:493] T 3b08a6f7d06940f395425d7fef9f0977 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:52.941551 17014 raft_consensus.cc:3060] T 3b08a6f7d06940f395425d7fef9f0977 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:52.949592 17014 raft_consensus.cc:515] T 3b08a6f7d06940f395425d7fef9f0977 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.952066 17014 leader_election.cc:290] T 3b08a6f7d06940f395425d7fef9f0977 P 5b0ce9a34e224f65aee2d205dd874ba2 [CANDIDATE]: Term 1 election: Requested vote from peers d641bfb9187942e9907fe05411aaac98 (127.3.212.130:44221), 631194f763324d39a224b5728199751f (127.3.212.131:32987)
I20260709 12:18:52.952731 16895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b08a6f7d06940f395425d7fef9f0977" candidate_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d641bfb9187942e9907fe05411aaac98"
I20260709 12:18:52.953312 16895 raft_consensus.cc:3060] T 3b08a6f7d06940f395425d7fef9f0977 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:52.953539 16970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b08a6f7d06940f395425d7fef9f0977" candidate_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631194f763324d39a224b5728199751f"
I20260709 12:18:52.954116 16970 raft_consensus.cc:3060] T 3b08a6f7d06940f395425d7fef9f0977 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:52.960274 16970 raft_consensus.cc:2468] T 3b08a6f7d06940f395425d7fef9f0977 P 631194f763324d39a224b5728199751f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b0ce9a34e224f65aee2d205dd874ba2 in term 1.
I20260709 12:18:52.961184 16895 raft_consensus.cc:2468] T 3b08a6f7d06940f395425d7fef9f0977 P d641bfb9187942e9907fe05411aaac98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b0ce9a34e224f65aee2d205dd874ba2 in term 1.
I20260709 12:18:52.961483 16787 leader_election.cc:304] T 3b08a6f7d06940f395425d7fef9f0977 P 5b0ce9a34e224f65aee2d205dd874ba2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b0ce9a34e224f65aee2d205dd874ba2, 631194f763324d39a224b5728199751f; no voters: 
I20260709 12:18:52.962502 17014 raft_consensus.cc:2804] T 3b08a6f7d06940f395425d7fef9f0977 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:52.962993 17014 raft_consensus.cc:697] T 3b08a6f7d06940f395425d7fef9f0977 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 LEADER]: Becoming Leader. State: Replica: 5b0ce9a34e224f65aee2d205dd874ba2, State: Running, Role: LEADER
I20260709 12:18:52.963868 17014 consensus_queue.cc:237] T 3b08a6f7d06940f395425d7fef9f0977 P 5b0ce9a34e224f65aee2d205dd874ba2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:52.972086 16717 catalog_manager.cc:5697] T 3b08a6f7d06940f395425d7fef9f0977 P 5b0ce9a34e224f65aee2d205dd874ba2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129). New cstate: current_term: 1 leader_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:52.993503 17018 consensus_queue.cc:1048] T a6f975cf54944342ae97c0a5b2bd6d3a P 631194f763324d39a224b5728199751f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:53.005415 17018 consensus_queue.cc:1048] T a6f975cf54944342ae97c0a5b2bd6d3a P 631194f763324d39a224b5728199751f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:53.136900 17031 consensus_queue.cc:1048] T 18210c7ef7cc4e2f8d96c1a686d66464 P d641bfb9187942e9907fe05411aaac98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:53.148886 17073 consensus_queue.cc:1048] T 18210c7ef7cc4e2f8d96c1a686d66464 P d641bfb9187942e9907fe05411aaac98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:53.200661 16895 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0408a37e9dc84eb8b74b3d8fc57ffef7"
dest_uuid: "d641bfb9187942e9907fe05411aaac98"
mode: GRACEFUL
new_leader_uuid: "5b0ce9a34e224f65aee2d205dd874ba2"
 from {username='slave'} at 127.0.0.1:47354
I20260709 12:18:53.201354 16895 raft_consensus.cc:606] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P d641bfb9187942e9907fe05411aaac98 [term 1 LEADER]: Received request to transfer leadership to TS 5b0ce9a34e224f65aee2d205dd874ba2
I20260709 12:18:53.218209 16820 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b08a6f7d06940f395425d7fef9f0977"
dest_uuid: "5b0ce9a34e224f65aee2d205dd874ba2"
mode: GRACEFUL
new_leader_uuid: "d641bfb9187942e9907fe05411aaac98"
 from {username='slave'} at 127.0.0.1:48182
I20260709 12:18:53.218736 16820 raft_consensus.cc:606] T 3b08a6f7d06940f395425d7fef9f0977 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 LEADER]: Received request to transfer leadership to TS d641bfb9187942e9907fe05411aaac98
I20260709 12:18:53.234970 16970 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6f975cf54944342ae97c0a5b2bd6d3a"
dest_uuid: "631194f763324d39a224b5728199751f"
mode: GRACEFUL
new_leader_uuid: "d641bfb9187942e9907fe05411aaac98"
 from {username='slave'} at 127.0.0.1:38892
I20260709 12:18:53.235548 16970 raft_consensus.cc:606] T a6f975cf54944342ae97c0a5b2bd6d3a P 631194f763324d39a224b5728199751f [term 1 LEADER]: Received request to transfer leadership to TS d641bfb9187942e9907fe05411aaac98
I20260709 12:18:53.241041 16970 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e3e70fc532a4fb48fcd5d6696714964"
dest_uuid: "631194f763324d39a224b5728199751f"
mode: GRACEFUL
new_leader_uuid: "d641bfb9187942e9907fe05411aaac98"
 from {username='slave'} at 127.0.0.1:38892
I20260709 12:18:53.241597 16970 raft_consensus.cc:606] T 9e3e70fc532a4fb48fcd5d6696714964 P 631194f763324d39a224b5728199751f [term 1 LEADER]: Received request to transfer leadership to TS d641bfb9187942e9907fe05411aaac98
I20260709 12:18:53.247186 16895 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18210c7ef7cc4e2f8d96c1a686d66464"
dest_uuid: "d641bfb9187942e9907fe05411aaac98"
mode: GRACEFUL
new_leader_uuid: "631194f763324d39a224b5728199751f"
 from {username='slave'} at 127.0.0.1:47354
I20260709 12:18:53.247886 16895 raft_consensus.cc:606] T 18210c7ef7cc4e2f8d96c1a686d66464 P d641bfb9187942e9907fe05411aaac98 [term 1 LEADER]: Received request to transfer leadership to TS 631194f763324d39a224b5728199751f
I20260709 12:18:53.257310 17014 consensus_queue.cc:1048] T 847b3169447b428ba3af26a55cb0229a P 5b0ce9a34e224f65aee2d205dd874ba2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:53.267912 17014 consensus_queue.cc:1048] T f556bc405348447bacc2d6bce606766e P 5b0ce9a34e224f65aee2d205dd874ba2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:53.271476 17049 consensus_queue.cc:1048] T 847b3169447b428ba3af26a55cb0229a P 5b0ce9a34e224f65aee2d205dd874ba2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:53.270156 17073 consensus_queue.cc:1048] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P d641bfb9187942e9907fe05411aaac98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:53.285344 17049 consensus_queue.cc:1048] T aababa64926d4ed2a9c906dbae553e1f P 5b0ce9a34e224f65aee2d205dd874ba2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:53.294193 17018 consensus_queue.cc:1048] T 9e3e70fc532a4fb48fcd5d6696714964 P 631194f763324d39a224b5728199751f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:53.294327 17031 consensus_queue.cc:1048] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P d641bfb9187942e9907fe05411aaac98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:53.305583 17014 consensus_queue.cc:1048] T f556bc405348447bacc2d6bce606766e P 5b0ce9a34e224f65aee2d205dd874ba2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:53.305840 17049 consensus_queue.cc:1048] T aababa64926d4ed2a9c906dbae553e1f P 5b0ce9a34e224f65aee2d205dd874ba2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:53.310807 17031 raft_consensus.cc:993] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P d641bfb9187942e9907fe05411aaac98: : Instructing follower 5b0ce9a34e224f65aee2d205dd874ba2 to start an election
I20260709 12:18:53.311277 17031 raft_consensus.cc:1081] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P d641bfb9187942e9907fe05411aaac98 [term 1 LEADER]: Signalling peer 5b0ce9a34e224f65aee2d205dd874ba2 to start an election
I20260709 12:18:53.317936 16821 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0408a37e9dc84eb8b74b3d8fc57ffef7"
dest_uuid: "5b0ce9a34e224f65aee2d205dd874ba2"
 from {username='slave'} at 127.0.0.1:48166
I20260709 12:18:53.318689 16821 raft_consensus.cc:493] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:53.319101 16821 raft_consensus.cc:3060] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:53.327282 16821 raft_consensus.cc:515] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:53.334188 16894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0408a37e9dc84eb8b74b3d8fc57ffef7" candidate_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d641bfb9187942e9907fe05411aaac98"
I20260709 12:18:53.335018 16894 raft_consensus.cc:3055] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P d641bfb9187942e9907fe05411aaac98 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:53.335400 16894 raft_consensus.cc:740] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P d641bfb9187942e9907fe05411aaac98 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d641bfb9187942e9907fe05411aaac98, State: Running, Role: LEADER
I20260709 12:18:53.336431 16894 consensus_queue.cc:260] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P d641bfb9187942e9907fe05411aaac98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:53.338616 16894 raft_consensus.cc:3060] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P d641bfb9187942e9907fe05411aaac98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:53.337848 16821 leader_election.cc:290] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 5b0ce9a34e224f65aee2d205dd874ba2 [CANDIDATE]: Term 2 election: Requested vote from peers d641bfb9187942e9907fe05411aaac98 (127.3.212.130:44221), 631194f763324d39a224b5728199751f (127.3.212.131:32987)
I20260709 12:18:53.345579 17041 raft_consensus.cc:993] T 9e3e70fc532a4fb48fcd5d6696714964 P 631194f763324d39a224b5728199751f: : Instructing follower d641bfb9187942e9907fe05411aaac98 to start an election
I20260709 12:18:53.346030 17041 raft_consensus.cc:1081] T 9e3e70fc532a4fb48fcd5d6696714964 P 631194f763324d39a224b5728199751f [term 1 LEADER]: Signalling peer d641bfb9187942e9907fe05411aaac98 to start an election
I20260709 12:18:53.350875 16894 raft_consensus.cc:2468] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P d641bfb9187942e9907fe05411aaac98 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b0ce9a34e224f65aee2d205dd874ba2 in term 2.
I20260709 12:18:53.352398 16784 leader_election.cc:304] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 5b0ce9a34e224f65aee2d205dd874ba2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b0ce9a34e224f65aee2d205dd874ba2, d641bfb9187942e9907fe05411aaac98; no voters: 
I20260709 12:18:53.353351 17084 raft_consensus.cc:2804] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:53.353885 17084 raft_consensus.cc:697] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 2 LEADER]: Becoming Leader. State: Replica: 5b0ce9a34e224f65aee2d205dd874ba2, State: Running, Role: LEADER
I20260709 12:18:53.354863 17084 consensus_queue.cc:237] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 5b0ce9a34e224f65aee2d205dd874ba2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:53.352530 16969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0408a37e9dc84eb8b74b3d8fc57ffef7" candidate_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "631194f763324d39a224b5728199751f"
I20260709 12:18:53.359177 16894 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e3e70fc532a4fb48fcd5d6696714964"
dest_uuid: "d641bfb9187942e9907fe05411aaac98"
 from {username='slave'} at 127.0.0.1:47344
I20260709 12:18:53.359889 16894 raft_consensus.cc:493] T 9e3e70fc532a4fb48fcd5d6696714964 P d641bfb9187942e9907fe05411aaac98 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:53.360294 16894 raft_consensus.cc:3060] T 9e3e70fc532a4fb48fcd5d6696714964 P d641bfb9187942e9907fe05411aaac98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:53.362386 17018 consensus_queue.cc:1048] T 9e3e70fc532a4fb48fcd5d6696714964 P 631194f763324d39a224b5728199751f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:53.370291 16894 raft_consensus.cc:515] T 9e3e70fc532a4fb48fcd5d6696714964 P d641bfb9187942e9907fe05411aaac98 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:53.373549 16894 leader_election.cc:290] T 9e3e70fc532a4fb48fcd5d6696714964 P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 2 election: Requested vote from peers 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979), 631194f763324d39a224b5728199751f (127.3.212.131:32987)
I20260709 12:18:53.374294 16820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3e70fc532a4fb48fcd5d6696714964" candidate_uuid: "d641bfb9187942e9907fe05411aaac98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5b0ce9a34e224f65aee2d205dd874ba2"
I20260709 12:18:53.377362 16970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e3e70fc532a4fb48fcd5d6696714964" candidate_uuid: "d641bfb9187942e9907fe05411aaac98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "631194f763324d39a224b5728199751f"
I20260709 12:18:53.378105 16970 raft_consensus.cc:3055] T 9e3e70fc532a4fb48fcd5d6696714964 P 631194f763324d39a224b5728199751f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:53.378485 16970 raft_consensus.cc:740] T 9e3e70fc532a4fb48fcd5d6696714964 P 631194f763324d39a224b5728199751f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 631194f763324d39a224b5728199751f, State: Running, Role: LEADER
I20260709 12:18:53.379535 16970 consensus_queue.cc:260] T 9e3e70fc532a4fb48fcd5d6696714964 P 631194f763324d39a224b5728199751f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:53.381134 16970 raft_consensus.cc:3060] T 9e3e70fc532a4fb48fcd5d6696714964 P 631194f763324d39a224b5728199751f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:53.387050 16970 raft_consensus.cc:2468] T 9e3e70fc532a4fb48fcd5d6696714964 P 631194f763324d39a224b5728199751f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d641bfb9187942e9907fe05411aaac98 in term 2.
I20260709 12:18:53.387637 16719 catalog_manager.cc:5697] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 5b0ce9a34e224f65aee2d205dd874ba2 reported cstate change: term changed from 1 to 2, leader changed from d641bfb9187942e9907fe05411aaac98 (127.3.212.130) to 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129). New cstate: current_term: 2 leader_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:53.388166 16862 leader_election.cc:304] T 9e3e70fc532a4fb48fcd5d6696714964 P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 631194f763324d39a224b5728199751f, d641bfb9187942e9907fe05411aaac98; no voters: 5b0ce9a34e224f65aee2d205dd874ba2
I20260709 12:18:53.389139 17031 raft_consensus.cc:2804] T 9e3e70fc532a4fb48fcd5d6696714964 P d641bfb9187942e9907fe05411aaac98 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:53.389657 17031 raft_consensus.cc:697] T 9e3e70fc532a4fb48fcd5d6696714964 P d641bfb9187942e9907fe05411aaac98 [term 2 LEADER]: Becoming Leader. State: Replica: d641bfb9187942e9907fe05411aaac98, State: Running, Role: LEADER
I20260709 12:18:53.390468 17031 consensus_queue.cc:237] T 9e3e70fc532a4fb48fcd5d6696714964 P d641bfb9187942e9907fe05411aaac98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:53.399793 16716 catalog_manager.cc:5697] T 9e3e70fc532a4fb48fcd5d6696714964 P d641bfb9187942e9907fe05411aaac98 reported cstate change: term changed from 1 to 2, leader changed from 631194f763324d39a224b5728199751f (127.3.212.131) to d641bfb9187942e9907fe05411aaac98 (127.3.212.130). New cstate: current_term: 2 leader_uuid: "d641bfb9187942e9907fe05411aaac98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:53.430900 17084 consensus_queue.cc:1048] T 3b08a6f7d06940f395425d7fef9f0977 P 5b0ce9a34e224f65aee2d205dd874ba2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:53.442416 17014 consensus_queue.cc:1048] T 3b08a6f7d06940f395425d7fef9f0977 P 5b0ce9a34e224f65aee2d205dd874ba2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:53.449774 17049 raft_consensus.cc:993] T 3b08a6f7d06940f395425d7fef9f0977 P 5b0ce9a34e224f65aee2d205dd874ba2: : Instructing follower d641bfb9187942e9907fe05411aaac98 to start an election
I20260709 12:18:53.450198 17014 raft_consensus.cc:1081] T 3b08a6f7d06940f395425d7fef9f0977 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 LEADER]: Signalling peer d641bfb9187942e9907fe05411aaac98 to start an election
I20260709 12:18:53.452282 16894 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b08a6f7d06940f395425d7fef9f0977"
dest_uuid: "d641bfb9187942e9907fe05411aaac98"
 from {username='slave'} at 127.0.0.1:47340
I20260709 12:18:53.452961 16894 raft_consensus.cc:493] T 3b08a6f7d06940f395425d7fef9f0977 P d641bfb9187942e9907fe05411aaac98 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:53.453444 16894 raft_consensus.cc:3060] T 3b08a6f7d06940f395425d7fef9f0977 P d641bfb9187942e9907fe05411aaac98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:53.458817 16894 raft_consensus.cc:515] T 3b08a6f7d06940f395425d7fef9f0977 P d641bfb9187942e9907fe05411aaac98 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:53.460716 16894 leader_election.cc:290] T 3b08a6f7d06940f395425d7fef9f0977 P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 2 election: Requested vote from peers 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979), 631194f763324d39a224b5728199751f (127.3.212.131:32987)
I20260709 12:18:53.461608 16821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b08a6f7d06940f395425d7fef9f0977" candidate_uuid: "d641bfb9187942e9907fe05411aaac98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5b0ce9a34e224f65aee2d205dd874ba2"
I20260709 12:18:53.462006 16970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b08a6f7d06940f395425d7fef9f0977" candidate_uuid: "d641bfb9187942e9907fe05411aaac98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "631194f763324d39a224b5728199751f"
I20260709 12:18:53.462332 16821 raft_consensus.cc:3055] T 3b08a6f7d06940f395425d7fef9f0977 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:53.462664 16821 raft_consensus.cc:740] T 3b08a6f7d06940f395425d7fef9f0977 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5b0ce9a34e224f65aee2d205dd874ba2, State: Running, Role: LEADER
I20260709 12:18:53.462672 16970 raft_consensus.cc:3060] T 3b08a6f7d06940f395425d7fef9f0977 P 631194f763324d39a224b5728199751f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:53.463403 16821 consensus_queue.cc:260] T 3b08a6f7d06940f395425d7fef9f0977 P 5b0ce9a34e224f65aee2d205dd874ba2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:53.464521 16821 raft_consensus.cc:3060] T 3b08a6f7d06940f395425d7fef9f0977 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:53.469141 16970 raft_consensus.cc:2468] T 3b08a6f7d06940f395425d7fef9f0977 P 631194f763324d39a224b5728199751f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d641bfb9187942e9907fe05411aaac98 in term 2.
I20260709 12:18:53.470134 16821 raft_consensus.cc:2468] T 3b08a6f7d06940f395425d7fef9f0977 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d641bfb9187942e9907fe05411aaac98 in term 2.
I20260709 12:18:53.470445 16862 leader_election.cc:304] T 3b08a6f7d06940f395425d7fef9f0977 P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631194f763324d39a224b5728199751f, d641bfb9187942e9907fe05411aaac98; no voters: 
I20260709 12:18:53.471441 17031 raft_consensus.cc:2804] T 3b08a6f7d06940f395425d7fef9f0977 P d641bfb9187942e9907fe05411aaac98 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:53.471853 17031 raft_consensus.cc:697] T 3b08a6f7d06940f395425d7fef9f0977 P d641bfb9187942e9907fe05411aaac98 [term 2 LEADER]: Becoming Leader. State: Replica: d641bfb9187942e9907fe05411aaac98, State: Running, Role: LEADER
I20260709 12:18:53.472600 17031 consensus_queue.cc:237] T 3b08a6f7d06940f395425d7fef9f0977 P d641bfb9187942e9907fe05411aaac98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:53.479264 16716 catalog_manager.cc:5697] T 3b08a6f7d06940f395425d7fef9f0977 P d641bfb9187942e9907fe05411aaac98 reported cstate change: term changed from 1 to 2, leader changed from 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129) to d641bfb9187942e9907fe05411aaac98 (127.3.212.130). New cstate: current_term: 2 leader_uuid: "d641bfb9187942e9907fe05411aaac98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:53.569006 17044 raft_consensus.cc:993] T a6f975cf54944342ae97c0a5b2bd6d3a P 631194f763324d39a224b5728199751f: : Instructing follower d641bfb9187942e9907fe05411aaac98 to start an election
I20260709 12:18:53.569489 17044 raft_consensus.cc:1081] T a6f975cf54944342ae97c0a5b2bd6d3a P 631194f763324d39a224b5728199751f [term 1 LEADER]: Signalling peer d641bfb9187942e9907fe05411aaac98 to start an election
I20260709 12:18:53.571096 16894 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a6f975cf54944342ae97c0a5b2bd6d3a"
dest_uuid: "d641bfb9187942e9907fe05411aaac98"
 from {username='slave'} at 127.0.0.1:47344
I20260709 12:18:53.571609 16894 raft_consensus.cc:493] T a6f975cf54944342ae97c0a5b2bd6d3a P d641bfb9187942e9907fe05411aaac98 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:53.572345 16894 raft_consensus.cc:3060] T a6f975cf54944342ae97c0a5b2bd6d3a P d641bfb9187942e9907fe05411aaac98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:53.577775 16894 raft_consensus.cc:515] T a6f975cf54944342ae97c0a5b2bd6d3a P d641bfb9187942e9907fe05411aaac98 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:53.579643 16894 leader_election.cc:290] T a6f975cf54944342ae97c0a5b2bd6d3a P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 2 election: Requested vote from peers 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979), 631194f763324d39a224b5728199751f (127.3.212.131:32987)
I20260709 12:18:53.580379 16821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6f975cf54944342ae97c0a5b2bd6d3a" candidate_uuid: "d641bfb9187942e9907fe05411aaac98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5b0ce9a34e224f65aee2d205dd874ba2"
I20260709 12:18:53.581013 16970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6f975cf54944342ae97c0a5b2bd6d3a" candidate_uuid: "d641bfb9187942e9907fe05411aaac98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "631194f763324d39a224b5728199751f"
I20260709 12:18:53.581041 16821 raft_consensus.cc:3060] T a6f975cf54944342ae97c0a5b2bd6d3a P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:53.581635 16970 raft_consensus.cc:3055] T a6f975cf54944342ae97c0a5b2bd6d3a P 631194f763324d39a224b5728199751f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:53.581909 16970 raft_consensus.cc:740] T a6f975cf54944342ae97c0a5b2bd6d3a P 631194f763324d39a224b5728199751f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 631194f763324d39a224b5728199751f, State: Running, Role: LEADER
I20260709 12:18:53.582536 16970 consensus_queue.cc:260] T a6f975cf54944342ae97c0a5b2bd6d3a P 631194f763324d39a224b5728199751f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:53.583516 16970 raft_consensus.cc:3060] T a6f975cf54944342ae97c0a5b2bd6d3a P 631194f763324d39a224b5728199751f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:53.587668 16821 raft_consensus.cc:2468] T a6f975cf54944342ae97c0a5b2bd6d3a P 5b0ce9a34e224f65aee2d205dd874ba2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d641bfb9187942e9907fe05411aaac98 in term 2.
I20260709 12:18:53.589082 16859 leader_election.cc:304] T a6f975cf54944342ae97c0a5b2bd6d3a P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b0ce9a34e224f65aee2d205dd874ba2, d641bfb9187942e9907fe05411aaac98; no voters: 
I20260709 12:18:53.590004 17031 raft_consensus.cc:2804] T a6f975cf54944342ae97c0a5b2bd6d3a P d641bfb9187942e9907fe05411aaac98 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:53.590457 17031 raft_consensus.cc:697] T a6f975cf54944342ae97c0a5b2bd6d3a P d641bfb9187942e9907fe05411aaac98 [term 2 LEADER]: Becoming Leader. State: Replica: d641bfb9187942e9907fe05411aaac98, State: Running, Role: LEADER
I20260709 12:18:53.590545 16970 raft_consensus.cc:2468] T a6f975cf54944342ae97c0a5b2bd6d3a P 631194f763324d39a224b5728199751f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d641bfb9187942e9907fe05411aaac98 in term 2.
I20260709 12:18:53.591369 17031 consensus_queue.cc:237] T a6f975cf54944342ae97c0a5b2bd6d3a P d641bfb9187942e9907fe05411aaac98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:53.594769 17019 raft_consensus.cc:993] T 18210c7ef7cc4e2f8d96c1a686d66464 P d641bfb9187942e9907fe05411aaac98: : Instructing follower 631194f763324d39a224b5728199751f to start an election
I20260709 12:18:53.595273 17031 raft_consensus.cc:1081] T 18210c7ef7cc4e2f8d96c1a686d66464 P d641bfb9187942e9907fe05411aaac98 [term 1 LEADER]: Signalling peer 631194f763324d39a224b5728199751f to start an election
I20260709 12:18:53.596994 16970 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "18210c7ef7cc4e2f8d96c1a686d66464"
dest_uuid: "631194f763324d39a224b5728199751f"
 from {username='slave'} at 127.0.0.1:38882
I20260709 12:18:53.597539 16970 raft_consensus.cc:493] T 18210c7ef7cc4e2f8d96c1a686d66464 P 631194f763324d39a224b5728199751f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:53.597867 16970 raft_consensus.cc:3060] T 18210c7ef7cc4e2f8d96c1a686d66464 P 631194f763324d39a224b5728199751f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:53.598701 16716 catalog_manager.cc:5697] T a6f975cf54944342ae97c0a5b2bd6d3a P d641bfb9187942e9907fe05411aaac98 reported cstate change: term changed from 1 to 2, leader changed from 631194f763324d39a224b5728199751f (127.3.212.131) to d641bfb9187942e9907fe05411aaac98 (127.3.212.130). New cstate: current_term: 2 leader_uuid: "d641bfb9187942e9907fe05411aaac98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:53.604990 16970 raft_consensus.cc:515] T 18210c7ef7cc4e2f8d96c1a686d66464 P 631194f763324d39a224b5728199751f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:53.606961 16970 leader_election.cc:290] T 18210c7ef7cc4e2f8d96c1a686d66464 P 631194f763324d39a224b5728199751f [CANDIDATE]: Term 2 election: Requested vote from peers 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979), d641bfb9187942e9907fe05411aaac98 (127.3.212.130:44221)
I20260709 12:18:53.607865 16821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18210c7ef7cc4e2f8d96c1a686d66464" candidate_uuid: "631194f763324d39a224b5728199751f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5b0ce9a34e224f65aee2d205dd874ba2"
I20260709 12:18:53.608213 16894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18210c7ef7cc4e2f8d96c1a686d66464" candidate_uuid: "631194f763324d39a224b5728199751f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d641bfb9187942e9907fe05411aaac98"
I20260709 12:18:53.608572 16821 raft_consensus.cc:3060] T 18210c7ef7cc4e2f8d96c1a686d66464 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:53.608871 16894 raft_consensus.cc:3055] T 18210c7ef7cc4e2f8d96c1a686d66464 P d641bfb9187942e9907fe05411aaac98 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:53.609232 16894 raft_consensus.cc:740] T 18210c7ef7cc4e2f8d96c1a686d66464 P d641bfb9187942e9907fe05411aaac98 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d641bfb9187942e9907fe05411aaac98, State: Running, Role: LEADER
I20260709 12:18:53.610111 16894 consensus_queue.cc:260] T 18210c7ef7cc4e2f8d96c1a686d66464 P d641bfb9187942e9907fe05411aaac98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:53.611400 16894 raft_consensus.cc:3060] T 18210c7ef7cc4e2f8d96c1a686d66464 P d641bfb9187942e9907fe05411aaac98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:53.616274 16821 raft_consensus.cc:2468] T 18210c7ef7cc4e2f8d96c1a686d66464 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631194f763324d39a224b5728199751f in term 2.
I20260709 12:18:53.617741 16933 leader_election.cc:304] T 18210c7ef7cc4e2f8d96c1a686d66464 P 631194f763324d39a224b5728199751f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b0ce9a34e224f65aee2d205dd874ba2, 631194f763324d39a224b5728199751f; no voters: 
I20260709 12:18:53.618404 16894 raft_consensus.cc:2468] T 18210c7ef7cc4e2f8d96c1a686d66464 P d641bfb9187942e9907fe05411aaac98 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631194f763324d39a224b5728199751f in term 2.
I20260709 12:18:53.618474 17044 raft_consensus.cc:2804] T 18210c7ef7cc4e2f8d96c1a686d66464 P 631194f763324d39a224b5728199751f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:53.619099 17044 raft_consensus.cc:697] T 18210c7ef7cc4e2f8d96c1a686d66464 P 631194f763324d39a224b5728199751f [term 2 LEADER]: Becoming Leader. State: Replica: 631194f763324d39a224b5728199751f, State: Running, Role: LEADER
I20260709 12:18:53.619963 17044 consensus_queue.cc:237] T 18210c7ef7cc4e2f8d96c1a686d66464 P 631194f763324d39a224b5728199751f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:53.627404 16716 catalog_manager.cc:5697] T 18210c7ef7cc4e2f8d96c1a686d66464 P 631194f763324d39a224b5728199751f reported cstate change: term changed from 1 to 2, leader changed from d641bfb9187942e9907fe05411aaac98 (127.3.212.130) to 631194f763324d39a224b5728199751f (127.3.212.131). New cstate: current_term: 2 leader_uuid: "631194f763324d39a224b5728199751f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:53.804229 16821 raft_consensus.cc:3060] T 9e3e70fc532a4fb48fcd5d6696714964 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:53.809798 16821 raft_consensus.cc:1275] T 9e3e70fc532a4fb48fcd5d6696714964 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 2 FOLLOWER]: Refusing update from remote peer d641bfb9187942e9907fe05411aaac98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:53.811142 17019 consensus_queue.cc:1048] T 9e3e70fc532a4fb48fcd5d6696714964 P d641bfb9187942e9907fe05411aaac98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:53.819077 16970 raft_consensus.cc:1275] T 9e3e70fc532a4fb48fcd5d6696714964 P 631194f763324d39a224b5728199751f [term 2 FOLLOWER]: Refusing update from remote peer d641bfb9187942e9907fe05411aaac98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:53.821005 17032 consensus_queue.cc:1048] T 9e3e70fc532a4fb48fcd5d6696714964 P d641bfb9187942e9907fe05411aaac98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:53.843750 16894 raft_consensus.cc:1275] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P d641bfb9187942e9907fe05411aaac98 [term 2 FOLLOWER]: Refusing update from remote peer 5b0ce9a34e224f65aee2d205dd874ba2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:53.845000 17014 consensus_queue.cc:1048] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 5b0ce9a34e224f65aee2d205dd874ba2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:53.856995 16970 raft_consensus.cc:3060] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 631194f763324d39a224b5728199751f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:53.863353 16970 raft_consensus.cc:1275] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 631194f763324d39a224b5728199751f [term 2 FOLLOWER]: Refusing update from remote peer 5b0ce9a34e224f65aee2d205dd874ba2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:53.865139 17084 consensus_queue.cc:1048] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 5b0ce9a34e224f65aee2d205dd874ba2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:53.948287 16821 raft_consensus.cc:1275] T 3b08a6f7d06940f395425d7fef9f0977 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 2 FOLLOWER]: Refusing update from remote peer d641bfb9187942e9907fe05411aaac98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:53.949783 17032 consensus_queue.cc:1048] T 3b08a6f7d06940f395425d7fef9f0977 P d641bfb9187942e9907fe05411aaac98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:53.958750 16968 raft_consensus.cc:1275] T 3b08a6f7d06940f395425d7fef9f0977 P 631194f763324d39a224b5728199751f [term 2 FOLLOWER]: Refusing update from remote peer d641bfb9187942e9907fe05411aaac98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:53.960825 17032 consensus_queue.cc:1048] T 3b08a6f7d06940f395425d7fef9f0977 P d641bfb9187942e9907fe05411aaac98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:54.056707 16821 raft_consensus.cc:1275] T a6f975cf54944342ae97c0a5b2bd6d3a P 5b0ce9a34e224f65aee2d205dd874ba2 [term 2 FOLLOWER]: Refusing update from remote peer d641bfb9187942e9907fe05411aaac98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:54.058202 17032 consensus_queue.cc:1048] T a6f975cf54944342ae97c0a5b2bd6d3a P d641bfb9187942e9907fe05411aaac98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:54.067909 16968 raft_consensus.cc:1275] T a6f975cf54944342ae97c0a5b2bd6d3a P 631194f763324d39a224b5728199751f [term 2 FOLLOWER]: Refusing update from remote peer d641bfb9187942e9907fe05411aaac98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:54.070343 17073 consensus_queue.cc:1048] T a6f975cf54944342ae97c0a5b2bd6d3a P d641bfb9187942e9907fe05411aaac98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:54.123678 16894 raft_consensus.cc:1275] T 18210c7ef7cc4e2f8d96c1a686d66464 P d641bfb9187942e9907fe05411aaac98 [term 2 FOLLOWER]: Refusing update from remote peer 631194f763324d39a224b5728199751f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:54.125260 17044 consensus_queue.cc:1048] T 18210c7ef7cc4e2f8d96c1a686d66464 P 631194f763324d39a224b5728199751f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:54.141744 16821 raft_consensus.cc:1275] T 18210c7ef7cc4e2f8d96c1a686d66464 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 2 FOLLOWER]: Refusing update from remote peer 631194f763324d39a224b5728199751f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:54.143235 17044 consensus_queue.cc:1048] T 18210c7ef7cc4e2f8d96c1a686d66464 P 631194f763324d39a224b5728199751f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:56.285497 16716 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34548:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:18:56.288805 16716 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:18:56.342521 16807 tablet_service.cc:1511] Processing CreateTablet for tablet 5fabedcf8a28457fab071f75fe106037 (DEFAULT_TABLE table=soft_deleted_table [id=bcf01e86d58f4f1190171d6eb08321d6]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:18:56.343765 16879 tablet_service.cc:1511] Processing CreateTablet for tablet 5fabedcf8a28457fab071f75fe106037 (DEFAULT_TABLE table=soft_deleted_table [id=bcf01e86d58f4f1190171d6eb08321d6]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:18:56.344522 16807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fabedcf8a28457fab071f75fe106037. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:56.347143 16956 tablet_service.cc:1511] Processing CreateTablet for tablet 5fabedcf8a28457fab071f75fe106037 (DEFAULT_TABLE table=soft_deleted_table [id=bcf01e86d58f4f1190171d6eb08321d6]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:18:56.348809 16956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fabedcf8a28457fab071f75fe106037. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:56.349328 16883 tablet_service.cc:1511] Processing CreateTablet for tablet 8affc906415f4b3aa5ed3e9a971f9aec (DEFAULT_TABLE table=soft_deleted_table [id=bcf01e86d58f4f1190171d6eb08321d6]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:18:56.350330 16960 tablet_service.cc:1511] Processing CreateTablet for tablet 8affc906415f4b3aa5ed3e9a971f9aec (DEFAULT_TABLE table=soft_deleted_table [id=bcf01e86d58f4f1190171d6eb08321d6]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:18:56.352084 16804 tablet_service.cc:1511] Processing CreateTablet for tablet 8affc906415f4b3aa5ed3e9a971f9aec (DEFAULT_TABLE table=soft_deleted_table [id=bcf01e86d58f4f1190171d6eb08321d6]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:18:56.353246 16960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8affc906415f4b3aa5ed3e9a971f9aec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:56.353874 16804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8affc906415f4b3aa5ed3e9a971f9aec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:56.345640 16879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fabedcf8a28457fab071f75fe106037. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:56.355649 16953 tablet_service.cc:1511] Processing CreateTablet for tablet 73a5894bf58143d3a71dabf8231d33ba (DEFAULT_TABLE table=soft_deleted_table [id=bcf01e86d58f4f1190171d6eb08321d6]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:18:56.359015 16885 tablet_service.cc:1511] Processing CreateTablet for tablet 73a5894bf58143d3a71dabf8231d33ba (DEFAULT_TABLE table=soft_deleted_table [id=bcf01e86d58f4f1190171d6eb08321d6]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:18:56.359948 16808 tablet_service.cc:1511] Processing CreateTablet for tablet 73a5894bf58143d3a71dabf8231d33ba (DEFAULT_TABLE table=soft_deleted_table [id=bcf01e86d58f4f1190171d6eb08321d6]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:18:56.360594 16885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73a5894bf58143d3a71dabf8231d33ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:56.362038 16808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73a5894bf58143d3a71dabf8231d33ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:56.362661 16811 tablet_service.cc:1511] Processing CreateTablet for tablet 0f2665342de64990947409a4e83aa0a2 (DEFAULT_TABLE table=soft_deleted_table [id=bcf01e86d58f4f1190171d6eb08321d6]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:18:56.364157 16811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f2665342de64990947409a4e83aa0a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:56.366885 16883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8affc906415f4b3aa5ed3e9a971f9aec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:56.366637 16952 tablet_service.cc:1511] Processing CreateTablet for tablet 0f2665342de64990947409a4e83aa0a2 (DEFAULT_TABLE table=soft_deleted_table [id=bcf01e86d58f4f1190171d6eb08321d6]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:18:56.368319 16952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f2665342de64990947409a4e83aa0a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:56.368973 16959 tablet_service.cc:1511] Processing CreateTablet for tablet 3c06f7f07974452599bbaebd7f818ca9 (DEFAULT_TABLE table=soft_deleted_table [id=bcf01e86d58f4f1190171d6eb08321d6]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:18:56.369283 16884 tablet_service.cc:1511] Processing CreateTablet for tablet 3c06f7f07974452599bbaebd7f818ca9 (DEFAULT_TABLE table=soft_deleted_table [id=bcf01e86d58f4f1190171d6eb08321d6]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:18:56.370661 16884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c06f7f07974452599bbaebd7f818ca9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:56.371417 16805 tablet_service.cc:1511] Processing CreateTablet for tablet 3c06f7f07974452599bbaebd7f818ca9 (DEFAULT_TABLE table=soft_deleted_table [id=bcf01e86d58f4f1190171d6eb08321d6]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:18:56.372403 16810 tablet_service.cc:1511] Processing CreateTablet for tablet 86e15b6028704208a711b8069cba2929 (DEFAULT_TABLE table=soft_deleted_table [id=bcf01e86d58f4f1190171d6eb08321d6]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:18:56.374614 16958 tablet_service.cc:1511] Processing CreateTablet for tablet 86e15b6028704208a711b8069cba2929 (DEFAULT_TABLE table=soft_deleted_table [id=bcf01e86d58f4f1190171d6eb08321d6]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:18:56.378644 16803 tablet_service.cc:1511] Processing CreateTablet for tablet 04bbf32b02ed450f99f360da0e55cff7 (DEFAULT_TABLE table=soft_deleted_table [id=bcf01e86d58f4f1190171d6eb08321d6]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:18:56.380676 16959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c06f7f07974452599bbaebd7f818ca9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:56.381196 16955 tablet_service.cc:1511] Processing CreateTablet for tablet 04bbf32b02ed450f99f360da0e55cff7 (DEFAULT_TABLE table=soft_deleted_table [id=bcf01e86d58f4f1190171d6eb08321d6]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:18:56.382359 16953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73a5894bf58143d3a71dabf8231d33ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:56.363188 16880 tablet_service.cc:1511] Processing CreateTablet for tablet 0f2665342de64990947409a4e83aa0a2 (DEFAULT_TABLE table=soft_deleted_table [id=bcf01e86d58f4f1190171d6eb08321d6]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:18:56.386782 16880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f2665342de64990947409a4e83aa0a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:56.389603 16810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86e15b6028704208a711b8069cba2929. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:56.386812 16954 tablet_service.cc:1511] Processing CreateTablet for tablet 877e171775ed47c8af9b177b9e7a13fa (DEFAULT_TABLE table=soft_deleted_table [id=bcf01e86d58f4f1190171d6eb08321d6]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:18:56.390328 16805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c06f7f07974452599bbaebd7f818ca9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:56.390875 16954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 877e171775ed47c8af9b177b9e7a13fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:56.377004 16882 tablet_service.cc:1511] Processing CreateTablet for tablet 86e15b6028704208a711b8069cba2929 (DEFAULT_TABLE table=soft_deleted_table [id=bcf01e86d58f4f1190171d6eb08321d6]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:18:56.393646 16882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86e15b6028704208a711b8069cba2929. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:56.397457 16958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86e15b6028704208a711b8069cba2929. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:56.400255 16803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04bbf32b02ed450f99f360da0e55cff7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:56.402448 16955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04bbf32b02ed450f99f360da0e55cff7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:56.407644 16957 tablet_service.cc:1511] Processing CreateTablet for tablet 9caa951d90c54e5086bc8d886ba6c450 (DEFAULT_TABLE table=soft_deleted_table [id=bcf01e86d58f4f1190171d6eb08321d6]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:18:56.409267 16957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9caa951d90c54e5086bc8d886ba6c450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:56.419275 16806 tablet_service.cc:1511] Processing CreateTablet for tablet 877e171775ed47c8af9b177b9e7a13fa (DEFAULT_TABLE table=soft_deleted_table [id=bcf01e86d58f4f1190171d6eb08321d6]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:18:56.420885 16806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 877e171775ed47c8af9b177b9e7a13fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:56.424619 16809 tablet_service.cc:1511] Processing CreateTablet for tablet 9caa951d90c54e5086bc8d886ba6c450 (DEFAULT_TABLE table=soft_deleted_table [id=bcf01e86d58f4f1190171d6eb08321d6]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:18:56.426357 16809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9caa951d90c54e5086bc8d886ba6c450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:56.426057 16878 tablet_service.cc:1511] Processing CreateTablet for tablet 9caa951d90c54e5086bc8d886ba6c450 (DEFAULT_TABLE table=soft_deleted_table [id=bcf01e86d58f4f1190171d6eb08321d6]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:18:56.427500 16878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9caa951d90c54e5086bc8d886ba6c450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:56.430783 16881 tablet_service.cc:1511] Processing CreateTablet for tablet 04bbf32b02ed450f99f360da0e55cff7 (DEFAULT_TABLE table=soft_deleted_table [id=bcf01e86d58f4f1190171d6eb08321d6]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:18:56.432545 16881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04bbf32b02ed450f99f360da0e55cff7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:56.434922 16886 tablet_service.cc:1511] Processing CreateTablet for tablet 877e171775ed47c8af9b177b9e7a13fa (DEFAULT_TABLE table=soft_deleted_table [id=bcf01e86d58f4f1190171d6eb08321d6]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:18:56.436714 16886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 877e171775ed47c8af9b177b9e7a13fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:56.440052 17114 tablet_bootstrap.cc:492] T 9caa951d90c54e5086bc8d886ba6c450 P 631194f763324d39a224b5728199751f: Bootstrap starting.
I20260709 12:18:56.448824 17114 tablet_bootstrap.cc:654] T 9caa951d90c54e5086bc8d886ba6c450 P 631194f763324d39a224b5728199751f: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:56.461692 17114 tablet_bootstrap.cc:492] T 9caa951d90c54e5086bc8d886ba6c450 P 631194f763324d39a224b5728199751f: No bootstrap required, opened a new log
I20260709 12:18:56.462270 17114 ts_tablet_manager.cc:1403] T 9caa951d90c54e5086bc8d886ba6c450 P 631194f763324d39a224b5728199751f: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.003s
I20260709 12:18:56.467162 17114 raft_consensus.cc:359] T 9caa951d90c54e5086bc8d886ba6c450 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:56.468143 17114 raft_consensus.cc:385] T 9caa951d90c54e5086bc8d886ba6c450 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:56.468493 17114 raft_consensus.cc:740] T 9caa951d90c54e5086bc8d886ba6c450 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631194f763324d39a224b5728199751f, State: Initialized, Role: FOLLOWER
I20260709 12:18:56.469427 17114 consensus_queue.cc:260] T 9caa951d90c54e5086bc8d886ba6c450 P 631194f763324d39a224b5728199751f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:56.472505 17114 ts_tablet_manager.cc:1434] T 9caa951d90c54e5086bc8d886ba6c450 P 631194f763324d39a224b5728199751f: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
W20260709 12:18:56.521862 16787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:32987, user_credentials={real_user=slave}} blocked reactor thread for 137574us
I20260709 12:18:56.557368 17117 tablet_bootstrap.cc:492] T 9caa951d90c54e5086bc8d886ba6c450 P 5b0ce9a34e224f65aee2d205dd874ba2: Bootstrap starting.
I20260709 12:18:56.562456 17114 tablet_bootstrap.cc:492] T 5fabedcf8a28457fab071f75fe106037 P 631194f763324d39a224b5728199751f: Bootstrap starting.
I20260709 12:18:56.571599 17114 tablet_bootstrap.cc:654] T 5fabedcf8a28457fab071f75fe106037 P 631194f763324d39a224b5728199751f: Neither blocks nor log segments found. Creating new log.
W20260709 12:18:56.590541 16767 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:18:56.601738 17118 tablet_bootstrap.cc:492] T 04bbf32b02ed450f99f360da0e55cff7 P d641bfb9187942e9907fe05411aaac98: Bootstrap starting.
W20260709 12:18:56.605561 16859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:45979, user_credentials={real_user=slave}} blocked reactor thread for 43679.6us
I20260709 12:18:56.609478 17117 tablet_bootstrap.cc:654] T 9caa951d90c54e5086bc8d886ba6c450 P 5b0ce9a34e224f65aee2d205dd874ba2: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:56.629046 17114 tablet_bootstrap.cc:492] T 5fabedcf8a28457fab071f75fe106037 P 631194f763324d39a224b5728199751f: No bootstrap required, opened a new log
I20260709 12:18:56.629688 17114 ts_tablet_manager.cc:1403] T 5fabedcf8a28457fab071f75fe106037 P 631194f763324d39a224b5728199751f: Time spent bootstrapping tablet: real 0.067s	user 0.014s	sys 0.014s
I20260709 12:18:56.629983 17118 tablet_bootstrap.cc:654] T 04bbf32b02ed450f99f360da0e55cff7 P d641bfb9187942e9907fe05411aaac98: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:56.630142 17117 tablet_bootstrap.cc:492] T 9caa951d90c54e5086bc8d886ba6c450 P 5b0ce9a34e224f65aee2d205dd874ba2: No bootstrap required, opened a new log
I20260709 12:18:56.630709 17117 ts_tablet_manager.cc:1403] T 9caa951d90c54e5086bc8d886ba6c450 P 5b0ce9a34e224f65aee2d205dd874ba2: Time spent bootstrapping tablet: real 0.074s	user 0.015s	sys 0.011s
I20260709 12:18:56.632851 17114 raft_consensus.cc:359] T 5fabedcf8a28457fab071f75fe106037 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:56.633728 17114 raft_consensus.cc:385] T 5fabedcf8a28457fab071f75fe106037 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:56.634085 17114 raft_consensus.cc:740] T 5fabedcf8a28457fab071f75fe106037 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631194f763324d39a224b5728199751f, State: Initialized, Role: FOLLOWER
I20260709 12:18:56.633875 17117 raft_consensus.cc:359] T 9caa951d90c54e5086bc8d886ba6c450 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:56.634697 17117 raft_consensus.cc:385] T 9caa951d90c54e5086bc8d886ba6c450 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:56.634914 17118 tablet_bootstrap.cc:492] T 04bbf32b02ed450f99f360da0e55cff7 P d641bfb9187942e9907fe05411aaac98: No bootstrap required, opened a new log
I20260709 12:18:56.635005 17117 raft_consensus.cc:740] T 9caa951d90c54e5086bc8d886ba6c450 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b0ce9a34e224f65aee2d205dd874ba2, State: Initialized, Role: FOLLOWER
I20260709 12:18:56.635447 17118 ts_tablet_manager.cc:1403] T 04bbf32b02ed450f99f360da0e55cff7 P d641bfb9187942e9907fe05411aaac98: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.000s
I20260709 12:18:56.634925 17114 consensus_queue.cc:260] T 5fabedcf8a28457fab071f75fe106037 P 631194f763324d39a224b5728199751f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:56.635991 17117 consensus_queue.cc:260] T 9caa951d90c54e5086bc8d886ba6c450 P 5b0ce9a34e224f65aee2d205dd874ba2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:56.638413 17118 raft_consensus.cc:359] T 04bbf32b02ed450f99f360da0e55cff7 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:56.639125 17118 raft_consensus.cc:385] T 04bbf32b02ed450f99f360da0e55cff7 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:56.639412 17118 raft_consensus.cc:740] T 04bbf32b02ed450f99f360da0e55cff7 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d641bfb9187942e9907fe05411aaac98, State: Initialized, Role: FOLLOWER
I20260709 12:18:56.640100 17118 consensus_queue.cc:260] T 04bbf32b02ed450f99f360da0e55cff7 P d641bfb9187942e9907fe05411aaac98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:56.641575 17118 ts_tablet_manager.cc:1434] T 04bbf32b02ed450f99f360da0e55cff7 P d641bfb9187942e9907fe05411aaac98: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.004s
I20260709 12:18:56.642649 17118 tablet_bootstrap.cc:492] T 73a5894bf58143d3a71dabf8231d33ba P d641bfb9187942e9907fe05411aaac98: Bootstrap starting.
I20260709 12:18:56.643496 17114 ts_tablet_manager.cc:1434] T 5fabedcf8a28457fab071f75fe106037 P 631194f763324d39a224b5728199751f: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 12:18:56.644595 17114 tablet_bootstrap.cc:492] T 3c06f7f07974452599bbaebd7f818ca9 P 631194f763324d39a224b5728199751f: Bootstrap starting.
I20260709 12:18:56.646912 17117 ts_tablet_manager.cc:1434] T 9caa951d90c54e5086bc8d886ba6c450 P 5b0ce9a34e224f65aee2d205dd874ba2: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.004s
I20260709 12:18:56.648396 17117 tablet_bootstrap.cc:492] T 3c06f7f07974452599bbaebd7f818ca9 P 5b0ce9a34e224f65aee2d205dd874ba2: Bootstrap starting.
I20260709 12:18:56.649832 17118 tablet_bootstrap.cc:654] T 73a5894bf58143d3a71dabf8231d33ba P d641bfb9187942e9907fe05411aaac98: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:56.651839 17114 tablet_bootstrap.cc:654] T 3c06f7f07974452599bbaebd7f818ca9 P 631194f763324d39a224b5728199751f: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:56.655982 17117 tablet_bootstrap.cc:654] T 3c06f7f07974452599bbaebd7f818ca9 P 5b0ce9a34e224f65aee2d205dd874ba2: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:56.664052 17114 tablet_bootstrap.cc:492] T 3c06f7f07974452599bbaebd7f818ca9 P 631194f763324d39a224b5728199751f: No bootstrap required, opened a new log
I20260709 12:18:56.664605 17114 ts_tablet_manager.cc:1403] T 3c06f7f07974452599bbaebd7f818ca9 P 631194f763324d39a224b5728199751f: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.009s
I20260709 12:18:56.668032 17114 raft_consensus.cc:359] T 3c06f7f07974452599bbaebd7f818ca9 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:56.668792 17114 raft_consensus.cc:385] T 3c06f7f07974452599bbaebd7f818ca9 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:56.669092 17114 raft_consensus.cc:740] T 3c06f7f07974452599bbaebd7f818ca9 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631194f763324d39a224b5728199751f, State: Initialized, Role: FOLLOWER
I20260709 12:18:56.670002 17114 consensus_queue.cc:260] T 3c06f7f07974452599bbaebd7f818ca9 P 631194f763324d39a224b5728199751f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:56.677783 17117 tablet_bootstrap.cc:492] T 3c06f7f07974452599bbaebd7f818ca9 P 5b0ce9a34e224f65aee2d205dd874ba2: No bootstrap required, opened a new log
I20260709 12:18:56.678404 17117 ts_tablet_manager.cc:1403] T 3c06f7f07974452599bbaebd7f818ca9 P 5b0ce9a34e224f65aee2d205dd874ba2: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.010s
I20260709 12:18:56.681610 17117 raft_consensus.cc:359] T 3c06f7f07974452599bbaebd7f818ca9 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:56.682786 17114 ts_tablet_manager.cc:1434] T 3c06f7f07974452599bbaebd7f818ca9 P 631194f763324d39a224b5728199751f: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.004s
I20260709 12:18:56.682789 17117 raft_consensus.cc:385] T 3c06f7f07974452599bbaebd7f818ca9 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:56.683507 17117 raft_consensus.cc:740] T 3c06f7f07974452599bbaebd7f818ca9 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b0ce9a34e224f65aee2d205dd874ba2, State: Initialized, Role: FOLLOWER
I20260709 12:18:56.684238 17114 tablet_bootstrap.cc:492] T 0f2665342de64990947409a4e83aa0a2 P 631194f763324d39a224b5728199751f: Bootstrap starting.
I20260709 12:18:56.684237 17117 consensus_queue.cc:260] T 3c06f7f07974452599bbaebd7f818ca9 P 5b0ce9a34e224f65aee2d205dd874ba2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:56.688151 17117 ts_tablet_manager.cc:1434] T 3c06f7f07974452599bbaebd7f818ca9 P 5b0ce9a34e224f65aee2d205dd874ba2: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.007s
I20260709 12:18:56.689167 17117 tablet_bootstrap.cc:492] T 877e171775ed47c8af9b177b9e7a13fa P 5b0ce9a34e224f65aee2d205dd874ba2: Bootstrap starting.
I20260709 12:18:56.695914 17117 tablet_bootstrap.cc:654] T 877e171775ed47c8af9b177b9e7a13fa P 5b0ce9a34e224f65aee2d205dd874ba2: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:56.696833 17114 tablet_bootstrap.cc:654] T 0f2665342de64990947409a4e83aa0a2 P 631194f763324d39a224b5728199751f: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:56.698017 17118 tablet_bootstrap.cc:492] T 73a5894bf58143d3a71dabf8231d33ba P d641bfb9187942e9907fe05411aaac98: No bootstrap required, opened a new log
I20260709 12:18:56.698652 17118 ts_tablet_manager.cc:1403] T 73a5894bf58143d3a71dabf8231d33ba P d641bfb9187942e9907fe05411aaac98: Time spent bootstrapping tablet: real 0.056s	user 0.012s	sys 0.043s
I20260709 12:18:56.702283 17118 raft_consensus.cc:359] T 73a5894bf58143d3a71dabf8231d33ba P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:56.703310 17118 raft_consensus.cc:385] T 73a5894bf58143d3a71dabf8231d33ba P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:56.703689 17118 raft_consensus.cc:740] T 73a5894bf58143d3a71dabf8231d33ba P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d641bfb9187942e9907fe05411aaac98, State: Initialized, Role: FOLLOWER
I20260709 12:18:56.704668 17118 consensus_queue.cc:260] T 73a5894bf58143d3a71dabf8231d33ba P d641bfb9187942e9907fe05411aaac98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:56.707988 17118 ts_tablet_manager.cc:1434] T 73a5894bf58143d3a71dabf8231d33ba P d641bfb9187942e9907fe05411aaac98: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:18:56.710501 17118 tablet_bootstrap.cc:492] T 877e171775ed47c8af9b177b9e7a13fa P d641bfb9187942e9907fe05411aaac98: Bootstrap starting.
I20260709 12:18:56.712744 17114 tablet_bootstrap.cc:492] T 0f2665342de64990947409a4e83aa0a2 P 631194f763324d39a224b5728199751f: No bootstrap required, opened a new log
I20260709 12:18:56.712900 17117 tablet_bootstrap.cc:492] T 877e171775ed47c8af9b177b9e7a13fa P 5b0ce9a34e224f65aee2d205dd874ba2: No bootstrap required, opened a new log
I20260709 12:18:56.713367 17114 ts_tablet_manager.cc:1403] T 0f2665342de64990947409a4e83aa0a2 P 631194f763324d39a224b5728199751f: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.013s
I20260709 12:18:56.713765 17117 ts_tablet_manager.cc:1403] T 877e171775ed47c8af9b177b9e7a13fa P 5b0ce9a34e224f65aee2d205dd874ba2: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.007s
I20260709 12:18:56.716889 17114 raft_consensus.cc:359] T 0f2665342de64990947409a4e83aa0a2 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:56.717823 17114 raft_consensus.cc:385] T 0f2665342de64990947409a4e83aa0a2 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:56.718003 17118 tablet_bootstrap.cc:654] T 877e171775ed47c8af9b177b9e7a13fa P d641bfb9187942e9907fe05411aaac98: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:56.718415 17114 raft_consensus.cc:740] T 0f2665342de64990947409a4e83aa0a2 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631194f763324d39a224b5728199751f, State: Initialized, Role: FOLLOWER
I20260709 12:18:56.717607 17117 raft_consensus.cc:359] T 877e171775ed47c8af9b177b9e7a13fa P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:56.718943 17117 raft_consensus.cc:385] T 877e171775ed47c8af9b177b9e7a13fa P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:56.719324 17117 raft_consensus.cc:740] T 877e171775ed47c8af9b177b9e7a13fa P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b0ce9a34e224f65aee2d205dd874ba2, State: Initialized, Role: FOLLOWER
I20260709 12:18:56.719265 17114 consensus_queue.cc:260] T 0f2665342de64990947409a4e83aa0a2 P 631194f763324d39a224b5728199751f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:56.723106 17117 consensus_queue.cc:260] T 877e171775ed47c8af9b177b9e7a13fa P 5b0ce9a34e224f65aee2d205dd874ba2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:56.723984 17114 ts_tablet_manager.cc:1434] T 0f2665342de64990947409a4e83aa0a2 P 631194f763324d39a224b5728199751f: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:18:56.725330 17114 tablet_bootstrap.cc:492] T 8affc906415f4b3aa5ed3e9a971f9aec P 631194f763324d39a224b5728199751f: Bootstrap starting.
I20260709 12:18:56.725889 17117 ts_tablet_manager.cc:1434] T 877e171775ed47c8af9b177b9e7a13fa P 5b0ce9a34e224f65aee2d205dd874ba2: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.001s
I20260709 12:18:56.727075 17117 tablet_bootstrap.cc:492] T 0f2665342de64990947409a4e83aa0a2 P 5b0ce9a34e224f65aee2d205dd874ba2: Bootstrap starting.
I20260709 12:18:56.730201 17118 tablet_bootstrap.cc:492] T 877e171775ed47c8af9b177b9e7a13fa P d641bfb9187942e9907fe05411aaac98: No bootstrap required, opened a new log
I20260709 12:18:56.730819 17118 ts_tablet_manager.cc:1403] T 877e171775ed47c8af9b177b9e7a13fa P d641bfb9187942e9907fe05411aaac98: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.008s
I20260709 12:18:56.733335 17114 tablet_bootstrap.cc:654] T 8affc906415f4b3aa5ed3e9a971f9aec P 631194f763324d39a224b5728199751f: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:56.734377 17118 raft_consensus.cc:359] T 877e171775ed47c8af9b177b9e7a13fa P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:56.735170 17118 raft_consensus.cc:385] T 877e171775ed47c8af9b177b9e7a13fa P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:56.735469 17118 raft_consensus.cc:740] T 877e171775ed47c8af9b177b9e7a13fa P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d641bfb9187942e9907fe05411aaac98, State: Initialized, Role: FOLLOWER
I20260709 12:18:56.736459 17118 consensus_queue.cc:260] T 877e171775ed47c8af9b177b9e7a13fa P d641bfb9187942e9907fe05411aaac98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:56.737004 17117 tablet_bootstrap.cc:654] T 0f2665342de64990947409a4e83aa0a2 P 5b0ce9a34e224f65aee2d205dd874ba2: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:56.739382 17113 raft_consensus.cc:493] T 3c06f7f07974452599bbaebd7f818ca9 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:56.739743 17118 ts_tablet_manager.cc:1434] T 877e171775ed47c8af9b177b9e7a13fa P d641bfb9187942e9907fe05411aaac98: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:18:56.740738 17099 raft_consensus.cc:493] T 9caa951d90c54e5086bc8d886ba6c450 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:56.741314 17099 raft_consensus.cc:515] T 9caa951d90c54e5086bc8d886ba6c450 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:56.739938 17113 raft_consensus.cc:515] T 3c06f7f07974452599bbaebd7f818ca9 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:56.742794 17114 tablet_bootstrap.cc:492] T 8affc906415f4b3aa5ed3e9a971f9aec P 631194f763324d39a224b5728199751f: No bootstrap required, opened a new log
I20260709 12:18:56.743314 17114 ts_tablet_manager.cc:1403] T 8affc906415f4b3aa5ed3e9a971f9aec P 631194f763324d39a224b5728199751f: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.001s
I20260709 12:18:56.743867 17099 leader_election.cc:290] T 9caa951d90c54e5086bc8d886ba6c450 P 631194f763324d39a224b5728199751f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979), d641bfb9187942e9907fe05411aaac98 (127.3.212.130:44221)
I20260709 12:18:56.744582 17113 leader_election.cc:290] T 3c06f7f07974452599bbaebd7f818ca9 P 5b0ce9a34e224f65aee2d205dd874ba2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d641bfb9187942e9907fe05411aaac98 (127.3.212.130:44221), 631194f763324d39a224b5728199751f (127.3.212.131:32987)
I20260709 12:18:56.745081 16894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c06f7f07974452599bbaebd7f818ca9" candidate_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d641bfb9187942e9907fe05411aaac98" is_pre_election: true
W20260709 12:18:56.747040 16784 leader_election.cc:343] T 3c06f7f07974452599bbaebd7f818ca9 P 5b0ce9a34e224f65aee2d205dd874ba2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d641bfb9187942e9907fe05411aaac98 (127.3.212.130:44221): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:56.747380 16895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9caa951d90c54e5086bc8d886ba6c450" candidate_uuid: "631194f763324d39a224b5728199751f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d641bfb9187942e9907fe05411aaac98" is_pre_election: true
I20260709 12:18:56.746971 17118 tablet_bootstrap.cc:492] T 9caa951d90c54e5086bc8d886ba6c450 P d641bfb9187942e9907fe05411aaac98: Bootstrap starting.
I20260709 12:18:56.748951 16968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c06f7f07974452599bbaebd7f818ca9" candidate_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631194f763324d39a224b5728199751f" is_pre_election: true
I20260709 12:18:56.749799 16968 raft_consensus.cc:2468] T 3c06f7f07974452599bbaebd7f818ca9 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b0ce9a34e224f65aee2d205dd874ba2 in term 0.
I20260709 12:18:56.748119 16820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9caa951d90c54e5086bc8d886ba6c450" candidate_uuid: "631194f763324d39a224b5728199751f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" is_pre_election: true
I20260709 12:18:56.751299 16820 raft_consensus.cc:2468] T 9caa951d90c54e5086bc8d886ba6c450 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631194f763324d39a224b5728199751f in term 0.
I20260709 12:18:56.753790 16787 leader_election.cc:304] T 3c06f7f07974452599bbaebd7f818ca9 P 5b0ce9a34e224f65aee2d205dd874ba2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b0ce9a34e224f65aee2d205dd874ba2, 631194f763324d39a224b5728199751f; no voters: d641bfb9187942e9907fe05411aaac98
I20260709 12:18:56.755299 17084 raft_consensus.cc:2804] T 3c06f7f07974452599bbaebd7f818ca9 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:56.755695 17084 raft_consensus.cc:493] T 3c06f7f07974452599bbaebd7f818ca9 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:56.756017 17118 tablet_bootstrap.cc:654] T 9caa951d90c54e5086bc8d886ba6c450 P d641bfb9187942e9907fe05411aaac98: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:56.753147 16933 leader_election.cc:304] T 9caa951d90c54e5086bc8d886ba6c450 P 631194f763324d39a224b5728199751f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b0ce9a34e224f65aee2d205dd874ba2, 631194f763324d39a224b5728199751f; no voters: 
I20260709 12:18:56.755955 17114 raft_consensus.cc:359] T 8affc906415f4b3aa5ed3e9a971f9aec P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:56.756927 17114 raft_consensus.cc:385] T 8affc906415f4b3aa5ed3e9a971f9aec P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:56.757710 17114 raft_consensus.cc:740] T 8affc906415f4b3aa5ed3e9a971f9aec P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631194f763324d39a224b5728199751f, State: Initialized, Role: FOLLOWER
I20260709 12:18:56.758539 17114 consensus_queue.cc:260] T 8affc906415f4b3aa5ed3e9a971f9aec P 631194f763324d39a224b5728199751f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:56.762712 17119 raft_consensus.cc:493] T 877e171775ed47c8af9b177b9e7a13fa P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:56.757184 16933 leader_election.cc:343] T 9caa951d90c54e5086bc8d886ba6c450 P 631194f763324d39a224b5728199751f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d641bfb9187942e9907fe05411aaac98 (127.3.212.130:44221): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:56.763391 17119 raft_consensus.cc:515] T 877e171775ed47c8af9b177b9e7a13fa P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:56.756026 17084 raft_consensus.cc:3060] T 3c06f7f07974452599bbaebd7f818ca9 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:56.765772 17114 ts_tablet_manager.cc:1434] T 8affc906415f4b3aa5ed3e9a971f9aec P 631194f763324d39a224b5728199751f: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.005s
I20260709 12:18:56.766892 17114 tablet_bootstrap.cc:492] T 73a5894bf58143d3a71dabf8231d33ba P 631194f763324d39a224b5728199751f: Bootstrap starting.
I20260709 12:18:56.765914 17119 leader_election.cc:290] T 877e171775ed47c8af9b177b9e7a13fa P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979), 631194f763324d39a224b5728199751f (127.3.212.131:32987)
I20260709 12:18:56.763747 17131 raft_consensus.cc:2804] T 9caa951d90c54e5086bc8d886ba6c450 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:56.776515 16820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "877e171775ed47c8af9b177b9e7a13fa" candidate_uuid: "d641bfb9187942e9907fe05411aaac98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" is_pre_election: true
I20260709 12:18:56.778618 16820 raft_consensus.cc:2468] T 877e171775ed47c8af9b177b9e7a13fa P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d641bfb9187942e9907fe05411aaac98 in term 0.
I20260709 12:18:56.773648 17131 raft_consensus.cc:493] T 9caa951d90c54e5086bc8d886ba6c450 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:56.780961 17131 raft_consensus.cc:3060] T 9caa951d90c54e5086bc8d886ba6c450 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:56.781090 16859 leader_election.cc:304] T 877e171775ed47c8af9b177b9e7a13fa P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b0ce9a34e224f65aee2d205dd874ba2, d641bfb9187942e9907fe05411aaac98; no voters: 
I20260709 12:18:56.786451 17119 raft_consensus.cc:2804] T 877e171775ed47c8af9b177b9e7a13fa P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:56.786859 17119 raft_consensus.cc:493] T 877e171775ed47c8af9b177b9e7a13fa P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:56.787210 17119 raft_consensus.cc:3060] T 877e171775ed47c8af9b177b9e7a13fa P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:56.784183 17084 raft_consensus.cc:515] T 3c06f7f07974452599bbaebd7f818ca9 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:56.798503 17084 leader_election.cc:290] T 3c06f7f07974452599bbaebd7f818ca9 P 5b0ce9a34e224f65aee2d205dd874ba2 [CANDIDATE]: Term 1 election: Requested vote from peers d641bfb9187942e9907fe05411aaac98 (127.3.212.130:44221), 631194f763324d39a224b5728199751f (127.3.212.131:32987)
I20260709 12:18:56.800024 17114 tablet_bootstrap.cc:654] T 73a5894bf58143d3a71dabf8231d33ba P 631194f763324d39a224b5728199751f: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:56.803498 16970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "877e171775ed47c8af9b177b9e7a13fa" candidate_uuid: "d641bfb9187942e9907fe05411aaac98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631194f763324d39a224b5728199751f" is_pre_election: true
I20260709 12:18:56.805140 17118 tablet_bootstrap.cc:492] T 9caa951d90c54e5086bc8d886ba6c450 P d641bfb9187942e9907fe05411aaac98: No bootstrap required, opened a new log
I20260709 12:18:56.805507 16895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c06f7f07974452599bbaebd7f818ca9" candidate_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d641bfb9187942e9907fe05411aaac98"
I20260709 12:18:56.805871 17118 ts_tablet_manager.cc:1403] T 9caa951d90c54e5086bc8d886ba6c450 P d641bfb9187942e9907fe05411aaac98: Time spent bootstrapping tablet: real 0.059s	user 0.016s	sys 0.021s
W20260709 12:18:56.808387 16784 leader_election.cc:343] T 3c06f7f07974452599bbaebd7f818ca9 P 5b0ce9a34e224f65aee2d205dd874ba2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d641bfb9187942e9907fe05411aaac98 (127.3.212.130:44221): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:56.810025 17118 raft_consensus.cc:359] T 9caa951d90c54e5086bc8d886ba6c450 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:56.811066 17118 raft_consensus.cc:385] T 9caa951d90c54e5086bc8d886ba6c450 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:56.811452 17118 raft_consensus.cc:740] T 9caa951d90c54e5086bc8d886ba6c450 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d641bfb9187942e9907fe05411aaac98, State: Initialized, Role: FOLLOWER
I20260709 12:18:56.812214 17117 tablet_bootstrap.cc:492] T 0f2665342de64990947409a4e83aa0a2 P 5b0ce9a34e224f65aee2d205dd874ba2: No bootstrap required, opened a new log
I20260709 12:18:56.812810 17117 ts_tablet_manager.cc:1403] T 0f2665342de64990947409a4e83aa0a2 P 5b0ce9a34e224f65aee2d205dd874ba2: Time spent bootstrapping tablet: real 0.086s	user 0.008s	sys 0.011s
I20260709 12:18:56.812412 17118 consensus_queue.cc:260] T 9caa951d90c54e5086bc8d886ba6c450 P d641bfb9187942e9907fe05411aaac98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:56.815611 17118 ts_tablet_manager.cc:1434] T 9caa951d90c54e5086bc8d886ba6c450 P d641bfb9187942e9907fe05411aaac98: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:18:56.816085 17117 raft_consensus.cc:359] T 0f2665342de64990947409a4e83aa0a2 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:56.816938 17117 raft_consensus.cc:385] T 0f2665342de64990947409a4e83aa0a2 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:56.817155 17118 tablet_bootstrap.cc:492] T 0f2665342de64990947409a4e83aa0a2 P d641bfb9187942e9907fe05411aaac98: Bootstrap starting.
I20260709 12:18:56.805899 17119 raft_consensus.cc:515] T 877e171775ed47c8af9b177b9e7a13fa P d641bfb9187942e9907fe05411aaac98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:56.822799 16969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c06f7f07974452599bbaebd7f818ca9" candidate_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631194f763324d39a224b5728199751f"
I20260709 12:18:56.823523 16969 raft_consensus.cc:3060] T 3c06f7f07974452599bbaebd7f818ca9 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:18:56.824671 16862 leader_election.cc:343] T 877e171775ed47c8af9b177b9e7a13fa P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 631194f763324d39a224b5728199751f (127.3.212.131:32987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:56.817252 17117 raft_consensus.cc:740] T 0f2665342de64990947409a4e83aa0a2 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b0ce9a34e224f65aee2d205dd874ba2, State: Initialized, Role: FOLLOWER
I20260709 12:18:56.828660 17118 tablet_bootstrap.cc:654] T 0f2665342de64990947409a4e83aa0a2 P d641bfb9187942e9907fe05411aaac98: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:56.828722 16820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "877e171775ed47c8af9b177b9e7a13fa" candidate_uuid: "d641bfb9187942e9907fe05411aaac98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b0ce9a34e224f65aee2d205dd874ba2"
I20260709 12:18:56.830538 16820 raft_consensus.cc:3060] T 877e171775ed47c8af9b177b9e7a13fa P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:56.827780 17117 consensus_queue.cc:260] T 0f2665342de64990947409a4e83aa0a2 P 5b0ce9a34e224f65aee2d205dd874ba2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:56.836252 17117 ts_tablet_manager.cc:1434] T 0f2665342de64990947409a4e83aa0a2 P 5b0ce9a34e224f65aee2d205dd874ba2: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 12:18:56.824755 17119 leader_election.cc:290] T 877e171775ed47c8af9b177b9e7a13fa P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 1 election: Requested vote from peers 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979), 631194f763324d39a224b5728199751f (127.3.212.131:32987)
I20260709 12:18:56.837620 17117 tablet_bootstrap.cc:492] T 73a5894bf58143d3a71dabf8231d33ba P 5b0ce9a34e224f65aee2d205dd874ba2: Bootstrap starting.
I20260709 12:18:56.839955 16968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "877e171775ed47c8af9b177b9e7a13fa" candidate_uuid: "d641bfb9187942e9907fe05411aaac98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631194f763324d39a224b5728199751f"
W20260709 12:18:56.841820 16862 leader_election.cc:343] T 877e171775ed47c8af9b177b9e7a13fa P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 631194f763324d39a224b5728199751f (127.3.212.131:32987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:56.851138 17117 tablet_bootstrap.cc:654] T 73a5894bf58143d3a71dabf8231d33ba P 5b0ce9a34e224f65aee2d205dd874ba2: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:56.853806 17119 raft_consensus.cc:493] T 04bbf32b02ed450f99f360da0e55cff7 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:56.854348 17119 raft_consensus.cc:515] T 04bbf32b02ed450f99f360da0e55cff7 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:56.856424 17119 leader_election.cc:290] T 04bbf32b02ed450f99f360da0e55cff7 P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979), 631194f763324d39a224b5728199751f (127.3.212.131:32987)
I20260709 12:18:56.858387 16968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04bbf32b02ed450f99f360da0e55cff7" candidate_uuid: "d641bfb9187942e9907fe05411aaac98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631194f763324d39a224b5728199751f" is_pre_election: true
I20260709 12:18:56.858502 16821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04bbf32b02ed450f99f360da0e55cff7" candidate_uuid: "d641bfb9187942e9907fe05411aaac98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" is_pre_election: true
W20260709 12:18:56.859753 16862 leader_election.cc:343] T 04bbf32b02ed450f99f360da0e55cff7 P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 631194f763324d39a224b5728199751f (127.3.212.131:32987): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:18:56.861017 16859 leader_election.cc:343] T 04bbf32b02ed450f99f360da0e55cff7 P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:56.861511 16859 leader_election.cc:304] T 04bbf32b02ed450f99f360da0e55cff7 P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d641bfb9187942e9907fe05411aaac98; no voters: 5b0ce9a34e224f65aee2d205dd874ba2, 631194f763324d39a224b5728199751f
I20260709 12:18:56.862658 17119 raft_consensus.cc:2749] T 04bbf32b02ed450f99f360da0e55cff7 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:56.865034 17131 raft_consensus.cc:515] T 9caa951d90c54e5086bc8d886ba6c450 P 631194f763324d39a224b5728199751f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:56.862690 16969 raft_consensus.cc:2468] T 3c06f7f07974452599bbaebd7f818ca9 P 631194f763324d39a224b5728199751f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b0ce9a34e224f65aee2d205dd874ba2 in term 1.
I20260709 12:18:56.852902 16820 raft_consensus.cc:2468] T 877e171775ed47c8af9b177b9e7a13fa P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d641bfb9187942e9907fe05411aaac98 in term 1.
I20260709 12:18:56.875903 16787 leader_election.cc:304] T 3c06f7f07974452599bbaebd7f818ca9 P 5b0ce9a34e224f65aee2d205dd874ba2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b0ce9a34e224f65aee2d205dd874ba2, 631194f763324d39a224b5728199751f; no voters: d641bfb9187942e9907fe05411aaac98
I20260709 12:18:56.876904 17115 raft_consensus.cc:2804] T 3c06f7f07974452599bbaebd7f818ca9 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:56.877424 17115 raft_consensus.cc:697] T 3c06f7f07974452599bbaebd7f818ca9 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 LEADER]: Becoming Leader. State: Replica: 5b0ce9a34e224f65aee2d205dd874ba2, State: Running, Role: LEADER
I20260709 12:18:56.878283 17115 consensus_queue.cc:237] T 3c06f7f07974452599bbaebd7f818ca9 P 5b0ce9a34e224f65aee2d205dd874ba2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:56.884814 16820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9caa951d90c54e5086bc8d886ba6c450" candidate_uuid: "631194f763324d39a224b5728199751f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b0ce9a34e224f65aee2d205dd874ba2"
I20260709 12:18:56.885587 16820 raft_consensus.cc:3060] T 9caa951d90c54e5086bc8d886ba6c450 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:56.886137 16859 leader_election.cc:304] T 877e171775ed47c8af9b177b9e7a13fa P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b0ce9a34e224f65aee2d205dd874ba2, d641bfb9187942e9907fe05411aaac98; no voters: 631194f763324d39a224b5728199751f
I20260709 12:18:56.887048 17100 raft_consensus.cc:493] T 73a5894bf58143d3a71dabf8231d33ba P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:56.887487 17100 raft_consensus.cc:515] T 73a5894bf58143d3a71dabf8231d33ba P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:56.887916 17102 raft_consensus.cc:2804] T 877e171775ed47c8af9b177b9e7a13fa P d641bfb9187942e9907fe05411aaac98 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:56.888442 17102 raft_consensus.cc:697] T 877e171775ed47c8af9b177b9e7a13fa P d641bfb9187942e9907fe05411aaac98 [term 1 LEADER]: Becoming Leader. State: Replica: d641bfb9187942e9907fe05411aaac98, State: Running, Role: LEADER
I20260709 12:18:56.889251 17102 consensus_queue.cc:237] T 877e171775ed47c8af9b177b9e7a13fa P d641bfb9187942e9907fe05411aaac98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:56.889740 17100 leader_election.cc:290] T 73a5894bf58143d3a71dabf8231d33ba P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979), 631194f763324d39a224b5728199751f (127.3.212.131:32987)
I20260709 12:18:56.894057 16821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a5894bf58143d3a71dabf8231d33ba" candidate_uuid: "d641bfb9187942e9907fe05411aaac98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" is_pre_election: true
I20260709 12:18:56.895020 16969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a5894bf58143d3a71dabf8231d33ba" candidate_uuid: "d641bfb9187942e9907fe05411aaac98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631194f763324d39a224b5728199751f" is_pre_election: true
W20260709 12:18:56.896648 16862 leader_election.cc:343] T 73a5894bf58143d3a71dabf8231d33ba P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 631194f763324d39a224b5728199751f (127.3.212.131:32987): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:18:56.897119 16859 leader_election.cc:343] T 73a5894bf58143d3a71dabf8231d33ba P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:56.897267 17119 raft_consensus.cc:493] T 9caa951d90c54e5086bc8d886ba6c450 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:56.897593 16859 leader_election.cc:304] T 73a5894bf58143d3a71dabf8231d33ba P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d641bfb9187942e9907fe05411aaac98; no voters: 5b0ce9a34e224f65aee2d205dd874ba2, 631194f763324d39a224b5728199751f
I20260709 12:18:56.897806 17119 raft_consensus.cc:515] T 9caa951d90c54e5086bc8d886ba6c450 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:56.898736 17100 raft_consensus.cc:2749] T 73a5894bf58143d3a71dabf8231d33ba P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:56.900108 17119 leader_election.cc:290] T 9caa951d90c54e5086bc8d886ba6c450 P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979), 631194f763324d39a224b5728199751f (127.3.212.131:32987)
I20260709 12:18:56.901803 16968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9caa951d90c54e5086bc8d886ba6c450" candidate_uuid: "d641bfb9187942e9907fe05411aaac98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631194f763324d39a224b5728199751f" is_pre_election: true
I20260709 12:18:56.902716 16968 raft_consensus.cc:2393] T 9caa951d90c54e5086bc8d886ba6c450 P 631194f763324d39a224b5728199751f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d641bfb9187942e9907fe05411aaac98 in current term 1: Already voted for candidate 631194f763324d39a224b5728199751f in this term.
I20260709 12:18:56.901664 17117 tablet_bootstrap.cc:492] T 73a5894bf58143d3a71dabf8231d33ba P 5b0ce9a34e224f65aee2d205dd874ba2: No bootstrap required, opened a new log
I20260709 12:18:56.903995 17117 ts_tablet_manager.cc:1403] T 73a5894bf58143d3a71dabf8231d33ba P 5b0ce9a34e224f65aee2d205dd874ba2: Time spent bootstrapping tablet: real 0.067s	user 0.020s	sys 0.000s
I20260709 12:18:56.905277 16821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9caa951d90c54e5086bc8d886ba6c450" candidate_uuid: "d641bfb9187942e9907fe05411aaac98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" is_pre_election: true
I20260709 12:18:56.906949 16859 leader_election.cc:304] T 9caa951d90c54e5086bc8d886ba6c450 P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d641bfb9187942e9907fe05411aaac98; no voters: 5b0ce9a34e224f65aee2d205dd874ba2, 631194f763324d39a224b5728199751f
I20260709 12:18:56.909922 17119 raft_consensus.cc:3060] T 9caa951d90c54e5086bc8d886ba6c450 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:56.918784 16895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9caa951d90c54e5086bc8d886ba6c450" candidate_uuid: "631194f763324d39a224b5728199751f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d641bfb9187942e9907fe05411aaac98"
I20260709 12:18:56.922502 17131 leader_election.cc:290] T 9caa951d90c54e5086bc8d886ba6c450 P 631194f763324d39a224b5728199751f [CANDIDATE]: Term 1 election: Requested vote from peers 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979), d641bfb9187942e9907fe05411aaac98 (127.3.212.130:44221)
I20260709 12:18:56.933892 16717 catalog_manager.cc:5697] T 877e171775ed47c8af9b177b9e7a13fa P d641bfb9187942e9907fe05411aaac98 reported cstate change: term changed from 0 to 1, leader changed from <none> to d641bfb9187942e9907fe05411aaac98 (127.3.212.130). New cstate: current_term: 1 leader_uuid: "d641bfb9187942e9907fe05411aaac98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:56.910873 17117 raft_consensus.cc:359] T 73a5894bf58143d3a71dabf8231d33ba P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:56.938155 17117 raft_consensus.cc:385] T 73a5894bf58143d3a71dabf8231d33ba P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:56.938577 17117 raft_consensus.cc:740] T 73a5894bf58143d3a71dabf8231d33ba P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b0ce9a34e224f65aee2d205dd874ba2, State: Initialized, Role: FOLLOWER
I20260709 12:18:56.942780 16718 catalog_manager.cc:5697] T 3c06f7f07974452599bbaebd7f818ca9 P 5b0ce9a34e224f65aee2d205dd874ba2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129). New cstate: current_term: 1 leader_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:56.930775 17119 raft_consensus.cc:2749] T 9caa951d90c54e5086bc8d886ba6c450 P d641bfb9187942e9907fe05411aaac98 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:56.945678 17114 tablet_bootstrap.cc:492] T 73a5894bf58143d3a71dabf8231d33ba P 631194f763324d39a224b5728199751f: No bootstrap required, opened a new log
I20260709 12:18:56.946272 17114 ts_tablet_manager.cc:1403] T 73a5894bf58143d3a71dabf8231d33ba P 631194f763324d39a224b5728199751f: Time spent bootstrapping tablet: real 0.180s	user 0.059s	sys 0.090s
I20260709 12:18:56.947062 17118 tablet_bootstrap.cc:492] T 0f2665342de64990947409a4e83aa0a2 P d641bfb9187942e9907fe05411aaac98: No bootstrap required, opened a new log
I20260709 12:18:56.946837 17117 consensus_queue.cc:260] T 73a5894bf58143d3a71dabf8231d33ba P 5b0ce9a34e224f65aee2d205dd874ba2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:56.947716 17118 ts_tablet_manager.cc:1403] T 0f2665342de64990947409a4e83aa0a2 P d641bfb9187942e9907fe05411aaac98: Time spent bootstrapping tablet: real 0.131s	user 0.031s	sys 0.094s
I20260709 12:18:56.949466 17114 raft_consensus.cc:359] T 73a5894bf58143d3a71dabf8231d33ba P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:56.950251 17114 raft_consensus.cc:385] T 73a5894bf58143d3a71dabf8231d33ba P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:56.950551 17114 raft_consensus.cc:740] T 73a5894bf58143d3a71dabf8231d33ba P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631194f763324d39a224b5728199751f, State: Initialized, Role: FOLLOWER
I20260709 12:18:56.951226 17118 raft_consensus.cc:359] T 0f2665342de64990947409a4e83aa0a2 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:56.951462 17114 consensus_queue.cc:260] T 73a5894bf58143d3a71dabf8231d33ba P 631194f763324d39a224b5728199751f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:56.953033 17117 ts_tablet_manager.cc:1434] T 73a5894bf58143d3a71dabf8231d33ba P 5b0ce9a34e224f65aee2d205dd874ba2: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.000s
I20260709 12:18:56.954602 17132 raft_consensus.cc:493] T 5fabedcf8a28457fab071f75fe106037 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:56.955561 17117 tablet_bootstrap.cc:492] T 5fabedcf8a28457fab071f75fe106037 P 5b0ce9a34e224f65aee2d205dd874ba2: Bootstrap starting.
I20260709 12:18:56.955174 17132 raft_consensus.cc:515] T 5fabedcf8a28457fab071f75fe106037 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:56.953639 17118 raft_consensus.cc:385] T 0f2665342de64990947409a4e83aa0a2 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:56.956494 17118 raft_consensus.cc:740] T 0f2665342de64990947409a4e83aa0a2 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d641bfb9187942e9907fe05411aaac98, State: Initialized, Role: FOLLOWER
I20260709 12:18:56.954573 16895 raft_consensus.cc:2468] T 9caa951d90c54e5086bc8d886ba6c450 P d641bfb9187942e9907fe05411aaac98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631194f763324d39a224b5728199751f in term 1.
I20260709 12:18:56.957451 17118 consensus_queue.cc:260] T 0f2665342de64990947409a4e83aa0a2 P d641bfb9187942e9907fe05411aaac98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:56.958397 17132 leader_election.cc:290] T 5fabedcf8a28457fab071f75fe106037 P 631194f763324d39a224b5728199751f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979), d641bfb9187942e9907fe05411aaac98 (127.3.212.130:44221)
I20260709 12:18:56.960021 17118 ts_tablet_manager.cc:1434] T 0f2665342de64990947409a4e83aa0a2 P d641bfb9187942e9907fe05411aaac98: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:18:56.960582 16821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fabedcf8a28457fab071f75fe106037" candidate_uuid: "631194f763324d39a224b5728199751f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" is_pre_election: true
I20260709 12:18:56.961241 17118 tablet_bootstrap.cc:492] T 5fabedcf8a28457fab071f75fe106037 P d641bfb9187942e9907fe05411aaac98: Bootstrap starting.
I20260709 12:18:56.961905 16894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fabedcf8a28457fab071f75fe106037" candidate_uuid: "631194f763324d39a224b5728199751f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d641bfb9187942e9907fe05411aaac98" is_pre_election: true
W20260709 12:18:56.968397 16933 leader_election.cc:343] T 5fabedcf8a28457fab071f75fe106037 P 631194f763324d39a224b5728199751f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:56.968549 17118 tablet_bootstrap.cc:654] T 5fabedcf8a28457fab071f75fe106037 P d641bfb9187942e9907fe05411aaac98: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:56.956173 17114 ts_tablet_manager.cc:1434] T 73a5894bf58143d3a71dabf8231d33ba P 631194f763324d39a224b5728199751f: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.004s
I20260709 12:18:56.970227 17114 tablet_bootstrap.cc:492] T 04bbf32b02ed450f99f360da0e55cff7 P 631194f763324d39a224b5728199751f: Bootstrap starting.
W20260709 12:18:56.970382 16933 leader_election.cc:343] T 5fabedcf8a28457fab071f75fe106037 P 631194f763324d39a224b5728199751f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d641bfb9187942e9907fe05411aaac98 (127.3.212.130:44221): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:18:56.971874 16933 leader_election.cc:304] T 5fabedcf8a28457fab071f75fe106037 P 631194f763324d39a224b5728199751f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 631194f763324d39a224b5728199751f; no voters: 5b0ce9a34e224f65aee2d205dd874ba2, d641bfb9187942e9907fe05411aaac98
I20260709 12:18:56.973839 17132 raft_consensus.cc:2749] T 5fabedcf8a28457fab071f75fe106037 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:56.954573 16820 raft_consensus.cc:2468] T 9caa951d90c54e5086bc8d886ba6c450 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631194f763324d39a224b5728199751f in term 1.
I20260709 12:18:56.980383 16933 leader_election.cc:304] T 9caa951d90c54e5086bc8d886ba6c450 P 631194f763324d39a224b5728199751f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b0ce9a34e224f65aee2d205dd874ba2, 631194f763324d39a224b5728199751f; no voters: 
I20260709 12:18:56.981312 17132 raft_consensus.cc:2804] T 9caa951d90c54e5086bc8d886ba6c450 P 631194f763324d39a224b5728199751f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:56.981871 17132 raft_consensus.cc:697] T 9caa951d90c54e5086bc8d886ba6c450 P 631194f763324d39a224b5728199751f [term 1 LEADER]: Becoming Leader. State: Replica: 631194f763324d39a224b5728199751f, State: Running, Role: LEADER
I20260709 12:18:56.982048 17118 tablet_bootstrap.cc:492] T 5fabedcf8a28457fab071f75fe106037 P d641bfb9187942e9907fe05411aaac98: No bootstrap required, opened a new log
I20260709 12:18:56.982733 17118 ts_tablet_manager.cc:1403] T 5fabedcf8a28457fab071f75fe106037 P d641bfb9187942e9907fe05411aaac98: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.006s
I20260709 12:18:56.982923 17132 consensus_queue.cc:237] T 9caa951d90c54e5086bc8d886ba6c450 P 631194f763324d39a224b5728199751f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:56.984345 17117 tablet_bootstrap.cc:654] T 5fabedcf8a28457fab071f75fe106037 P 5b0ce9a34e224f65aee2d205dd874ba2: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:56.986219 17118 raft_consensus.cc:359] T 5fabedcf8a28457fab071f75fe106037 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:56.987115 17118 raft_consensus.cc:385] T 5fabedcf8a28457fab071f75fe106037 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:56.987432 17118 raft_consensus.cc:740] T 5fabedcf8a28457fab071f75fe106037 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d641bfb9187942e9907fe05411aaac98, State: Initialized, Role: FOLLOWER
I20260709 12:18:56.986439 17131 raft_consensus.cc:493] T 0f2665342de64990947409a4e83aa0a2 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:56.988610 17118 consensus_queue.cc:260] T 5fabedcf8a28457fab071f75fe106037 P d641bfb9187942e9907fe05411aaac98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:56.989259 17131 raft_consensus.cc:515] T 0f2665342de64990947409a4e83aa0a2 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:56.990551 17114 tablet_bootstrap.cc:654] T 04bbf32b02ed450f99f360da0e55cff7 P 631194f763324d39a224b5728199751f: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:56.991458 17118 ts_tablet_manager.cc:1434] T 5fabedcf8a28457fab071f75fe106037 P d641bfb9187942e9907fe05411aaac98: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:18:56.992666 17118 tablet_bootstrap.cc:492] T 8affc906415f4b3aa5ed3e9a971f9aec P d641bfb9187942e9907fe05411aaac98: Bootstrap starting.
I20260709 12:18:56.992864 16821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f2665342de64990947409a4e83aa0a2" candidate_uuid: "631194f763324d39a224b5728199751f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" is_pre_election: true
I20260709 12:18:56.993690 16821 raft_consensus.cc:2468] T 0f2665342de64990947409a4e83aa0a2 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631194f763324d39a224b5728199751f in term 0.
I20260709 12:18:56.996147 16894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f2665342de64990947409a4e83aa0a2" candidate_uuid: "631194f763324d39a224b5728199751f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d641bfb9187942e9907fe05411aaac98" is_pre_election: true
I20260709 12:18:56.997040 16894 raft_consensus.cc:2468] T 0f2665342de64990947409a4e83aa0a2 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631194f763324d39a224b5728199751f in term 0.
I20260709 12:18:56.998708 16933 leader_election.cc:304] T 0f2665342de64990947409a4e83aa0a2 P 631194f763324d39a224b5728199751f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631194f763324d39a224b5728199751f, d641bfb9187942e9907fe05411aaac98; no voters: 
I20260709 12:18:56.999559 17099 raft_consensus.cc:2804] T 0f2665342de64990947409a4e83aa0a2 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:56.999902 17118 tablet_bootstrap.cc:654] T 8affc906415f4b3aa5ed3e9a971f9aec P d641bfb9187942e9907fe05411aaac98: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:56.999927 17099 raft_consensus.cc:493] T 0f2665342de64990947409a4e83aa0a2 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:56.991514 17131 leader_election.cc:290] T 0f2665342de64990947409a4e83aa0a2 P 631194f763324d39a224b5728199751f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979), d641bfb9187942e9907fe05411aaac98 (127.3.212.130:44221)
I20260709 12:18:57.000125 17117 tablet_bootstrap.cc:492] T 5fabedcf8a28457fab071f75fe106037 P 5b0ce9a34e224f65aee2d205dd874ba2: No bootstrap required, opened a new log
I20260709 12:18:57.000893 17099 raft_consensus.cc:3060] T 0f2665342de64990947409a4e83aa0a2 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:57.001123 17117 ts_tablet_manager.cc:1403] T 5fabedcf8a28457fab071f75fe106037 P 5b0ce9a34e224f65aee2d205dd874ba2: Time spent bootstrapping tablet: real 0.046s	user 0.015s	sys 0.004s
I20260709 12:18:57.004310 17117 raft_consensus.cc:359] T 5fabedcf8a28457fab071f75fe106037 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:57.005010 17117 raft_consensus.cc:385] T 5fabedcf8a28457fab071f75fe106037 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:57.005295 17117 raft_consensus.cc:740] T 5fabedcf8a28457fab071f75fe106037 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b0ce9a34e224f65aee2d205dd874ba2, State: Initialized, Role: FOLLOWER
I20260709 12:18:57.006063 17117 consensus_queue.cc:260] T 5fabedcf8a28457fab071f75fe106037 P 5b0ce9a34e224f65aee2d205dd874ba2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:57.008481 17117 ts_tablet_manager.cc:1434] T 5fabedcf8a28457fab071f75fe106037 P 5b0ce9a34e224f65aee2d205dd874ba2: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:18:57.009892 17117 tablet_bootstrap.cc:492] T 86e15b6028704208a711b8069cba2929 P 5b0ce9a34e224f65aee2d205dd874ba2: Bootstrap starting.
I20260709 12:18:57.009785 17099 raft_consensus.cc:515] T 0f2665342de64990947409a4e83aa0a2 P 631194f763324d39a224b5728199751f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:57.017571 16715 catalog_manager.cc:5697] T 9caa951d90c54e5086bc8d886ba6c450 P 631194f763324d39a224b5728199751f reported cstate change: term changed from 0 to 1, leader changed from <none> to 631194f763324d39a224b5728199751f (127.3.212.131). New cstate: current_term: 1 leader_uuid: "631194f763324d39a224b5728199751f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:57.018603 17118 tablet_bootstrap.cc:492] T 8affc906415f4b3aa5ed3e9a971f9aec P d641bfb9187942e9907fe05411aaac98: No bootstrap required, opened a new log
I20260709 12:18:57.019301 17118 ts_tablet_manager.cc:1403] T 8affc906415f4b3aa5ed3e9a971f9aec P d641bfb9187942e9907fe05411aaac98: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.008s
I20260709 12:18:57.021667 16820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f2665342de64990947409a4e83aa0a2" candidate_uuid: "631194f763324d39a224b5728199751f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b0ce9a34e224f65aee2d205dd874ba2"
I20260709 12:18:57.022370 16820 raft_consensus.cc:3060] T 0f2665342de64990947409a4e83aa0a2 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:57.022873 17118 raft_consensus.cc:359] T 8affc906415f4b3aa5ed3e9a971f9aec P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:57.023720 17118 raft_consensus.cc:385] T 8affc906415f4b3aa5ed3e9a971f9aec P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:57.024049 17118 raft_consensus.cc:740] T 8affc906415f4b3aa5ed3e9a971f9aec P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d641bfb9187942e9907fe05411aaac98, State: Initialized, Role: FOLLOWER
I20260709 12:18:57.024981 17118 consensus_queue.cc:260] T 8affc906415f4b3aa5ed3e9a971f9aec P d641bfb9187942e9907fe05411aaac98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:57.027750 17118 ts_tablet_manager.cc:1434] T 8affc906415f4b3aa5ed3e9a971f9aec P d641bfb9187942e9907fe05411aaac98: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:18:57.028919 17118 tablet_bootstrap.cc:492] T 3c06f7f07974452599bbaebd7f818ca9 P d641bfb9187942e9907fe05411aaac98: Bootstrap starting.
I20260709 12:18:57.033242 17117 tablet_bootstrap.cc:654] T 86e15b6028704208a711b8069cba2929 P 5b0ce9a34e224f65aee2d205dd874ba2: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:57.035965 17118 tablet_bootstrap.cc:654] T 3c06f7f07974452599bbaebd7f818ca9 P d641bfb9187942e9907fe05411aaac98: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:57.036592 16895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f2665342de64990947409a4e83aa0a2" candidate_uuid: "631194f763324d39a224b5728199751f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d641bfb9187942e9907fe05411aaac98"
I20260709 12:18:57.037290 16895 raft_consensus.cc:3060] T 0f2665342de64990947409a4e83aa0a2 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:57.041286 17099 leader_election.cc:290] T 0f2665342de64990947409a4e83aa0a2 P 631194f763324d39a224b5728199751f [CANDIDATE]: Term 1 election: Requested vote from peers 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979), d641bfb9187942e9907fe05411aaac98 (127.3.212.130:44221)
I20260709 12:18:57.045971 17114 tablet_bootstrap.cc:492] T 04bbf32b02ed450f99f360da0e55cff7 P 631194f763324d39a224b5728199751f: No bootstrap required, opened a new log
I20260709 12:18:57.046630 16820 raft_consensus.cc:2468] T 0f2665342de64990947409a4e83aa0a2 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631194f763324d39a224b5728199751f in term 1.
I20260709 12:18:57.046701 17114 ts_tablet_manager.cc:1403] T 04bbf32b02ed450f99f360da0e55cff7 P 631194f763324d39a224b5728199751f: Time spent bootstrapping tablet: real 0.077s	user 0.021s	sys 0.005s
I20260709 12:18:57.048256 16933 leader_election.cc:304] T 0f2665342de64990947409a4e83aa0a2 P 631194f763324d39a224b5728199751f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b0ce9a34e224f65aee2d205dd874ba2, 631194f763324d39a224b5728199751f; no voters: 
I20260709 12:18:57.049496 17099 raft_consensus.cc:2804] T 0f2665342de64990947409a4e83aa0a2 P 631194f763324d39a224b5728199751f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:57.050217 17099 raft_consensus.cc:697] T 0f2665342de64990947409a4e83aa0a2 P 631194f763324d39a224b5728199751f [term 1 LEADER]: Becoming Leader. State: Replica: 631194f763324d39a224b5728199751f, State: Running, Role: LEADER
I20260709 12:18:57.052156 17117 tablet_bootstrap.cc:492] T 86e15b6028704208a711b8069cba2929 P 5b0ce9a34e224f65aee2d205dd874ba2: No bootstrap required, opened a new log
I20260709 12:18:57.052771 17117 ts_tablet_manager.cc:1403] T 86e15b6028704208a711b8069cba2929 P 5b0ce9a34e224f65aee2d205dd874ba2: Time spent bootstrapping tablet: real 0.043s	user 0.010s	sys 0.009s
I20260709 12:18:57.056326 17117 raft_consensus.cc:359] T 86e15b6028704208a711b8069cba2929 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:57.057114 17117 raft_consensus.cc:385] T 86e15b6028704208a711b8069cba2929 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:57.057441 17117 raft_consensus.cc:740] T 86e15b6028704208a711b8069cba2929 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b0ce9a34e224f65aee2d205dd874ba2, State: Initialized, Role: FOLLOWER
I20260709 12:18:57.058357 17117 consensus_queue.cc:260] T 86e15b6028704208a711b8069cba2929 P 5b0ce9a34e224f65aee2d205dd874ba2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:57.057493 17099 consensus_queue.cc:237] T 0f2665342de64990947409a4e83aa0a2 P 631194f763324d39a224b5728199751f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:57.063688 17114 raft_consensus.cc:359] T 04bbf32b02ed450f99f360da0e55cff7 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:57.064663 17114 raft_consensus.cc:385] T 04bbf32b02ed450f99f360da0e55cff7 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:57.064978 17114 raft_consensus.cc:740] T 04bbf32b02ed450f99f360da0e55cff7 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631194f763324d39a224b5728199751f, State: Initialized, Role: FOLLOWER
I20260709 12:18:57.065846 17114 consensus_queue.cc:260] T 04bbf32b02ed450f99f360da0e55cff7 P 631194f763324d39a224b5728199751f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:57.067620 17117 ts_tablet_manager.cc:1434] T 86e15b6028704208a711b8069cba2929 P 5b0ce9a34e224f65aee2d205dd874ba2: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.002s
I20260709 12:18:57.068807 17117 tablet_bootstrap.cc:492] T 04bbf32b02ed450f99f360da0e55cff7 P 5b0ce9a34e224f65aee2d205dd874ba2: Bootstrap starting.
I20260709 12:18:57.069015 17114 ts_tablet_manager.cc:1434] T 04bbf32b02ed450f99f360da0e55cff7 P 631194f763324d39a224b5728199751f: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:18:57.071477 17114 tablet_bootstrap.cc:492] T 877e171775ed47c8af9b177b9e7a13fa P 631194f763324d39a224b5728199751f: Bootstrap starting.
I20260709 12:18:57.073206 16895 raft_consensus.cc:2468] T 0f2665342de64990947409a4e83aa0a2 P d641bfb9187942e9907fe05411aaac98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631194f763324d39a224b5728199751f in term 1.
I20260709 12:18:57.075850 17117 tablet_bootstrap.cc:654] T 04bbf32b02ed450f99f360da0e55cff7 P 5b0ce9a34e224f65aee2d205dd874ba2: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:57.076385 17118 tablet_bootstrap.cc:492] T 3c06f7f07974452599bbaebd7f818ca9 P d641bfb9187942e9907fe05411aaac98: No bootstrap required, opened a new log
I20260709 12:18:57.076968 17118 ts_tablet_manager.cc:1403] T 3c06f7f07974452599bbaebd7f818ca9 P d641bfb9187942e9907fe05411aaac98: Time spent bootstrapping tablet: real 0.048s	user 0.034s	sys 0.008s
I20260709 12:18:57.080551 17118 raft_consensus.cc:359] T 3c06f7f07974452599bbaebd7f818ca9 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:57.081413 17118 raft_consensus.cc:385] T 3c06f7f07974452599bbaebd7f818ca9 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:57.081758 17118 raft_consensus.cc:740] T 3c06f7f07974452599bbaebd7f818ca9 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d641bfb9187942e9907fe05411aaac98, State: Initialized, Role: FOLLOWER
I20260709 12:18:57.083083 17118 consensus_queue.cc:260] T 3c06f7f07974452599bbaebd7f818ca9 P d641bfb9187942e9907fe05411aaac98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:57.085927 17118 ts_tablet_manager.cc:1434] T 3c06f7f07974452599bbaebd7f818ca9 P d641bfb9187942e9907fe05411aaac98: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 12:18:57.087002 17118 tablet_bootstrap.cc:492] T 86e15b6028704208a711b8069cba2929 P d641bfb9187942e9907fe05411aaac98: Bootstrap starting.
I20260709 12:18:57.090160 17114 tablet_bootstrap.cc:654] T 877e171775ed47c8af9b177b9e7a13fa P 631194f763324d39a224b5728199751f: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:57.093111 17118 tablet_bootstrap.cc:654] T 86e15b6028704208a711b8069cba2929 P d641bfb9187942e9907fe05411aaac98: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:57.092922 16718 catalog_manager.cc:5697] T 0f2665342de64990947409a4e83aa0a2 P 631194f763324d39a224b5728199751f reported cstate change: term changed from 0 to 1, leader changed from <none> to 631194f763324d39a224b5728199751f (127.3.212.131). New cstate: current_term: 1 leader_uuid: "631194f763324d39a224b5728199751f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:57.099797 17117 tablet_bootstrap.cc:492] T 04bbf32b02ed450f99f360da0e55cff7 P 5b0ce9a34e224f65aee2d205dd874ba2: No bootstrap required, opened a new log
I20260709 12:18:57.100230 17117 ts_tablet_manager.cc:1403] T 04bbf32b02ed450f99f360da0e55cff7 P 5b0ce9a34e224f65aee2d205dd874ba2: Time spent bootstrapping tablet: real 0.032s	user 0.009s	sys 0.006s
I20260709 12:18:57.103086 17117 raft_consensus.cc:359] T 04bbf32b02ed450f99f360da0e55cff7 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:57.103958 17117 raft_consensus.cc:385] T 04bbf32b02ed450f99f360da0e55cff7 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:57.104220 17117 raft_consensus.cc:740] T 04bbf32b02ed450f99f360da0e55cff7 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b0ce9a34e224f65aee2d205dd874ba2, State: Initialized, Role: FOLLOWER
I20260709 12:18:57.104900 17117 consensus_queue.cc:260] T 04bbf32b02ed450f99f360da0e55cff7 P 5b0ce9a34e224f65aee2d205dd874ba2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:57.106180 17118 tablet_bootstrap.cc:492] T 86e15b6028704208a711b8069cba2929 P d641bfb9187942e9907fe05411aaac98: No bootstrap required, opened a new log
I20260709 12:18:57.106739 17118 ts_tablet_manager.cc:1403] T 86e15b6028704208a711b8069cba2929 P d641bfb9187942e9907fe05411aaac98: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.005s
I20260709 12:18:57.108270 17114 tablet_bootstrap.cc:492] T 877e171775ed47c8af9b177b9e7a13fa P 631194f763324d39a224b5728199751f: No bootstrap required, opened a new log
I20260709 12:18:57.108777 17114 ts_tablet_manager.cc:1403] T 877e171775ed47c8af9b177b9e7a13fa P 631194f763324d39a224b5728199751f: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.005s
I20260709 12:18:57.109531 17118 raft_consensus.cc:359] T 86e15b6028704208a711b8069cba2929 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:57.110281 17118 raft_consensus.cc:385] T 86e15b6028704208a711b8069cba2929 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:57.110564 17118 raft_consensus.cc:740] T 86e15b6028704208a711b8069cba2929 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d641bfb9187942e9907fe05411aaac98, State: Initialized, Role: FOLLOWER
I20260709 12:18:57.111268 17117 ts_tablet_manager.cc:1434] T 04bbf32b02ed450f99f360da0e55cff7 P 5b0ce9a34e224f65aee2d205dd874ba2: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:18:57.111447 17118 consensus_queue.cc:260] T 86e15b6028704208a711b8069cba2929 P d641bfb9187942e9907fe05411aaac98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:57.111539 17114 raft_consensus.cc:359] T 877e171775ed47c8af9b177b9e7a13fa P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:57.112437 17114 raft_consensus.cc:385] T 877e171775ed47c8af9b177b9e7a13fa P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:57.112715 17114 raft_consensus.cc:740] T 877e171775ed47c8af9b177b9e7a13fa P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631194f763324d39a224b5728199751f, State: Initialized, Role: FOLLOWER
I20260709 12:18:57.113570 17114 consensus_queue.cc:260] T 877e171775ed47c8af9b177b9e7a13fa P 631194f763324d39a224b5728199751f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:57.114099 17118 ts_tablet_manager.cc:1434] T 86e15b6028704208a711b8069cba2929 P d641bfb9187942e9907fe05411aaac98: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:18:57.115248 17117 tablet_bootstrap.cc:492] T 8affc906415f4b3aa5ed3e9a971f9aec P 5b0ce9a34e224f65aee2d205dd874ba2: Bootstrap starting.
I20260709 12:18:57.115639 17114 ts_tablet_manager.cc:1434] T 877e171775ed47c8af9b177b9e7a13fa P 631194f763324d39a224b5728199751f: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.008s
I20260709 12:18:57.116680 17114 tablet_bootstrap.cc:492] T 86e15b6028704208a711b8069cba2929 P 631194f763324d39a224b5728199751f: Bootstrap starting.
I20260709 12:18:57.122833 17117 tablet_bootstrap.cc:654] T 8affc906415f4b3aa5ed3e9a971f9aec P 5b0ce9a34e224f65aee2d205dd874ba2: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:57.122833 17114 tablet_bootstrap.cc:654] T 86e15b6028704208a711b8069cba2929 P 631194f763324d39a224b5728199751f: Neither blocks nor log segments found. Creating new log.
I20260709 12:18:57.142371 17117 tablet_bootstrap.cc:492] T 8affc906415f4b3aa5ed3e9a971f9aec P 5b0ce9a34e224f65aee2d205dd874ba2: No bootstrap required, opened a new log
I20260709 12:18:57.142928 17117 ts_tablet_manager.cc:1403] T 8affc906415f4b3aa5ed3e9a971f9aec P 5b0ce9a34e224f65aee2d205dd874ba2: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.006s
I20260709 12:18:57.143013 17114 tablet_bootstrap.cc:492] T 86e15b6028704208a711b8069cba2929 P 631194f763324d39a224b5728199751f: No bootstrap required, opened a new log
I20260709 12:18:57.143564 17114 ts_tablet_manager.cc:1403] T 86e15b6028704208a711b8069cba2929 P 631194f763324d39a224b5728199751f: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.009s
I20260709 12:18:57.144726 17099 raft_consensus.cc:493] T 73a5894bf58143d3a71dabf8231d33ba P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:57.145433 17099 raft_consensus.cc:515] T 73a5894bf58143d3a71dabf8231d33ba P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:57.146083 17117 raft_consensus.cc:359] T 8affc906415f4b3aa5ed3e9a971f9aec P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:57.146309 17114 raft_consensus.cc:359] T 86e15b6028704208a711b8069cba2929 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:57.146905 17117 raft_consensus.cc:385] T 8affc906415f4b3aa5ed3e9a971f9aec P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:57.146973 17114 raft_consensus.cc:385] T 86e15b6028704208a711b8069cba2929 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:18:57.147226 17117 raft_consensus.cc:740] T 8affc906415f4b3aa5ed3e9a971f9aec P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b0ce9a34e224f65aee2d205dd874ba2, State: Initialized, Role: FOLLOWER
I20260709 12:18:57.147341 17114 raft_consensus.cc:740] T 86e15b6028704208a711b8069cba2929 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631194f763324d39a224b5728199751f, State: Initialized, Role: FOLLOWER
I20260709 12:18:57.147497 17099 leader_election.cc:290] T 73a5894bf58143d3a71dabf8231d33ba P 631194f763324d39a224b5728199751f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979), d641bfb9187942e9907fe05411aaac98 (127.3.212.130:44221)
I20260709 12:18:57.148041 17117 consensus_queue.cc:260] T 8affc906415f4b3aa5ed3e9a971f9aec P 5b0ce9a34e224f65aee2d205dd874ba2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:57.148142 17114 consensus_queue.cc:260] T 86e15b6028704208a711b8069cba2929 P 631194f763324d39a224b5728199751f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:57.148679 16820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a5894bf58143d3a71dabf8231d33ba" candidate_uuid: "631194f763324d39a224b5728199751f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" is_pre_election: true
I20260709 12:18:57.149471 16820 raft_consensus.cc:2468] T 73a5894bf58143d3a71dabf8231d33ba P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631194f763324d39a224b5728199751f in term 0.
I20260709 12:18:57.149219 16895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a5894bf58143d3a71dabf8231d33ba" candidate_uuid: "631194f763324d39a224b5728199751f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d641bfb9187942e9907fe05411aaac98" is_pre_election: true
I20260709 12:18:57.150348 17114 ts_tablet_manager.cc:1434] T 86e15b6028704208a711b8069cba2929 P 631194f763324d39a224b5728199751f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:18:57.150341 17117 ts_tablet_manager.cc:1434] T 8affc906415f4b3aa5ed3e9a971f9aec P 5b0ce9a34e224f65aee2d205dd874ba2: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.005s
I20260709 12:18:57.153465 16933 leader_election.cc:304] T 73a5894bf58143d3a71dabf8231d33ba P 631194f763324d39a224b5728199751f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b0ce9a34e224f65aee2d205dd874ba2, 631194f763324d39a224b5728199751f; no voters: 
I20260709 12:18:57.150231 16895 raft_consensus.cc:2468] T 73a5894bf58143d3a71dabf8231d33ba P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631194f763324d39a224b5728199751f in term 0.
I20260709 12:18:57.154461 17099 raft_consensus.cc:2804] T 73a5894bf58143d3a71dabf8231d33ba P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:57.154927 17099 raft_consensus.cc:493] T 73a5894bf58143d3a71dabf8231d33ba P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:57.155342 17099 raft_consensus.cc:3060] T 73a5894bf58143d3a71dabf8231d33ba P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:57.163965 17099 raft_consensus.cc:515] T 73a5894bf58143d3a71dabf8231d33ba P 631194f763324d39a224b5728199751f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:57.165995 17099 leader_election.cc:290] T 73a5894bf58143d3a71dabf8231d33ba P 631194f763324d39a224b5728199751f [CANDIDATE]: Term 1 election: Requested vote from peers 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979), d641bfb9187942e9907fe05411aaac98 (127.3.212.130:44221)
I20260709 12:18:57.167001 16895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a5894bf58143d3a71dabf8231d33ba" candidate_uuid: "631194f763324d39a224b5728199751f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d641bfb9187942e9907fe05411aaac98"
I20260709 12:18:57.167003 16820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a5894bf58143d3a71dabf8231d33ba" candidate_uuid: "631194f763324d39a224b5728199751f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b0ce9a34e224f65aee2d205dd874ba2"
I20260709 12:18:57.167891 16895 raft_consensus.cc:3060] T 73a5894bf58143d3a71dabf8231d33ba P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:57.167906 16820 raft_consensus.cc:3060] T 73a5894bf58143d3a71dabf8231d33ba P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:57.175804 16820 raft_consensus.cc:2468] T 73a5894bf58143d3a71dabf8231d33ba P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631194f763324d39a224b5728199751f in term 1.
I20260709 12:18:57.175804 16895 raft_consensus.cc:2468] T 73a5894bf58143d3a71dabf8231d33ba P d641bfb9187942e9907fe05411aaac98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631194f763324d39a224b5728199751f in term 1.
I20260709 12:18:57.177299 16933 leader_election.cc:304] T 73a5894bf58143d3a71dabf8231d33ba P 631194f763324d39a224b5728199751f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b0ce9a34e224f65aee2d205dd874ba2, 631194f763324d39a224b5728199751f; no voters: 
I20260709 12:18:57.178092 17099 raft_consensus.cc:2804] T 73a5894bf58143d3a71dabf8231d33ba P 631194f763324d39a224b5728199751f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:57.178504 17099 raft_consensus.cc:697] T 73a5894bf58143d3a71dabf8231d33ba P 631194f763324d39a224b5728199751f [term 1 LEADER]: Becoming Leader. State: Replica: 631194f763324d39a224b5728199751f, State: Running, Role: LEADER
I20260709 12:18:57.179409 17099 consensus_queue.cc:237] T 73a5894bf58143d3a71dabf8231d33ba P 631194f763324d39a224b5728199751f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:57.186805 16717 catalog_manager.cc:5697] T 73a5894bf58143d3a71dabf8231d33ba P 631194f763324d39a224b5728199751f reported cstate change: term changed from 0 to 1, leader changed from <none> to 631194f763324d39a224b5728199751f (127.3.212.131). New cstate: current_term: 1 leader_uuid: "631194f763324d39a224b5728199751f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:57.209589 17119 raft_consensus.cc:493] T 5fabedcf8a28457fab071f75fe106037 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:57.210206 17119 raft_consensus.cc:515] T 5fabedcf8a28457fab071f75fe106037 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:57.212064 17119 leader_election.cc:290] T 5fabedcf8a28457fab071f75fe106037 P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979), 631194f763324d39a224b5728199751f (127.3.212.131:32987)
I20260709 12:18:57.213034 16820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fabedcf8a28457fab071f75fe106037" candidate_uuid: "d641bfb9187942e9907fe05411aaac98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" is_pre_election: true
I20260709 12:18:57.213209 16969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fabedcf8a28457fab071f75fe106037" candidate_uuid: "d641bfb9187942e9907fe05411aaac98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631194f763324d39a224b5728199751f" is_pre_election: true
I20260709 12:18:57.213932 16969 raft_consensus.cc:2468] T 5fabedcf8a28457fab071f75fe106037 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d641bfb9187942e9907fe05411aaac98 in term 0.
I20260709 12:18:57.213990 16820 raft_consensus.cc:2468] T 5fabedcf8a28457fab071f75fe106037 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d641bfb9187942e9907fe05411aaac98 in term 0.
I20260709 12:18:57.215054 16862 leader_election.cc:304] T 5fabedcf8a28457fab071f75fe106037 P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631194f763324d39a224b5728199751f, d641bfb9187942e9907fe05411aaac98; no voters: 
I20260709 12:18:57.215786 17119 raft_consensus.cc:2804] T 5fabedcf8a28457fab071f75fe106037 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:57.216055 17119 raft_consensus.cc:493] T 5fabedcf8a28457fab071f75fe106037 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:57.216323 17119 raft_consensus.cc:3060] T 5fabedcf8a28457fab071f75fe106037 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:57.221681 17119 raft_consensus.cc:515] T 5fabedcf8a28457fab071f75fe106037 P d641bfb9187942e9907fe05411aaac98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:57.223479 17119 leader_election.cc:290] T 5fabedcf8a28457fab071f75fe106037 P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 1 election: Requested vote from peers 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979), 631194f763324d39a224b5728199751f (127.3.212.131:32987)
I20260709 12:18:57.224331 16820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fabedcf8a28457fab071f75fe106037" candidate_uuid: "d641bfb9187942e9907fe05411aaac98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b0ce9a34e224f65aee2d205dd874ba2"
I20260709 12:18:57.224511 16968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fabedcf8a28457fab071f75fe106037" candidate_uuid: "d641bfb9187942e9907fe05411aaac98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631194f763324d39a224b5728199751f"
I20260709 12:18:57.224895 16820 raft_consensus.cc:3060] T 5fabedcf8a28457fab071f75fe106037 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:57.225108 16968 raft_consensus.cc:3060] T 5fabedcf8a28457fab071f75fe106037 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:57.230324 16820 raft_consensus.cc:2468] T 5fabedcf8a28457fab071f75fe106037 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d641bfb9187942e9907fe05411aaac98 in term 1.
I20260709 12:18:57.230597 16968 raft_consensus.cc:2468] T 5fabedcf8a28457fab071f75fe106037 P 631194f763324d39a224b5728199751f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d641bfb9187942e9907fe05411aaac98 in term 1.
I20260709 12:18:57.231406 16859 leader_election.cc:304] T 5fabedcf8a28457fab071f75fe106037 P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b0ce9a34e224f65aee2d205dd874ba2, d641bfb9187942e9907fe05411aaac98; no voters: 
I20260709 12:18:57.232231 17119 raft_consensus.cc:2804] T 5fabedcf8a28457fab071f75fe106037 P d641bfb9187942e9907fe05411aaac98 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:57.232699 17119 raft_consensus.cc:697] T 5fabedcf8a28457fab071f75fe106037 P d641bfb9187942e9907fe05411aaac98 [term 1 LEADER]: Becoming Leader. State: Replica: d641bfb9187942e9907fe05411aaac98, State: Running, Role: LEADER
I20260709 12:18:57.233332 17119 consensus_queue.cc:237] T 5fabedcf8a28457fab071f75fe106037 P d641bfb9187942e9907fe05411aaac98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:57.241475 16717 catalog_manager.cc:5697] T 5fabedcf8a28457fab071f75fe106037 P d641bfb9187942e9907fe05411aaac98 reported cstate change: term changed from 0 to 1, leader changed from <none> to d641bfb9187942e9907fe05411aaac98 (127.3.212.130). New cstate: current_term: 1 leader_uuid: "d641bfb9187942e9907fe05411aaac98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:57.256899 17099 raft_consensus.cc:493] T 8affc906415f4b3aa5ed3e9a971f9aec P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:57.257534 17099 raft_consensus.cc:515] T 8affc906415f4b3aa5ed3e9a971f9aec P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:57.259471 17099 leader_election.cc:290] T 8affc906415f4b3aa5ed3e9a971f9aec P 631194f763324d39a224b5728199751f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979), d641bfb9187942e9907fe05411aaac98 (127.3.212.130:44221)
I20260709 12:18:57.260239 16820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8affc906415f4b3aa5ed3e9a971f9aec" candidate_uuid: "631194f763324d39a224b5728199751f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" is_pre_election: true
I20260709 12:18:57.260519 16895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8affc906415f4b3aa5ed3e9a971f9aec" candidate_uuid: "631194f763324d39a224b5728199751f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d641bfb9187942e9907fe05411aaac98" is_pre_election: true
I20260709 12:18:57.260929 16820 raft_consensus.cc:2468] T 8affc906415f4b3aa5ed3e9a971f9aec P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631194f763324d39a224b5728199751f in term 0.
I20260709 12:18:57.261255 16895 raft_consensus.cc:2468] T 8affc906415f4b3aa5ed3e9a971f9aec P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631194f763324d39a224b5728199751f in term 0.
I20260709 12:18:57.261963 16933 leader_election.cc:304] T 8affc906415f4b3aa5ed3e9a971f9aec P 631194f763324d39a224b5728199751f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b0ce9a34e224f65aee2d205dd874ba2, 631194f763324d39a224b5728199751f; no voters: 
I20260709 12:18:57.262791 17099 raft_consensus.cc:2804] T 8affc906415f4b3aa5ed3e9a971f9aec P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:57.263185 17099 raft_consensus.cc:493] T 8affc906415f4b3aa5ed3e9a971f9aec P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:57.263504 17099 raft_consensus.cc:3060] T 8affc906415f4b3aa5ed3e9a971f9aec P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:57.270000 17099 raft_consensus.cc:515] T 8affc906415f4b3aa5ed3e9a971f9aec P 631194f763324d39a224b5728199751f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:57.271633 17099 leader_election.cc:290] T 8affc906415f4b3aa5ed3e9a971f9aec P 631194f763324d39a224b5728199751f [CANDIDATE]: Term 1 election: Requested vote from peers 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979), d641bfb9187942e9907fe05411aaac98 (127.3.212.130:44221)
I20260709 12:18:57.272743 16820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8affc906415f4b3aa5ed3e9a971f9aec" candidate_uuid: "631194f763324d39a224b5728199751f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b0ce9a34e224f65aee2d205dd874ba2"
I20260709 12:18:57.272908 16895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8affc906415f4b3aa5ed3e9a971f9aec" candidate_uuid: "631194f763324d39a224b5728199751f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d641bfb9187942e9907fe05411aaac98"
I20260709 12:18:57.273322 16820 raft_consensus.cc:3060] T 8affc906415f4b3aa5ed3e9a971f9aec P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:57.273500 16895 raft_consensus.cc:3060] T 8affc906415f4b3aa5ed3e9a971f9aec P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:57.278096 16968 raft_consensus.cc:3060] T 877e171775ed47c8af9b177b9e7a13fa P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:57.280414 16820 raft_consensus.cc:2468] T 8affc906415f4b3aa5ed3e9a971f9aec P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631194f763324d39a224b5728199751f in term 1.
I20260709 12:18:57.281435 16895 raft_consensus.cc:2468] T 8affc906415f4b3aa5ed3e9a971f9aec P d641bfb9187942e9907fe05411aaac98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631194f763324d39a224b5728199751f in term 1.
I20260709 12:18:57.281690 16933 leader_election.cc:304] T 8affc906415f4b3aa5ed3e9a971f9aec P 631194f763324d39a224b5728199751f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b0ce9a34e224f65aee2d205dd874ba2, 631194f763324d39a224b5728199751f; no voters: 
I20260709 12:18:57.282558 17099 raft_consensus.cc:2804] T 8affc906415f4b3aa5ed3e9a971f9aec P 631194f763324d39a224b5728199751f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:57.283069 17099 raft_consensus.cc:697] T 8affc906415f4b3aa5ed3e9a971f9aec P 631194f763324d39a224b5728199751f [term 1 LEADER]: Becoming Leader. State: Replica: 631194f763324d39a224b5728199751f, State: Running, Role: LEADER
I20260709 12:18:57.283926 17099 consensus_queue.cc:237] T 8affc906415f4b3aa5ed3e9a971f9aec P 631194f763324d39a224b5728199751f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:57.287700 17119 consensus_queue.cc:1048] T 877e171775ed47c8af9b177b9e7a13fa P d641bfb9187942e9907fe05411aaac98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:57.293350 16717 catalog_manager.cc:5697] T 8affc906415f4b3aa5ed3e9a971f9aec P 631194f763324d39a224b5728199751f reported cstate change: term changed from 0 to 1, leader changed from <none> to 631194f763324d39a224b5728199751f (127.3.212.131). New cstate: current_term: 1 leader_uuid: "631194f763324d39a224b5728199751f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:57.303963 17100 raft_consensus.cc:493] T 3c06f7f07974452599bbaebd7f818ca9 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:57.304608 17100 raft_consensus.cc:515] T 3c06f7f07974452599bbaebd7f818ca9 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:57.307574 17100 leader_election.cc:290] T 3c06f7f07974452599bbaebd7f818ca9 P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979), 631194f763324d39a224b5728199751f (127.3.212.131:32987)
I20260709 12:18:57.309000 16820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c06f7f07974452599bbaebd7f818ca9" candidate_uuid: "d641bfb9187942e9907fe05411aaac98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" is_pre_election: true
I20260709 12:18:57.312716 17119 consensus_queue.cc:1048] T 877e171775ed47c8af9b177b9e7a13fa P d641bfb9187942e9907fe05411aaac98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:57.312942 16968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c06f7f07974452599bbaebd7f818ca9" candidate_uuid: "d641bfb9187942e9907fe05411aaac98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631194f763324d39a224b5728199751f" is_pre_election: true
I20260709 12:18:57.313872 16968 raft_consensus.cc:2393] T 3c06f7f07974452599bbaebd7f818ca9 P 631194f763324d39a224b5728199751f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d641bfb9187942e9907fe05411aaac98 in current term 1: Already voted for candidate 5b0ce9a34e224f65aee2d205dd874ba2 in this term.
I20260709 12:18:57.315044 16862 leader_election.cc:304] T 3c06f7f07974452599bbaebd7f818ca9 P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d641bfb9187942e9907fe05411aaac98; no voters: 5b0ce9a34e224f65aee2d205dd874ba2, 631194f763324d39a224b5728199751f
I20260709 12:18:57.317505 17100 raft_consensus.cc:3060] T 3c06f7f07974452599bbaebd7f818ca9 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:57.326567 17119 raft_consensus.cc:493] T 86e15b6028704208a711b8069cba2929 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:57.327204 17119 raft_consensus.cc:515] T 86e15b6028704208a711b8069cba2929 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:57.327564 17100 raft_consensus.cc:2749] T 3c06f7f07974452599bbaebd7f818ca9 P d641bfb9187942e9907fe05411aaac98 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:18:57.329555 17119 leader_election.cc:290] T 86e15b6028704208a711b8069cba2929 P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979), 631194f763324d39a224b5728199751f (127.3.212.131:32987)
I20260709 12:18:57.332320 16968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e15b6028704208a711b8069cba2929" candidate_uuid: "d641bfb9187942e9907fe05411aaac98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631194f763324d39a224b5728199751f" is_pre_election: true
I20260709 12:18:57.334648 16821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e15b6028704208a711b8069cba2929" candidate_uuid: "d641bfb9187942e9907fe05411aaac98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" is_pre_election: true
I20260709 12:18:57.334736 16968 raft_consensus.cc:2468] T 86e15b6028704208a711b8069cba2929 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d641bfb9187942e9907fe05411aaac98 in term 0.
I20260709 12:18:57.335939 16821 raft_consensus.cc:2468] T 86e15b6028704208a711b8069cba2929 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d641bfb9187942e9907fe05411aaac98 in term 0.
I20260709 12:18:57.337249 16859 leader_election.cc:304] T 86e15b6028704208a711b8069cba2929 P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b0ce9a34e224f65aee2d205dd874ba2, d641bfb9187942e9907fe05411aaac98; no voters: 
I20260709 12:18:57.338308 17119 raft_consensus.cc:2804] T 86e15b6028704208a711b8069cba2929 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:57.338682 17119 raft_consensus.cc:493] T 86e15b6028704208a711b8069cba2929 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:57.339005 17119 raft_consensus.cc:3060] T 86e15b6028704208a711b8069cba2929 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:57.340149 17115 consensus_queue.cc:1048] T 3c06f7f07974452599bbaebd7f818ca9 P 5b0ce9a34e224f65aee2d205dd874ba2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:57.348493 17119 raft_consensus.cc:515] T 86e15b6028704208a711b8069cba2929 P d641bfb9187942e9907fe05411aaac98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:57.351068 17119 leader_election.cc:290] T 86e15b6028704208a711b8069cba2929 P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 1 election: Requested vote from peers 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979), 631194f763324d39a224b5728199751f (127.3.212.131:32987)
I20260709 12:18:57.352198 16968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e15b6028704208a711b8069cba2929" candidate_uuid: "d641bfb9187942e9907fe05411aaac98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631194f763324d39a224b5728199751f"
I20260709 12:18:57.352900 16968 raft_consensus.cc:3060] T 86e15b6028704208a711b8069cba2929 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:57.359532 17115 consensus_queue.cc:1048] T 3c06f7f07974452599bbaebd7f818ca9 P 5b0ce9a34e224f65aee2d205dd874ba2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:57.361809 16821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86e15b6028704208a711b8069cba2929" candidate_uuid: "d641bfb9187942e9907fe05411aaac98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b0ce9a34e224f65aee2d205dd874ba2"
I20260709 12:18:57.362593 16821 raft_consensus.cc:3060] T 86e15b6028704208a711b8069cba2929 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:57.375854 16968 raft_consensus.cc:2468] T 86e15b6028704208a711b8069cba2929 P 631194f763324d39a224b5728199751f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d641bfb9187942e9907fe05411aaac98 in term 1.
I20260709 12:18:57.379137 17099 consensus_queue.cc:1048] T 9caa951d90c54e5086bc8d886ba6c450 P 631194f763324d39a224b5728199751f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:57.381982 16862 leader_election.cc:304] T 86e15b6028704208a711b8069cba2929 P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631194f763324d39a224b5728199751f, d641bfb9187942e9907fe05411aaac98; no voters: 
I20260709 12:18:57.383345 17119 raft_consensus.cc:2804] T 86e15b6028704208a711b8069cba2929 P d641bfb9187942e9907fe05411aaac98 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:57.385917 17119 raft_consensus.cc:697] T 86e15b6028704208a711b8069cba2929 P d641bfb9187942e9907fe05411aaac98 [term 1 LEADER]: Becoming Leader. State: Replica: d641bfb9187942e9907fe05411aaac98, State: Running, Role: LEADER
I20260709 12:18:57.379910 16821 raft_consensus.cc:2468] T 86e15b6028704208a711b8069cba2929 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d641bfb9187942e9907fe05411aaac98 in term 1.
I20260709 12:18:57.386819 17119 consensus_queue.cc:237] T 86e15b6028704208a711b8069cba2929 P d641bfb9187942e9907fe05411aaac98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:57.400784 16716 catalog_manager.cc:5697] T 86e15b6028704208a711b8069cba2929 P d641bfb9187942e9907fe05411aaac98 reported cstate change: term changed from 0 to 1, leader changed from <none> to d641bfb9187942e9907fe05411aaac98 (127.3.212.130). New cstate: current_term: 1 leader_uuid: "d641bfb9187942e9907fe05411aaac98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:57.404212 17132 consensus_queue.cc:1048] T 9caa951d90c54e5086bc8d886ba6c450 P 631194f763324d39a224b5728199751f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:57.441171 17132 raft_consensus.cc:493] T 04bbf32b02ed450f99f360da0e55cff7 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:57.441694 17132 raft_consensus.cc:515] T 04bbf32b02ed450f99f360da0e55cff7 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:57.443439 17132 leader_election.cc:290] T 04bbf32b02ed450f99f360da0e55cff7 P 631194f763324d39a224b5728199751f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979), d641bfb9187942e9907fe05411aaac98 (127.3.212.130:44221)
I20260709 12:18:57.444222 16820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04bbf32b02ed450f99f360da0e55cff7" candidate_uuid: "631194f763324d39a224b5728199751f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" is_pre_election: true
I20260709 12:18:57.445024 16820 raft_consensus.cc:2468] T 04bbf32b02ed450f99f360da0e55cff7 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631194f763324d39a224b5728199751f in term 0.
I20260709 12:18:57.445103 16895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04bbf32b02ed450f99f360da0e55cff7" candidate_uuid: "631194f763324d39a224b5728199751f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d641bfb9187942e9907fe05411aaac98" is_pre_election: true
I20260709 12:18:57.445847 16895 raft_consensus.cc:2468] T 04bbf32b02ed450f99f360da0e55cff7 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631194f763324d39a224b5728199751f in term 0.
I20260709 12:18:57.446309 16933 leader_election.cc:304] T 04bbf32b02ed450f99f360da0e55cff7 P 631194f763324d39a224b5728199751f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b0ce9a34e224f65aee2d205dd874ba2, 631194f763324d39a224b5728199751f; no voters: 
I20260709 12:18:57.447170 17132 raft_consensus.cc:2804] T 04bbf32b02ed450f99f360da0e55cff7 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:18:57.447451 17132 raft_consensus.cc:493] T 04bbf32b02ed450f99f360da0e55cff7 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:57.447707 17132 raft_consensus.cc:3060] T 04bbf32b02ed450f99f360da0e55cff7 P 631194f763324d39a224b5728199751f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:57.453225 17132 raft_consensus.cc:515] T 04bbf32b02ed450f99f360da0e55cff7 P 631194f763324d39a224b5728199751f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:57.454921 17132 leader_election.cc:290] T 04bbf32b02ed450f99f360da0e55cff7 P 631194f763324d39a224b5728199751f [CANDIDATE]: Term 1 election: Requested vote from peers 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979), d641bfb9187942e9907fe05411aaac98 (127.3.212.130:44221)
I20260709 12:18:57.455744 16820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04bbf32b02ed450f99f360da0e55cff7" candidate_uuid: "631194f763324d39a224b5728199751f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b0ce9a34e224f65aee2d205dd874ba2"
I20260709 12:18:57.455919 16895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04bbf32b02ed450f99f360da0e55cff7" candidate_uuid: "631194f763324d39a224b5728199751f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d641bfb9187942e9907fe05411aaac98"
I20260709 12:18:57.456324 16820 raft_consensus.cc:3060] T 04bbf32b02ed450f99f360da0e55cff7 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:57.456490 16895 raft_consensus.cc:3060] T 04bbf32b02ed450f99f360da0e55cff7 P d641bfb9187942e9907fe05411aaac98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:18:57.461968 16820 raft_consensus.cc:2468] T 04bbf32b02ed450f99f360da0e55cff7 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631194f763324d39a224b5728199751f in term 1.
I20260709 12:18:57.461982 16895 raft_consensus.cc:2468] T 04bbf32b02ed450f99f360da0e55cff7 P d641bfb9187942e9907fe05411aaac98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631194f763324d39a224b5728199751f in term 1.
I20260709 12:18:57.463416 16933 leader_election.cc:304] T 04bbf32b02ed450f99f360da0e55cff7 P 631194f763324d39a224b5728199751f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b0ce9a34e224f65aee2d205dd874ba2, 631194f763324d39a224b5728199751f; no voters: 
I20260709 12:18:57.464049 17132 raft_consensus.cc:2804] T 04bbf32b02ed450f99f360da0e55cff7 P 631194f763324d39a224b5728199751f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:18:57.464442 17132 raft_consensus.cc:697] T 04bbf32b02ed450f99f360da0e55cff7 P 631194f763324d39a224b5728199751f [term 1 LEADER]: Becoming Leader. State: Replica: 631194f763324d39a224b5728199751f, State: Running, Role: LEADER
I20260709 12:18:57.465222 17132 consensus_queue.cc:237] T 04bbf32b02ed450f99f360da0e55cff7 P 631194f763324d39a224b5728199751f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:57.474022 16717 catalog_manager.cc:5697] T 04bbf32b02ed450f99f360da0e55cff7 P 631194f763324d39a224b5728199751f reported cstate change: term changed from 0 to 1, leader changed from <none> to 631194f763324d39a224b5728199751f (127.3.212.131). New cstate: current_term: 1 leader_uuid: "631194f763324d39a224b5728199751f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:57.567934 16895 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5fabedcf8a28457fab071f75fe106037"
dest_uuid: "d641bfb9187942e9907fe05411aaac98"
mode: GRACEFUL
new_leader_uuid: "5b0ce9a34e224f65aee2d205dd874ba2"
 from {username='slave'} at 127.0.0.1:47354
I20260709 12:18:57.568665 16895 raft_consensus.cc:606] T 5fabedcf8a28457fab071f75fe106037 P d641bfb9187942e9907fe05411aaac98 [term 1 LEADER]: Received request to transfer leadership to TS 5b0ce9a34e224f65aee2d205dd874ba2
I20260709 12:18:57.574679 16968 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8affc906415f4b3aa5ed3e9a971f9aec"
dest_uuid: "631194f763324d39a224b5728199751f"
mode: GRACEFUL
new_leader_uuid: "5b0ce9a34e224f65aee2d205dd874ba2"
 from {username='slave'} at 127.0.0.1:38892
I20260709 12:18:57.575289 16968 raft_consensus.cc:606] T 8affc906415f4b3aa5ed3e9a971f9aec P 631194f763324d39a224b5728199751f [term 1 LEADER]: Received request to transfer leadership to TS 5b0ce9a34e224f65aee2d205dd874ba2
I20260709 12:18:57.580674 16968 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73a5894bf58143d3a71dabf8231d33ba"
dest_uuid: "631194f763324d39a224b5728199751f"
mode: GRACEFUL
new_leader_uuid: "5b0ce9a34e224f65aee2d205dd874ba2"
 from {username='slave'} at 127.0.0.1:38892
I20260709 12:18:57.581250 16968 raft_consensus.cc:606] T 73a5894bf58143d3a71dabf8231d33ba P 631194f763324d39a224b5728199751f [term 1 LEADER]: Received request to transfer leadership to TS 5b0ce9a34e224f65aee2d205dd874ba2
I20260709 12:18:57.586470 16968 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f2665342de64990947409a4e83aa0a2"
dest_uuid: "631194f763324d39a224b5728199751f"
mode: GRACEFUL
new_leader_uuid: "5b0ce9a34e224f65aee2d205dd874ba2"
 from {username='slave'} at 127.0.0.1:38892
I20260709 12:18:57.587021 16968 raft_consensus.cc:606] T 0f2665342de64990947409a4e83aa0a2 P 631194f763324d39a224b5728199751f [term 1 LEADER]: Received request to transfer leadership to TS 5b0ce9a34e224f65aee2d205dd874ba2
I20260709 12:18:57.589859 17132 consensus_queue.cc:1048] T 73a5894bf58143d3a71dabf8231d33ba P 631194f763324d39a224b5728199751f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:57.593281 16820 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c06f7f07974452599bbaebd7f818ca9"
dest_uuid: "5b0ce9a34e224f65aee2d205dd874ba2"
mode: GRACEFUL
new_leader_uuid: "d641bfb9187942e9907fe05411aaac98"
 from {username='slave'} at 127.0.0.1:48182
I20260709 12:18:57.594022 16820 raft_consensus.cc:606] T 3c06f7f07974452599bbaebd7f818ca9 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 LEADER]: Received request to transfer leadership to TS d641bfb9187942e9907fe05411aaac98
I20260709 12:18:57.604156 16968 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04bbf32b02ed450f99f360da0e55cff7"
dest_uuid: "631194f763324d39a224b5728199751f"
mode: GRACEFUL
new_leader_uuid: "d641bfb9187942e9907fe05411aaac98"
 from {username='slave'} at 127.0.0.1:38892
I20260709 12:18:57.604815 16968 raft_consensus.cc:606] T 04bbf32b02ed450f99f360da0e55cff7 P 631194f763324d39a224b5728199751f [term 1 LEADER]: Received request to transfer leadership to TS d641bfb9187942e9907fe05411aaac98
I20260709 12:18:57.607810 17131 consensus_queue.cc:1048] T 73a5894bf58143d3a71dabf8231d33ba P 631194f763324d39a224b5728199751f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:57.614049 17131 consensus_queue.cc:1048] T 0f2665342de64990947409a4e83aa0a2 P 631194f763324d39a224b5728199751f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:57.620630 17132 consensus_queue.cc:1048] T 0f2665342de64990947409a4e83aa0a2 P 631194f763324d39a224b5728199751f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:57.635015 17132 raft_consensus.cc:993] T 73a5894bf58143d3a71dabf8231d33ba P 631194f763324d39a224b5728199751f: : Instructing follower 5b0ce9a34e224f65aee2d205dd874ba2 to start an election
I20260709 12:18:57.635612 17132 raft_consensus.cc:1081] T 73a5894bf58143d3a71dabf8231d33ba P 631194f763324d39a224b5728199751f [term 1 LEADER]: Signalling peer 5b0ce9a34e224f65aee2d205dd874ba2 to start an election
I20260709 12:18:57.639014 16820 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "73a5894bf58143d3a71dabf8231d33ba"
dest_uuid: "5b0ce9a34e224f65aee2d205dd874ba2"
 from {username='slave'} at 127.0.0.1:48170
I20260709 12:18:57.639736 16820 raft_consensus.cc:493] T 73a5894bf58143d3a71dabf8231d33ba P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:57.640057 16820 raft_consensus.cc:3060] T 73a5894bf58143d3a71dabf8231d33ba P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:57.646354 17131 raft_consensus.cc:993] T 0f2665342de64990947409a4e83aa0a2 P 631194f763324d39a224b5728199751f: : Instructing follower 5b0ce9a34e224f65aee2d205dd874ba2 to start an election
I20260709 12:18:57.646926 17131 raft_consensus.cc:1081] T 0f2665342de64990947409a4e83aa0a2 P 631194f763324d39a224b5728199751f [term 1 LEADER]: Signalling peer 5b0ce9a34e224f65aee2d205dd874ba2 to start an election
I20260709 12:18:57.650038 16819 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f2665342de64990947409a4e83aa0a2"
dest_uuid: "5b0ce9a34e224f65aee2d205dd874ba2"
 from {username='slave'} at 127.0.0.1:48170
I20260709 12:18:57.650200 16820 raft_consensus.cc:515] T 73a5894bf58143d3a71dabf8231d33ba P 5b0ce9a34e224f65aee2d205dd874ba2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:57.650676 16819 raft_consensus.cc:493] T 0f2665342de64990947409a4e83aa0a2 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:57.651118 16819 raft_consensus.cc:3060] T 0f2665342de64990947409a4e83aa0a2 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:57.652897 16820 leader_election.cc:290] T 73a5894bf58143d3a71dabf8231d33ba P 5b0ce9a34e224f65aee2d205dd874ba2 [CANDIDATE]: Term 2 election: Requested vote from peers d641bfb9187942e9907fe05411aaac98 (127.3.212.130:44221), 631194f763324d39a224b5728199751f (127.3.212.131:32987)
I20260709 12:18:57.653681 16894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a5894bf58143d3a71dabf8231d33ba" candidate_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d641bfb9187942e9907fe05411aaac98"
I20260709 12:18:57.654167 16968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a5894bf58143d3a71dabf8231d33ba" candidate_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "631194f763324d39a224b5728199751f"
I20260709 12:18:57.654372 16894 raft_consensus.cc:3060] T 73a5894bf58143d3a71dabf8231d33ba P d641bfb9187942e9907fe05411aaac98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:57.654685 16968 raft_consensus.cc:3055] T 73a5894bf58143d3a71dabf8231d33ba P 631194f763324d39a224b5728199751f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:57.655437 16968 raft_consensus.cc:740] T 73a5894bf58143d3a71dabf8231d33ba P 631194f763324d39a224b5728199751f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 631194f763324d39a224b5728199751f, State: Running, Role: LEADER
I20260709 12:18:57.656143 16968 consensus_queue.cc:260] T 73a5894bf58143d3a71dabf8231d33ba P 631194f763324d39a224b5728199751f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:57.657120 16968 raft_consensus.cc:3060] T 73a5894bf58143d3a71dabf8231d33ba P 631194f763324d39a224b5728199751f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:57.659881 17162 consensus_queue.cc:1048] T 5fabedcf8a28457fab071f75fe106037 P d641bfb9187942e9907fe05411aaac98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:57.664238 16894 raft_consensus.cc:2468] T 73a5894bf58143d3a71dabf8231d33ba P d641bfb9187942e9907fe05411aaac98 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b0ce9a34e224f65aee2d205dd874ba2 in term 2.
I20260709 12:18:57.665575 16784 leader_election.cc:304] T 73a5894bf58143d3a71dabf8231d33ba P 5b0ce9a34e224f65aee2d205dd874ba2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b0ce9a34e224f65aee2d205dd874ba2, d641bfb9187942e9907fe05411aaac98; no voters: 
I20260709 12:18:57.665766 16968 raft_consensus.cc:2468] T 73a5894bf58143d3a71dabf8231d33ba P 631194f763324d39a224b5728199751f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b0ce9a34e224f65aee2d205dd874ba2 in term 2.
I20260709 12:18:57.667086 17167 raft_consensus.cc:2804] T 73a5894bf58143d3a71dabf8231d33ba P 5b0ce9a34e224f65aee2d205dd874ba2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:57.667614 17167 raft_consensus.cc:697] T 73a5894bf58143d3a71dabf8231d33ba P 5b0ce9a34e224f65aee2d205dd874ba2 [term 2 LEADER]: Becoming Leader. State: Replica: 5b0ce9a34e224f65aee2d205dd874ba2, State: Running, Role: LEADER
I20260709 12:18:57.668449 17167 consensus_queue.cc:237] T 73a5894bf58143d3a71dabf8231d33ba P 5b0ce9a34e224f65aee2d205dd874ba2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:57.668493 16819 raft_consensus.cc:515] T 0f2665342de64990947409a4e83aa0a2 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:57.674113 16819 leader_election.cc:290] T 0f2665342de64990947409a4e83aa0a2 P 5b0ce9a34e224f65aee2d205dd874ba2 [CANDIDATE]: Term 2 election: Requested vote from peers d641bfb9187942e9907fe05411aaac98 (127.3.212.130:44221), 631194f763324d39a224b5728199751f (127.3.212.131:32987)
I20260709 12:18:57.675525 16895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f2665342de64990947409a4e83aa0a2" candidate_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d641bfb9187942e9907fe05411aaac98"
I20260709 12:18:57.676055 16968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f2665342de64990947409a4e83aa0a2" candidate_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "631194f763324d39a224b5728199751f"
I20260709 12:18:57.676335 16895 raft_consensus.cc:3060] T 0f2665342de64990947409a4e83aa0a2 P d641bfb9187942e9907fe05411aaac98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:57.676717 16968 raft_consensus.cc:3055] T 0f2665342de64990947409a4e83aa0a2 P 631194f763324d39a224b5728199751f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:57.677026 16968 raft_consensus.cc:740] T 0f2665342de64990947409a4e83aa0a2 P 631194f763324d39a224b5728199751f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 631194f763324d39a224b5728199751f, State: Running, Role: LEADER
I20260709 12:18:57.677771 16968 consensus_queue.cc:260] T 0f2665342de64990947409a4e83aa0a2 P 631194f763324d39a224b5728199751f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:57.678840 16968 raft_consensus.cc:3060] T 0f2665342de64990947409a4e83aa0a2 P 631194f763324d39a224b5728199751f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:57.679497 17119 raft_consensus.cc:993] T 5fabedcf8a28457fab071f75fe106037 P d641bfb9187942e9907fe05411aaac98: : Instructing follower 5b0ce9a34e224f65aee2d205dd874ba2 to start an election
I20260709 12:18:57.680001 17119 raft_consensus.cc:1081] T 5fabedcf8a28457fab071f75fe106037 P d641bfb9187942e9907fe05411aaac98 [term 1 LEADER]: Signalling peer 5b0ce9a34e224f65aee2d205dd874ba2 to start an election
I20260709 12:18:57.682991 16818 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5fabedcf8a28457fab071f75fe106037"
dest_uuid: "5b0ce9a34e224f65aee2d205dd874ba2"
 from {username='slave'} at 127.0.0.1:48166
I20260709 12:18:57.683660 16818 raft_consensus.cc:493] T 5fabedcf8a28457fab071f75fe106037 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:57.684051 16818 raft_consensus.cc:3060] T 5fabedcf8a28457fab071f75fe106037 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:57.685892 17162 consensus_queue.cc:1048] T 5fabedcf8a28457fab071f75fe106037 P d641bfb9187942e9907fe05411aaac98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:57.687611 16895 raft_consensus.cc:2468] T 0f2665342de64990947409a4e83aa0a2 P d641bfb9187942e9907fe05411aaac98 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b0ce9a34e224f65aee2d205dd874ba2 in term 2.
I20260709 12:18:57.675508 16821 raft_consensus.cc:1240] T 0f2665342de64990947409a4e83aa0a2 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 2 FOLLOWER]: Rejecting Update request from peer 631194f763324d39a224b5728199751f for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:57.689489 16784 leader_election.cc:304] T 0f2665342de64990947409a4e83aa0a2 P 5b0ce9a34e224f65aee2d205dd874ba2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b0ce9a34e224f65aee2d205dd874ba2, d641bfb9187942e9907fe05411aaac98; no voters: 
I20260709 12:18:57.689357 16968 raft_consensus.cc:2468] T 0f2665342de64990947409a4e83aa0a2 P 631194f763324d39a224b5728199751f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b0ce9a34e224f65aee2d205dd874ba2 in term 2.
I20260709 12:18:57.697537 17167 raft_consensus.cc:2804] T 0f2665342de64990947409a4e83aa0a2 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:57.699657 17167 raft_consensus.cc:697] T 0f2665342de64990947409a4e83aa0a2 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 2 LEADER]: Becoming Leader. State: Replica: 5b0ce9a34e224f65aee2d205dd874ba2, State: Running, Role: LEADER
I20260709 12:18:57.700358 17167 consensus_queue.cc:237] T 0f2665342de64990947409a4e83aa0a2 P 5b0ce9a34e224f65aee2d205dd874ba2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:57.701617 16716 catalog_manager.cc:5697] T 73a5894bf58143d3a71dabf8231d33ba P 5b0ce9a34e224f65aee2d205dd874ba2 reported cstate change: term changed from 1 to 2, leader changed from 631194f763324d39a224b5728199751f (127.3.212.131) to 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129). New cstate: current_term: 2 leader_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:57.705493 16818 raft_consensus.cc:515] T 5fabedcf8a28457fab071f75fe106037 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:57.707643 16818 leader_election.cc:290] T 5fabedcf8a28457fab071f75fe106037 P 5b0ce9a34e224f65aee2d205dd874ba2 [CANDIDATE]: Term 2 election: Requested vote from peers d641bfb9187942e9907fe05411aaac98 (127.3.212.130:44221), 631194f763324d39a224b5728199751f (127.3.212.131:32987)
I20260709 12:18:57.708511 16894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fabedcf8a28457fab071f75fe106037" candidate_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d641bfb9187942e9907fe05411aaac98"
I20260709 12:18:57.709321 16894 raft_consensus.cc:3055] T 5fabedcf8a28457fab071f75fe106037 P d641bfb9187942e9907fe05411aaac98 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:57.707067 16819 raft_consensus.cc:1240] T 5fabedcf8a28457fab071f75fe106037 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 2 FOLLOWER]: Rejecting Update request from peer d641bfb9187942e9907fe05411aaac98 for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:57.709776 16894 raft_consensus.cc:740] T 5fabedcf8a28457fab071f75fe106037 P d641bfb9187942e9907fe05411aaac98 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d641bfb9187942e9907fe05411aaac98, State: Running, Role: LEADER
I20260709 12:18:57.711308 17162 consensus_queue.cc:1059] T 5fabedcf8a28457fab071f75fe106037 P d641bfb9187942e9907fe05411aaac98 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:57.711402 16970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fabedcf8a28457fab071f75fe106037" candidate_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "631194f763324d39a224b5728199751f"
I20260709 12:18:57.712255 16970 raft_consensus.cc:3060] T 5fabedcf8a28457fab071f75fe106037 P 631194f763324d39a224b5728199751f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:57.712301 16894 consensus_queue.cc:260] T 5fabedcf8a28457fab071f75fe106037 P d641bfb9187942e9907fe05411aaac98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:57.713783 16894 raft_consensus.cc:3060] T 5fabedcf8a28457fab071f75fe106037 P d641bfb9187942e9907fe05411aaac98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:57.718688 16716 catalog_manager.cc:5697] T 0f2665342de64990947409a4e83aa0a2 P 5b0ce9a34e224f65aee2d205dd874ba2 reported cstate change: term changed from 1 to 2, leader changed from 631194f763324d39a224b5728199751f (127.3.212.131) to 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129). New cstate: current_term: 2 leader_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:57.720954 16970 raft_consensus.cc:2468] T 5fabedcf8a28457fab071f75fe106037 P 631194f763324d39a224b5728199751f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b0ce9a34e224f65aee2d205dd874ba2 in term 2.
I20260709 12:18:57.721583 16894 raft_consensus.cc:2468] T 5fabedcf8a28457fab071f75fe106037 P d641bfb9187942e9907fe05411aaac98 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b0ce9a34e224f65aee2d205dd874ba2 in term 2.
I20260709 12:18:57.722242 16787 leader_election.cc:304] T 5fabedcf8a28457fab071f75fe106037 P 5b0ce9a34e224f65aee2d205dd874ba2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b0ce9a34e224f65aee2d205dd874ba2, 631194f763324d39a224b5728199751f; no voters: 
I20260709 12:18:57.723119 17167 raft_consensus.cc:2804] T 5fabedcf8a28457fab071f75fe106037 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:57.723583 17167 raft_consensus.cc:697] T 5fabedcf8a28457fab071f75fe106037 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 2 LEADER]: Becoming Leader. State: Replica: 5b0ce9a34e224f65aee2d205dd874ba2, State: Running, Role: LEADER
I20260709 12:18:57.724287 17167 consensus_queue.cc:237] T 5fabedcf8a28457fab071f75fe106037 P 5b0ce9a34e224f65aee2d205dd874ba2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:57.732292 16716 catalog_manager.cc:5697] T 5fabedcf8a28457fab071f75fe106037 P 5b0ce9a34e224f65aee2d205dd874ba2 reported cstate change: term changed from 1 to 2, leader changed from d641bfb9187942e9907fe05411aaac98 (127.3.212.130) to 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129). New cstate: current_term: 2 leader_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:57.788039 17084 raft_consensus.cc:993] T 3c06f7f07974452599bbaebd7f818ca9 P 5b0ce9a34e224f65aee2d205dd874ba2: : Instructing follower d641bfb9187942e9907fe05411aaac98 to start an election
I20260709 12:18:57.788551 17167 raft_consensus.cc:1081] T 3c06f7f07974452599bbaebd7f818ca9 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 LEADER]: Signalling peer d641bfb9187942e9907fe05411aaac98 to start an election
I20260709 12:18:57.790127 16894 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c06f7f07974452599bbaebd7f818ca9"
dest_uuid: "d641bfb9187942e9907fe05411aaac98"
 from {username='slave'} at 127.0.0.1:47340
I20260709 12:18:57.790661 16894 raft_consensus.cc:493] T 3c06f7f07974452599bbaebd7f818ca9 P d641bfb9187942e9907fe05411aaac98 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:57.790928 16894 raft_consensus.cc:3060] T 3c06f7f07974452599bbaebd7f818ca9 P d641bfb9187942e9907fe05411aaac98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:57.796756 16894 raft_consensus.cc:515] T 3c06f7f07974452599bbaebd7f818ca9 P d641bfb9187942e9907fe05411aaac98 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:57.798533 16894 leader_election.cc:290] T 3c06f7f07974452599bbaebd7f818ca9 P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 2 election: Requested vote from peers 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979), 631194f763324d39a224b5728199751f (127.3.212.131:32987)
I20260709 12:18:57.799500 16819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c06f7f07974452599bbaebd7f818ca9" candidate_uuid: "d641bfb9187942e9907fe05411aaac98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5b0ce9a34e224f65aee2d205dd874ba2"
I20260709 12:18:57.799687 16970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c06f7f07974452599bbaebd7f818ca9" candidate_uuid: "d641bfb9187942e9907fe05411aaac98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "631194f763324d39a224b5728199751f"
I20260709 12:18:57.800206 16819 raft_consensus.cc:3055] T 3c06f7f07974452599bbaebd7f818ca9 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:57.800395 16970 raft_consensus.cc:3060] T 3c06f7f07974452599bbaebd7f818ca9 P 631194f763324d39a224b5728199751f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:57.800524 16819 raft_consensus.cc:740] T 3c06f7f07974452599bbaebd7f818ca9 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5b0ce9a34e224f65aee2d205dd874ba2, State: Running, Role: LEADER
I20260709 12:18:57.801301 16819 consensus_queue.cc:260] T 3c06f7f07974452599bbaebd7f818ca9 P 5b0ce9a34e224f65aee2d205dd874ba2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:57.802603 16819 raft_consensus.cc:3060] T 3c06f7f07974452599bbaebd7f818ca9 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:57.808010 16970 raft_consensus.cc:2468] T 3c06f7f07974452599bbaebd7f818ca9 P 631194f763324d39a224b5728199751f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d641bfb9187942e9907fe05411aaac98 in term 2.
I20260709 12:18:57.810108 16819 raft_consensus.cc:2468] T 3c06f7f07974452599bbaebd7f818ca9 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d641bfb9187942e9907fe05411aaac98 in term 2.
I20260709 12:18:57.811056 16862 leader_election.cc:304] T 3c06f7f07974452599bbaebd7f818ca9 P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631194f763324d39a224b5728199751f, d641bfb9187942e9907fe05411aaac98; no voters: 
I20260709 12:18:57.812091 17119 raft_consensus.cc:2804] T 3c06f7f07974452599bbaebd7f818ca9 P d641bfb9187942e9907fe05411aaac98 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:57.813778 17119 raft_consensus.cc:697] T 3c06f7f07974452599bbaebd7f818ca9 P d641bfb9187942e9907fe05411aaac98 [term 2 LEADER]: Becoming Leader. State: Replica: d641bfb9187942e9907fe05411aaac98, State: Running, Role: LEADER
I20260709 12:18:57.814674 17119 consensus_queue.cc:237] T 3c06f7f07974452599bbaebd7f818ca9 P d641bfb9187942e9907fe05411aaac98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:57.815366 17132 consensus_queue.cc:1048] T 8affc906415f4b3aa5ed3e9a971f9aec P 631194f763324d39a224b5728199751f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:57.821663 17119 consensus_queue.cc:1048] T 86e15b6028704208a711b8069cba2929 P d641bfb9187942e9907fe05411aaac98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:57.825028 17132 consensus_queue.cc:1048] T 8affc906415f4b3aa5ed3e9a971f9aec P 631194f763324d39a224b5728199751f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:57.824716 16716 catalog_manager.cc:5697] T 3c06f7f07974452599bbaebd7f818ca9 P d641bfb9187942e9907fe05411aaac98 reported cstate change: term changed from 1 to 2, leader changed from 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129) to d641bfb9187942e9907fe05411aaac98 (127.3.212.130). New cstate: current_term: 2 leader_uuid: "d641bfb9187942e9907fe05411aaac98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:57.830897 17099 raft_consensus.cc:993] T 8affc906415f4b3aa5ed3e9a971f9aec P 631194f763324d39a224b5728199751f: : Instructing follower 5b0ce9a34e224f65aee2d205dd874ba2 to start an election
I20260709 12:18:57.831419 17099 raft_consensus.cc:1081] T 8affc906415f4b3aa5ed3e9a971f9aec P 631194f763324d39a224b5728199751f [term 1 LEADER]: Signalling peer 5b0ce9a34e224f65aee2d205dd874ba2 to start an election
I20260709 12:18:57.835296 16819 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8affc906415f4b3aa5ed3e9a971f9aec"
dest_uuid: "5b0ce9a34e224f65aee2d205dd874ba2"
 from {username='slave'} at 127.0.0.1:48170
I20260709 12:18:57.836023 16819 raft_consensus.cc:493] T 8affc906415f4b3aa5ed3e9a971f9aec P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:57.836459 16819 raft_consensus.cc:3060] T 8affc906415f4b3aa5ed3e9a971f9aec P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:57.851197 17100 consensus_queue.cc:1048] T 86e15b6028704208a711b8069cba2929 P d641bfb9187942e9907fe05411aaac98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:18:57.854513 16819 raft_consensus.cc:515] T 8affc906415f4b3aa5ed3e9a971f9aec P 5b0ce9a34e224f65aee2d205dd874ba2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:57.855767 16821 raft_consensus.cc:1240] T 8affc906415f4b3aa5ed3e9a971f9aec P 5b0ce9a34e224f65aee2d205dd874ba2 [term 2 FOLLOWER]: Rejecting Update request from peer 631194f763324d39a224b5728199751f for earlier term 1. Current term is 2. Ops: []
I20260709 12:18:57.857596 16819 leader_election.cc:290] T 8affc906415f4b3aa5ed3e9a971f9aec P 5b0ce9a34e224f65aee2d205dd874ba2 [CANDIDATE]: Term 2 election: Requested vote from peers d641bfb9187942e9907fe05411aaac98 (127.3.212.130:44221), 631194f763324d39a224b5728199751f (127.3.212.131:32987)
I20260709 12:18:57.857990 16894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8affc906415f4b3aa5ed3e9a971f9aec" candidate_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d641bfb9187942e9907fe05411aaac98"
I20260709 12:18:57.858770 16894 raft_consensus.cc:3060] T 8affc906415f4b3aa5ed3e9a971f9aec P d641bfb9187942e9907fe05411aaac98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:57.863260 16968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8affc906415f4b3aa5ed3e9a971f9aec" candidate_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "631194f763324d39a224b5728199751f"
I20260709 12:18:57.864081 16968 raft_consensus.cc:3055] T 8affc906415f4b3aa5ed3e9a971f9aec P 631194f763324d39a224b5728199751f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:57.864431 16968 raft_consensus.cc:740] T 8affc906415f4b3aa5ed3e9a971f9aec P 631194f763324d39a224b5728199751f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 631194f763324d39a224b5728199751f, State: Running, Role: LEADER
I20260709 12:18:57.865234 16968 consensus_queue.cc:260] T 8affc906415f4b3aa5ed3e9a971f9aec P 631194f763324d39a224b5728199751f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:57.866046 17131 consensus_queue.cc:1059] T 8affc906415f4b3aa5ed3e9a971f9aec P 631194f763324d39a224b5728199751f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:57.871524 16894 raft_consensus.cc:2468] T 8affc906415f4b3aa5ed3e9a971f9aec P d641bfb9187942e9907fe05411aaac98 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b0ce9a34e224f65aee2d205dd874ba2 in term 2.
I20260709 12:18:57.873255 16784 leader_election.cc:304] T 8affc906415f4b3aa5ed3e9a971f9aec P 5b0ce9a34e224f65aee2d205dd874ba2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b0ce9a34e224f65aee2d205dd874ba2, d641bfb9187942e9907fe05411aaac98; no voters: 
I20260709 12:18:57.874212 17167 raft_consensus.cc:2804] T 8affc906415f4b3aa5ed3e9a971f9aec P 5b0ce9a34e224f65aee2d205dd874ba2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:57.874716 17167 raft_consensus.cc:697] T 8affc906415f4b3aa5ed3e9a971f9aec P 5b0ce9a34e224f65aee2d205dd874ba2 [term 2 LEADER]: Becoming Leader. State: Replica: 5b0ce9a34e224f65aee2d205dd874ba2, State: Running, Role: LEADER
I20260709 12:18:57.874758 16968 raft_consensus.cc:3060] T 8affc906415f4b3aa5ed3e9a971f9aec P 631194f763324d39a224b5728199751f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:57.875609 17167 consensus_queue.cc:237] T 8affc906415f4b3aa5ed3e9a971f9aec P 5b0ce9a34e224f65aee2d205dd874ba2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:57.883060 16968 raft_consensus.cc:2468] T 8affc906415f4b3aa5ed3e9a971f9aec P 631194f763324d39a224b5728199751f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b0ce9a34e224f65aee2d205dd874ba2 in term 2.
I20260709 12:18:57.884837 16717 catalog_manager.cc:5697] T 8affc906415f4b3aa5ed3e9a971f9aec P 5b0ce9a34e224f65aee2d205dd874ba2 reported cstate change: term changed from 1 to 2, leader changed from 631194f763324d39a224b5728199751f (127.3.212.131) to 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129). New cstate: current_term: 2 leader_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:57.897403 17132 consensus_queue.cc:1048] T 04bbf32b02ed450f99f360da0e55cff7 P 631194f763324d39a224b5728199751f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:57.908490 17099 consensus_queue.cc:1048] T 04bbf32b02ed450f99f360da0e55cff7 P 631194f763324d39a224b5728199751f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:18:57.916211 17099 raft_consensus.cc:993] T 04bbf32b02ed450f99f360da0e55cff7 P 631194f763324d39a224b5728199751f: : Instructing follower d641bfb9187942e9907fe05411aaac98 to start an election
I20260709 12:18:57.916677 17132 raft_consensus.cc:1081] T 04bbf32b02ed450f99f360da0e55cff7 P 631194f763324d39a224b5728199751f [term 1 LEADER]: Signalling peer d641bfb9187942e9907fe05411aaac98 to start an election
I20260709 12:18:57.918494 16895 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "04bbf32b02ed450f99f360da0e55cff7"
dest_uuid: "d641bfb9187942e9907fe05411aaac98"
 from {username='slave'} at 127.0.0.1:47344
I20260709 12:18:57.918968 16895 raft_consensus.cc:493] T 04bbf32b02ed450f99f360da0e55cff7 P d641bfb9187942e9907fe05411aaac98 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:57.919245 16895 raft_consensus.cc:3060] T 04bbf32b02ed450f99f360da0e55cff7 P d641bfb9187942e9907fe05411aaac98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:57.924692 16895 raft_consensus.cc:515] T 04bbf32b02ed450f99f360da0e55cff7 P d641bfb9187942e9907fe05411aaac98 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:57.926496 16895 leader_election.cc:290] T 04bbf32b02ed450f99f360da0e55cff7 P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 2 election: Requested vote from peers 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979), 631194f763324d39a224b5728199751f (127.3.212.131:32987)
I20260709 12:18:57.927505 16818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04bbf32b02ed450f99f360da0e55cff7" candidate_uuid: "d641bfb9187942e9907fe05411aaac98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5b0ce9a34e224f65aee2d205dd874ba2"
I20260709 12:18:57.927601 16968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04bbf32b02ed450f99f360da0e55cff7" candidate_uuid: "d641bfb9187942e9907fe05411aaac98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "631194f763324d39a224b5728199751f"
I20260709 12:18:57.928292 16818 raft_consensus.cc:3060] T 04bbf32b02ed450f99f360da0e55cff7 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:57.928493 16968 raft_consensus.cc:3055] T 04bbf32b02ed450f99f360da0e55cff7 P 631194f763324d39a224b5728199751f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:18:57.928848 16968 raft_consensus.cc:740] T 04bbf32b02ed450f99f360da0e55cff7 P 631194f763324d39a224b5728199751f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 631194f763324d39a224b5728199751f, State: Running, Role: LEADER
I20260709 12:18:57.929610 16968 consensus_queue.cc:260] T 04bbf32b02ed450f99f360da0e55cff7 P 631194f763324d39a224b5728199751f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:57.930912 16968 raft_consensus.cc:3060] T 04bbf32b02ed450f99f360da0e55cff7 P 631194f763324d39a224b5728199751f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:18:57.934309 16818 raft_consensus.cc:2468] T 04bbf32b02ed450f99f360da0e55cff7 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d641bfb9187942e9907fe05411aaac98 in term 2.
I20260709 12:18:57.935523 16859 leader_election.cc:304] T 04bbf32b02ed450f99f360da0e55cff7 P d641bfb9187942e9907fe05411aaac98 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b0ce9a34e224f65aee2d205dd874ba2, d641bfb9187942e9907fe05411aaac98; no voters: 
I20260709 12:18:57.936266 17102 raft_consensus.cc:2804] T 04bbf32b02ed450f99f360da0e55cff7 P d641bfb9187942e9907fe05411aaac98 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:18:57.936759 17102 raft_consensus.cc:697] T 04bbf32b02ed450f99f360da0e55cff7 P d641bfb9187942e9907fe05411aaac98 [term 2 LEADER]: Becoming Leader. State: Replica: d641bfb9187942e9907fe05411aaac98, State: Running, Role: LEADER
I20260709 12:18:57.936970 16968 raft_consensus.cc:2468] T 04bbf32b02ed450f99f360da0e55cff7 P 631194f763324d39a224b5728199751f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d641bfb9187942e9907fe05411aaac98 in term 2.
I20260709 12:18:57.937680 17102 consensus_queue.cc:237] T 04bbf32b02ed450f99f360da0e55cff7 P d641bfb9187942e9907fe05411aaac98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:18:57.944545 16716 catalog_manager.cc:5697] T 04bbf32b02ed450f99f360da0e55cff7 P d641bfb9187942e9907fe05411aaac98 reported cstate change: term changed from 1 to 2, leader changed from 631194f763324d39a224b5728199751f (127.3.212.131) to d641bfb9187942e9907fe05411aaac98 (127.3.212.130). New cstate: current_term: 2 leader_uuid: "d641bfb9187942e9907fe05411aaac98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:58.130810 16895 raft_consensus.cc:1275] T 5fabedcf8a28457fab071f75fe106037 P d641bfb9187942e9907fe05411aaac98 [term 2 FOLLOWER]: Refusing update from remote peer 5b0ce9a34e224f65aee2d205dd874ba2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:58.132328 17167 consensus_queue.cc:1048] T 5fabedcf8a28457fab071f75fe106037 P 5b0ce9a34e224f65aee2d205dd874ba2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:18:58.146286 16968 raft_consensus.cc:1275] T 5fabedcf8a28457fab071f75fe106037 P 631194f763324d39a224b5728199751f [term 2 FOLLOWER]: Refusing update from remote peer 5b0ce9a34e224f65aee2d205dd874ba2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:58.148185 17167 consensus_queue.cc:1048] T 5fabedcf8a28457fab071f75fe106037 P 5b0ce9a34e224f65aee2d205dd874ba2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:58.171865 16895 raft_consensus.cc:1275] T 0f2665342de64990947409a4e83aa0a2 P d641bfb9187942e9907fe05411aaac98 [term 2 FOLLOWER]: Refusing update from remote peer 5b0ce9a34e224f65aee2d205dd874ba2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:58.173089 17167 consensus_queue.cc:1048] T 0f2665342de64990947409a4e83aa0a2 P 5b0ce9a34e224f65aee2d205dd874ba2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:58.182391 16968 raft_consensus.cc:1275] T 0f2665342de64990947409a4e83aa0a2 P 631194f763324d39a224b5728199751f [term 2 FOLLOWER]: Refusing update from remote peer 5b0ce9a34e224f65aee2d205dd874ba2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:58.184055 17167 consensus_queue.cc:1048] T 0f2665342de64990947409a4e83aa0a2 P 5b0ce9a34e224f65aee2d205dd874ba2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:58.190002 16970 raft_consensus.cc:1275] T 73a5894bf58143d3a71dabf8231d33ba P 631194f763324d39a224b5728199751f [term 2 FOLLOWER]: Refusing update from remote peer 5b0ce9a34e224f65aee2d205dd874ba2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:58.192736 17185 consensus_queue.cc:1048] T 73a5894bf58143d3a71dabf8231d33ba P 5b0ce9a34e224f65aee2d205dd874ba2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:58.193095 16895 raft_consensus.cc:1275] T 73a5894bf58143d3a71dabf8231d33ba P d641bfb9187942e9907fe05411aaac98 [term 2 FOLLOWER]: Refusing update from remote peer 5b0ce9a34e224f65aee2d205dd874ba2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:58.198378 17185 consensus_queue.cc:1048] T 73a5894bf58143d3a71dabf8231d33ba P 5b0ce9a34e224f65aee2d205dd874ba2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:58.217550 16968 raft_consensus.cc:1275] T 3c06f7f07974452599bbaebd7f818ca9 P 631194f763324d39a224b5728199751f [term 2 FOLLOWER]: Refusing update from remote peer d641bfb9187942e9907fe05411aaac98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:58.219058 17102 consensus_queue.cc:1048] T 3c06f7f07974452599bbaebd7f818ca9 P d641bfb9187942e9907fe05411aaac98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:58.226827 16818 raft_consensus.cc:1275] T 3c06f7f07974452599bbaebd7f818ca9 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 2 FOLLOWER]: Refusing update from remote peer d641bfb9187942e9907fe05411aaac98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:58.228101 17119 consensus_queue.cc:1048] T 3c06f7f07974452599bbaebd7f818ca9 P d641bfb9187942e9907fe05411aaac98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:58.284480 16894 raft_consensus.cc:1275] T 8affc906415f4b3aa5ed3e9a971f9aec P d641bfb9187942e9907fe05411aaac98 [term 2 FOLLOWER]: Refusing update from remote peer 5b0ce9a34e224f65aee2d205dd874ba2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:58.285898 17167 consensus_queue.cc:1048] T 8affc906415f4b3aa5ed3e9a971f9aec P 5b0ce9a34e224f65aee2d205dd874ba2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:58.295701 16968 raft_consensus.cc:1275] T 8affc906415f4b3aa5ed3e9a971f9aec P 631194f763324d39a224b5728199751f [term 2 FOLLOWER]: Refusing update from remote peer 5b0ce9a34e224f65aee2d205dd874ba2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:58.297219 17167 consensus_queue.cc:1048] T 8affc906415f4b3aa5ed3e9a971f9aec P 5b0ce9a34e224f65aee2d205dd874ba2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:58.437852 16968 raft_consensus.cc:1275] T 04bbf32b02ed450f99f360da0e55cff7 P 631194f763324d39a224b5728199751f [term 2 FOLLOWER]: Refusing update from remote peer d641bfb9187942e9907fe05411aaac98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:58.439689 17162 consensus_queue.cc:1048] T 04bbf32b02ed450f99f360da0e55cff7 P d641bfb9187942e9907fe05411aaac98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:58.447842 16818 raft_consensus.cc:1275] T 04bbf32b02ed450f99f360da0e55cff7 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 2 FOLLOWER]: Refusing update from remote peer d641bfb9187942e9907fe05411aaac98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:18:58.449851 17100 consensus_queue.cc:1048] T 04bbf32b02ed450f99f360da0e55cff7 P d641bfb9187942e9907fe05411aaac98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:00.621304 16718 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34548:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:19:00.643643 16718 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34548:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:19:00.666011  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:00.846874 17232 tablet.cc:1724] T 9caa951d90c54e5086bc8d886ba6c450 P 631194f763324d39a224b5728199751f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:00.918848 17235 tablet.cc:1724] T 8affc906415f4b3aa5ed3e9a971f9aec P d641bfb9187942e9907fe05411aaac98: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:19:00.940698 16784 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.130:44221, user_credentials={real_user=slave}} blocked reactor thread for 69800.3us
I20260709 12:19:00.871766 17233 tablet.cc:1724] T 9caa951d90c54e5086bc8d886ba6c450 P d641bfb9187942e9907fe05411aaac98: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:19:00.960747 16859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.129:45979, user_credentials={real_user=slave}} blocked reactor thread for 46137.1us
I20260709 12:19:00.966131 16821 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0408a37e9dc84eb8b74b3d8fc57ffef7"
dest_uuid: "5b0ce9a34e224f65aee2d205dd874ba2"
mode: GRACEFUL
new_leader_uuid: "631194f763324d39a224b5728199751f"
 from {username='slave'} at 127.0.0.1:40498
I20260709 12:19:00.966827 16821 raft_consensus.cc:606] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 2 LEADER]: Received request to transfer leadership to TS 631194f763324d39a224b5728199751f
I20260709 12:19:00.922420 17230 tablet.cc:1724] T 8affc906415f4b3aa5ed3e9a971f9aec P 5b0ce9a34e224f65aee2d205dd874ba2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:00.988447 17243 tablet.cc:1724] T 73a5894bf58143d3a71dabf8231d33ba P 5b0ce9a34e224f65aee2d205dd874ba2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:19:00.992964 17234 log.cc:927] Time spent T 877e171775ed47c8af9b177b9e7a13fa P d641bfb9187942e9907fe05411aaac98: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:19:00.968255 17245 tablet.cc:1724] T 9caa951d90c54e5086bc8d886ba6c450 P 5b0ce9a34e224f65aee2d205dd874ba2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:01.016340 17247 tablet.cc:1724] T 5fabedcf8a28457fab071f75fe106037 P 5b0ce9a34e224f65aee2d205dd874ba2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:19:01.012600 16862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.3.212.131:32987, user_credentials={real_user=slave}} blocked reactor thread for 54065.8us
W20260709 12:19:01.035086 17239 log.cc:927] Time spent T 8affc906415f4b3aa5ed3e9a971f9aec P 631194f763324d39a224b5728199751f: Append to log took a long time: real 0.120s	user 0.002s	sys 0.000s
I20260709 12:19:01.033038 17250 tablet.cc:1724] T 86e15b6028704208a711b8069cba2929 P d641bfb9187942e9907fe05411aaac98: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:01.039284 17248 tablet.cc:1724] T 73a5894bf58143d3a71dabf8231d33ba P d641bfb9187942e9907fe05411aaac98: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:01.041836 17232 tablet.cc:1724] T 5fabedcf8a28457fab071f75fe106037 P 631194f763324d39a224b5728199751f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:01.091372 17251 tablet.cc:1724] T 73a5894bf58143d3a71dabf8231d33ba P 631194f763324d39a224b5728199751f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:01.106076 17232 tablet.cc:1724] T 3c06f7f07974452599bbaebd7f818ca9 P 631194f763324d39a224b5728199751f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:01.070719 17230 tablet.cc:1724] T 0f2665342de64990947409a4e83aa0a2 P 5b0ce9a34e224f65aee2d205dd874ba2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:01.118680 17167 raft_consensus.cc:993] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 5b0ce9a34e224f65aee2d205dd874ba2: : Instructing follower 631194f763324d39a224b5728199751f to start an election
I20260709 12:19:01.119575 17236 raft_consensus.cc:1081] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 2 LEADER]: Signalling peer 631194f763324d39a224b5728199751f to start an election
I20260709 12:19:01.112284 17235 tablet.cc:1724] T 5fabedcf8a28457fab071f75fe106037 P d641bfb9187942e9907fe05411aaac98: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:01.124509 17255 tablet.cc:1724] T 0f2665342de64990947409a4e83aa0a2 P 631194f763324d39a224b5728199751f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:01.124229 17233 tablet.cc:1724] T 3c06f7f07974452599bbaebd7f818ca9 P d641bfb9187942e9907fe05411aaac98: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:01.125705 17245 tablet.cc:1724] T 3c06f7f07974452599bbaebd7f818ca9 P 5b0ce9a34e224f65aee2d205dd874ba2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:01.128631 17243 tablet.cc:1724] T 877e171775ed47c8af9b177b9e7a13fa P 5b0ce9a34e224f65aee2d205dd874ba2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:01.131729 17254 tablet.cc:1724] T 8affc906415f4b3aa5ed3e9a971f9aec P 631194f763324d39a224b5728199751f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:01.143285 16970 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0408a37e9dc84eb8b74b3d8fc57ffef7"
dest_uuid: "631194f763324d39a224b5728199751f"
 from {username='slave'} at 127.0.0.1:38874
I20260709 12:19:01.144076 16970 raft_consensus.cc:493] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 631194f763324d39a224b5728199751f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:01.144472 16970 raft_consensus.cc:3060] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 631194f763324d39a224b5728199751f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:01.176712 16970 raft_consensus.cc:515] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 631194f763324d39a224b5728199751f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:19:01.179224 17250 tablet.cc:1724] T 877e171775ed47c8af9b177b9e7a13fa P d641bfb9187942e9907fe05411aaac98: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:01.184434 16821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0408a37e9dc84eb8b74b3d8fc57ffef7" candidate_uuid: "631194f763324d39a224b5728199751f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5b0ce9a34e224f65aee2d205dd874ba2"
I20260709 12:19:01.189903 16821 raft_consensus.cc:3055] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:01.190256 16821 raft_consensus.cc:740] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5b0ce9a34e224f65aee2d205dd874ba2, State: Running, Role: LEADER
I20260709 12:19:01.191078 16821 consensus_queue.cc:260] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 5b0ce9a34e224f65aee2d205dd874ba2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:19:01.159729 17247 tablet.cc:1724] T 04bbf32b02ed450f99f360da0e55cff7 P 5b0ce9a34e224f65aee2d205dd874ba2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:01.192507 17251 tablet.cc:1724] T 04bbf32b02ed450f99f360da0e55cff7 P 631194f763324d39a224b5728199751f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:01.192169 16821 raft_consensus.cc:3060] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:01.195679 17232 tablet.cc:1724] T 86e15b6028704208a711b8069cba2929 P 631194f763324d39a224b5728199751f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:01.191856 17248 tablet.cc:1724] T 04bbf32b02ed450f99f360da0e55cff7 P d641bfb9187942e9907fe05411aaac98: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:01.203303 16821 raft_consensus.cc:2468] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631194f763324d39a224b5728199751f in term 3.
I20260709 12:19:01.205116 16895 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b08a6f7d06940f395425d7fef9f0977"
dest_uuid: "d641bfb9187942e9907fe05411aaac98"
mode: GRACEFUL
new_leader_uuid: "631194f763324d39a224b5728199751f"
 from {username='slave'} at 127.0.0.1:56470
I20260709 12:19:01.205222 16933 leader_election.cc:304] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 631194f763324d39a224b5728199751f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b0ce9a34e224f65aee2d205dd874ba2, 631194f763324d39a224b5728199751f; no voters: 
I20260709 12:19:01.205727 16895 raft_consensus.cc:606] T 3b08a6f7d06940f395425d7fef9f0977 P d641bfb9187942e9907fe05411aaac98 [term 2 LEADER]: Received request to transfer leadership to TS 631194f763324d39a224b5728199751f
I20260709 12:19:01.186410 17235 tablet.cc:1724] T 0f2665342de64990947409a4e83aa0a2 P d641bfb9187942e9907fe05411aaac98: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:01.187134 16892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0408a37e9dc84eb8b74b3d8fc57ffef7" candidate_uuid: "631194f763324d39a224b5728199751f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d641bfb9187942e9907fe05411aaac98"
I20260709 12:19:01.206408 16892 raft_consensus.cc:3060] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P d641bfb9187942e9907fe05411aaac98 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:01.206921 17213 raft_consensus.cc:2804] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 631194f763324d39a224b5728199751f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:01.207486 17213 raft_consensus.cc:697] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 631194f763324d39a224b5728199751f [term 3 LEADER]: Becoming Leader. State: Replica: 631194f763324d39a224b5728199751f, State: Running, Role: LEADER
I20260709 12:19:01.208374 17213 consensus_queue.cc:237] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 631194f763324d39a224b5728199751f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:19:01.209053  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:19:01.209901  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:01.187625 16970 leader_election.cc:290] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 631194f763324d39a224b5728199751f [CANDIDATE]: Term 3 election: Requested vote from peers 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979), d641bfb9187942e9907fe05411aaac98 (127.3.212.130:44221)
I20260709 12:19:01.217407 17255 tablet.cc:1724] T 877e171775ed47c8af9b177b9e7a13fa P 631194f763324d39a224b5728199751f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:01.226473 17245 tablet.cc:1724] T 86e15b6028704208a711b8069cba2929 P 5b0ce9a34e224f65aee2d205dd874ba2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:19:01.245209 16892 raft_consensus.cc:2468] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P d641bfb9187942e9907fe05411aaac98 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631194f763324d39a224b5728199751f in term 3.
I20260709 12:19:01.249022 17188 raft_consensus.cc:993] T 3b08a6f7d06940f395425d7fef9f0977 P d641bfb9187942e9907fe05411aaac98: : Instructing follower 631194f763324d39a224b5728199751f to start an election
I20260709 12:19:01.249601 17188 raft_consensus.cc:1081] T 3b08a6f7d06940f395425d7fef9f0977 P d641bfb9187942e9907fe05411aaac98 [term 2 LEADER]: Signalling peer 631194f763324d39a224b5728199751f to start an election
I20260709 12:19:01.253131 16964 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b08a6f7d06940f395425d7fef9f0977"
dest_uuid: "631194f763324d39a224b5728199751f"
 from {username='slave'} at 127.0.0.1:38882
I20260709 12:19:01.254104 16964 raft_consensus.cc:493] T 3b08a6f7d06940f395425d7fef9f0977 P 631194f763324d39a224b5728199751f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:01.254493 16964 raft_consensus.cc:3060] T 3b08a6f7d06940f395425d7fef9f0977 P 631194f763324d39a224b5728199751f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:01.250658 16718 catalog_manager.cc:5697] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 631194f763324d39a224b5728199751f reported cstate change: term changed from 2 to 3, leader changed from 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129) to 631194f763324d39a224b5728199751f (127.3.212.131). New cstate: current_term: 3 leader_uuid: "631194f763324d39a224b5728199751f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:01.263620 16964 raft_consensus.cc:515] T 3b08a6f7d06940f395425d7fef9f0977 P 631194f763324d39a224b5728199751f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:19:01.266604 16821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b08a6f7d06940f395425d7fef9f0977" candidate_uuid: "631194f763324d39a224b5728199751f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5b0ce9a34e224f65aee2d205dd874ba2"
I20260709 12:19:01.267212 16821 raft_consensus.cc:3060] T 3b08a6f7d06940f395425d7fef9f0977 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:01.268088 16892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b08a6f7d06940f395425d7fef9f0977" candidate_uuid: "631194f763324d39a224b5728199751f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d641bfb9187942e9907fe05411aaac98"
I20260709 12:19:01.268778 16892 raft_consensus.cc:3055] T 3b08a6f7d06940f395425d7fef9f0977 P d641bfb9187942e9907fe05411aaac98 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:01.269114 16892 raft_consensus.cc:740] T 3b08a6f7d06940f395425d7fef9f0977 P d641bfb9187942e9907fe05411aaac98 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d641bfb9187942e9907fe05411aaac98, State: Running, Role: LEADER
I20260709 12:19:01.269996 16892 consensus_queue.cc:260] T 3b08a6f7d06940f395425d7fef9f0977 P d641bfb9187942e9907fe05411aaac98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:19:01.271211 16892 raft_consensus.cc:3060] T 3b08a6f7d06940f395425d7fef9f0977 P d641bfb9187942e9907fe05411aaac98 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:01.273976 16964 leader_election.cc:290] T 3b08a6f7d06940f395425d7fef9f0977 P 631194f763324d39a224b5728199751f [CANDIDATE]: Term 3 election: Requested vote from peers 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979), d641bfb9187942e9907fe05411aaac98 (127.3.212.130:44221)
I20260709 12:19:01.274925 16821 raft_consensus.cc:2468] T 3b08a6f7d06940f395425d7fef9f0977 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631194f763324d39a224b5728199751f in term 3.
I20260709 12:19:01.278018 16933 leader_election.cc:304] T 3b08a6f7d06940f395425d7fef9f0977 P 631194f763324d39a224b5728199751f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b0ce9a34e224f65aee2d205dd874ba2, 631194f763324d39a224b5728199751f; no voters: 
I20260709 12:19:01.278954 17213 raft_consensus.cc:2804] T 3b08a6f7d06940f395425d7fef9f0977 P 631194f763324d39a224b5728199751f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:01.279462 17213 raft_consensus.cc:697] T 3b08a6f7d06940f395425d7fef9f0977 P 631194f763324d39a224b5728199751f [term 3 LEADER]: Becoming Leader. State: Replica: 631194f763324d39a224b5728199751f, State: Running, Role: LEADER
I20260709 12:19:01.280411 17213 consensus_queue.cc:237] T 3b08a6f7d06940f395425d7fef9f0977 P 631194f763324d39a224b5728199751f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } }
I20260709 12:19:01.284231 16892 raft_consensus.cc:2468] T 3b08a6f7d06940f395425d7fef9f0977 P d641bfb9187942e9907fe05411aaac98 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631194f763324d39a224b5728199751f in term 3.
I20260709 12:19:01.284741 16716 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 324613a4e3ff41f29c52539c92ead285: soft_deleted_table [id=bcf01e86d58f4f1190171d6eb08321d6] alter complete (version 1)
I20260709 12:19:01.301362 16717 catalog_manager.cc:5697] T 3b08a6f7d06940f395425d7fef9f0977 P 631194f763324d39a224b5728199751f reported cstate change: term changed from 2 to 3, leader changed from d641bfb9187942e9907fe05411aaac98 (127.3.212.130) to 631194f763324d39a224b5728199751f (127.3.212.131). New cstate: current_term: 3 leader_uuid: "631194f763324d39a224b5728199751f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631194f763324d39a224b5728199751f" member_type: VOTER last_known_addr { host: "127.3.212.131" port: 32987 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:01.724437 16892 raft_consensus.cc:1275] T 3b08a6f7d06940f395425d7fef9f0977 P d641bfb9187942e9907fe05411aaac98 [term 3 FOLLOWER]: Refusing update from remote peer 631194f763324d39a224b5728199751f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:01.726092 17213 consensus_queue.cc:1048] T 3b08a6f7d06940f395425d7fef9f0977 P 631194f763324d39a224b5728199751f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:01.737684 16818 raft_consensus.cc:1275] T 3b08a6f7d06940f395425d7fef9f0977 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 3 FOLLOWER]: Refusing update from remote peer 631194f763324d39a224b5728199751f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:01.739387 17132 consensus_queue.cc:1048] T 3b08a6f7d06940f395425d7fef9f0977 P 631194f763324d39a224b5728199751f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:01.830515 16895 raft_consensus.cc:1275] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P d641bfb9187942e9907fe05411aaac98 [term 3 FOLLOWER]: Refusing update from remote peer 631194f763324d39a224b5728199751f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:01.831878 17132 consensus_queue.cc:1048] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 631194f763324d39a224b5728199751f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d641bfb9187942e9907fe05411aaac98" member_type: VOTER last_known_addr { host: "127.3.212.130" port: 44221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:01.835702 16818 raft_consensus.cc:1275] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 3 FOLLOWER]: Refusing update from remote peer 631194f763324d39a224b5728199751f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:01.837258 17132 consensus_queue.cc:1048] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 631194f763324d39a224b5728199751f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b0ce9a34e224f65aee2d205dd874ba2" member_type: VOTER last_known_addr { host: "127.3.212.129" port: 45979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:02.210916  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:02.218554  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:02.219313  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:03.357798  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:03.366304  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:03.366961  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:19:03.751554 16787 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.004s	sys 0.008s
W20260709 12:19:03.751929 16787 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.004s	sys 0.008s
W20260709 12:19:04.127563 16842 debug-util.cc:398] Leaking SignalData structure 0x7b08001dd000 after lost signal to thread 3925
W20260709 12:19:04.128899 16842 debug-util.cc:398] Leaking SignalData structure 0x7b08002cde40 after lost signal to thread 16753
W20260709 12:19:04.130254 16842 debug-util.cc:398] Leaking SignalData structure 0x7b080029b300 after lost signal to thread 16845
W20260709 12:19:04.131455 16842 debug-util.cc:398] Leaking SignalData structure 0x7b08001243c0 after lost signal to thread 16920
W20260709 12:19:04.132575 16842 debug-util.cc:398] Leaking SignalData structure 0x7b08002eda60 after lost signal to thread 16994
I20260709 12:19:04.368125  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:04.373842  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:04.374320  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:05.375370  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:05.383378  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:05.383965  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:06.385262  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:06.393842  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:06.394443  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:07.395794  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:07.401129  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:07.401614  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:08.402581  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:08.407702  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:08.408140  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:09.409113  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:09.414422  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:09.414878  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:10.415978  3922 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:10.421780  3922 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:10.422320  3922 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:11.488101  3922 tablet_server.cc:179] TabletServer@127.3.212.129:0 shutting down...
I20260709 12:19:11.526569  3922 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:19:11.527534  3922 tablet_replica.cc:333] T 8affc906415f4b3aa5ed3e9a971f9aec P 5b0ce9a34e224f65aee2d205dd874ba2: stopping tablet replica
I20260709 12:19:11.528700  3922 raft_consensus.cc:2243] T 8affc906415f4b3aa5ed3e9a971f9aec P 5b0ce9a34e224f65aee2d205dd874ba2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:11.529799  3922 raft_consensus.cc:2272] T 8affc906415f4b3aa5ed3e9a971f9aec P 5b0ce9a34e224f65aee2d205dd874ba2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.532474  3922 tablet_replica.cc:333] T 73a5894bf58143d3a71dabf8231d33ba P 5b0ce9a34e224f65aee2d205dd874ba2: stopping tablet replica
I20260709 12:19:11.533136  3922 raft_consensus.cc:2243] T 73a5894bf58143d3a71dabf8231d33ba P 5b0ce9a34e224f65aee2d205dd874ba2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:11.534144  3922 raft_consensus.cc:2272] T 73a5894bf58143d3a71dabf8231d33ba P 5b0ce9a34e224f65aee2d205dd874ba2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.536722  3922 tablet_replica.cc:333] T 0f2665342de64990947409a4e83aa0a2 P 5b0ce9a34e224f65aee2d205dd874ba2: stopping tablet replica
I20260709 12:19:11.537428  3922 raft_consensus.cc:2243] T 0f2665342de64990947409a4e83aa0a2 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:11.538650  3922 raft_consensus.cc:2272] T 0f2665342de64990947409a4e83aa0a2 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.541887  3922 tablet_replica.cc:333] T 18210c7ef7cc4e2f8d96c1a686d66464 P 5b0ce9a34e224f65aee2d205dd874ba2: stopping tablet replica
I20260709 12:19:11.542593  3922 raft_consensus.cc:2243] T 18210c7ef7cc4e2f8d96c1a686d66464 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.543193  3922 raft_consensus.cc:2272] T 18210c7ef7cc4e2f8d96c1a686d66464 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:11.546406 16859 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 9 similar messages]
I20260709 12:19:11.546589  3922 tablet_replica.cc:333] T 3c06f7f07974452599bbaebd7f818ca9 P 5b0ce9a34e224f65aee2d205dd874ba2: stopping tablet replica
I20260709 12:19:11.547798  3922 raft_consensus.cc:2243] T 3c06f7f07974452599bbaebd7f818ca9 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.548813  3922 raft_consensus.cc:2272] T 3c06f7f07974452599bbaebd7f818ca9 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:11.550448 16859 consensus_peers.cc:597] T 877e171775ed47c8af9b177b9e7a13fa P d641bfb9187942e9907fe05411aaac98 -> Peer 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979): Couldn't send request to peer 5b0ce9a34e224f65aee2d205dd874ba2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:11.553320  3922 tablet_replica.cc:333] T 86e15b6028704208a711b8069cba2929 P 5b0ce9a34e224f65aee2d205dd874ba2: stopping tablet replica
W20260709 12:19:11.553884 16933 consensus_peers.cc:597] T 9caa951d90c54e5086bc8d886ba6c450 P 631194f763324d39a224b5728199751f -> Peer 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979): Couldn't send request to peer 5b0ce9a34e224f65aee2d205dd874ba2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:11.554510  3922 raft_consensus.cc:2243] T 86e15b6028704208a711b8069cba2929 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.555135  3922 raft_consensus.cc:2272] T 86e15b6028704208a711b8069cba2929 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.557835  3922 tablet_replica.cc:333] T 5fabedcf8a28457fab071f75fe106037 P 5b0ce9a34e224f65aee2d205dd874ba2: stopping tablet replica
I20260709 12:19:11.558480  3922 raft_consensus.cc:2243] T 5fabedcf8a28457fab071f75fe106037 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:11.559592  3922 raft_consensus.cc:2272] T 5fabedcf8a28457fab071f75fe106037 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:11.563119 16933 consensus_peers.cc:597] T 3b08a6f7d06940f395425d7fef9f0977 P 631194f763324d39a224b5728199751f -> Peer 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979): Couldn't send request to peer 5b0ce9a34e224f65aee2d205dd874ba2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:11.563185  3922 tablet_replica.cc:333] T 9caa951d90c54e5086bc8d886ba6c450 P 5b0ce9a34e224f65aee2d205dd874ba2: stopping tablet replica
I20260709 12:19:11.564208  3922 raft_consensus.cc:2243] T 9caa951d90c54e5086bc8d886ba6c450 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.564805  3922 raft_consensus.cc:2272] T 9caa951d90c54e5086bc8d886ba6c450 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.567528  3922 tablet_replica.cc:333] T 877e171775ed47c8af9b177b9e7a13fa P 5b0ce9a34e224f65aee2d205dd874ba2: stopping tablet replica
I20260709 12:19:11.568216  3922 raft_consensus.cc:2243] T 877e171775ed47c8af9b177b9e7a13fa P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.568867  3922 raft_consensus.cc:2272] T 877e171775ed47c8af9b177b9e7a13fa P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:11.571080 16859 consensus_peers.cc:597] T 9e3e70fc532a4fb48fcd5d6696714964 P d641bfb9187942e9907fe05411aaac98 -> Peer 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979): Couldn't send request to peer 5b0ce9a34e224f65aee2d205dd874ba2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:11.571913  3922 tablet_replica.cc:333] T 3b08a6f7d06940f395425d7fef9f0977 P 5b0ce9a34e224f65aee2d205dd874ba2: stopping tablet replica
I20260709 12:19:11.572623  3922 raft_consensus.cc:2243] T 3b08a6f7d06940f395425d7fef9f0977 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.573261  3922 raft_consensus.cc:2272] T 3b08a6f7d06940f395425d7fef9f0977 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.576526  3922 tablet_replica.cc:333] T aababa64926d4ed2a9c906dbae553e1f P 5b0ce9a34e224f65aee2d205dd874ba2: stopping tablet replica
I20260709 12:19:11.577154  3922 raft_consensus.cc:2243] T aababa64926d4ed2a9c906dbae553e1f P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:11.578083  3922 raft_consensus.cc:2272] T aababa64926d4ed2a9c906dbae553e1f P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.580577  3922 tablet_replica.cc:333] T 847b3169447b428ba3af26a55cb0229a P 5b0ce9a34e224f65aee2d205dd874ba2: stopping tablet replica
I20260709 12:19:11.581250  3922 raft_consensus.cc:2243] T 847b3169447b428ba3af26a55cb0229a P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:11.582231  3922 raft_consensus.cc:2272] T 847b3169447b428ba3af26a55cb0229a P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.584749  3922 tablet_replica.cc:333] T 04bbf32b02ed450f99f360da0e55cff7 P 5b0ce9a34e224f65aee2d205dd874ba2: stopping tablet replica
I20260709 12:19:11.585325  3922 raft_consensus.cc:2243] T 04bbf32b02ed450f99f360da0e55cff7 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.585897  3922 raft_consensus.cc:2272] T 04bbf32b02ed450f99f360da0e55cff7 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.588434  3922 tablet_replica.cc:333] T f556bc405348447bacc2d6bce606766e P 5b0ce9a34e224f65aee2d205dd874ba2: stopping tablet replica
I20260709 12:19:11.589080  3922 raft_consensus.cc:2243] T f556bc405348447bacc2d6bce606766e P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:11.590123  3922 raft_consensus.cc:2272] T f556bc405348447bacc2d6bce606766e P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:11.592579 16859 consensus_peers.cc:597] T a6f975cf54944342ae97c0a5b2bd6d3a P d641bfb9187942e9907fe05411aaac98 -> Peer 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979): Couldn't send request to peer 5b0ce9a34e224f65aee2d205dd874ba2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:11.593258  3922 tablet_replica.cc:333] T a6f975cf54944342ae97c0a5b2bd6d3a P 5b0ce9a34e224f65aee2d205dd874ba2: stopping tablet replica
I20260709 12:19:11.594025  3922 raft_consensus.cc:2243] T a6f975cf54944342ae97c0a5b2bd6d3a P 5b0ce9a34e224f65aee2d205dd874ba2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.594731  3922 raft_consensus.cc:2272] T a6f975cf54944342ae97c0a5b2bd6d3a P 5b0ce9a34e224f65aee2d205dd874ba2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.597860  3922 tablet_replica.cc:333] T 9e3e70fc532a4fb48fcd5d6696714964 P 5b0ce9a34e224f65aee2d205dd874ba2: stopping tablet replica
I20260709 12:19:11.598454  3922 raft_consensus.cc:2243] T 9e3e70fc532a4fb48fcd5d6696714964 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.598938  3922 raft_consensus.cc:2272] T 9e3e70fc532a4fb48fcd5d6696714964 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.601346  3922 tablet_replica.cc:333] T d821b440bbe34471b1ffd70da3afe069 P 5b0ce9a34e224f65aee2d205dd874ba2: stopping tablet replica
I20260709 12:19:11.601933  3922 raft_consensus.cc:2243] T d821b440bbe34471b1ffd70da3afe069 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.602439  3922 raft_consensus.cc:2272] T d821b440bbe34471b1ffd70da3afe069 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.604848  3922 tablet_replica.cc:333] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 5b0ce9a34e224f65aee2d205dd874ba2: stopping tablet replica
I20260709 12:19:11.605351  3922 raft_consensus.cc:2243] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.605861  3922 raft_consensus.cc:2272] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 5b0ce9a34e224f65aee2d205dd874ba2 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:11.646275 16933 consensus_peers.cc:597] T 18210c7ef7cc4e2f8d96c1a686d66464 P 631194f763324d39a224b5728199751f -> Peer 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979): Couldn't send request to peer 5b0ce9a34e224f65aee2d205dd874ba2. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:45979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:11.661269  3922 tablet_server.cc:196] TabletServer@127.3.212.129:0 shutdown complete.
I20260709 12:19:11.709213  3922 tablet_server.cc:179] TabletServer@127.3.212.130:0 shutting down...
I20260709 12:19:11.740562  3922 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:19:11.741415  3922 tablet_replica.cc:333] T 8affc906415f4b3aa5ed3e9a971f9aec P d641bfb9187942e9907fe05411aaac98: stopping tablet replica
I20260709 12:19:11.742420  3922 raft_consensus.cc:2243] T 8affc906415f4b3aa5ed3e9a971f9aec P d641bfb9187942e9907fe05411aaac98 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.743181  3922 raft_consensus.cc:2272] T 8affc906415f4b3aa5ed3e9a971f9aec P d641bfb9187942e9907fe05411aaac98 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.746747  3922 tablet_replica.cc:333] T 0f2665342de64990947409a4e83aa0a2 P d641bfb9187942e9907fe05411aaac98: stopping tablet replica
I20260709 12:19:11.747623  3922 raft_consensus.cc:2243] T 0f2665342de64990947409a4e83aa0a2 P d641bfb9187942e9907fe05411aaac98 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.748169  3922 raft_consensus.cc:2272] T 0f2665342de64990947409a4e83aa0a2 P d641bfb9187942e9907fe05411aaac98 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.750681  3922 tablet_replica.cc:333] T 86e15b6028704208a711b8069cba2929 P d641bfb9187942e9907fe05411aaac98: stopping tablet replica
I20260709 12:19:11.751286  3922 raft_consensus.cc:2243] T 86e15b6028704208a711b8069cba2929 P d641bfb9187942e9907fe05411aaac98 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:11.752230  3922 raft_consensus.cc:2272] T 86e15b6028704208a711b8069cba2929 P d641bfb9187942e9907fe05411aaac98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.754503  3922 tablet_replica.cc:333] T 5fabedcf8a28457fab071f75fe106037 P d641bfb9187942e9907fe05411aaac98: stopping tablet replica
I20260709 12:19:11.755086  3922 raft_consensus.cc:2243] T 5fabedcf8a28457fab071f75fe106037 P d641bfb9187942e9907fe05411aaac98 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.755704  3922 raft_consensus.cc:2272] T 5fabedcf8a28457fab071f75fe106037 P d641bfb9187942e9907fe05411aaac98 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.758039  3922 tablet_replica.cc:333] T 9caa951d90c54e5086bc8d886ba6c450 P d641bfb9187942e9907fe05411aaac98: stopping tablet replica
I20260709 12:19:11.758628  3922 raft_consensus.cc:2243] T 9caa951d90c54e5086bc8d886ba6c450 P d641bfb9187942e9907fe05411aaac98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.759191  3922 raft_consensus.cc:2272] T 9caa951d90c54e5086bc8d886ba6c450 P d641bfb9187942e9907fe05411aaac98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.761560  3922 tablet_replica.cc:333] T 73a5894bf58143d3a71dabf8231d33ba P d641bfb9187942e9907fe05411aaac98: stopping tablet replica
I20260709 12:19:11.762185  3922 raft_consensus.cc:2243] T 73a5894bf58143d3a71dabf8231d33ba P d641bfb9187942e9907fe05411aaac98 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.762701  3922 raft_consensus.cc:2272] T 73a5894bf58143d3a71dabf8231d33ba P d641bfb9187942e9907fe05411aaac98 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.764923  3922 tablet_replica.cc:333] T 847b3169447b428ba3af26a55cb0229a P d641bfb9187942e9907fe05411aaac98: stopping tablet replica
I20260709 12:19:11.765516  3922 raft_consensus.cc:2243] T 847b3169447b428ba3af26a55cb0229a P d641bfb9187942e9907fe05411aaac98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.765967  3922 raft_consensus.cc:2272] T 847b3169447b428ba3af26a55cb0229a P d641bfb9187942e9907fe05411aaac98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.768389  3922 tablet_replica.cc:333] T 9e3e70fc532a4fb48fcd5d6696714964 P d641bfb9187942e9907fe05411aaac98: stopping tablet replica
I20260709 12:19:11.768994  3922 raft_consensus.cc:2243] T 9e3e70fc532a4fb48fcd5d6696714964 P d641bfb9187942e9907fe05411aaac98 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:11.769927  3922 raft_consensus.cc:2272] T 9e3e70fc532a4fb48fcd5d6696714964 P d641bfb9187942e9907fe05411aaac98 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.772333  3922 tablet_replica.cc:333] T 04bbf32b02ed450f99f360da0e55cff7 P d641bfb9187942e9907fe05411aaac98: stopping tablet replica
I20260709 12:19:11.772915  3922 raft_consensus.cc:2243] T 04bbf32b02ed450f99f360da0e55cff7 P d641bfb9187942e9907fe05411aaac98 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:11.773808  3922 raft_consensus.cc:2272] T 04bbf32b02ed450f99f360da0e55cff7 P d641bfb9187942e9907fe05411aaac98 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.776095  3922 tablet_replica.cc:333] T f556bc405348447bacc2d6bce606766e P d641bfb9187942e9907fe05411aaac98: stopping tablet replica
I20260709 12:19:11.776750  3922 raft_consensus.cc:2243] T f556bc405348447bacc2d6bce606766e P d641bfb9187942e9907fe05411aaac98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.777230  3922 raft_consensus.cc:2272] T f556bc405348447bacc2d6bce606766e P d641bfb9187942e9907fe05411aaac98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.779542  3922 tablet_replica.cc:333] T a6f975cf54944342ae97c0a5b2bd6d3a P d641bfb9187942e9907fe05411aaac98: stopping tablet replica
I20260709 12:19:11.780126  3922 raft_consensus.cc:2243] T a6f975cf54944342ae97c0a5b2bd6d3a P d641bfb9187942e9907fe05411aaac98 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:11.781061  3922 raft_consensus.cc:2272] T a6f975cf54944342ae97c0a5b2bd6d3a P d641bfb9187942e9907fe05411aaac98 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.783350  3922 tablet_replica.cc:333] T 3c06f7f07974452599bbaebd7f818ca9 P d641bfb9187942e9907fe05411aaac98: stopping tablet replica
I20260709 12:19:11.783929  3922 raft_consensus.cc:2243] T 3c06f7f07974452599bbaebd7f818ca9 P d641bfb9187942e9907fe05411aaac98 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:11.784900  3922 raft_consensus.cc:2272] T 3c06f7f07974452599bbaebd7f818ca9 P d641bfb9187942e9907fe05411aaac98 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.787182  3922 tablet_replica.cc:333] T 18210c7ef7cc4e2f8d96c1a686d66464 P d641bfb9187942e9907fe05411aaac98: stopping tablet replica
I20260709 12:19:11.787716  3922 raft_consensus.cc:2243] T 18210c7ef7cc4e2f8d96c1a686d66464 P d641bfb9187942e9907fe05411aaac98 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.788331  3922 raft_consensus.cc:2272] T 18210c7ef7cc4e2f8d96c1a686d66464 P d641bfb9187942e9907fe05411aaac98 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.790488  3922 tablet_replica.cc:333] T 877e171775ed47c8af9b177b9e7a13fa P d641bfb9187942e9907fe05411aaac98: stopping tablet replica
I20260709 12:19:11.791043  3922 raft_consensus.cc:2243] T 877e171775ed47c8af9b177b9e7a13fa P d641bfb9187942e9907fe05411aaac98 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:11.792009  3922 raft_consensus.cc:2272] T 877e171775ed47c8af9b177b9e7a13fa P d641bfb9187942e9907fe05411aaac98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.794356  3922 tablet_replica.cc:333] T aababa64926d4ed2a9c906dbae553e1f P d641bfb9187942e9907fe05411aaac98: stopping tablet replica
I20260709 12:19:11.794911  3922 raft_consensus.cc:2243] T aababa64926d4ed2a9c906dbae553e1f P d641bfb9187942e9907fe05411aaac98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.795428  3922 raft_consensus.cc:2272] T aababa64926d4ed2a9c906dbae553e1f P d641bfb9187942e9907fe05411aaac98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.797794  3922 tablet_replica.cc:333] T 3b08a6f7d06940f395425d7fef9f0977 P d641bfb9187942e9907fe05411aaac98: stopping tablet replica
I20260709 12:19:11.798444  3922 raft_consensus.cc:2243] T 3b08a6f7d06940f395425d7fef9f0977 P d641bfb9187942e9907fe05411aaac98 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.798967  3922 raft_consensus.cc:2272] T 3b08a6f7d06940f395425d7fef9f0977 P d641bfb9187942e9907fe05411aaac98 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.801721  3922 tablet_replica.cc:333] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P d641bfb9187942e9907fe05411aaac98: stopping tablet replica
I20260709 12:19:11.802385  3922 raft_consensus.cc:2243] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P d641bfb9187942e9907fe05411aaac98 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.802981  3922 raft_consensus.cc:2272] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P d641bfb9187942e9907fe05411aaac98 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.805174  3922 tablet_replica.cc:333] T d821b440bbe34471b1ffd70da3afe069 P d641bfb9187942e9907fe05411aaac98: stopping tablet replica
I20260709 12:19:11.805755  3922 raft_consensus.cc:2243] T d821b440bbe34471b1ffd70da3afe069 P d641bfb9187942e9907fe05411aaac98 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:11.806738  3922 raft_consensus.cc:2272] T d821b440bbe34471b1ffd70da3afe069 P d641bfb9187942e9907fe05411aaac98 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:11.841065 16933 consensus_peers.cc:597] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 631194f763324d39a224b5728199751f -> Peer 5b0ce9a34e224f65aee2d205dd874ba2 (127.3.212.129:45979): Couldn't send request to peer 5b0ce9a34e224f65aee2d205dd874ba2. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.129:45979: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:11.847810 16933 consensus_peers.cc:597] T 18210c7ef7cc4e2f8d96c1a686d66464 P 631194f763324d39a224b5728199751f -> Peer d641bfb9187942e9907fe05411aaac98 (127.3.212.130:44221): Couldn't send request to peer d641bfb9187942e9907fe05411aaac98. Status: Network error: Client connection negotiation failed: client connection to 127.3.212.130:44221: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:11.850158  3922 tablet_server.cc:196] TabletServer@127.3.212.130:0 shutdown complete.
I20260709 12:19:11.888049  3922 tablet_server.cc:179] TabletServer@127.3.212.131:0 shutting down...
I20260709 12:19:11.917915  3922 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:19:11.918620  3922 tablet_replica.cc:333] T 73a5894bf58143d3a71dabf8231d33ba P 631194f763324d39a224b5728199751f: stopping tablet replica
I20260709 12:19:11.919458  3922 raft_consensus.cc:2243] T 73a5894bf58143d3a71dabf8231d33ba P 631194f763324d39a224b5728199751f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.920066  3922 raft_consensus.cc:2272] T 73a5894bf58143d3a71dabf8231d33ba P 631194f763324d39a224b5728199751f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.922605  3922 tablet_replica.cc:333] T 0f2665342de64990947409a4e83aa0a2 P 631194f763324d39a224b5728199751f: stopping tablet replica
I20260709 12:19:11.923231  3922 raft_consensus.cc:2243] T 0f2665342de64990947409a4e83aa0a2 P 631194f763324d39a224b5728199751f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.923729  3922 raft_consensus.cc:2272] T 0f2665342de64990947409a4e83aa0a2 P 631194f763324d39a224b5728199751f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.926038  3922 tablet_replica.cc:333] T 8affc906415f4b3aa5ed3e9a971f9aec P 631194f763324d39a224b5728199751f: stopping tablet replica
I20260709 12:19:11.926651  3922 raft_consensus.cc:2243] T 8affc906415f4b3aa5ed3e9a971f9aec P 631194f763324d39a224b5728199751f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.927163  3922 raft_consensus.cc:2272] T 8affc906415f4b3aa5ed3e9a971f9aec P 631194f763324d39a224b5728199751f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.929422  3922 tablet_replica.cc:333] T 86e15b6028704208a711b8069cba2929 P 631194f763324d39a224b5728199751f: stopping tablet replica
I20260709 12:19:11.930053  3922 raft_consensus.cc:2243] T 86e15b6028704208a711b8069cba2929 P 631194f763324d39a224b5728199751f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.930567  3922 raft_consensus.cc:2272] T 86e15b6028704208a711b8069cba2929 P 631194f763324d39a224b5728199751f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.933202  3922 tablet_replica.cc:333] T 5fabedcf8a28457fab071f75fe106037 P 631194f763324d39a224b5728199751f: stopping tablet replica
I20260709 12:19:11.933920  3922 raft_consensus.cc:2243] T 5fabedcf8a28457fab071f75fe106037 P 631194f763324d39a224b5728199751f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.934624  3922 raft_consensus.cc:2272] T 5fabedcf8a28457fab071f75fe106037 P 631194f763324d39a224b5728199751f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.937636  3922 tablet_replica.cc:333] T 9caa951d90c54e5086bc8d886ba6c450 P 631194f763324d39a224b5728199751f: stopping tablet replica
I20260709 12:19:11.938251  3922 raft_consensus.cc:2243] T 9caa951d90c54e5086bc8d886ba6c450 P 631194f763324d39a224b5728199751f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:11.939200  3922 raft_consensus.cc:2272] T 9caa951d90c54e5086bc8d886ba6c450 P 631194f763324d39a224b5728199751f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.941751  3922 tablet_replica.cc:333] T 877e171775ed47c8af9b177b9e7a13fa P 631194f763324d39a224b5728199751f: stopping tablet replica
I20260709 12:19:11.942335  3922 raft_consensus.cc:2243] T 877e171775ed47c8af9b177b9e7a13fa P 631194f763324d39a224b5728199751f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.942914  3922 raft_consensus.cc:2272] T 877e171775ed47c8af9b177b9e7a13fa P 631194f763324d39a224b5728199751f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.945348  3922 tablet_replica.cc:333] T aababa64926d4ed2a9c906dbae553e1f P 631194f763324d39a224b5728199751f: stopping tablet replica
I20260709 12:19:11.945967  3922 raft_consensus.cc:2243] T aababa64926d4ed2a9c906dbae553e1f P 631194f763324d39a224b5728199751f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.946420  3922 raft_consensus.cc:2272] T aababa64926d4ed2a9c906dbae553e1f P 631194f763324d39a224b5728199751f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.948880  3922 tablet_replica.cc:333] T 3b08a6f7d06940f395425d7fef9f0977 P 631194f763324d39a224b5728199751f: stopping tablet replica
I20260709 12:19:11.949508  3922 raft_consensus.cc:2243] T 3b08a6f7d06940f395425d7fef9f0977 P 631194f763324d39a224b5728199751f [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:19:11.950438  3922 raft_consensus.cc:2272] T 3b08a6f7d06940f395425d7fef9f0977 P 631194f763324d39a224b5728199751f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.952944  3922 tablet_replica.cc:333] T 3c06f7f07974452599bbaebd7f818ca9 P 631194f763324d39a224b5728199751f: stopping tablet replica
I20260709 12:19:11.953558  3922 raft_consensus.cc:2243] T 3c06f7f07974452599bbaebd7f818ca9 P 631194f763324d39a224b5728199751f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.954119  3922 raft_consensus.cc:2272] T 3c06f7f07974452599bbaebd7f818ca9 P 631194f763324d39a224b5728199751f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.956653  3922 tablet_replica.cc:333] T 18210c7ef7cc4e2f8d96c1a686d66464 P 631194f763324d39a224b5728199751f: stopping tablet replica
I20260709 12:19:11.957230  3922 raft_consensus.cc:2243] T 18210c7ef7cc4e2f8d96c1a686d66464 P 631194f763324d39a224b5728199751f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:11.958151  3922 raft_consensus.cc:2272] T 18210c7ef7cc4e2f8d96c1a686d66464 P 631194f763324d39a224b5728199751f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.960283  3922 tablet_replica.cc:333] T d821b440bbe34471b1ffd70da3afe069 P 631194f763324d39a224b5728199751f: stopping tablet replica
I20260709 12:19:11.960824  3922 raft_consensus.cc:2243] T d821b440bbe34471b1ffd70da3afe069 P 631194f763324d39a224b5728199751f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.961283  3922 raft_consensus.cc:2272] T d821b440bbe34471b1ffd70da3afe069 P 631194f763324d39a224b5728199751f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.963402  3922 tablet_replica.cc:333] T 9e3e70fc532a4fb48fcd5d6696714964 P 631194f763324d39a224b5728199751f: stopping tablet replica
I20260709 12:19:11.963908  3922 raft_consensus.cc:2243] T 9e3e70fc532a4fb48fcd5d6696714964 P 631194f763324d39a224b5728199751f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.964371  3922 raft_consensus.cc:2272] T 9e3e70fc532a4fb48fcd5d6696714964 P 631194f763324d39a224b5728199751f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.966723  3922 tablet_replica.cc:333] T 04bbf32b02ed450f99f360da0e55cff7 P 631194f763324d39a224b5728199751f: stopping tablet replica
I20260709 12:19:11.967262  3922 raft_consensus.cc:2243] T 04bbf32b02ed450f99f360da0e55cff7 P 631194f763324d39a224b5728199751f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.967749  3922 raft_consensus.cc:2272] T 04bbf32b02ed450f99f360da0e55cff7 P 631194f763324d39a224b5728199751f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.969810  3922 tablet_replica.cc:333] T f556bc405348447bacc2d6bce606766e P 631194f763324d39a224b5728199751f: stopping tablet replica
I20260709 12:19:11.970333  3922 raft_consensus.cc:2243] T f556bc405348447bacc2d6bce606766e P 631194f763324d39a224b5728199751f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.970748  3922 raft_consensus.cc:2272] T f556bc405348447bacc2d6bce606766e P 631194f763324d39a224b5728199751f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.973012  3922 tablet_replica.cc:333] T a6f975cf54944342ae97c0a5b2bd6d3a P 631194f763324d39a224b5728199751f: stopping tablet replica
I20260709 12:19:11.973574  3922 raft_consensus.cc:2243] T a6f975cf54944342ae97c0a5b2bd6d3a P 631194f763324d39a224b5728199751f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.974064  3922 raft_consensus.cc:2272] T a6f975cf54944342ae97c0a5b2bd6d3a P 631194f763324d39a224b5728199751f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.976557  3922 tablet_replica.cc:333] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 631194f763324d39a224b5728199751f: stopping tablet replica
I20260709 12:19:11.977188  3922 raft_consensus.cc:2243] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 631194f763324d39a224b5728199751f [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:19:11.978030  3922 raft_consensus.cc:2272] T 0408a37e9dc84eb8b74b3d8fc57ffef7 P 631194f763324d39a224b5728199751f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:11.980129  3922 tablet_replica.cc:333] T 847b3169447b428ba3af26a55cb0229a P 631194f763324d39a224b5728199751f: stopping tablet replica
I20260709 12:19:11.980554  3922 raft_consensus.cc:2243] T 847b3169447b428ba3af26a55cb0229a P 631194f763324d39a224b5728199751f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:11.981027  3922 raft_consensus.cc:2272] T 847b3169447b428ba3af26a55cb0229a P 631194f763324d39a224b5728199751f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:12.024152  3922 tablet_server.cc:196] TabletServer@127.3.212.131:0 shutdown complete.
I20260709 12:19:12.063108  3922 master.cc:562] Master@127.3.212.190:43871 shutting down...
I20260709 12:19:12.083958  3922 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 324613a4e3ff41f29c52539c92ead285 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:12.084542  3922 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 324613a4e3ff41f29c52539c92ead285 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:12.084870  3922 tablet_replica.cc:333] T 00000000000000000000000000000000 P 324613a4e3ff41f29c52539c92ead285: stopping tablet replica
I20260709 12:19:12.106381  3922 master.cc:584] Master@127.3.212.190:43871 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (20752 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (48521 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (448225 ms total)
[  PASSED  ] 8 tests.
I20260709 12:19:12.163228  3922 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 2431 messages since previous log ~39 seconds ago
I20260709 12:19:12.163440  3922 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 2435 messages since previous log ~39 seconds ago
I20260709 12:19:12.163579  3922 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 2434 messages since previous log ~39 seconds ago
I20260709 12:19:12.163735  3922 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~56 seconds ago
I20260709 12:19:12.163878  3922 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~56 seconds ago
I20260709 12:19:12.164018  3922 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 2 messages since previous log ~101 seconds ago
I20260709 12:19:12.164232  3922 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 8 messages since previous log ~0 seconds ago
I20260709 12:19:12.164487  3922 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~19 seconds ago
